2024-02-17T11:54:44.876 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-17T11:54:44.876 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143 --owner scheduled_yuriw@teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} -- /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143/orig.config.yaml 2024-02-17T11:54:44.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T11:54:45.009 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143 branch: main description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: yweinste@redhat.com first_in_suite: false job_id: '7563143' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 6822c7b54e949006be7a0802650d01723d834d1d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6822c7b54e949006be7a0802650d01723d834d1d kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 6822c7b54e949006be7a0802650d01723d834d1d owner: scheduled_yuriw@teuthology priority: 51 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 2794 sha1: 6822c7b54e949006be7a0802650d01723d834d1d sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 6822c7b54e949006be7a0802650d01723d834d1d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL6soZ/2M0BMyTZaG5SYv/KkFa4RALmBoVtHAPaRow79sRvEhfmgz33c2kcX1s88HA3Yq1ObhawzKCu2QI7LLUw= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDktHTE9B9MTGoufF2t6x5vPChZAEQ/ahQGXp91POuQtL+bao8eCNm13wDkdquQussIFlKHfFzqTde3pGGysEQM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-16_20:13:25 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-17T11:54:45.009 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa; will attempt to use it 2024-02-17T11:54:45.009 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks 2024-02-17T11:54:45.010 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-17T11:54:45.011 INFO:teuthology.task.internal:Checking packages... 2024-02-17T11:54:45.035 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6822c7b54e949006be7a0802650d01723d834d1d' 2024-02-17T11:54:45.036 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-17T11:54:45.036 INFO:teuthology.packaging:ref: None 2024-02-17T11:54:45.036 INFO:teuthology.packaging:tag: None 2024-02-17T11:54:45.036 INFO:teuthology.packaging:branch: main 2024-02-17T11:54:45.036 INFO:teuthology.packaging:sha1: 6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T11:54:45.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-02-17T11:54:45.254 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1543-g0ed764e6-1jammy 2024-02-17T11:54:45.255 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-17T11:54:45.261 INFO:teuthology.task.internal:no buildpackages task found 2024-02-17T11:54:45.261 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-17T11:54:45.267 INFO:teuthology.task.internal:Saving configuration 2024-02-17T11:54:45.283 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-17T11:54:45.288 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T11:54:45.311 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 11:49:09.162999', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM/yGKsczKS9G2o1fKqAd0Zj3oJz7ZNTzY4dyYND9i1s'} 2024-02-17T11:54:45.331 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 11:49:09.164943', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILYL8sexEMPwb3j/5LOrusSf1Xj5d5K3otUPZGqlBmLB'} 2024-02-17T11:54:45.331 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-17T11:54:45.337 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-02-17T11:54:45.337 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-02-17T11:54:45.337 INFO:teuthology.run_tasks:Running task console_log... 2024-02-17T11:54:45.402 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a72eb2430>, signals=[15]) 2024-02-17T11:54:45.402 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-17T11:54:45.408 INFO:teuthology.task.internal:Opening connections... 2024-02-17T11:54:45.408 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T11:54:45.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:54:45.490 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T11:54:45.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T11:54:45.566 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-17T11:54:45.573 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-02-17T11:54:45.577 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-02-17T11:54:45.578 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-02-17T11:54:45.628 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-17T11:54:45.628 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2024-02-17T11:54:45.628 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="22.04" 2024-02-17T11:54:45.628 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-17T11:54:45.628 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=jammy 2024-02-17T11:54:45.628 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2024-02-17T11:54:45.628 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2024-02-17T11:54:45.628 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-17T11:54:45.629 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-17T11:54:45.629 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-17T11:54:45.629 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-17T11:54:45.629 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=jammy 2024-02-17T11:54:45.629 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-02-17T11:54:45.649 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-02-17T11:54:45.655 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-02-17T11:54:45.655 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-02-17T11:54:45.706 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-17T11:54:45.706 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Ubuntu" 2024-02-17T11:54:45.707 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="22.04" 2024-02-17T11:54:45.707 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-17T11:54:45.707 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_CODENAME=jammy 2024-02-17T11:54:45.707 INFO:teuthology.orchestra.run.smithi116.stdout:ID=ubuntu 2024-02-17T11:54:45.707 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE=debian 2024-02-17T11:54:45.707 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-17T11:54:45.707 INFO:teuthology.orchestra.run.smithi116.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-17T11:54:45.707 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-17T11:54:45.707 INFO:teuthology.orchestra.run.smithi116.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-17T11:54:45.707 INFO:teuthology.orchestra.run.smithi116.stdout:UBUNTU_CODENAME=jammy 2024-02-17T11:54:45.707 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-02-17T11:54:45.732 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-17T11:54:45.741 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-17T11:54:45.746 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-17T11:54:45.746 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-02-17T11:54:45.749 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-02-17T11:54:45.754 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-17T11:54:45.760 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-17T11:54:45.760 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-02-17T11:54:45.793 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-02-17T11:54:45.805 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-17T11:54:45.858 INFO:teuthology.run_tasks:Running task kernel... 2024-02-17T11:54:45.872 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-02-17T11:54:45.872 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-02-17T11:54:45.873 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-02-17T11:54:45.873 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-17T11:54:45.873 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-17T11:54:45.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T11:54:45.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T11:54:45.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-02-17T11:54:45.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-02-17T11:54:46.132 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8d59ab0bd93c806231018a6729893bf309624262 2024-02-17T11:54:46.132 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8d59ab0bd93c806231018a6729893bf309624262"... 2024-02-17T11:54:46.132 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-02-17T11:54:46.138 INFO:teuthology.orchestra.run.smithi116.stdout:5.15.0-56-generic 2024-02-17T11:54:46.138 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8d59ab0bd93c806231018a6729893bf309624262 2024-02-17T11:54:46.138 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-17T11:54:46.139 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-02-17T11:54:46.139 DEBUG:teuthology.orchestra.run.smithi116:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-02-17T11:54:46.145 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8d59ab0bd93c806231018a6729893bf309624262 2024-02-17T11:54:46.145 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8d59ab0bd93c806231018a6729893bf309624262"... 2024-02-17T11:54:46.145 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-02-17T11:54:46.151 INFO:teuthology.orchestra.run.smithi114.stdout:5.15.0-56-generic 2024-02-17T11:54:46.151 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8d59ab0bd93c806231018a6729893bf309624262 2024-02-17T11:54:46.151 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-17T11:54:46.151 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-02-17T11:54:46.151 DEBUG:teuthology.orchestra.run.smithi114:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-02-17T11:54:46.202 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-02-17T11:54:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-02-17T11:54:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-02-17T11:54:46.336 INFO:teuthology.orchestra.run.smithi114.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-02-17T11:54:46.336 INFO:teuthology.orchestra.run.smithi114.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-02-17T11:54:46.336 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 2024-02-17T11:54:46.336 INFO:teuthology.orchestra.run.smithi114.stderr:hint: git config --global init.defaultBranch 2024-02-17T11:54:46.336 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 2024-02-17T11:54:46.336 INFO:teuthology.orchestra.run.smithi114.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-02-17T11:54:46.336 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-02-17T11:54:46.336 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 2024-02-17T11:54:46.336 INFO:teuthology.orchestra.run.smithi114.stderr:hint: git branch -m 2024-02-17T11:54:46.337 INFO:teuthology.orchestra.run.smithi114.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-02-17T11:54:46.338 DEBUG:teuthology.orchestra.run.smithi114:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-02-17T11:54:46.355 INFO:teuthology.orchestra.run.smithi116.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-02-17T11:54:46.355 INFO:teuthology.orchestra.run.smithi116.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-02-17T11:54:46.355 INFO:teuthology.orchestra.run.smithi116.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-02-17T11:54:46.355 INFO:teuthology.orchestra.run.smithi116.stderr:hint: 2024-02-17T11:54:46.355 INFO:teuthology.orchestra.run.smithi116.stderr:hint: git config --global init.defaultBranch 2024-02-17T11:54:46.355 INFO:teuthology.orchestra.run.smithi116.stderr:hint: 2024-02-17T11:54:46.355 INFO:teuthology.orchestra.run.smithi116.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-02-17T11:54:46.355 INFO:teuthology.orchestra.run.smithi116.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-02-17T11:54:46.355 INFO:teuthology.orchestra.run.smithi116.stderr:hint: 2024-02-17T11:54:46.355 INFO:teuthology.orchestra.run.smithi116.stderr:hint: git branch -m 2024-02-17T11:54:46.356 INFO:teuthology.orchestra.run.smithi116.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-02-17T11:54:46.358 DEBUG:teuthology.orchestra.run.smithi116:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-02-17T11:54:46.402 DEBUG:teuthology.orchestra.run.smithi114:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-02-17T11:54:46.423 DEBUG:teuthology.orchestra.run.smithi116:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-02-17T11:54:46.456 DEBUG:teuthology.orchestra.run.smithi114:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-02-17T11:54:46.480 DEBUG:teuthology.orchestra.run.smithi116:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-02-17T11:59:38.957 INFO:teuthology.orchestra.run.smithi116.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-02-17T11:59:38.958 INFO:teuthology.orchestra.run.smithi116.stderr: * [new branch] main -> origin/main 2024-02-17T11:59:38.990 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190312 -> 20190312 2024-02-17T11:59:38.990 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190416 -> 20190416 2024-02-17T11:59:38.990 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190514 -> 20190514 2024-02-17T11:59:38.991 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190618 -> 20190618 2024-02-17T11:59:38.991 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190717 -> 20190717 2024-02-17T11:59:38.992 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190815 -> 20190815 2024-02-17T11:59:38.992 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20190923 -> 20190923 2024-02-17T11:59:38.992 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20191022 -> 20191022 2024-02-17T11:59:38.992 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20191215 -> 20191215 2024-02-17T11:59:38.992 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200122 -> 20200122 2024-02-17T11:59:38.992 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200316 -> 20200316 2024-02-17T11:59:38.992 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200421 -> 20200421 2024-02-17T11:59:38.993 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200519 -> 20200519 2024-02-17T11:59:38.993 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200619 -> 20200619 2024-02-17T11:59:38.993 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200721 -> 20200721 2024-02-17T11:59:38.993 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200817 -> 20200817 2024-02-17T11:59:38.993 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20200918 -> 20200918 2024-02-17T11:59:38.993 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20201022 -> 20201022 2024-02-17T11:59:38.994 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20201118 -> 20201118 2024-02-17T11:59:38.994 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20201218 -> 20201218 2024-02-17T11:59:38.995 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20210208 -> 20210208 2024-02-17T11:59:38.995 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20210315 -> 20210315 2024-02-17T11:59:38.995 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20210511 -> 20210511 2024-02-17T11:59:38.995 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20210716 -> 20210716 2024-02-17T11:59:38.995 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20210818 -> 20210818 2024-02-17T11:59:38.995 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20210919 -> 20210919 2024-02-17T11:59:38.995 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20211027 -> 20211027 2024-02-17T11:59:38.995 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20211216 -> 20211216 2024-02-17T11:59:38.996 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20220209 -> 20220209 2024-02-17T11:59:38.996 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20220310 -> 20220310 2024-02-17T11:59:38.996 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20220411 -> 20220411 2024-02-17T11:59:38.996 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20220509 -> 20220509 2024-02-17T11:59:38.996 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20220610 -> 20220610 2024-02-17T11:59:38.996 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20220708 -> 20220708 2024-02-17T11:59:38.997 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20220815 -> 20220815 2024-02-17T11:59:38.997 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20220913 -> 20220913 2024-02-17T11:59:38.997 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20221012 -> 20221012 2024-02-17T11:59:38.998 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20221109 -> 20221109 2024-02-17T11:59:38.998 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20221214 -> 20221214 2024-02-17T11:59:38.998 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20230117 -> 20230117 2024-02-17T11:59:38.999 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20230210 -> 20230210 2024-02-17T11:59:38.999 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20230310 -> 20230310 2024-02-17T11:59:38.999 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20230404 -> 20230404 2024-02-17T11:59:38.999 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20230515 -> 20230515 2024-02-17T11:59:38.999 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20230625 -> 20230625 2024-02-17T11:59:38.999 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20230804 -> 20230804 2024-02-17T11:59:38.999 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20230919 -> 20230919 2024-02-17T11:59:39.000 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20231030 -> 20231030 2024-02-17T11:59:39.000 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20231111 -> 20231111 2024-02-17T11:59:39.000 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20231211 -> 20231211 2024-02-17T11:59:39.000 INFO:teuthology.orchestra.run.smithi116.stderr: * [new tag] 20240115 -> 20240115 2024-02-17T11:59:43.069 INFO:teuthology.orchestra.run.smithi116.stderr:Updating files: 51% (1844/3554) Updating files: 52% (1849/3554) Updating files: 53% (1884/3554) Updating files: 54% (1920/3554) Updating files: 55% (1955/3554) Updating files: 56% (1991/3554) Updating files: 57% (2026/3554) Updating files: 58% (2062/3554) Updating files: 59% (2097/3554) Updating files: 60% (2133/3554) Updating files: 61% (2168/3554) Updating files: 62% (2204/3554) Updating files: 63% (2240/3554) Updating files: 64% (2275/3554) Updating files: 65% (2311/3554) Updating files: 65% (2345/3554) Updating files: 66% (2346/3554) Updating files: 67% (2382/3554) Updating files: 68% (2417/3554) Updating files: 69% (2453/3554) Updating files: 70% (2488/3554) Updating files: 71% (2524/3554) Updating files: 72% (2559/3554) Updating files: 73% (2595/3554) Updating files: 74% (2630/3554) Updating files: 75% (2666/3554) Updating files: 76% (2702/3554) Updating files: 77% (2737/3554) Updating files: 78% (2773/3554) Updating files: 79% (2808/3554) Updating files: 80% (2844/3554) Updating files: 81% (2879/3554) Updating files: 81% (2909/3554) Updating files: 82% (2915/3554) Updating files: 83% (2950/3554) Updating files: 84% (2986/3554) Updating files: 85% (3021/3554) Updating files: 86% (3057/3554) Updating files: 87% (3092/3554) Updating files: 88% (3128/3554) Updating files: 89% (3164/3554) Updating files: 90% (3199/3554) Updating files: 91% (3235/3554) Updating files: 92% (3270/3554) Updating files: 93% (3306/3554) Updating files: 94% (3341/3554) Updating files: 95% (3377/3554) Updating files: 96% (3412/3554) Updating files: 96% (3436/3554) Updating files: 97% (3448/3554) Updating files: 98% (3483/3554) Updating files: 99% (3519/3554) Updating files: 100% (3554/3554) Updating files: 100% (3554/3554), done. 2024-02-17T11:59:43.074 INFO:teuthology.orchestra.run.smithi116.stdout:HEAD is now at fbef4d38 Merge branch 'main' into 'main' 2024-02-17T11:59:43.095 INFO:teuthology.task.kernel:Downloading kernel 8d59ab0bd93c806231018a6729893bf309624262 on client.1... 2024-02-17T11:59:43.096 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8d59ab0bd93c806231018a6729893bf309624262 2024-02-17T11:59:43.313 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc4-g8d59ab0bd93c/ 2024-02-17T11:59:43.313 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-rc4-g8d59ab0bd93c_6.8.0-rc4-g8d59ab0bd93c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc4-g8d59ab0bd93c/ --input-file=- 2024-02-17T11:59:43.316 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi116.front.sepia.ceph.com to complete... 2024-02-17T11:59:45.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17 11:59:45 URL:https://3.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc4-g8d59ab0bd93c/linux-image-6.8.0-rc4-g8d59ab0bd93c_6.8.0-rc4-g8d59ab0bd93c-1_amd64.deb [39240030/39240030] -> "/tmp/linux-image.deb" [1] 2024-02-17T11:59:45.124 INFO:teuthology.orchestra.run.smithi116.stderr:FINISHED --2024-02-17 11:59:45-- 2024-02-17T11:59:45.124 INFO:teuthology.orchestra.run.smithi116.stderr:Total wall clock time: 1.8s 2024-02-17T11:59:45.124 INFO:teuthology.orchestra.run.smithi116.stderr:Downloaded: 1 files, 37M in 1.7s (22.6 MB/s) 2024-02-17T11:59:45.128 INFO:teuthology.task.kernel:Installing kernel 8d59ab0bd93c806231018a6729893bf309624262 on client.1... 2024-02-17T11:59:45.128 DEBUG:teuthology.orchestra.run.smithi116:> sudo dpkg -i /tmp/linux-image.deb 2024-02-17T11:59:45.355 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-image-6.8.0-rc4-g8d59ab0bd93c. 2024-02-17T11:59:47.293 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-02-17T11:59:47.297 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-02-17T11:59:47.418 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-image-6.8.0-rc4-g8d59ab0bd93c (6.8.0-rc4-g8d59ab0bd93c-1) ... 2024-02-17T11:59:50.729 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-image-6.8.0-rc4-g8d59ab0bd93c (6.8.0-rc4-g8d59ab0bd93c-1) ... 2024-02-17T11:59:50.857 INFO:teuthology.orchestra.run.smithi116.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:10.990 INFO:teuthology.orchestra.run.smithi116.stderr:Sourcing file `/etc/default/grub' 2024-02-17T12:00:11.006 INFO:teuthology.orchestra.run.smithi116.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-17T12:00:11.031 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-02-17T12:00:11.321 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:11.334 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:11.618 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-17T12:00:11.630 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-17T12:00:11.694 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-17T12:00:11.699 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-17T12:00:11.841 INFO:teuthology.orchestra.run.smithi116.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-17T12:00:11.841 INFO:teuthology.orchestra.run.smithi116.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-17T12:00:11.841 INFO:teuthology.orchestra.run.smithi116.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-17T12:00:11.887 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-02-17T12:00:12.076 DEBUG:teuthology.orchestra.run.smithi116:> dpkg-deb -c /tmp/linux-image.deb 2024-02-17T12:00:12.084 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./ 2024-02-17T12:00:12.084 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./boot/ 2024-02-17T12:00:12.084 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 4469316 2024-02-13 10:58 ./boot/System.map-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:12.097 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 170841 2024-02-13 10:58 ./boot/config-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:12.140 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11527168 2024-02-13 10:58 ./boot/vmlinuz-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:12.221 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/ 2024-02-17T12:00:12.221 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/kernel/ 2024-02-17T12:00:12.221 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/kernel/postinst.d/ 2024-02-17T12:00:12.221 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/kernel/postrm.d/ 2024-02-17T12:00:12.221 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/kernel/preinst.d/ 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/kernel/prerm.d/ 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/ 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/ 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/ 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/ 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/ 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/ 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/ 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 490449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/aesni-intel.ko 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-17T12:00:12.222 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 93081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 106697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 152145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 83857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 58489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-17T12:00:12.223 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/ 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/ 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/mce/ 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpuid.ko 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/msr.ko 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/ 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 354001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-17T12:00:12.224 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 885905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 2294545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm.ko 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 53841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/af_alg.ko 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/algif_hash.ko 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/algif_skcipher.ko 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ansi_cprng.ko 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/anubis.ko 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/arc4.ko 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/asymmetric_keys/ 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/ 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_memcpy.ko 2024-02-17T12:00:12.225 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_pq.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_tx.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_xor.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/raid6test.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/authenc.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/authencesn.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blake2b_generic.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blowfish_common.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blowfish_generic.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/camellia_generic.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast5_generic.ko 2024-02-17T12:00:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast6_generic.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast_common.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ccm.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cmac.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crc32_generic.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cryptd.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_engine.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_simd.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_user.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cts.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/des_generic.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/dh_generic.ko 2024-02-17T12:00:12.227 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/echainiv.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/essiv.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/fcrypt.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/khazad.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lrw.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lz4.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lz4hc.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/md4.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/michael_mic.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/pcbc.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/pcrypt.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/rmd160.ko 2024-02-17T12:00:12.228 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/seed.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/serpent_generic.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 143033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/tcrypt.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/tea.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/twofish_common.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/twofish_generic.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/vmac.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/wp512.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xcbc.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xor.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xts.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xxhash_generic.ko 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ 2024-02-17T12:00:12.229 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/ 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_extlog.ko 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_pad.ko 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/apei/ 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/apei/einj.ko 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/ec_sys.ko 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/platform_profile.ko 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/sbs.ko 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/sbshc.ko 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 104433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/video.ko 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/acard-ahci.ko 2024-02-17T12:00:12.230 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 89825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ahci.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ahci_platform.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 88313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/libahci.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/libahci_platform.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_acpi.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ali.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_amd.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_artop.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_atiixp.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_atp867x.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cmd640.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cmd64x.ko 2024-02-17T12:00:12.231 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cypress.ko 2024-02-17T12:00:12.232 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_efar.ko 2024-02-17T12:00:12.232 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt366.ko 2024-02-17T12:00:12.232 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt37x.ko 2024-02-17T12:00:12.232 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-17T12:00:12.232 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-17T12:00:12.232 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_it8213.ko 2024-02-17T12:00:12.232 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_it821x.ko 2024-02-17T12:00:12.232 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_jmicron.ko 2024-02-17T12:00:12.234 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 52177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_legacy.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_marvell.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_mpiix.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_netcell.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ninja32.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ns87410.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ns87415.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_oldpiix.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_opti.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_optidma.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pcmcia.ko 2024-02-17T12:00:12.235 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 37697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_piccolo.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_radisys.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_rdc.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_rz1000.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sch.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_serverworks.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sil680.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sl82c105.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_triflex.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_via.ko 2024-02-17T12:00:12.236 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pdc_adma.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_inic162x.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 83257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_mv.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 70305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_nv.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 37281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_promise.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_qstor.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sil.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sil24.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sis.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_svw.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sx4.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_uli.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_via.ko 2024-02-17T12:00:12.237 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_vsc.ko 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/auxdisplay/ 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/auxdisplay/ks0108.ko 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/bcma/ 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 124457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/bcma/bcma.ko 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/ 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/aoe/ 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 113833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/aoe/aoe.ko 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/drbd/ 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 964817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/drbd/drbd.ko 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 169705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/floppy.ko 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/mtip32xx/ 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 94217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 116401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/nbd.ko 2024-02-17T12:00:12.238 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/null_blk/ 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 110329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/null_blk/null_blk.ko 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 98193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/pktcdvd.ko 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 263641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/rbd.ko 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkback/ 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 98121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/zram/ 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 58777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/zram/zram.ko 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/applicom.ko 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hangcheck-timer.ko 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/ 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-17T12:00:12.239 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/via-rng.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 148521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 139361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 70873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 53417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/lp.ko 2024-02-17T12:00:12.240 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/mwave/ 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 84025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/mwave/mwave.ko 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/nvram.ko 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ppdev.ko 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tlclk.ko 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/ 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-17T12:00:12.241 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/xillybus/ 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/xillybus/xillybus_class.ko 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/xillybus/xillybus_core.ko 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/clk/ 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/clk/clk-palmas.ko 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/clk/clk-si5351.ko 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/clk/clk-twl6040.ko 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/clk/clk-wm831x.ko 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/ 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-17T12:00:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 70473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 246841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ccp.ko 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/ 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/ 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_common/ 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 570497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/padlock-aes.ko 2024-02-17T12:00:12.243 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/padlock-sha.ko 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/virtio/ 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 70433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dca/ 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dca/dca.ko 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/dw/ 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ioat/ 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 122817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/ 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 80305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/amd64_edac.ko 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/e752x_edac.ko 2024-02-17T12:00:12.244 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/edac_mce_amd.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i3000_edac.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i3200_edac.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i5100_edac.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i5400_edac.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i7300_edac.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i7core_edac.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i82975x_edac.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/ie31200_edac.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 56737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/sb_edac.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/x38_edac.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/ 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-gpio.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-max14577.ko 2024-02-17T12:00:12.245 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-max77693.ko 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-max8997.ko 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-palmas.ko 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-rt8973a.ko 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-sm5502.ko 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/ 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/dmi-sysfs.ko 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/efi/ 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/efi/efi-pstore.ko 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/ 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-adp5520.ko 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-amd8111.ko 2024-02-17T12:00:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-arizona.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-da9052.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-da9055.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-dln2.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 77753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-f7188x.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-generic.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-ich.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-kempld.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-lp3943.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-max7300.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-max730x.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-max732x.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-02-17T12:00:12.247 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-pca953x.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-pcf857x.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-rdc321x.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-sch.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-sch311x.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-tps65912.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-twl4030.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-twl6040.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-vx855.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-wm831x.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-wm8350.ko 2024-02-17T12:00:12.248 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-wm8994.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/ 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-a4tech.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-apple.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-appleir.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-aureal.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-axff.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-belkin.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-cherry.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-chicony.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 60665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-cp2112.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-cypress.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-dr.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-elecom.ko 2024-02-17T12:00:12.249 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-elo.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-emsff.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-ezkey.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gaff.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-generic.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gt683r.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gyration.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtekff.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-hyperv.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-icade.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-kensington.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-keytouch.ko 2024-02-17T12:00:12.250 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-kye.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lcpower.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-led.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lenovo.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lg-g15.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 57977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 100657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 80921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-magicmouse.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-microsoft.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-monterey.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-multitouch.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-ntrig.ko 2024-02-17T12:00:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-ortek.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-penmount.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-petalynx.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 72865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-picolcd.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-pl.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-plantronics.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-primax.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-rmi.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-common.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-17T12:00:12.252 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-saitek.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-samsung.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sjoy.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sony.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-speedlink.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-steelseries.ko 2024-02-17T12:00:12.253 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sunplus.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-tivo.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-tmff.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-topseed.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-twinhan.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 70993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-uclogic.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-waltop.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 143393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-wiimote.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-xinmo.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-zpff.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-zydacron.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 269233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid.ko 2024-02-17T12:00:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/uhid.ko 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/usbhid/ 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 125641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/usbhid/usbhid.ko 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/usbhid/usbkbd.ko 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/usbhid/usbmouse.ko 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 218817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/wacom.ko 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/ 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 64305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_balloon.ko 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 89553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_utils.ko 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 305425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_vmbus.ko 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 66801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/abituguru.ko 2024-02-17T12:00:12.255 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 61817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/abituguru3.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ad7414.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ad7418.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adc128d818.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1025.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 97889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1026.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1029.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 45465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1031.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm9240.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ads7828.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7410.ko 2024-02-17T12:00:12.256 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7411.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 74321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7462.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7470.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 69313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7475.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7x10.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/amc6821.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 55177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/applesmc.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asb100.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 58529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asc7621.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 40793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/atxp1.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/coretemp.ko 2024-02-17T12:00:12.257 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/da9052-hwmon.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/da9055-hwmon.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 99513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/dme1737.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ds1621.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ds620.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc1403.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc2103.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc6w201.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 66897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f71805f.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 94601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f71882fg.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f75375s.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/fam15h_power.ko 2024-02-17T12:00:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 55361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/fschmd.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/g760a.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/g762.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 46713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/gl518sm.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 45441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/gl520sm.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/hih6130.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/i5500_temp.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/i5k_amb.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ibmaem.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ibmpex.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ina209.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ina2xx.ko 2024-02-17T12:00:12.259 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 140137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/it87.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/jc42.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/k10temp.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/k8temp.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lineage-pem.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 48513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm63.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm73.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm75.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm77.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm78.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm80.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm83.ko 2024-02-17T12:00:12.260 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 72745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm85.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 46065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm87.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 37825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm90.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm92.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 108753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm93.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95234.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95241.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95245.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc2945.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4151.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4215.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4222.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4245.ko 2024-02-17T12:00:12.261 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4260.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4261.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max16065.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max1619.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max1668.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max197.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6639.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6650.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6697.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/mc13783-adc.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/mcp3021.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-02-17T12:00:12.262 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6683.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 119721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6775-core.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 61441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6775.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 59649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct7802.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 82721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pc87360.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 54345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pc87427.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pcf8591.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-17T12:00:12.263 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 82481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/powr1220.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch5627.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch5636.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sht15.ko 2024-02-17T12:00:12.264 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sht21.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/shtc1.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 40489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sis5595.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47b397.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 40361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47m1.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 37289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47m192.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/thmc50.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp102.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp103.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp401.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp421.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/via-cputemp.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 43449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/via686a.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 52369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/vt1211.ko 2024-02-17T12:00:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 53209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/vt8231.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 58265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83627ehf.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 79841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83627hf.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 71257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83781d.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 63201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83791d.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 71233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83792d.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 101385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83793.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 119417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83795.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83l785ts.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83l786ng.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/ 2024-02-17T12:00:12.266 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/ 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/ 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-17T12:00:12.267 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 67417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-02-17T12:00:12.268 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-17T12:00:12.269 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-mux.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-smbus.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-stub.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/muxes/ 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-02-17T12:00:12.270 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 273529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 883945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_core.ko 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 69185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 324337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 97841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 282345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 66057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/ 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/cxgb4/ 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 493177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-17T12:00:12.271 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx4/ 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 420593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx5/ 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 741673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mthca/ 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 296881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/ocrdma/ 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 153729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/usnic/ 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 169145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ipoib/ 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 266577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-17T12:00:12.272 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/iser/ 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 100281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/isert/ 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 111337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srp/ 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 128665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srpt/ 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 129553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/ 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/evbug.ko 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/ff-memless.ko 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/ 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-17T12:00:12.273 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/gameport.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/joydev.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/ 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 37281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/lkkbd.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/lm8323.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/lm8333.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-02-17T12:00:12.274 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/newtonkbd.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/qt1070.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/qt2160.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/stowaway.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/sunkbd.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-02-17T12:00:12.275 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/xtkbd.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/matrix-keymap.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/ 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/appletouch.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/bcm5974.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 123201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/cyapatp.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 89393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/gpio_mouse.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 335921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/psmouse.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/sermouse.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-17T12:00:12.276 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/rmi4/ 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 109601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/ 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/altera_ps2.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/arc_ps2.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/ct82c710.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/parkbd.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/pcips2.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/ps2mult.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/serio_raw.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/serport.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/sparse-keymap.ko 2024-02-17T12:00:12.277 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/ 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-88pm860x.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-adp5520.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 59657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-bd2802.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-blinkm.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-da903x.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-da9052.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-gpio.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm3530.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm3533.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm355x.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm3642.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lp3944.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lp8788.ko 2024-02-17T12:00:12.278 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-max8997.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-mc13783.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-menf21bmc.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-pca9532.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-pca955x.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-pca963x.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-ss4200.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-tca6507.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-wm831x-status.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-wm8350.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-17T12:00:12.279 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/ 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/bcache/ 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 647121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/bcache/bcache.ko 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 40489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-bio-prison.ko 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 93321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-bufio.ko 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-cache-smq.ko 2024-02-17T12:00:12.280 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 155825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-cache.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 105473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-crypt.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-delay.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 53769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-era.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-flakey.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-log-userspace.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-log.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-mirror.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 77881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-multipath.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-queue-length.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 70985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-raid.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-region-hash.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-round-robin.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-service-time.ko 2024-02-17T12:00:12.281 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 109521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-snapshot.ko 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-switch.ko 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 181777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-thin-pool.ko 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-verity.ko 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-zero.ko 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/persistent-data/ 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 199881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 37321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid0.ko 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 100841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid1.ko 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 126761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid10.ko 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 369433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid456.ko 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/ 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/ 2024-02-17T12:00:12.282 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 178049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptbase.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 63241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptctl.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 46249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptfc.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 37121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptlan.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 123233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptsas.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 80985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptscsih.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 52929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptspi.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/ 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/88pm800.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/88pm805.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/88pm80x.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/arizona-i2c.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 123649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/arizona.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/bcm590xx.ko 2024-02-17T12:00:12.283 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/cros_ec_dev.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/dln2.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/janz-cmodio.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 53489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/kempld-core.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lm3533-core.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lp3943.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 56969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lpc_ich.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lpc_sch.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/max8907.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/mc13xxx-core.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-02-17T12:00:12.284 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/menf21bmc.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/pcf50633-adc.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/pcf50633-gpio.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/pcf50633.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/retu-mfd.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 80345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/si476x-core.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 48369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/sm501.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/tps65010.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/tps6507x.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/viperboard.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/vx855.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/wl1273-core.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/wm8994.ko 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ 2024-02-17T12:00:12.285 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 48393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ad525x_dpot.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/altera-stapl/ 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 46513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/apds9802als.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/apds990x.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 45497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/bh1770glc.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/c2port/ 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/c2port/core.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/cb710/ 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/cb710/cb710.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ds1682.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/dummy-irq.ko 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/echo/ 2024-02-17T12:00:12.286 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/echo/echo.ko 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/ 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/at24.ko 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/max6875.ko 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/enclosure.ko 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/genwqe/ 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 152073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/hmc6352.ko 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/hpilo.ko 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ibmasm/ 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 72561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ics932s401.ko 2024-02-17T12:00:12.287 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/isl29003.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/isl29020.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/ 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/ 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 125865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei-me.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 56377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei-txe.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 313601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/phantom.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ti-st/ 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 74305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ti-st/st_drv.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tifm_7xx1.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tifm_core.ko 2024-02-17T12:00:12.288 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tsl2550.ko 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 48345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_balloon.ko 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_vmci/ 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 183569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/bonding/ 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 491721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/bonding/bonding.ko 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/ 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/b53/ 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 105937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 40225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6xxx/ 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 459065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-17T12:00:12.289 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dummy.ko 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/eql.ko 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/ 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 45961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 130665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 68785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/ 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 64617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 101681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/adaptec/ 2024-02-17T12:00:12.290 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 54625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/agere/ 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 69169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/alteon/ 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 59993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/altera/ 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/ 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 54617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 87457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/ 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/alx/ 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 97201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-17T12:00:12.291 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 102497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 90209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/ 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 81321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 69545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/ 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 78385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 176697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1434505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 128433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/genet/ 2024-02-17T12:00:12.292 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 131281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 314329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/ 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/bna/ 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 323737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/ 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 193593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 347217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1045449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 166145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-17T12:00:12.293 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/ 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/enic/ 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 204249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/ 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/ 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 69433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 61425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 141201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 62833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/ 2024-02-17T12:00:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 60673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 62833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 45489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dnet.ko 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ec_bhf.ko 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/ 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/benet/ 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 281217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ethoc.ko 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/fealnx.ko 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/fujitsu/ 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 45553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 90305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000/ 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 295697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-17T12:00:12.295 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000e/ 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 584353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/fm10k/ 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 246041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/i40e/ 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 944865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/iavf/ 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 288529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igb/ 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 513857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igbvf/ 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 93489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-02-17T12:00:12.296 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 734729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 151745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 86993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/jme.ko 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/ 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 102441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 122609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/ 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 727481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 278881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-02-17T12:00:12.297 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1121769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 52985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 40881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 95577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/ 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 108409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/ 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 73617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/neterion/ 2024-02-17T12:00:12.298 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 151097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/nvidia/ 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 136801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/ 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/ 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 227865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 87017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-02-17T12:00:12.299 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 672057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-17T12:00:12.410 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rdc/ 2024-02-17T12:00:12.410 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-17T12:00:12.410 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/ 2024-02-17T12:00:12.410 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 67281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-17T12:00:12.410 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 83809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-17T12:00:12.410 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-17T12:00:12.410 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 194073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-17T12:00:12.410 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/samsung/ 2024-02-17T12:00:12.410 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-02-17T12:00:12.410 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 104049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sfc/ 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1067001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/silan/ 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/ 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 54729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 63201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/ 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 61425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 67297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 73257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 68049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-17T12:00:12.411 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/ 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 497201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/ 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 103185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 166049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 66273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 78721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/tehuti/ 2024-02-17T12:00:12.412 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ti/ 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 92345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/ 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 80001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 83721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/ 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 46313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/xircom/ 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 59921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/fddi/ 2024-02-17T12:00:12.413 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/fddi/defxx.ko 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/fddi/skfp/ 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 217065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/fddi/skfp/skfp.ko 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 74729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/geneve.ko 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/hyperv/ 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 237265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ieee802154/ 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ifb.ko 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ipvlan/ 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 85857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 62897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/macvlan.ko 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/macvtap.ko 2024-02-17T12:00:12.414 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/ 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-gpio.ko 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio.ko 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mii.ko 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 45057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/netconsole.ko 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/nlmon.ko 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/ 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/ 2024-02-17T12:00:12.415 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/amd.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm87xx.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/broadcom.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/cicada.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/davicom.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/et1011c.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/icplus.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/lxt.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 81961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/marvell.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 76569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/micrel.ko 2024-02-17T12:00:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/national.ko 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 99009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/phylink.ko 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/qsemi.ko 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/realtek.ko 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/smsc.ko 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/ste10Xp.ko 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/vitesse.ko 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/plip/ 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 43721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/plip/plip.ko 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_async.ko 2024-02-17T12:00:12.417 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pppoe.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pppox.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pptp.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/sb1000.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip/ 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip/slip.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/sungem_phy.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 64625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/tap.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/ 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 107233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-17T12:00:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-17T12:00:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-17T12:00:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_random.ko 2024-02-17T12:00:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-17T12:00:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 87105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/veth.ko 2024-02-17T12:00:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vmxnet3/ 2024-02-17T12:00:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 144361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-17T12:00:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vxlan/ 2024-02-17T12:00:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 307257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vxlan/vxlan.ko 2024-02-17T12:00:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netback/ 2024-02-17T12:00:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 143905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-17T12:00:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ntb/ 2024-02-17T12:00:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ntb/ntb.ko 2024-02-17T12:00:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/ 2024-02-17T12:00:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/ 2024-02-17T12:00:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 267745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/nvme-core.ko 2024-02-17T12:00:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 103361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/nvme.ko 2024-02-17T12:00:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/ 2024-02-17T12:00:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 131329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport.ko 2024-02-17T12:00:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_cs.ko 2024-02-17T12:00:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 85217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_pc.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_serial.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/ 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/ 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/pci-stub.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 46433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/xen-pcifront.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/ 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/i82092.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 146153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pcmcia.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 62081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pcmcia_core.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-02-17T12:00:12.421 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pd6729.ko 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 112793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/phy/ 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/phy/broadcom/ 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/phy/samsung/ 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/ 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/intel/ 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 69033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/ 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/ 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_ec.ko 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-02-17T12:00:12.422 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-02-17T12:00:12.423 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-02-17T12:00:12.423 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-02-17T12:00:12.423 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-02-17T12:00:12.423 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/ 2024-02-17T12:00:12.423 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 73601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-17T12:00:12.423 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/acerhdf.ko 2024-02-17T12:00:12.423 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-17T12:00:12.423 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 59569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-17T12:00:12.423 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-17T12:00:12.423 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 131945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 40169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/hdaps.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/ibm_rtl.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel/ 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel_ips.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-17T12:00:12.424 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 48481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/wmi.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/ 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/ 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/88pm860x_battery.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/88pm860x_charger.ko 2024-02-17T12:00:12.425 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 54961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/bq2415x_charger.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 59505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/bq24190_charger.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/bq24735-charger.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/da9030_battery.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/da9052-battery.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/ds2760_battery.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/ds2780_battery.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/ds2781_battery.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/ds2782_battery.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/gpio-charger.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/isp1704_charger.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/lp8727_charger.ko 2024-02-17T12:00:12.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/max14577_charger.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/max17042_battery.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/max8903_charger.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/max8925_power.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/pcf50633-charger.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 37841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/sbs-battery.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/test_power.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/tps65090-charger.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/wm831x_backup.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/wm831x_power.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/wm8350_power.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/ 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 58105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-17T12:00:12.427 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/ 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/ 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps_parport.ko 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/pps_core.ko 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 70873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ptp.ko 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ptp_kvm.ko 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/ 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-88pm80x.ko 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-88pm860x.ko 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-17T12:00:12.428 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-da9052.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-da9055.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-da9063.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 68481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-em3027.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-17T12:00:12.429 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-lp8788.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t86.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max6900.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max8907.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max8925.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max8997.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max8998.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-02-17T12:00:12.430 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-palmas.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 46537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf50633.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rc5t583.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-17T12:00:12.431 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-s35390a.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-tps6586x.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-tps65910.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-wm831x.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-wm8350.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-x1205.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 77529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-9xxx.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 57721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-sas.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 55081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-xxxx.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 135345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/BusLogic.ko 2024-02-17T12:00:12.432 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/a100u2w.ko 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aacraid/ 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 271441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 100473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/advansys.ko 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/ 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 356865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 295993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic94xx/ 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 189145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/am53c974.ko 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/arcmsr/ 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 108273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-17T12:00:12.433 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/atp870u.ko 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/be2iscsi/ 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 246937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bfa/ 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1171953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bfa/bfa.ko 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2fc/ 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 238401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2i/ 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 115329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 40785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ch.ko 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/csiostor/ 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 308961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-17T12:00:12.434 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/ 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 76041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 101425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 146817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 75977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/dc395x.ko 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/dmx3191d.ko 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esas2r/ 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 212385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 60505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esp_scsi.ko 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/ 2024-02-17T12:00:12.435 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 78225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 157961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fdomain.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fnic/ 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 294601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fnic/fnic.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 201729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hpsa.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hptiop.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hv_storvsc.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/imm.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 43977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/initio.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 265945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ipr.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 101881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ips.ko 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/isci/ 2024-02-17T12:00:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 317193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/isci/isci.ko 2024-02-17T12:00:12.437 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-17T12:00:12.437 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 52865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-17T12:00:12.437 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libfc/ 2024-02-17T12:00:12.437 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 315385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libfc/libfc.ko 2024-02-17T12:00:12.437 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 145497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libiscsi.ko 2024-02-17T12:00:12.437 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 53809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-17T12:00:12.438 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libsas/ 2024-02-17T12:00:12.438 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 216401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libsas/libsas.ko 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/lpfc/ 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 2194089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/ 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 73473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 310689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 85521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid.ko 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mpt3sas/ 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 659569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvsas/ 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 119489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-17T12:00:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 78041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvumi.ko 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pcmcia/ 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 81561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pm8001/ 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 366337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 124601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pmcraid.ko 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ppa.ko 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 55337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla1280.ko 2024-02-17T12:00:12.440 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/ 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1876753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 85193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla4xxx/ 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 558953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qlogicfas408.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/raid_class.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 261081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_debug.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 173929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 280113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 97625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 73865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-17T12:00:12.441 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ses.ko 2024-02-17T12:00:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 115713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/st.ko 2024-02-17T12:00:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 46737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/stex.ko 2024-02-17T12:00:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/sym53c8xx_2/ 2024-02-17T12:00:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 164889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-17T12:00:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/virtio_scsi.ko 2024-02-17T12:00:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-17T12:00:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/wd719x.ko 2024-02-17T12:00:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/xen-scsifront.ko 2024-02-17T12:00:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ssb/ 2024-02-17T12:00:12.442 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 129393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ssb/ssb.ko 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/ 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/iscsi/ 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 736761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/loopback/ 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_file.ko 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_iblock.ko 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 930977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_mod.ko 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_pscsi.ko 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 122489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_user.ko 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/tcm_fc/ 2024-02-17T12:00:12.443 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 75521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/ 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/ 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/ 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-17T12:00:12.444 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ipwireless/ 2024-02-17T12:00:12.445 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 78353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 57777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/moxa.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/mxser.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 108489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/n_gsm.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/n_hdlc.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 67841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/nozomi.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/ 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250/ 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 59401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/altera_uart.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/arc_uart.ko 2024-02-17T12:00:12.446 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 72489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/jsm/ 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 101993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/rp2.ko 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 53177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/sc16is7xx.ko 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/ 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/core/ 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 545401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host/ 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/ 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio.ko 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_aec.ko 2024-02-17T12:00:12.447 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_cif.ko 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_dmem_genirq.ko 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_mf624.ko 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_netx.ko 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_pci_generic.ko 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_sercos3.ko 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/ 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/c67x00/ 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 73225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/c67x00/c67x00.ko 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 145793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-02-17T12:00:12.448 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/ 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 87009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/cdc-acm.ko 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/usblp.ko 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 89769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/usbtmc.ko 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/common/ 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/common/ulpi.ko 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc2/ 2024-02-17T12:00:12.449 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc3/ 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 452577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc3/dwc3.ko 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/ 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/ 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 60329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/u_ether.ko 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/u_serial.ko 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-02-17T12:00:12.450 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 92409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 50945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 122257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 59801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 57633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 85521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 58025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 67353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/ 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-02-17T12:00:12.451 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 62369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-02-17T12:00:12.452 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 161233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/libcomposite.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/ 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/bdc/ 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 157617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 52929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 69617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 55953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 75969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/net2272.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 74985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/net2280.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 73017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 65881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-02-17T12:00:12.453 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 66001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 81409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 156337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/ 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/bcma-hcd.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 80017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/isp116x-hcd.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 87193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 78777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/sl811_cs.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/ssb-hcd.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-02-17T12:00:12.454 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/ 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/mdc800.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/microtek.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/adutux.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/appledisplay.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/cytherm.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ehset.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/emi26.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/emi62.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ezusb.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/idmouse.ko 2024-02-17T12:00:12.455 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/iowarrior.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ldusb.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/legousbtower.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/lvstest.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/sisusbvga/ 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 64745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usb3503.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usblcd.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 70721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usbtest.ko 2024-02-17T12:00:12.456 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/uss720.ko 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/yurex.ko 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/mon/ 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 72825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/mon/usbmon.ko 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/musb/ 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 301633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/musb/musb_hdrc.ko 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/ 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-generic.ko 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-isp1301.ko 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-tahvo.ko 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/aircable.ko 2024-02-17T12:00:12.457 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ark3116.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ch341.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 70345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cp210x.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cyberjack.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 58121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/empeg.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/f81232.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 175105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 53017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 136985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-17T12:00:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 124745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/io_ti.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 67681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ipaq.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ipw.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ir-usb.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 58137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 107433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/keyspan.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mct_u232.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/metro-usb.ko 2024-02-17T12:00:12.459 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 66361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mos7720.ko 2024-02-17T12:00:12.460 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 78129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mos7840.ko 2024-02-17T12:00:12.460 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 56249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mxuport.ko 2024-02-17T12:00:12.460 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/navman.ko 2024-02-17T12:00:12.460 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/omninet.ko 2024-02-17T12:00:12.460 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/opticon.ko 2024-02-17T12:00:12.460 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 191825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/option.ko 2024-02-17T12:00:12.460 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/oti6858.ko 2024-02-17T12:00:12.460 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 54265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/pl2303.ko 2024-02-17T12:00:12.460 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/qcaux.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/qcserial.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/quatech2.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/safe_serial.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/sierra.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ssu100.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/symbolserial.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 61393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb_debug.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 125529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usbserial.ko 2024-02-17T12:00:12.461 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/visor.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 37313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/whiteheat.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/wishbone-serial.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 52761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/uas.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-17T12:00:12.462 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-karma.ko 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 180329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/usb-storage.ko 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/ 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 67401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 71025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 104065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/ 2024-02-17T12:00:12.463 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/ 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 162865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 103673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/vfio.ko 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 76441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/ 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 113665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost.ko 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 58001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_net.ko 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 89057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_scsi.ko 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/ 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/ 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-02-17T12:00:12.464 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/aat2870_bl.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/adp5520_bl.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/adp8860_bl.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/adp8870_bl.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/apple_bl.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/as3711_bl.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/bd6107.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/da903x_bl.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/da9052_bl.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/gpio_backlight.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/kb3886_bl.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lcd.ko 2024-02-17T12:00:12.465 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lm3533_bl.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lm3639_bl.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lv5207lp.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/max8925_bl.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/pandora_bl.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/wm831x_bl.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/ 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ds2482.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ds2490.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/matrox_w1.ko 2024-02-17T12:00:12.466 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/w1-gpio.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/ 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 56337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 103049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/wire.ko 2024-02-17T12:00:12.467 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/acquirewdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/advantechwdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/cpu5wdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/da9052_wdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/da9055_wdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/da9063_wdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/dw_wdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/eurotechwdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-17T12:00:12.468 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/hpwdt.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/i6300esb.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ib700wdt.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ibmasr.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/it87_wdt.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/kempld_wdt.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/machzwd.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/mena21_wdt.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-02-17T12:00:12.469 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/nv_tco.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pc87413_wdt.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/retu_wdt.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sc1200wdt.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/softdog.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-17T12:00:12.470 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/twl4030_wdt.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/via_wdt.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wafer5823wdt.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wdt_pci.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wm831x_wdt.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wm8350_wdt.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/xen_wdt.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/ 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-evtchn.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-gntalloc.ko 2024-02-17T12:00:12.471 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-gntdev.ko 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-pciback/ 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 176385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 40097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-privcmd.ko 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 71153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-scsiback.ko 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xenfs/ 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/9p/ 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 158281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/9p/9p.ko 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/adfs/ 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 61721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/adfs/adfs.ko 2024-02-17T12:00:12.472 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/affs/ 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 163377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/affs/affs.ko 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/afs/ 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1018985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/afs/kafs.ko 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/autofs/ 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 103225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/autofs/autofs4.ko 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/befs/ 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 64625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/befs/befs.ko 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/bfs/ 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 41017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/bfs/bfs.ko 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/binfmt_misc.ko 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/btrfs/ 2024-02-17T12:00:12.473 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 3484777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/btrfs/btrfs.ko 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cachefiles/ 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 305737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cachefiles/cachefiles.ko 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ceph/ 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1335377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ceph/ceph.ko 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/coda/ 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 97769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/coda/coda.ko 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/configfs/ 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 108577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/configfs/configfs.ko 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cramfs/ 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cramfs/cramfs.ko 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/dlm/ 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 644249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/dlm/dlm.ko 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/efs/ 2024-02-17T12:00:12.474 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/efs/efs.ko 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/f2fs/ 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1527729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/f2fs/f2fs.ko 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/ 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/msdos.ko 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/freevxfs/ 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/freevxfs/freevxfs.ko 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse/ 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse/cuse.ko 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/gfs2/ 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1231361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/gfs2/gfs2.ko 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfs/ 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 141713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfs/hfs.ko 2024-02-17T12:00:12.475 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfsplus/ 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 222897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfsplus/hfsplus.ko 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hpfs/ 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 193545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hpfs/hpfs.ko 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/isofs/ 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 74737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/isofs/isofs.ko 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/jfs/ 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 420449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/jfs/jfs.ko 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/lockd/ 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 281705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/lockd/lockd.ko 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/minix/ 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 88937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/minix/minix.ko 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/netfs/ 2024-02-17T12:00:12.476 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 490001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/netfs/netfs.ko 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/ 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/blocklayout/ 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 81457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/filelayout/ 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 59353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/flexfilelayout/ 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 117377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1057985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfs.ko 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 66361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv2.ko 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 120193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv3.ko 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 2041825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv4.ko 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/ 2024-02-17T12:00:12.477 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/grace.ko 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/nfs_acl.ko 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfsd/ 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1511665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfsd/nfsd.ko 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nilfs2/ 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 582529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nilfs2/nilfs2.ko 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/ 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-celtic.ko 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-centeuro.ko 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-croatian.ko 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-cyrillic.ko 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-gaelic.ko 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-greek.ko 2024-02-17T12:00:12.478 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-iceland.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-inuit.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-roman.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-romanian.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-turkish.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_ascii.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1250.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1251.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1255.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp737.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp775.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp850.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp852.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp855.ko 2024-02-17T12:00:12.479 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp857.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp860.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp861.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp862.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp863.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp864.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp865.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp866.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp869.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp874.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 94041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp932.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 142577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp936.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 165649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp949.ko 2024-02-17T12:00:12.480 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 118025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp950.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_euc-jp.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-1.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-13.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-14.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-15.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-2.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-3.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-4.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-5.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-6.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-7.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-9.ko 2024-02-17T12:00:12.481 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-r.ko 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-ru.ko 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-u.ko 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_utf8.ko 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ntfs/ 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 220545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ntfs/ntfs.ko 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/cluster/ 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 244673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlm/ 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 440681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-17T12:00:12.482 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlmfs/ 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 54177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 2590849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2.ko 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/omfs/ 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 53705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/omfs/omfs.ko 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/overlayfs/ 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 361169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/overlayfs/overlay.ko 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/pstore/ 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 56945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/pstore/ramoops.ko 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/qnx4/ 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/qnx4/qnx4.ko 2024-02-17T12:00:12.483 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/qnx6/ 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 46625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/qnx6/qnx6.ko 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/quota/ 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/quota/quota_tree.ko 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/quota/quota_v1.ko 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/quota/quota_v2.ko 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/reiserfs/ 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 532289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/reiserfs/reiserfs.ko 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/romfs/ 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/romfs/romfs.ko 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/ 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/client/ 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 2710993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/client/cifs.ko 2024-02-17T12:00:12.484 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/ 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/cifs_arc4.ko 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/cifs_md4.ko 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/squashfs/ 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 134809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/squashfs/squashfs.ko 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/sysv/ 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 91329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/sysv/sysv.ko 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/udf/ 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 248409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/udf/udf.ko 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ufs/ 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 162785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ufs/ufs.ko 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/xfs/ 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 4036329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/xfs/xfs.ko 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/ 2024-02-17T12:00:12.485 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/locking/ 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 80489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/locking/locktorture.ko 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/time/ 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/time/test_udelay.ko 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 60265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/torture.ko 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc-itu-t.ko 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc7.ko 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc8.ko 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/ 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/libarc4.ko 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/libdes.ko 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/interval_tree_test.ko 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/libcrc32c.ko 2024-02-17T12:00:12.486 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lru_cache.ko 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/ 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/lz4_compress.ko 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/lz4hc_compress.ko 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/math/ 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/math/cordic.ko 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/memory-notifier-error-inject.ko 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/notifier-error-inject.ko 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/percpu_test.ko 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/pm-notifier-error-inject.ko 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/raid6/ 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 143337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/raid6/raid6_pq.ko 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/rbtree_test.ko 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/reed_solomon/ 2024-02-17T12:00:12.487 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test-kstrtox.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test-string_helpers.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 4863225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test_bpf.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 48993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test_firmware.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test_module.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test_user_copy.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_bm.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_fsm.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_kmp.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/xz/ 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/xz/xz_dec_test.ko 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/mm/ 2024-02-17T12:00:12.488 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/mm/hwpoison-inject.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/ 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 55665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/6lowpan.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_dest.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_fragment.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_hop.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_mobility.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 6969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_routing.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_udp.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/ 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/garp.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/mrp.ko 2024-02-17T12:00:12.489 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/p8022.ko 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/psnap.ko 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/stp.ko 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/8021q/ 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 82897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/8021q/8021q.ko 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/ 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 198833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet.ko 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_fd.ko 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_rdma.ko 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_virtio.ko 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/batman-adv/ 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 667545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/batman-adv/batman-adv.ko 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/ 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 65953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/br_netfilter.ko 2024-02-17T12:00:12.490 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 791305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/bridge.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-17T12:00:12.491 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 55945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtables.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-17T12:00:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ceph/ 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1046801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ceph/libceph.ko 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core/ 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 125769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core/pktgen.ko 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/ 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 194505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp.ko 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_diag.ko 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 58745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_ipv4.ko 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 61401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_ipv6.ko 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/ 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 390089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/dsa_core.ko 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_brcm.ko 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_dsa.ko 2024-02-17T12:00:12.493 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_none.ko 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_trailer.ko 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/hsr/ 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 102073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/hsr/hsr.ko 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/6lowpan/ 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 45505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 284721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ieee802154.ko 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 47881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ah4.ko 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/esp4.ko 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 48249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/fou.ko 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/gre.ko 2024-02-17T12:00:12.494 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 51217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/inet_diag.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 61017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_gre.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 61337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_tunnel.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_vti.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ipcomp.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 29033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ipip.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ip_tables.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-17T12:00:12.495 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-02-17T12:00:12.496 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_bic.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_dctcp.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_diag.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_highspeed.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_htcp.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_hybla.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_illinois.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_lp.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_scalable.ko 2024-02-17T12:00:12.497 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_vegas.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_veno.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_westwood.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_yeah.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tunnel4.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/udp_diag.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 45001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/udp_tunnel.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ah6.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/esp6.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/fou6.ko 2024-02-17T12:00:12.498 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 79929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_gre.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 94169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_tunnel.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 54273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_vti.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ipcomp6.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/mip6.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-17T12:00:12.499 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-17T12:00:12.500 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 74833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/sit.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/tunnel6.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/key/ 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 84345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/key/af_key.ko 2024-02-17T12:00:12.501 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/ 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 125209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_core.ko 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 25817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_eth.ko 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ip.ko 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 37377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ip6.ko 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_netlink.ko 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 53233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ppp.ko 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/lapb/ 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 48121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/lapb/lapb.ko 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc/ 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc/llc.ko 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 268521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc/llc2.ko 2024-02-17T12:00:12.502 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mac802154/ 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 309417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mac802154/mac802154.ko 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mpls/ 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mpls/mpls_gso.ko 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 119705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set.ko 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 99993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 100281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-17T12:00:12.503 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 102553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 102345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 111673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 59193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 108345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 112145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 112409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 110337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 113289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 412513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-17T12:00:12.504 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conncount.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 411745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack.ko 2024-02-17T12:00:12.505 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 118097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 108313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 66537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 92209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_flow_table.ko 2024-02-17T12:00:12.506 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_log_syslog.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 96521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_irc.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_sip.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 44137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 623417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_tables.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 42577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-02-17T12:00:12.507 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_log.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_chain_nat.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_compat.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 40761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_ct.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_fib.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_hash.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_limit.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_log.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_masq.ko 2024-02-17T12:00:12.508 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_nat.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_numgen.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_osf.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_queue.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_redir.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_reject.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_reject_inet.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_socket.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_synproxy.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_tproxy.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 89233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/x_tables.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_AUDIT.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-17T12:00:12.509 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 18081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CT.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_DSCP.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_HL.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_HMARK.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 38777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_LED.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_LOG.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NETMAP.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NFLOG.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-17T12:00:12.510 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_RATEEST.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_SECMARK.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TEE.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TPROXY.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TRACE.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_addrtype.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_bpf.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cgroup.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cluster.ko 2024-02-17T12:00:12.511 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_comment.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connbytes.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connlabel.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connlimit.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connmark.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_conntrack.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cpu.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_dccp.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_devgroup.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_dscp.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ecn.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_esp.ko 2024-02-17T12:00:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 43201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_hashlimit.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_helper.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_hl.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ipcomp.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_iprange.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ipvs.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_l2tp.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_length.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_limit.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_mac.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_mark.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_multiport.ko 2024-02-17T12:00:12.513 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_nat.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_nfacct.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_osf.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_owner.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_physdev.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_pkttype.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_policy.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_quota.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_rateest.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_realm.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_recent.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_sctp.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_set.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 16817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_socket.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_state.ko 2024-02-17T12:00:12.514 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_statistic.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_string.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 8457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_tcpmss.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_tcpudp.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_time.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_u32.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netlink/ 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 14441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netlink/netlink_diag.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/nsh/ 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 12337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/nsh/nsh.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/ 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 384097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/openvswitch.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-geneve.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-gre.ko 2024-02-17T12:00:12.515 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-vxlan.ko 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/packet/ 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/packet/af_packet_diag.ko 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/phonet/ 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 112153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/phonet/phonet.ko 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 54729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/phonet/pn_pep.ko 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/ 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 253737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds.ko 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 165105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds_rdma.ko 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 68161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds_tcp.ko 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rxrpc/ 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 828297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rxrpc/rxrpc.ko 2024-02-17T12:00:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/ 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_csum.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_gact.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_mirred.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_nat.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 43417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_pedit.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_police.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_simple.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_skbedit.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_vlan.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_basic.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_bpf.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 19185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_cgroup.ko 2024-02-17T12:00:12.517 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_flow.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_fw.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 39521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_route.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 62657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_u32.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_cmp.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 13321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_ipset.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 33249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_meta.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_nbyte.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_text.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_u32.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_choke.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_codel.ko 2024-02-17T12:00:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 34657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_drr.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_fq.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_fq_codel.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 35457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_gred.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 49849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_hfsc.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 21977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_hhf.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 66449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_htb.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_ingress.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 30225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_mqprio.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_mqprio_lib.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_multiq.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 36153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_netem.ko 2024-02-17T12:00:12.519 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 27409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_pie.ko 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_plug.ko 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 24777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_prio.ko 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 48537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_qfq.ko 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 32817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_red.ko 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 26793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_sfb.ko 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 31321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_sfq.ko 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_tbf.ko 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 28273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_teql.ko 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/ 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 932945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/sctp.ko 2024-02-17T12:00:12.520 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/sctp_diag.ko 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/ 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/ 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 337009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 55041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 1513905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/sunrpc.ko 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/xprtrdma/ 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 704761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/ 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 10401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/diag.ko 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 867249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/tipc.ko 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/unix/ 2024-02-17T12:00:12.521 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/unix/unix_diag.ko 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/ 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 87745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 67953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 98113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock.ko 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 11081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 17817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/x25/ 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 131273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/x25/x25.ko 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/ 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 22953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/xfrm_algo.ko 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 20553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 105097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/xfrm_user.ko 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/ 2024-02-17T12:00:12.522 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/lib/ 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 15441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/lib/irqbypass.ko 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 642229 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.alias 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 625558 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.alias.bin 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 7677 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 23498 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.alias.bin 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 9916 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.bin 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 70627 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.modinfo 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 147214 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.dep 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 233213 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.dep.bin 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 210 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.devname 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 72614 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.order 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 879 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.softdep 2024-02-17T12:00:12.523 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 257955 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.symbols 2024-02-17T12:00:12.524 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 312782 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.symbols.bin 2024-02-17T12:00:12.524 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./usr/ 2024-02-17T12:00:12.524 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./usr/share/ 2024-02-17T12:00:12.524 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./usr/share/doc/ 2024-02-17T12:00:12.524 INFO:teuthology.orchestra.run.smithi116.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./usr/share/doc/linux-image-6.8.0-rc4-g8d59ab0bd93c/ 2024-02-17T12:00:12.524 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 174 2024-02-13 10:58 ./usr/share/doc/linux-image-6.8.0-rc4-g8d59ab0bd93c/changelog.Debian.gz 2024-02-17T12:00:12.524 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r-- root/root 691 2024-02-13 10:58 ./usr/share/doc/linux-image-6.8.0-rc4-g8d59ab0bd93c/copyright 2024-02-17T12:00:12.530 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:12.530 INFO:teuthology.task.kernel:searching for kernel 6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:12.530 DEBUG:teuthology.orchestra.run.smithi116:> egrep '(submenu|menuentry.*6.8.0-rc4-g8d59ab0bd93c).*{' /boot/grub/grub.cfg 2024-02-17T12:00:12.537 INFO:teuthology.orchestra.run.smithi116.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-02-17T12:00:12.537 INFO:teuthology.orchestra.run.smithi116.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc4-g8d59ab0bd93c' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc4-g8d59ab0bd93c-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-02-17T12:00:12.537 INFO:teuthology.orchestra.run.smithi116.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc4-g8d59ab0bd93c (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc4-g8d59ab0bd93c-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-02-17T12:00:12.537 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-02-17T12:00:12.538 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:12.538 DEBUG:teuthology.orchestra.run.smithi116:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-02-17T12:00:12.581 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi116.front.sepia.ceph.com to complete... 2024-02-17T12:00:12.986 INFO:teuthology.orchestra.run.smithi116.stderr:Sourcing file `/etc/default/grub' 2024-02-17T12:00:12.987 INFO:teuthology.orchestra.run.smithi116.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-17T12:00:13.007 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-02-17T12:00:13.212 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:13.219 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:00:13.451 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-17T12:00:13.459 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-17T12:00:13.502 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-17T12:00:13.508 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-17T12:00:13.640 INFO:teuthology.orchestra.run.smithi116.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-17T12:00:13.640 INFO:teuthology.orchestra.run.smithi116.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-17T12:00:13.640 INFO:teuthology.orchestra.run.smithi116.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-17T12:00:13.656 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-02-17T12:00:44.753 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-02-17T12:00:44.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-17T12:00:44.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:01:03.292 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-02-17T12:01:12.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-17T12:01:12.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:01:15.360 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-02-17T12:01:27.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-17T12:01:27.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:01:45.788 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-02-17T12:02:00.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-17T12:02:00.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:02:01.248 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-02-17T12:02:02.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-17T12:02:02.248 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-rc4-g8d59ab0bd93c"... 2024-02-17T12:02:02.248 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-02-17T12:02:02.300 INFO:teuthology.orchestra.run.smithi116.stdout:6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:02.300 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc4-g8d59ab0bd93c vs 6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:02.300 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-17T12:02:02.300 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-17T12:02:03.301 DEBUG:teuthology.parallel:result is None 2024-02-17T12:02:23.800 INFO:teuthology.orchestra.run.smithi114.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-02-17T12:02:23.801 INFO:teuthology.orchestra.run.smithi114.stderr: * [new branch] main -> origin/main 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190312 -> 20190312 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190416 -> 20190416 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190514 -> 20190514 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190618 -> 20190618 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190717 -> 20190717 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190815 -> 20190815 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190923 -> 20190923 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20191022 -> 20191022 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20191215 -> 20191215 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200122 -> 20200122 2024-02-17T12:02:23.834 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200316 -> 20200316 2024-02-17T12:02:23.837 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200421 -> 20200421 2024-02-17T12:02:23.837 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200519 -> 20200519 2024-02-17T12:02:23.837 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200619 -> 20200619 2024-02-17T12:02:23.837 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200721 -> 20200721 2024-02-17T12:02:23.837 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200817 -> 20200817 2024-02-17T12:02:23.837 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200918 -> 20200918 2024-02-17T12:02:23.837 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201022 -> 20201022 2024-02-17T12:02:23.837 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201118 -> 20201118 2024-02-17T12:02:23.837 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201218 -> 20201218 2024-02-17T12:02:23.837 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210208 -> 20210208 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210315 -> 20210315 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210511 -> 20210511 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210716 -> 20210716 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210818 -> 20210818 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210919 -> 20210919 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20211027 -> 20211027 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20211216 -> 20211216 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220209 -> 20220209 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220310 -> 20220310 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220411 -> 20220411 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220509 -> 20220509 2024-02-17T12:02:23.838 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220610 -> 20220610 2024-02-17T12:02:23.840 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220708 -> 20220708 2024-02-17T12:02:23.840 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220815 -> 20220815 2024-02-17T12:02:23.840 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220913 -> 20220913 2024-02-17T12:02:23.840 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221012 -> 20221012 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221109 -> 20221109 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221214 -> 20221214 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230117 -> 20230117 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230210 -> 20230210 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230310 -> 20230310 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230404 -> 20230404 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230515 -> 20230515 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230625 -> 20230625 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230804 -> 20230804 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230919 -> 20230919 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20231030 -> 20231030 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20231111 -> 20231111 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20231211 -> 20231211 2024-02-17T12:02:23.841 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240115 -> 20240115 2024-02-17T12:02:27.911 INFO:teuthology.orchestra.run.smithi114.stderr:Updating files: 51% (1844/3554) Updating files: 52% (1849/3554) Updating files: 53% (1884/3554) Updating files: 54% (1920/3554) Updating files: 55% (1955/3554) Updating files: 56% (1991/3554) Updating files: 57% (2026/3554) Updating files: 58% (2062/3554) Updating files: 59% (2097/3554) Updating files: 60% (2133/3554) Updating files: 61% (2168/3554) Updating files: 62% (2204/3554) Updating files: 63% (2240/3554) Updating files: 64% (2275/3554) Updating files: 65% (2311/3554) Updating files: 65% (2345/3554) Updating files: 66% (2346/3554) Updating files: 67% (2382/3554) Updating files: 68% (2417/3554) Updating files: 69% (2453/3554) Updating files: 70% (2488/3554) Updating files: 71% (2524/3554) Updating files: 72% (2559/3554) Updating files: 73% (2595/3554) Updating files: 74% (2630/3554) Updating files: 75% (2666/3554) Updating files: 76% (2702/3554) Updating files: 77% (2737/3554) Updating files: 78% (2773/3554) Updating files: 79% (2808/3554) Updating files: 80% (2844/3554) Updating files: 81% (2879/3554) Updating files: 81% (2909/3554) Updating files: 82% (2915/3554) Updating files: 83% (2950/3554) Updating files: 84% (2986/3554) Updating files: 85% (3021/3554) Updating files: 86% (3057/3554) Updating files: 87% (3092/3554) Updating files: 88% (3128/3554) Updating files: 89% (3164/3554) Updating files: 90% (3199/3554) Updating files: 91% (3235/3554) Updating files: 92% (3270/3554) Updating files: 93% (3306/3554) Updating files: 94% (3341/3554) Updating files: 95% (3377/3554) Updating files: 96% (3412/3554) Updating files: 96% (3436/3554) Updating files: 97% (3448/3554) Updating files: 98% (3483/3554) Updating files: 99% (3519/3554) Updating files: 100% (3554/3554) Updating files: 100% (3554/3554), done. 2024-02-17T12:02:27.916 INFO:teuthology.orchestra.run.smithi114.stdout:HEAD is now at fbef4d38 Merge branch 'main' into 'main' 2024-02-17T12:02:27.937 INFO:teuthology.task.kernel:Downloading kernel 8d59ab0bd93c806231018a6729893bf309624262 on client.0... 2024-02-17T12:02:27.938 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8d59ab0bd93c806231018a6729893bf309624262 2024-02-17T12:02:28.242 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc4-g8d59ab0bd93c/ 2024-02-17T12:02:28.242 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-rc4-g8d59ab0bd93c_6.8.0-rc4-g8d59ab0bd93c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc4-g8d59ab0bd93c/ --input-file=- 2024-02-17T12:02:28.245 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi114.front.sepia.ceph.com to complete... 2024-02-17T12:02:29.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17 12:02:29 URL:https://3.chacra.ceph.com/r/kernel/testing/8d59ab0bd93c806231018a6729893bf309624262/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc4-g8d59ab0bd93c/linux-image-6.8.0-rc4-g8d59ab0bd93c_6.8.0-rc4-g8d59ab0bd93c-1_amd64.deb [39240030/39240030] -> "/tmp/linux-image.deb" [1] 2024-02-17T12:02:29.762 INFO:teuthology.orchestra.run.smithi114.stderr:FINISHED --2024-02-17 12:02:29-- 2024-02-17T12:02:29.762 INFO:teuthology.orchestra.run.smithi114.stderr:Total wall clock time: 1.5s 2024-02-17T12:02:29.762 INFO:teuthology.orchestra.run.smithi114.stderr:Downloaded: 1 files, 37M in 1.4s (27.3 MB/s) 2024-02-17T12:02:29.767 INFO:teuthology.task.kernel:Installing kernel 8d59ab0bd93c806231018a6729893bf309624262 on client.0... 2024-02-17T12:02:29.767 DEBUG:teuthology.orchestra.run.smithi114:> sudo dpkg -i /tmp/linux-image.deb 2024-02-17T12:02:30.038 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-image-6.8.0-rc4-g8d59ab0bd93c. 2024-02-17T12:02:32.065 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-02-17T12:02:32.069 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-02-17T12:02:32.203 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-image-6.8.0-rc4-g8d59ab0bd93c (6.8.0-rc4-g8d59ab0bd93c-1) ... 2024-02-17T12:02:35.572 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-image-6.8.0-rc4-g8d59ab0bd93c (6.8.0-rc4-g8d59ab0bd93c-1) ... 2024-02-17T12:02:35.702 INFO:teuthology.orchestra.run.smithi114.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2024-02-17T12:02:57.190 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-17T12:02:57.219 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-02-17T12:02:57.509 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:57.522 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:57.823 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-17T12:02:57.835 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-17T12:02:57.907 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-17T12:02:57.912 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-17T12:02:58.075 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-17T12:02:58.075 INFO:teuthology.orchestra.run.smithi114.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-17T12:02:58.075 INFO:teuthology.orchestra.run.smithi114.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-17T12:02:58.105 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-02-17T12:02:58.288 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-deb -c /tmp/linux-image.deb 2024-02-17T12:02:58.295 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./ 2024-02-17T12:02:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./boot/ 2024-02-17T12:02:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 4469316 2024-02-13 10:58 ./boot/System.map-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 170841 2024-02-13 10:58 ./boot/config-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:58.308 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11527168 2024-02-13 10:58 ./boot/vmlinuz-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/kernel/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/kernel/postinst.d/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/kernel/postrm.d/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/kernel/preinst.d/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./etc/kernel/prerm.d/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/ 2024-02-17T12:02:58.330 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/ 2024-02-17T12:02:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/ 2024-02-17T12:02:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 490449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/aesni-intel.ko 2024-02-17T12:02:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-17T12:02:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-17T12:02:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-17T12:02:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 93081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-17T12:02:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-17T12:02:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 152145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-17T12:02:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-17T12:02:58.331 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/ 2024-02-17T12:02:58.332 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/ 2024-02-17T12:02:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/mce/ 2024-02-17T12:02:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-17T12:02:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/cpuid.ko 2024-02-17T12:02:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kernel/msr.ko 2024-02-17T12:02:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/ 2024-02-17T12:02:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 354001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-17T12:02:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 885905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-17T12:02:58.334 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2294545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/arch/x86/kvm/kvm.ko 2024-02-17T12:02:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ 2024-02-17T12:02:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/af_alg.ko 2024-02-17T12:02:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/algif_hash.ko 2024-02-17T12:02:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/algif_skcipher.ko 2024-02-17T12:02:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ansi_cprng.ko 2024-02-17T12:02:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/anubis.ko 2024-02-17T12:02:58.347 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/arc4.ko 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/asymmetric_keys/ 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/ 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_memcpy.ko 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_pq.ko 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_tx.ko 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/async_xor.ko 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/async_tx/raid6test.ko 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/authenc.ko 2024-02-17T12:02:58.348 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/authencesn.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blake2b_generic.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blowfish_common.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/blowfish_generic.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/camellia_generic.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast5_generic.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast6_generic.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cast_common.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/ccm.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cmac.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crc32_generic.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cryptd.ko 2024-02-17T12:02:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_engine.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_simd.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/crypto_user.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/cts.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/des_generic.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/dh_generic.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/echainiv.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/essiv.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/fcrypt.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/khazad.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lrw.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lz4.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/lz4hc.ko 2024-02-17T12:02:58.350 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/md4.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/michael_mic.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/pcbc.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/pcrypt.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/rmd160.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/seed.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/serpent_generic.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 143033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/tcrypt.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/tea.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/twofish_common.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/twofish_generic.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/vmac.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/wp512.ko 2024-02-17T12:02:58.351 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xcbc.ko 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xor.ko 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xts.ko 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/crypto/xxhash_generic.ko 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/ 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_extlog.ko 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/acpi_pad.ko 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/apei/ 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/apei/einj.ko 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/ec_sys.ko 2024-02-17T12:02:58.352 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/platform_profile.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/sbs.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/sbshc.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 104433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/acpi/video.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/acard-ahci.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ahci.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/ahci_platform.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 88313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/libahci.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/libahci_platform.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_acpi.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ali.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_amd.ko 2024-02-17T12:02:58.353 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_artop.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_atiixp.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_atp867x.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cmd640.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cmd64x.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_cypress.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_efar.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt366.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt37x.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_it8213.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_it821x.ko 2024-02-17T12:02:58.354 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_jmicron.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_legacy.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_marvell.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_mpiix.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_netcell.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ninja32.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ns87410.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_ns87415.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_oldpiix.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_opti.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_optidma.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pcmcia.ko 2024-02-17T12:02:58.355 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_piccolo.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_radisys.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_rdc.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_rz1000.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sch.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_serverworks.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sil680.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_sl82c105.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_triflex.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pata_via.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/pdc_adma.ko 2024-02-17T12:02:58.356 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_inic162x.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_mv.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_nv.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_promise.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_qstor.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sil.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sil24.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sis.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_svw.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_sx4.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_uli.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_via.ko 2024-02-17T12:02:58.357 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ata/sata_vsc.ko 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/auxdisplay/ 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/auxdisplay/ks0108.ko 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/bcma/ 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/bcma/bcma.ko 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/ 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/aoe/ 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/aoe/aoe.ko 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/drbd/ 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 964817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/drbd/drbd.ko 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 169705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/floppy.ko 2024-02-17T12:02:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/mtip32xx/ 2024-02-17T12:02:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-17T12:02:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 116401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/nbd.ko 2024-02-17T12:02:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/null_blk/ 2024-02-17T12:02:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 110329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/null_blk/null_blk.ko 2024-02-17T12:02:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/pktcdvd.ko 2024-02-17T12:02:58.430 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 263641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/rbd.ko 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkback/ 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/zram/ 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/block/zram/zram.ko 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/applicom.ko 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hangcheck-timer.ko 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/ 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-17T12:02:58.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/via-rng.ko 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 148521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 139361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/lp.ko 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/mwave/ 2024-02-17T12:02:58.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/mwave/mwave.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/nvram.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/ppdev.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tlclk.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/ 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-02-17T12:02:58.433 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/xillybus/ 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/xillybus/xillybus_class.ko 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/xillybus/xillybus_core.ko 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/clk/ 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/clk/clk-palmas.ko 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/clk/clk-si5351.ko 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/clk/clk-twl6040.ko 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/clk/clk-wm831x.ko 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/ 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-17T12:02:58.434 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ 2024-02-17T12:02:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ 2024-02-17T12:02:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-17T12:02:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 246841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/ccp/ccp.ko 2024-02-17T12:02:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/ 2024-02-17T12:02:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/ 2024-02-17T12:02:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_common/ 2024-02-17T12:02:58.435 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 570497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/padlock-aes.ko 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/padlock-sha.ko 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/virtio/ 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dca/ 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dca/dca.ko 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/dw/ 2024-02-17T12:02:58.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ioat/ 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/ 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/amd64_edac.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/e752x_edac.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/edac_mce_amd.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i3000_edac.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i3200_edac.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i5100_edac.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i5400_edac.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i7300_edac.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i7core_edac.ko 2024-02-17T12:02:58.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/i82975x_edac.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/ie31200_edac.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/sb_edac.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/edac/x38_edac.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/ 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-gpio.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-max14577.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-max77693.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-max8997.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-palmas.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-rt8973a.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/extcon/extcon-sm5502.ko 2024-02-17T12:02:58.438 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/ 2024-02-17T12:02:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/dmi-sysfs.ko 2024-02-17T12:02:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/efi/ 2024-02-17T12:02:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/efi/efi-pstore.ko 2024-02-17T12:02:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-17T12:02:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/ 2024-02-17T12:02:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-adp5520.ko 2024-02-17T12:02:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-amd8111.ko 2024-02-17T12:02:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-arizona.ko 2024-02-17T12:02:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-da9052.ko 2024-02-17T12:02:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-da9055.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-dln2.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-f7188x.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-generic.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-ich.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-kempld.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-lp3943.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-max7300.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-max730x.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-max732x.ko 2024-02-17T12:02:58.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-pca953x.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-pcf857x.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-rdc321x.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-sch.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-sch311x.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-tps65912.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-twl4030.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-twl6040.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-vx855.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-wm831x.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-wm8350.ko 2024-02-17T12:02:58.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/gpio/gpio-wm8994.ko 2024-02-17T12:02:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/ 2024-02-17T12:02:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-a4tech.ko 2024-02-17T12:02:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-apple.ko 2024-02-17T12:02:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-appleir.ko 2024-02-17T12:02:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-aureal.ko 2024-02-17T12:02:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-axff.ko 2024-02-17T12:02:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-belkin.ko 2024-02-17T12:02:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-cherry.ko 2024-02-17T12:02:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-chicony.ko 2024-02-17T12:02:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-cp2112.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-cypress.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-dr.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-elecom.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-elo.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-emsff.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-ezkey.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gaff.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-generic.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gt683r.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-gyration.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-17T12:02:58.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-holtekff.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-hyperv.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-icade.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-kensington.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-keytouch.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-kye.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lcpower.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-led.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lenovo.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-lg-g15.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-17T12:02:58.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-logitech.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-magicmouse.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-microsoft.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-monterey.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-multitouch.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-ntrig.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-ortek.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-penmount.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-petalynx.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-picolcd.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-pl.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-plantronics.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-primax.ko 2024-02-17T12:02:58.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-rmi.ko 2024-02-17T12:02:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-17T12:02:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-common.ko 2024-02-17T12:02:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-17T12:02:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-17T12:02:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-17T12:02:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-17T12:02:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-17T12:02:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-17T12:02:58.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-roccat.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-saitek.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-samsung.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sjoy.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sony.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-speedlink.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-steelseries.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-sunplus.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-tivo.ko 2024-02-17T12:02:58.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-tmff.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-topseed.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-twinhan.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-uclogic.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-waltop.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 143393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-wiimote.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-xinmo.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-zpff.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid-zydacron.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 269233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/hid.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/uhid.ko 2024-02-17T12:02:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/usbhid/ 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/usbhid/usbhid.ko 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/usbhid/usbkbd.ko 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/usbhid/usbmouse.ko 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 218817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hid/wacom.ko 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/ 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_balloon.ko 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_utils.ko 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 305425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hv/hv_vmbus.ko 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/abituguru.ko 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/abituguru3.ko 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-17T12:02:58.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ad7414.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ad7418.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adc128d818.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1025.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1026.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1029.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm1031.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adm9240.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ads7828.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7410.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7411.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7462.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7470.ko 2024-02-17T12:02:58.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7475.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/adt7x10.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/amc6821.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/applesmc.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asb100.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asc7621.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/atxp1.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/coretemp.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/da9052-hwmon.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/da9055-hwmon.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-17T12:02:58.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 99513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/dme1737.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ds1621.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ds620.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc1403.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc2103.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/emc6w201.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f71805f.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f71882fg.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/f75375s.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/fam15h_power.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/fschmd.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/g760a.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/g762.ko 2024-02-17T12:02:58.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/gl518sm.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/gl520sm.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/hih6130.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/i5500_temp.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/i5k_amb.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ibmaem.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ibmpex.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ina209.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ina2xx.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 140137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/it87.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/jc42.ko 2024-02-17T12:02:58.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/k10temp.ko 2024-02-17T12:02:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/k8temp.ko 2024-02-17T12:02:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lineage-pem.ko 2024-02-17T12:02:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm63.ko 2024-02-17T12:02:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm73.ko 2024-02-17T12:02:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm75.ko 2024-02-17T12:02:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm77.ko 2024-02-17T12:02:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm78.ko 2024-02-17T12:02:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm80.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm83.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm85.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm87.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm90.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm92.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm93.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95234.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95241.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/lm95245.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc2945.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4151.ko 2024-02-17T12:02:58.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4215.ko 2024-02-17T12:02:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4222.ko 2024-02-17T12:02:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4245.ko 2024-02-17T12:02:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4260.ko 2024-02-17T12:02:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/ltc4261.ko 2024-02-17T12:02:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max16065.ko 2024-02-17T12:02:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max1619.ko 2024-02-17T12:02:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max1668.ko 2024-02-17T12:02:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max197.ko 2024-02-17T12:02:58.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6639.ko 2024-02-17T12:02:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6650.ko 2024-02-17T12:02:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/max6697.ko 2024-02-17T12:02:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/mc13783-adc.ko 2024-02-17T12:02:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/mcp3021.ko 2024-02-17T12:02:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-02-17T12:02:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6683.ko 2024-02-17T12:02:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6775-core.ko 2024-02-17T12:02:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct6775.ko 2024-02-17T12:02:58.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/nct7802.ko 2024-02-17T12:02:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pc87360.ko 2024-02-17T12:02:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pc87427.ko 2024-02-17T12:02:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pcf8591.ko 2024-02-17T12:02:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ 2024-02-17T12:02:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-17T12:02:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-17T12:02:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-17T12:02:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-17T12:02:58.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/powr1220.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch5627.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch5636.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-17T12:02:58.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sht15.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sht21.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/shtc1.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/sis5595.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47b397.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47m1.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/smsc47m192.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/thmc50.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp102.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp103.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp401.ko 2024-02-17T12:02:58.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/tmp421.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/via-cputemp.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/via686a.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/vt1211.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/vt8231.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83627ehf.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83627hf.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83781d.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83791d.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83792d.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83793.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83795.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83l785ts.ko 2024-02-17T12:02:58.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/w83l786ng.ko 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/ 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/ 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/ 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-17T12:02:58.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-17T12:02:58.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-02-17T12:02:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-02-17T12:02:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-17T12:02:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-02-17T12:02:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-17T12:02:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-17T12:02:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-17T12:02:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-17T12:02:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-02-17T12:02:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-mux.ko 2024-02-17T12:02:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-smbus.ko 2024-02-17T12:02:58.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/i2c-stub.ko 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/muxes/ 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 273529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 883945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_core.ko 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 324337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-17T12:02:58.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 282345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-17T12:02:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-17T12:02:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/ 2024-02-17T12:02:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/cxgb4/ 2024-02-17T12:02:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 493177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-17T12:02:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx4/ 2024-02-17T12:02:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 420593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-17T12:02:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx5/ 2024-02-17T12:02:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 741673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-17T12:02:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mthca/ 2024-02-17T12:02:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 296881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/ocrdma/ 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 153729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/usnic/ 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 169145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ipoib/ 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 266577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/iser/ 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/isert/ 2024-02-17T12:02:58.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 111337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srp/ 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 128665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srpt/ 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 129553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/ 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/evbug.ko 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/ff-memless.ko 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/ 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-17T12:02:58.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/gameport/gameport.ko 2024-02-17T12:02:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/joydev.ko 2024-02-17T12:02:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/ 2024-02-17T12:02:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-02-17T12:02:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-02-17T12:02:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-02-17T12:02:58.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/lkkbd.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/lm8323.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/lm8333.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/newtonkbd.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-02-17T12:02:58.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/qt1070.ko 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/qt2160.ko 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/stowaway.ko 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/sunkbd.ko 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/keyboard/xtkbd.ko 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/matrix-keymap.ko 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/ 2024-02-17T12:02:58.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/appletouch.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/bcm5974.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 123201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/cyapatp.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/gpio_mouse.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 335921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/psmouse.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/sermouse.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/rmi4/ 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-17T12:02:58.473 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/ 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/altera_ps2.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/arc_ps2.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/ct82c710.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/parkbd.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/pcips2.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/ps2mult.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/serio_raw.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/serio/serport.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/input/sparse-keymap.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/ 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-88pm860x.ko 2024-02-17T12:02:58.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-adp5520.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-bd2802.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-blinkm.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-da903x.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-da9052.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-gpio.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm3530.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm3533.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm355x.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lm3642.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lp3944.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-lp8788.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-max8997.ko 2024-02-17T12:02:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-mc13783.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-menf21bmc.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-pca9532.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-pca955x.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-pca963x.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-ss4200.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-tca6507.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-wm831x-status.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/leds-wm8350.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-17T12:02:58.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/ 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/bcache/ 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 647121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/bcache/bcache.ko 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-bio-prison.ko 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 93321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-bufio.ko 2024-02-17T12:02:58.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-cache-smq.ko 2024-02-17T12:02:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 155825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-cache.ko 2024-02-17T12:02:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 105473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-crypt.ko 2024-02-17T12:02:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-delay.ko 2024-02-17T12:02:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-era.ko 2024-02-17T12:02:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-flakey.ko 2024-02-17T12:02:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-log-userspace.ko 2024-02-17T12:02:58.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-log.ko 2024-02-17T12:02:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-mirror.ko 2024-02-17T12:02:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-multipath.ko 2024-02-17T12:02:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-queue-length.ko 2024-02-17T12:02:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-raid.ko 2024-02-17T12:02:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-region-hash.ko 2024-02-17T12:02:58.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-round-robin.ko 2024-02-17T12:02:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-service-time.ko 2024-02-17T12:02:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-snapshot.ko 2024-02-17T12:02:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-switch.ko 2024-02-17T12:02:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 181777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-thin-pool.ko 2024-02-17T12:02:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-verity.ko 2024-02-17T12:02:58.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/dm-zero.ko 2024-02-17T12:02:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/persistent-data/ 2024-02-17T12:02:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 199881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-17T12:02:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid0.ko 2024-02-17T12:02:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid1.ko 2024-02-17T12:02:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 126761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid10.ko 2024-02-17T12:02:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 369433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/md/raid456.ko 2024-02-17T12:02:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/ 2024-02-17T12:02:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/ 2024-02-17T12:02:58.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 178049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptbase.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptctl.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptfc.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptlan.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 123233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptsas.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptscsih.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/message/fusion/mptspi.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/ 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/88pm800.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/88pm805.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/88pm80x.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/arizona-i2c.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 123649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/arizona.ko 2024-02-17T12:02:58.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/bcm590xx.ko 2024-02-17T12:02:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/cros_ec_dev.ko 2024-02-17T12:02:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/dln2.ko 2024-02-17T12:02:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/janz-cmodio.ko 2024-02-17T12:02:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/kempld-core.ko 2024-02-17T12:02:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lm3533-core.ko 2024-02-17T12:02:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-02-17T12:02:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lp3943.ko 2024-02-17T12:02:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lpc_ich.ko 2024-02-17T12:02:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/lpc_sch.ko 2024-02-17T12:02:58.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/max8907.ko 2024-02-17T12:02:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/mc13xxx-core.ko 2024-02-17T12:02:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-02-17T12:02:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/menf21bmc.ko 2024-02-17T12:02:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/pcf50633-adc.ko 2024-02-17T12:02:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/pcf50633-gpio.ko 2024-02-17T12:02:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/pcf50633.ko 2024-02-17T12:02:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-02-17T12:02:58.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/retu-mfd.ko 2024-02-17T12:02:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/si476x-core.ko 2024-02-17T12:02:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/sm501.ko 2024-02-17T12:02:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/tps65010.ko 2024-02-17T12:02:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/tps6507x.ko 2024-02-17T12:02:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/viperboard.ko 2024-02-17T12:02:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/vx855.ko 2024-02-17T12:02:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/wl1273-core.ko 2024-02-17T12:02:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/mfd/wm8994.ko 2024-02-17T12:02:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ 2024-02-17T12:02:58.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ad525x_dpot.ko 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/altera-stapl/ 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/apds9802als.ko 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/apds990x.ko 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/bh1770glc.ko 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/c2port/ 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/c2port/core.ko 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/cb710/ 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/cb710/cb710.ko 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ds1682.ko 2024-02-17T12:02:58.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/dummy-irq.ko 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/echo/ 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/echo/echo.ko 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/ 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/at24.ko 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/eeprom/max6875.ko 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/enclosure.ko 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/genwqe/ 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 152073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/hmc6352.ko 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/hpilo.ko 2024-02-17T12:02:58.487 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ibmasm/ 2024-02-17T12:02:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-02-17T12:02:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ics932s401.ko 2024-02-17T12:02:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/isl29003.ko 2024-02-17T12:02:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/isl29020.ko 2024-02-17T12:02:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/ 2024-02-17T12:02:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-17T12:02:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-17T12:02:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/ 2024-02-17T12:02:58.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei-me.ko 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei-txe.ko 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 313601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/mei/mei.ko 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/phantom.ko 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ti-st/ 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/ti-st/st_drv.ko 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tifm_7xx1.ko 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tifm_core.ko 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/tsl2550.ko 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_balloon.ko 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_vmci/ 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 183569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-17T12:02:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ 2024-02-17T12:02:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/bonding/ 2024-02-17T12:02:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 491721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/bonding/bonding.ko 2024-02-17T12:02:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/ 2024-02-17T12:02:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/b53/ 2024-02-17T12:02:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 105937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-17T12:02:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-17T12:02:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-17T12:02:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6xxx/ 2024-02-17T12:02:58.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 459065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/dummy.ko 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/eql.ko 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/ 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 130665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/ 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-17T12:02:58.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-17T12:02:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-17T12:02:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-17T12:02:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/adaptec/ 2024-02-17T12:02:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-17T12:02:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/agere/ 2024-02-17T12:02:58.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-17T12:02:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/alteon/ 2024-02-17T12:02:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-17T12:02:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/altera/ 2024-02-17T12:02:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-17T12:02:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/ 2024-02-17T12:02:58.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-17T12:02:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-17T12:02:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-17T12:02:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/ 2024-02-17T12:02:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/alx/ 2024-02-17T12:02:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-17T12:02:58.494 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-02-17T12:02:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-17T12:02:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-02-17T12:02:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-17T12:02:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/ 2024-02-17T12:02:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-17T12:02:58.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-17T12:02:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/ 2024-02-17T12:02:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-17T12:02:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 176697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-17T12:02:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-02-17T12:02:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1434505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-17T12:02:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 128433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-17T12:02:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/genet/ 2024-02-17T12:02:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 131281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-17T12:02:58.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 314329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/ 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/bna/ 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 323737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/ 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 193593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 347217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1045449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-02-17T12:02:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 166145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/ 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/enic/ 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 204249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/ 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/ 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 141201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-17T12:02:58.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-17T12:02:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-17T12:02:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/ 2024-02-17T12:02:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-17T12:02:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-17T12:02:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/dnet.ko 2024-02-17T12:02:58.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ec_bhf.ko 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/ 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/benet/ 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 281217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ethoc.ko 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/fealnx.ko 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/fujitsu/ 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000/ 2024-02-17T12:02:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 295697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000e/ 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 584353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/fm10k/ 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 246041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/i40e/ 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 944865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/iavf/ 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 288529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igb/ 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 513857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igbvf/ 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 93489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-17T12:02:58.501 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 734729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 151745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 86993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/jme.ko 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/ 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/ 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 727481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-17T12:02:58.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 278881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-17T12:02:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-02-17T12:02:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-02-17T12:02:58.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1121769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-17T12:02:58.646 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 95577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/ 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/ 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-17T12:02:58.647 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/neterion/ 2024-02-17T12:02:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 151097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-17T12:02:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/nvidia/ 2024-02-17T12:02:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 136801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-17T12:02:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/ 2024-02-17T12:02:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-17T12:02:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-17T12:02:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/ 2024-02-17T12:02:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-02-17T12:02:58.648 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 227865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 672057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rdc/ 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/ 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 194073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/samsung/ 2024-02-17T12:02:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 104049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sfc/ 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1067001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/silan/ 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/ 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/ 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-17T12:02:58.650 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/ 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 497201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/ 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 166049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-17T12:02:58.651 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/tehuti/ 2024-02-17T12:02:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-17T12:02:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ti/ 2024-02-17T12:02:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 92345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-17T12:02:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/ 2024-02-17T12:02:58.652 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-17T12:02:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-17T12:02:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/ 2024-02-17T12:02:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-17T12:02:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-17T12:02:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/xircom/ 2024-02-17T12:02:58.653 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-17T12:02:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/fddi/ 2024-02-17T12:02:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/fddi/defxx.ko 2024-02-17T12:02:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/fddi/skfp/ 2024-02-17T12:02:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 217065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/fddi/skfp/skfp.ko 2024-02-17T12:02:58.654 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/geneve.ko 2024-02-17T12:02:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/hyperv/ 2024-02-17T12:02:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 237265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-17T12:02:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ieee802154/ 2024-02-17T12:02:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-17T12:02:58.655 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ifb.ko 2024-02-17T12:02:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ipvlan/ 2024-02-17T12:02:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-17T12:02:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/macvlan.ko 2024-02-17T12:02:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/macvtap.ko 2024-02-17T12:02:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/ 2024-02-17T12:02:58.656 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-17T12:02:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-17T12:02:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-gpio.ko 2024-02-17T12:02:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-17T12:02:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mdio.ko 2024-02-17T12:02:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/mii.ko 2024-02-17T12:02:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/netconsole.ko 2024-02-17T12:02:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/nlmon.ko 2024-02-17T12:02:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/ 2024-02-17T12:02:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-17T12:02:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-17T12:02:58.658 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/ 2024-02-17T12:02:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/amd.ko 2024-02-17T12:02:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-17T12:02:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-17T12:02:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/bcm87xx.ko 2024-02-17T12:02:58.659 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/broadcom.ko 2024-02-17T12:02:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/cicada.ko 2024-02-17T12:02:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/davicom.ko 2024-02-17T12:02:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/et1011c.ko 2024-02-17T12:02:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/icplus.ko 2024-02-17T12:02:58.660 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/lxt.ko 2024-02-17T12:02:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/marvell.ko 2024-02-17T12:02:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/micrel.ko 2024-02-17T12:02:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/national.ko 2024-02-17T12:02:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 99009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/phylink.ko 2024-02-17T12:02:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/qsemi.ko 2024-02-17T12:02:58.661 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/realtek.ko 2024-02-17T12:02:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/smsc.ko 2024-02-17T12:02:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/ste10Xp.ko 2024-02-17T12:02:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/phy/vitesse.ko 2024-02-17T12:02:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/plip/ 2024-02-17T12:02:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/plip/plip.ko 2024-02-17T12:02:58.662 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ 2024-02-17T12:02:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-17T12:02:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_async.ko 2024-02-17T12:02:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-17T12:02:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-17T12:02:58.663 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-17T12:02:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pppoe.ko 2024-02-17T12:02:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pppox.ko 2024-02-17T12:02:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/ppp/pptp.ko 2024-02-17T12:02:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/sb1000.ko 2024-02-17T12:02:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip/ 2024-02-17T12:02:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/slip/slip.ko 2024-02-17T12:02:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/sungem_phy.ko 2024-02-17T12:02:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/tap.ko 2024-02-17T12:02:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/ 2024-02-17T12:02:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 107233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team.ko 2024-02-17T12:02:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-17T12:02:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-17T12:02:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-17T12:02:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_random.ko 2024-02-17T12:02:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-17T12:02:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/veth.ko 2024-02-17T12:02:58.666 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vmxnet3/ 2024-02-17T12:02:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 144361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-17T12:02:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vxlan/ 2024-02-17T12:02:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 307257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/vxlan/vxlan.ko 2024-02-17T12:02:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netback/ 2024-02-17T12:02:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 143905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-17T12:02:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ntb/ 2024-02-17T12:02:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ntb/ntb.ko 2024-02-17T12:02:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/ 2024-02-17T12:02:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/ 2024-02-17T12:02:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 267745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/nvme-core.ko 2024-02-17T12:02:58.668 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/nvme/host/nvme.ko 2024-02-17T12:02:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/ 2024-02-17T12:02:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 131329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport.ko 2024-02-17T12:02:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_cs.ko 2024-02-17T12:02:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_pc.ko 2024-02-17T12:02:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/parport/parport_serial.ko 2024-02-17T12:02:58.669 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/ 2024-02-17T12:02:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/ 2024-02-17T12:02:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-17T12:02:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-02-17T12:02:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-02-17T12:02:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/pci-stub.ko 2024-02-17T12:02:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pci/xen-pcifront.ko 2024-02-17T12:02:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/ 2024-02-17T12:02:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/i82092.ko 2024-02-17T12:02:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 146153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pcmcia.ko 2024-02-17T12:02:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pcmcia_core.ko 2024-02-17T12:02:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-02-17T12:02:58.671 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/pd6729.ko 2024-02-17T12:02:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 112793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-17T12:02:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/phy/ 2024-02-17T12:02:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/phy/broadcom/ 2024-02-17T12:02:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-02-17T12:02:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/phy/samsung/ 2024-02-17T12:02:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-02-17T12:02:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/ 2024-02-17T12:02:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/intel/ 2024-02-17T12:02:58.672 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/ 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/ 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_ec.ko 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/ 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-17T12:02:58.673 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/acerhdf.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 131945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/hdaps.ko 2024-02-17T12:02:58.674 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/ibm_rtl.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel/ 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/intel_ips.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-17T12:02:58.675 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/platform/x86/wmi.ko 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/ 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/ 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/88pm860x_battery.ko 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/88pm860x_charger.ko 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/bq2415x_charger.ko 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/bq24190_charger.ko 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/bq24735-charger.ko 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/da9030_battery.ko 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/da9052-battery.ko 2024-02-17T12:02:58.676 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/ds2760_battery.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/ds2780_battery.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/ds2781_battery.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/ds2782_battery.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/gpio-charger.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/isp1704_charger.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/lp8727_charger.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/max14577_charger.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/max17042_battery.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/max8903_charger.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/max8925_power.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/pcf50633-charger.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/sbs-battery.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/test_power.ko 2024-02-17T12:02:58.677 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/tps65090-charger.ko 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/wm831x_backup.ko 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/wm831x_power.ko 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/power/supply/wm8350_power.ko 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/ 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/ 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/ 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/clients/pps_parport.ko 2024-02-17T12:02:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/pps/pps_core.ko 2024-02-17T12:02:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ 2024-02-17T12:02:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ptp.ko 2024-02-17T12:02:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ptp/ptp_kvm.ko 2024-02-17T12:02:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/ 2024-02-17T12:02:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-88pm80x.ko 2024-02-17T12:02:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-88pm860x.ko 2024-02-17T12:02:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-17T12:02:58.679 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-da9052.ko 2024-02-17T12:02:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-da9055.ko 2024-02-17T12:02:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-da9063.ko 2024-02-17T12:02:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-17T12:02:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-17T12:02:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-17T12:02:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-17T12:02:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-17T12:02:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-17T12:02:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-17T12:02:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-em3027.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-lp8788.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-m48t86.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max6900.ko 2024-02-17T12:02:58.681 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max8907.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max8925.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max8997.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-max8998.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-palmas.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf50633.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-17T12:02:58.682 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rc5t583.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-s35390a.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-tps6586x.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-tps65910.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-wm831x.ko 2024-02-17T12:02:58.683 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-wm8350.ko 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/rtc/rtc-x1205.ko 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-9xxx.ko 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-sas.ko 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/3w-xxxx.ko 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 135345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/BusLogic.ko 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/a100u2w.ko 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aacraid/ 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 271441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/advansys.ko 2024-02-17T12:02:58.684 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/ 2024-02-17T12:02:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 356865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-17T12:02:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 295993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-17T12:02:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic94xx/ 2024-02-17T12:02:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 189145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-02-17T12:02:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/am53c974.ko 2024-02-17T12:02:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/arcmsr/ 2024-02-17T12:02:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-17T12:02:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/atp870u.ko 2024-02-17T12:02:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/be2iscsi/ 2024-02-17T12:02:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 246937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bfa/ 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1171953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bfa/bfa.ko 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2fc/ 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 238401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2i/ 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ch.ko 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/csiostor/ 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 308961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/ 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-02-17T12:02:58.686 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-17T12:02:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-02-17T12:02:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-17T12:02:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 146817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-17T12:02:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 75977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/dc395x.ko 2024-02-17T12:02:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/dmx3191d.ko 2024-02-17T12:02:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esas2r/ 2024-02-17T12:02:58.687 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 212385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-17T12:02:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/esp_scsi.ko 2024-02-17T12:02:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/ 2024-02-17T12:02:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-17T12:02:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 157961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-17T12:02:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fdomain.ko 2024-02-17T12:02:58.688 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fnic/ 2024-02-17T12:02:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 294601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/fnic/fnic.ko 2024-02-17T12:02:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 201729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hpsa.ko 2024-02-17T12:02:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hptiop.ko 2024-02-17T12:02:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/hv_storvsc.ko 2024-02-17T12:02:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/imm.ko 2024-02-17T12:02:58.689 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/initio.ko 2024-02-17T12:02:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 265945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ipr.ko 2024-02-17T12:02:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ips.ko 2024-02-17T12:02:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/isci/ 2024-02-17T12:02:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 317193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/isci/isci.ko 2024-02-17T12:02:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-17T12:02:58.690 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-17T12:02:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libfc/ 2024-02-17T12:02:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 315385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libfc/libfc.ko 2024-02-17T12:02:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 145497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libiscsi.ko 2024-02-17T12:02:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-17T12:02:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libsas/ 2024-02-17T12:02:58.691 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 216401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/libsas/libsas.ko 2024-02-17T12:02:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/lpfc/ 2024-02-17T12:02:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2194089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-17T12:02:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/ 2024-02-17T12:02:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-17T12:02:58.692 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-17T12:02:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 310689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-17T12:02:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/megaraid.ko 2024-02-17T12:02:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mpt3sas/ 2024-02-17T12:02:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 659569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-17T12:02:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvsas/ 2024-02-17T12:02:58.693 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-17T12:02:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/mvumi.ko 2024-02-17T12:02:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pcmcia/ 2024-02-17T12:02:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-02-17T12:02:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-02-17T12:02:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-02-17T12:02:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-02-17T12:02:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pm8001/ 2024-02-17T12:02:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 366337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-17T12:02:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/pmcraid.ko 2024-02-17T12:02:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ppa.ko 2024-02-17T12:02:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla1280.ko 2024-02-17T12:02:58.695 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/ 2024-02-17T12:02:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1876753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-17T12:02:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-17T12:02:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla4xxx/ 2024-02-17T12:02:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 558953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-17T12:02:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/qlogicfas408.ko 2024-02-17T12:02:58.696 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/raid_class.ko 2024-02-17T12:02:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 261081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_debug.ko 2024-02-17T12:02:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 173929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-17T12:02:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 280113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-17T12:02:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-17T12:02:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-17T12:02:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-17T12:02:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/ses.ko 2024-02-17T12:02:58.697 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/st.ko 2024-02-17T12:02:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/stex.ko 2024-02-17T12:02:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/sym53c8xx_2/ 2024-02-17T12:02:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 164889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-17T12:02:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/virtio_scsi.ko 2024-02-17T12:02:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-17T12:02:58.698 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/wd719x.ko 2024-02-17T12:02:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/scsi/xen-scsifront.ko 2024-02-17T12:02:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ssb/ 2024-02-17T12:02:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 129393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ssb/ssb.ko 2024-02-17T12:02:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/ 2024-02-17T12:02:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/iscsi/ 2024-02-17T12:02:58.699 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 736761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-17T12:02:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/loopback/ 2024-02-17T12:02:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-17T12:02:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_file.ko 2024-02-17T12:02:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_iblock.ko 2024-02-17T12:02:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 930977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_mod.ko 2024-02-17T12:02:58.700 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_pscsi.ko 2024-02-17T12:02:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/target_core_user.ko 2024-02-17T12:02:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/tcm_fc/ 2024-02-17T12:02:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 75521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-17T12:02:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/ 2024-02-17T12:02:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/ 2024-02-17T12:02:58.701 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/ 2024-02-17T12:02:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-17T12:02:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-17T12:02:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-17T12:02:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-17T12:02:58.702 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-17T12:02:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-17T12:02:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-17T12:02:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-17T12:02:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-17T12:02:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-17T12:02:58.703 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-17T12:02:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-17T12:02:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-17T12:02:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-17T12:02:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-17T12:02:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-02-17T12:02:58.704 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-17T12:02:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-17T12:02:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-17T12:02:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ 2024-02-17T12:02:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ipwireless/ 2024-02-17T12:02:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-17T12:02:58.705 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/moxa.ko 2024-02-17T12:02:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/mxser.ko 2024-02-17T12:02:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/n_gsm.ko 2024-02-17T12:02:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/n_hdlc.ko 2024-02-17T12:02:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/nozomi.ko 2024-02-17T12:02:58.706 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/ 2024-02-17T12:02:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250/ 2024-02-17T12:02:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-02-17T12:02:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-17T12:02:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-02-17T12:02:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/altera_uart.ko 2024-02-17T12:02:58.707 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/arc_uart.ko 2024-02-17T12:02:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-02-17T12:02:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/jsm/ 2024-02-17T12:02:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-17T12:02:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/rp2.ko 2024-02-17T12:02:58.708 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/tty/serial/sc16is7xx.ko 2024-02-17T12:02:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/ 2024-02-17T12:02:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/core/ 2024-02-17T12:02:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 545401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-17T12:02:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host/ 2024-02-17T12:02:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-17T12:02:58.709 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-02-17T12:02:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/ 2024-02-17T12:02:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio.ko 2024-02-17T12:02:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_aec.ko 2024-02-17T12:02:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_cif.ko 2024-02-17T12:02:58.710 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_dmem_genirq.ko 2024-02-17T12:02:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_mf624.ko 2024-02-17T12:02:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_netx.ko 2024-02-17T12:02:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_pci_generic.ko 2024-02-17T12:02:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-02-17T12:02:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/uio/uio_sercos3.ko 2024-02-17T12:02:58.711 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/ 2024-02-17T12:02:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/c67x00/ 2024-02-17T12:02:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/c67x00/c67x00.ko 2024-02-17T12:02:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ 2024-02-17T12:02:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 145793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-02-17T12:02:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-02-17T12:02:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-02-17T12:02:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-02-17T12:02:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-02-17T12:02:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/ 2024-02-17T12:02:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/cdc-acm.ko 2024-02-17T12:02:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-17T12:02:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/usblp.ko 2024-02-17T12:02:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/class/usbtmc.ko 2024-02-17T12:02:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/common/ 2024-02-17T12:02:58.713 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/common/ulpi.ko 2024-02-17T12:02:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc2/ 2024-02-17T12:02:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-02-17T12:02:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc3/ 2024-02-17T12:02:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-02-17T12:02:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-02-17T12:02:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 452577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/dwc3/dwc3.ko 2024-02-17T12:02:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/ 2024-02-17T12:02:58.714 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/ 2024-02-17T12:02:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/u_ether.ko 2024-02-17T12:02:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/u_serial.ko 2024-02-17T12:02:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-02-17T12:02:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-02-17T12:02:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-02-17T12:02:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-02-17T12:02:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 92409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-02-17T12:02:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-02-17T12:02:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-02-17T12:02:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-02-17T12:02:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-02-17T12:02:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-02-17T12:02:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-02-17T12:02:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-02-17T12:02:58.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/ 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-02-17T12:02:58.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 161233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/libcomposite.ko 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/ 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/bdc/ 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 157617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-02-17T12:02:58.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-02-17T12:02:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-02-17T12:02:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-02-17T12:02:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 75969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/net2272.ko 2024-02-17T12:02:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/net2280.ko 2024-02-17T12:02:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-02-17T12:02:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-02-17T12:02:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-02-17T12:02:58.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-02-17T12:02:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 156337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-02-17T12:02:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/ 2024-02-17T12:02:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/bcma-hcd.ko 2024-02-17T12:02:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/isp116x-hcd.ko 2024-02-17T12:02:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-02-17T12:02:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-02-17T12:02:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-17T12:02:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/sl811_cs.ko 2024-02-17T12:02:58.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/ssb-hcd.ko 2024-02-17T12:02:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-02-17T12:02:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/ 2024-02-17T12:02:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/mdc800.ko 2024-02-17T12:02:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/image/microtek.ko 2024-02-17T12:02:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ 2024-02-17T12:02:58.721 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/adutux.ko 2024-02-17T12:02:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/appledisplay.ko 2024-02-17T12:02:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-02-17T12:02:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/cytherm.ko 2024-02-17T12:02:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ehset.ko 2024-02-17T12:02:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/emi26.ko 2024-02-17T12:02:58.722 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/emi62.ko 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ezusb.ko 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/idmouse.ko 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/iowarrior.ko 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/ldusb.ko 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/legousbtower.ko 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/lvstest.ko 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/sisusbvga/ 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-17T12:02:58.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usb3503.ko 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usblcd.ko 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/usbtest.ko 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/uss720.ko 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/misc/yurex.ko 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/mon/ 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/mon/usbmon.ko 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/musb/ 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 301633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/musb/musb_hdrc.ko 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/ 2024-02-17T12:02:58.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-generic.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-isp1301.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/phy/phy-tahvo.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/aircable.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ark3116.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ch341.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cp210x.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cyberjack.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-17T12:02:58.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/empeg.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/f81232.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 175105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 136985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/io_ti.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ipaq.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ipw.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ir-usb.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 107433 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/keyspan.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-17T12:02:58.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mct_u232.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/metro-usb.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mos7720.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mos7840.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/mxuport.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/navman.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/omninet.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/opticon.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 191825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/option.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/oti6858.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/pl2303.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/qcaux.ko 2024-02-17T12:02:58.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/qcserial.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/quatech2.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/safe_serial.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/sierra.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ssu100.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/symbolserial.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb_debug.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/usbserial.ko 2024-02-17T12:02:58.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/visor.ko 2024-02-17T12:02:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/whiteheat.ko 2024-02-17T12:02:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/wishbone-serial.ko 2024-02-17T12:02:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-17T12:02:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ 2024-02-17T12:02:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/uas.ko 2024-02-17T12:02:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-17T12:02:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-17T12:02:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-17T12:02:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-17T12:02:58.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-17T12:02:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-17T12:02:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-17T12:02:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-karma.ko 2024-02-17T12:02:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-17T12:02:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-17T12:02:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-17T12:02:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-17T12:02:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-17T12:02:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 180329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/storage/usb-storage.ko 2024-02-17T12:02:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/ 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 104065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/ 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/ 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 162865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/vfio.ko 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/ 2024-02-17T12:02:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost.ko 2024-02-17T12:02:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-17T12:02:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_net.ko 2024-02-17T12:02:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/vhost/vhost_scsi.ko 2024-02-17T12:02:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/ 2024-02-17T12:02:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/ 2024-02-17T12:02:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-02-17T12:02:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/aat2870_bl.ko 2024-02-17T12:02:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/adp5520_bl.ko 2024-02-17T12:02:58.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/adp8860_bl.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/adp8870_bl.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/apple_bl.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/as3711_bl.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/bd6107.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/da903x_bl.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/da9052_bl.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/gpio_backlight.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/kb3886_bl.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lcd.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lm3533_bl.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lm3639_bl.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/lv5207lp.ko 2024-02-17T12:02:58.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/max8925_bl.ko 2024-02-17T12:02:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/pandora_bl.ko 2024-02-17T12:02:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-02-17T12:02:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-17T12:02:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/video/backlight/wm831x_bl.ko 2024-02-17T12:02:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/ 2024-02-17T12:02:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ 2024-02-17T12:02:58.734 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ds2482.ko 2024-02-17T12:02:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/ds2490.ko 2024-02-17T12:02:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/matrox_w1.ko 2024-02-17T12:02:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/masters/w1-gpio.ko 2024-02-17T12:02:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/ 2024-02-17T12:02:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-17T12:02:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-17T12:02:58.735 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103049 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/w1/wire.ko 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ 2024-02-17T12:02:58.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/acquirewdt.ko 2024-02-17T12:02:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/advantechwdt.ko 2024-02-17T12:02:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18465 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-17T12:02:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-17T12:02:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/cpu5wdt.ko 2024-02-17T12:02:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/da9052_wdt.ko 2024-02-17T12:02:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/da9055_wdt.ko 2024-02-17T12:02:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/da9063_wdt.ko 2024-02-17T12:02:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/dw_wdt.ko 2024-02-17T12:02:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/eurotechwdt.ko 2024-02-17T12:02:58.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-17T12:02:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/hpwdt.ko 2024-02-17T12:02:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/i6300esb.ko 2024-02-17T12:02:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-17T12:02:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-17T12:02:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ib700wdt.ko 2024-02-17T12:02:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ibmasr.ko 2024-02-17T12:02:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-17T12:02:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-17T12:02:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/it87_wdt.ko 2024-02-17T12:02:58.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21393 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/kempld_wdt.ko 2024-02-17T12:02:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/machzwd.ko 2024-02-17T12:02:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/mena21_wdt.ko 2024-02-17T12:02:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-02-17T12:02:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/nv_tco.ko 2024-02-17T12:02:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-02-17T12:02:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pc87413_wdt.ko 2024-02-17T12:02:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39921 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-17T12:02:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-17T12:02:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/retu_wdt.ko 2024-02-17T12:02:58.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-02-17T12:02:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-02-17T12:02:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-17T12:02:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sc1200wdt.ko 2024-02-17T12:02:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-17T12:02:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21481 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-02-17T12:02:58.740 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/softdog.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/twl4030_wdt.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/via_wdt.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wafer5823wdt.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wdt_pci.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wm831x_wdt.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13689 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/wm8350_wdt.ko 2024-02-17T12:02:58.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15609 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/watchdog/xen_wdt.ko 2024-02-17T12:02:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/ 2024-02-17T12:02:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-evtchn.ko 2024-02-17T12:02:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-gntalloc.ko 2024-02-17T12:02:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-gntdev.ko 2024-02-17T12:02:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-pciback/ 2024-02-17T12:02:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 176385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-17T12:02:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-privcmd.ko 2024-02-17T12:02:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xen-scsiback.ko 2024-02-17T12:02:58.742 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xenfs/ 2024-02-17T12:02:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-17T12:02:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ 2024-02-17T12:02:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/9p/ 2024-02-17T12:02:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 158281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/9p/9p.ko 2024-02-17T12:02:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/adfs/ 2024-02-17T12:02:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/adfs/adfs.ko 2024-02-17T12:02:58.743 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/affs/ 2024-02-17T12:02:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 163377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/affs/affs.ko 2024-02-17T12:02:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/afs/ 2024-02-17T12:02:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1018985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/afs/kafs.ko 2024-02-17T12:02:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/autofs/ 2024-02-17T12:02:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/autofs/autofs4.ko 2024-02-17T12:02:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/befs/ 2024-02-17T12:02:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/befs/befs.ko 2024-02-17T12:02:58.744 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/bfs/ 2024-02-17T12:02:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/bfs/bfs.ko 2024-02-17T12:02:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/binfmt_misc.ko 2024-02-17T12:02:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/btrfs/ 2024-02-17T12:02:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 3484777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/btrfs/btrfs.ko 2024-02-17T12:02:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cachefiles/ 2024-02-17T12:02:58.745 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 305737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cachefiles/cachefiles.ko 2024-02-17T12:02:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ceph/ 2024-02-17T12:02:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1335377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ceph/ceph.ko 2024-02-17T12:02:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/coda/ 2024-02-17T12:02:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/coda/coda.ko 2024-02-17T12:02:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/configfs/ 2024-02-17T12:02:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/configfs/configfs.ko 2024-02-17T12:02:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cramfs/ 2024-02-17T12:02:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29593 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/cramfs/cramfs.ko 2024-02-17T12:02:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/dlm/ 2024-02-17T12:02:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 644249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/dlm/dlm.ko 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/efs/ 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/efs/efs.ko 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/f2fs/ 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1527729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/f2fs/f2fs.ko 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/ 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fat/msdos.ko 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/freevxfs/ 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/freevxfs/freevxfs.ko 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse/ 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/fuse/cuse.ko 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/gfs2/ 2024-02-17T12:02:58.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1231361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/gfs2/gfs2.ko 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfs/ 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 141713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfs/hfs.ko 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfsplus/ 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 222897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hfsplus/hfsplus.ko 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hpfs/ 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 193545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/hpfs/hpfs.ko 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/isofs/ 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/isofs/isofs.ko 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/jfs/ 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 420449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/jfs/jfs.ko 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/lockd/ 2024-02-17T12:02:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 281705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/lockd/lockd.ko 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/minix/ 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 88937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/minix/minix.ko 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/netfs/ 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 490001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/netfs/netfs.ko 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/ 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/blocklayout/ 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/filelayout/ 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/flexfilelayout/ 2024-02-17T12:02:58.749 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 117377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-17T12:02:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1057985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfs.ko 2024-02-17T12:02:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv2.ko 2024-02-17T12:02:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv3.ko 2024-02-17T12:02:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2041825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs/nfsv4.ko 2024-02-17T12:02:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/ 2024-02-17T12:02:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/grace.ko 2024-02-17T12:02:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfs_common/nfs_acl.ko 2024-02-17T12:02:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfsd/ 2024-02-17T12:02:58.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1511665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nfsd/nfsd.ko 2024-02-17T12:02:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nilfs2/ 2024-02-17T12:02:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 582529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nilfs2/nilfs2.ko 2024-02-17T12:02:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/ 2024-02-17T12:02:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-celtic.ko 2024-02-17T12:02:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-centeuro.ko 2024-02-17T12:02:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-croatian.ko 2024-02-17T12:02:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-cyrillic.ko 2024-02-17T12:02:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-gaelic.ko 2024-02-17T12:02:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-greek.ko 2024-02-17T12:02:58.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-iceland.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-inuit.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-roman.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-romanian.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/mac-turkish.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_ascii.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1250.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1251.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp1255.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp737.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp775.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp850.ko 2024-02-17T12:02:58.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp852.ko 2024-02-17T12:02:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp855.ko 2024-02-17T12:02:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp857.ko 2024-02-17T12:02:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp860.ko 2024-02-17T12:02:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp861.ko 2024-02-17T12:02:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp862.ko 2024-02-17T12:02:58.753 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp863.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp864.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp865.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp866.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp869.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp874.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp932.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 142577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp936.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 165649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp949.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 118025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_cp950.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_euc-jp.ko 2024-02-17T12:02:58.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-1.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-13.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-14.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-15.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-2.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-3.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-4.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-5.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-6.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-7.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_iso8859-9.ko 2024-02-17T12:02:58.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-r.ko 2024-02-17T12:02:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-ru.ko 2024-02-17T12:02:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_koi8-u.ko 2024-02-17T12:02:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-17T12:02:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/nls/nls_utf8.ko 2024-02-17T12:02:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ntfs/ 2024-02-17T12:02:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 220545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ntfs/ntfs.ko 2024-02-17T12:02:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ 2024-02-17T12:02:58.756 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/cluster/ 2024-02-17T12:02:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 244673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-17T12:02:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlm/ 2024-02-17T12:02:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 440681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-17T12:02:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlmfs/ 2024-02-17T12:02:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54177 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-17T12:02:58.757 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2590849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2.ko 2024-02-17T12:02:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-17T12:02:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-17T12:02:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-17T12:02:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/omfs/ 2024-02-17T12:02:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/omfs/omfs.ko 2024-02-17T12:02:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/overlayfs/ 2024-02-17T12:02:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 361169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/overlayfs/overlay.ko 2024-02-17T12:02:58.758 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/pstore/ 2024-02-17T12:02:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/pstore/ramoops.ko 2024-02-17T12:02:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/qnx4/ 2024-02-17T12:02:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/qnx4/qnx4.ko 2024-02-17T12:02:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/qnx6/ 2024-02-17T12:02:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46625 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/qnx6/qnx6.ko 2024-02-17T12:02:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/quota/ 2024-02-17T12:02:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/quota/quota_tree.ko 2024-02-17T12:02:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/quota/quota_v1.ko 2024-02-17T12:02:58.759 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/quota/quota_v2.ko 2024-02-17T12:02:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/reiserfs/ 2024-02-17T12:02:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 532289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/reiserfs/reiserfs.ko 2024-02-17T12:02:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/romfs/ 2024-02-17T12:02:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/romfs/romfs.ko 2024-02-17T12:02:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/ 2024-02-17T12:02:58.760 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/client/ 2024-02-17T12:02:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2710993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/client/cifs.ko 2024-02-17T12:02:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/ 2024-02-17T12:02:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7065 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/cifs_arc4.ko 2024-02-17T12:02:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/smb/common/cifs_md4.ko 2024-02-17T12:02:58.761 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/squashfs/ 2024-02-17T12:02:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 134809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/squashfs/squashfs.ko 2024-02-17T12:02:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/sysv/ 2024-02-17T12:02:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/sysv/sysv.ko 2024-02-17T12:02:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/udf/ 2024-02-17T12:02:58.762 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 248409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/udf/udf.ko 2024-02-17T12:02:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ufs/ 2024-02-17T12:02:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 162785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/ufs/ufs.ko 2024-02-17T12:02:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/xfs/ 2024-02-17T12:02:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 4036329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/fs/xfs/xfs.ko 2024-02-17T12:02:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/ 2024-02-17T12:02:58.763 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/locking/ 2024-02-17T12:02:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/locking/locktorture.ko 2024-02-17T12:02:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/time/ 2024-02-17T12:02:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/time/test_udelay.ko 2024-02-17T12:02:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/kernel/torture.ko 2024-02-17T12:02:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc-itu-t.ko 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc7.ko 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crc8.ko 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/ 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/libarc4.ko 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/crypto/libdes.ko 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/interval_tree_test.ko 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/libcrc32c.ko 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lru_cache.ko 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/ 2024-02-17T12:02:58.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/lz4_compress.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/lz4/lz4hc_compress.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/math/ 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/math/cordic.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/memory-notifier-error-inject.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/notifier-error-inject.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/percpu_test.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/pm-notifier-error-inject.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/raid6/ 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 143337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/raid6/raid6_pq.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/rbtree_test.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/reed_solomon/ 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test-kstrtox.ko 2024-02-17T12:02:58.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test-string_helpers.ko 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 4863225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test_bpf.ko 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test_firmware.ko 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test_module.ko 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/test_user_copy.ko 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_bm.ko 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_fsm.ko 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/ts_kmp.ko 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/xz/ 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/lib/xz/xz_dec_test.ko 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/mm/ 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18129 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/mm/hwpoison-inject.ko 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ 2024-02-17T12:02:58.767 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/ 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/6lowpan.ko 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_dest.ko 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_fragment.ko 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6961 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_hop.ko 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_mobility.ko 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_routing.ko 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/6lowpan/nhc_udp.ko 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/ 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/garp.ko 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/mrp.ko 2024-02-17T12:02:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/p8022.ko 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/psnap.ko 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/802/stp.ko 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/8021q/ 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/8021q/8021q.ko 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/ 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 198833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet.ko 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_fd.ko 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_rdma.ko 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/9p/9pnet_virtio.ko 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/batman-adv/ 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 667545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/batman-adv/batman-adv.ko 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/ 2024-02-17T12:02:58.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/br_netfilter.ko 2024-02-17T12:02:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 791305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/bridge.ko 2024-02-17T12:02:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ 2024-02-17T12:02:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-17T12:02:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-17T12:02:58.770 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-17T12:02:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-17T12:02:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-17T12:02:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-17T12:02:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-17T12:02:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-17T12:02:58.771 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-17T12:02:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-17T12:02:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-17T12:02:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-17T12:02:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-17T12:02:58.772 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-17T12:02:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-17T12:02:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-17T12:02:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-17T12:02:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-17T12:02:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-17T12:02:58.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-17T12:02:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/ebtables.ko 2024-02-17T12:02:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-17T12:02:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-17T12:02:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ceph/ 2024-02-17T12:02:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1046801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ceph/libceph.ko 2024-02-17T12:02:58.774 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core/ 2024-02-17T12:02:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/core/pktgen.ko 2024-02-17T12:02:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/ 2024-02-17T12:02:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 194505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp.ko 2024-02-17T12:02:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_diag.ko 2024-02-17T12:02:58.775 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_ipv4.ko 2024-02-17T12:02:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dccp/dccp_ipv6.ko 2024-02-17T12:02:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/ 2024-02-17T12:02:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 390089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/dsa_core.ko 2024-02-17T12:02:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13361 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_brcm.ko 2024-02-17T12:02:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12601 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_dsa.ko 2024-02-17T12:02:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_none.ko 2024-02-17T12:02:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/dsa/tag_trailer.ko 2024-02-17T12:02:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/hsr/ 2024-02-17T12:02:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102073 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/hsr/hsr.ko 2024-02-17T12:02:58.776 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/6lowpan/ 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 284721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ieee802154.ko 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ah4.ko 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/esp4.ko 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/fou.ko 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/gre.ko 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/inet_diag.ko 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_gre.ko 2024-02-17T12:02:58.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_tunnel.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ip_vti.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ipcomp.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/ipip.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42057 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ip_tables.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9585 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-17T12:02:58.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14785 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13241 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-17T12:02:58.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_bic.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_dctcp.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15969 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_diag.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_highspeed.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_htcp.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_hybla.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_illinois.ko 2024-02-17T12:02:58.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_lp.ko 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_scalable.ko 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_vegas.ko 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_veno.ko 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10857 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_westwood.ko 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tcp_yeah.ko 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/tunnel4.ko 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/udp_diag.ko 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/udp_tunnel.ko 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ 2024-02-17T12:02:58.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ah6.ko 2024-02-17T12:02:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/esp6.ko 2024-02-17T12:02:58.782 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/fou6.ko 2024-02-17T12:02:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_gre.ko 2024-02-17T12:02:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_tunnel.ko 2024-02-17T12:02:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-17T12:02:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ip6_vti.ko 2024-02-17T12:02:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/ipcomp6.ko 2024-02-17T12:02:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/mip6.ko 2024-02-17T12:02:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ 2024-02-17T12:02:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-17T12:02:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-02-17T12:02:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-17T12:02:58.784 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-17T12:02:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-17T12:02:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-17T12:02:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-17T12:02:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-17T12:02:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-17T12:02:58.785 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-17T12:02:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-17T12:02:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-17T12:02:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-17T12:02:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-17T12:02:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15025 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-17T12:02:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-17T12:02:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-17T12:02:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-17T12:02:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-17T12:02:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-17T12:02:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-17T12:02:58.787 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-17T12:02:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-17T12:02:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-17T12:02:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8913 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-17T12:02:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/sit.ko 2024-02-17T12:02:58.788 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/tunnel6.ko 2024-02-17T12:02:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-17T12:02:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/key/ 2024-02-17T12:02:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/key/af_key.ko 2024-02-17T12:02:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/ 2024-02-17T12:02:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_core.ko 2024-02-17T12:02:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-17T12:02:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_eth.ko 2024-02-17T12:02:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36497 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ip.ko 2024-02-17T12:02:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ip6.ko 2024-02-17T12:02:58.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_netlink.ko 2024-02-17T12:02:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/l2tp/l2tp_ppp.ko 2024-02-17T12:02:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/lapb/ 2024-02-17T12:02:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/lapb/lapb.ko 2024-02-17T12:02:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc/ 2024-02-17T12:02:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc/llc.ko 2024-02-17T12:02:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 268521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/llc/llc2.ko 2024-02-17T12:02:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mac802154/ 2024-02-17T12:02:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 309417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mac802154/mac802154.ko 2024-02-17T12:02:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mpls/ 2024-02-17T12:02:58.790 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/mpls/mpls_gso.ko 2024-02-17T12:02:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ 2024-02-17T12:02:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ 2024-02-17T12:02:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119705 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set.ko 2024-02-17T12:02:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28617 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-17T12:02:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-17T12:02:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-17T12:02:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 99993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-17T12:02:58.791 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100281 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 111673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 112145 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 112409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 110337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113289 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-17T12:02:58.792 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 412513 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11993 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10641 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9265 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-17T12:02:58.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13545 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-17T12:02:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7721 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-17T12:02:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-17T12:02:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conncount.ko 2024-02-17T12:02:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 411745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack.ko 2024-02-17T12:02:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15881 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-17T12:02:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-17T12:02:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-17T12:02:58.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 118097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 92209 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_flow_table.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_log_syslog.ko 2024-02-17T12:02:58.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 96521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat.ko 2024-02-17T12:02:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-17T12:02:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12529 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-17T12:02:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_irc.ko 2024-02-17T12:02:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_sip.ko 2024-02-17T12:02:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-17T12:02:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44137 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-17T12:02:58.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 623417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nf_tables.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_log.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49649 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_chain_nat.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_compat.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_ct.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9505 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-17T12:02:58.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_fib.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_hash.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20033 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_limit.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_log.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_masq.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14329 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_nat.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_numgen.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11753 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_osf.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_queue.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_redir.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_reject.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9985 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_reject_inet.ko 2024-02-17T12:02:58.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12841 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_socket.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_synproxy.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/nft_tproxy.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/x_tables.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_AUDIT.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7633 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_CT.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_DSCP.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_HL.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13345 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_HMARK.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-17T12:02:58.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13801 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_LED.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_LOG.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11561 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NETMAP.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NFLOG.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_RATEEST.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_SECMARK.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-17T12:02:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TEE.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TPROXY.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8233 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_TRACE.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_addrtype.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_bpf.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cgroup.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11121 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cluster.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_comment.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connbytes.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11257 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connlabel.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connlimit.ko 2024-02-17T12:02:58.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_connmark.ko 2024-02-17T12:02:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_conntrack.ko 2024-02-17T12:02:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_cpu.ko 2024-02-17T12:02:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10889 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_dccp.ko 2024-02-17T12:02:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_devgroup.ko 2024-02-17T12:02:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_dscp.ko 2024-02-17T12:02:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10569 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ecn.ko 2024-02-17T12:02:58.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_esp.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_hashlimit.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_helper.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_hl.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11825 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ipcomp.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_iprange.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11697 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_ipvs.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_l2tp.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_length.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_limit.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_mac.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_mark.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_multiport.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_nat.ko 2024-02-17T12:02:58.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_nfacct.ko 2024-02-17T12:02:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8217 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_osf.ko 2024-02-17T12:02:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_owner.ko 2024-02-17T12:02:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10017 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_physdev.ko 2024-02-17T12:02:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_pkttype.ko 2024-02-17T12:02:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11897 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_policy.ko 2024-02-17T12:02:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9385 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_quota.ko 2024-02-17T12:02:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_rateest.ko 2024-02-17T12:02:58.804 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8169 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_realm.ko 2024-02-17T12:02:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36425 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_recent.ko 2024-02-17T12:02:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_sctp.ko 2024-02-17T12:02:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30001 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_set.ko 2024-02-17T12:02:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_socket.ko 2024-02-17T12:02:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_state.ko 2024-02-17T12:02:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_statistic.ko 2024-02-17T12:02:58.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8713 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_string.ko 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_tcpmss.ko 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15681 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_tcpudp.ko 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_time.ko 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9313 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netfilter/xt_u32.ko 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netlink/ 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/netlink/netlink_diag.ko 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/nsh/ 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12337 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/nsh/nsh.ko 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/ 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 384097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/openvswitch.ko 2024-02-17T12:02:58.806 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10369 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-geneve.ko 2024-02-17T12:02:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-gre.ko 2024-02-17T12:02:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11833 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/openvswitch/vport-vxlan.ko 2024-02-17T12:02:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/packet/ 2024-02-17T12:02:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13473 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/packet/af_packet_diag.ko 2024-02-17T12:02:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/phonet/ 2024-02-17T12:02:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 112153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/phonet/phonet.ko 2024-02-17T12:02:58.807 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54729 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/phonet/pn_pep.ko 2024-02-17T12:02:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/ 2024-02-17T12:02:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 253737 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds.ko 2024-02-17T12:02:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 165105 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds_rdma.ko 2024-02-17T12:02:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rds/rds_tcp.ko 2024-02-17T12:02:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rxrpc/ 2024-02-17T12:02:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 828297 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/rxrpc/rxrpc.ko 2024-02-17T12:02:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/ 2024-02-17T12:02:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_csum.ko 2024-02-17T12:02:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23489 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_gact.ko 2024-02-17T12:02:58.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36769 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_mirred.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23377 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_nat.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43417 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_pedit.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31929 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_police.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20193 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_simple.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35201 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_skbedit.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36577 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/act_vlan.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_basic.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33873 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_bpf.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19185 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_cgroup.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_flow.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_fw.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_route.ko 2024-02-17T12:02:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/cls_u32.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7353 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_cmp.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_ipset.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_meta.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_nbyte.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_text.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7161 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/em_u32.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21673 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_choke.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20865 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_codel.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34657 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_drr.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_fq.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31521 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_fq_codel.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35457 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_gred.ko 2024-02-17T12:02:58.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49849 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_hfsc.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21977 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_hhf.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66449 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_htb.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_ingress.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30225 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_mqprio.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10809 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_mqprio_lib.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26089 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_multiq.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36153 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_netem.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27409 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_pie.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10665 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_plug.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24777 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_prio.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48537 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_qfq.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_red.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26793 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_sfb.ko 2024-02-17T12:02:58.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31321 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_sfq.ko 2024-02-17T12:02:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_tbf.ko 2024-02-17T12:02:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sched/sch_teql.ko 2024-02-17T12:02:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/ 2024-02-17T12:02:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 932945 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/sctp.ko 2024-02-17T12:02:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sctp/sctp_diag.ko 2024-02-17T12:02:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/ 2024-02-17T12:02:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/ 2024-02-17T12:02:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 337009 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-17T12:02:58.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55041 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1513905 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/sunrpc.ko 2024-02-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/xprtrdma/ 2024-02-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 704761 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/ 2024-02-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10401 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/diag.ko 2024-02-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 867249 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/tipc/tipc.ko 2024-02-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/unix/ 2024-02-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15937 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/unix/unix_diag.ko 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/ 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87745 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98113 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock.ko 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11081 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17817 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/x25/ 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 131273 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/x25/x25.ko 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/ 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22953 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/xfrm_algo.ko 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20553 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 105097 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/net/xfrm/xfrm_user.ko 2024-02-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/ 2024-02-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/lib/ 2024-02-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15441 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/kernel/virt/lib/irqbypass.ko 2024-02-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 642229 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.alias 2024-02-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 625558 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.alias.bin 2024-02-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7677 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin 2024-02-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23498 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.alias.bin 2024-02-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9916 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.bin 2024-02-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70627 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.builtin.modinfo 2024-02-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 147214 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.dep 2024-02-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 233213 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.dep.bin 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 210 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.devname 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72614 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.order 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 879 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.softdep 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 257955 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.symbols 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 312782 2024-02-13 10:58 ./lib/modules/6.8.0-rc4-g8d59ab0bd93c/modules.symbols.bin 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./usr/ 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./usr/share/ 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./usr/share/doc/ 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-02-13 10:58 ./usr/share/doc/linux-image-6.8.0-rc4-g8d59ab0bd93c/ 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 174 2024-02-13 10:58 ./usr/share/doc/linux-image-6.8.0-rc4-g8d59ab0bd93c/changelog.Debian.gz 2024-02-17T12:02:58.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 691 2024-02-13 10:58 ./usr/share/doc/linux-image-6.8.0-rc4-g8d59ab0bd93c/copyright 2024-02-17T12:02:58.822 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:58.822 INFO:teuthology.task.kernel:searching for kernel 6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:58.822 DEBUG:teuthology.orchestra.run.smithi114:> egrep '(submenu|menuentry.*6.8.0-rc4-g8d59ab0bd93c).*{' /boot/grub/grub.cfg 2024-02-17T12:02:58.829 INFO:teuthology.orchestra.run.smithi114.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-02-17T12:02:58.829 INFO:teuthology.orchestra.run.smithi114.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc4-g8d59ab0bd93c' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc4-g8d59ab0bd93c-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-02-17T12:02:58.829 INFO:teuthology.orchestra.run.smithi114.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc4-g8d59ab0bd93c (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc4-g8d59ab0bd93c-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-02-17T12:02:58.830 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-02-17T12:02:58.830 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:58.830 DEBUG:teuthology.orchestra.run.smithi114:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-02-17T12:02:58.874 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi114.front.sepia.ceph.com to complete... 2024-02-17T12:02:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2024-02-17T12:02:59.228 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-17T12:02:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-02-17T12:02:59.480 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:59.486 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:02:59.705 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-17T12:02:59.710 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-17T12:02:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-17T12:02:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-17T12:02:59.884 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-17T12:02:59.885 INFO:teuthology.orchestra.run.smithi114.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-17T12:02:59.885 INFO:teuthology.orchestra.run.smithi114.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-17T12:02:59.898 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-02-17T12:03:31.003 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-17T12:03:31.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-17T12:03:31.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:03:49.439 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-17T12:03:58.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-17T12:03:58.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:04:01.500 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-17T12:04:13.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-17T12:04:13.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:04:31.932 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-02-17T12:04:46.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-17T12:04:46.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:04:47.585 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-02-17T12:04:49.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-17T12:04:49.085 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc4-g8d59ab0bd93c"... 2024-02-17T12:04:49.085 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-02-17T12:04:49.134 INFO:teuthology.orchestra.run.smithi114.stdout:6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:04:49.136 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc4-g8d59ab0bd93c vs 6.8.0-rc4-g8d59ab0bd93c 2024-02-17T12:04:49.136 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-17T12:04:49.136 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-17T12:04:50.137 DEBUG:teuthology.parallel:result is None 2024-02-17T12:04:50.138 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-17T12:04:50.150 INFO:teuthology.task.internal:Creating test directory... 2024-02-17T12:04:50.150 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-17T12:04:50.153 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-17T12:04:50.162 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-17T12:04:50.184 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-17T12:04:50.196 INFO:teuthology.task.internal:Creating archive directory... 2024-02-17T12:04:50.196 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-17T12:04:50.204 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-17T12:04:50.229 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-17T12:04:50.236 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-17T12:04:50.237 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-17T12:04:50.268 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-17T12:04:50.343 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T12:04:50.376 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T12:04:50.687 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T12:04:50.707 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T12:04:50.709 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-17T12:04:50.717 INFO:teuthology.task.internal:Configuring sudo... 2024-02-17T12:04:50.717 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-17T12:04:50.720 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-17T12:04:50.741 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-17T12:04:50.750 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-17T12:04:50.750 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-17T12:04:50.785 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-17T12:04:50.793 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T12:04:50.837 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T12:04:50.889 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:04:50.890 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-17T12:04:50.963 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T12:04:50.972 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T12:04:51.024 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:04:51.024 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-17T12:04:51.098 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-02-17T12:04:51.101 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-02-17T12:04:51.205 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-17T12:04:51.213 INFO:teuthology.task.internal:Starting timer... 2024-02-17T12:04:51.213 INFO:teuthology.run_tasks:Running task pcp... 2024-02-17T12:04:51.238 INFO:teuthology.run_tasks:Running task selinux... 2024-02-17T12:04:51.247 DEBUG:teuthology.task.selinux:Excluding smithi114: OS 'ubuntu' does not support SELinux 2024-02-17T12:04:51.248 DEBUG:teuthology.task.selinux:Excluding smithi116: OS 'ubuntu' does not support SELinux 2024-02-17T12:04:51.248 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-17T12:04:51.248 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-02-17T12:04:51.248 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-17T12:04:51.248 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-17T12:04:51.259 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-17T12:04:51.266 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-17T12:04:51.403 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-17T12:04:51.419 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-17T12:04:51.420 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi114.front.sepia.ceph.com,smithi116.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-17T12:12:25.650 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com')] 2024-02-17T12:12:25.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-17T12:12:25.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:12:25.736 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-02-17T12:12:25.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-02-17T12:12:25.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-17T12:12:25.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:12:25.942 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-02-17T12:12:26.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-02-17T12:12:26.071 INFO:teuthology.run_tasks:Running task clock... 2024-02-17T12:12:26.083 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-17T12:12:26.083 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-17T12:12:26.083 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T12:12:26.086 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-17T12:12:26.086 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T12:12:26.122 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-17T12:12:26.122 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: Command line: ntpd -gq 2024-02-17T12:12:26.122 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: ---------------------------------------------------- 2024-02-17T12:12:26.123 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: ntp-4 is maintained by Network Time Foundation, 2024-02-17T12:12:26.123 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-17T12:12:26.123 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: corporation. Support and training for ntp-4 are 2024-02-17T12:12:26.123 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: available at https://www.nwtime.org/support 2024-02-17T12:12:26.123 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: ---------------------------------------------------- 2024-02-17T12:12:26.123 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: proto: precision = 0.043 usec (-24) 2024-02-17T12:12:26.123 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: basedate set to 2022-02-04 2024-02-17T12:12:26.124 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: gps base set to 2022-02-06 (week 2196) 2024-02-17T12:12:26.124 INFO:teuthology.orchestra.run.smithi114.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-17T12:12:26.124 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-17T12:12:26.124 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: restrict ::: KOD does nothing without LIMITED. 2024-02-17T12:12:26.125 INFO:teuthology.orchestra.run.smithi114.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-17T12:12:26.126 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: Listen and drop on 0 v6wildcard [::]:123 2024-02-17T12:12:26.126 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-17T12:12:26.126 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: Listen normally on 2 lo 127.0.0.1:123 2024-02-17T12:12:26.126 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: Listen normally on 3 enp3s0f1 172.21.15.114:123 2024-02-17T12:12:26.126 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: Listen normally on 4 lo [::1]:123 2024-02-17T12:12:26.126 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb63%5]:123 2024-02-17T12:12:26.126 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:26 ntpd[17126]: Listening on routing socket on fd #22 for interface updates 2024-02-17T12:12:26.155 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-17T12:12:26.155 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: Command line: ntpd -gq 2024-02-17T12:12:26.155 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: ---------------------------------------------------- 2024-02-17T12:12:26.155 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: ntp-4 is maintained by Network Time Foundation, 2024-02-17T12:12:26.155 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-17T12:12:26.155 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: corporation. Support and training for ntp-4 are 2024-02-17T12:12:26.155 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: available at https://www.nwtime.org/support 2024-02-17T12:12:26.155 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: ---------------------------------------------------- 2024-02-17T12:12:26.156 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: proto: precision = 0.042 usec (-24) 2024-02-17T12:12:26.156 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: basedate set to 2022-02-04 2024-02-17T12:12:26.156 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: gps base set to 2022-02-06 (week 2196) 2024-02-17T12:12:26.156 INFO:teuthology.orchestra.run.smithi116.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-17T12:12:26.157 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-17T12:12:26.157 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: restrict ::: KOD does nothing without LIMITED. 2024-02-17T12:12:26.157 INFO:teuthology.orchestra.run.smithi116.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-17T12:12:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: Listen and drop on 0 v6wildcard [::]:123 2024-02-17T12:12:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-17T12:12:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: Listen normally on 2 lo 127.0.0.1:123 2024-02-17T12:12:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: Listen normally on 3 enp3s0f1 172.21.15.116:123 2024-02-17T12:12:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: Listen normally on 4 lo [::1]:123 2024-02-17T12:12:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:3f67%5]:123 2024-02-17T12:12:26.159 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:26 ntpd[17145]: Listening on routing socket on fd #22 for interface updates 2024-02-17T12:12:27.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:27 ntpd[17126]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:27.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:27.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.159 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.159 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:27.159 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:27.159 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:27.159 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:27.159 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:27.159 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:27 ntpd[17145]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:29.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:29.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:29 ntpd[17126]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:29.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:29.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:29.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:29.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:29.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:29.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:29.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:29.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:29.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:29.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:29.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:29.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:29.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:29.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:29.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:29.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:29.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:29.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:29 ntpd[17145]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:31.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:31.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:31 ntpd[17126]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:31.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:31.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:31.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:31.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:31.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:31 ntpd[17145]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:33.123 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:33.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:33.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:33.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:33.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:33.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:33.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:33.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:33.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:33.124 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:33.125 INFO:teuthology.orchestra.run.smithi114.stdout:17 Feb 12:12:33 ntpd[17126]: ntpd: time slew +0.002322 s 2024-02-17T12:12:33.125 INFO:teuthology.orchestra.run.smithi114.stdout:ntpd: time slew +0.002322s 2024-02-17T12:12:33.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-17T12:12:33.125 INFO:teuthology.orchestra.run.smithi114.stderr:17 Feb 12:12:33 ntpd[17126]: can't open /var/log/ntpstats/loopstats.20240217: Permission denied 2024-02-17T12:12:33.156 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:33.156 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:33.156 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:33.156 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:33.156 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:33.156 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:33.156 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-17T12:12:33.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: can't open /var/log/ntpstats/rawstats.20240217: Permission denied 2024-02-17T12:12:33.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-17T12:12:33.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: can't open /var/log/ntpstats/peerstats.20240217: Permission denied 2024-02-17T12:12:33.157 INFO:teuthology.orchestra.run.smithi116.stdout:17 Feb 12:12:33 ntpd[17145]: ntpd: time slew -0.000144 s 2024-02-17T12:12:33.157 INFO:teuthology.orchestra.run.smithi116.stdout:ntpd: time slew -0.000144s 2024-02-17T12:12:33.157 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-17T12:12:33.158 INFO:teuthology.orchestra.run.smithi116.stderr:17 Feb 12:12:33 ntpd[17145]: can't open /var/log/ntpstats/loopstats.20240217: Permission denied 2024-02-17T12:12:33.228 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2024-02-17T12:12:33.228 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2024-02-17T12:12:33.228 INFO:teuthology.orchestra.run.smithi114.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-17T12:12:33.228 INFO:teuthology.orchestra.run.smithi114.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-17T12:12:33.228 INFO:teuthology.orchestra.run.smithi114.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-17T12:12:33.229 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-17T12:12:33.261 INFO:teuthology.orchestra.run.smithi116.stdout: remote refid st t when poll reach delay offset jitter 2024-02-17T12:12:33.261 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================== 2024-02-17T12:12:33.261 INFO:teuthology.orchestra.run.smithi116.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-17T12:12:33.261 INFO:teuthology.orchestra.run.smithi116.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-17T12:12:33.262 INFO:teuthology.orchestra.run.smithi116.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-17T12:12:33.262 INFO:teuthology.orchestra.run.smithi116.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-17T12:12:33.263 INFO:teuthology.run_tasks:Running task install... 2024-02-17T12:12:33.271 DEBUG:teuthology.task.install:project ceph 2024-02-17T12:12:33.272 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}} 2024-02-17T12:12:33.272 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'} 2024-02-17T12:12:33.272 INFO:teuthology.task.install:Using flavor: default 2024-02-17T12:12:33.277 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-17T12:12:33.277 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-17T12:12:33.278 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-key list | grep Ceph 2024-02-17T12:12:33.278 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-key list | grep Ceph 2024-02-17T12:12:33.379 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-17T12:12:33.404 INFO:teuthology.orchestra.run.smithi116.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-17T12:12:33.429 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-17T12:12:33.429 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph.com (release key) 2024-02-17T12:12:33.430 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-02-17T12:12:33.430 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-02-17T12:12:33.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:12:33.453 INFO:teuthology.orchestra.run.smithi116.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-17T12:12:33.453 INFO:teuthology.orchestra.run.smithi116.stdout:uid [ unknown] Ceph.com (release key) 2024-02-17T12:12:33.454 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-02-17T12:12:33.454 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-02-17T12:12:33.454 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:12:33.598 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default/ 2024-02-17T12:12:33.598 INFO:teuthology.task.install.deb:Package version is 19.0.0-1515-g6822c7b5-1jammy 2024-02-17T12:12:33.657 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default/ 2024-02-17T12:12:33.658 INFO:teuthology.task.install.deb:Package version is 19.0.0-1515-g6822c7b5-1jammy 2024-02-17T12:12:33.776 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:12:33.776 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-17T12:12:33.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get update 2024-02-17T12:12:33.833 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:12:33.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-17T12:12:33.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2024-02-17T12:12:33.982 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-17T12:12:33.994 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-17T12:12:33.998 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-17T12:12:34.016 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-17T12:12:34.046 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-17T12:12:34.046 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-17T12:12:34.056 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-17T12:12:34.077 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-17T12:12:34.089 INFO:teuthology.orchestra.run.smithi116.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy InRelease 2024-02-17T12:12:34.130 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-17T12:12:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy InRelease 2024-02-17T12:12:34.169 INFO:teuthology.orchestra.run.smithi116.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-17T12:12:34.194 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-17T12:12:34.208 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-17T12:12:34.233 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-17T12:12:34.272 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-17T12:12:34.293 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-02-17T12:12:34.320 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-02-17T12:12:34.563 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 28.9 kB in 1s (52.4 kB/s) 2024-02-17T12:12:34.627 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 28.9 kB in 1s (52.4 kB/s) 2024-02-17T12:12:35.509 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-02-17T12:12:35.523 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1515-g6822c7b5-1jammy cephadm=19.0.0-1515-g6822c7b5-1jammy ceph-mds=19.0.0-1515-g6822c7b5-1jammy ceph-mgr=19.0.0-1515-g6822c7b5-1jammy ceph-common=19.0.0-1515-g6822c7b5-1jammy ceph-fuse=19.0.0-1515-g6822c7b5-1jammy ceph-test=19.0.0-1515-g6822c7b5-1jammy ceph-volume=19.0.0-1515-g6822c7b5-1jammy radosgw=19.0.0-1515-g6822c7b5-1jammy python3-rados=19.0.0-1515-g6822c7b5-1jammy python3-rgw=19.0.0-1515-g6822c7b5-1jammy python3-cephfs=19.0.0-1515-g6822c7b5-1jammy python3-rbd=19.0.0-1515-g6822c7b5-1jammy libcephfs2=19.0.0-1515-g6822c7b5-1jammy libcephfs-dev=19.0.0-1515-g6822c7b5-1jammy librados2=19.0.0-1515-g6822c7b5-1jammy librbd1=19.0.0-1515-g6822c7b5-1jammy rbd-fuse=19.0.0-1515-g6822c7b5-1jammy python3-cephfs=19.0.0-1515-g6822c7b5-1jammy cephfs-shell=19.0.0-1515-g6822c7b5-1jammy cephfs-top=19.0.0-1515-g6822c7b5-1jammy cephfs-mirror=19.0.0-1515-g6822c7b5-1jammy 2024-02-17T12:12:35.558 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-02-17T12:12:35.572 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1515-g6822c7b5-1jammy cephadm=19.0.0-1515-g6822c7b5-1jammy ceph-mds=19.0.0-1515-g6822c7b5-1jammy ceph-mgr=19.0.0-1515-g6822c7b5-1jammy ceph-common=19.0.0-1515-g6822c7b5-1jammy ceph-fuse=19.0.0-1515-g6822c7b5-1jammy ceph-test=19.0.0-1515-g6822c7b5-1jammy ceph-volume=19.0.0-1515-g6822c7b5-1jammy radosgw=19.0.0-1515-g6822c7b5-1jammy python3-rados=19.0.0-1515-g6822c7b5-1jammy python3-rgw=19.0.0-1515-g6822c7b5-1jammy python3-cephfs=19.0.0-1515-g6822c7b5-1jammy python3-rbd=19.0.0-1515-g6822c7b5-1jammy libcephfs2=19.0.0-1515-g6822c7b5-1jammy libcephfs-dev=19.0.0-1515-g6822c7b5-1jammy librados2=19.0.0-1515-g6822c7b5-1jammy librbd1=19.0.0-1515-g6822c7b5-1jammy rbd-fuse=19.0.0-1515-g6822c7b5-1jammy python3-cephfs=19.0.0-1515-g6822c7b5-1jammy cephfs-shell=19.0.0-1515-g6822c7b5-1jammy cephfs-top=19.0.0-1515-g6822c7b5-1jammy cephfs-mirror=19.0.0-1515-g6822c7b5-1jammy 2024-02-17T12:12:35.596 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-02-17T12:12:35.646 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-02-17T12:12:35.762 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-02-17T12:12:35.762 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-02-17T12:12:35.821 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-02-17T12:12:35.822 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-02-17T12:12:35.917 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-02-17T12:12:35.917 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-17T12:12:35.917 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-17T12:12:35.918 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-17T12:12:35.918 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-17T12:12:35.919 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-17T12:12:35.919 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-17T12:12:35.919 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-02-17T12:12:35.919 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-17T12:12:35.919 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-17T12:12:35.919 INFO:teuthology.orchestra.run.smithi116.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-17T12:12:35.919 INFO:teuthology.orchestra.run.smithi116.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-02-17T12:12:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-17T12:12:35.922 INFO:teuthology.orchestra.run.smithi116.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-17T12:12:35.923 INFO:teuthology.orchestra.run.smithi116.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-17T12:12:35.923 INFO:teuthology.orchestra.run.smithi116.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-17T12:12:35.923 INFO:teuthology.orchestra.run.smithi116.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-17T12:12:35.923 INFO:teuthology.orchestra.run.smithi116.stdout:Recommended packages: 2024-02-17T12:12:35.923 INFO:teuthology.orchestra.run.smithi116.stdout: btrfs-tools 2024-02-17T12:12:35.985 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-02-17T12:12:35.986 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-17T12:12:35.986 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-17T12:12:35.986 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-17T12:12:35.986 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-17T12:12:35.986 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-17T12:12:35.987 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-17T12:12:35.987 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-02-17T12:12:35.987 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-17T12:12:35.987 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-17T12:12:35.988 INFO:teuthology.orchestra.run.smithi114.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-17T12:12:35.988 INFO:teuthology.orchestra.run.smithi114.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-17T12:12:35.989 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-02-17T12:12:35.990 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-17T12:12:35.991 INFO:teuthology.orchestra.run.smithi114.stdout:Recommended packages: 2024-02-17T12:12:35.992 INFO:teuthology.orchestra.run.smithi114.stdout: btrfs-tools 2024-02-17T12:12:36.069 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-02-17T12:12:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-17T12:12:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-17T12:12:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-02-17T12:12:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-02-17T12:12:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-17T12:12:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-17T12:12:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-17T12:12:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-02-17T12:12:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-02-17T12:12:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-02-17T12:12:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-17T12:12:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-17T12:12:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-17T12:12:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-17T12:12:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-02-17T12:12:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: socat unzip xmlstarlet zip 2024-02-17T12:12:36.138 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-02-17T12:12:36.138 INFO:teuthology.orchestra.run.smithi114.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-17T12:12:36.138 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-17T12:12:36.139 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-02-17T12:12:36.140 INFO:teuthology.orchestra.run.smithi114.stdout: socat unzip xmlstarlet zip 2024-02-17T12:12:36.144 INFO:teuthology.orchestra.run.smithi116.stdout:0 upgraded, 124 newly installed, 0 to remove and 277 not upgraded. 2024-02-17T12:12:36.144 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 176 MB of archives. 2024-02-17T12:12:36.144 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 731 MB of additional disk space will be used. 2024-02-17T12:12:36.144 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-02-17T12:12:36.165 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-17T12:12:36.176 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-02-17T12:12:36.213 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 124 newly installed, 0 to remove and 277 not upgraded. 2024-02-17T12:12:36.213 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 176 MB of archives. 2024-02-17T12:12:36.213 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 731 MB of additional disk space will be used. 2024-02-17T12:12:36.213 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-02-17T12:12:36.225 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-17T12:12:36.235 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-17T12:12:36.246 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-02-17T12:12:36.249 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-17T12:12:36.252 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-17T12:12:36.267 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-17T12:12:36.288 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1515-g6822c7b5-1jammy [3,529 kB] 2024-02-17T12:12:36.300 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1515-g6822c7b5-1jammy [3,529 kB] 2024-02-17T12:12:36.304 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-17T12:12:36.322 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-17T12:12:36.325 INFO:teuthology.orchestra.run.smithi116.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-17T12:12:36.337 INFO:teuthology.orchestra.run.smithi116.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-17T12:12:36.338 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-17T12:12:36.341 INFO:teuthology.orchestra.run.smithi116.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-17T12:12:36.342 INFO:teuthology.orchestra.run.smithi116.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-17T12:12:36.344 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-17T12:12:36.350 INFO:teuthology.orchestra.run.smithi116.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-17T12:12:36.352 INFO:teuthology.orchestra.run.smithi116.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-17T12:12:36.355 INFO:teuthology.orchestra.run.smithi116.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-17T12:12:36.356 INFO:teuthology.orchestra.run.smithi116.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-17T12:12:36.359 INFO:teuthology.orchestra.run.smithi116.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-17T12:12:36.365 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-17T12:12:36.379 INFO:teuthology.orchestra.run.smithi116.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-02-17T12:12:36.381 INFO:teuthology.orchestra.run.smithi116.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-17T12:12:36.383 INFO:teuthology.orchestra.run.smithi116.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-17T12:12:36.384 INFO:teuthology.orchestra.run.smithi116.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-17T12:12:36.384 INFO:teuthology.orchestra.run.smithi116.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-17T12:12:36.386 INFO:teuthology.orchestra.run.smithi116.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-17T12:12:36.386 INFO:teuthology.orchestra.run.smithi116.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-17T12:12:36.386 INFO:teuthology.orchestra.run.smithi116.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-17T12:12:36.386 INFO:teuthology.orchestra.run.smithi116.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-17T12:12:36.409 INFO:teuthology.orchestra.run.smithi116.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-17T12:12:36.409 INFO:teuthology.orchestra.run.smithi116.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-17T12:12:36.410 INFO:teuthology.orchestra.run.smithi116.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-17T12:12:36.432 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-17T12:12:36.436 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-17T12:12:36.436 INFO:teuthology.orchestra.run.smithi116.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-17T12:12:36.438 INFO:teuthology.orchestra.run.smithi116.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-17T12:12:36.438 INFO:teuthology.orchestra.run.smithi116.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-17T12:12:36.438 INFO:teuthology.orchestra.run.smithi116.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-17T12:12:36.439 INFO:teuthology.orchestra.run.smithi116.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-17T12:12:36.440 INFO:teuthology.orchestra.run.smithi116.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-17T12:12:36.440 INFO:teuthology.orchestra.run.smithi116.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-17T12:12:36.451 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-17T12:12:36.454 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-17T12:12:36.455 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-17T12:12:36.464 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-17T12:12:36.466 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-17T12:12:36.468 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-17T12:12:36.469 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-17T12:12:36.469 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-17T12:12:36.472 INFO:teuthology.orchestra.run.smithi116.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-17T12:12:36.473 INFO:teuthology.orchestra.run.smithi116.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-17T12:12:36.473 INFO:teuthology.orchestra.run.smithi116.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-17T12:12:36.490 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-02-17T12:12:36.492 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-17T12:12:36.494 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-17T12:12:36.495 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-17T12:12:36.495 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-17T12:12:36.496 INFO:teuthology.orchestra.run.smithi116.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-17T12:12:36.496 INFO:teuthology.orchestra.run.smithi116.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-17T12:12:36.497 INFO:teuthology.orchestra.run.smithi116.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-17T12:12:36.498 INFO:teuthology.orchestra.run.smithi116.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-17T12:12:36.499 INFO:teuthology.orchestra.run.smithi116.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-17T12:12:36.501 INFO:teuthology.orchestra.run.smithi116.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-17T12:12:36.502 INFO:teuthology.orchestra.run.smithi116.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-17T12:12:36.511 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-17T12:12:36.512 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-17T12:12:36.512 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-17T12:12:36.513 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-17T12:12:36.513 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-17T12:12:36.517 INFO:teuthology.orchestra.run.smithi116.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-17T12:12:36.517 INFO:teuthology.orchestra.run.smithi116.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-17T12:12:36.520 INFO:teuthology.orchestra.run.smithi116.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-17T12:12:36.532 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-17T12:12:36.532 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-17T12:12:36.535 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-17T12:12:36.535 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-17T12:12:36.536 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-17T12:12:36.539 INFO:teuthology.orchestra.run.smithi116.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-17T12:12:36.540 INFO:teuthology.orchestra.run.smithi116.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-17T12:12:36.542 INFO:teuthology.orchestra.run.smithi116.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-17T12:12:36.574 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-17T12:12:36.575 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-17T12:12:36.575 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-17T12:12:36.576 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-17T12:12:36.577 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-17T12:12:36.608 INFO:teuthology.orchestra.run.smithi116.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-17T12:12:36.610 INFO:teuthology.orchestra.run.smithi116.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-17T12:12:36.611 INFO:teuthology.orchestra.run.smithi116.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-17T12:12:36.611 INFO:teuthology.orchestra.run.smithi116.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-17T12:12:36.612 INFO:teuthology.orchestra.run.smithi116.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-17T12:12:36.615 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-17T12:12:36.615 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-17T12:12:36.626 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-17T12:12:36.626 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-17T12:12:36.627 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-17T12:12:36.643 INFO:teuthology.orchestra.run.smithi116.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-17T12:12:36.645 INFO:teuthology.orchestra.run.smithi116.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-17T12:12:36.646 INFO:teuthology.orchestra.run.smithi116.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-17T12:12:36.661 INFO:teuthology.orchestra.run.smithi114.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-17T12:12:36.663 INFO:teuthology.orchestra.run.smithi114.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-17T12:12:36.665 INFO:teuthology.orchestra.run.smithi114.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-17T12:12:36.666 INFO:teuthology.orchestra.run.smithi114.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-17T12:12:36.667 INFO:teuthology.orchestra.run.smithi116.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-17T12:12:36.667 INFO:teuthology.orchestra.run.smithi114.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-17T12:12:36.675 INFO:teuthology.orchestra.run.smithi116.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-17T12:12:36.676 INFO:teuthology.orchestra.run.smithi116.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-17T12:12:36.676 INFO:teuthology.orchestra.run.smithi116.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-17T12:12:36.677 INFO:teuthology.orchestra.run.smithi116.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-17T12:12:36.678 INFO:teuthology.orchestra.run.smithi116.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-17T12:12:36.682 INFO:teuthology.orchestra.run.smithi114.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-17T12:12:36.685 INFO:teuthology.orchestra.run.smithi114.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-17T12:12:36.685 INFO:teuthology.orchestra.run.smithi114.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-17T12:12:36.686 INFO:teuthology.orchestra.run.smithi114.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-17T12:12:36.688 INFO:teuthology.orchestra.run.smithi114.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-17T12:12:36.704 INFO:teuthology.orchestra.run.smithi114.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1515-g6822c7b5-1jammy [3,212 kB] 2024-02-17T12:12:36.717 INFO:teuthology.orchestra.run.smithi116.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-17T12:12:36.717 INFO:teuthology.orchestra.run.smithi116.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-17T12:12:36.724 INFO:teuthology.orchestra.run.smithi116.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-17T12:12:36.726 INFO:teuthology.orchestra.run.smithi116.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-17T12:12:36.729 INFO:teuthology.orchestra.run.smithi116.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-17T12:12:36.761 INFO:teuthology.orchestra.run.smithi116.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-17T12:12:36.761 INFO:teuthology.orchestra.run.smithi114.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-17T12:12:36.762 INFO:teuthology.orchestra.run.smithi114.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-17T12:12:36.763 INFO:teuthology.orchestra.run.smithi114.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-17T12:12:36.764 INFO:teuthology.orchestra.run.smithi114.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-17T12:12:36.765 INFO:teuthology.orchestra.run.smithi114.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-17T12:12:36.766 INFO:teuthology.orchestra.run.smithi116.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-17T12:12:36.770 INFO:teuthology.orchestra.run.smithi116.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-02-17T12:12:36.771 INFO:teuthology.orchestra.run.smithi116.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-17T12:12:36.772 INFO:teuthology.orchestra.run.smithi116.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-17T12:12:36.796 INFO:teuthology.orchestra.run.smithi114.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-17T12:12:36.798 INFO:teuthology.orchestra.run.smithi114.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-17T12:12:36.799 INFO:teuthology.orchestra.run.smithi114.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-17T12:12:36.803 INFO:teuthology.orchestra.run.smithi116.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-17T12:12:36.811 INFO:teuthology.orchestra.run.smithi116.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-17T12:12:36.812 INFO:teuthology.orchestra.run.smithi116.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-17T12:12:36.817 INFO:teuthology.orchestra.run.smithi116.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-17T12:12:36.817 INFO:teuthology.orchestra.run.smithi116.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-17T12:12:36.833 INFO:teuthology.orchestra.run.smithi114.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-17T12:12:36.833 INFO:teuthology.orchestra.run.smithi114.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-17T12:12:36.834 INFO:teuthology.orchestra.run.smithi114.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-17T12:12:36.835 INFO:teuthology.orchestra.run.smithi114.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-17T12:12:36.835 INFO:teuthology.orchestra.run.smithi114.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-17T12:12:36.836 INFO:teuthology.orchestra.run.smithi116.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-17T12:12:36.836 INFO:teuthology.orchestra.run.smithi114.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-17T12:12:36.836 INFO:teuthology.orchestra.run.smithi116.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-17T12:12:36.838 INFO:teuthology.orchestra.run.smithi116.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-17T12:12:36.839 INFO:teuthology.orchestra.run.smithi116.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-17T12:12:36.846 INFO:teuthology.orchestra.run.smithi116.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-17T12:12:36.855 INFO:teuthology.orchestra.run.smithi114.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-17T12:12:36.855 INFO:teuthology.orchestra.run.smithi114.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-17T12:12:36.859 INFO:teuthology.orchestra.run.smithi114.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-17T12:12:36.861 INFO:teuthology.orchestra.run.smithi116.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-17T12:12:36.861 INFO:teuthology.orchestra.run.smithi116.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-17T12:12:36.864 INFO:teuthology.orchestra.run.smithi116.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-17T12:12:36.865 INFO:teuthology.orchestra.run.smithi116.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-17T12:12:36.872 INFO:teuthology.orchestra.run.smithi114.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1515-g6822c7b5-1jammy [710 kB] 2024-02-17T12:12:36.893 INFO:teuthology.orchestra.run.smithi114.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-17T12:12:36.895 INFO:teuthology.orchestra.run.smithi114.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-17T12:12:36.895 INFO:teuthology.orchestra.run.smithi114.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-17T12:12:36.899 INFO:teuthology.orchestra.run.smithi114.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-17T12:12:36.902 INFO:teuthology.orchestra.run.smithi114.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-02-17T12:12:36.902 INFO:teuthology.orchestra.run.smithi114.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-17T12:12:36.903 INFO:teuthology.orchestra.run.smithi114.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-17T12:12:36.910 INFO:teuthology.orchestra.run.smithi114.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1515-g6822c7b5-1jammy [357 kB] 2024-02-17T12:12:36.914 INFO:teuthology.orchestra.run.smithi114.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-17T12:12:36.915 INFO:teuthology.orchestra.run.smithi114.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1515-g6822c7b5-1jammy [32.8 kB] 2024-02-17T12:12:36.915 INFO:teuthology.orchestra.run.smithi114.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1515-g6822c7b5-1jammy [180 kB] 2024-02-17T12:12:36.920 INFO:teuthology.orchestra.run.smithi114.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-17T12:12:36.921 INFO:teuthology.orchestra.run.smithi114.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-17T12:12:36.931 INFO:teuthology.orchestra.run.smithi114.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1515-g6822c7b5-1jammy [64.8 kB] 2024-02-17T12:12:36.932 INFO:teuthology.orchestra.run.smithi114.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1515-g6822c7b5-1jammy [330 kB] 2024-02-17T12:12:36.935 INFO:teuthology.orchestra.run.smithi114.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-17T12:12:36.936 INFO:teuthology.orchestra.run.smithi114.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-17T12:12:36.936 INFO:teuthology.orchestra.run.smithi114.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-17T12:12:36.937 INFO:teuthology.orchestra.run.smithi114.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-17T12:12:36.939 INFO:teuthology.orchestra.run.smithi114.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-17T12:12:36.939 INFO:teuthology.orchestra.run.smithi114.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1515-g6822c7b5-1jammy [6,565 kB] 2024-02-17T12:12:36.939 INFO:teuthology.orchestra.run.smithi114.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-17T12:12:36.949 INFO:teuthology.orchestra.run.smithi114.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-17T12:12:36.958 INFO:teuthology.orchestra.run.smithi114.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-17T12:12:36.958 INFO:teuthology.orchestra.run.smithi114.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-17T12:12:36.961 INFO:teuthology.orchestra.run.smithi114.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-17T12:12:36.978 INFO:teuthology.orchestra.run.smithi114.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-17T12:12:37.184 INFO:teuthology.orchestra.run.smithi114.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1515-g6822c7b5-1jammy [112 kB] 2024-02-17T12:12:37.186 INFO:teuthology.orchestra.run.smithi114.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1515-g6822c7b5-1jammy [465 kB] 2024-02-17T12:12:37.204 INFO:teuthology.orchestra.run.smithi114.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1515-g6822c7b5-1jammy [24.1 MB] 2024-02-17T12:12:37.679 INFO:teuthology.orchestra.run.smithi116.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1515-g6822c7b5-1jammy [3,212 kB] 2024-02-17T12:12:38.104 INFO:teuthology.orchestra.run.smithi114.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1515-g6822c7b5-1jammy [5,073 kB] 2024-02-17T12:12:38.319 INFO:teuthology.orchestra.run.smithi114.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1515-g6822c7b5-1jammy [243 kB] 2024-02-17T12:12:38.320 INFO:teuthology.orchestra.run.smithi114.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1515-g6822c7b5-1jammy [124 kB] 2024-02-17T12:12:38.322 INFO:teuthology.orchestra.run.smithi114.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1515-g6822c7b5-1jammy [1,519 kB] 2024-02-17T12:12:38.348 INFO:teuthology.orchestra.run.smithi114.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1515-g6822c7b5-1jammy [6,240 kB] 2024-02-17T12:12:38.588 INFO:teuthology.orchestra.run.smithi114.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1515-g6822c7b5-1jammy [22.7 MB] 2024-02-17T12:12:38.613 INFO:teuthology.orchestra.run.smithi116.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1515-g6822c7b5-1jammy [710 kB] 2024-02-17T12:12:38.744 INFO:teuthology.orchestra.run.smithi116.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1515-g6822c7b5-1jammy [357 kB] 2024-02-17T12:12:38.822 INFO:teuthology.orchestra.run.smithi116.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1515-g6822c7b5-1jammy [32.8 kB] 2024-02-17T12:12:38.826 INFO:teuthology.orchestra.run.smithi116.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1515-g6822c7b5-1jammy [180 kB] 2024-02-17T12:12:38.862 INFO:teuthology.orchestra.run.smithi116.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1515-g6822c7b5-1jammy [64.8 kB] 2024-02-17T12:12:38.875 INFO:teuthology.orchestra.run.smithi116.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1515-g6822c7b5-1jammy [330 kB] 2024-02-17T12:12:38.943 INFO:teuthology.orchestra.run.smithi116.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1515-g6822c7b5-1jammy [6,565 kB] 2024-02-17T12:12:39.503 INFO:teuthology.orchestra.run.smithi114.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1515-g6822c7b5-1jammy [14.0 kB] 2024-02-17T12:12:39.504 INFO:teuthology.orchestra.run.smithi114.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1515-g6822c7b5-1jammy [865 kB] 2024-02-17T12:12:39.533 INFO:teuthology.orchestra.run.smithi114.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1515-g6822c7b5-1jammy [2,185 kB] 2024-02-17T12:12:39.627 INFO:teuthology.orchestra.run.smithi114.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1515-g6822c7b5-1jammy [776 kB] 2024-02-17T12:12:39.658 INFO:teuthology.orchestra.run.smithi114.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1515-g6822c7b5-1jammy [144 kB] 2024-02-17T12:12:39.665 INFO:teuthology.orchestra.run.smithi114.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1515-g6822c7b5-1jammy [1,921 kB] 2024-02-17T12:12:39.749 INFO:teuthology.orchestra.run.smithi114.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1515-g6822c7b5-1jammy [8,625 kB] 2024-02-17T12:12:39.914 INFO:teuthology.orchestra.run.smithi116.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1515-g6822c7b5-1jammy [112 kB] 2024-02-17T12:12:39.928 INFO:teuthology.orchestra.run.smithi116.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1515-g6822c7b5-1jammy [465 kB] 2024-02-17T12:12:39.979 INFO:teuthology.orchestra.run.smithi116.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1515-g6822c7b5-1jammy [24.1 MB] 2024-02-17T12:12:40.148 INFO:teuthology.orchestra.run.smithi114.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1515-g6822c7b5-1jammy [14.2 kB] 2024-02-17T12:12:40.148 INFO:teuthology.orchestra.run.smithi114.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1515-g6822c7b5-1jammy [49.9 MB] 2024-02-17T12:12:42.457 INFO:teuthology.orchestra.run.smithi116.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1515-g6822c7b5-1jammy [5,073 kB] 2024-02-17T12:12:42.580 INFO:teuthology.orchestra.run.smithi114.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1515-g6822c7b5-1jammy [121 kB] 2024-02-17T12:12:42.581 INFO:teuthology.orchestra.run.smithi114.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1515-g6822c7b5-1jammy [226 kB] 2024-02-17T12:12:42.583 INFO:teuthology.orchestra.run.smithi114.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1515-g6822c7b5-1jammy [34.0 kB] 2024-02-17T12:12:42.587 INFO:teuthology.orchestra.run.smithi114.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1515-g6822c7b5-1jammy [23.4 kB] 2024-02-17T12:12:42.588 INFO:teuthology.orchestra.run.smithi114.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1515-g6822c7b5-1jammy [38.4 kB] 2024-02-17T12:12:42.588 INFO:teuthology.orchestra.run.smithi114.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1515-g6822c7b5-1jammy [13.0 MB] 2024-02-17T12:12:42.966 INFO:teuthology.orchestra.run.smithi116.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1515-g6822c7b5-1jammy [243 kB] 2024-02-17T12:12:42.991 INFO:teuthology.orchestra.run.smithi116.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1515-g6822c7b5-1jammy [124 kB] 2024-02-17T12:12:43.001 INFO:teuthology.orchestra.run.smithi116.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1515-g6822c7b5-1jammy [1,519 kB] 2024-02-17T12:12:43.161 INFO:teuthology.orchestra.run.smithi116.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1515-g6822c7b5-1jammy [6,240 kB] 2024-02-17T12:12:43.216 INFO:teuthology.orchestra.run.smithi114.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1515-g6822c7b5-1jammy [91.5 kB] 2024-02-17T12:12:43.575 INFO:teuthology.orchestra.run.smithi116.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1515-g6822c7b5-1jammy [22.7 MB] 2024-02-17T12:12:43.853 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 176 MB in 7s (24.9 MB/s) 2024-02-17T12:12:43.979 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyperclip. 2024-02-17T12:12:44.043 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-02-17T12:12:44.046 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-02-17T12:12:44.094 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-02-17T12:12:44.430 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-17T12:12:44.444 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-17T12:12:44.488 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-17T12:12:44.662 INFO:teuthology.orchestra.run.smithi116.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1515-g6822c7b5-1jammy [14.0 kB] 2024-02-17T12:12:44.662 INFO:teuthology.orchestra.run.smithi116.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1515-g6822c7b5-1jammy [865 kB] 2024-02-17T12:12:44.692 INFO:teuthology.orchestra.run.smithi116.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1515-g6822c7b5-1jammy [2,185 kB] 2024-02-17T12:12:44.758 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cmd2. 2024-02-17T12:12:44.771 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-02-17T12:12:44.786 INFO:teuthology.orchestra.run.smithi116.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1515-g6822c7b5-1jammy [776 kB] 2024-02-17T12:12:44.807 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-02-17T12:12:44.815 INFO:teuthology.orchestra.run.smithi116.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1515-g6822c7b5-1jammy [144 kB] 2024-02-17T12:12:44.823 INFO:teuthology.orchestra.run.smithi116.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1515-g6822c7b5-1jammy [1,921 kB] 2024-02-17T12:12:44.901 INFO:teuthology.orchestra.run.smithi116.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1515-g6822c7b5-1jammy [8,625 kB] 2024-02-17T12:12:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-17T12:12:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-17T12:12:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-17T12:12:45.266 INFO:teuthology.orchestra.run.smithi116.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1515-g6822c7b5-1jammy [14.2 kB] 2024-02-17T12:12:45.266 INFO:teuthology.orchestra.run.smithi116.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1515-g6822c7b5-1jammy [49.9 MB] 2024-02-17T12:12:45.556 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-17T12:12:45.569 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-17T12:12:45.614 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-17T12:12:45.934 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-17T12:12:45.947 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-17T12:12:45.992 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-17T12:12:46.396 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-17T12:12:46.410 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-17T12:12:46.453 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:12:46.857 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-17T12:12:46.871 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-17T12:12:46.915 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:12:47.243 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-17T12:12:47.258 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-17T12:12:47.310 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:12:47.320 INFO:teuthology.orchestra.run.smithi116.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1515-g6822c7b5-1jammy [121 kB] 2024-02-17T12:12:47.321 INFO:teuthology.orchestra.run.smithi116.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1515-g6822c7b5-1jammy [226 kB] 2024-02-17T12:12:47.323 INFO:teuthology.orchestra.run.smithi116.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1515-g6822c7b5-1jammy [34.0 kB] 2024-02-17T12:12:47.323 INFO:teuthology.orchestra.run.smithi116.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1515-g6822c7b5-1jammy [23.4 kB] 2024-02-17T12:12:47.324 INFO:teuthology.orchestra.run.smithi116.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1515-g6822c7b5-1jammy [38.4 kB] 2024-02-17T12:12:47.324 INFO:teuthology.orchestra.run.smithi116.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1515-g6822c7b5-1jammy [13.0 MB] 2024-02-17T12:12:47.663 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-17T12:12:47.678 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-17T12:12:47.721 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-17T12:12:47.856 INFO:teuthology.orchestra.run.smithi116.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/main/6822c7b54e949006be7a0802650d01723d834d1d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1515-g6822c7b5-1jammy [91.5 kB] 2024-02-17T12:12:48.015 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librados2. 2024-02-17T12:12:48.031 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../010-librados2_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:48.073 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librados2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:48.493 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librbd1. 2024-02-17T12:12:48.508 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../011-librbd1_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:48.527 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 176 MB in 12s (15.0 MB/s) 2024-02-17T12:12:48.543 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librbd1 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:48.679 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyperclip. 2024-02-17T12:12:48.745 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-02-17T12:12:48.748 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-02-17T12:12:48.795 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-02-17T12:12:49.098 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-17T12:12:49.111 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-17T12:12:49.156 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-17T12:12:49.196 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs2. 2024-02-17T12:12:49.211 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:49.254 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:49.434 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cmd2. 2024-02-17T12:12:49.448 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-02-17T12:12:49.492 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-02-17T12:12:49.531 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rados. 2024-02-17T12:12:49.546 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:49.590 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rados (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:49.803 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-17T12:12:49.818 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-17T12:12:49.887 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-17T12:12:49.918 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-17T12:12:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:12:49.976 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-argparse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:50.198 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-17T12:12:50.213 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-17T12:12:50.245 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cephfs. 2024-02-17T12:12:50.248 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-17T12:12:50.259 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:50.295 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cephfs (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:50.576 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-17T12:12:50.589 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-17T12:12:50.591 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-17T12:12:50.603 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:12:50.634 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-17T12:12:50.647 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-common (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:50.967 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-prettytable. 2024-02-17T12:12:50.981 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-02-17T12:12:51.071 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-17T12:12:51.071 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-17T12:12:51.086 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-17T12:12:51.129 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:12:51.328 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rbd. 2024-02-17T12:12:51.342 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:51.386 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rbd (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:51.482 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-17T12:12:51.497 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-17T12:12:51.541 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:12:51.739 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-17T12:12:51.754 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-17T12:12:51.797 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-17T12:12:51.860 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-17T12:12:51.875 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-17T12:12:51.918 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:12:52.100 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-17T12:12:52.114 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-17T12:12:52.158 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-17T12:12:52.263 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-17T12:12:52.278 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-17T12:12:52.313 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-17T12:12:52.453 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-17T12:12:52.468 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-17T12:12:52.503 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-17T12:12:52.599 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librados2. 2024-02-17T12:12:52.614 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../010-librados2_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:52.649 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librados2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:52.823 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua5.1. 2024-02-17T12:12:52.838 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-17T12:12:52.881 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-17T12:12:53.060 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librbd1. 2024-02-17T12:12:53.075 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../011-librbd1_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:53.118 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librbd1 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:53.217 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-any. 2024-02-17T12:12:53.232 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-02-17T12:12:53.275 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-17T12:12:53.521 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libcephfs2. 2024-02-17T12:12:53.528 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package zip. 2024-02-17T12:12:53.535 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:53.543 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-02-17T12:12:53.578 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking zip (3.0-12build2) ... 2024-02-17T12:12:53.579 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libcephfs2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:53.856 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package unzip. 2024-02-17T12:12:53.871 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-02-17T12:12:53.924 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rados. 2024-02-17T12:12:53.938 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:53.939 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-02-17T12:12:53.974 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rados (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:54.226 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-17T12:12:54.241 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:12:54.276 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-ceph-argparse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:54.327 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package luarocks. 2024-02-17T12:12:54.342 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-17T12:12:54.385 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-17T12:12:54.512 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cephfs. 2024-02-17T12:12:54.526 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:54.570 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cephfs (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:54.775 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librgw2. 2024-02-17T12:12:54.789 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../027-librgw2_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:54.833 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librgw2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:54.881 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-17T12:12:54.896 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:12:54.939 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-ceph-common (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:55.276 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-prettytable. 2024-02-17T12:12:55.290 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-02-17T12:12:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rgw. 2024-02-17T12:12:55.325 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:55.334 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-17T12:12:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rgw (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:55.570 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rbd. 2024-02-17T12:12:55.584 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:55.620 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rbd (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:55.714 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-17T12:12:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-17T12:12:55.772 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-17T12:12:55.931 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-17T12:12:55.946 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-17T12:12:55.989 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-17T12:12:56.100 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libradosstriper1. 2024-02-17T12:12:56.114 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:56.158 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libradosstriper1 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:56.291 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-17T12:12:56.306 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-17T12:12:56.350 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-17T12:12:56.612 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-common. 2024-02-17T12:12:56.626 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:56.644 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-17T12:12:56.659 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-17T12:12:56.661 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-common (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:56.702 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-17T12:12:56.997 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package lua5.1. 2024-02-17T12:12:57.012 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-17T12:12:57.047 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-17T12:12:57.325 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package lua-any. 2024-02-17T12:12:57.340 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-02-17T12:12:57.383 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-17T12:12:57.653 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package zip. 2024-02-17T12:12:57.667 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-02-17T12:12:57.683 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-base. 2024-02-17T12:12:57.697 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:57.711 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking zip (3.0-12build2) ... 2024-02-17T12:12:57.750 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-base (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:58.031 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package unzip. 2024-02-17T12:12:58.045 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-02-17T12:12:58.081 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-02-17T12:12:58.304 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-17T12:12:58.317 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-17T12:12:58.363 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-17T12:12:58.467 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package luarocks. 2024-02-17T12:12:58.482 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-17T12:12:58.517 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-17T12:12:58.665 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cheroot. 2024-02-17T12:12:58.678 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-17T12:12:58.748 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-17T12:12:58.908 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librgw2. 2024-02-17T12:12:58.922 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../027-librgw2_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:58.966 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librgw2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:59.077 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-17T12:12:59.090 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-17T12:12:59.135 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-17T12:12:59.437 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-17T12:12:59.444 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rgw. 2024-02-17T12:12:59.451 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-17T12:12:59.457 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:12:59.496 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-17T12:12:59.502 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rgw (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:12:59.824 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-17T12:12:59.837 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-17T12:12:59.872 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-17T12:12:59.873 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-17T12:12:59.886 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-17T12:12:59.930 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-17T12:13:00.168 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempora. 2024-02-17T12:13:00.182 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-02-17T12:13:00.191 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libradosstriper1. 2024-02-17T12:13:00.206 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:00.235 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-17T12:13:00.241 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libradosstriper1 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:00.529 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-portend. 2024-02-17T12:13:00.543 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-02-17T12:13:00.587 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-17T12:13:00.661 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-common. 2024-02-17T12:13:00.675 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:00.719 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-common (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:00.923 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-17T12:13:00.938 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-17T12:13:00.981 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-17T12:13:01.285 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-17T12:13:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-17T12:13:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-17T12:13:01.705 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-natsort. 2024-02-17T12:13:01.718 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-02-17T12:13:01.763 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-17T12:13:01.800 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-base. 2024-02-17T12:13:01.814 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:01.866 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-base (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:02.074 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-logutils. 2024-02-17T12:13:02.087 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-02-17T12:13:02.132 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-17T12:13:02.435 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-17T12:13:02.437 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-17T12:13:02.449 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-17T12:13:02.450 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-17T12:13:02.493 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-17T12:13:02.495 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-17T12:13:02.773 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cheroot. 2024-02-17T12:13:02.787 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-17T12:13:02.821 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-mako. 2024-02-17T12:13:02.823 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-17T12:13:02.835 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-17T12:13:02.879 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-17T12:13:03.093 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-17T12:13:03.107 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-17T12:13:03.142 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-17T12:13:03.182 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-17T12:13:03.197 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-17T12:13:03.232 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-17T12:13:03.445 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-17T12:13:03.460 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-17T12:13:03.503 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-17T12:13:03.560 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-17T12:13:03.575 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-17T12:13:03.619 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-17T12:13:03.823 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-17T12:13:03.838 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-17T12:13:03.881 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-17T12:13:03.921 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webob. 2024-02-17T12:13:03.936 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-17T12:13:03.979 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-17T12:13:04.401 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-tempora. 2024-02-17T12:13:04.415 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-02-17T12:13:04.451 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-17T12:13:04.533 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-waitress. 2024-02-17T12:13:04.547 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-17T12:13:04.593 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-17T12:13:04.712 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-portend. 2024-02-17T12:13:04.726 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-02-17T12:13:04.803 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-17T12:13:04.910 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempita. 2024-02-17T12:13:04.925 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-17T12:13:04.960 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-17T12:13:05.091 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-17T12:13:05.106 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-17T12:13:05.149 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-17T12:13:05.238 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-paste. 2024-02-17T12:13:05.253 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-17T12:13:05.296 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-17T12:13:05.402 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-17T12:13:05.417 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-17T12:13:05.452 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-17T12:13:05.658 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-17T12:13:05.672 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-17T12:13:05.716 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-17T12:13:05.806 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-natsort. 2024-02-17T12:13:05.820 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-02-17T12:13:05.864 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-17T12:13:06.018 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-17T12:13:06.033 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-17T12:13:06.085 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-17T12:13:06.200 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-logutils. 2024-02-17T12:13:06.215 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-02-17T12:13:06.258 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-17T12:13:06.339 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webtest. 2024-02-17T12:13:06.353 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-02-17T12:13:06.420 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-17T12:13:06.569 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-17T12:13:06.584 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-17T12:13:06.627 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-17T12:13:06.708 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pecan. 2024-02-17T12:13:06.722 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-17T12:13:06.766 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-17T12:13:06.897 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-mako. 2024-02-17T12:13:06.912 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-17T12:13:06.947 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-17T12:13:07.121 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-certifi. 2024-02-17T12:13:07.135 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-02-17T12:13:07.170 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-17T12:13:07.284 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-17T12:13:07.299 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-17T12:13:07.350 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-17T12:13:07.465 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-idna. 2024-02-17T12:13:07.479 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-02-17T12:13:07.523 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-17T12:13:07.653 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-17T12:13:07.668 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-17T12:13:07.711 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-17T12:13:07.826 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-urllib3. 2024-02-17T12:13:07.841 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-17T12:13:07.884 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-17T12:13:08.006 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-webob. 2024-02-17T12:13:08.020 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-17T12:13:08.064 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-17T12:13:08.188 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests. 2024-02-17T12:13:08.203 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-17T12:13:08.245 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-17T12:13:08.384 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-waitress. 2024-02-17T12:13:08.398 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-17T12:13:08.453 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-17T12:13:08.573 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-17T12:13:08.588 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-17T12:13:08.623 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-17T12:13:08.736 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-tempita. 2024-02-17T12:13:08.751 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-17T12:13:08.786 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-17T12:13:08.909 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-17T12:13:08.924 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:08.968 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:09.089 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-paste. 2024-02-17T12:13:09.104 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-17T12:13:09.764 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-17T12:13:09.998 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-17T12:13:10.013 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:10.056 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:10.076 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-17T12:13:10.090 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-17T12:13:10.134 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-17T12:13:10.334 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-17T12:13:10.349 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-17T12:13:10.395 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-17T12:13:10.409 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-17T12:13:10.410 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-17T12:13:10.453 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-17T12:13:10.712 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-openssl. 2024-02-17T12:13:10.727 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-02-17T12:13:10.739 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-webtest. 2024-02-17T12:13:10.754 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-02-17T12:13:10.770 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-17T12:13:10.798 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-17T12:13:11.106 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr. 2024-02-17T12:13:11.121 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:11.134 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pecan. 2024-02-17T12:13:11.149 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-17T12:13:11.165 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:11.192 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-17T12:13:11.538 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-certifi. 2024-02-17T12:13:11.553 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-02-17T12:13:11.576 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mon. 2024-02-17T12:13:11.591 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:11.596 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-17T12:13:11.634 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mon (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:11.933 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-idna. 2024-02-17T12:13:11.948 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-02-17T12:13:11.983 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-17T12:13:12.171 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-osd. 2024-02-17T12:13:12.185 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:12.221 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-osd (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:12.294 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-urllib3. 2024-02-17T12:13:12.309 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-17T12:13:12.352 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-17T12:13:12.630 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-requests. 2024-02-17T12:13:12.644 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-17T12:13:12.688 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-17T12:13:12.957 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph. 2024-02-17T12:13:12.972 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../068-ceph_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:12.991 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-17T12:13:13.006 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-17T12:13:13.015 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:13.049 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-17T12:13:13.302 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-17T12:13:13.317 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:13.360 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-fuse. 2024-02-17T12:13:13.360 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:13.375 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:13.417 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-fuse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:13.748 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mds. 2024-02-17T12:13:13.763 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:13.782 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-17T12:13:13.796 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:13.797 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mds (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:13.840 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:14.118 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-17T12:13:14.132 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-17T12:13:14.158 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephadm. 2024-02-17T12:13:14.168 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-17T12:13:14.172 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../071-cephadm_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:14.250 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephadm (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:14.462 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-openssl. 2024-02-17T12:13:14.477 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-02-17T12:13:14.537 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-17T12:13:14.570 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-17T12:13:14.584 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-17T12:13:14.627 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-17T12:13:14.907 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr. 2024-02-17T12:13:14.922 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:14.972 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-17T12:13:14.974 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:14.986 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-17T12:13:15.030 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-17T12:13:15.352 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mon. 2024-02-17T12:13:15.367 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:15.410 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mon (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:15.952 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-babel. 2024-02-17T12:13:15.966 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-17T12:13:15.972 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-osd. 2024-02-17T12:13:15.987 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:16.010 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-17T12:13:16.030 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-osd (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:16.360 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jinja2. 2024-02-17T12:13:16.369 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-17T12:13:16.417 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-17T12:13:16.724 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-17T12:13:16.742 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:16.782 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:16.784 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph. 2024-02-17T12:13:16.798 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../068-ceph_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:16.849 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:17.135 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-17T12:13:17.150 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-02-17T12:13:17.177 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-fuse. 2024-02-17T12:13:17.192 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:17.193 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-17T12:13:17.235 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-fuse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:17.505 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-routes. 2024-02-17T12:13:17.519 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-17T12:13:17.538 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mds. 2024-02-17T12:13:17.553 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:17.563 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-17T12:13:17.588 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mds (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:17.891 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-17T12:13:17.905 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:17.949 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:17.974 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package cephadm. 2024-02-17T12:13:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../071-cephadm_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:18.032 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking cephadm (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:18.327 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-17T12:13:18.342 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-17T12:13:18.361 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-17T12:13:18.375 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-17T12:13:18.405 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-17T12:13:18.419 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-17T12:13:18.713 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-17T12:13:18.728 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-17T12:13:18.771 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-17T12:13:18.922 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-joblib. 2024-02-17T12:13:18.937 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-17T12:13:18.981 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-17T12:13:19.326 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-17T12:13:19.339 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-17T12:13:19.461 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-17T12:13:19.784 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-babel. 2024-02-17T12:13:19.797 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-17T12:13:19.834 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-17T12:13:19.989 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn. 2024-02-17T12:13:20.004 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-17T12:13:20.047 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-17T12:13:20.145 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jinja2. 2024-02-17T12:13:20.162 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-17T12:13:20.203 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-17T12:13:20.540 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-17T12:13:20.554 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:20.598 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:20.690 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-17T12:13:20.703 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:20.739 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:20.943 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-17T12:13:20.958 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-02-17T12:13:21.001 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-17T12:13:21.287 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-routes. 2024-02-17T12:13:21.303 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-17T12:13:21.345 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-17T12:13:21.659 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cachetools. 2024-02-17T12:13:21.675 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-02-17T12:13:21.682 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-17T12:13:21.697 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:21.717 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-17T12:13:21.740 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:22.053 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-17T12:13:22.069 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-17T12:13:22.112 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-17T12:13:22.152 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-17T12:13:22.166 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-17T12:13:22.210 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-17T12:13:22.432 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-17T12:13:22.447 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-17T12:13:22.490 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-17T12:13:22.680 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-joblib. 2024-02-17T12:13:22.694 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-17T12:13:22.738 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-17T12:13:22.809 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rsa. 2024-02-17T12:13:22.825 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-02-17T12:13:22.893 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-17T12:13:23.100 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-17T12:13:23.115 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-17T12:13:23.213 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-google-auth. 2024-02-17T12:13:23.229 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-02-17T12:13:23.235 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-17T12:13:23.262 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-17T12:13:23.558 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-17T12:13:23.563 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-sklearn. 2024-02-17T12:13:23.573 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-17T12:13:23.578 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-17T12:13:23.616 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-17T12:13:23.621 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-17T12:13:23.960 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-websocket. 2024-02-17T12:13:23.976 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-02-17T12:13:24.018 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-17T12:13:24.230 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-17T12:13:24.244 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:24.288 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:24.338 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-17T12:13:24.354 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-17T12:13:24.396 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-17T12:13:25.043 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-17T12:13:25.058 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:25.102 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:25.200 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cachetools. 2024-02-17T12:13:25.215 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-02-17T12:13:25.258 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-17T12:13:25.421 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-17T12:13:25.435 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-17T12:13:25.479 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-17T12:13:25.561 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-17T12:13:25.576 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-17T12:13:25.619 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-17T12:13:25.824 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-17T12:13:25.838 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-17T12:13:25.883 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-17T12:13:25.922 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-17T12:13:25.938 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-17T12:13:25.980 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-17T12:13:26.110 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package jq. 2024-02-17T12:13:26.124 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-17T12:13:26.168 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-17T12:13:26.275 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rsa. 2024-02-17T12:13:26.290 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-02-17T12:13:26.333 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-17T12:13:26.445 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package socat. 2024-02-17T12:13:26.459 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-17T12:13:26.504 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-17T12:13:26.654 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-google-auth. 2024-02-17T12:13:26.669 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-02-17T12:13:26.711 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-17T12:13:26.843 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package xmlstarlet. 2024-02-17T12:13:26.854 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-17T12:13:26.898 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-17T12:13:27.057 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-17T12:13:27.072 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-17T12:13:27.114 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-17T12:13:27.236 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-test. 2024-02-17T12:13:27.252 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:27.294 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-test (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:27.418 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-websocket. 2024-02-17T12:13:27.433 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-02-17T12:13:27.467 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-17T12:13:27.754 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-17T12:13:27.769 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-17T12:13:27.804 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-17T12:13:28.501 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-17T12:13:28.515 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:28.559 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:28.862 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-17T12:13:28.876 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-17T12:13:28.920 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-17T12:13:29.223 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-17T12:13:29.236 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-17T12:13:29.265 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-volume. 2024-02-17T12:13:29.281 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:29.281 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-17T12:13:29.323 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-volume (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:29.542 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package jq. 2024-02-17T12:13:29.554 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-17T12:13:29.592 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-17T12:13:29.652 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-mirror. 2024-02-17T12:13:29.667 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:29.710 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-mirror (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:29.844 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package socat. 2024-02-17T12:13:29.855 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-17T12:13:29.894 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-17T12:13:30.198 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package xmlstarlet. 2024-02-17T12:13:30.208 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-17T12:13:30.247 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-17T12:13:30.288 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-colorama. 2024-02-17T12:13:30.304 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-02-17T12:13:30.346 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-02-17T12:13:30.635 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-test. 2024-02-17T12:13:30.646 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:30.685 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-test (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:30.707 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-shell. 2024-02-17T12:13:30.723 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:30.765 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-shell (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:31.071 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-top. 2024-02-17T12:13:31.084 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:31.126 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-top (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:31.363 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-17T12:13:31.378 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:31.412 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs-dev (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:31.707 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-17T12:13:31.722 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-17T12:13:31.765 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-17T12:13:32.127 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-17T12:13:32.150 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-02-17T12:13:32.194 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-17T12:13:32.581 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package nvme-cli. 2024-02-17T12:13:32.597 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-17T12:13:32.614 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-volume. 2024-02-17T12:13:32.626 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:32.639 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-17T12:13:32.664 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-volume (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:33.068 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package cephfs-mirror. 2024-02-17T12:13:33.069 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package pkg-config. 2024-02-17T12:13:33.080 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:33.083 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-17T12:13:33.118 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking cephfs-mirror (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:33.127 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-17T12:13:33.363 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-17T12:13:33.376 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-17T12:13:33.379 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-colorama. 2024-02-17T12:13:33.392 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-02-17T12:13:33.422 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-17T12:13:33.429 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-02-17T12:13:33.673 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package cephfs-shell. 2024-02-17T12:13:33.684 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:33.722 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking cephfs-shell (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:33.804 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-17T12:13:33.819 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-17T12:13:33.867 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-17T12:13:33.976 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package cephfs-top. 2024-02-17T12:13:33.988 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1515-g6822c7b5-1jammy_all.deb ... 2024-02-17T12:13:34.025 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking cephfs-top (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:34.152 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastescript. 2024-02-17T12:13:34.166 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-02-17T12:13:34.210 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-17T12:13:34.303 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-17T12:13:34.315 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:34.352 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libcephfs-dev (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:34.538 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pluggy. 2024-02-17T12:13:34.552 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-17T12:13:34.597 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-17T12:13:34.639 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-17T12:13:34.651 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-17T12:13:34.696 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-17T12:13:34.941 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-psutil. 2024-02-17T12:13:34.955 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-17T12:13:35.150 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-17T12:13:35.285 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-17T12:13:35.297 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-02-17T12:13:35.334 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-17T12:13:35.486 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-py. 2024-02-17T12:13:35.499 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-02-17T12:13:35.544 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-17T12:13:35.713 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package nvme-cli. 2024-02-17T12:13:35.726 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-17T12:13:35.754 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-17T12:13:35.880 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pygments. 2024-02-17T12:13:35.894 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-17T12:13:35.938 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-17T12:13:36.160 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package pkg-config. 2024-02-17T12:13:36.172 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-17T12:13:36.209 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-17T12:13:36.384 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-17T12:13:36.397 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-17T12:13:36.442 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-17T12:13:36.445 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-17T12:13:36.457 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-17T12:13:36.487 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-17T12:13:36.761 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-toml. 2024-02-17T12:13:36.775 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-02-17T12:13:36.819 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-17T12:13:36.923 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-17T12:13:36.935 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-17T12:13:36.964 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-17T12:13:37.115 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pytest. 2024-02-17T12:13:37.128 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-17T12:13:37.172 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-17T12:13:37.251 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pastescript. 2024-02-17T12:13:37.267 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-02-17T12:13:37.309 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-17T12:13:37.509 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplejson. 2024-02-17T12:13:37.523 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-17T12:13:37.567 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-17T12:13:37.629 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pluggy. 2024-02-17T12:13:37.643 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-17T12:13:37.687 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-17T12:13:37.862 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-17T12:13:37.875 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-17T12:13:37.920 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-17T12:13:38.015 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-psutil. 2024-02-17T12:13:38.029 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-17T12:13:38.073 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-17T12:13:38.410 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-py. 2024-02-17T12:13:38.423 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-02-17T12:13:38.468 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-17T12:13:38.682 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package radosgw. 2024-02-17T12:13:38.695 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../122-radosgw_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:38.740 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking radosgw (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:38.779 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pygments. 2024-02-17T12:13:38.793 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-17T12:13:38.837 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-17T12:13:39.291 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-17T12:13:39.301 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package rbd-fuse. 2024-02-17T12:13:39.303 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-17T12:13:39.315 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:39.341 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-17T12:13:39.359 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking rbd-fuse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:39.660 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-toml. 2024-02-17T12:13:39.670 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-17T12:13:39.672 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-02-17T12:13:39.710 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-17T12:13:39.940 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-17T12:13:40.013 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pytest. 2024-02-17T12:13:40.026 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-17T12:13:40.063 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-17T12:13:40.065 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-17T12:13:40.314 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-17T12:13:40.391 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-simplejson. 2024-02-17T12:13:40.404 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-17T12:13:40.441 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-17T12:13:40.702 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-17T12:13:40.707 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-17T12:13:40.715 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-17T12:13:40.744 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-17T12:13:41.275 INFO:teuthology.orchestra.run.smithi114.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-17T12:13:41.310 INFO:teuthology.orchestra.run.smithi114.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-02-17T12:13:41.350 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephadm (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:41.406 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package radosgw. 2024-02-17T12:13:41.418 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../122-radosgw_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:41.447 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking radosgw (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:41.895 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user cephadm....done 2024-02-17T12:13:42.036 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package rbd-fuse. 2024-02-17T12:13:42.040 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-17T12:13:42.048 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1515-g6822c7b5-1jammy_amd64.deb ... 2024-02-17T12:13:42.085 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking rbd-fuse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:42.333 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-17T12:13:42.369 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-17T12:13:42.584 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-17T12:13:42.640 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-17T12:13:42.710 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-17T12:13:42.750 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-17T12:13:42.961 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-17T12:13:43.035 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-17T12:13:43.229 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-17T12:13:43.355 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-17T12:13:43.417 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-17T12:13:43.698 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-17T12:13:44.026 INFO:teuthology.orchestra.run.smithi116.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-17T12:13:44.075 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-17T12:13:44.078 INFO:teuthology.orchestra.run.smithi116.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-02-17T12:13:44.160 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up cephadm (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:44.318 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-02-17T12:13:44.611 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-17T12:13:44.688 INFO:teuthology.orchestra.run.smithi116.stdout:Adding system user cephadm....done 2024-02-17T12:13:44.849 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-17T12:13:44.878 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-02-17T12:13:45.142 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-17T12:13:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-17T12:13:45.406 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-17T12:13:45.426 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-17T12:13:45.561 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-17T12:13:45.799 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-17T12:13:45.820 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-17T12:13:46.059 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-argparse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:46.088 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-17T12:13:46.214 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-17T12:13:46.318 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-17T12:13:46.444 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-17T12:13:46.524 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-17T12:13:46.570 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-02-17T12:13:46.829 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-17T12:13:46.884 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-17T12:13:46.955 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-17T12:13:47.144 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-02-17T12:13:47.257 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-17T12:13:47.395 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-17T12:13:47.673 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-17T12:13:47.688 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-02-17T12:13:47.695 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-17T12:13:47.751 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-17T12:13:47.852 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-17T12:13:47.948 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-17T12:13:48.207 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-17T12:13:48.228 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-17T12:13:48.354 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-17T12:13:48.475 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-17T12:13:48.630 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-17T12:13:48.743 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-ceph-argparse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:48.915 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-17T12:13:48.994 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-17T12:13:49.103 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-17T12:13:49.229 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-02-17T12:13:49.250 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up zip (3.0-12build2) ... 2024-02-17T12:13:49.350 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-17T12:13:49.497 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-17T12:13:49.623 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-17T12:13:49.882 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-17T12:13:50.011 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-17T12:13:50.243 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-17T12:13:50.287 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-17T12:13:50.304 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-17T12:13:50.377 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-17T12:13:50.413 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-17T12:13:50.503 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-17T12:13:50.539 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-17T12:13:50.862 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-17T12:13:50.865 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-17T12:13:50.988 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-17T12:13:51.258 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-17T12:13:51.264 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-17T12:13:51.493 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-17T12:13:51.541 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-17T12:13:51.833 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up zip (3.0-12build2) ... 2024-02-17T12:13:51.869 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-17T12:13:51.968 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-17T12:13:52.170 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-02-17T12:13:52.488 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-17T12:13:52.645 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-17T12:13:52.848 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-17T12:13:52.921 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-17T12:13:53.047 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-17T12:13:53.116 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-17T12:13:53.173 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-17T12:13:53.242 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-common (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:53.482 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-17T12:13:53.526 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-idna (3.3-1) ... 2024-02-17T12:13:53.844 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-17T12:13:53.883 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-17T12:13:54.143 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-17T12:13:54.528 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-17T12:13:54.821 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-02-17T12:13:55.058 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-17T12:13:55.147 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-17T12:13:55.277 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:13:55.386 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-17T12:13:55.646 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-17T12:13:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-17T12:13:55.806 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-17T12:13:55.914 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-17T12:13:56.108 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-17T12:13:56.241 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-17T12:13:56.259 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-ceph-common (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:13:56.508 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-17T12:13:56.560 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-idna (3.3-1) ... 2024-02-17T12:13:56.776 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:13:56.894 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-17T12:13:56.910 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-17T12:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-17T12:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-17T12:13:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-17T12:13:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-17T12:13:58.108 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-17T12:13:58.285 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-17T12:13:58.360 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:13:58.486 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-17T12:13:58.552 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-17T12:13:58.670 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-17T12:13:58.762 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-17T12:13:58.888 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-17T12:13:58.980 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-17T12:13:59.014 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-17T12:13:59.106 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-17T12:13:59.307 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-17T12:13:59.398 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-17T12:13:59.566 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-17T12:13:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-17T12:13:59.851 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:13:59.979 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-17T12:13:59.985 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-17T12:14:00.077 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-17T12:14:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-17T12:14:00.266 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-17T12:14:00.295 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-17T12:14:00.504 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-17T12:14:00.554 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-17T12:14:00.639 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-17T12:14:00.830 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-17T12:14:01.066 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-17T12:14:01.098 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-17T12:14:01.334 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-17T12:14:01.349 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-17T12:14:01.459 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-17T12:14:01.617 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-17T12:14:01.719 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:14:01.742 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-17T12:14:01.836 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-17T12:14:02.027 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-17T12:14:02.153 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-17T12:14:02.163 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-17T12:14:02.446 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-17T12:14:02.472 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-17T12:14:02.756 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-17T12:14:02.757 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-17T12:14:02.960 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-17T12:14:03.023 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-17T12:14:03.149 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-17T12:14:03.228 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-17T12:14:03.275 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-17T12:14:03.347 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-17T12:14:03.504 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-17T12:14:03.585 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-17T12:14:03.703 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-17T12:14:03.805 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-17T12:14:04.105 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-17T12:14:04.190 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-17T12:14:04.380 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-17T12:14:04.476 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-17T12:14:04.506 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-17T12:14:04.766 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-17T12:14:04.853 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-17T12:14:04.883 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-17T12:14:04.970 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librados2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:05.096 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:05.201 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-17T12:14:05.222 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-17T12:14:05.583 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:05.619 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-17T12:14:05.895 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-17T12:14:06.009 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libradosstriper1 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:06.131 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-17T12:14:06.144 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-17T12:14:06.408 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-17T12:14:06.420 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librbd1 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:06.571 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-modules-core (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:06.676 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-17T12:14:06.697 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-fuse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:06.906 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-17T12:14:06.906 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-17T12:14:06.952 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-17T12:14:07.329 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-17T12:14:07.456 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs-dev (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:07.583 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rados (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:07.622 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-17T12:14:07.700 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librgw2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:07.801 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-top (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:07.902 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-17T12:14:07.974 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-17T12:14:08.092 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librados2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:08.193 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:08.302 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-17T12:14:08.663 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libcephfs2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:08.789 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libradosstriper1 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:08.916 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-17T12:14:09.156 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rbd (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:09.209 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librbd1 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:09.274 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up rbd-fuse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:09.309 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-modules-core (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:09.417 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rgw (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:09.419 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-fuse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:09.542 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cephfs (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:09.619 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-17T12:14:09.619 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-17T12:14:09.685 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-shell (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:09.811 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-common (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:10.270 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libcephfs-dev (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:10.381 INFO:teuthology.orchestra.run.smithi114.stdout:Adding group ceph....done 2024-02-17T12:14:10.396 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rados (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:10.523 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librgw2 (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:10.665 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up cephfs-top (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:10.765 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user ceph....done 2024-02-17T12:14:10.808 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-17T12:14:10.959 INFO:teuthology.orchestra.run.smithi114.stdout:Setting system user ceph properties....done 2024-02-17T12:14:10.976 INFO:teuthology.orchestra.run.smithi114.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-17T12:14:11.115 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-17T12:14:11.495 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-17T12:14:12.078 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rbd (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:12.079 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-mirror (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:12.204 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up rbd-fuse (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:12.330 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rgw (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:12.436 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-02-17T12:14:12.437 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-02-17T12:14:12.439 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cephfs (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:12.549 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up cephfs-shell (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:12.658 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-common (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:13.047 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-test (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:13.200 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up radosgw (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:13.203 INFO:teuthology.orchestra.run.smithi116.stdout:Adding group ceph....done 2024-02-17T12:14:13.579 INFO:teuthology.orchestra.run.smithi116.stdout:Adding system user ceph....done 2024-02-17T12:14:13.723 INFO:teuthology.orchestra.run.smithi116.stdout:Setting system user ceph properties....done 2024-02-17T12:14:13.729 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-17T12:14:13.729 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-17T12:14:13.738 INFO:teuthology.orchestra.run.smithi116.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-17T12:14:13.883 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-17T12:14:14.272 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-17T12:14:14.374 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-base (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:14.731 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-17T12:14:14.950 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up cephfs-mirror (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:15.143 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-02-17T12:14:15.143 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-02-17T12:14:15.377 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mds (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:15.608 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-17T12:14:15.608 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-17T12:14:15.744 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-test (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:15.869 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up radosgw (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:16.279 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:16.408 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-17T12:14:16.409 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-17T12:14:16.492 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-17T12:14:16.492 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-17T12:14:16.980 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-base (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:17.114 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-osd (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:17.336 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-17T12:14:17.415 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-17T12:14:17.415 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-17T12:14:17.990 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mds (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:18.024 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:18.133 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:18.206 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-17T12:14:18.206 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-17T12:14:18.276 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mon (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:18.484 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-17T12:14:18.484 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-17T12:14:18.849 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:19.061 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-17T12:14:19.061 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-17T12:14:19.085 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-cephadm (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:19.228 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:19.354 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-dashboard (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:19.497 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-volume (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:19.676 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-osd (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:19.849 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-17T12:14:19.975 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-17T12:14:20.001 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-17T12:14:20.001 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-17T12:14:20.127 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-17T12:14:20.628 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:20.753 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:20.947 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mon (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:21.155 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-17T12:14:21.155 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-17T12:14:21.236 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-17T12:14:21.790 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-cephadm (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:21.933 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:21.957 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-17T12:14:21.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-02-17T12:14:22.035 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-02-17T12:14:22.050 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-dashboard (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:22.177 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-volume (19.0.0-1515-g6822c7b5-1jammy) ... 2024-02-17T12:14:22.203 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-02-17T12:14:22.204 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-02-17T12:14:22.356 INFO:teuthology.orchestra.run.smithi114.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-02-17T12:14:22.357 INFO:teuthology.orchestra.run.smithi114.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-02-17T12:14:22.357 INFO:teuthology.orchestra.run.smithi114.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-02-17T12:14:22.357 INFO:teuthology.orchestra.run.smithi114.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-02-17T12:14:22.357 INFO:teuthology.orchestra.run.smithi114.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-02-17T12:14:22.357 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-02-17T12:14:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-17T12:14:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-17T12:14:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-17T12:14:22.357 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-17T12:14:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-17T12:14:22.358 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-17T12:14:22.358 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-02-17T12:14:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-02-17T12:14:22.358 INFO:teuthology.orchestra.run.smithi114.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-02-17T12:14:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-02-17T12:14:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-02-17T12:14:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-02-17T12:14:22.359 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-02-17T12:14:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-02-17T12:14:22.359 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-02-17T12:14:22.360 INFO:teuthology.orchestra.run.smithi114.stdout: libengine-pkcs11-openssl 2024-02-17T12:14:22.409 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-02-17T12:14:22.410 INFO:teuthology.orchestra.run.smithi114.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-02-17T12:14:22.410 INFO:teuthology.orchestra.run.smithi114.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-02-17T12:14:22.410 INFO:teuthology.orchestra.run.smithi114.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-02-17T12:14:22.410 INFO:teuthology.orchestra.run.smithi114.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-02-17T12:14:22.411 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-02-17T12:14:22.411 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-02-17T12:14:22.411 INFO:teuthology.orchestra.run.smithi114.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-02-17T12:14:22.411 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2024-02-17T12:14:22.412 INFO:teuthology.orchestra.run.smithi114.stdout: libssl3 2024-02-17T12:14:22.513 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-17T12:14:22.596 INFO:teuthology.orchestra.run.smithi114.stdout:1 upgraded, 39 newly installed, 0 to remove and 276 not upgraded. 2024-02-17T12:14:22.596 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 54.6 MB of archives. 2024-02-17T12:14:22.596 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 202 MB of additional disk space will be used. 2024-02-17T12:14:22.596 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-02-17T12:14:22.613 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-17T12:14:22.765 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-17T12:14:23.094 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.14 [1,902 kB] 2024-02-17T12:14:23.352 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-02-17T12:14:23.386 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-02-17T12:14:23.388 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-02-17T12:14:23.393 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-02-17T12:14:23.396 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-02-17T12:14:23.397 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-02-17T12:14:23.401 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-02-17T12:14:23.403 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-02-17T12:14:23.568 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-02-17T12:14:23.568 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-02-17T12:14:23.819 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-02-17T12:14:23.840 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-17T12:14:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-17T12:14:24.549 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-02-17T12:14:24.622 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-02-17T12:14:24.788 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-02-17T12:14:24.788 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-02-17T12:14:24.824 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-02-17T12:14:24.826 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-02-17T12:14:24.826 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-02-17T12:14:24.853 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-02-17T12:14:24.854 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-02-17T12:14:24.858 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-02-17T12:14:24.860 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-02-17T12:14:24.889 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-02-17T12:14:24.942 INFO:teuthology.orchestra.run.smithi116.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-02-17T12:14:24.942 INFO:teuthology.orchestra.run.smithi116.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-02-17T12:14:24.942 INFO:teuthology.orchestra.run.smithi116.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-02-17T12:14:24.943 INFO:teuthology.orchestra.run.smithi116.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-02-17T12:14:24.943 INFO:teuthology.orchestra.run.smithi116.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-02-17T12:14:24.943 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-02-17T12:14:24.943 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-17T12:14:24.943 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-17T12:14:24.943 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-17T12:14:24.943 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-17T12:14:24.943 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-17T12:14:24.943 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-17T12:14:24.944 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-02-17T12:14:24.944 INFO:teuthology.orchestra.run.smithi116.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-02-17T12:14:24.944 INFO:teuthology.orchestra.run.smithi116.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-02-17T12:14:24.944 INFO:teuthology.orchestra.run.smithi116.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-02-17T12:14:24.944 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-02-17T12:14:24.945 INFO:teuthology.orchestra.run.smithi116.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-02-17T12:14:24.945 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-02-17T12:14:24.945 INFO:teuthology.orchestra.run.smithi116.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-02-17T12:14:24.945 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-02-17T12:14:24.945 INFO:teuthology.orchestra.run.smithi116.stdout: libengine-pkcs11-openssl 2024-02-17T12:14:24.995 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-02-17T12:14:24.996 INFO:teuthology.orchestra.run.smithi116.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-02-17T12:14:24.996 INFO:teuthology.orchestra.run.smithi116.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-02-17T12:14:24.996 INFO:teuthology.orchestra.run.smithi116.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-02-17T12:14:24.996 INFO:teuthology.orchestra.run.smithi116.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-02-17T12:14:24.996 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-02-17T12:14:24.996 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-02-17T12:14:24.996 INFO:teuthology.orchestra.run.smithi116.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-02-17T12:14:24.997 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages will be upgraded: 2024-02-17T12:14:24.997 INFO:teuthology.orchestra.run.smithi116.stdout: libssl3 2024-02-17T12:14:25.053 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.14 [2,374 kB] 2024-02-17T12:14:25.073 INFO:teuthology.orchestra.run.smithi116.stdout:1 upgraded, 39 newly installed, 0 to remove and 276 not upgraded. 2024-02-17T12:14:25.073 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 54.6 MB of archives. 2024-02-17T12:14:25.073 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 202 MB of additional disk space will be used. 2024-02-17T12:14:25.073 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-02-17T12:14:25.250 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.14 [1,902 kB] 2024-02-17T12:14:25.347 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-02-17T12:14:25.365 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-02-17T12:14:25.366 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-02-17T12:14:25.369 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-02-17T12:14:25.370 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-02-17T12:14:25.370 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-02-17T12:14:25.372 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-02-17T12:14:25.374 INFO:teuthology.orchestra.run.smithi116.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-02-17T12:14:25.374 INFO:teuthology.orchestra.run.smithi116.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-02-17T12:14:25.385 INFO:teuthology.orchestra.run.smithi116.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-02-17T12:14:25.406 INFO:teuthology.orchestra.run.smithi116.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-02-17T12:14:25.788 INFO:teuthology.orchestra.run.smithi116.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-02-17T12:14:25.789 INFO:teuthology.orchestra.run.smithi116.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-02-17T12:14:25.790 INFO:teuthology.orchestra.run.smithi116.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-02-17T12:14:25.793 INFO:teuthology.orchestra.run.smithi116.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-02-17T12:14:25.793 INFO:teuthology.orchestra.run.smithi116.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-02-17T12:14:25.794 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-02-17T12:14:25.794 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-02-17T12:14:25.797 INFO:teuthology.orchestra.run.smithi116.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-02-17T12:14:25.799 INFO:teuthology.orchestra.run.smithi116.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-02-17T12:14:25.809 INFO:teuthology.orchestra.run.smithi116.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-02-17T12:14:25.809 INFO:teuthology.orchestra.run.smithi116.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.14 [2,374 kB] 2024-02-17T12:14:25.821 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-02-17T12:14:25.842 INFO:teuthology.orchestra.run.smithi116.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-02-17T12:14:25.848 INFO:teuthology.orchestra.run.smithi116.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-02-17T12:14:25.862 INFO:teuthology.orchestra.run.smithi116.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-02-17T12:14:25.893 INFO:teuthology.orchestra.run.smithi116.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-02-17T12:14:25.897 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-02-17T12:14:25.900 INFO:teuthology.orchestra.run.smithi116.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-02-17T12:14:25.901 INFO:teuthology.orchestra.run.smithi116.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-02-17T12:14:25.902 INFO:teuthology.orchestra.run.smithi116.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-02-17T12:14:25.902 INFO:teuthology.orchestra.run.smithi116.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-02-17T12:14:25.906 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-02-17T12:14:25.907 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-02-17T12:14:25.907 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-02-17T12:14:25.908 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-02-17T12:14:25.914 INFO:teuthology.orchestra.run.smithi116.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-02-17T12:14:25.923 INFO:teuthology.orchestra.run.smithi116.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-02-17T12:14:25.937 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-02-17T12:14:25.940 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-02-17T12:14:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-02-17T12:14:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-02-17T12:14:26.158 INFO:teuthology.orchestra.run.smithi116.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-02-17T12:14:26.159 INFO:teuthology.orchestra.run.smithi116.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-02-17T12:14:26.159 INFO:teuthology.orchestra.run.smithi116.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-02-17T12:14:26.159 INFO:teuthology.orchestra.run.smithi116.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-02-17T12:14:26.180 INFO:teuthology.orchestra.run.smithi116.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-02-17T12:14:26.180 INFO:teuthology.orchestra.run.smithi116.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-02-17T12:14:26.553 INFO:teuthology.orchestra.run.smithi116.stdout:Preconfiguring packages ... 2024-02-17T12:14:26.563 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-02-17T12:14:26.646 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-02-17T12:14:26.646 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-02-17T12:14:26.647 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-02-17T12:14:26.722 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 54.6 MB in 1s (46.4 MB/s) 2024-02-17T12:14:26.736 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-02-17T12:14:26.742 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-02-17T12:14:26.864 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package flex. 2024-02-17T12:14:26.934 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140583 files and directories currently installed.) 2024-02-17T12:14:26.938 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-02-17T12:14:26.980 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking flex (2.6.4-8build2) ... 2024-02-17T12:14:27.206 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-02-17T12:14:27.207 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-02-17T12:14:27.515 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.14_amd64.deb ... 2024-02-17T12:14:27.586 INFO:teuthology.orchestra.run.smithi114.stdout:Preconfiguring packages ... 2024-02-17T12:14:27.685 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.14) over (3.0.2-0ubuntu1.7) ... 2024-02-17T12:14:27.727 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2024-02-17T12:14:27.870 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package flex. 2024-02-17T12:14:27.938 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140583 files and directories currently installed.) 2024-02-17T12:14:27.941 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-02-17T12:14:27.985 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking flex (2.6.4-8build2) ... 2024-02-17T12:14:28.075 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.14) ... 2024-02-17T12:14:28.529 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.14_amd64.deb ... 2024-02-17T12:14:28.611 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package bison. 2024-02-17T12:14:28.681 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140656 files and directories currently installed.) 2024-02-17T12:14:28.685 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-02-17T12:14:28.730 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-02-17T12:14:28.733 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.14) over (3.0.2-0ubuntu1.7) ... 2024-02-17T12:14:29.106 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.14) ... 2024-02-17T12:14:29.114 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-02-17T12:14:29.128 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-02-17T12:14:29.172 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-02-17T12:14:29.500 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package dump. 2024-02-17T12:14:29.514 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-02-17T12:14:29.558 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking dump (0.4b47-3) ... 2024-02-17T12:14:29.641 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package bison. 2024-02-17T12:14:29.711 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140656 files and directories currently installed.) 2024-02-17T12:14:29.714 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-02-17T12:14:29.760 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-02-17T12:14:29.837 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package indent. 2024-02-17T12:14:29.852 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:29.895 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-02-17T12:14:30.145 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-02-17T12:14:30.159 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-02-17T12:14:30.195 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-02-17T12:14:30.231 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-02-17T12:14:30.245 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-02-17T12:14:30.306 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-02-17T12:14:30.539 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package dump. 2024-02-17T12:14:30.554 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-02-17T12:14:30.598 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking dump (0.4b47-3) ... 2024-02-17T12:14:30.626 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-02-17T12:14:30.641 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-02-17T12:14:30.684 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-02-17T12:14:30.876 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package indent. 2024-02-17T12:14:30.891 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:30.920 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-02-17T12:14:30.934 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-02-17T12:14:30.936 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-02-17T12:14:30.979 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-02-17T12:14:31.195 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-02-17T12:14:31.210 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-02-17T12:14:31.253 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-02-17T12:14:31.358 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libfl2:amd64. 2024-02-17T12:14:31.373 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-02-17T12:14:31.408 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-02-17T12:14:31.616 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-02-17T12:14:31.632 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-02-17T12:14:31.668 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-02-17T12:14:31.683 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-02-17T12:14:31.684 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-02-17T12:14:31.726 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-02-17T12:14:31.928 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-02-17T12:14:31.943 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-02-17T12:14:31.977 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-02-17T12:14:32.029 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libjson-perl. 2024-02-17T12:14:32.045 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-02-17T12:14:32.088 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-02-17T12:14:32.272 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libfl2:amd64. 2024-02-17T12:14:32.288 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-02-17T12:14:32.330 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-02-17T12:14:32.390 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libllvm14:amd64. 2024-02-17T12:14:32.406 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-02-17T12:14:32.449 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-02-17T12:14:32.616 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-02-17T12:14:32.632 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-02-17T12:14:32.683 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-02-17T12:14:32.936 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjson-perl. 2024-02-17T12:14:32.952 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-02-17T12:14:32.994 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-02-17T12:14:33.288 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libllvm14:amd64. 2024-02-17T12:14:33.304 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-02-17T12:14:33.364 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-02-17T12:14:33.852 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-02-17T12:14:33.867 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-02-17T12:14:33.924 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-02-17T12:14:34.204 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libmbim-proxy. 2024-02-17T12:14:34.220 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-02-17T12:14:34.262 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-02-17T12:14:34.581 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-02-17T12:14:34.597 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-02-17T12:14:34.640 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-02-17T12:14:34.683 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-02-17T12:14:34.699 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-02-17T12:14:34.750 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-02-17T12:14:34.942 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libndp0:amd64. 2024-02-17T12:14:34.958 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-02-17T12:14:34.992 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-02-17T12:14:35.002 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmbim-proxy. 2024-02-17T12:14:35.018 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-02-17T12:14:35.052 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-02-17T12:14:35.328 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libnm0:amd64. 2024-02-17T12:14:35.344 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-02-17T12:14:35.371 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-02-17T12:14:35.387 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-02-17T12:14:35.387 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-02-17T12:14:35.429 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-02-17T12:14:35.732 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libpq5:amd64. 2024-02-17T12:14:35.747 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:35.766 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libndp0:amd64. 2024-02-17T12:14:35.781 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-02-17T12:14:35.789 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:35.823 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-02-17T12:14:36.117 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-02-17T12:14:36.132 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:36.151 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libnm0:amd64. 2024-02-17T12:14:36.167 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-02-17T12:14:36.202 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-02-17T12:14:36.546 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpq5:amd64. 2024-02-17T12:14:36.562 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:36.583 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-02-17T12:14:36.604 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:36.918 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqmi-proxy. 2024-02-17T12:14:36.933 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:36.978 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-02-17T12:14:37.214 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-02-17T12:14:37.230 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.14_amd64.deb ... 2024-02-17T12:14:37.272 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.14) ... 2024-02-17T12:14:37.350 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-02-17T12:14:37.366 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:37.416 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-02-17T12:14:37.711 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqmi-proxy. 2024-02-17T12:14:37.727 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:37.769 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-02-17T12:14:37.775 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-02-17T12:14:37.790 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-02-17T12:14:37.867 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-02-17T12:14:37.980 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-02-17T12:14:37.995 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.14_amd64.deb ... 2024-02-17T12:14:38.038 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.14) ... 2024-02-17T12:14:38.197 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package modemmanager. 2024-02-17T12:14:38.213 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-02-17T12:14:38.255 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-02-17T12:14:38.575 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-02-17T12:14:38.590 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-02-17T12:14:38.633 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-02-17T12:14:38.871 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package network-manager. 2024-02-17T12:14:38.885 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-02-17T12:14:38.935 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-02-17T12:14:38.994 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package modemmanager. 2024-02-17T12:14:39.010 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-02-17T12:14:39.052 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-02-17T12:14:39.568 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ppp. 2024-02-17T12:14:39.584 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-02-17T12:14:39.692 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package network-manager. 2024-02-17T12:14:39.707 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-02-17T12:14:39.767 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-02-17T12:14:39.920 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-02-17T12:14:40.264 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package pptp-linux. 2024-02-17T12:14:40.278 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-02-17T12:14:40.347 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-02-17T12:14:40.374 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ppp. 2024-02-17T12:14:40.389 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-02-17T12:14:40.583 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package network-manager-pptp. 2024-02-17T12:14:40.597 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-02-17T12:14:40.633 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-02-17T12:14:40.719 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-02-17T12:14:40.910 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-client-common. 2024-02-17T12:14:40.925 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-02-17T12:14:40.969 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-client-common (238) ... 2024-02-17T12:14:41.012 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package pptp-linux. 2024-02-17T12:14:41.026 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-02-17T12:14:41.070 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-02-17T12:14:41.281 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-client-14. 2024-02-17T12:14:41.295 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:41.339 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:41.347 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package network-manager-pptp. 2024-02-17T12:14:41.362 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-02-17T12:14:41.406 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-02-17T12:14:41.675 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client-common. 2024-02-17T12:14:41.690 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-02-17T12:14:41.735 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client-common (238) ... 2024-02-17T12:14:41.894 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-common. 2024-02-17T12:14:41.908 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-02-17T12:14:41.961 INFO:teuthology.orchestra.run.smithi116.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-02-17T12:14:41.992 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-common (238) ... 2024-02-17T12:14:42.147 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client-14. 2024-02-17T12:14:42.164 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:42.247 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:42.645 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-14. 2024-02-17T12:14:42.659 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:42.705 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:42.835 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-common. 2024-02-17T12:14:42.850 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-02-17T12:14:42.911 INFO:teuthology.orchestra.run.smithi114.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-02-17T12:14:42.942 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-common (238) ... 2024-02-17T12:14:43.576 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-14. 2024-02-17T12:14:43.592 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-02-17T12:14:43.637 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:43.756 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql. 2024-02-17T12:14:43.771 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-02-17T12:14:43.805 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql (14+238) ... 2024-02-17T12:14:44.041 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-client. 2024-02-17T12:14:44.056 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-02-17T12:14:44.099 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-client (14+238) ... 2024-02-17T12:14:44.343 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package postgresql-contrib. 2024-02-17T12:14:44.358 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-02-17T12:14:44.401 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking postgresql-contrib (14+238) ... 2024-02-17T12:14:44.703 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package tcl8.6. 2024-02-17T12:14:44.719 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-02-17T12:14:44.720 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql. 2024-02-17T12:14:44.735 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-02-17T12:14:44.762 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-02-17T12:14:44.778 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql (14+238) ... 2024-02-17T12:14:45.048 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package tcl. 2024-02-17T12:14:45.055 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client. 2024-02-17T12:14:45.064 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-02-17T12:14:45.070 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-02-17T12:14:45.110 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-02-17T12:14:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client (14+238) ... 2024-02-17T12:14:45.358 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-contrib. 2024-02-17T12:14:45.373 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-02-17T12:14:45.416 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-contrib (14+238) ... 2024-02-17T12:14:45.451 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package wpasupplicant. 2024-02-17T12:14:45.467 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-02-17T12:14:45.509 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-02-17T12:14:45.702 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package tcl8.6. 2024-02-17T12:14:45.717 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-02-17T12:14:45.752 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-02-17T12:14:45.854 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-02-17T12:14:45.871 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-02-17T12:14:45.913 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-02-17T12:14:46.063 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package tcl. 2024-02-17T12:14:46.079 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-02-17T12:14:46.126 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-02-17T12:14:46.291 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package usb-modeswitch. 2024-02-17T12:14:46.307 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-02-17T12:14:46.357 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-02-17T12:14:46.482 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package wpasupplicant. 2024-02-17T12:14:46.498 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-02-17T12:14:46.540 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-02-17T12:14:46.668 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-client-common (238) ... 2024-02-17T12:14:46.888 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up flex (2.6.4-8build2) ... 2024-02-17T12:14:46.937 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-02-17T12:14:46.953 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-02-17T12:14:46.987 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-02-17T12:14:47.014 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-02-17T12:14:47.140 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:47.266 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-02-17T12:14:47.340 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package usb-modeswitch. 2024-02-17T12:14:47.356 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-02-17T12:14:47.367 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-02-17T12:14:47.406 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-02-17T12:14:47.493 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:47.692 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client-common (238) ... 2024-02-17T12:14:47.930 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up flex (2.6.4-8build2) ... 2024-02-17T12:14:48.055 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-02-17T12:14:48.181 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:48.307 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-02-17T12:14:48.433 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-02-17T12:14:48.436 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-02-17T12:14:48.532 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-02-17T12:14:48.542 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:48.884 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-02-17T12:14:48.885 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-02-17T12:14:49.488 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-02-17T12:14:49.560 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-02-17T12:14:49.615 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-02-17T12:14:49.677 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.14) ... 2024-02-17T12:14:49.795 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-02-17T12:14:49.904 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-02-17T12:14:50.030 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-02-17T12:14:50.030 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-02-17T12:14:50.030 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-02-17T12:14:50.181 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-02-17T12:14:50.299 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-02-17T12:14:50.703 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-02-17T12:14:50.888 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.14) ... 2024-02-17T12:14:50.931 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-02-17T12:14:51.022 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-02-17T12:14:51.055 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up dump (0.4b47-3) ... 2024-02-17T12:14:51.150 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-02-17T12:14:51.173 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-02-17T12:14:51.207 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-02-17T12:14:51.307 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-02-17T12:14:51.341 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-02-17T12:14:51.441 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-02-17T12:14:51.458 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up tcl (8.6.11+1build2) ... 2024-02-17T12:14:51.559 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libjson-perl (4.04000-1) ... 2024-02-17T12:14:51.584 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-02-17T12:14:51.685 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-02-17T12:14:51.792 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-02-17T12:14:51.862 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-02-17T12:14:51.987 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-02-17T12:14:52.172 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-02-17T12:14:52.298 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-02-17T12:14:52.424 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-02-17T12:14:52.564 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-02-17T12:14:52.592 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-client (14+238) ... 2024-02-17T12:14:52.701 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-02-17T12:14:52.757 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up dump (0.4b47-3) ... 2024-02-17T12:14:52.853 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-02-17T12:14:52.917 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-02-17T12:14:53.043 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-02-17T12:14:53.153 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up tcl (8.6.11+1build2) ... 2024-02-17T12:14:53.270 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjson-perl (4.04000-1) ... 2024-02-17T12:14:53.300 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:14:53.300 INFO:teuthology.orchestra.run.smithi116.stdout:The following network interfaces were found in /etc/network/interfaces 2024-02-17T12:14:53.300 INFO:teuthology.orchestra.run.smithi116.stdout:which means they are currently configured by ifupdown: 2024-02-17T12:14:53.300 INFO:teuthology.orchestra.run.smithi116.stdout:- enp3s0f1 2024-02-17T12:14:53.300 INFO:teuthology.orchestra.run.smithi116.stdout:If you want to manage those interfaces with NetworkManager instead 2024-02-17T12:14:53.300 INFO:teuthology.orchestra.run.smithi116.stdout:remove their configuration from /etc/network/interfaces. 2024-02-17T12:14:53.301 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:14:53.396 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-02-17T12:14:53.433 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-02-17T12:14:53.486 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-02-17T12:14:53.548 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-02-17T12:14:53.724 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-02-17T12:14:53.832 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-02-17T12:14:53.900 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-02-17T12:14:54.026 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-02-17T12:14:54.144 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-02-17T12:14:54.218 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-02-17T12:14:54.295 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client (14+238) ... 2024-02-17T12:14:54.421 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-02-17T12:14:54.912 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-02-17T12:14:55.013 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:14:55.014 INFO:teuthology.orchestra.run.smithi114.stdout:The following network interfaces were found in /etc/network/interfaces 2024-02-17T12:14:55.014 INFO:teuthology.orchestra.run.smithi114.stdout:which means they are currently configured by ifupdown: 2024-02-17T12:14:55.014 INFO:teuthology.orchestra.run.smithi114.stdout:- enp3s0f1 2024-02-17T12:14:55.014 INFO:teuthology.orchestra.run.smithi114.stdout:If you want to manage those interfaces with NetworkManager instead 2024-02-17T12:14:55.014 INFO:teuthology.orchestra.run.smithi114.stdout:remove their configuration from /etc/network/interfaces. 2024-02-17T12:14:55.014 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:14:55.097 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-02-17T12:14:55.146 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-02-17T12:14:55.223 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-02-17T12:14:55.349 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-common (238) ... 2024-02-17T12:14:55.506 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-02-17T12:14:55.902 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-02-17T12:14:56.295 INFO:teuthology.orchestra.run.smithi116.stdout:Adding user postgres to group ssl-cert 2024-02-17T12:14:56.563 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:14:56.564 INFO:teuthology.orchestra.run.smithi116.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-02-17T12:14:56.607 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-02-17T12:14:56.734 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-02-17T12:14:56.828 INFO:teuthology.orchestra.run.smithi116.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-02-17T12:14:56.828 INFO:teuthology.orchestra.run.smithi116.stdout:Removing obsolete dictionary files: 2024-02-17T12:14:56.859 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-02-17T12:14:56.985 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-common (238) ... 2024-02-17T12:14:57.505 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-02-17T12:14:57.909 INFO:teuthology.orchestra.run.smithi114.stdout:Adding user postgres to group ssl-cert 2024-02-17T12:14:57.949 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:58.168 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:14:58.168 INFO:teuthology.orchestra.run.smithi114.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-02-17T12:14:58.265 INFO:teuthology.orchestra.run.smithi116.stdout:Creating new PostgreSQL cluster 14/main ... 2024-02-17T12:14:58.287 INFO:teuthology.orchestra.run.smithi116.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-02-17T12:14:58.337 INFO:teuthology.orchestra.run.smithi116.stdout:The files belonging to this database system will be owned by user "postgres". 2024-02-17T12:14:58.338 INFO:teuthology.orchestra.run.smithi116.stdout:This user must also own the server process. 2024-02-17T12:14:58.338 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:14:58.338 INFO:teuthology.orchestra.run.smithi116.stdout:The database cluster will be initialized with locale "en_US". 2024-02-17T12:14:58.338 INFO:teuthology.orchestra.run.smithi116.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-02-17T12:14:58.338 INFO:teuthology.orchestra.run.smithi116.stdout:The default text search configuration will be set to "english". 2024-02-17T12:14:58.338 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:14:58.338 INFO:teuthology.orchestra.run.smithi116.stdout:Data page checksums are disabled. 2024-02-17T12:14:58.338 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:14:58.338 INFO:teuthology.orchestra.run.smithi116.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-02-17T12:14:58.339 INFO:teuthology.orchestra.run.smithi116.stdout:creating subdirectories ... ok 2024-02-17T12:14:58.339 INFO:teuthology.orchestra.run.smithi116.stdout:selecting dynamic shared memory implementation ... posix 2024-02-17T12:14:58.362 INFO:teuthology.orchestra.run.smithi116.stdout:selecting default max_connections ... 100 2024-02-17T12:14:58.395 INFO:teuthology.orchestra.run.smithi116.stdout:selecting default shared_buffers ... 128MB 2024-02-17T12:14:58.410 INFO:teuthology.orchestra.run.smithi116.stdout:selecting default time zone ... Etc/UTC 2024-02-17T12:14:58.411 INFO:teuthology.orchestra.run.smithi116.stdout:creating configuration files ... ok 2024-02-17T12:14:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-02-17T12:14:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:Removing obsolete dictionary files: 2024-02-17T12:14:58.573 INFO:teuthology.orchestra.run.smithi116.stdout:running bootstrap script ... ok 2024-02-17T12:14:59.040 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-02-17T12:14:59.180 INFO:teuthology.orchestra.run.smithi116.stdout:performing post-bootstrap initialization ... ok 2024-02-17T12:14:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-02-17T12:14:59.697 INFO:teuthology.orchestra.run.smithi116.stdout:syncing data to disk ... ok 2024-02-17T12:14:59.867 INFO:teuthology.orchestra.run.smithi114.stdout:Creating new PostgreSQL cluster 14/main ... 2024-02-17T12:14:59.885 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-02-17T12:14:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:The files belonging to this database system will be owned by user "postgres". 2024-02-17T12:14:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:This user must also own the server process. 2024-02-17T12:14:59.942 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:14:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:The database cluster will be initialized with locale "en_US". 2024-02-17T12:14:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-02-17T12:14:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:The default text search configuration will be set to "english". 2024-02-17T12:14:59.942 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:14:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:Data page checksums are disabled. 2024-02-17T12:14:59.942 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:14:59.942 INFO:teuthology.orchestra.run.smithi114.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-02-17T12:14:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:creating subdirectories ... ok 2024-02-17T12:14:59.943 INFO:teuthology.orchestra.run.smithi114.stdout:selecting dynamic shared memory implementation ... posix 2024-02-17T12:14:59.966 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default max_connections ... 100 2024-02-17T12:14:59.999 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default shared_buffers ... 128MB 2024-02-17T12:15:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default time zone ... Etc/UTC 2024-02-17T12:15:00.014 INFO:teuthology.orchestra.run.smithi114.stdout:creating configuration files ... ok 2024-02-17T12:15:00.178 INFO:teuthology.orchestra.run.smithi114.stdout:running bootstrap script ... ok 2024-02-17T12:15:00.185 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-02-17T12:15:00.906 INFO:teuthology.orchestra.run.smithi114.stdout:performing post-bootstrap initialization ... ok 2024-02-17T12:15:01.476 INFO:teuthology.orchestra.run.smithi114.stdout:syncing data to disk ... ok 2024-02-17T12:15:01.969 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-02-17T12:15:03.232 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-02-17T12:15:03.341 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql-contrib (14+238) ... 2024-02-17T12:15:03.442 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up postgresql (14+238) ... 2024-02-17T12:15:03.560 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-02-17T12:15:03.719 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-02-17T12:15:03.979 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-02-17T12:15:03.979 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-02-17T12:15:04.729 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-02-17T12:15:05.011 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-02-17T12:15:05.081 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-17T12:15:05.112 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-contrib (14+238) ... 2024-02-17T12:15:05.241 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-17T12:15:05.261 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql (14+238) ... 2024-02-17T12:15:05.389 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-02-17T12:15:05.515 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-02-17T12:15:05.774 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-02-17T12:15:05.774 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-02-17T12:15:06.509 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-02-17T12:15:06.585 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-02-17T12:15:06.685 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-17T12:15:06.837 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-17T12:15:06.988 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-17T12:15:07.191 INFO:teuthology.orchestra.run.smithi116.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-17T12:15:07.199 DEBUG:teuthology.parallel:result is None 2024-02-17T12:15:09.323 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-02-17T12:15:09.483 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-17T12:15:10.002 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-17T12:15:10.010 DEBUG:teuthology.parallel:result is None 2024-02-17T12:15:10.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:15:10.236 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-query -W -f '${Version}' ceph 2024-02-17T12:15:10.258 INFO:teuthology.orchestra.run.smithi114.stdout:19.0.0-1515-g6822c7b5-1jammy 2024-02-17T12:15:10.259 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1515-g6822c7b5-1jammy 2024-02-17T12:15:10.259 INFO:teuthology.task.install:The correct ceph version 19.0.0-1515-g6822c7b5-1jammy is installed. 2024-02-17T12:15:10.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6822c7b54e949006be7a0802650d01723d834d1d 2024-02-17T12:15:10.476 DEBUG:teuthology.orchestra.run.smithi116:> dpkg-query -W -f '${Version}' ceph 2024-02-17T12:15:10.500 INFO:teuthology.orchestra.run.smithi116.stdout:19.0.0-1515-g6822c7b5-1jammy 2024-02-17T12:15:10.500 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1515-g6822c7b5-1jammy 2024-02-17T12:15:10.500 INFO:teuthology.task.install:The correct ceph version 19.0.0-1515-g6822c7b5-1jammy is installed. 2024-02-17T12:15:10.502 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-17T12:15:10.502 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:10.502 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-17T12:15:10.522 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:10.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-17T12:15:10.565 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-17T12:15:10.565 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:10.565 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-02-17T12:15:10.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-17T12:15:10.645 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:10.645 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-02-17T12:15:10.665 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-17T12:15:10.727 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-17T12:15:10.727 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:10.727 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-17T12:15:10.746 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-17T12:15:10.809 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:10.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-17T12:15:10.829 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-17T12:15:10.891 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-17T12:15:10.892 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:10.892 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-02-17T12:15:10.911 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-17T12:15:10.972 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:10.973 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-02-17T12:15:10.993 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-17T12:15:11.055 INFO:teuthology.run_tasks:Running task ceph... 2024-02-17T12:15:11.143 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-17T12:15:11.143 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2024-02-17T12:15:11.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2024-02-17T12:15:11.166 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-17T12:15:11.166 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-17T12:15:11.206 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-17T12:15:11.232 INFO:tasks.ceph:Creating extra log directories... 2024-02-17T12:15:11.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-17T12:15:11.266 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-17T12:15:11.302 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-17T12:15:11.303 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-17T12:15:11.303 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-17T12:15:11.303 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:11.303 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-17T12:15:11.331 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-17T12:15:11.416 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:11.416 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-17T12:15:11.425 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-17T12:15:11.521 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-17T12:15:11.521 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-17T12:15:11.522 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143', 'branch': 'main', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7563143', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 51, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 2794, 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL6soZ/2M0BMyTZaG5SYv/KkFa4RALmBoVtHAPaRow79sRvEhfmgz33c2kcX1s88HA3Yq1ObhawzKCu2QI7LLUw=', 'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDktHTE9B9MTGoufF2t6x5vPChZAEQ/ahQGXp91POuQtL+bao8eCNm13wDkdquQussIFlKHfFzqTde3pGGysEQM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '6822c7b54e949006be7a0802650d01723d834d1d', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-16_20:13:25', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-17T12:15:11.522 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-17T12:15:11.525 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-17T12:15:11.534 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2024-02-17T12:15:11.574 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2024-02-17T12:15:11.599 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:11.599 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-02-17T12:15:11.639 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-17T12:15:11.639 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-02-17T12:15:11.691 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-17T12:15:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:15:11.692 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-02-17T12:15:11.692 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:15:11.692 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-02-17 12:08:56.990677341 +0000 2024-02-17T12:15:11.692 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-02-17 12:08:56.734679627 +0000 2024-02-17T12:15:11.692 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-02-17 12:08:56.734679627 +0000 2024-02-17T12:15:11.692 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-02-17 12:08:56.734679627 +0000 2024-02-17T12:15:11.692 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-17T12:15:11.752 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-02-17T12:15:11.752 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-02-17T12:15:11.752 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000382885 s, 1.3 MB/s 2024-02-17T12:15:11.754 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-17T12:15:11.805 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-02-17T12:15:11.855 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-17T12:15:11.855 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:15:11.855 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-02-17T12:15:11.855 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:15:11.855 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-02-17 12:08:57.518672624 +0000 2024-02-17T12:15:11.855 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-02-17 12:08:57.258674947 +0000 2024-02-17T12:15:11.856 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-02-17 12:08:57.258674947 +0000 2024-02-17T12:15:11.856 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-02-17 12:08:57.258674947 +0000 2024-02-17T12:15:11.856 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-17T12:15:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-02-17T12:15:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-02-17T12:15:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000370841 s, 1.4 MB/s 2024-02-17T12:15:11.923 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-17T12:15:11.977 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-02-17T12:15:12.032 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-17T12:15:12.032 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:15:12.032 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-02-17T12:15:12.032 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:15:12.032 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-02-17 12:08:58.038667980 +0000 2024-02-17T12:15:12.032 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-02-17 12:08:57.786670230 +0000 2024-02-17T12:15:12.032 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-02-17 12:08:57.786670230 +0000 2024-02-17T12:15:12.032 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-02-17 12:08:57.786670230 +0000 2024-02-17T12:15:12.033 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-17T12:15:12.093 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-02-17T12:15:12.093 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-02-17T12:15:12.093 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000376171 s, 1.4 MB/s 2024-02-17T12:15:12.095 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-17T12:15:12.149 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-02-17T12:15:12.199 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-17T12:15:12.199 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:15:12.200 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 943 Links: 1 2024-02-17T12:15:12.200 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:15:12.200 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-02-17 12:08:58.530663584 +0000 2024-02-17T12:15:12.200 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-02-17 12:08:58.274665872 +0000 2024-02-17T12:15:12.200 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-02-17 12:08:58.274665872 +0000 2024-02-17T12:15:12.200 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-02-17 12:08:58.274665872 +0000 2024-02-17T12:15:12.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-17T12:15:12.261 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-02-17T12:15:12.261 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-02-17T12:15:12.261 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000394366 s, 1.3 MB/s 2024-02-17T12:15:12.263 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-17T12:15:12.317 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T12:15:12.318 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:12.318 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-02-17T12:15:12.327 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-17T12:15:12.327 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-02-17T12:15:12.376 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-17T12:15:12.376 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:15:12.376 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-02-17T12:15:12.376 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:15:12.376 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-02-17 12:08:58.038935060 +0000 2024-02-17T12:15:12.376 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-02-17 12:08:57.782951873 +0000 2024-02-17T12:15:12.376 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-02-17 12:08:57.782951873 +0000 2024-02-17T12:15:12.376 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-02-17 12:08:57.782951873 +0000 2024-02-17T12:15:12.377 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-17T12:15:12.438 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-02-17T12:15:12.438 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-02-17T12:15:12.438 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000385777 s, 1.3 MB/s 2024-02-17T12:15:12.440 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-17T12:15:12.494 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-02-17T12:15:12.544 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-17T12:15:12.544 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:15:12.544 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-02-17T12:15:12.545 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:15:12.545 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-02-17 12:08:58.546902582 +0000 2024-02-17T12:15:12.545 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-02-17 12:08:58.290918950 +0000 2024-02-17T12:15:12.545 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-02-17 12:08:58.290918950 +0000 2024-02-17T12:15:12.545 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-02-17 12:08:58.290918950 +0000 2024-02-17T12:15:12.545 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-17T12:15:12.606 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-02-17T12:15:12.606 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-02-17T12:15:12.606 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000377021 s, 1.4 MB/s 2024-02-17T12:15:12.608 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-17T12:15:12.662 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-02-17T12:15:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-17T12:15:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:15:12.712 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-02-17T12:15:12.712 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:15:12.712 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-02-17 12:08:59.090867976 +0000 2024-02-17T12:15:12.712 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-02-17 12:08:58.830884426 +0000 2024-02-17T12:15:12.713 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-02-17 12:08:58.830884426 +0000 2024-02-17T12:15:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-02-17 12:08:58.830884426 +0000 2024-02-17T12:15:12.713 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-17T12:15:12.774 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-02-17T12:15:12.774 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-02-17T12:15:12.774 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000382097 s, 1.3 MB/s 2024-02-17T12:15:12.776 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-17T12:15:12.834 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-02-17T12:15:12.888 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-17T12:15:12.888 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T12:15:12.888 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-02-17T12:15:12.888 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T12:15:12.888 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-02-17 12:08:59.602836267 +0000 2024-02-17T12:15:12.889 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-02-17 12:08:59.350851874 +0000 2024-02-17T12:15:12.889 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-02-17 12:08:59.350851874 +0000 2024-02-17T12:15:12.889 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-02-17 12:08:59.350851874 +0000 2024-02-17T12:15:12.889 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-17T12:15:12.950 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-02-17T12:15:12.950 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-02-17T12:15:12.950 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000392627 s, 1.3 MB/s 2024-02-17T12:15:12.952 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-17T12:15:13.010 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T12:15:13.010 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-17T12:15:13.010 INFO:tasks.ceph:Generating config... 2024-02-17T12:15:13.011 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-17T12:15:13.011 INFO:tasks.ceph:[client] debug client = 20 2024-02-17T12:15:13.011 INFO:tasks.ceph:[client] debug ms = 1 2024-02-17T12:15:13.011 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-17T12:15:13.011 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-17T12:15:13.011 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-02-17T12:15:13.011 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-17T12:15:13.012 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-17T12:15:13.013 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-17T12:15:13.014 INFO:tasks.ceph:Setting up mon.a... 2024-02-17T12:15:13.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-17T12:15:13.059 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.keyring 2024-02-17T12:15:13.078 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-17T12:15:13.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T12:15:13.190 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.114'), ('mon.b', '172.21.15.116'), ('mon.c', '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]')] 2024-02-17T12:15:13.190 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.114,172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-17T12:15:13.191 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:13.191 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-17T12:15:13.239 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.114 --add b 172.21.15.116 --addv c '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:13.325 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:13.325 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: generated fsid 718e3165-e11b-4138-adc9-584dcfeb6e24 2024-02-17T12:15:13.325 INFO:teuthology.orchestra.run.smithi114.stdout:setting min_mon_release = quincy 2024-02-17T12:15:13.325 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 0 2024-02-17T12:15:13.325 INFO:teuthology.orchestra.run.smithi114.stdout:fsid 718e3165-e11b-4138-adc9-584dcfeb6e24 2024-02-17T12:15:13.325 INFO:teuthology.orchestra.run.smithi114.stdout:last_changed 2024-02-17T12:15:13.326937+0000 2024-02-17T12:15:13.326 INFO:teuthology.orchestra.run.smithi114.stdout:created 2024-02-17T12:15:13.326937+0000 2024-02-17T12:15:13.326 INFO:teuthology.orchestra.run.smithi114.stdout:min_mon_release 17 (quincy) 2024-02-17T12:15:13.326 INFO:teuthology.orchestra.run.smithi114.stdout:election_strategy: 1 2024-02-17T12:15:13.326 INFO:teuthology.orchestra.run.smithi114.stdout:0: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.a 2024-02-17T12:15:13.326 INFO:teuthology.orchestra.run.smithi114.stdout:1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-02-17T12:15:13.326 INFO:teuthology.orchestra.run.smithi114.stdout:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-02-17T12:15:13.326 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-17T12:15:13.328 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-17T12:15:13.336 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 718e3165-e11b-4138-adc9-584dcfeb6e24... 2024-02-17T12:15:13.337 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-17T12:15:13.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-17T12:15:13.420 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-02-17T12:15:13.421 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-02-17T12:15:13.422 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-02-17T12:15:13.423 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790]" 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = 718e3165-e11b-4138-adc9-584dcfeb6e24 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-02-17T12:15:13.424 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.425 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: bdev async discard = True 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: bdev enable discard = True 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore allocator = bitmap 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 1/20 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 1/20 2024-02-17T12:15:13.426 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 4/10 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-02-17T12:15:13.427 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-02-17T12:15:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-02-17T12:15:13.429 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-02-17T12:15:13.430 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-02-17T12:15:13.431 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-02-17T12:15:13.432 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2024-02-17T12:15:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2024-02-17T12:15:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-17T12:15:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2024-02-17T12:15:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2024-02-17T12:15:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2024-02-17T12:15:13.432 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2024-02-17T12:15:13.433 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2024-02-17T12:15:13.434 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.114,172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790]" 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on skipped message = False 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 718e3165-e11b-4138-adc9-584dcfeb6e24 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2024-02-17T12:15:13.435 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug trim objects = true 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.436 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: bdev async discard = True 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: bdev enable discard = True 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore allocator = bitmap 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2024-02-17T12:15:13.437 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 1/20 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 1/20 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 4/10 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2024-02-17T12:15:13.438 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2024-02-17T12:15:13.439 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.440 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: mon op complaint time = 120 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: client mount timeout = 600 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: debug client = 20 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: rados mon op timeout = 900 2024-02-17T12:15:13.441 INFO:teuthology.orchestra.run.smithi116.stdout: rados osd op timeout = 900 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.c] 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.d] 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout:[mds] 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds = 20 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds balancer = 20 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug frag = True 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug scatterstat = True 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: mds op complaint time = 180 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: mds verify scatter = True 2024-02-17T12:15:13.442 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2024-02-17T12:15:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: rados mon op timeout = 900 2024-02-17T12:15:13.443 INFO:teuthology.orchestra.run.smithi116.stdout: rados osd op timeout = 900 2024-02-17T12:15:13.444 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-17T12:15:13.444 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-17T12:15:13.546 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-17T12:15:13.546 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:13.546 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-17T12:15:13.555 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:13.555 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-17T12:15:13.603 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:15:13.603 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:13.603 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-17T12:15:13.603 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T12:15:13.673 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:13.673 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:13.723 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:15:13.723 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:13.723 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-17T12:15:13.723 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-17T12:15:13.757 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:13.757 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:13.812 INFO:tasks.ceph:Setting up mon nodes... 2024-02-17T12:15:13.812 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-17T12:15:13.812 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-17T12:15:13.866 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-17T12:15:13.871 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-17T12:15:13.930 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-17T12:15:13.950 INFO:tasks.ceph:Setting up mds nodes... 2024-02-17T12:15:13.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-17T12:15:14.004 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-17T12:15:14.008 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-17T12:15:14.027 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-17T12:15:14.124 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-17T12:15:14.128 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-17T12:15:14.147 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-17T12:15:14.205 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-17T12:15:14.210 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-17T12:15:14.229 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-02-17T12:15:14.325 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-02-17T12:15:14.330 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-02-17T12:15:14.349 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-17T12:15:14.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-17T12:15:14.392 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-17T12:15:14.409 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-17T12:15:14.449 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-02-17T12:15:14.465 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-17T12:15:14.465 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-17T12:15:14.465 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-17T12:15:14.484 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T12:15:14.484 INFO:tasks.ceph:role: osd.0 2024-02-17T12:15:14.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:15:14.485 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-17T12:15:14.554 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:15:14.554 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:15:14.554 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:15:14.554 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-17T12:15:14.554 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:15:14.555 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:15:14.555 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:15:14.555 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-17T12:15:14.555 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:15:14.555 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:15:15.017 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-02-17T12:15:15.020 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-02-17T12:15:15.020 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-17T12:15:15.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-17T12:15:15.141 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-02-17T12:15:15.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:15:15.142 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-17T12:15:15.201 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T12:15:15.201 INFO:tasks.ceph:role: osd.1 2024-02-17T12:15:15.202 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:15:15.202 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-17T12:15:15.270 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:15:15.270 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:15:15.270 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:15:15.270 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-17T12:15:15.270 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:15:15.271 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:15:15.271 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:15:15.271 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-17T12:15:15.271 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:15:15.271 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:15:15.732 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-02-17T12:15:15.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-02-17T12:15:15.735 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-17T12:15:15.876 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-17T12:15:15.893 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-02-17T12:15:15.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:15:15.894 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-17T12:15:15.960 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T12:15:15.960 INFO:tasks.ceph:role: osd.2 2024-02-17T12:15:15.960 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:15:15.960 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-17T12:15:16.031 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:15:16.031 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:15:16.031 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:15:16.031 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-17T12:15:16.031 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:15:16.031 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:15:16.031 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:15:16.031 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-17T12:15:16.031 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:15:16.031 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:15:16.519 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-02-17T12:15:16.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-02-17T12:15:16.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-17T12:15:16.686 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-17T12:15:16.702 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-02-17T12:15:16.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:15:16.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-17T12:15:16.771 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-17T12:15:16.771 INFO:tasks.ceph:role: osd.3 2024-02-17T12:15:16.771 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:15:16.771 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-17T12:15:16.842 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:15:16.843 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:15:16.843 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:15:16.843 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-17T12:15:16.843 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:15:16.843 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:15:16.843 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:15:16.843 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-17T12:15:16.843 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:15:16.843 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:15:17.272 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-02-17T12:15:17.275 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-02-17T12:15:17.275 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-17T12:15:17.386 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-17T12:15:17.402 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-02-17T12:15:17.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:15:17.404 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:17.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:17.524+0000 7f0e1822b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-17T12:15:17.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:17.532+0000 7f0e1822b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-17T12:15:17.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:17.532+0000 7f0e1822b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T12:15:17.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:17.532+0000 7f0e1822b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T12:15:17.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:17.532+0000 7f0e1822b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-17T12:15:17.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:17.536+0000 7f0e1822b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-17T12:15:20.518 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-17T12:15:20.539 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:20.627+0000 7f9729d637c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-17T12:15:20.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:20.627+0000 7f9729d637c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-17T12:15:20.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:20.627+0000 7f9729d637c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T12:15:20.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:20.627+0000 7f9729d637c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T12:15:20.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:20.627+0000 7f9729d637c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-17T12:15:20.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:20.631+0000 7f9729d637c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-17T12:15:23.621 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-17T12:15:23.642 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:23.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:23.735+0000 7f81f4b317c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-17T12:15:23.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:23.735+0000 7f81f4b317c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-17T12:15:23.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:23.735+0000 7f81f4b317c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T12:15:23.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:23.735+0000 7f81f4b317c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T12:15:23.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:23.735+0000 7f81f4b317c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-17T12:15:23.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:23.739+0000 7f81f4b317c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-17T12:15:26.741 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-17T12:15:26.761 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:26.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:26.855+0000 7fd75b2377c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-17T12:15:26.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:26.855+0000 7fd75b2377c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-17T12:15:26.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:26.855+0000 7fd75b2377c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T12:15:26.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:26.855+0000 7fd75b2377c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T12:15:26.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:26.855+0000 7fd75b2377c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-17T12:15:26.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:26.859+0000 7fd75b2377c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-17T12:15:29.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-17T12:15:29.849 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-17T12:15:29.871 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T12:15:29.871 INFO:tasks.ceph:role: osd.4 2024-02-17T12:15:29.871 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:15:29.871 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-17T12:15:29.940 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:15:29.940 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:15:29.940 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:15:29.940 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-17T12:15:29.940 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:15:29.940 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:15:29.940 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:15:29.941 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-17T12:15:29.941 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:15:29.941 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:15:30.433 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-02-17T12:15:30.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-02-17T12:15:30.437 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-17T12:15:30.587 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-17T12:15:30.604 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: /sbin/restorecon: command not found 2024-02-17T12:15:30.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:15:30.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-17T12:15:30.672 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T12:15:30.672 INFO:tasks.ceph:role: osd.5 2024-02-17T12:15:30.672 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:15:30.672 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-17T12:15:30.743 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:15:30.743 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:15:30.743 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:15:30.743 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-17T12:15:30.743 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:15:30.743 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:15:30.744 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:15:30.744 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-17T12:15:30.744 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:15:30.744 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:15:31.175 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-02-17T12:15:31.178 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-02-17T12:15:31.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-17T12:15:31.281 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-17T12:15:31.298 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: /sbin/restorecon: command not found 2024-02-17T12:15:31.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:15:31.299 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-17T12:15:31.364 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T12:15:31.364 INFO:tasks.ceph:role: osd.6 2024-02-17T12:15:31.364 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:15:31.364 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-17T12:15:31.439 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:15:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:15:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:15:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-17T12:15:31.439 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:15:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:15:31.439 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:15:31.439 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-17T12:15:31.439 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:15:31.440 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:15:31.899 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-02-17T12:15:31.902 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-02-17T12:15:31.902 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-17T12:15:32.036 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-17T12:15:32.053 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: /sbin/restorecon: command not found 2024-02-17T12:15:32.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:15:32.055 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-17T12:15:32.120 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-17T12:15:32.120 INFO:tasks.ceph:role: osd.7 2024-02-17T12:15:32.120 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:15:32.120 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-17T12:15:32.191 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-17T12:15:32.191 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-17T12:15:32.191 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-17T12:15:32.191 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-02-17T12:15:32.192 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-17T12:15:32.192 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-02-17T12:15:32.192 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-17T12:15:32.192 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-02-17T12:15:32.192 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-17T12:15:32.192 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-17T12:15:32.687 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-02-17T12:15:32.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-02-17T12:15:32.691 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-17T12:15:32.849 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-17T12:15:32.866 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: /sbin/restorecon: command not found 2024-02-17T12:15:32.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:15:32.868 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:32.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:32.989+0000 7fbfe399f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-17T12:15:32.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:32.989+0000 7fbfe399f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-17T12:15:32.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:32.989+0000 7fbfe399f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T12:15:32.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:32.989+0000 7fbfe399f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T12:15:32.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:32.989+0000 7fbfe399f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-17T12:15:32.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:32.993+0000 7fbfe399f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-17T12:15:35.971 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-17T12:15:35.991 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:36.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:36.077+0000 7f16b64ed7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-17T12:15:36.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:36.077+0000 7f16b64ed7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-17T12:15:36.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:36.077+0000 7f16b64ed7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T12:15:36.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:36.077+0000 7f16b64ed7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T12:15:36.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:36.077+0000 7f16b64ed7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-17T12:15:36.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:36.081+0000 7f16b64ed7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-17T12:15:39.075 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-17T12:15:39.095 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:39.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:39.189+0000 7f05270937c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-17T12:15:39.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:39.189+0000 7f05270937c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-17T12:15:39.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:39.189+0000 7f05270937c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T12:15:39.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:39.189+0000 7f05270937c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T12:15:39.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:39.189+0000 7f05270937c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-17T12:15:39.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:39.189+0000 7f05270937c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-17T12:15:41.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:15:41.527 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:15:42.182 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-17T12:15:42.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:42.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:42.293+0000 7f15385437c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-17T12:15:42.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:42.293+0000 7f15385437c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-17T12:15:42.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:42.293+0000 7f15385437c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T12:15:42.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:42.293+0000 7f15385437c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T12:15:42.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:42.293+0000 7f15385437c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-17T12:15:42.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:42.297+0000 7f15385437c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-17T12:15:45.277 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-17T12:15:45.298 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-17T12:15:45.298 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:45.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-17T12:15:45.319 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:45.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-17T12:15:45.383 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:45.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-17T12:15:45.447 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:45.447 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-17T12:15:45.510 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:45.511 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-17T12:15:45.571 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:45.571 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-17T12:15:45.634 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:45.635 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-17T12:15:45.695 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:45.695 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-17T12:15:45.716 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:45.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-17T12:15:45.780 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:45.780 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-02-17T12:15:45.844 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:45.844 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-17T12:15:45.908 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:45.908 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-17T12:15:45.971 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:45.972 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-17T12:15:46.035 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:46.036 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-17T12:15:46.099 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:46.099 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-17T12:15:46.109 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:46.109 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-02-17T12:15:46.152 INFO:tasks.ceph:Adding keys to all mons... 2024-02-17T12:15:46.152 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-17T12:15:46.156 DEBUG:teuthology.orchestra.run.smithi116:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-17T12:15:46.199 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2024-02-17T12:15:46.199 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBRo9Bl3bHCMxAAWLsuBBXWkaHkJFObZxBxpQ== 2024-02-17T12:15:46.199 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-02-17T12:15:46.199 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlC5lYABAA6azd56jLhAjZE9g08V7QEg== 2024-02-17T12:15:46.199 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-02-17T12:15:46.199 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlcfWBBxAAcGpOI9tt2XFAE53Z5D3IGQ== 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBVo9BlIUGPHxAAYFvkX6XSdQ2zrMlbG0tyLQ== 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBYo9BlhFOpJRAAw6abcA91k7UIqP7ZI0DJXw== 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBbo9BlcGMaLBAAowE5MXll20j9H2Bu9ENlHA== 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBeo9BlCjw4MxAAj8jUcH+AdAKzUGE1FV93AA== 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBRo9BlkgiBNxAAv1cRMj0JAsCW3C1QET2fxg== 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlN91JDBAA39pNGkFXITBkFPknKh80Zg== 2024-02-17T12:15:46.200 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9Bl6zR5ExAAhNGl0iGdaBXJGCuUW+v7mg== 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBko9BleeA4OxAAyqyptyDYwOEwVuofLJ2FIA== 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBoo9BlDQvsBBAARlmMLmSs370Rf6QXYzUURw== 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBro9Bl/IOLCxAACdC11z4y11nLvXVOngFJJA== 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBuo9Bl2traERAAej15lW/SHoN/AF0WWZUHQA== 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlaXt+FxAAn4YhbPPnUC6y0giRDPuYyQ== 2024-02-17T12:15:46.201 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-02-17T12:15:46.202 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlffPTGhAA6uMply4Nxw6KXsGwVHriZg== 2024-02-17T12:15:46.213 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.y] 2024-02-17T12:15:46.213 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBRo9Bl3bHCMxAAWLsuBBXWkaHkJFObZxBxpQ== 2024-02-17T12:15:46.213 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBSo9BlC5lYABAA6azd56jLhAjZE9g08V7QEg== 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.c] 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBSo9BlcfWBBxAAcGpOI9tt2XFAE53Z5D3IGQ== 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.0] 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBVo9BlIUGPHxAAYFvkX6XSdQ2zrMlbG0tyLQ== 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.1] 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBYo9BlhFOpJRAAw6abcA91k7UIqP7ZI0DJXw== 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.2] 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBbo9BlcGMaLBAAowE5MXll20j9H2Bu9ENlHA== 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.3] 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBeo9BlCjw4MxAAj8jUcH+AdAKzUGE1FV93AA== 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.x] 2024-02-17T12:15:46.214 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBRo9BlkgiBNxAAv1cRMj0JAsCW3C1QET2fxg== 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBSo9BlN91JDBAA39pNGkFXITBkFPknKh80Zg== 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.d] 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBSo9Bl6zR5ExAAhNGl0iGdaBXJGCuUW+v7mg== 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.4] 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBko9BleeA4OxAAyqyptyDYwOEwVuofLJ2FIA== 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.5] 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBoo9BlDQvsBBAARlmMLmSs370Rf6QXYzUURw== 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.6] 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBro9Bl/IOLCxAACdC11z4y11nLvXVOngFJJA== 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.7] 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBuo9Bl2traERAAej15lW/SHoN/AF0WWZUHQA== 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout:[client.0] 2024-02-17T12:15:46.215 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBSo9BlaXt+FxAAn4YhbPPnUC6y0giRDPuYyQ== 2024-02-17T12:15:46.216 INFO:teuthology.orchestra.run.smithi116.stdout:[client.1] 2024-02-17T12:15:46.216 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBSo9BlffPTGhAA6uMply4Nxw6KXsGwVHriZg== 2024-02-17T12:15:46.217 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T12:15:46.246 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T12:15:46.316 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:15:46.319 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:15:46.378 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:15:46.381 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:15:46.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.495 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.547 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.550 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.602 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.605 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T12:15:46.660 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-17T12:15:46.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:15:46.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:15:46.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:15:46.774 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-17T12:15:46.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.832 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.888 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.939 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.943 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:46.999 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-17T12:15:47.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T12:15:47.056 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T12:15:47.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T12:15:47.115 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-17T12:15:47.171 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-17T12:15:47.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-17T12:15:47.190 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T12:15:47.295 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-17T12:15:47.314 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-17T12:15:47.333 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T12:15:47.440 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-17T12:15:47.460 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-17T12:15:47.525 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-17T12:15:47.635 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-17T12:15:47.654 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:47.657 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-17T12:15:47.703 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-17T12:15:47.703 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-17T12:15:47.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-17T12:15:47.706 INFO:tasks.ceph.mon.a:Started 2024-02-17T12:15:47.707 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-17T12:15:47.707 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-17T12:15:47.746 INFO:tasks.ceph.mon.b:Started 2024-02-17T12:15:47.746 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-17T12:15:47.746 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-17T12:15:47.749 INFO:tasks.ceph.mon.c:Started 2024-02-17T12:15:47.749 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-17T12:15:47.750 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-17T12:15:47.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-17T12:15:47.753 INFO:tasks.ceph.mgr.y:Started 2024-02-17T12:15:47.753 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-17T12:15:47.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-17T12:15:47.756 INFO:tasks.ceph.mgr.x:Started 2024-02-17T12:15:47.756 INFO:tasks.ceph:Setting crush tunables to default 2024-02-17T12:15:47.756 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd crush tunables default 2024-02-17T12:15:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.891+0000 7fb3c6a00640 1 Processor -- start 2024-02-17T12:15:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.891+0000 7fb3c6a00640 1 -- start start 2024-02-17T12:15:47.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.891+0000 7fb3c6a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:47.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.891+0000 7fb3c6a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:47.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.891+0000 7fb3c6a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00723b0 con 0x7fb3c00c4760 2024-02-17T12:15:47.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.891+0000 7fb3c6a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0070000 con 0x7fb3c0152560 2024-02-17T12:15:47.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.891+0000 7fb3c6a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0154dc0 con 0x7fb3c0072b20 2024-02-17T12:15:47.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3bfe00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3b7400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3c4a00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb3c00c4760 0x7fb3c01586f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:43176/0 (socket says 172.21.15.114:43176) 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3c4a00640 1 -- 172.21.15.114:0/3686579877 learned_addr learned my addr 172.21.15.114:0/3686579877 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 msgr2=0x7fb3c00c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 msgr2=0x7fb3c00c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 msgr2=0x7fb3c00c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 msgr2=0x7fb3c00c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:47.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:47.895+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:15:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.099+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.099+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 msgr2=0x7fb3c00c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.099+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 msgr2=0x7fb3c00c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:48.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.099+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.099+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:15:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.099+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.099+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 msgr2=0x7fb3c00c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:15:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.099+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 msgr2=0x7fb3c00c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.099+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:48.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.099+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:15:48.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.503+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:48.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.503+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.503+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 msgr2=0x7fb3c00c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.503+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 msgr2=0x7fb3c00c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.503+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.503+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 msgr2=0x7fb3c00c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:15:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.503+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 msgr2=0x7fb3c00c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.503+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.503+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:15:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:48.503+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:15:49.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:49.307+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:49.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:49.307+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:49.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:49.307+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 msgr2=0x7fb3c00c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:15:49.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:49.307+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 msgr2=0x7fb3c00c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:49.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:49.307+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:49.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:49.307+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:15:49.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:49.307+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 msgr2=0x7fb3c00c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:49.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:49.307+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 msgr2=0x7fb3c00c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:49.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:49.307+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:49.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:49.307+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:15:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.891+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 msgr2=0x7fb3c00c4220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:15:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.891+0000 7fb3be000640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c0072b20 0x7fb3c00c4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 msgr2=0x7fb3c00c17c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:15:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3be000640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb3c0152560 0x7fb3c00c17c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 >> v1:172.21.15.116:6789/0 conn(0x7fb3c00c4760 legacy=0x7fb3c01586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3be000640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00728e0 con 0x7fb39c0036d0 2024-02-17T12:15:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0070000 con 0x7fb39c007360 2024-02-17T12:15:50.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:50.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 msgr2=0x7fb39c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:50.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 msgr2=0x7fb39c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:50.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:50.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:50.895+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:15:51.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:51.099+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:51.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:51.099+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 msgr2=0x7fb39c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:51.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:51.099+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 msgr2=0x7fb39c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:51.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:51.099+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:51.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:51.099+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:15:51.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:51.503+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:51.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:51.503+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 msgr2=0x7fb39c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:51.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:51.503+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 msgr2=0x7fb39c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:51.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:51.503+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:51.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:51.503+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:15:52.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:52.307+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:52.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:52.307+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 msgr2=0x7fb39c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:52.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:52.307+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 msgr2=0x7fb39c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:52.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:52.307+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:52.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:52.307+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:15:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 msgr2=0x7fb39c009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:15:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3be000640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c007360 0x7fb39c009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 >> v1:172.21.15.114:6789/0 conn(0x7fb39c0036d0 legacy=0x7fb39c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3c4a00640 1 -- 172.21.15.114:0/3686579877 reap_dead start 2024-02-17T12:15:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3be000640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39c00af30 con 0x7fb39c009ff0 2024-02-17T12:15:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39c005fe0 con 0x7fb39c0067a0 2024-02-17T12:15:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0070000 con 0x7fb39c003b20 2024-02-17T12:15:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:53.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 msgr2=0x7fb39c006260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:53.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 msgr2=0x7fb39c006260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:53.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:53.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:53.895+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:15:54.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:54.099+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:54.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:54.099+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 msgr2=0x7fb39c006260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:54.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:54.099+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 msgr2=0x7fb39c006260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:54.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:54.099+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:54.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:54.099+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:15:54.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:54.503+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:54.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:54.503+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 msgr2=0x7fb39c006260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:54.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:54.503+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 msgr2=0x7fb39c006260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:54.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:54.503+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:54.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:54.503+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:15:55.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:55.307+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:55.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:55.307+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 msgr2=0x7fb39c006260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:55.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:55.307+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 msgr2=0x7fb39c006260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:55.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:55.307+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:55.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:55.307+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-17T12:15:56.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 msgr2=0x7fb39c006260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-17T12:15:56.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3be000640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.114:3300/0 conn(0x7fb39c003b20 0x7fb39c006260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:56.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 >> v1:172.21.15.116:6789/0 conn(0x7fb39c0067a0 legacy=0x7fb39c00e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:56.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 >> v1:172.21.15.114:6789/0 conn(0x7fb39c009ff0 legacy=0x7fb39c00a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:56.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3be000640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:56.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3be000640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:56.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0070000 con 0x7fb39c006c50 2024-02-17T12:15:56.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3be000640 1 -- 172.21.15.114:0/3686579877 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0154dc0 con 0x7fb39c011e90 2024-02-17T12:15:56.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:56.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:56.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 msgr2=0x7fb39c011950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:56.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 msgr2=0x7fb39c011950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:56.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:56.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:15:56.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 msgr2=0x7fb39c014280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:15:56.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 msgr2=0x7fb39c014280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:56.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:56.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:56.894+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-17T12:15:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.098+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.098+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.098+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 msgr2=0x7fb39c011950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:15:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.098+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 msgr2=0x7fb39c011950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.098+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.098+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:15:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.098+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 msgr2=0x7fb39c014280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:57.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.098+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 msgr2=0x7fb39c014280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:57.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.098+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:57.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.098+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-17T12:15:57.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.502+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:57.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.502+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:57.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.502+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 msgr2=0x7fb39c011950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-17T12:15:57.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.502+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 msgr2=0x7fb39c011950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:57.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.502+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:57.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.502+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:15:57.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.502+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 msgr2=0x7fb39c014280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-17T12:15:57.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.502+0000 7fb3b7400640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 msgr2=0x7fb39c014280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-17T12:15:57.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.502+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-17T12:15:57.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:57.502+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-17T12:15:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.306+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> v2:172.21.15.116:3300/0 conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.306+0000 7fb3b7400640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.306+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 msgr2=0x7fb39c014280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:15:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.306+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb39c011e90 0x7fb39c014280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.306+0000 7fb3bfe00640 1 -- 172.21.15.114:0/3686579877 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c0097d0 con 0x7fb39c006c50 2024-02-17T12:15:58.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.306+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb39c006c50 0x7fb39c011950 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb39c007270 tx=0x7fb3b001e1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8de959b86e5fb5f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:58.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3bf400640 1 -- 172.21.15.114:0/3686579877 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00af410 con 0x7fb39c006c50 2024-02-17T12:15:58.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3bf400640 1 -- 172.21.15.114:0/3686579877 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b00a9030 con 0x7fb39c006c50 2024-02-17T12:15:58.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3bf400640 1 -- 172.21.15.114:0/3686579877 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00af790 con 0x7fb39c006c50 2024-02-17T12:15:58.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3c6a00640 1 -- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb39c006c50 msgr2=0x7fb39c011950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:58.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3c6a00640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb39c006c50 0x7fb39c011950 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb39c007270 tx=0x7fb3b001e1f0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3c4a00640 1 -- 172.21.15.114:0/3686579877 reap_dead start 2024-02-17T12:15:58.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3c6a00640 1 -- 172.21.15.114:0/3686579877 shutdown_connections 2024-02-17T12:15:58.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3c6a00640 1 --2- 172.21.15.114:0/3686579877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb39c006c50 0x7fb39c011950 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3c6a00640 1 -- 172.21.15.114:0/3686579877 >> 172.21.15.114:0/3686579877 conn(0x7fb3c006bef0 msgr2=0x7fb3c006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:58.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3c6a00640 1 -- 172.21.15.114:0/3686579877 shutdown_connections 2024-02-17T12:15:58.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3c6a00640 1 -- 172.21.15.114:0/3686579877 wait complete. 2024-02-17T12:15:58.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3c6a00640 1 Processor -- start 2024-02-17T12:15:58.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.310+0000 7fb3c6a00640 1 -- start start 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3c6a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb39c006c50 0x7fb3c00a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3c6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3c014c030 0x7fb3c014c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3c6a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c014f6c0 0x7fb3c014fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3c6a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00a7d90 con 0x7fb3c014c030 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3c6a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c01ee6b0 con 0x7fb39c006c50 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3c6a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c014c4b0 con 0x7fb3c014f6c0 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3b7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3c014c030 0x7fb3c014c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3b7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3c014c030 0x7fb3c014c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35628/0 (socket says 172.21.15.114:35628) 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3b7400640 1 -- 172.21.15.114:0/959178776 learned_addr learned my addr 172.21.15.114:0/959178776 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3c4a00640 1 --2- 172.21.15.114:0/959178776 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c014f6c0 0x7fb3c014fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3bfe00640 1 --2- 172.21.15.114:0/959178776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb39c006c50 0x7fb3c00a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:58.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3b7400640 1 -- 172.21.15.114:0/959178776 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c014f6c0 msgr2=0x7fb3c014fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:58.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3b7400640 1 --2- 172.21.15.114:0/959178776 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c014f6c0 0x7fb3c014fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3b7400640 1 -- 172.21.15.114:0/959178776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb39c006c50 msgr2=0x7fb3c00a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:58.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3b7400640 1 --2- 172.21.15.114:0/959178776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb39c006c50 0x7fb3c00a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3b7400640 1 -- 172.21.15.114:0/959178776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c00af30 con 0x7fb3c014c030 2024-02-17T12:15:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3b7400640 1 --2- 172.21.15.114:0/959178776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3c014c030 0x7fb3c014c6a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80179f0 tx=0x7fb3a8017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3bcc00640 1 -- 172.21.15.114:0/959178776 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8023bf0 con 0x7fb3c014c030 2024-02-17T12:15:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3bcc00640 1 -- 172.21.15.114:0/959178776 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a800c040 con 0x7fb3c014c030 2024-02-17T12:15:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3bcc00640 1 -- 172.21.15.114:0/959178776 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8025420 con 0x7fb3c014c030 2024-02-17T12:15:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3c6a00640 1 -- 172.21.15.114:0/959178776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c00a75a0 con 0x7fb3c014c030 2024-02-17T12:15:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3c6a00640 1 -- 172.21.15.114:0/959178776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c01ee060 con 0x7fb3c014c030 2024-02-17T12:15:58.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3bcc00640 1 -- 172.21.15.114:0/959178776 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb3a8025580 con 0x7fb3c014c030 2024-02-17T12:15:58.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3bcc00640 1 -- 172.21.15.114:0/959178776 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb3a802dcc0 con 0x7fb3c014c030 2024-02-17T12:15:58.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.314+0000 7fb3c6a00640 1 -- 172.21.15.114:0/959178776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c0067370 con 0x7fb3c014c030 2024-02-17T12:15:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.330+0000 7fb3bcc00640 1 -- 172.21.15.114:0/959178776 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fb3a8032020 con 0x7fb3c014c030 2024-02-17T12:15:58.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.394+0000 7fb3c6a00640 1 -- 172.21.15.114:0/959178776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb3c0074840 con 0x7fb3c014c030 2024-02-17T12:15:58.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.398+0000 7fb3bcc00640 1 -- 172.21.15.114:0/959178776 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb3a800f040 con 0x7fb3c014c030 2024-02-17T12:15:58.400 INFO:teuthology.orchestra.run.smithi114.stderr:adjusted tunables profile to default 2024-02-17T12:15:58.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.398+0000 7fb3c6a00640 1 -- 172.21.15.114:0/959178776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3c014c030 msgr2=0x7fb3c014c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:58.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.398+0000 7fb3c6a00640 1 --2- 172.21.15.114:0/959178776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3c014c030 0x7fb3c014c6a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80179f0 tx=0x7fb3a8017eb0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.398+0000 7fb3c6a00640 1 -- 172.21.15.114:0/959178776 shutdown_connections 2024-02-17T12:15:58.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.398+0000 7fb3c6a00640 1 --2- 172.21.15.114:0/959178776 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3c014f6c0 0x7fb3c014fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.398+0000 7fb3c6a00640 1 --2- 172.21.15.114:0/959178776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3c014c030 0x7fb3c014c6a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.398+0000 7fb3c6a00640 1 --2- 172.21.15.114:0/959178776 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb39c006c50 0x7fb3c00a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.398+0000 7fb3c6a00640 1 -- 172.21.15.114:0/959178776 >> 172.21.15.114:0/959178776 conn(0x7fb3c006bef0 msgr2=0x7fb3c01519c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:58.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.398+0000 7fb3c6a00640 1 -- 172.21.15.114:0/959178776 shutdown_connections 2024-02-17T12:15:58.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:15:58.398+0000 7fb3c6a00640 1 -- 172.21.15.114:0/959178776 wait complete. 2024-02-17T12:15:58.423 INFO:tasks.ceph:check_enable_crimson: False 2024-02-17T12:15:58.423 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-17T12:15:58.423 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:58.423 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-17T12:15:58.443 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:58.443 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-17T12:15:58.503 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:58.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-17T12:15:58.505 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:15:58.502+0000 7f1346b4f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-17T12:15:58.512 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:15:58.509+0000 7fda1850b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-17T12:15:58.524 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:15:58.524 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-17T12:15:58.587 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:58.587 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-17T12:15:58.606 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:58.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-17T12:15:58.667 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:58.667 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-17T12:15:58.730 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:15:58.730 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-17T12:15:58.790 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 27755643-ee85-4399-8ad6-962e7c2a630d 0 2024-02-17T12:15:58.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.957+0000 7fc9c7000640 1 Processor -- start 2024-02-17T12:15:58.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9c7000640 1 -- start start 2024-02-17T12:15:58.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9c7000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc9c0152540 0x7fc9c006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:58.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9c7000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc9c00c6460 0x7fc9c0158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:58.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9c7000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c0155dd0 con 0x7fc9c0154e30 2024-02-17T12:15:58.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9c7000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c01588c0 con 0x7fc9c00c6460 2024-02-17T12:15:58.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9c7000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c0155810 con 0x7fc9c0152540 2024-02-17T12:15:58.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9bfe00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc9c0152540 0x7fc9c006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:58.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9bfe00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc9c0152540 0x7fc9c006ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:41034/0 (socket says 172.21.15.116:41034) 2024-02-17T12:15:58.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9bfe00640 1 -- 172.21.15.116:0/3527811057 learned_addr learned my addr 172.21.15.116:0/3527811057 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:15:58.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9c5000640 1 --1- 172.21.15.116:0/3527811057 >> v1:172.21.15.116:6789/0 conn(0x7fc9c0154e30 0x7fc9c00aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:34130/0 (socket says 172.21.15.116:34130) 2024-02-17T12:15:58.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9b7400640 1 --2- 172.21.15.116:0/3527811057 >> v2:172.21.15.114:3300/0 conn(0x7fc9c00c6460 0x7fc9c0158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:58.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9bfe00640 1 -- 172.21.15.116:0/3527811057 >> v2:172.21.15.114:3300/0 conn(0x7fc9c00c6460 msgr2=0x7fc9c0158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:15:58.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9bfe00640 1 --2- 172.21.15.116:0/3527811057 >> v2:172.21.15.114:3300/0 conn(0x7fc9c00c6460 0x7fc9c0158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9bfe00640 1 -- 172.21.15.116:0/3527811057 >> v1:172.21.15.116:6789/0 conn(0x7fc9c0154e30 legacy=0x7fc9c00aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:58.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9bfe00640 1 -- 172.21.15.116:0/3527811057 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0155af0 con 0x7fc9c0152540 2024-02-17T12:15:58.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.961+0000 7fc9bf400640 1 -- 172.21.15.116:0/3527811057 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150986845 0 0) 0x7fc9c0155dd0 con 0x7fc9c0154e30 2024-02-17T12:15:58.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9bfe00640 1 --2- 172.21.15.116:0/3527811057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 0x7fc9c006ff80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006dff0 tx=0x7fc9b001c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a50076f2ef1a861 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:58.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9bf400640 1 -- 172.21.15.116:0/3527811057 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00ac640 con 0x7fc9c0152540 2024-02-17T12:15:58.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9bf400640 1 -- 172.21.15.116:0/3527811057 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b00ac7a0 con 0x7fc9c0152540 2024-02-17T12:15:58.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9bf400640 1 -- 172.21.15.116:0/3527811057 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00acb30 con 0x7fc9c0152540 2024-02-17T12:15:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9c7000640 1 -- 172.21.15.116:0/3527811057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 msgr2=0x7fc9c006ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9c7000640 1 --2- 172.21.15.116:0/3527811057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 0x7fc9c006ff80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006dff0 tx=0x7fc9b001c400 comp rx=0 tx=0).stop 2024-02-17T12:15:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9c7000640 1 -- 172.21.15.116:0/3527811057 shutdown_connections 2024-02-17T12:15:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9c7000640 1 --2- 172.21.15.116:0/3527811057 >> v2:172.21.15.114:3300/0 conn(0x7fc9c00c6460 0x7fc9c0158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9c7000640 1 --2- 172.21.15.116:0/3527811057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 0x7fc9c006ff80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9c7000640 1 -- 172.21.15.116:0/3527811057 >> 172.21.15.116:0/3527811057 conn(0x7fc9c00c4f20 msgr2=0x7fc9c00c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9c7000640 1 -- 172.21.15.116:0/3527811057 shutdown_connections 2024-02-17T12:15:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9c7000640 1 -- 172.21.15.116:0/3527811057 wait complete. 2024-02-17T12:15:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9c7000640 1 Processor -- start 2024-02-17T12:15:58.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.965+0000 7fc9c7000640 1 -- start start 2024-02-17T12:15:58.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c7000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c00c6460 0x7fc9c01505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:58.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c7000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 0x7fc9c00c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:58.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c7000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9c0154e30 0x7fc9c01ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:58.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c7000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0150160 con 0x7fc9c00c6460 2024-02-17T12:15:58.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c7000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0150b30 con 0x7fc9c0152540 2024-02-17T12:15:58.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c7000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c014c2d0 con 0x7fc9c0154e30 2024-02-17T12:15:58.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c5000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9c0154e30 0x7fc9c01ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:58.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9b7400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 0x7fc9c00c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:58.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9b7400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 0x7fc9c00c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:41036/0 (socket says 172.21.15.116:41036) 2024-02-17T12:15:58.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9b7400640 1 -- 172.21.15.116:0/192317975 learned_addr learned my addr 172.21.15.116:0/192317975 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:15:58.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c5000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9c0154e30 0x7fc9c01ed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:47068/0 (socket says 172.21.15.116:47068) 2024-02-17T12:15:58.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9bfe00640 1 --2- 172.21.15.116:0/192317975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c00c6460 0x7fc9c01505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:58.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9b7400640 1 -- 172.21.15.116:0/192317975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9c0154e30 msgr2=0x7fc9c01ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:58.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9b7400640 1 --2- 172.21.15.116:0/192317975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9c0154e30 0x7fc9c01ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9b7400640 1 -- 172.21.15.116:0/192317975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c00c6460 msgr2=0x7fc9c01505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:58.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9b7400640 1 --2- 172.21.15.116:0/192317975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c00c6460 0x7fc9c01505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:58.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9b7400640 1 -- 172.21.15.116:0/192317975 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b00094d0 con 0x7fc9c0152540 2024-02-17T12:15:58.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9b7400640 1 --2- 172.21.15.116:0/192317975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 0x7fc9c00c85d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800e930 tx=0x7fc9a800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:58.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9bcc00640 1 -- 172.21.15.116:0/192317975 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8009690 con 0x7fc9c0152540 2024-02-17T12:15:58.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9bcc00640 1 -- 172.21.15.116:0/192317975 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a800ca00 con 0x7fc9c0152540 2024-02-17T12:15:58.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9bcc00640 1 -- 172.21.15.116:0/192317975 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a800cd70 con 0x7fc9c0152540 2024-02-17T12:15:58.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c7000640 1 -- 172.21.15.116:0/192317975 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c014c5b0 con 0x7fc9c0152540 2024-02-17T12:15:58.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c7000640 1 -- 172.21.15.116:0/192317975 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c014fdf0 con 0x7fc9c0152540 2024-02-17T12:15:58.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9bcc00640 1 -- 172.21.15.116:0/192317975 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc9a80059a0 con 0x7fc9c0152540 2024-02-17T12:15:58.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9bcc00640 1 -- 172.21.15.116:0/192317975 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc9a8013890 con 0x7fc9c0152540 2024-02-17T12:15:58.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.969+0000 7fc9c7000640 1 -- 172.21.15.116:0/192317975 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c0074840 con 0x7fc9c0152540 2024-02-17T12:15:58.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:58.973+0000 7fc9bcc00640 1 -- 172.21.15.116:0/192317975 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc9a8021060 con 0x7fc9c0152540 2024-02-17T12:15:59.002 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:15:58.998+0000 7f1346b4f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T12:15:59.014 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:15:59.009+0000 7fda1850b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T12:15:59.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.037+0000 7fc9c7000640 1 -- 172.21.15.116:0/192317975 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "27755643-ee85-4399-8ad6-962e7c2a630d", "id": 0} v 0) v1 -- 0x7fc9c00718b0 con 0x7fc9c0152540 2024-02-17T12:15:59.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.045+0000 7fc9bcc00640 1 -- 172.21.15.116:0/192317975 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27755643-ee85-4399-8ad6-962e7c2a630d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9a8017070 con 0x7fc9c0152540 2024-02-17T12:15:59.052 INFO:teuthology.orchestra.run.smithi116.stdout:0 2024-02-17T12:15:59.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.045+0000 7fc9c7000640 1 -- 172.21.15.116:0/192317975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 msgr2=0x7fc9c00c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.045+0000 7fc9c7000640 1 --2- 172.21.15.116:0/192317975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 0x7fc9c00c85d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800e930 tx=0x7fc9a800edf0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.045+0000 7fc9c7000640 1 -- 172.21.15.116:0/192317975 shutdown_connections 2024-02-17T12:15:59.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.045+0000 7fc9c7000640 1 --2- 172.21.15.116:0/192317975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9c0154e30 0x7fc9c01ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.045+0000 7fc9c7000640 1 --2- 172.21.15.116:0/192317975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9c0152540 0x7fc9c00c85d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.045+0000 7fc9c7000640 1 --2- 172.21.15.116:0/192317975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9c00c6460 0x7fc9c01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.045+0000 7fc9c7000640 1 -- 172.21.15.116:0/192317975 >> 172.21.15.116:0/192317975 conn(0x7fc9c00c4f20 msgr2=0x7fc9c014b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:59.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.045+0000 7fc9c7000640 1 -- 172.21.15.116:0/192317975 shutdown_connections 2024-02-17T12:15:59.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.045+0000 7fc9c7000640 1 -- 172.21.15.116:0/192317975 wait complete. 2024-02-17T12:15:59.070 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 0d073445-0602-4622-93b7-a9c40a747000 1 2024-02-17T12:15:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.197+0000 7f2055000640 1 Processor -- start 2024-02-17T12:15:59.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.197+0000 7f2055000640 1 -- start start 2024-02-17T12:15:59.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.197+0000 7f2055000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2050152540 0x7f205006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.197+0000 7f2055000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2050154e30 0x7f20500aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f2055000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2050155dd0 con 0x7f20500c6460 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f2055000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20501588c0 con 0x7f2050152540 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f2055000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2050155810 con 0x7f2050154e30 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f204de00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2050152540 0x7f205006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f2045400640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f20500c6460 0x7f2050158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:34144/0 (socket says 172.21.15.116:34144) 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f2045400640 1 -- 172.21.15.116:0/4028850436 learned_addr learned my addr 172.21.15.116:0/4028850436 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f204e800640 1 --2- 172.21.15.116:0/4028850436 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2050154e30 0x7f20500aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f204de00640 1 -- 172.21.15.116:0/4028850436 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2050154e30 msgr2=0x7f20500aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f204de00640 1 --2- 172.21.15.116:0/4028850436 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2050154e30 0x7f20500aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f204de00640 1 -- 172.21.15.116:0/4028850436 >> v1:172.21.15.116:6789/0 conn(0x7f20500c6460 legacy=0x7f2050158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f204de00640 1 -- 172.21.15.116:0/4028850436 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2050155af0 con 0x7f2050152540 2024-02-17T12:15:59.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f204de00640 1 --2- 172.21.15.116:0/4028850436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2050152540 0x7f205006ff80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f20400097c0 tx=0x7f204001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80d68c1707b69359 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:59.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.201+0000 7f204d400640 1 -- 172.21.15.116:0/4028850436 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400ab600 con 0x7f2050152540 2024-02-17T12:15:59.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204d400640 1 -- 172.21.15.116:0/4028850436 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20400a7050 con 0x7f2050152540 2024-02-17T12:15:59.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204d400640 1 -- 172.21.15.116:0/4028850436 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400ab980 con 0x7f2050152540 2024-02-17T12:15:59.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 -- 172.21.15.116:0/4028850436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2050152540 msgr2=0x7f205006ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 --2- 172.21.15.116:0/4028850436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2050152540 0x7f205006ff80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f20400097c0 tx=0x7f204001c380 comp rx=0 tx=0).stop 2024-02-17T12:15:59.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 -- 172.21.15.116:0/4028850436 shutdown_connections 2024-02-17T12:15:59.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 --2- 172.21.15.116:0/4028850436 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2050154e30 0x7f20500aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 --2- 172.21.15.116:0/4028850436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2050152540 0x7f205006ff80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 -- 172.21.15.116:0/4028850436 >> 172.21.15.116:0/4028850436 conn(0x7f20500c4f20 msgr2=0x7f20500c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:59.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 -- 172.21.15.116:0/4028850436 shutdown_connections 2024-02-17T12:15:59.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 -- 172.21.15.116:0/4028850436 wait complete. 2024-02-17T12:15:59.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 Processor -- start 2024-02-17T12:15:59.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 -- start start 2024-02-17T12:15:59.212 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20500c6460 0x7f205014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2050152540 0x7f20501f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2050154e30 0x7f20501f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205014cc00 con 0x7f2050154e30 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205014bed0 con 0x7f2050152540 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2055000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205014c770 con 0x7f20500c6460 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20500c6460 0x7f205014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f2045400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2050152540 0x7f20501f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20500c6460 0x7f205014a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:47082/0 (socket says 172.21.15.116:47082) 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204de00640 1 -- 172.21.15.116:0/1014461778 learned_addr learned my addr 172.21.15.116:0/1014461778 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204e800640 1 --2- 172.21.15.116:0/1014461778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2050154e30 0x7f20501f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204de00640 1 -- 172.21.15.116:0/1014461778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2050152540 msgr2=0x7f20501f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204de00640 1 --2- 172.21.15.116:0/1014461778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2050152540 0x7f20501f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204de00640 1 -- 172.21.15.116:0/1014461778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2050154e30 msgr2=0x7f20501f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204de00640 1 --2- 172.21.15.116:0/1014461778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2050154e30 0x7f20501f1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204de00640 1 -- 172.21.15.116:0/1014461778 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2040009420 con 0x7f20500c6460 2024-02-17T12:15:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.205+0000 7f204e800640 1 --2- 172.21.15.116:0/1014461778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2050154e30 0x7f20501f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:15:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.209+0000 7f204de00640 1 --2- 172.21.15.116:0/1014461778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20500c6460 0x7f205014a340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20400ae040 tx=0x7f204001abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.209+0000 7f2046a00640 1 -- 172.21.15.116:0/1014461778 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400b7450 con 0x7f20500c6460 2024-02-17T12:15:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.209+0000 7f2046a00640 1 -- 172.21.15.116:0/1014461778 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20400b75b0 con 0x7f20500c6460 2024-02-17T12:15:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.209+0000 7f2046a00640 1 -- 172.21.15.116:0/1014461778 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400b7960 con 0x7f20500c6460 2024-02-17T12:15:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.209+0000 7f2055000640 1 -- 172.21.15.116:0/1014461778 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2050158050 con 0x7f20500c6460 2024-02-17T12:15:59.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.209+0000 7f2055000640 1 -- 172.21.15.116:0/1014461778 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205014c400 con 0x7f20500c6460 2024-02-17T12:15:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.209+0000 7f2046a00640 1 -- 172.21.15.116:0/1014461778 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f20400c0400 con 0x7f20500c6460 2024-02-17T12:15:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.209+0000 7f2046a00640 1 -- 172.21.15.116:0/1014461778 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f20400b5940 con 0x7f20500c6460 2024-02-17T12:15:59.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.209+0000 7f2055000640 1 -- 172.21.15.116:0/1014461778 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2050074840 con 0x7f20500c6460 2024-02-17T12:15:59.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.217+0000 7f2046a00640 1 -- 172.21.15.116:0/1014461778 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f20400dedd0 con 0x7f20500c6460 2024-02-17T12:15:59.233 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:15:59.230+0000 7f1346b4f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T12:15:59.246 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:15:59.241+0000 7fda1850b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T12:15:59.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.285+0000 7f2055000640 1 -- 172.21.15.116:0/1014461778 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d073445-0602-4622-93b7-a9c40a747000", "id": 1} v 0) v1 -- 0x7f2050159240 con 0x7f20500c6460 2024-02-17T12:15:59.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.293+0000 7f2046a00640 1 -- 172.21.15.116:0/1014461778 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d073445-0602-4622-93b7-a9c40a747000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f20400cd030 con 0x7f20500c6460 2024-02-17T12:15:59.298 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-17T12:15:59.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.293+0000 7f2055000640 1 -- 172.21.15.116:0/1014461778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20500c6460 msgr2=0x7f205014a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.293+0000 7f2055000640 1 --2- 172.21.15.116:0/1014461778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20500c6460 0x7f205014a340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20400ae040 tx=0x7f204001abc0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.293+0000 7f2055000640 1 -- 172.21.15.116:0/1014461778 shutdown_connections 2024-02-17T12:15:59.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.293+0000 7f2055000640 1 --2- 172.21.15.116:0/1014461778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2050154e30 0x7f20501f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.293+0000 7f2055000640 1 --2- 172.21.15.116:0/1014461778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2050152540 0x7f20501f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.293+0000 7f2055000640 1 --2- 172.21.15.116:0/1014461778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20500c6460 0x7f205014a340 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.293+0000 7f2055000640 1 -- 172.21.15.116:0/1014461778 >> 172.21.15.116:0/1014461778 conn(0x7f20500c4f20 msgr2=0x7f20500c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:59.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.293+0000 7f2055000640 1 -- 172.21.15.116:0/1014461778 shutdown_connections 2024-02-17T12:15:59.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.293+0000 7f2055000640 1 -- 172.21.15.116:0/1014461778 wait complete. 2024-02-17T12:15:59.317 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4 2 2024-02-17T12:15:59.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd469400640 1 Processor -- start 2024-02-17T12:15:59.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd469400640 1 -- start start 2024-02-17T12:15:59.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd469400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd464150300 0x7fd464156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd469400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd464152d30 0x7fd4641531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd469400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd464157270 con 0x7fd4640714c0 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd469400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4640c6900 con 0x7fd464150300 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd469400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640c3580 con 0x7fd464152d30 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd463200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd464152d30 0x7fd4641531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd462800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd464150300 0x7fd464156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd459e00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd4640714c0 0x7fd4640aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:34154/0 (socket says 172.21.15.116:34154) 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd459e00640 1 -- 172.21.15.116:0/1406443385 learned_addr learned my addr 172.21.15.116:0/1406443385 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd463200640 1 -- 172.21.15.116:0/1406443385 >> v2:172.21.15.116:3300/0 conn(0x7fd464150300 msgr2=0x7fd464156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd463200640 1 --2- 172.21.15.116:0/1406443385 >> v2:172.21.15.116:3300/0 conn(0x7fd464150300 0x7fd464156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd463200640 1 -- 172.21.15.116:0/1406443385 >> v1:172.21.15.116:6789/0 conn(0x7fd4640714c0 legacy=0x7fd4640aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd463200640 1 -- 172.21.15.116:0/1406443385 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640c2fc0 con 0x7fd464152d30 2024-02-17T12:15:59.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.445+0000 7fd462800640 1 --2- 172.21.15.116:0/1406443385 >> v2:172.21.15.116:3300/0 conn(0x7fd464150300 0x7fd464156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:15:59.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd463200640 1 --2- 172.21.15.116:0/1406443385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd464152d30 0x7fd4641531c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009d90 tx=0x7fd45c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=563c7052daf4500c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:59.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd461e00640 1 -- 172.21.15.116:0/1406443385 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0a57a0 con 0x7fd464152d30 2024-02-17T12:15:59.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd461e00640 1 -- 172.21.15.116:0/1406443385 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c0a5900 con 0x7fd464152d30 2024-02-17T12:15:59.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd461e00640 1 -- 172.21.15.116:0/1406443385 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0a5c90 con 0x7fd464152d30 2024-02-17T12:15:59.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd469400640 1 -- 172.21.15.116:0/1406443385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd464152d30 msgr2=0x7fd4641531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd469400640 1 --2- 172.21.15.116:0/1406443385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd464152d30 0x7fd4641531c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009d90 tx=0x7fd45c01c8e0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd469400640 1 -- 172.21.15.116:0/1406443385 shutdown_connections 2024-02-17T12:15:59.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd469400640 1 --2- 172.21.15.116:0/1406443385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd464152d30 0x7fd4641531c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd469400640 1 --2- 172.21.15.116:0/1406443385 >> v2:172.21.15.116:3300/0 conn(0x7fd464150300 0x7fd464156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd469400640 1 -- 172.21.15.116:0/1406443385 >> 172.21.15.116:0/1406443385 conn(0x7fd4640c4f20 msgr2=0x7fd4640c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:59.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd469400640 1 -- 172.21.15.116:0/1406443385 shutdown_connections 2024-02-17T12:15:59.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.449+0000 7fd469400640 1 -- 172.21.15.116:0/1406443385 wait complete. 2024-02-17T12:15:59.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd469400640 1 Processor -- start 2024-02-17T12:15:59.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd469400640 1 -- start start 2024-02-17T12:15:59.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd469400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4640714c0 0x7fd4640c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd469400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd464150300 0x7fd4641edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd469400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd464152d30 0x7fd4641ee460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd469400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4641f1de0 con 0x7fd464150300 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd469400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4641eda90 con 0x7fd464152d30 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd469400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46406d5b0 con 0x7fd4640714c0 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd462800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4640714c0 0x7fd4640c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd462800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4640714c0 0x7fd4640c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:47092/0 (socket says 172.21.15.116:47092) 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd463200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd464152d30 0x7fd4641ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd462800640 1 -- 172.21.15.116:0/1204282035 learned_addr learned my addr 172.21.15.116:0/1204282035 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd459e00640 1 --2- 172.21.15.116:0/1204282035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd464150300 0x7fd4641edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd463200640 1 -- 172.21.15.116:0/1204282035 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4640714c0 msgr2=0x7fd4640c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd463200640 1 --2- 172.21.15.116:0/1204282035 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4640714c0 0x7fd4640c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd463200640 1 -- 172.21.15.116:0/1204282035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd464150300 msgr2=0x7fd4641edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd463200640 1 --2- 172.21.15.116:0/1204282035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd464150300 0x7fd4641edf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd463200640 1 -- 172.21.15.116:0/1204282035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454009420 con 0x7fd464152d30 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd462800640 1 --2- 172.21.15.116:0/1204282035 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4640714c0 0x7fd4640c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd459e00640 1 --2- 172.21.15.116:0/1204282035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd464150300 0x7fd4641edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd463200640 1 --2- 172.21.15.116:0/1204282035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd464152d30 0x7fd4641ee460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0ac000 tx=0x7fd45c019680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd45b400640 1 -- 172.21.15.116:0/1204282035 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0b9650 con 0x7fd464152d30 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd45b400640 1 -- 172.21.15.116:0/1204282035 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c0b97b0 con 0x7fd464152d30 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd45b400640 1 -- 172.21.15.116:0/1204282035 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0b9b20 con 0x7fd464152d30 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd469400640 1 -- 172.21.15.116:0/1204282035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45c009a70 con 0x7fd464152d30 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd469400640 1 -- 172.21.15.116:0/1204282035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46406d2d0 con 0x7fd464152d30 2024-02-17T12:15:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd45b400640 1 -- 172.21.15.116:0/1204282035 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd45c0ad7d0 con 0x7fd464152d30 2024-02-17T12:15:59.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.453+0000 7fd45b400640 1 -- 172.21.15.116:0/1204282035 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd45c0c2400 con 0x7fd464152d30 2024-02-17T12:15:59.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.457+0000 7fd469400640 1 -- 172.21.15.116:0/1204282035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4641edc00 con 0x7fd464152d30 2024-02-17T12:15:59.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.457+0000 7fd45b400640 1 -- 172.21.15.116:0/1204282035 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd45c0e0dd0 con 0x7fd464152d30 2024-02-17T12:15:59.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.525+0000 7fd469400640 1 -- 172.21.15.116:0/1204282035 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4", "id": 2} v 0) v1 -- 0x7fd464074840 con 0x7fd464152d30 2024-02-17T12:15:59.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.533+0000 7fd45b400640 1 -- 172.21.15.116:0/1204282035 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd45c0cf030 con 0x7fd464152d30 2024-02-17T12:15:59.537 INFO:teuthology.orchestra.run.smithi116.stdout:2 2024-02-17T12:15:59.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.533+0000 7fd469400640 1 -- 172.21.15.116:0/1204282035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd464152d30 msgr2=0x7fd4641ee460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.533+0000 7fd469400640 1 --2- 172.21.15.116:0/1204282035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd464152d30 0x7fd4641ee460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0ac000 tx=0x7fd45c019680 comp rx=0 tx=0).stop 2024-02-17T12:15:59.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.533+0000 7fd469400640 1 -- 172.21.15.116:0/1204282035 shutdown_connections 2024-02-17T12:15:59.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.533+0000 7fd469400640 1 --2- 172.21.15.116:0/1204282035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd464152d30 0x7fd4641ee460 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.533+0000 7fd469400640 1 --2- 172.21.15.116:0/1204282035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd464150300 0x7fd4641edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.533+0000 7fd469400640 1 --2- 172.21.15.116:0/1204282035 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd4640714c0 0x7fd4640c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.533+0000 7fd469400640 1 -- 172.21.15.116:0/1204282035 >> 172.21.15.116:0/1204282035 conn(0x7fd4640c4f20 msgr2=0x7fd4640a8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:59.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.533+0000 7fd469400640 1 -- 172.21.15.116:0/1204282035 shutdown_connections 2024-02-17T12:15:59.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.533+0000 7fd469400640 1 -- 172.21.15.116:0/1204282035 wait complete. 2024-02-17T12:15:59.555 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 2691c517-9b74-4289-81a4-1ac089d4b349 3 2024-02-17T12:15:59.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fb5400640 1 Processor -- start 2024-02-17T12:15:59.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fb5400640 1 -- start start 2024-02-17T12:15:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fb5400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb0150300 0x7f6fb0156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fb5400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb0157270 con 0x7f6fb0152d30 2024-02-17T12:15:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fb5400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb00c3580 con 0x7f6fb00714c0 2024-02-17T12:15:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fb5400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00c6900 con 0x7f6fb0150300 2024-02-17T12:15:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fae800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb0150300 0x7f6fb0156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fa5e00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f6fb00714c0 0x7f6fb00aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:34170/0 (socket says 172.21.15.116:34170) 2024-02-17T12:15:59.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fa5e00640 1 -- 172.21.15.116:0/730320824 learned_addr learned my addr 172.21.15.116:0/730320824 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-17T12:15:59.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fae800640 1 -- 172.21.15.116:0/730320824 >> v1:172.21.15.116:6789/0 conn(0x7f6fb00714c0 legacy=0x7f6fb00aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fae800640 1 -- 172.21.15.116:0/730320824 >> v1:172.21.15.114:6789/0 conn(0x7f6fb0152d30 legacy=0x7f6fb01531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fade00640 1 -- 172.21.15.116:0/730320824 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381065642 0 0) 0x7f6fb00c3580 con 0x7f6fb00714c0 2024-02-17T12:15:59.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.685+0000 7f6fae800640 1 -- 172.21.15.116:0/730320824 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb00c2fc0 con 0x7f6fb0150300 2024-02-17T12:15:59.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fae800640 1 --2- 172.21.15.116:0/730320824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb0150300 0x7f6fb0156d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00097f0 tx=0x7f6fa001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=759d643e09cc74cf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:59.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fade00640 1 -- 172.21.15.116:0/730320824 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00ab600 con 0x7f6fb0150300 2024-02-17T12:15:59.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fade00640 1 -- 172.21.15.116:0/730320824 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa00a7050 con 0x7f6fb0150300 2024-02-17T12:15:59.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fade00640 1 -- 172.21.15.116:0/730320824 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00ab980 con 0x7f6fb0150300 2024-02-17T12:15:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fb5400640 1 -- 172.21.15.116:0/730320824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb0150300 msgr2=0x7f6fb0156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fb5400640 1 --2- 172.21.15.116:0/730320824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb0150300 0x7f6fb0156d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00097f0 tx=0x7f6fa001c450 comp rx=0 tx=0).stop 2024-02-17T12:15:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fb5400640 1 -- 172.21.15.116:0/730320824 shutdown_connections 2024-02-17T12:15:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fb5400640 1 --2- 172.21.15.116:0/730320824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb0150300 0x7f6fb0156d30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fb5400640 1 -- 172.21.15.116:0/730320824 >> 172.21.15.116:0/730320824 conn(0x7f6fb00c4f20 msgr2=0x7f6fb00c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fb5400640 1 -- 172.21.15.116:0/730320824 shutdown_connections 2024-02-17T12:15:59.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.689+0000 7f6fb5400640 1 -- 172.21.15.116:0/730320824 wait complete. 2024-02-17T12:15:59.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 Processor -- start 2024-02-17T12:15:59.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 -- start start 2024-02-17T12:15:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb00714c0 0x7f6fb014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fb0150300 0x7f6fb01eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fb0152d30 0x7f6fb01ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00acf20 con 0x7f6fb0152d30 2024-02-17T12:15:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00ad9d0 con 0x7f6fb0150300 2024-02-17T12:15:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00ad130 con 0x7f6fb00714c0 2024-02-17T12:15:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fae800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb00714c0 0x7f6fb014e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fae800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb00714c0 0x7f6fb014e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:47108/0 (socket says 172.21.15.116:47108) 2024-02-17T12:15:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fae800640 1 -- 172.21.15.116:0/2175511559 learned_addr learned my addr 172.21.15.116:0/2175511559 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:15:59.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fa5e00640 1 --2- 172.21.15.116:0/2175511559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fb0150300 0x7f6fb01eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6faf200640 1 --2- 172.21.15.116:0/2175511559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fb0152d30 0x7f6fb01ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fae800640 1 -- 172.21.15.116:0/2175511559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fb0150300 msgr2=0x7f6fb01eeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fae800640 1 --2- 172.21.15.116:0/2175511559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fb0150300 0x7f6fb01eeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fae800640 1 -- 172.21.15.116:0/2175511559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fb0152d30 msgr2=0x7f6fb01ef420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fae800640 1 --2- 172.21.15.116:0/2175511559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fb0152d30 0x7f6fb01ef420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fae800640 1 -- 172.21.15.116:0/2175511559 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0009420 con 0x7f6fb00714c0 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fae800640 1 --2- 172.21.15.116:0/2175511559 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb00714c0 0x7f6fb014e960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0019060 tx=0x7f6fa00191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fa7400640 1 -- 172.21.15.116:0/2175511559 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00b4600 con 0x7f6fb00714c0 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fa7400640 1 -- 172.21.15.116:0/2175511559 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa00b4780 con 0x7f6fb00714c0 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fa7400640 1 -- 172.21.15.116:0/2175511559 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00b4b30 con 0x7f6fb00714c0 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 -- 172.21.15.116:0/2175511559 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb00ad410 con 0x7f6fb00714c0 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 -- 172.21.15.116:0/2175511559 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb01ee9c0 con 0x7f6fb00714c0 2024-02-17T12:15:59.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fa7400640 1 -- 172.21.15.116:0/2175511559 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6fa00b2040 con 0x7f6fb00714c0 2024-02-17T12:15:59.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fa7400640 1 -- 172.21.15.116:0/2175511559 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6fa00b4c90 con 0x7f6fb00714c0 2024-02-17T12:15:59.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.693+0000 7f6fb5400640 1 -- 172.21.15.116:0/2175511559 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb0074840 con 0x7f6fb00714c0 2024-02-17T12:15:59.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.697+0000 7f6fa7400640 1 -- 172.21.15.116:0/2175511559 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6fa00b0070 con 0x7f6fb00714c0 2024-02-17T12:15:59.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.765+0000 7f6fb5400640 1 -- 172.21.15.116:0/2175511559 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2691c517-9b74-4289-81a4-1ac089d4b349", "id": 3} v 0) v1 -- 0x7f6fb01eebb0 con 0x7f6fb00714c0 2024-02-17T12:15:59.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.773+0000 7f6fa7400640 1 -- 172.21.15.116:0/2175511559 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2691c517-9b74-4289-81a4-1ac089d4b349", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6fa00c0460 con 0x7f6fb00714c0 2024-02-17T12:15:59.779 INFO:teuthology.orchestra.run.smithi116.stdout:3 2024-02-17T12:15:59.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.773+0000 7f6fb5400640 1 -- 172.21.15.116:0/2175511559 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb00714c0 msgr2=0x7f6fb014e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.773+0000 7f6fb5400640 1 --2- 172.21.15.116:0/2175511559 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb00714c0 0x7f6fb014e960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0019060 tx=0x7f6fa00191f0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.773+0000 7f6fb5400640 1 -- 172.21.15.116:0/2175511559 shutdown_connections 2024-02-17T12:15:59.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.773+0000 7f6fb5400640 1 --2- 172.21.15.116:0/2175511559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fb0152d30 0x7f6fb01ef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.773+0000 7f6fb5400640 1 --2- 172.21.15.116:0/2175511559 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fb0150300 0x7f6fb01eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.773+0000 7f6fb5400640 1 --2- 172.21.15.116:0/2175511559 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fb00714c0 0x7f6fb014e960 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.773+0000 7f6fb5400640 1 -- 172.21.15.116:0/2175511559 >> 172.21.15.116:0/2175511559 conn(0x7f6fb00c4f20 msgr2=0x7f6fb0152620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:59.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.777+0000 7f6fb5400640 1 -- 172.21.15.116:0/2175511559 shutdown_connections 2024-02-17T12:15:59.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.777+0000 7f6fb5400640 1 -- 172.21.15.116:0/2175511559 wait complete. 2024-02-17T12:15:59.798 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new c9e2ca17-5905-4400-aae4-b89546d5aa11 4 2024-02-17T12:15:59.841 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:15:59.838+0000 7f1346b4f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T12:15:59.885 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:15:59.881+0000 7fda1850b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T12:15:59.902 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:15:59.898+0000 7f1346b4f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T12:15:59.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e7c800640 1 Processor -- start 2024-02-17T12:15:59.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e7c800640 1 -- start start 2024-02-17T12:15:59.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e7c800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4e7406ff80 0x7f4e740aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e7c800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e74155dd0 con 0x7f4e740c6460 2024-02-17T12:15:59.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e7c800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e741588c0 con 0x7f4e74152540 2024-02-17T12:15:59.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e7c800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e740703d0 con 0x7f4e7406ff80 2024-02-17T12:15:59.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e79e00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f4e74152540 0x7f4e74158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:37362/0 (socket says 172.21.15.116:37362) 2024-02-17T12:15:59.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e79e00640 1 -- 172.21.15.116:0/2359858028 learned_addr learned my addr 172.21.15.116:0/2359858028 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-17T12:15:59.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e7a800640 1 --2- 172.21.15.116:0/2359858028 >> v2:172.21.15.116:3300/0 conn(0x7f4e7406ff80 0x7f4e740aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e7a800640 1 -- 172.21.15.116:0/2359858028 >> v1:172.21.15.116:6789/0 conn(0x7f4e74152540 legacy=0x7f4e74158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e7a800640 1 -- 172.21.15.116:0/2359858028 >> v1:172.21.15.114:6789/0 conn(0x7f4e740c6460 legacy=0x7f4e74154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.929+0000 7f4e7a800640 1 -- 172.21.15.116:0/2359858028 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e74155540 con 0x7f4e7406ff80 2024-02-17T12:15:59.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e7a800640 1 --2- 172.21.15.116:0/2359858028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e7406ff80 0x7f4e740aa160 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009d90 tx=0x7f4e7001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5e1313a2f4ca6c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:59.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e78a00640 1 -- 172.21.15.116:0/2359858028 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e700a5820 con 0x7f4e7406ff80 2024-02-17T12:15:59.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e78a00640 1 -- 172.21.15.116:0/2359858028 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e700a5980 con 0x7f4e7406ff80 2024-02-17T12:15:59.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e78a00640 1 -- 172.21.15.116:0/2359858028 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e700a5d10 con 0x7f4e7406ff80 2024-02-17T12:15:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e7c800640 1 -- 172.21.15.116:0/2359858028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e7406ff80 msgr2=0x7f4e740aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e7c800640 1 --2- 172.21.15.116:0/2359858028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e7406ff80 0x7f4e740aa160 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009d90 tx=0x7f4e7001c850 comp rx=0 tx=0).stop 2024-02-17T12:15:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e7c800640 1 -- 172.21.15.116:0/2359858028 shutdown_connections 2024-02-17T12:15:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e7c800640 1 --2- 172.21.15.116:0/2359858028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e7406ff80 0x7f4e740aa160 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e7c800640 1 -- 172.21.15.116:0/2359858028 >> 172.21.15.116:0/2359858028 conn(0x7f4e740c4f20 msgr2=0x7f4e740c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:15:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e7c800640 1 -- 172.21.15.116:0/2359858028 shutdown_connections 2024-02-17T12:15:59.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e7c800640 1 -- 172.21.15.116:0/2359858028 wait complete. 2024-02-17T12:15:59.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.933+0000 7f4e7c800640 1 Processor -- start 2024-02-17T12:15:59.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7c800640 1 -- start start 2024-02-17T12:15:59.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7c800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7406ff80 0x7f4e740ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7c800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e740c6460 0x7f4e740abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7c800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e74152540 0x7f4e741533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7c800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e741552b0 con 0x7f4e7406ff80 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7c800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740ae120 con 0x7f4e74152540 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7c800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74154940 con 0x7f4e740c6460 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7a800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e74152540 0x7f4e741533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7406ff80 0x7f4e740ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7a800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e74152540 0x7f4e741533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43338/0 (socket says 172.21.15.116:43338) 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7a800640 1 -- 172.21.15.116:0/4154988111 learned_addr learned my addr 172.21.15.116:0/4154988111 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e79400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e740c6460 0x7f4e740abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e79400640 1 -- 172.21.15.116:0/4154988111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e74152540 msgr2=0x7f4e741533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e79400640 1 --2- 172.21.15.116:0/4154988111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e74152540 0x7f4e741533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e79400640 1 -- 172.21.15.116:0/4154988111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7406ff80 msgr2=0x7f4e740ab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e79400640 1 --2- 172.21.15.116:0/4154988111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7406ff80 0x7f4e740ab730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e79400640 1 -- 172.21.15.116:0/4154988111 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e70009a70 con 0x7f4e740c6460 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7a800640 1 --2- 172.21.15.116:0/4154988111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e74152540 0x7f4e741533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e79e00640 1 --2- 172.21.15.116:0/4154988111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7406ff80 0x7f4e740ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e79400640 1 --2- 172.21.15.116:0/4154988111 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e740c6460 0x7f4e740abc70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c3c0 tx=0x7f4e6400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e6e000640 1 -- 172.21.15.116:0/4154988111 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e640052d0 con 0x7f4e740c6460 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e6e000640 1 -- 172.21.15.116:0/4154988111 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e64005430 con 0x7f4e740c6460 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7c800640 1 -- 172.21.15.116:0/4154988111 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e741546a0 con 0x7f4e740c6460 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e6e000640 1 -- 172.21.15.116:0/4154988111 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e64007260 con 0x7f4e740c6460 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7c800640 1 -- 172.21.15.116:0/4154988111 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e740ac1b0 con 0x7f4e740c6460 2024-02-17T12:15:59.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e6e000640 1 -- 172.21.15.116:0/4154988111 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4e640073c0 con 0x7f4e740c6460 2024-02-17T12:15:59.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e6e000640 1 -- 172.21.15.116:0/4154988111 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4e64007670 con 0x7f4e740c6460 2024-02-17T12:15:59.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.937+0000 7f4e7c800640 1 -- 172.21.15.116:0/4154988111 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e74068180 con 0x7f4e740c6460 2024-02-17T12:15:59.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:15:59.941+0000 7f4e6e000640 1 -- 172.21.15.116:0/4154988111 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4e64020060 con 0x7f4e740c6460 2024-02-17T12:15:59.950 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:15:59.945+0000 7fda1850b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T12:15:59.963 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:15:59.958+0000 7f1346b4f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T12:16:00.011 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:00.005+0000 7fda1850b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T12:16:00.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.009+0000 7f4e7c800640 1 -- 172.21.15.116:0/4154988111 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c9e2ca17-5905-4400-aae4-b89546d5aa11", "id": 4} v 0) v1 -- 0x7f4e74074840 con 0x7f4e740c6460 2024-02-17T12:16:00.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.013+0000 7f4e6e000640 1 -- 172.21.15.116:0/4154988111 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9e2ca17-5905-4400-aae4-b89546d5aa11", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e64003920 con 0x7f4e740c6460 2024-02-17T12:16:00.019 INFO:teuthology.orchestra.run.smithi116.stdout:4 2024-02-17T12:16:00.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.017+0000 7f4e7c800640 1 -- 172.21.15.116:0/4154988111 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e740c6460 msgr2=0x7f4e740abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.017+0000 7f4e7c800640 1 --2- 172.21.15.116:0/4154988111 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e740c6460 0x7f4e740abc70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c3c0 tx=0x7f4e6400c880 comp rx=0 tx=0).stop 2024-02-17T12:16:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.017+0000 7f4e7c800640 1 -- 172.21.15.116:0/4154988111 shutdown_connections 2024-02-17T12:16:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.017+0000 7f4e7c800640 1 --2- 172.21.15.116:0/4154988111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e74152540 0x7f4e741533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.017+0000 7f4e7c800640 1 --2- 172.21.15.116:0/4154988111 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e740c6460 0x7f4e740abc70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.017+0000 7f4e7c800640 1 --2- 172.21.15.116:0/4154988111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7406ff80 0x7f4e740ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.017+0000 7f4e7c800640 1 -- 172.21.15.116:0/4154988111 >> 172.21.15.116:0/4154988111 conn(0x7f4e740c4f20 msgr2=0x7f4e74070510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.017+0000 7f4e7c800640 1 -- 172.21.15.116:0/4154988111 shutdown_connections 2024-02-17T12:16:00.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.017+0000 7f4e7c800640 1 -- 172.21.15.116:0/4154988111 wait complete. 2024-02-17T12:16:00.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 231b988c-4494-4ba2-91a4-a2d229b0fccc 5 2024-02-17T12:16:00.051 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:00.046+0000 7f1346b4f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T12:16:00.107 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:00.101+0000 7fda1850b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T12:16:00.112 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:00.110+0000 7f1346b4f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T12:16:00.169 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:00.165+0000 7fda1850b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T12:16:00.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.169+0000 7f0c53200640 1 Processor -- start 2024-02-17T12:16:00.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.169+0000 7f0c53200640 1 -- start start 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c53200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0c4c0714c0 0x7f0c4c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c53200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c53200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c157270 con 0x7f0c4c150300 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c53200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4c0c6900 con 0x7f0c4c0714c0 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c53200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0c3580 con 0x7f0c4c152d30 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c51200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c4be00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f0c4c150300 0x7f0c4c0aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:37376/0 (socket says 172.21.15.116:37376) 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c4be00640 1 -- 172.21.15.116:0/622752806 learned_addr learned my addr 172.21.15.116:0/622752806 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c43400640 1 --2- 172.21.15.116:0/622752806 >> v2:172.21.15.116:3300/0 conn(0x7f0c4c0714c0 0x7f0c4c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c51200640 1 -- 172.21.15.116:0/622752806 >> v2:172.21.15.116:3300/0 conn(0x7f0c4c0714c0 msgr2=0x7f0c4c156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:00.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c51200640 1 --2- 172.21.15.116:0/622752806 >> v2:172.21.15.116:3300/0 conn(0x7f0c4c0714c0 0x7f0c4c156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c51200640 1 -- 172.21.15.116:0/622752806 >> v1:172.21.15.116:6789/0 conn(0x7f0c4c150300 legacy=0x7f0c4c0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c51200640 1 -- 172.21.15.116:0/622752806 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0c2fc0 con 0x7f0c4c152d30 2024-02-17T12:16:00.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c4b400640 1 -- 172.21.15.116:0/622752806 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205693449 0 0) 0x7f0c4c157270 con 0x7f0c4c150300 2024-02-17T12:16:00.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.173+0000 7f0c43400640 1 --2- 172.21.15.116:0/622752806 >> v2:172.21.15.116:3300/0 conn(0x7f0c4c0714c0 0x7f0c4c156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:00.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c51200640 1 --2- 172.21.15.116:0/622752806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1531c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009d90 tx=0x7f0c4401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0bd107bf6194c63 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:00.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c4b400640 1 -- 172.21.15.116:0/622752806 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c440a57a0 con 0x7f0c4c152d30 2024-02-17T12:16:00.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c4b400640 1 -- 172.21.15.116:0/622752806 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c440a5900 con 0x7f0c4c152d30 2024-02-17T12:16:00.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c4b400640 1 -- 172.21.15.116:0/622752806 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c440a5c90 con 0x7f0c4c152d30 2024-02-17T12:16:00.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c53200640 1 -- 172.21.15.116:0/622752806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 msgr2=0x7f0c4c1531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c53200640 1 --2- 172.21.15.116:0/622752806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1531c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009d90 tx=0x7f0c4401c8e0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c53200640 1 -- 172.21.15.116:0/622752806 shutdown_connections 2024-02-17T12:16:00.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c53200640 1 --2- 172.21.15.116:0/622752806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1531c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c53200640 1 --2- 172.21.15.116:0/622752806 >> v2:172.21.15.116:3300/0 conn(0x7f0c4c0714c0 0x7f0c4c156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c53200640 1 -- 172.21.15.116:0/622752806 >> 172.21.15.116:0/622752806 conn(0x7f0c4c0c4f20 msgr2=0x7f0c4c0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:00.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c53200640 1 -- 172.21.15.116:0/622752806 shutdown_connections 2024-02-17T12:16:00.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c53200640 1 -- 172.21.15.116:0/622752806 wait complete. 2024-02-17T12:16:00.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c53200640 1 Processor -- start 2024-02-17T12:16:00.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.177+0000 7f0c53200640 1 -- start start 2024-02-17T12:16:00.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c53200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4c0714c0 0x7f0c4c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c53200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c4c150300 0x7f0c4c1ec050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c53200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c53200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c149690 con 0x7f0c4c0714c0 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c53200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c1ec590 con 0x7f0c4c150300 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c53200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c1493b0 con 0x7f0c4c152d30 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c51200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c51200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:41874/0 (socket says 172.21.15.116:41874) 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c43400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c4c150300 0x7f0c4c1ec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c51200640 1 -- 172.21.15.116:0/625800765 learned_addr learned my addr 172.21.15.116:0/625800765 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c4be00640 1 --2- 172.21.15.116:0/625800765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4c0714c0 0x7f0c4c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c51200640 1 -- 172.21.15.116:0/625800765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c4c150300 msgr2=0x7f0c4c1ec050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c51200640 1 --2- 172.21.15.116:0/625800765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c4c150300 0x7f0c4c1ec050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c51200640 1 -- 172.21.15.116:0/625800765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4c0714c0 msgr2=0x7f0c4c148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c51200640 1 --2- 172.21.15.116:0/625800765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4c0714c0 0x7f0c4c148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c51200640 1 -- 172.21.15.116:0/625800765 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34009420 con 0x7f0c4c152d30 2024-02-17T12:16:00.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c4be00640 1 --2- 172.21.15.116:0/625800765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4c0714c0 0x7f0c4c148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:00.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c51200640 1 --2- 172.21.15.116:0/625800765 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1556c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c4401af90 tx=0x7f0c44019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:00.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c48c00640 1 -- 172.21.15.116:0/625800765 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c440ad640 con 0x7f0c4c152d30 2024-02-17T12:16:00.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c48c00640 1 -- 172.21.15.116:0/625800765 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c440ad7a0 con 0x7f0c4c152d30 2024-02-17T12:16:00.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c48c00640 1 -- 172.21.15.116:0/625800765 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c440adb10 con 0x7f0c4c152d30 2024-02-17T12:16:00.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c53200640 1 -- 172.21.15.116:0/625800765 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c44009a70 con 0x7f0c4c152d30 2024-02-17T12:16:00.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c53200640 1 -- 172.21.15.116:0/625800765 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c1ef000 con 0x7f0c4c152d30 2024-02-17T12:16:00.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c48c00640 1 -- 172.21.15.116:0/625800765 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0c440b4050 con 0x7f0c4c152d30 2024-02-17T12:16:00.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c48c00640 1 -- 172.21.15.116:0/625800765 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f0c440c2e00 con 0x7f0c4c152d30 2024-02-17T12:16:00.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.181+0000 7f0c53200640 1 -- 172.21.15.116:0/625800765 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4c1eeb80 con 0x7f0c4c152d30 2024-02-17T12:16:00.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.185+0000 7f0c48c00640 1 -- 172.21.15.116:0/625800765 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0c4c1eeb80 con 0x7f0c4c152d30 2024-02-17T12:16:00.200 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:00.198+0000 7f1346b4f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T12:16:00.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.249+0000 7f0c53200640 1 -- 172.21.15.116:0/625800765 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "231b988c-4494-4ba2-91a4-a2d229b0fccc", "id": 5} v 0) v1 -- 0x7f0c4c074840 con 0x7f0c4c152d30 2024-02-17T12:16:00.259 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:00.254+0000 7f1346b4f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T12:16:00.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.253+0000 7f0c48c00640 1 -- 172.21.15.116:0/625800765 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "231b988c-4494-4ba2-91a4-a2d229b0fccc", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c440c7060 con 0x7f0c4c152d30 2024-02-17T12:16:00.260 INFO:teuthology.orchestra.run.smithi116.stdout:5 2024-02-17T12:16:00.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.257+0000 7f0c53200640 1 -- 172.21.15.116:0/625800765 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 msgr2=0x7f0c4c1556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.257+0000 7f0c53200640 1 --2- 172.21.15.116:0/625800765 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1556c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0c4401af90 tx=0x7f0c44019680 comp rx=0 tx=0).stop 2024-02-17T12:16:00.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.257+0000 7f0c53200640 1 -- 172.21.15.116:0/625800765 shutdown_connections 2024-02-17T12:16:00.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.257+0000 7f0c53200640 1 --2- 172.21.15.116:0/625800765 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c4c152d30 0x7f0c4c1556c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.257+0000 7f0c53200640 1 --2- 172.21.15.116:0/625800765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c4c150300 0x7f0c4c1ec050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.257+0000 7f0c53200640 1 --2- 172.21.15.116:0/625800765 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4c0714c0 0x7f0c4c148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.257+0000 7f0c53200640 1 -- 172.21.15.116:0/625800765 >> 172.21.15.116:0/625800765 conn(0x7f0c4c0c4f20 msgr2=0x7f0c4c15ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:00.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.257+0000 7f0c53200640 1 -- 172.21.15.116:0/625800765 shutdown_connections 2024-02-17T12:16:00.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.257+0000 7f0c53200640 1 -- 172.21.15.116:0/625800765 wait complete. 2024-02-17T12:16:00.262 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:00.257+0000 7fda1850b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T12:16:00.279 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 44a29cad-292d-4cf5-9cbc-88bfe692ecff 6 2024-02-17T12:16:00.325 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:00.321+0000 7fda1850b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T12:16:00.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc9c00640 1 Processor -- start 2024-02-17T12:16:00.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc9c00640 1 -- start start 2024-02-17T12:16:00.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc9c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc4156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc9c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbfc4152d30 0x7fbfc41531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc9c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc4157270 con 0x7fbfc40714c0 2024-02-17T12:16:00.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc9c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc40c6900 con 0x7fbfc4152d30 2024-02-17T12:16:00.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc9c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc40c3580 con 0x7fbfc4150300 2024-02-17T12:16:00.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc2a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc4156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc2a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc4156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:41880/0 (socket says 172.21.15.116:41880) 2024-02-17T12:16:00.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc2a00640 1 -- 172.21.15.116:0/1885661414 learned_addr learned my addr 172.21.15.116:0/1885661414 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:16:00.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc3400640 1 --2- 172.21.15.116:0/1885661414 >> v2:172.21.15.116:3300/0 conn(0x7fbfc4152d30 0x7fbfc41531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc2a00640 1 -- 172.21.15.116:0/1885661414 >> v2:172.21.15.116:3300/0 conn(0x7fbfc4152d30 msgr2=0x7fbfc41531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:00.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc2a00640 1 --2- 172.21.15.116:0/1885661414 >> v2:172.21.15.116:3300/0 conn(0x7fbfc4152d30 0x7fbfc41531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc2a00640 1 -- 172.21.15.116:0/1885661414 >> v1:172.21.15.114:6789/0 conn(0x7fbfc40714c0 legacy=0x7fbfc40aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.409+0000 7fbfc2a00640 1 -- 172.21.15.116:0/1885661414 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc40c2fc0 con 0x7fbfc4150300 2024-02-17T12:16:00.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc2a00640 1 --2- 172.21.15.116:0/1885661414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc4156d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009870 tx=0x7fbfb401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ac6c15072627d13 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:00.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc2000640 1 -- 172.21.15.116:0/1885661414 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40ab600 con 0x7fbfc4150300 2024-02-17T12:16:00.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc2000640 1 -- 172.21.15.116:0/1885661414 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40a7050 con 0x7fbfc4150300 2024-02-17T12:16:00.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc2000640 1 -- 172.21.15.116:0/1885661414 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40ab980 con 0x7fbfc4150300 2024-02-17T12:16:00.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc9c00640 1 -- 172.21.15.116:0/1885661414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 msgr2=0x7fbfc4156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc9c00640 1 --2- 172.21.15.116:0/1885661414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc4156d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009870 tx=0x7fbfb401c4d0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc9c00640 1 -- 172.21.15.116:0/1885661414 shutdown_connections 2024-02-17T12:16:00.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc9c00640 1 --2- 172.21.15.116:0/1885661414 >> v2:172.21.15.116:3300/0 conn(0x7fbfc4152d30 0x7fbfc41531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc9c00640 1 --2- 172.21.15.116:0/1885661414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc4156d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc9c00640 1 -- 172.21.15.116:0/1885661414 >> 172.21.15.116:0/1885661414 conn(0x7fbfc40c4f20 msgr2=0x7fbfc40c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:00.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc9c00640 1 -- 172.21.15.116:0/1885661414 shutdown_connections 2024-02-17T12:16:00.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc9c00640 1 -- 172.21.15.116:0/1885661414 wait complete. 2024-02-17T12:16:00.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc9c00640 1 Processor -- start 2024-02-17T12:16:00.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.413+0000 7fbfc9c00640 1 -- start start 2024-02-17T12:16:00.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc9c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfc40714c0 0x7fbfc4149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc9c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc40aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc9c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfc4152d30 0x7fbfc4148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc9c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4149d60 con 0x7fbfc4152d30 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc9c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc414cbe0 con 0x7fbfc40714c0 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc9c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc414c2b0 con 0x7fbfc4150300 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfba000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc40aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc2a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfc40714c0 0x7fbfc4149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfba000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc40aba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:41888/0 (socket says 172.21.15.116:41888) 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfba000640 1 -- 172.21.15.116:0/2503902023 learned_addr learned my addr 172.21.15.116:0/2503902023 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc3400640 1 --2- 172.21.15.116:0/2503902023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfc4152d30 0x7fbfc4148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfba000640 1 -- 172.21.15.116:0/2503902023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfc40714c0 msgr2=0x7fbfc4149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfba000640 1 --2- 172.21.15.116:0/2503902023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfc40714c0 0x7fbfc4149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfba000640 1 -- 172.21.15.116:0/2503902023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfc4152d30 msgr2=0x7fbfc4148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfba000640 1 --2- 172.21.15.116:0/2503902023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfc4152d30 0x7fbfc4148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfba000640 1 -- 172.21.15.116:0/2503902023 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb40094d0 con 0x7fbfc4150300 2024-02-17T12:16:00.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfba000640 1 --2- 172.21.15.116:0/2503902023 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc40aba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c760 tx=0x7fbfac00cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:00.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfbb400640 1 -- 172.21.15.116:0/2503902023 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac006d60 con 0x7fbfc4150300 2024-02-17T12:16:00.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfbb400640 1 -- 172.21.15.116:0/2503902023 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac00ce70 con 0x7fbfc4150300 2024-02-17T12:16:00.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc9c00640 1 -- 172.21.15.116:0/2503902023 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc414c590 con 0x7fbfc4150300 2024-02-17T12:16:00.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfbb400640 1 -- 172.21.15.116:0/2503902023 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac003ba0 con 0x7fbfc4150300 2024-02-17T12:16:00.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc9c00640 1 -- 172.21.15.116:0/2503902023 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc4158710 con 0x7fbfc4150300 2024-02-17T12:16:00.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfbb400640 1 -- 172.21.15.116:0/2503902023 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fbfac00abe0 con 0x7fbfc4150300 2024-02-17T12:16:00.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfbb400640 1 -- 172.21.15.116:0/2503902023 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fbfac003d00 con 0x7fbfc4150300 2024-02-17T12:16:00.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.417+0000 7fbfc9c00640 1 -- 172.21.15.116:0/2503902023 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc40c7e10 con 0x7fbfc4150300 2024-02-17T12:16:00.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.421+0000 7fbfbb400640 1 -- 172.21.15.116:0/2503902023 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fbfac016020 con 0x7fbfc4150300 2024-02-17T12:16:00.426 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:00.422+0000 7f1346b4f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T12:16:00.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.489+0000 7fbfc9c00640 1 -- 172.21.15.116:0/2503902023 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "44a29cad-292d-4cf5-9cbc-88bfe692ecff", "id": 6} v 0) v1 -- 0x7fbfc4074840 con 0x7fbfc4150300 2024-02-17T12:16:00.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fbfbb400640 1 -- 172.21.15.116:0/2503902023 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44a29cad-292d-4cf5-9cbc-88bfe692ecff", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbfac02a0b0 con 0x7fbfc4150300 2024-02-17T12:16:00.496 INFO:teuthology.orchestra.run.smithi116.stdout:6 2024-02-17T12:16:00.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fbfc9c00640 1 -- 172.21.15.116:0/2503902023 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 msgr2=0x7fbfc40aba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fbfc9c00640 1 --2- 172.21.15.116:0/2503902023 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc40aba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c760 tx=0x7fbfac00cc20 comp rx=0 tx=0).stop 2024-02-17T12:16:00.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fbfc9c00640 1 -- 172.21.15.116:0/2503902023 shutdown_connections 2024-02-17T12:16:00.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fbfc9c00640 1 --2- 172.21.15.116:0/2503902023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfc4152d30 0x7fbfc4148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fbfc9c00640 1 --2- 172.21.15.116:0/2503902023 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfc4150300 0x7fbfc40aba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fbfc9c00640 1 --2- 172.21.15.116:0/2503902023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfc40714c0 0x7fbfc4149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fbfc9c00640 1 -- 172.21.15.116:0/2503902023 >> 172.21.15.116:0/2503902023 conn(0x7fbfc40c4f20 msgr2=0x7fbfc40706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:00.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fbfc9c00640 1 -- 172.21.15.116:0/2503902023 shutdown_connections 2024-02-17T12:16:00.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fbfc9c00640 1 -- 172.21.15.116:0/2503902023 wait complete. 2024-02-17T12:16:00.499 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:00.494+0000 7f1346b4f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T12:16:00.499 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:00.493+0000 7fda1850b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T12:16:00.515 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 8bb2e00e-2e38-4a78-a55c-27e65b334c9b 7 2024-02-17T12:16:00.572 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:00.569+0000 7fda1850b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T12:16:00.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f6115c00640 1 Processor -- start 2024-02-17T12:16:00.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f6115c00640 1 -- start start 2024-02-17T12:16:00.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f6115c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6110150300 0x7f6110156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f6115c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6110152d30 0x7f61101531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f6115c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6110157270 con 0x7f61100714c0 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f6115c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61100c6900 con 0x7f6110150300 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f6115c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61100c3580 con 0x7f6110152d30 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610ea00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6110150300 0x7f6110156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610f400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6110152d30 0x7f61101531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610ea00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6110150300 0x7f6110156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43366/0 (socket says 172.21.15.116:43366) 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610f400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6110152d30 0x7f61101531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:41900/0 (socket says 172.21.15.116:41900) 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f6107e00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f61100714c0 0x7f61100aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:37378/0 (socket says 172.21.15.116:37378) 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610ea00640 1 -- 172.21.15.116:0/1583063498 learned_addr learned my addr 172.21.15.116:0/1583063498 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:16:00.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610f400640 1 -- 172.21.15.116:0/1583063498 >> v2:172.21.15.116:3300/0 conn(0x7f6110150300 msgr2=0x7f6110156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:00.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610f400640 1 --2- 172.21.15.116:0/1583063498 >> v2:172.21.15.116:3300/0 conn(0x7f6110150300 0x7f6110156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610f400640 1 -- 172.21.15.116:0/1583063498 >> v1:172.21.15.116:6789/0 conn(0x7f61100714c0 legacy=0x7f61100aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610f400640 1 -- 172.21.15.116:0/1583063498 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61100c2fc0 con 0x7f6110152d30 2024-02-17T12:16:00.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610e000640 1 -- 172.21.15.116:0/1583063498 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539569690 0 0) 0x7f6110157270 con 0x7f61100714c0 2024-02-17T12:16:00.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.645+0000 7f610ea00640 1 --2- 172.21.15.116:0/1583063498 >> v2:172.21.15.116:3300/0 conn(0x7f6110150300 0x7f6110156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:00.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f610f400640 1 --2- 172.21.15.116:0/1583063498 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6110152d30 0x7f61101531c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6108009d90 tx=0x7f610801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31d5ad26bf5fb8b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f610e000640 1 -- 172.21.15.116:0/1583063498 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080a57a0 con 0x7f6110152d30 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f610e000640 1 -- 172.21.15.116:0/1583063498 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61080a5900 con 0x7f6110152d30 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f610e000640 1 -- 172.21.15.116:0/1583063498 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080a5c90 con 0x7f6110152d30 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f6115c00640 1 -- 172.21.15.116:0/1583063498 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6110152d30 msgr2=0x7f61101531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f6115c00640 1 --2- 172.21.15.116:0/1583063498 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6110152d30 0x7f61101531c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6108009d90 tx=0x7f610801c8e0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f6115c00640 1 -- 172.21.15.116:0/1583063498 shutdown_connections 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f6115c00640 1 --2- 172.21.15.116:0/1583063498 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6110152d30 0x7f61101531c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f6115c00640 1 --2- 172.21.15.116:0/1583063498 >> v2:172.21.15.116:3300/0 conn(0x7f6110150300 0x7f6110156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f6115c00640 1 -- 172.21.15.116:0/1583063498 >> 172.21.15.116:0/1583063498 conn(0x7f61100c4f20 msgr2=0x7f61100c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f6115c00640 1 -- 172.21.15.116:0/1583063498 shutdown_connections 2024-02-17T12:16:00.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f6115c00640 1 -- 172.21.15.116:0/1583063498 wait complete. 2024-02-17T12:16:00.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f6115c00640 1 Processor -- start 2024-02-17T12:16:00.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.649+0000 7f6115c00640 1 -- start start 2024-02-17T12:16:00.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6115c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61100714c0 0x7f61101ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6115c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6110150300 0x7f61100ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6115c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6110152d30 0x7f6110154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6115c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61100c7220 con 0x7f6110150300 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6115c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61100c7500 con 0x7f6110152d30 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6115c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61100c77e0 con 0x7f61100714c0 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f610ea00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61100714c0 0x7f61101ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f610f400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6110152d30 0x7f6110154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f610ea00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61100714c0 0x7f61101ef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:41912/0 (socket says 172.21.15.116:41912) 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f610ea00640 1 -- 172.21.15.116:0/1896253471 learned_addr learned my addr 172.21.15.116:0/1896253471 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6107e00640 1 --2- 172.21.15.116:0/1896253471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6110150300 0x7f61100ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f610ea00640 1 -- 172.21.15.116:0/1896253471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6110152d30 msgr2=0x7f6110154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f610ea00640 1 --2- 172.21.15.116:0/1896253471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6110152d30 0x7f6110154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f610ea00640 1 -- 172.21.15.116:0/1896253471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6110150300 msgr2=0x7f61100ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f610ea00640 1 --2- 172.21.15.116:0/1896253471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6110150300 0x7f61100ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f610ea00640 1 -- 172.21.15.116:0/1896253471 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61000094d0 con 0x7f61100714c0 2024-02-17T12:16:00.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f610ea00640 1 --2- 172.21.15.116:0/1896253471 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61100714c0 0x7f61101ef6e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f610000e930 tx=0x7f610000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:00.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6106a00640 1 -- 172.21.15.116:0/1896253471 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000ca00 con 0x7f61100714c0 2024-02-17T12:16:00.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6106a00640 1 -- 172.21.15.116:0/1896253471 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610000cb60 con 0x7f61100714c0 2024-02-17T12:16:00.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6106a00640 1 -- 172.21.15.116:0/1896253471 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100013470 con 0x7f61100714c0 2024-02-17T12:16:00.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6115c00640 1 -- 172.21.15.116:0/1896253471 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6108009a70 con 0x7f61100714c0 2024-02-17T12:16:00.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6115c00640 1 -- 172.21.15.116:0/1896253471 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61100c7da0 con 0x7f61100714c0 2024-02-17T12:16:00.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6106a00640 1 -- 172.21.15.116:0/1896253471 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f61000059a0 con 0x7f61100714c0 2024-02-17T12:16:00.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6106a00640 1 -- 172.21.15.116:0/1896253471 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6100005c50 con 0x7f61100714c0 2024-02-17T12:16:00.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.653+0000 7f6115c00640 1 -- 172.21.15.116:0/1896253471 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6110074840 con 0x7f61100714c0 2024-02-17T12:16:00.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.657+0000 7f6106a00640 1 -- 172.21.15.116:0/1896253471 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6100021060 con 0x7f61100714c0 2024-02-17T12:16:00.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.721+0000 7f6115c00640 1 -- 172.21.15.116:0/1896253471 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8bb2e00e-2e38-4a78-a55c-27e65b334c9b", "id": 7} v 0) v1 -- 0x7f611014fb30 con 0x7f61100714c0 2024-02-17T12:16:00.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.729+0000 7f6106a00640 1 -- 172.21.15.116:0/1896253471 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8bb2e00e-2e38-4a78-a55c-27e65b334c9b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6100029020 con 0x7f61100714c0 2024-02-17T12:16:00.731 INFO:teuthology.orchestra.run.smithi116.stdout:7 2024-02-17T12:16:00.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.729+0000 7f6115c00640 1 -- 172.21.15.116:0/1896253471 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61100714c0 msgr2=0x7f61101ef6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.729+0000 7f6115c00640 1 --2- 172.21.15.116:0/1896253471 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61100714c0 0x7f61101ef6e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f610000e930 tx=0x7f610000edf0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.729+0000 7f6115c00640 1 -- 172.21.15.116:0/1896253471 shutdown_connections 2024-02-17T12:16:00.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.729+0000 7f6115c00640 1 --2- 172.21.15.116:0/1896253471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6110152d30 0x7f6110154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.729+0000 7f6115c00640 1 --2- 172.21.15.116:0/1896253471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6110150300 0x7f61100ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.729+0000 7f6115c00640 1 --2- 172.21.15.116:0/1896253471 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61100714c0 0x7f61101ef6e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.729+0000 7f6115c00640 1 -- 172.21.15.116:0/1896253471 >> 172.21.15.116:0/1896253471 conn(0x7f61100c4f20 msgr2=0x7f611015cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:00.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.729+0000 7f6115c00640 1 -- 172.21.15.116:0/1896253471 shutdown_connections 2024-02-17T12:16:00.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-02-17T12:16:00.729+0000 7f6115c00640 1 -- 172.21.15.116:0/1896253471 wait complete. 2024-02-17T12:16:00.749 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-17T12:16:00.749 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-17T12:16:00.752 INFO:tasks.ceph.osd.0:Started 2024-02-17T12:16:00.752 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-17T12:16:00.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-17T12:16:00.755 INFO:tasks.ceph.osd.1:Started 2024-02-17T12:16:00.755 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-17T12:16:00.756 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-17T12:16:00.759 INFO:tasks.ceph.osd.2:Started 2024-02-17T12:16:00.759 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-17T12:16:00.759 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-17T12:16:00.762 INFO:tasks.ceph.osd.3:Started 2024-02-17T12:16:00.762 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-17T12:16:00.762 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-17T12:16:00.765 INFO:tasks.ceph.osd.4:Started 2024-02-17T12:16:00.765 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-17T12:16:00.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-17T12:16:00.768 INFO:tasks.ceph.osd.5:Started 2024-02-17T12:16:00.768 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-17T12:16:00.768 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-17T12:16:00.771 INFO:tasks.ceph.osd.6:Started 2024-02-17T12:16:00.771 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-17T12:16:00.771 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-17T12:16:00.776 INFO:tasks.ceph.osd.7:Started 2024-02-17T12:16:00.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:00.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e81e00640 1 Processor -- start 2024-02-17T12:16:00.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e81e00640 1 -- start start 2024-02-17T12:16:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e81e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5e7c152410 0x7f5e7c0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e81e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5e7c1588f0 0x7f5e7c06bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e81e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c072b90 con 0x7f5e7c06b730 2024-02-17T12:16:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e81e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7c0c6390 con 0x7f5e7c152410 2024-02-17T12:16:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e81e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c0c1830 con 0x7f5e7c1588f0 2024-02-17T12:16:00.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e80a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5e7c152410 0x7f5e7c0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e80a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5e7c152410 0x7f5e7c0c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35656/0 (socket says 172.21.15.114:35656) 2024-02-17T12:16:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e7be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5e7c06b730 0x7f5e7c1581e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38294/0 (socket says 172.21.15.114:38294) 2024-02-17T12:16:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e80a00640 1 -- 172.21.15.114:0/508714 learned_addr learned my addr 172.21.15.114:0/508714 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e81400640 1 --2- 172.21.15.114:0/508714 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5e7c1588f0 0x7f5e7c06bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e80a00640 1 -- 172.21.15.114:0/508714 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5e7c1588f0 msgr2=0x7f5e7c06bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e80a00640 1 --2- 172.21.15.114:0/508714 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5e7c1588f0 0x7f5e7c06bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e80a00640 1 -- 172.21.15.114:0/508714 >> v1:172.21.15.114:6789/0 conn(0x7f5e7c06b730 legacy=0x7f5e7c1581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e80a00640 1 -- 172.21.15.114:0/508714 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0c60b0 con 0x7f5e7c152410 2024-02-17T12:16:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.970+0000 7f5e7b400640 1 -- 172.21.15.114:0/508714 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920047646 0 0) 0x7f5e7c072b90 con 0x7f5e7c06b730 2024-02-17T12:16:00.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e80a00640 1 --2- 172.21.15.114:0/508714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c152410 0x7f5e7c0c59d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009e50 tx=0x7f5e6c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258ddc6972cc5cd1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:00.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e7b400640 1 -- 172.21.15.114:0/508714 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0a57a0 con 0x7f5e7c152410 2024-02-17T12:16:00.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e7b400640 1 -- 172.21.15.114:0/508714 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0a5900 con 0x7f5e7c152410 2024-02-17T12:16:00.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e7b400640 1 -- 172.21.15.114:0/508714 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0a5c90 con 0x7f5e7c152410 2024-02-17T12:16:00.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e81e00640 1 -- 172.21.15.114:0/508714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c152410 msgr2=0x7f5e7c0c59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e81e00640 1 --2- 172.21.15.114:0/508714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c152410 0x7f5e7c0c59d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009e50 tx=0x7f5e6c01c8e0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e81e00640 1 -- 172.21.15.114:0/508714 shutdown_connections 2024-02-17T12:16:00.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e81e00640 1 --2- 172.21.15.114:0/508714 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5e7c1588f0 0x7f5e7c06bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e81e00640 1 --2- 172.21.15.114:0/508714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c152410 0x7f5e7c0c59d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e81e00640 1 -- 172.21.15.114:0/508714 >> 172.21.15.114:0/508714 conn(0x7f5e7c06ac10 msgr2=0x7f5e7c06b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:00.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e81e00640 1 -- 172.21.15.114:0/508714 shutdown_connections 2024-02-17T12:16:00.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e81e00640 1 -- 172.21.15.114:0/508714 wait complete. 2024-02-17T12:16:00.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e81e00640 1 Processor -- start 2024-02-17T12:16:00.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.974+0000 7f5e81e00640 1 -- start start 2024-02-17T12:16:00.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e81e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c06b730 0x7f5e7c1edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e81e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e7c152410 0x7f5e7c0a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e81e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5e7c1588f0 0x7f5e7c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e81e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c1ee050 con 0x7f5e7c06b730 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e81e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c158140 con 0x7f5e7c152410 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e81e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c1578a0 con 0x7f5e7c1588f0 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e80a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c06b730 0x7f5e7c1edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e80a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c06b730 0x7f5e7c1edb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35672/0 (socket says 172.21.15.114:35672) 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e80a00640 1 -- 172.21.15.114:0/3113468838 learned_addr learned my addr 172.21.15.114:0/3113468838 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e7be00640 1 --2- 172.21.15.114:0/3113468838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e7c152410 0x7f5e7c0a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e81400640 1 --2- 172.21.15.114:0/3113468838 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5e7c1588f0 0x7f5e7c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e80a00640 1 -- 172.21.15.114:0/3113468838 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5e7c1588f0 msgr2=0x7f5e7c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e80a00640 1 --2- 172.21.15.114:0/3113468838 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5e7c1588f0 0x7f5e7c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e80a00640 1 -- 172.21.15.114:0/3113468838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e7c152410 msgr2=0x7f5e7c0a78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e80a00640 1 --2- 172.21.15.114:0/3113468838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e7c152410 0x7f5e7c0a78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e80a00640 1 -- 172.21.15.114:0/3113468838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c009b30 con 0x7f5e7c06b730 2024-02-17T12:16:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e80a00640 1 --2- 172.21.15.114:0/3113468838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c06b730 0x7f5e7c1edb10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0af040 tx=0x7f5e6c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e78c00640 1 -- 172.21.15.114:0/3113468838 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0b8670 con 0x7f5e7c06b730 2024-02-17T12:16:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e78c00640 1 -- 172.21.15.114:0/3113468838 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c0b87f0 con 0x7f5e7c06b730 2024-02-17T12:16:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e78c00640 1 -- 172.21.15.114:0/3113468838 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0b8ba0 con 0x7f5e7c06b730 2024-02-17T12:16:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e81e00640 1 -- 172.21.15.114:0/3113468838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7c0731a0 con 0x7f5e7c06b730 2024-02-17T12:16:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e81e00640 1 -- 172.21.15.114:0/3113468838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c157e60 con 0x7f5e7c06b730 2024-02-17T12:16:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e78c00640 1 -- 172.21.15.114:0/3113468838 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5e6c0c1790 con 0x7f5e7c06b730 2024-02-17T12:16:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e78c00640 1 -- 172.21.15.114:0/3113468838 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5e6c0b6e80 con 0x7f5e7c06b730 2024-02-17T12:16:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.978+0000 7f5e81e00640 1 -- 172.21.15.114:0/3113468838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c04eef0 con 0x7f5e7c06b730 2024-02-17T12:16:00.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:00.982+0000 7f5e78c00640 1 -- 172.21.15.114:0/3113468838 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5e6c0bc020 con 0x7f5e7c06b730 2024-02-17T12:16:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e81e00640 1 -- 172.21.15.114:0/3113468838 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e7c0a8620 con 0x7f5e7c06b730 2024-02-17T12:16:01.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e78c00640 1 -- 172.21.15.114:0/3113468838 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f5e6c0b8d00 con 0x7f5e7c06b730 2024-02-17T12:16:01.053 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:01.054 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":10,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:00.728982+0000","last_up_change":"0.000000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e81e00640 1 -- 172.21.15.114:0/3113468838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c06b730 msgr2=0x7f5e7c1edb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e81e00640 1 --2- 172.21.15.114:0/3113468838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c06b730 0x7f5e7c1edb10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0af040 tx=0x7f5e6c019680 comp rx=0 tx=0).stop 2024-02-17T12:16:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e81e00640 1 -- 172.21.15.114:0/3113468838 shutdown_connections 2024-02-17T12:16:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e81e00640 1 --2- 172.21.15.114:0/3113468838 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5e7c1588f0 0x7f5e7c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e81e00640 1 --2- 172.21.15.114:0/3113468838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5e7c152410 0x7f5e7c0a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e81e00640 1 --2- 172.21.15.114:0/3113468838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e7c06b730 0x7f5e7c1edb10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e81e00640 1 -- 172.21.15.114:0/3113468838 >> 172.21.15.114:0/3113468838 conn(0x7f5e7c06ac10 msgr2=0x7f5e7c154400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e81e00640 1 -- 172.21.15.114:0/3113468838 shutdown_connections 2024-02-17T12:16:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:01.050+0000 7f5e81e00640 1 -- 172.21.15.114:0/3113468838 wait complete. 2024-02-17T12:16:01.076 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-17T12:16:01.076 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-17T12:16:01.109 INFO:tasks.ceph.mgr.y.smithi114.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-02-17T12:16:01.109 INFO:tasks.ceph.mgr.y.smithi114.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-02-17T12:16:01.109 INFO:tasks.ceph.mgr.y.smithi114.stderr: from numpy import show_config as show_numpy_config 2024-02-17T12:16:01.169 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:01.166+0000 7f1346b4f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T12:16:01.315 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:01.310+0000 7f1346b4f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T12:16:01.345 INFO:tasks.ceph.mgr.x.smithi116.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-02-17T12:16:01.345 INFO:tasks.ceph.mgr.x.smithi116.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-02-17T12:16:01.345 INFO:tasks.ceph.mgr.x.smithi116.stderr: from numpy import show_config as show_numpy_config 2024-02-17T12:16:01.396 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:01.397+0000 7fda1850b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T12:16:01.406 INFO:tasks.ceph.osd.4.smithi116.stderr:2024-02-17T12:16:01.405+0000 7f084d4597c0 -1 Falling back to public interface 2024-02-17T12:16:01.425 INFO:tasks.ceph.osd.7.smithi116.stderr:2024-02-17T12:16:01.425+0000 7f54cdeff7c0 -1 Falling back to public interface 2024-02-17T12:16:01.426 INFO:tasks.ceph.osd.6.smithi116.stderr:2024-02-17T12:16:01.425+0000 7f636f3ad7c0 -1 Falling back to public interface 2024-02-17T12:16:01.433 INFO:tasks.ceph.osd.5.smithi116.stderr:2024-02-17T12:16:01.433+0000 7f7b746957c0 -1 Falling back to public interface 2024-02-17T12:16:01.433 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-02-17T12:16:01.430+0000 7fe1b36727c0 -1 Falling back to public interface 2024-02-17T12:16:01.453 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-02-17T12:16:01.450+0000 7f65928e47c0 -1 Falling back to public interface 2024-02-17T12:16:01.454 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-02-17T12:16:01.450+0000 7f9d57dbf7c0 -1 Falling back to public interface 2024-02-17T12:16:01.454 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-02-17T12:16:01.450+0000 7f9d56800640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-02-17T12:16:01.477 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-02-17T12:16:01.474+0000 7fdac17557c0 -1 Falling back to public interface 2024-02-17T12:16:01.494 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:01.490+0000 7f1346b4f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T12:16:01.552 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:01.549+0000 7fda1850b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T12:16:01.567 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:01.562+0000 7f1346b4f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T12:16:01.714 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:01.710+0000 7f1346b4f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T12:16:01.738 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:01.737+0000 7fda1850b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T12:16:01.811 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:01.809+0000 7fda1850b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T12:16:01.882 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:01.958 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:01.957+0000 7fda1850b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T12:16:02.008 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.002+0000 7f70b7c00640 1 Processor -- start 2024-02-17T12:16:02.008 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.002+0000 7f70b7c00640 1 -- start start 2024-02-17T12:16:02.010 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b7c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f70b00c76a0 0x7f70b0156080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:02.010 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b7c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70b00c4cd0 0x7f70b00c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:02.010 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b7c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b0156980 con 0x7f70b00c48f0 2024-02-17T12:16:02.010 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b7c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b0153ab0 con 0x7f70b00c4cd0 2024-02-17T12:16:02.010 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b7c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b0156c60 con 0x7f70b00c76a0 2024-02-17T12:16:02.010 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b5c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70b00c4cd0 0x7f70b00c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:02.010 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b5c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70b00c4cd0 0x7f70b00c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35684/0 (socket says 172.21.15.114:35684) 2024-02-17T12:16:02.010 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b5c00640 1 -- 172.21.15.114:0/2662581269 learned_addr learned my addr 172.21.15.114:0/2662581269 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:02.010 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70a7e00640 1 --2- 172.21.15.114:0/2662581269 >> v2:172.21.15.116:3300/0 conn(0x7f70b00c76a0 0x7f70b0156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:02.010 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b5c00640 1 -- 172.21.15.114:0/2662581269 >> v2:172.21.15.116:3300/0 conn(0x7f70b00c76a0 msgr2=0x7f70b0156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:02.011 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b5c00640 1 --2- 172.21.15.114:0/2662581269 >> v2:172.21.15.116:3300/0 conn(0x7f70b00c76a0 0x7f70b0156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:02.011 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b5c00640 1 -- 172.21.15.114:0/2662581269 >> v1:172.21.15.114:6789/0 conn(0x7f70b00c48f0 legacy=0x7f70b01533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:02.011 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.006+0000 7f70b5c00640 1 -- 172.21.15.114:0/2662581269 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b0156f40 con 0x7f70b00c4cd0 2024-02-17T12:16:02.013 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b5c00640 1 --2- 172.21.15.114:0/2662581269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b00c4cd0 0x7f70b00c5160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f70b00c85b0 tx=0x7f70a801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7b9c6bb2c7dfa8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:02.013 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70afe00640 1 -- 172.21.15.114:0/2662581269 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a80090d0 con 0x7f70b00c4cd0 2024-02-17T12:16:02.013 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70afe00640 1 -- 172.21.15.114:0/2662581269 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8009230 con 0x7f70b00c4cd0 2024-02-17T12:16:02.013 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70afe00640 1 -- 172.21.15.114:0/2662581269 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a80a5980 con 0x7f70b00c4cd0 2024-02-17T12:16:02.014 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 -- 172.21.15.114:0/2662581269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b00c4cd0 msgr2=0x7f70b00c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:02.014 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 --2- 172.21.15.114:0/2662581269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b00c4cd0 0x7f70b00c5160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f70b00c85b0 tx=0x7f70a801c8a0 comp rx=0 tx=0).stop 2024-02-17T12:16:02.014 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 -- 172.21.15.114:0/2662581269 shutdown_connections 2024-02-17T12:16:02.014 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 --2- 172.21.15.114:0/2662581269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b00c4cd0 0x7f70b00c5160 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:02.014 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 --2- 172.21.15.114:0/2662581269 >> v2:172.21.15.116:3300/0 conn(0x7f70b00c76a0 0x7f70b0156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:02.014 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 -- 172.21.15.114:0/2662581269 >> 172.21.15.114:0/2662581269 conn(0x7f70b006ade0 msgr2=0x7f70b006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:02.015 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 -- 172.21.15.114:0/2662581269 shutdown_connections 2024-02-17T12:16:02.015 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 -- 172.21.15.114:0/2662581269 wait complete. 2024-02-17T12:16:02.015 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 Processor -- start 2024-02-17T12:16:02.015 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 -- start start 2024-02-17T12:16:02.018 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70b00c48f0 0x7f70b0151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:02.018 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.010+0000 7f70b7c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70b00c4cd0 0x7f70b01540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:02.018 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70b7c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b00c76a0 0x7f70b01ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:02.018 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70b7c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0154d20 con 0x7f70b00c76a0 2024-02-17T12:16:02.018 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70b7c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b01ed380 con 0x7f70b00c4cd0 2024-02-17T12:16:02.018 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70b7c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b01508f0 con 0x7f70b00c48f0 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70a7e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70b00c4cd0 0x7f70b01540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70a7e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70b00c4cd0 0x7f70b01540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:45736/0 (socket says 172.21.15.114:45736) 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70b5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b00c76a0 0x7f70b01ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70a7e00640 1 -- 172.21.15.114:0/2789850998 learned_addr learned my addr 172.21.15.114:0/2789850998 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70b5200640 1 --2- 172.21.15.114:0/2789850998 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70b00c48f0 0x7f70b0151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70a7e00640 1 -- 172.21.15.114:0/2789850998 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70b00c48f0 msgr2=0x7f70b0151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70a7e00640 1 --2- 172.21.15.114:0/2789850998 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70b00c48f0 0x7f70b0151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70a7e00640 1 -- 172.21.15.114:0/2789850998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b00c76a0 msgr2=0x7f70b01ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70a7e00640 1 --2- 172.21.15.114:0/2789850998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b00c76a0 0x7f70b01ed810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70a7e00640 1 -- 172.21.15.114:0/2789850998 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a8009b30 con 0x7f70b00c4cd0 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70a7e00640 1 --2- 172.21.15.114:0/2789850998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70b00c4cd0 0x7f70b01540e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f709800e900 tx=0x7f709800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70ad600640 1 -- 172.21.15.114:0/2789850998 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098009690 con 0x7f70b00c4cd0 2024-02-17T12:16:02.019 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70ad600640 1 -- 172.21.15.114:0/2789850998 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709800ca00 con 0x7f70b00c4cd0 2024-02-17T12:16:02.020 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70ad600640 1 -- 172.21.15.114:0/2789850998 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800cd90 con 0x7f70b00c4cd0 2024-02-17T12:16:02.020 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70b7c00640 1 -- 172.21.15.114:0/2789850998 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b0150bd0 con 0x7f70b00c4cd0 2024-02-17T12:16:02.020 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70b7c00640 1 -- 172.21.15.114:0/2789850998 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b0154620 con 0x7f70b00c4cd0 2024-02-17T12:16:02.020 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70ad600640 1 -- 172.21.15.114:0/2789850998 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f70980059a0 con 0x7f70b00c4cd0 2024-02-17T12:16:02.020 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70ad600640 1 -- 172.21.15.114:0/2789850998 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7098005c50 con 0x7f70b00c4cd0 2024-02-17T12:16:02.020 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.014+0000 7f70b7c00640 1 -- 172.21.15.114:0/2789850998 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b004ef60 con 0x7f70b00c4cd0 2024-02-17T12:16:02.021 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.018+0000 7f70ad600640 1 -- 172.21.15.114:0/2789850998 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7098021060 con 0x7f70b00c4cd0 2024-02-17T12:16:02.105 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70b7c00640 1 -- 172.21.15.114:0/2789850998 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70b00c73a0 con 0x7f70b00c4cd0 2024-02-17T12:16:02.106 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70ad600640 1 -- 172.21.15.114:0/2789850998 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f7098029020 con 0x7f70b00c4cd0 2024-02-17T12:16:02.106 INFO:teuthology.misc.health.smithi114.stdout: 2024-02-17T12:16:02.107 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":10,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:00.728982+0000","last_up_change":"0.000000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:02.107 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70b7c00640 1 -- 172.21.15.114:0/2789850998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70b00c4cd0 msgr2=0x7f70b01540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:02.108 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70b7c00640 1 --2- 172.21.15.114:0/2789850998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70b00c4cd0 0x7f70b01540e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f709800e900 tx=0x7f709800edc0 comp rx=0 tx=0).stop 2024-02-17T12:16:02.108 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70b7c00640 1 -- 172.21.15.114:0/2789850998 shutdown_connections 2024-02-17T12:16:02.108 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70b7c00640 1 --2- 172.21.15.114:0/2789850998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70b00c76a0 0x7f70b01ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:02.108 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70b7c00640 1 --2- 172.21.15.114:0/2789850998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70b00c4cd0 0x7f70b01540e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:02.108 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70b7c00640 1 --2- 172.21.15.114:0/2789850998 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70b00c48f0 0x7f70b0151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:02.108 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70b7c00640 1 -- 172.21.15.114:0/2789850998 >> 172.21.15.114:0/2789850998 conn(0x7f70b006ade0 msgr2=0x7f70b00c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:02.108 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70b7c00640 1 -- 172.21.15.114:0/2789850998 shutdown_connections 2024-02-17T12:16:02.108 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:02.102+0000 7f70b7c00640 1 -- 172.21.15.114:0/2789850998 wait complete. 2024-02-17T12:16:02.124 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-17T12:16:02.435 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:02.430+0000 7f1346b4f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T12:16:02.521 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:02.518+0000 7f1346b4f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T12:16:02.646 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:02.645+0000 7fda1850b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T12:16:02.721 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:02.718+0000 7f1346b4f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T12:16:02.733 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:02.733+0000 7fda1850b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T12:16:02.806 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:02.802+0000 7f1346b4f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-17T12:16:02.934 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:02.933+0000 7fda1850b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T12:16:03.018 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:03.017+0000 7fda1850b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-17T12:16:03.132 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:03.126+0000 7f1346b4f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T12:16:03.202 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:03.198+0000 7f1346b4f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T12:16:03.355 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:03.353+0000 7fda1850b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T12:16:03.426 INFO:tasks.ceph.mgr.x.smithi116.stderr:2024-02-17T12:16:03.425+0000 7fda1850b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T12:16:04.225 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:04.222+0000 7f12ecc00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-17T12:16:04.226 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-02-17T12:16:04.222+0000 7f12ecc00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-17T12:16:05.157 INFO:tasks.ceph.osd.4.smithi116.stderr:2024-02-17T12:16:05.157+0000 7f084d4597c0 -1 osd.4 0 log_to_monitors true 2024-02-17T12:16:05.244 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-02-17T12:16:05.237+0000 7fe1b36727c0 -1 osd.2 0 log_to_monitors true 2024-02-17T12:16:05.273 INFO:tasks.ceph.osd.7.smithi116.stderr:2024-02-17T12:16:05.273+0000 7f54cdeff7c0 -1 osd.7 0 log_to_monitors true 2024-02-17T12:16:05.342 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-02-17T12:16:05.337+0000 7f9d57dbf7c0 -1 osd.3 0 log_to_monitors true 2024-02-17T12:16:05.364 INFO:tasks.ceph.osd.6.smithi116.stderr:2024-02-17T12:16:05.361+0000 7f636f3ad7c0 -1 osd.6 0 log_to_monitors true 2024-02-17T12:16:05.387 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-02-17T12:16:05.381+0000 7f65928e47c0 -1 osd.1 0 log_to_monitors true 2024-02-17T12:16:05.397 INFO:tasks.ceph.osd.5.smithi116.stderr:2024-02-17T12:16:05.397+0000 7f7b746957c0 -1 osd.5 0 log_to_monitors true 2024-02-17T12:16:05.452 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-02-17T12:16:05.445+0000 7fdac17557c0 -1 osd.0 0 log_to_monitors true 2024-02-17T12:16:07.375 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-02-17T12:16:07.369+0000 7fe1adc00640 -1 osd.2 0 waiting for initial osdmap 2024-02-17T12:16:07.463 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-02-17T12:16:07.457+0000 7fe1a4600640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:16:07.831 INFO:tasks.ceph.osd.4.smithi116.stderr:2024-02-17T12:16:07.828+0000 7f0847a00640 -1 osd.4 0 waiting for initial osdmap 2024-02-17T12:16:07.877 INFO:tasks.ceph.osd.7.smithi116.stderr:2024-02-17T12:16:07.876+0000 7f54c8400640 -1 osd.7 0 waiting for initial osdmap 2024-02-17T12:16:07.957 INFO:tasks.ceph.osd.4.smithi116.stderr:2024-02-17T12:16:07.956+0000 7f083e400640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:16:08.034 INFO:tasks.ceph.osd.7.smithi116.stderr:2024-02-17T12:16:08.032+0000 7f54bee00640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:16:08.732 INFO:tasks.ceph.osd.6.smithi116.stderr:2024-02-17T12:16:08.732+0000 7f6369800640 -1 osd.6 0 waiting for initial osdmap 2024-02-17T12:16:08.740 INFO:tasks.ceph.osd.5.smithi116.stderr:2024-02-17T12:16:08.736+0000 7f7b70a00640 -1 osd.5 0 waiting for initial osdmap 2024-02-17T12:16:08.753 INFO:tasks.ceph.osd.6.smithi116.stderr:2024-02-17T12:16:08.752+0000 7f6360200640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:16:08.773 INFO:tasks.ceph.osd.5.smithi116.stderr:2024-02-17T12:16:08.772+0000 7f7b65600640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:16:08.931 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:09.139 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.133+0000 7f78b9600640 1 Processor -- start 2024-02-17T12:16:09.139 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.133+0000 7f78b9600640 1 -- start start 2024-02-17T12:16:09.140 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.133+0000 7f78b9600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f78b40ac670 0x7f78b415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:09.141 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.133+0000 7f78b9600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b40ab590 con 0x7f78b4150320 2024-02-17T12:16:09.141 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.133+0000 7f78b9600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b40acb70 con 0x7f78b40c1f80 2024-02-17T12:16:09.141 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.133+0000 7f78b9600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b40ace50 con 0x7f78b40ac670 2024-02-17T12:16:09.142 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.137+0000 7f78b3400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f78b40ac670 0x7f78b415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:09.142 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.137+0000 7f78b2000640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f78b40c1f80 0x7f78b4152be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:41956/0 (socket says 172.21.15.114:41956) 2024-02-17T12:16:09.142 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.137+0000 7f78b2000640 1 -- 172.21.15.114:0/1066997446 learned_addr learned my addr 172.21.15.114:0/1066997446 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:09.142 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.137+0000 7f78b3400640 1 -- 172.21.15.114:0/1066997446 >> v1:172.21.15.116:6789/0 conn(0x7f78b40c1f80 legacy=0x7f78b4152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:09.143 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.137+0000 7f78b3400640 1 -- 172.21.15.114:0/1066997446 >> v1:172.21.15.114:6789/0 conn(0x7f78b4150320 legacy=0x7f78b406bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:09.143 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.137+0000 7f78b3400640 1 -- 172.21.15.114:0/1066997446 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b40ab800 con 0x7f78b40ac670 2024-02-17T12:16:09.147 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b3400640 1 --2- 172.21.15.114:0/1066997446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 0x7f78b415e4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009d90 tx=0x7f78ac01f120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=123cc5a25eb62d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:09.147 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b1600640 1 -- 172.21.15.114:0/1066997446 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0af600 con 0x7f78b40ac670 2024-02-17T12:16:09.147 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b1600640 1 -- 172.21.15.114:0/1066997446 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac0ab050 con 0x7f78b40ac670 2024-02-17T12:16:09.147 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b1600640 1 -- 172.21.15.114:0/1066997446 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0af980 con 0x7f78b40ac670 2024-02-17T12:16:09.148 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b9600640 1 -- 172.21.15.114:0/1066997446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 msgr2=0x7f78b415e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:09.148 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b9600640 1 --2- 172.21.15.114:0/1066997446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 0x7f78b415e4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009d90 tx=0x7f78ac01f120 comp rx=0 tx=0).stop 2024-02-17T12:16:09.148 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b9600640 1 -- 172.21.15.114:0/1066997446 shutdown_connections 2024-02-17T12:16:09.148 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b9600640 1 --2- 172.21.15.114:0/1066997446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 0x7f78b415e4d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:09.148 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b9600640 1 -- 172.21.15.114:0/1066997446 >> 172.21.15.114:0/1066997446 conn(0x7f78b4071720 msgr2=0x7f78b4071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:09.148 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b9600640 1 -- 172.21.15.114:0/1066997446 shutdown_connections 2024-02-17T12:16:09.148 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.141+0000 7f78b9600640 1 -- 172.21.15.114:0/1066997446 wait complete. 2024-02-17T12:16:09.150 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b9600640 1 Processor -- start 2024-02-17T12:16:09.150 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b9600640 1 -- start start 2024-02-17T12:16:09.151 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b9600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 0x7f78b4148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:09.152 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b9600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78b40c1f80 0x7f78b40c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:09.152 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4150320 0x7f78b41e1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:09.152 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b9600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4147e70 con 0x7f78b4150320 2024-02-17T12:16:09.152 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b9600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40c1510 con 0x7f78b40ac670 2024-02-17T12:16:09.152 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b9600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b41f26b0 con 0x7f78b40c1f80 2024-02-17T12:16:09.153 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b2a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 0x7f78b4148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:09.153 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b2a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 0x7f78b4148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:59510/0 (socket says 172.21.15.114:59510) 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b2a00640 1 -- 172.21.15.114:0/928734359 learned_addr learned my addr 172.21.15.114:0/928734359 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b3400640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4150320 0x7f78b41e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b2000640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78b40c1f80 0x7f78b40c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b2a00640 1 -- 172.21.15.114:0/928734359 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78b40c1f80 msgr2=0x7f78b40c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b2a00640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78b40c1f80 0x7f78b40c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b2a00640 1 -- 172.21.15.114:0/928734359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4150320 msgr2=0x7f78b41e1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b2a00640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4150320 0x7f78b41e1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b2a00640 1 -- 172.21.15.114:0/928734359 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac009a70 con 0x7f78b40ac670 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.145+0000 7f78b2000640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78b40c1f80 0x7f78b40c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.149+0000 7f78b2a00640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 0x7f78b4148050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78a400b410 tx=0x7f78a400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:09.154 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.149+0000 7f78aaa00640 1 -- 172.21.15.114:0/928734359 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4004020 con 0x7f78b40ac670 2024-02-17T12:16:09.155 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.149+0000 7f78aaa00640 1 -- 172.21.15.114:0/928734359 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a4004180 con 0x7f78b40ac670 2024-02-17T12:16:09.155 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.149+0000 7f78b9600640 1 -- 172.21.15.114:0/928734359 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b40c1230 con 0x7f78b40ac670 2024-02-17T12:16:09.155 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.149+0000 7f78aaa00640 1 -- 172.21.15.114:0/928734359 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4011630 con 0x7f78b40ac670 2024-02-17T12:16:09.155 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.149+0000 7f78b9600640 1 -- 172.21.15.114:0/928734359 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b40c5350 con 0x7f78b40ac670 2024-02-17T12:16:09.155 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.149+0000 7f78b9600640 1 -- 172.21.15.114:0/928734359 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b404ef60 con 0x7f78b40ac670 2024-02-17T12:16:09.155 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.149+0000 7f78aaa00640 1 -- 172.21.15.114:0/928734359 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 86353+0+0 (secure 0 0 0) 0x7f78a4011790 con 0x7f78b40ac670 2024-02-17T12:16:09.157 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.149+0000 7f78aaa00640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7894066e30 0x7f78940692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:09.157 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.149+0000 7f78aaa00640 1 -- 172.21.15.114:0/928734359 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3071+0+0 (secure 0 0 0) 0x7f78a4083b80 con 0x7f78b40ac670 2024-02-17T12:16:09.157 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-02-17T12:16:09.153+0000 7f9d54000640 -1 osd.3 0 waiting for initial osdmap 2024-02-17T12:16:09.157 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.153+0000 7f78b2000640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7894066e30 0x7f78940692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:09.158 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.153+0000 7f78b2000640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7894066e30 0x7f78940692f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f78b40c4c70 tx=0x7f78a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:09.158 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-02-17T12:16:09.153+0000 7f658ce00640 -1 osd.1 0 waiting for initial osdmap 2024-02-17T12:16:09.161 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.157+0000 7f78aaa00640 1 -- 172.21.15.114:0/928734359 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f78a4051510 con 0x7f78b40ac670 2024-02-17T12:16:09.183 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-02-17T12:16:09.177+0000 7f6583800640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:16:09.186 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-02-17T12:16:09.181+0000 7f9d48c00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:16:09.206 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-02-17T12:16:09.201+0000 7fdabbc00640 -1 osd.0 0 waiting for initial osdmap 2024-02-17T12:16:09.234 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-02-17T12:16:09.229+0000 7fdab2600640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T12:16:09.336 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.329+0000 7f78b9600640 1 -- 172.21.15.114:0/928734359 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78b40ac1a0 con 0x7f78b40ac670 2024-02-17T12:16:09.337 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.329+0000 7f78aaa00640 1 -- 172.21.15.114:0/928734359 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8515 (secure 0 0 0) 0x7f78a4015070 con 0x7f78b40ac670 2024-02-17T12:16:09.337 INFO:teuthology.misc.health.smithi114.stdout: 2024-02-17T12:16:09.337 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":14,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:08.407875+0000","last_up_change":"2024-02-17T12:16:08.407875+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:09.339 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 -- 172.21.15.114:0/928734359 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7894066e30 msgr2=0x7f78940692f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:09.339 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7894066e30 0x7f78940692f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f78b40c4c70 tx=0x7f78a0009040 comp rx=0 tx=0).stop 2024-02-17T12:16:09.339 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 -- 172.21.15.114:0/928734359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 msgr2=0x7f78b4148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:09.340 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 0x7f78b4148050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78a400b410 tx=0x7f78a400b8d0 comp rx=0 tx=0).stop 2024-02-17T12:16:09.340 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 -- 172.21.15.114:0/928734359 shutdown_connections 2024-02-17T12:16:09.340 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7894066e30 0x7f78940692f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:09.340 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78b4150320 0x7f78b41e1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:09.340 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f78b40c1f80 0x7f78b40c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:09.341 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 --2- 172.21.15.114:0/928734359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78b40ac670 0x7f78b4148050 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:09.341 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 -- 172.21.15.114:0/928734359 >> 172.21.15.114:0/928734359 conn(0x7f78b4071720 msgr2=0x7f78b40c1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:09.341 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 -- 172.21.15.114:0/928734359 shutdown_connections 2024-02-17T12:16:09.341 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:09.333+0000 7f78b9600640 1 -- 172.21.15.114:0/928734359 wait complete. 2024-02-17T12:16:09.355 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-02-17T12:16:11.765 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:16:11.769 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:16:16.161 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:16.296 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.293+0000 7f9a67e00640 1 Processor -- start 2024-02-17T12:16:16.296 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.293+0000 7f9a67e00640 1 -- start start 2024-02-17T12:16:16.297 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a67e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a6814f360 0x7f9a681519a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.298 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a67e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a68072ad0 con 0x7f9a680c2340 2024-02-17T12:16:16.298 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a67e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a68152940 con 0x7f9a680c30a0 2024-02-17T12:16:16.298 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a67e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a681520a0 con 0x7f9a6814f360 2024-02-17T12:16:16.298 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a67400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9a680c2340 0x7f9a680c1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58844/0 (socket says 172.21.15.114:58844) 2024-02-17T12:16:16.298 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a67400640 1 -- 172.21.15.114:0/451230140 learned_addr learned my addr 172.21.15.114:0/451230140 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:16.298 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a66000640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a6814f360 0x7f9a681519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.300 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795709073 0 0) 0x7f9a68072ad0 con 0x7f9a680c2340 2024-02-17T12:16:16.300 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a4c005740 con 0x7f9a680c2340 2024-02-17T12:16:16.300 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655687024 0 0) 0x7f9a68152940 con 0x7f9a680c30a0 2024-02-17T12:16:16.300 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a68072ad0 con 0x7f9a680c30a0 2024-02-17T12:16:16.300 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 893449296 0 0) 0x7f9a4c005740 con 0x7f9a680c2340 2024-02-17T12:16:16.300 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a6814f360 msgr2=0x7f9a681519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:16.300 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a6814f360 0x7f9a681519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.300 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 >> v1:172.21.15.116:6789/0 conn(0x7f9a680c30a0 legacy=0x7f9a6814ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.300 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68152380 con 0x7f9a680c2340 2024-02-17T12:16:16.300 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f9a60001a00 con 0x7f9a680c2340 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 >> v1:172.21.15.114:6789/0 conn(0x7f9a680c2340 legacy=0x7f9a680c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a4c005d50 0x7f9a4c006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a6814f360 0x7f9a4c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c006f20 0x7f9a4c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a681520a0 con 0x7f9a4c006f20 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c00dd30 con 0x7f9a4c005d50 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c00dec0 con 0x7f9a6814f360 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a66a00640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a4c005d50 0x7f9a4c006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a67400640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c006f20 0x7f9a4c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a66000640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a6814f360 0x7f9a4c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a66a00640 1 -- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a6814f360 msgr2=0x7f9a4c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a66a00640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a6814f360 0x7f9a4c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.301 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a66a00640 1 -- 172.21.15.114:0/451230140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c006f20 msgr2=0x7f9a4c0073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:16.302 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a66a00640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c006f20 0x7f9a4c0073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.302 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.297+0000 7f9a66a00640 1 -- 172.21.15.114:0/451230140 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c005740 con 0x7f9a4c005d50 2024-02-17T12:16:16.302 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a66a00640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a4c005d50 0x7f9a4c006150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a500018d0 tx=0x7f9a5001ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1b6606d1213602b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:16.303 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500052d0 con 0x7f9a4c005d50 2024-02-17T12:16:16.303 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a50005450 con 0x7f9a4c005d50 2024-02-17T12:16:16.303 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a65600640 1 -- 172.21.15.114:0/451230140 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500a8950 con 0x7f9a4c005d50 2024-02-17T12:16:16.303 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a67e00640 1 -- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a4c005d50 msgr2=0x7f9a4c006150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.304 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a67e00640 1 --2- 172.21.15.114:0/451230140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a4c005d50 0x7f9a4c006150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a500018d0 tx=0x7f9a5001ecf0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.304 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a67400640 1 -- 172.21.15.114:0/451230140 reap_dead start 2024-02-17T12:16:16.304 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a67e00640 1 -- 172.21.15.114:0/451230140 shutdown_connections 2024-02-17T12:16:16.304 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a67e00640 1 -- 172.21.15.114:0/451230140 >> 172.21.15.114:0/451230140 conn(0x7f9a6806ac10 msgr2=0x7f9a6806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:16.304 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a67e00640 1 -- 172.21.15.114:0/451230140 shutdown_connections 2024-02-17T12:16:16.304 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a67e00640 1 -- 172.21.15.114:0/451230140 wait complete. 2024-02-17T12:16:16.305 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a67e00640 1 Processor -- start 2024-02-17T12:16:16.305 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.301+0000 7f9a67e00640 1 -- start start 2024-02-17T12:16:16.306 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a67e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c005d50 0x7f9a680aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a67e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a681eb430 0x7f9a681e7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a67e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a681e7770 0x7f9a681ea250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a67e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680aaf10 con 0x7f9a4c005d50 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a67e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68153230 con 0x7f9a681eb430 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a67e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a681e7c20 con 0x7f9a681e7770 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c005d50 0x7f9a680aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c005d50 0x7f9a680aa9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59842/0 (socket says 172.21.15.114:59842) 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66a00640 1 -- 172.21.15.114:0/3881789958 learned_addr learned my addr 172.21.15.114:0/3881789958 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66000640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a681eb430 0x7f9a681e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a67400640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a681e7770 0x7f9a681ea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66a00640 1 -- 172.21.15.114:0/3881789958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a681e7770 msgr2=0x7f9a681ea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66a00640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a681e7770 0x7f9a681ea250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66a00640 1 -- 172.21.15.114:0/3881789958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a681eb430 msgr2=0x7f9a681e7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.307 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66a00640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a681eb430 0x7f9a681e7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.308 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66a00640 1 -- 172.21.15.114:0/3881789958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a680ac000 con 0x7f9a4c005d50 2024-02-17T12:16:16.308 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66000640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a681eb430 0x7f9a681e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:16.308 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a66a00640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c005d50 0x7f9a680aa9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a500019c0 tx=0x7f9a4c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:16.309 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a5ea00640 1 -- 172.21.15.114:0/3881789958 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50000bf0 con 0x7f9a4c005d50 2024-02-17T12:16:16.309 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a5ea00640 1 -- 172.21.15.114:0/3881789958 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a500050d0 con 0x7f9a4c005d50 2024-02-17T12:16:16.309 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a5ea00640 1 -- 172.21.15.114:0/3881789958 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500067e0 con 0x7f9a4c005d50 2024-02-17T12:16:16.309 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a67e00640 1 -- 172.21.15.114:0/3881789958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a680ac2e0 con 0x7f9a4c005d50 2024-02-17T12:16:16.309 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a67e00640 1 -- 172.21.15.114:0/3881789958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a680aa1f0 con 0x7f9a4c005d50 2024-02-17T12:16:16.309 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a67e00640 1 -- 172.21.15.114:0/3881789958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6806bba0 con 0x7f9a4c005d50 2024-02-17T12:16:16.309 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.305+0000 7f9a5ea00640 1 -- 172.21.15.114:0/3881789958 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9a50006940 con 0x7f9a4c005d50 2024-02-17T12:16:16.310 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.309+0000 7f9a5ea00640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9a44066e70 0x7f9a44069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.310 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.309+0000 7f9a5ea00640 1 -- 172.21.15.114:0/3881789958 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a501216d0 con 0x7f9a4c005d50 2024-02-17T12:16:16.310 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.309+0000 7f9a66000640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9a44066e70 0x7f9a44069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.310 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.309+0000 7f9a66000640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9a44066e70 0x7f9a44069330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a6814b440 tx=0x7f9a58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:16.314 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.313+0000 7f9a5ea00640 1 -- 172.21.15.114:0/3881789958 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9a500ee890 con 0x7f9a4c005d50 2024-02-17T12:16:16.468 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.465+0000 7f9a67e00640 1 -- 172.21.15.114:0/3881789958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a6804eef0 con 0x7f9a4c005d50 2024-02-17T12:16:16.469 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.465+0000 7f9a5ea00640 1 -- 172.21.15.114:0/3881789958 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12896 (secure 0 0 0) 0x7f9a500f1f50 con 0x7f9a4c005d50 2024-02-17T12:16:16.469 INFO:teuthology.misc.health.smithi114.stdout: 2024-02-17T12:16:16.469 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":17,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:11.750837+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:16.471 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 -- 172.21.15.114:0/3881789958 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9a44066e70 msgr2=0x7f9a44069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.471 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9a44066e70 0x7f9a44069330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a6814b440 tx=0x7f9a58008040 comp rx=0 tx=0).stop 2024-02-17T12:16:16.471 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 -- 172.21.15.114:0/3881789958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c005d50 msgr2=0x7f9a680aa9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.471 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c005d50 0x7f9a680aa9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a500019c0 tx=0x7f9a4c007a10 comp rx=0 tx=0).stop 2024-02-17T12:16:16.471 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 -- 172.21.15.114:0/3881789958 shutdown_connections 2024-02-17T12:16:16.471 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a681e7770 0x7f9a681ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.472 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a681eb430 0x7f9a681e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.472 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9a44066e70 0x7f9a44069330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.472 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 --2- 172.21.15.114:0/3881789958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c005d50 0x7f9a680aa9d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.472 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 -- 172.21.15.114:0/3881789958 >> 172.21.15.114:0/3881789958 conn(0x7f9a6806ac10 msgr2=0x7f9a6814d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:16.472 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 -- 172.21.15.114:0/3881789958 shutdown_connections 2024-02-17T12:16:16.472 INFO:teuthology.misc.health.smithi114.stderr:2024-02-17T12:16:16.469+0000 7f9a67e00640 1 -- 172.21.15.114:0/3881789958 wait complete. 2024-02-17T12:16:16.488 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-17T12:16:16.488 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-17T12:16:16.488 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-17T12:16:16.488 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-17T12:16:16.491 INFO:tasks.ceph.mds.a:Started 2024-02-17T12:16:16.492 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-17T12:16:16.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-17T12:16:16.494 INFO:tasks.ceph.mds.c:Started 2024-02-17T12:16:16.495 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-17T12:16:16.495 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-17T12:16:16.498 INFO:tasks.ceph.mds.b:Started 2024-02-17T12:16:16.498 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-17T12:16:16.498 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-17T12:16:16.501 INFO:tasks.ceph.mds.d:Started 2024-02-17T12:16:16.502 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-17T12:16:16.502 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:16.593 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-02-17T12:16:16.594 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-02-17T12:16:16.617 INFO:tasks.ceph.mds.d.smithi116.stdout:starting mds.d at 2024-02-17T12:16:16.617 INFO:tasks.ceph.mds.b.smithi116.stdout:starting mds.b at 2024-02-17T12:16:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.641+0000 7fb232800640 1 Processor -- start 2024-02-17T12:16:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.641+0000 7fb232800640 1 -- start start 2024-02-17T12:16:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb232800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb22c0c1eb0 0x7fb22c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb232800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c0a9420 con 0x7fb22c0c2580 2024-02-17T12:16:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb232800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c152850 con 0x7fb22c14f110 2024-02-17T12:16:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb232800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22c14f4f0 con 0x7fb22c0c1eb0 2024-02-17T12:16:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22b400640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb22c14f110 0x7fb22c0c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:58656/0 (socket says 172.21.15.114:58656) 2024-02-17T12:16:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb22c0c1eb0 0x7fb22c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22b400640 1 -- 172.21.15.114:0/671948479 learned_addr learned my addr 172.21.15.114:0/671948479 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22aa00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb22c0c2580 0x7fb22c0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58858/0 (socket says 172.21.15.114:58858) 2024-02-17T12:16:16.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22be00640 1 -- 172.21.15.114:0/671948479 >> v1:172.21.15.116:6789/0 conn(0x7fb22c14f110 legacy=0x7fb22c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22be00640 1 -- 172.21.15.114:0/671948479 >> v1:172.21.15.114:6789/0 conn(0x7fb22c0c2580 legacy=0x7fb22c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22a000640 1 -- 172.21.15.114:0/671948479 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714129582 0 0) 0x7fb22c152850 con 0x7fb22c14f110 2024-02-17T12:16:16.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22be00640 1 -- 172.21.15.114:0/671948479 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c0a9670 con 0x7fb22c0c1eb0 2024-02-17T12:16:16.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22be00640 1 --2- 172.21.15.114:0/671948479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb22c0c1eb0 0x7fb22c15d3a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb224009d90 tx=0x7fb22401c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b5c8416005c168 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:16.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22a000640 1 -- 172.21.15.114:0/671948479 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240a8610 con 0x7fb22c0c1eb0 2024-02-17T12:16:16.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22a000640 1 -- 172.21.15.114:0/671948479 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2240a8770 con 0x7fb22c0c1eb0 2024-02-17T12:16:16.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.645+0000 7fb22a000640 1 -- 172.21.15.114:0/671948479 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240a8b00 con 0x7fb22c0c1eb0 2024-02-17T12:16:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 -- 172.21.15.114:0/671948479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb22c0c1eb0 msgr2=0x7fb22c15d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 --2- 172.21.15.114:0/671948479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb22c0c1eb0 0x7fb22c15d3a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb224009d90 tx=0x7fb22401c770 comp rx=0 tx=0).stop 2024-02-17T12:16:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 -- 172.21.15.114:0/671948479 shutdown_connections 2024-02-17T12:16:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 --2- 172.21.15.114:0/671948479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb22c0c1eb0 0x7fb22c15d3a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 -- 172.21.15.114:0/671948479 >> 172.21.15.114:0/671948479 conn(0x7fb22c0a8490 msgr2=0x7fb22c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 -- 172.21.15.114:0/671948479 shutdown_connections 2024-02-17T12:16:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 -- 172.21.15.114:0/671948479 wait complete. 2024-02-17T12:16:16.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 Processor -- start 2024-02-17T12:16:16.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 -- start start 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb22c0c1eb0 0x7fb22c0c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb22c0c2580 0x7fb22c13e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb22c14f110 0x7fb22c14b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c14d0c0 con 0x7fb22c14f110 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0c60b0 con 0x7fb22c0c1eb0 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb232800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0c5af0 con 0x7fb22c0c2580 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22b400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb22c0c1eb0 0x7fb22c0c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb22c14f110 0x7fb22c14b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22b400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb22c0c1eb0 0x7fb22c0c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:60770/0 (socket says 172.21.15.114:60770) 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22b400640 1 -- 172.21.15.114:0/3139721756 learned_addr learned my addr 172.21.15.114:0/3139721756 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22aa00640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb22c0c2580 0x7fb22c13e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22be00640 1 -- 172.21.15.114:0/3139721756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb22c0c2580 msgr2=0x7fb22c13e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22be00640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb22c0c2580 0x7fb22c13e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22be00640 1 -- 172.21.15.114:0/3139721756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb22c0c1eb0 msgr2=0x7fb22c0c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22be00640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb22c0c1eb0 0x7fb22c0c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22be00640 1 -- 172.21.15.114:0/3139721756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224009a70 con 0x7fb22c14f110 2024-02-17T12:16:16.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.649+0000 7fb22aa00640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb22c0c2580 0x7fb22c13e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:16.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb22be00640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb22c14f110 0x7fb22c14b740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb2240ac000 tx=0x7fb224019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:16.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb223400640 1 -- 172.21.15.114:0/3139721756 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240b6070 con 0x7fb22c14f110 2024-02-17T12:16:16.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb223400640 1 -- 172.21.15.114:0/3139721756 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2240a85d0 con 0x7fb22c14f110 2024-02-17T12:16:16.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb232800640 1 -- 172.21.15.114:0/3139721756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c0c5dd0 con 0x7fb22c14f110 2024-02-17T12:16:16.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb223400640 1 -- 172.21.15.114:0/3139721756 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224003ba0 con 0x7fb22c14f110 2024-02-17T12:16:16.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb232800640 1 -- 172.21.15.114:0/3139721756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c14b220 con 0x7fb22c14f110 2024-02-17T12:16:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb232800640 1 -- 172.21.15.114:0/3139721756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c14b410 con 0x7fb22c14f110 2024-02-17T12:16:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb223400640 1 -- 172.21.15.114:0/3139721756 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb2240a6040 con 0x7fb22c14f110 2024-02-17T12:16:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb223400640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb20c066e70 0x7fb20c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb223400640 1 -- 172.21.15.114:0/3139721756 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb22411e670 con 0x7fb22c14f110 2024-02-17T12:16:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.653+0000 7fb22b400640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb20c066e70 0x7fb20c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.657+0000 7fb22b400640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb20c066e70 0x7fb20c069330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb21c007b20 tx=0x7fb21c007a70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:16.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.657+0000 7fb223400640 1 -- 172.21.15.114:0/3139721756 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb2240ef390 con 0x7fb22c14f110 2024-02-17T12:16:16.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.812+0000 7fb232800640 1 -- 172.21.15.114:0/3139721756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb22c074840 con 0x7fb22c14f110 2024-02-17T12:16:16.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.812+0000 7fb223400640 1 -- 172.21.15.114:0/3139721756 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12896 (secure 0 0 0) 0x7fb2240eef20 con 0x7fb22c14f110 2024-02-17T12:16:16.816 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:16.816 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:11.750837+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:16.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 -- 172.21.15.114:0/3139721756 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb20c066e70 msgr2=0x7fb20c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb20c066e70 0x7fb20c069330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb21c007b20 tx=0x7fb21c007a70 comp rx=0 tx=0).stop 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 -- 172.21.15.114:0/3139721756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb22c14f110 msgr2=0x7fb22c14b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb22c14f110 0x7fb22c14b740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb2240ac000 tx=0x7fb224019510 comp rx=0 tx=0).stop 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 -- 172.21.15.114:0/3139721756 shutdown_connections 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb20c066e70 0x7fb20c069330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb22c14f110 0x7fb22c14b740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb22c0c2580 0x7fb22c13e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 --2- 172.21.15.114:0/3139721756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb22c0c1eb0 0x7fb22c0c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 -- 172.21.15.114:0/3139721756 >> 172.21.15.114:0/3139721756 conn(0x7fb22c0a8490 msgr2=0x7fb22c0aa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 -- 172.21.15.114:0/3139721756 shutdown_connections 2024-02-17T12:16:16.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.816+0000 7fb232800640 1 -- 172.21.15.114:0/3139721756 wait complete. 2024-02-17T12:16:16.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:16.838 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:16.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25fe000640 1 Processor -- start 2024-02-17T12:16:16.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25fe000640 1 -- start start 2024-02-17T12:16:16.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25fe000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f8150300 0x7f25f8156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25fe000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f25f80714c0 0x7f25f80aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25fe000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25f80aa6a0 0x7f25f8152d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25fe000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f80c6900 con 0x7f25f80aa6a0 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25fe000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f8157270 con 0x7f25f80714c0 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25fe000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f80c3580 con 0x7f25f8150300 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25f7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25f80aa6a0 0x7f25f8152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25f7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25f80aa6a0 0x7f25f8152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59910/0 (socket says 172.21.15.114:59910) 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25f7e00640 1 -- 172.21.15.114:0/28941633 learned_addr learned my addr 172.21.15.114:0/28941633 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25f6a00640 1 --2- 172.21.15.114:0/28941633 >> v2:172.21.15.116:3300/0 conn(0x7f25f80714c0 0x7f25f80aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25f7400640 1 --2- 172.21.15.114:0/28941633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f8150300 0x7f25f8156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25f7e00640 1 -- 172.21.15.114:0/28941633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f8150300 msgr2=0x7f25f8156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25f7e00640 1 --2- 172.21.15.114:0/28941633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f8150300 0x7f25f8156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25f7e00640 1 -- 172.21.15.114:0/28941633 >> v2:172.21.15.116:3300/0 conn(0x7f25f80714c0 msgr2=0x7f25f80aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:16.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25f7e00640 1 --2- 172.21.15.114:0/28941633 >> v2:172.21.15.116:3300/0 conn(0x7f25f80714c0 0x7f25f80aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.972+0000 7f25f7e00640 1 -- 172.21.15.114:0/28941633 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f80c2fc0 con 0x7f25f80aa6a0 2024-02-17T12:16:16.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25f7e00640 1 --2- 172.21.15.114:0/28941633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 0x7f25f8152d30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f25f8071af0 tx=0x7f25f001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6d0b42584b193e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:16.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25f6000640 1 -- 172.21.15.114:0/28941633 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f00ab600 con 0x7f25f80aa6a0 2024-02-17T12:16:16.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25f6000640 1 -- 172.21.15.114:0/28941633 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f00a7050 con 0x7f25f80aa6a0 2024-02-17T12:16:16.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25f6000640 1 -- 172.21.15.114:0/28941633 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f00ab980 con 0x7f25f80aa6a0 2024-02-17T12:16:16.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25fe000640 1 -- 172.21.15.114:0/28941633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 msgr2=0x7f25f8152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25fe000640 1 --2- 172.21.15.114:0/28941633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 0x7f25f8152d30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f25f8071af0 tx=0x7f25f001c490 comp rx=0 tx=0).stop 2024-02-17T12:16:16.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25fe000640 1 -- 172.21.15.114:0/28941633 shutdown_connections 2024-02-17T12:16:16.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25fe000640 1 --2- 172.21.15.114:0/28941633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 0x7f25f8152d30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25fe000640 1 --2- 172.21.15.114:0/28941633 >> v2:172.21.15.116:3300/0 conn(0x7f25f80714c0 0x7f25f80aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25fe000640 1 --2- 172.21.15.114:0/28941633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f8150300 0x7f25f8156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25fe000640 1 -- 172.21.15.114:0/28941633 >> 172.21.15.114:0/28941633 conn(0x7f25f80c4f20 msgr2=0x7f25f80c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:16.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25fe000640 1 -- 172.21.15.114:0/28941633 shutdown_connections 2024-02-17T12:16:16.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.976+0000 7f25fe000640 1 -- 172.21.15.114:0/28941633 wait complete. 2024-02-17T12:16:16.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25fe000640 1 Processor -- start 2024-02-17T12:16:16.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25fe000640 1 -- start start 2024-02-17T12:16:16.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25fe000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f80714c0 0x7f25f814e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25fe000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 0x7f25f806c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25fe000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f8150300 0x7f25f806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25fe000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f806bd20 con 0x7f25f80aa6a0 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25fe000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f81ee110 con 0x7f25f80714c0 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25fe000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f806d1f0 con 0x7f25f8150300 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 0x7f25f806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 0x7f25f806c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59916/0 (socket says 172.21.15.114:59916) 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f6a00640 1 -- 172.21.15.114:0/2469152638 learned_addr learned my addr 172.21.15.114:0/2469152638 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f7400640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f80714c0 0x7f25f814e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f7e00640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f8150300 0x7f25f806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f6a00640 1 -- 172.21.15.114:0/2469152638 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f8150300 msgr2=0x7f25f806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f6a00640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f8150300 0x7f25f806ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f6a00640 1 -- 172.21.15.114:0/2469152638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f80714c0 msgr2=0x7f25f814e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f6a00640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f80714c0 0x7f25f814e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:16.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f6a00640 1 -- 172.21.15.114:0/2469152638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f00094d0 con 0x7f25f80aa6a0 2024-02-17T12:16:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25f6a00640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 0x7f25f806c770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f25e000d830 tx=0x7f25e000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25ef400640 1 -- 172.21.15.114:0/2469152638 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e00096a0 con 0x7f25f80aa6a0 2024-02-17T12:16:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25ef400640 1 -- 172.21.15.114:0/2469152638 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e0009800 con 0x7f25f80aa6a0 2024-02-17T12:16:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25ef400640 1 -- 172.21.15.114:0/2469152638 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0009b70 con 0x7f25f80aa6a0 2024-02-17T12:16:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25fe000640 1 -- 172.21.15.114:0/2469152638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f81ee370 con 0x7f25f80aa6a0 2024-02-17T12:16:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.980+0000 7f25fe000640 1 -- 172.21.15.114:0/2469152638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f806bf70 con 0x7f25f80aa6a0 2024-02-17T12:16:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.984+0000 7f25fe000640 1 -- 172.21.15.114:0/2469152638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f8074840 con 0x7f25f80aa6a0 2024-02-17T12:16:16.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.984+0000 7f25ef400640 1 -- 172.21.15.114:0/2469152638 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f25e0014410 con 0x7f25f80aa6a0 2024-02-17T12:16:16.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.984+0000 7f25ef400640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25d4066e40 0x7f25d4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:16.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.984+0000 7f25ef400640 1 -- 172.21.15.114:0/2469152638 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f25e0084f20 con 0x7f25f80aa6a0 2024-02-17T12:16:16.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.984+0000 7f25f7400640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25d4066e40 0x7f25d4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:16.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.984+0000 7f25f7400640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25d4066e40 0x7f25d4069300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25f814efe0 tx=0x7f25e8009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:16.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:16.988+0000 7f25ef400640 1 -- 172.21.15.114:0/2469152638 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f25e0052100 con 0x7f25f80aa6a0 2024-02-17T12:16:17.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.140+0000 7f25fe000640 1 -- 172.21.15.114:0/2469152638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25f80712a0 con 0x7f25f80aa6a0 2024-02-17T12:16:17.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.140+0000 7f25ef400640 1 -- 172.21.15.114:0/2469152638 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25e00557c0 con 0x7f25f80aa6a0 2024-02-17T12:16:17.145 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:17.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 -- 172.21.15.114:0/2469152638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25d4066e40 msgr2=0x7f25d4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:17.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25d4066e40 0x7f25d4069300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25f814efe0 tx=0x7f25e8009830 comp rx=0 tx=0).stop 2024-02-17T12:16:17.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 -- 172.21.15.114:0/2469152638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 msgr2=0x7f25f806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:17.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 0x7f25f806c770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f25e000d830 tx=0x7f25e000dcf0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 -- 172.21.15.114:0/2469152638 shutdown_connections 2024-02-17T12:16:17.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f8150300 0x7f25f806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25d4066e40 0x7f25d4069300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f80aa6a0 0x7f25f806c770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 --2- 172.21.15.114:0/2469152638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f80714c0 0x7f25f814e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 -- 172.21.15.114:0/2469152638 >> 172.21.15.114:0/2469152638 conn(0x7f25f80c4f20 msgr2=0x7f25f8156130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:17.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 -- 172.21.15.114:0/2469152638 shutdown_connections 2024-02-17T12:16:17.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.144+0000 7f25fe000640 1 -- 172.21.15.114:0/2469152638 wait complete. 2024-02-17T12:16:17.166 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:16:17.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325f600640 1 Processor -- start 2024-02-17T12:16:17.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325f600640 1 -- start start 2024-02-17T12:16:17.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325f600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3258150300 0x7f3258156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:17.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325f600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32580714c0 0x7f32580aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325f600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3258157270 con 0x7f32580aa6a0 2024-02-17T12:16:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325f600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32580c6900 con 0x7f3258150300 2024-02-17T12:16:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325f600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32580c3580 con 0x7f32580714c0 2024-02-17T12:16:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325cc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3258150300 0x7f3258156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325d600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f32580aa6a0 0x7f3258152d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58866/0 (socket says 172.21.15.114:58866) 2024-02-17T12:16:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325d600640 1 -- 172.21.15.114:0/2324653811 learned_addr learned my addr 172.21.15.114:0/2324653811 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:17.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f3257e00640 1 --2- 172.21.15.114:0/2324653811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32580714c0 0x7f32580aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:17.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325cc00640 1 -- 172.21.15.114:0/2324653811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32580714c0 msgr2=0x7f32580aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:17.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325cc00640 1 --2- 172.21.15.114:0/2324653811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32580714c0 0x7f32580aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325cc00640 1 -- 172.21.15.114:0/2324653811 >> v1:172.21.15.114:6789/0 conn(0x7f32580aa6a0 legacy=0x7f3258152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:17.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f325cc00640 1 -- 172.21.15.114:0/2324653811 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32580c2fc0 con 0x7f3258150300 2024-02-17T12:16:17.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.300+0000 7f3257400640 1 -- 172.21.15.114:0/2324653811 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346497592 0 0) 0x7f3258157270 con 0x7f32580aa6a0 2024-02-17T12:16:17.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325cc00640 1 --2- 172.21.15.114:0/2324653811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3258150300 0x7f3258156d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3248009d90 tx=0x7f324801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47348256f3e181c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:17.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f3257400640 1 -- 172.21.15.114:0/2324653811 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32480a5890 con 0x7f3258150300 2024-02-17T12:16:17.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f3257400640 1 -- 172.21.15.114:0/2324653811 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32480a59f0 con 0x7f3258150300 2024-02-17T12:16:17.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f3257400640 1 -- 172.21.15.114:0/2324653811 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32480a5d80 con 0x7f3258150300 2024-02-17T12:16:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325f600640 1 -- 172.21.15.114:0/2324653811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3258150300 msgr2=0x7f3258156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325f600640 1 --2- 172.21.15.114:0/2324653811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3258150300 0x7f3258156d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3248009d90 tx=0x7f324801c8e0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325f600640 1 -- 172.21.15.114:0/2324653811 shutdown_connections 2024-02-17T12:16:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325f600640 1 --2- 172.21.15.114:0/2324653811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f32580714c0 0x7f32580aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325f600640 1 --2- 172.21.15.114:0/2324653811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3258150300 0x7f3258156d30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325f600640 1 -- 172.21.15.114:0/2324653811 >> 172.21.15.114:0/2324653811 conn(0x7f32580c4f20 msgr2=0x7f32580c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325f600640 1 -- 172.21.15.114:0/2324653811 shutdown_connections 2024-02-17T12:16:17.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325f600640 1 -- 172.21.15.114:0/2324653811 wait complete. 2024-02-17T12:16:17.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325f600640 1 Processor -- start 2024-02-17T12:16:17.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.304+0000 7f325f600640 1 -- start start 2024-02-17T12:16:17.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325f600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32580714c0 0x7f3258148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:17.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32580aa6a0 0x7f32581540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:17.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325f600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258150300 0x7f3258154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32580c7d20 con 0x7f32580aa6a0 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325f600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3258154b60 con 0x7f32580714c0 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325f600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32580c90b0 con 0x7f3258150300 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3257e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32580aa6a0 0x7f32581540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3257e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32580aa6a0 0x7f32581540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59930/0 (socket says 172.21.15.114:59930) 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3257e00640 1 -- 172.21.15.114:0/3499405217 learned_addr learned my addr 172.21.15.114:0/3499405217 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325cc00640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32580714c0 0x7f3258148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325d600640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258150300 0x7f3258154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3257e00640 1 -- 172.21.15.114:0/3499405217 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258150300 msgr2=0x7f3258154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3257e00640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258150300 0x7f3258154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3257e00640 1 -- 172.21.15.114:0/3499405217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32580714c0 msgr2=0x7f3258148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3257e00640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32580714c0 0x7f3258148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3257e00640 1 -- 172.21.15.114:0/3499405217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248009a70 con 0x7f32580aa6a0 2024-02-17T12:16:17.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325cc00640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32580714c0 0x7f3258148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:17.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3257e00640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32580aa6a0 0x7f32581540e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f324000e930 tx=0x7f324000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:17.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3254c00640 1 -- 172.21.15.114:0/3499405217 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240009690 con 0x7f32580aa6a0 2024-02-17T12:16:17.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3254c00640 1 -- 172.21.15.114:0/3499405217 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324000ca00 con 0x7f32580aa6a0 2024-02-17T12:16:17.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3254c00640 1 -- 172.21.15.114:0/3499405217 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324000cd70 con 0x7f32580aa6a0 2024-02-17T12:16:17.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325f600640 1 -- 172.21.15.114:0/3499405217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32580c8010 con 0x7f32580aa6a0 2024-02-17T12:16:17.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325f600640 1 -- 172.21.15.114:0/3499405217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32580c85d0 con 0x7f32580aa6a0 2024-02-17T12:16:17.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f325f600640 1 -- 172.21.15.114:0/3499405217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3258074840 con 0x7f32580aa6a0 2024-02-17T12:16:17.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.308+0000 7f3254c00640 1 -- 172.21.15.114:0/3499405217 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3240013470 con 0x7f32580aa6a0 2024-02-17T12:16:17.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.312+0000 7f3254c00640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066e70 0x7f3234069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:17.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.312+0000 7f3254c00640 1 -- 172.21.15.114:0/3499405217 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3240084d90 con 0x7f32580aa6a0 2024-02-17T12:16:17.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.312+0000 7f325cc00640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066e70 0x7f3234069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:17.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.312+0000 7f325cc00640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066e70 0x7f3234069330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f32480af000 tx=0x7f32480a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:17.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.316+0000 7f3254c00640 1 -- 172.21.15.114:0/3499405217 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3240051ef0 con 0x7f32580aa6a0 2024-02-17T12:16:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.500+0000 7f325f600640 1 -- 172.21.15.114:0/3499405217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32580712a0 con 0x7f32580aa6a0 2024-02-17T12:16:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.500+0000 7f3254c00640 1 -- 172.21.15.114:0/3499405217 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f3240017540 con 0x7f32580aa6a0 2024-02-17T12:16:17.504 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:17.505 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/178899564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":178899564},{"type":"v1","addr":"172.21.15.114:6836","nonce":178899564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-17T12:16:17.505 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 2 2024-02-17T12:16:17.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 -- 172.21.15.114:0/3499405217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066e70 msgr2=0x7f3234069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:17.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066e70 0x7f3234069330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f32480af000 tx=0x7f32480a7070 comp rx=0 tx=0).stop 2024-02-17T12:16:17.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 -- 172.21.15.114:0/3499405217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32580aa6a0 msgr2=0x7f32581540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:17.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32580aa6a0 0x7f32581540e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f324000e930 tx=0x7f324000edf0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 -- 172.21.15.114:0/3499405217 shutdown_connections 2024-02-17T12:16:17.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258150300 0x7f3258154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066e70 0x7f3234069330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32580aa6a0 0x7f32581540e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 --2- 172.21.15.114:0/3499405217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32580714c0 0x7f3258148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:17.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 -- 172.21.15.114:0/3499405217 >> 172.21.15.114:0/3499405217 conn(0x7f32580c4f20 msgr2=0x7f3258149d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:17.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 -- 172.21.15.114:0/3499405217 shutdown_connections 2024-02-17T12:16:17.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:17.504+0000 7f325f600640 1 -- 172.21.15.114:0/3499405217 wait complete. 2024-02-17T12:16:19.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:16:19.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.668+0000 7f2854c00640 1 Processor -- start 2024-02-17T12:16:19.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.668+0000 7f2854c00640 1 -- start start 2024-02-17T12:16:19.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.668+0000 7f2854c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f285006db50 0x7f285014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:19.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.668+0000 7f2854c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2850156270 con 0x7f28500c25a0 2024-02-17T12:16:19.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.668+0000 7f2854c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2850156550 con 0x7f2850150490 2024-02-17T12:16:19.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.668+0000 7f2854c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285006f090 con 0x7f285006db50 2024-02-17T12:16:19.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284de00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f28500c25a0 0x7f285006e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58872/0 (socket says 172.21.15.114:58872) 2024-02-17T12:16:19.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284de00640 1 -- 172.21.15.114:0/58877355 learned_addr learned my addr 172.21.15.114:0/58877355 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:19.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284d400640 1 --2- 172.21.15.114:0/58877355 >> v2:172.21.15.116:3300/0 conn(0x7f285006db50 0x7f285014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:19.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569518386 0 0) 0x7f2850156270 con 0x7f28500c25a0 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2834003530 con 0x7f28500c25a0 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1903629457 0 0) 0x7f2834003530 con 0x7f28500c25a0 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 >> v2:172.21.15.116:3300/0 conn(0x7f285006db50 msgr2=0x7f285014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 --2- 172.21.15.114:0/58877355 >> v2:172.21.15.116:3300/0 conn(0x7f285006db50 0x7f285014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 >> v1:172.21.15.116:6789/0 conn(0x7f2850150490 legacy=0x7f2850152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2850156830 con 0x7f28500c25a0 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f2840001a00 con 0x7f28500c25a0 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284d400640 1 --2- 172.21.15.114:0/58877355 >> v2:172.21.15.116:3300/0 conn(0x7f285006db50 0x7f285014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 >> v1:172.21.15.114:6789/0 conn(0x7f28500c25a0 legacy=0x7f285006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834003980 0x7f2834003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:19.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28340047d0 0x7f2834004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:19.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2834005190 0x7f283400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:19.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285006f090 con 0x7f28340047d0 2024-02-17T12:16:19.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283400c0e0 con 0x7f2834005190 2024-02-17T12:16:19.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283400c2a0 con 0x7f2834003980 2024-02-17T12:16:19.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284d400640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28340047d0 0x7f2834004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:19.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284de00640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834003980 0x7f2834003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:19.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284e800640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2834005190 0x7f283400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:19.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284d400640 1 -- 172.21.15.114:0/58877355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834003980 msgr2=0x7f2834003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:19.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284d400640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834003980 0x7f2834003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284d400640 1 -- 172.21.15.114:0/58877355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2834005190 msgr2=0x7f283400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:19.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284d400640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2834005190 0x7f283400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284d400640 1 -- 172.21.15.114:0/58877355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834003530 con 0x7f28340047d0 2024-02-17T12:16:19.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284de00640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834003980 0x7f2834003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:19.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.672+0000 7f284e800640 1 -- 172.21.15.114:0/58877355 reap_dead start 2024-02-17T12:16:19.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f284d400640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28340047d0 0x7f2834004c50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f283c009cb0 tx=0x7f283c01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a91e4c5766b02b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:19.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0a56b0 con 0x7f28340047d0 2024-02-17T12:16:19.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c0a5810 con 0x7f28340047d0 2024-02-17T12:16:19.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f284ca00640 1 -- 172.21.15.114:0/58877355 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0a5c00 con 0x7f28340047d0 2024-02-17T12:16:19.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 -- 172.21.15.114:0/58877355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28340047d0 msgr2=0x7f2834004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:19.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28340047d0 0x7f2834004c50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f283c009cb0 tx=0x7f283c01cc10 comp rx=0 tx=0).stop 2024-02-17T12:16:19.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 -- 172.21.15.114:0/58877355 shutdown_connections 2024-02-17T12:16:19.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 --2- 172.21.15.114:0/58877355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28340047d0 0x7f2834004c50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 -- 172.21.15.114:0/58877355 >> 172.21.15.114:0/58877355 conn(0x7f28500a8490 msgr2=0x7f28500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:19.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 -- 172.21.15.114:0/58877355 shutdown_connections 2024-02-17T12:16:19.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 -- 172.21.15.114:0/58877355 wait complete. 2024-02-17T12:16:19.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 Processor -- start 2024-02-17T12:16:19.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 -- start start 2024-02-17T12:16:19.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28340047d0 0x7f2850141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:19.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28500c41c0 0x7f28500c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:19.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.676+0000 7f2854c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28500c5620 0x7f28500c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:19.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2854c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2850144520 con 0x7f28500c5620 2024-02-17T12:16:19.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2854c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501421e0 con 0x7f28500c41c0 2024-02-17T12:16:19.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2854c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2850155a20 con 0x7f28340047d0 2024-02-17T12:16:19.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28500c5620 0x7f28500c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:19.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28500c5620 0x7f28500c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59950/0 (socket says 172.21.15.114:59950) 2024-02-17T12:16:19.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284e800640 1 -- 172.21.15.114:0/4282766275 learned_addr learned my addr 172.21.15.114:0/4282766275 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:19.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284de00640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28340047d0 0x7f2850141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:19.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284d400640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28500c41c0 0x7f28500c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:19.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284e800640 1 -- 172.21.15.114:0/4282766275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28340047d0 msgr2=0x7f2850141ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:19.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284e800640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28340047d0 0x7f2850141ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284e800640 1 -- 172.21.15.114:0/4282766275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28500c41c0 msgr2=0x7f28500c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:19.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284e800640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28500c41c0 0x7f28500c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284e800640 1 -- 172.21.15.114:0/4282766275 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2850142c10 con 0x7f28500c5620 2024-02-17T12:16:19.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f284e800640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28500c5620 0x7f28500c5aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f28500c0bb0 tx=0x7f284800e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:19.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2846000640 1 -- 172.21.15.114:0/4282766275 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28480052e0 con 0x7f28500c5620 2024-02-17T12:16:19.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2846000640 1 -- 172.21.15.114:0/4282766275 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2848005440 con 0x7f28500c5620 2024-02-17T12:16:19.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2854c00640 1 -- 172.21.15.114:0/4282766275 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28501556b0 con 0x7f28500c5620 2024-02-17T12:16:19.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2846000640 1 -- 172.21.15.114:0/4282766275 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848003840 con 0x7f28500c5620 2024-02-17T12:16:19.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2854c00640 1 -- 172.21.15.114:0/4282766275 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2850141930 con 0x7f28500c5620 2024-02-17T12:16:19.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2854c00640 1 -- 172.21.15.114:0/4282766275 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2850074840 con 0x7f28500c5620 2024-02-17T12:16:19.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2846000640 1 -- 172.21.15.114:0/4282766275 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f28480039a0 con 0x7f28500c5620 2024-02-17T12:16:19.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.680+0000 7f2846000640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2830066e40 0x7f2830069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:19.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.684+0000 7f2846000640 1 -- 172.21.15.114:0/4282766275 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2848083d90 con 0x7f28500c5620 2024-02-17T12:16:19.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.684+0000 7f284de00640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2830066e40 0x7f2830069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:19.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.684+0000 7f284de00640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2830066e40 0x7f2830069300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f28500ab320 tx=0x7f28400014b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:19.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.688+0000 7f2846000640 1 -- 172.21.15.114:0/4282766275 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2848050f70 con 0x7f28500c5620 2024-02-17T12:16:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 -- 172.21.15.114:0/4282766275 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28500a8a10 con 0x7f28500c5620 2024-02-17T12:16:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2846000640 1 -- 172.21.15.114:0/4282766275 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7f2848019020 con 0x7f28500c5620 2024-02-17T12:16:19.876 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:19.876 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4241624725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4241624725},{"type":"v1","addr":"172.21.15.114:6837","nonce":4241624725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/178899564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":178899564},{"type":"v1","addr":"172.21.15.114:6836","nonce":178899564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/3301698475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3301698475},{"type":"v1","addr":"172.21.15.116:6834","nonce":3301698475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/4001468997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":4001468997},{"type":"v1","addr":"172.21.15.116:6835","nonce":4001468997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-02-17T12:16:19.876 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 3 2024-02-17T12:16:19.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 -- 172.21.15.114:0/4282766275 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2830066e40 msgr2=0x7f2830069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2830066e40 0x7f2830069300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f28500ab320 tx=0x7f28400014b0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 -- 172.21.15.114:0/4282766275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28500c5620 msgr2=0x7f28500c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28500c5620 0x7f28500c5aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f28500c0bb0 tx=0x7f284800e820 comp rx=0 tx=0).stop 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 -- 172.21.15.114:0/4282766275 shutdown_connections 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2830066e40 0x7f2830069300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28500c5620 0x7f28500c5aa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28500c41c0 0x7f28500c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 --2- 172.21.15.114:0/4282766275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28340047d0 0x7f2850141ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.872+0000 7f2854c00640 1 -- 172.21.15.114:0/4282766275 >> 172.21.15.114:0/4282766275 conn(0x7f28500a8490 msgr2=0x7f28500c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.876+0000 7f2854c00640 1 -- 172.21.15.114:0/4282766275 shutdown_connections 2024-02-17T12:16:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:19.876+0000 7f2854c00640 1 -- 172.21.15.114:0/4282766275 wait complete. 2024-02-17T12:16:19.897 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:20.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.028+0000 7f2e5e800640 1 Processor -- start 2024-02-17T12:16:20.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.028+0000 7f2e5e800640 1 -- start start 2024-02-17T12:16:20.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.028+0000 7f2e5e800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2e5814f110 0x7f2e580c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.028+0000 7f2e5e800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e580a9420 con 0x7f2e580c1eb0 2024-02-17T12:16:20.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e5e800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e58152850 con 0x7f2e580c2580 2024-02-17T12:16:20.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e5e800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5814f4f0 con 0x7f2e5814f110 2024-02-17T12:16:20.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e57e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2e580c1eb0 0x7f2e5815c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58874/0 (socket says 172.21.15.114:58874) 2024-02-17T12:16:20.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e57e00640 1 -- 172.21.15.114:0/2183203472 learned_addr learned my addr 172.21.15.114:0/2183203472 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:20.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e57400640 1 --2- 172.21.15.114:0/2183203472 >> v2:172.21.15.116:3300/0 conn(0x7f2e5814f110 0x7f2e580c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e56000640 1 -- 172.21.15.114:0/2183203472 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476211473 0 0) 0x7f2e580a9420 con 0x7f2e580c1eb0 2024-02-17T12:16:20.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e56000640 1 -- 172.21.15.114:0/2183203472 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c003530 con 0x7f2e580c1eb0 2024-02-17T12:16:20.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e57400640 1 -- 172.21.15.114:0/2183203472 >> v1:172.21.15.116:6789/0 conn(0x7f2e580c2580 legacy=0x7f2e580aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e56000640 1 -- 172.21.15.114:0/2183203472 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400646756 0 0) 0x7f2e58152850 con 0x7f2e580c2580 2024-02-17T12:16:20.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e57400640 1 -- 172.21.15.114:0/2183203472 >> v1:172.21.15.114:6789/0 conn(0x7f2e580c1eb0 legacy=0x7f2e5815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e57400640 1 -- 172.21.15.114:0/2183203472 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e580a9670 con 0x7f2e5814f110 2024-02-17T12:16:20.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.032+0000 7f2e57400640 1 --2- 172.21.15.114:0/2183203472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e5814f110 0x7f2e580c65a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2e480097c0 tx=0x7f2e4801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adb68abd1fc59102 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:20.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e56000640 1 -- 172.21.15.114:0/2183203472 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480ab600 con 0x7f2e5814f110 2024-02-17T12:16:20.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e56000640 1 -- 172.21.15.114:0/2183203472 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e480a7050 con 0x7f2e5814f110 2024-02-17T12:16:20.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e56000640 1 -- 172.21.15.114:0/2183203472 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480ab980 con 0x7f2e5814f110 2024-02-17T12:16:20.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 -- 172.21.15.114:0/2183203472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e5814f110 msgr2=0x7f2e580c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 --2- 172.21.15.114:0/2183203472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e5814f110 0x7f2e580c65a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2e480097c0 tx=0x7f2e4801c410 comp rx=0 tx=0).stop 2024-02-17T12:16:20.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 -- 172.21.15.114:0/2183203472 shutdown_connections 2024-02-17T12:16:20.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 --2- 172.21.15.114:0/2183203472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e5814f110 0x7f2e580c65a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 -- 172.21.15.114:0/2183203472 >> 172.21.15.114:0/2183203472 conn(0x7f2e580a8490 msgr2=0x7f2e580a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:20.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 -- 172.21.15.114:0/2183203472 shutdown_connections 2024-02-17T12:16:20.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 -- 172.21.15.114:0/2183203472 wait complete. 2024-02-17T12:16:20.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 Processor -- start 2024-02-17T12:16:20.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 -- start start 2024-02-17T12:16:20.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e580c1eb0 0x7f2e58144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e580c2580 0x7f2e58141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e5814f110 0x7f2e581420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e581425e0 con 0x7f2e580c2580 2024-02-17T12:16:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e580c4d30 con 0x7f2e580c1eb0 2024-02-17T12:16:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e5e800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5814ea10 con 0x7f2e5814f110 2024-02-17T12:16:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e56a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e580c2580 0x7f2e58141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e56a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e580c2580 0x7f2e58141b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59958/0 (socket says 172.21.15.114:59958) 2024-02-17T12:16:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e56a00640 1 -- 172.21.15.114:0/642958103 learned_addr learned my addr 172.21.15.114:0/642958103 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e57400640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e580c1eb0 0x7f2e58144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e57e00640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e5814f110 0x7f2e581420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.036+0000 7f2e56a00640 1 -- 172.21.15.114:0/642958103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e5814f110 msgr2=0x7f2e581420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e56a00640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e5814f110 0x7f2e581420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e56a00640 1 -- 172.21.15.114:0/642958103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e580c1eb0 msgr2=0x7f2e58144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e56a00640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e580c1eb0 0x7f2e58144210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e56a00640 1 -- 172.21.15.114:0/642958103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e48009420 con 0x7f2e580c2580 2024-02-17T12:16:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e56a00640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e580c2580 0x7f2e58141b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400c3e0 tx=0x7f2e4400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e4f400640 1 -- 172.21.15.114:0/642958103 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440054e0 con 0x7f2e580c2580 2024-02-17T12:16:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e4f400640 1 -- 172.21.15.114:0/642958103 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44003600 con 0x7f2e580c2580 2024-02-17T12:16:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e5e800640 1 -- 172.21.15.114:0/642958103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5814e060 con 0x7f2e580c2580 2024-02-17T12:16:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e4f400640 1 -- 172.21.15.114:0/642958103 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440039b0 con 0x7f2e580c2580 2024-02-17T12:16:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e5e800640 1 -- 172.21.15.114:0/642958103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5814e730 con 0x7f2e580c2580 2024-02-17T12:16:20.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e5e800640 1 -- 172.21.15.114:0/642958103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e58074840 con 0x7f2e580c2580 2024-02-17T12:16:20.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e4f400640 1 -- 172.21.15.114:0/642958103 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2e44003b10 con 0x7f2e580c2580 2024-02-17T12:16:20.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e4f400640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e38066e40 0x7f2e38069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e4f400640 1 -- 172.21.15.114:0/642958103 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2e44083cd0 con 0x7f2e580c2580 2024-02-17T12:16:20.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.040+0000 7f2e57400640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e38066e40 0x7f2e38069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.044+0000 7f2e57400640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e38066e40 0x7f2e38069300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2e480ad000 tx=0x7f2e480a4f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:20.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.044+0000 7f2e4f400640 1 -- 172.21.15.114:0/642958103 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2e44054940 con 0x7f2e580c2580 2024-02-17T12:16:20.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.200+0000 7f2e5e800640 1 -- 172.21.15.114:0/642958103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e580c1380 con 0x7f2e580c2580 2024-02-17T12:16:20.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.200+0000 7f2e4f400640 1 -- 172.21.15.114:0/642958103 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12896 (secure 0 0 0) 0x7f2e440544d0 con 0x7f2e580c2580 2024-02-17T12:16:20.205 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:20.205 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:11.750837+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:20.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 -- 172.21.15.114:0/642958103 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e38066e40 msgr2=0x7f2e38069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e38066e40 0x7f2e38069300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2e480ad000 tx=0x7f2e480a4f90 comp rx=0 tx=0).stop 2024-02-17T12:16:20.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 -- 172.21.15.114:0/642958103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e580c2580 msgr2=0x7f2e58141b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e580c2580 0x7f2e58141b60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400c3e0 tx=0x7f2e4400c8a0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 -- 172.21.15.114:0/642958103 shutdown_connections 2024-02-17T12:16:20.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e5814f110 0x7f2e581420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e38066e40 0x7f2e38069300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e580c2580 0x7f2e58141b60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 --2- 172.21.15.114:0/642958103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e580c1eb0 0x7f2e58144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 -- 172.21.15.114:0/642958103 >> 172.21.15.114:0/642958103 conn(0x7f2e580a8490 msgr2=0x7f2e5806b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:20.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 -- 172.21.15.114:0/642958103 shutdown_connections 2024-02-17T12:16:20.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.204+0000 7f2e5e800640 1 -- 172.21.15.114:0/642958103 wait complete. 2024-02-17T12:16:20.226 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:20.226 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:20.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa900800640 1 Processor -- start 2024-02-17T12:16:20.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa900800640 1 -- start start 2024-02-17T12:16:20.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa900800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8f80c58b0 0x7fa8f81583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa900800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8f80c4b30 0x7fa8f806bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa900800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f8155090 con 0x7fa8f806c160 2024-02-17T12:16:20.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa900800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f80c6110 con 0x7fa8f80c4b30 2024-02-17T12:16:20.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa900800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f8159300 con 0x7fa8f80c58b0 2024-02-17T12:16:20.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa8fd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8f80c4b30 0x7fa8f806bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa8fd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa8f80c4b30 0x7fa8f806bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59968/0 (socket says 172.21.15.114:59968) 2024-02-17T12:16:20.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa8fd400640 1 -- 172.21.15.114:0/2285438620 learned_addr learned my addr 172.21.15.114:0/2285438620 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:20.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa8fd400640 1 -- 172.21.15.114:0/2285438620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8f80c58b0 msgr2=0x7fa8f81583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:20.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa8fd400640 1 --2- 172.21.15.114:0/2285438620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8f80c58b0 0x7fa8f81583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa8fd400640 1 -- 172.21.15.114:0/2285438620 >> v1:172.21.15.116:6789/0 conn(0x7fa8f806c160 legacy=0x7fa8f8155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:20.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.364+0000 7fa8fd400640 1 -- 172.21.15.114:0/2285438620 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8158a60 con 0x7fa8f80c4b30 2024-02-17T12:16:20.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa8fd400640 1 --2- 172.21.15.114:0/2285438620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 0x7fa8f806bc20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009870 tx=0x7fa8ec01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4afa1175a3701f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:20.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa8fca00640 1 -- 172.21.15.114:0/2285438620 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0aa610 con 0x7fa8f80c4b30 2024-02-17T12:16:20.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa8fca00640 1 -- 172.21.15.114:0/2285438620 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0a6040 con 0x7fa8f80c4b30 2024-02-17T12:16:20.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa8fca00640 1 -- 172.21.15.114:0/2285438620 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0aa990 con 0x7fa8f80c4b30 2024-02-17T12:16:20.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa900800640 1 -- 172.21.15.114:0/2285438620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 msgr2=0x7fa8f806bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa900800640 1 --2- 172.21.15.114:0/2285438620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 0x7fa8f806bc20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009870 tx=0x7fa8ec01c4f0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa900800640 1 -- 172.21.15.114:0/2285438620 shutdown_connections 2024-02-17T12:16:20.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa900800640 1 --2- 172.21.15.114:0/2285438620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 0x7fa8f806bc20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa900800640 1 --2- 172.21.15.114:0/2285438620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8f80c58b0 0x7fa8f81583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa900800640 1 -- 172.21.15.114:0/2285438620 >> 172.21.15.114:0/2285438620 conn(0x7fa8f80c3730 msgr2=0x7fa8f80c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:20.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa900800640 1 -- 172.21.15.114:0/2285438620 shutdown_connections 2024-02-17T12:16:20.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa900800640 1 -- 172.21.15.114:0/2285438620 wait complete. 2024-02-17T12:16:20.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa900800640 1 Processor -- start 2024-02-17T12:16:20.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.368+0000 7fa900800640 1 -- start start 2024-02-17T12:16:20.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa900800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8f806c160 0x7fa8f80a8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa900800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 0x7fa8f80a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa900800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8f80c58b0 0x7fa8f80a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa900800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f80a7990 con 0x7fa8f80c4b30 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa900800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f814aab0 con 0x7fa8f806c160 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa900800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f814c5a0 con 0x7fa8f80c58b0 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 0x7fa8f80a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 0x7fa8f80a6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59982/0 (socket says 172.21.15.114:59982) 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fd400640 1 -- 172.21.15.114:0/667569924 learned_addr learned my addr 172.21.15.114:0/667569924 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fde00640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8f806c160 0x7fa8f80a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fe800640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8f80c58b0 0x7fa8f80a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fd400640 1 -- 172.21.15.114:0/667569924 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8f80c58b0 msgr2=0x7fa8f80a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fd400640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8f80c58b0 0x7fa8f80a7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fd400640 1 -- 172.21.15.114:0/667569924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8f806c160 msgr2=0x7fa8f80a8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fd400640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8f806c160 0x7fa8f80a8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fd400640 1 -- 172.21.15.114:0/667569924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec0094d0 con 0x7fa8f80c4b30 2024-02-17T12:16:20.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fde00640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8f806c160 0x7fa8f80a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:20.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8fd400640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 0x7fa8f80a6f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0ac040 tx=0x7fa8ec01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:20.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8f2000640 1 -- 172.21.15.114:0/667569924 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0b3800 con 0x7fa8f80c4b30 2024-02-17T12:16:20.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8f2000640 1 -- 172.21.15.114:0/667569924 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0b3980 con 0x7fa8f80c4b30 2024-02-17T12:16:20.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8f2000640 1 -- 172.21.15.114:0/667569924 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0b3d30 con 0x7fa8f80c4b30 2024-02-17T12:16:20.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa900800640 1 -- 172.21.15.114:0/667569924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f814c880 con 0x7fa8f80c4b30 2024-02-17T12:16:20.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa900800640 1 -- 172.21.15.114:0/667569924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f80a69f0 con 0x7fa8f80c4b30 2024-02-17T12:16:20.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa900800640 1 -- 172.21.15.114:0/667569924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f8067170 con 0x7fa8f80c4b30 2024-02-17T12:16:20.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.372+0000 7fa8f2000640 1 -- 172.21.15.114:0/667569924 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa8ec0c6390 con 0x7fa8f80c4b30 2024-02-17T12:16:20.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.376+0000 7fa8f2000640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8d8066e40 0x7fa8d8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.376+0000 7fa8f2000640 1 -- 172.21.15.114:0/667569924 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa8ec11f0c0 con 0x7fa8f80c4b30 2024-02-17T12:16:20.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.376+0000 7fa8fde00640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8d8066e40 0x7fa8d8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.376+0000 7fa8fde00640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8d8066e40 0x7fa8d8069300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4006fd0 tx=0x7fa8e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:20.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.380+0000 7fa8f2000640 1 -- 172.21.15.114:0/667569924 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa8ec0ec200 con 0x7fa8f80c4b30 2024-02-17T12:16:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.532+0000 7fa900800640 1 -- 172.21.15.114:0/667569924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8f80c5400 con 0x7fa8f80c4b30 2024-02-17T12:16:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.532+0000 7fa8f2000640 1 -- 172.21.15.114:0/667569924 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8ec0ef8c0 con 0x7fa8f80c4b30 2024-02-17T12:16:20.537 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 -- 172.21.15.114:0/667569924 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8d8066e40 msgr2=0x7fa8d8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8d8066e40 0x7fa8d8069300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4006fd0 tx=0x7fa8e4008040 comp rx=0 tx=0).stop 2024-02-17T12:16:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 -- 172.21.15.114:0/667569924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 msgr2=0x7fa8f80a6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 0x7fa8f80a6f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0ac040 tx=0x7fa8ec01ad30 comp rx=0 tx=0).stop 2024-02-17T12:16:20.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 -- 172.21.15.114:0/667569924 shutdown_connections 2024-02-17T12:16:20.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8f80c58b0 0x7fa8f80a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8d8066e40 0x7fa8d8069300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f80c4b30 0x7fa8f80a6f10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 --2- 172.21.15.114:0/667569924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8f806c160 0x7fa8f80a8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 -- 172.21.15.114:0/667569924 >> 172.21.15.114:0/667569924 conn(0x7fa8f80c3730 msgr2=0x7fa8f8155520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:20.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 -- 172.21.15.114:0/667569924 shutdown_connections 2024-02-17T12:16:20.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.536+0000 7fa900800640 1 -- 172.21.15.114:0/667569924 wait complete. 2024-02-17T12:16:20.557 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T12:16:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.688+0000 7f1c2c600640 1 Processor -- start 2024-02-17T12:16:20.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.688+0000 7f1c2c600640 1 -- start start 2024-02-17T12:16:20.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.688+0000 7f1c2c600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c240c58b0 0x7f1c241583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.688+0000 7f1c2c600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c24155090 con 0x7f1c240a6360 2024-02-17T12:16:20.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.688+0000 7f1c2c600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c24159300 con 0x7f1c240c4b30 2024-02-17T12:16:20.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.688+0000 7f1c2c600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240c6110 con 0x7f1c240c58b0 2024-02-17T12:16:20.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.688+0000 7f1c2a600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1c240a6360 0x7f1c24155520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58876/0 (socket says 172.21.15.114:58876) 2024-02-17T12:16:20.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.688+0000 7f1c2a600640 1 -- 172.21.15.114:0/868394819 learned_addr learned my addr 172.21.15.114:0/868394819 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:20.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.688+0000 7f1c29c00640 1 --2- 172.21.15.114:0/868394819 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c240c58b0 0x7f1c241583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.688+0000 7f1c23e00640 1 -- 172.21.15.114:0/868394819 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198619294 0 0) 0x7f1c24155090 con 0x7f1c240a6360 2024-02-17T12:16:20.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c23e00640 1 -- 172.21.15.114:0/868394819 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c0c003530 con 0x7f1c240a6360 2024-02-17T12:16:20.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c23e00640 1 -- 172.21.15.114:0/868394819 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197249877 0 0) 0x7f1c24159300 con 0x7f1c240c4b30 2024-02-17T12:16:20.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c23e00640 1 -- 172.21.15.114:0/868394819 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c24155090 con 0x7f1c240c4b30 2024-02-17T12:16:20.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c29c00640 1 -- 172.21.15.114:0/868394819 >> v1:172.21.15.116:6789/0 conn(0x7f1c240c4b30 legacy=0x7f1c2406bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c23e00640 1 -- 172.21.15.114:0/868394819 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4004150454 0 0) 0x7f1c0c003530 con 0x7f1c240a6360 2024-02-17T12:16:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c29c00640 1 -- 172.21.15.114:0/868394819 >> v1:172.21.15.114:6789/0 conn(0x7f1c240a6360 legacy=0x7f1c24155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c29c00640 1 -- 172.21.15.114:0/868394819 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24158a60 con 0x7f1c240c58b0 2024-02-17T12:16:20.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c29c00640 1 --2- 172.21.15.114:0/868394819 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c240c58b0 0x7f1c241583d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c180097f0 tx=0x7f1c1801c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e881af07924d32 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:20.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c23e00640 1 -- 172.21.15.114:0/868394819 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c001a00 con 0x7f1c240c58b0 2024-02-17T12:16:20.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c23e00640 1 -- 172.21.15.114:0/868394819 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c180a7050 con 0x7f1c240c58b0 2024-02-17T12:16:20.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c23e00640 1 -- 172.21.15.114:0/868394819 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18004250 con 0x7f1c240c58b0 2024-02-17T12:16:20.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c2c600640 1 -- 172.21.15.114:0/868394819 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c240c58b0 msgr2=0x7f1c241583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.692+0000 7f1c2c600640 1 --2- 172.21.15.114:0/868394819 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c240c58b0 0x7f1c241583d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c180097f0 tx=0x7f1c1801c3d0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 -- 172.21.15.114:0/868394819 shutdown_connections 2024-02-17T12:16:20.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 --2- 172.21.15.114:0/868394819 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c240c58b0 0x7f1c241583d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 -- 172.21.15.114:0/868394819 >> 172.21.15.114:0/868394819 conn(0x7f1c240c3730 msgr2=0x7f1c240c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:20.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 -- 172.21.15.114:0/868394819 shutdown_connections 2024-02-17T12:16:20.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 -- 172.21.15.114:0/868394819 wait complete. 2024-02-17T12:16:20.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 Processor -- start 2024-02-17T12:16:20.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 -- start start 2024-02-17T12:16:20.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c240a6360 0x7f1c241edb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c240c4b30 0x7f1c24157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c240c58b0 0x7f1c24152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240ac9a0 con 0x7f1c240a6360 2024-02-17T12:16:20.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c241ee040 con 0x7f1c240c58b0 2024-02-17T12:16:20.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2415a260 con 0x7f1c240c4b30 2024-02-17T12:16:20.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c29c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c240a6360 0x7f1c241edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c29c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c240a6360 0x7f1c241edb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59994/0 (socket says 172.21.15.114:59994) 2024-02-17T12:16:20.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c29c00640 1 -- 172.21.15.114:0/4094747921 learned_addr learned my addr 172.21.15.114:0/4094747921 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:20.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c29c00640 1 -- 172.21.15.114:0/4094747921 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c240c4b30 msgr2=0x7f1c24157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c29c00640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c240c4b30 0x7f1c24157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2a600640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c240c58b0 0x7f1c24152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c29c00640 1 -- 172.21.15.114:0/4094747921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c240c58b0 msgr2=0x7f1c24152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c29c00640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c240c58b0 0x7f1c24152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c29c00640 1 -- 172.21.15.114:0/4094747921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18009420 con 0x7f1c240a6360 2024-02-17T12:16:20.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2a600640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c240c58b0 0x7f1c24152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:20.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c29c00640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c240a6360 0x7f1c241edb00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1c180097f0 tx=0x7f1c18019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:20.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c21600640 1 -- 172.21.15.114:0/4094747921 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18003a30 con 0x7f1c240a6360 2024-02-17T12:16:20.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c21600640 1 -- 172.21.15.114:0/4094747921 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c18003b90 con 0x7f1c240a6360 2024-02-17T12:16:20.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c21600640 1 -- 172.21.15.114:0/4094747921 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c180ab440 con 0x7f1c240a6360 2024-02-17T12:16:20.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 -- 172.21.15.114:0/4094747921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c24159ca0 con 0x7f1c240a6360 2024-02-17T12:16:20.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.696+0000 7f1c2c600640 1 -- 172.21.15.114:0/4094747921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c240ac5c0 con 0x7f1c240a6360 2024-02-17T12:16:20.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.700+0000 7f1c2c600640 1 -- 172.21.15.114:0/4094747921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c24067170 con 0x7f1c240a6360 2024-02-17T12:16:20.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.700+0000 7f1c21600640 1 -- 172.21.15.114:0/4094747921 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1c180b2040 con 0x7f1c240a6360 2024-02-17T12:16:20.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.700+0000 7f1c21600640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1c04066e40 0x7f1c04069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:20.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.700+0000 7f1c21600640 1 -- 172.21.15.114:0/4094747921 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1c1811e510 con 0x7f1c240a6360 2024-02-17T12:16:20.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.700+0000 7f1c29200640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1c04066e40 0x7f1c04069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:20.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.700+0000 7f1c29200640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1c04066e40 0x7f1c04069300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c10007fd0 tx=0x7f1c10007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:20.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.704+0000 7f1c21600640 1 -- 172.21.15.114:0/4094747921 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1c180eb640 con 0x7f1c240a6360 2024-02-17T12:16:20.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 -- 172.21.15.114:0/4094747921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1c240ac420 con 0x7f1c240a6360 2024-02-17T12:16:20.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c21600640 1 -- 172.21.15.114:0/4094747921 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1c240ac420 con 0x7f1c240a6360 2024-02-17T12:16:20.863 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:20.863 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-02-17T12:16:20.864 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:16:20.864 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-02-17T12:16:20.864 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-02-17T12:16:20.864 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:16:20.864 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-02-17T12:16:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 -- 172.21.15.114:0/4094747921 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1c04066e40 msgr2=0x7f1c04069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1c04066e40 0x7f1c04069300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c10007fd0 tx=0x7f1c10007960 comp rx=0 tx=0).stop 2024-02-17T12:16:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 -- 172.21.15.114:0/4094747921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c240a6360 msgr2=0x7f1c241edb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c240a6360 0x7f1c241edb00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1c180097f0 tx=0x7f1c18019170 comp rx=0 tx=0).stop 2024-02-17T12:16:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 -- 172.21.15.114:0/4094747921 shutdown_connections 2024-02-17T12:16:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c240c58b0 0x7f1c24152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c240c4b30 0x7f1c24157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1c04066e40 0x7f1c04069300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 --2- 172.21.15.114:0/4094747921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c240a6360 0x7f1c241edb00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 -- 172.21.15.114:0/4094747921 >> 172.21.15.114:0/4094747921 conn(0x7f1c240c3730 msgr2=0x7f1c240c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 -- 172.21.15.114:0/4094747921 shutdown_connections 2024-02-17T12:16:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:20.860+0000 7f1c2c600640 1 -- 172.21.15.114:0/4094747921 wait complete. 2024-02-17T12:16:20.884 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-17T12:16:20.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-17T12:16:21.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ea00640 1 Processor -- start 2024-02-17T12:16:21.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ea00640 1 -- start start 2024-02-17T12:16:21.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ea00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5d380a7dd0 0x7f5d380c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ea00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d380c2530 0x7f5d380c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ea00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d380c2e00 con 0x7f5d3814f310 2024-02-17T12:16:21.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ea00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380a6980 con 0x7f5d380a7dd0 2024-02-17T12:16:21.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ea00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380c30e0 con 0x7f5d380c2530 2024-02-17T12:16:21.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d37e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5d3814f310 0x7f5d381524d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58884/0 (socket says 172.21.15.114:58884) 2024-02-17T12:16:21.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d37e00640 1 -- 172.21.15.114:0/2575944893 learned_addr learned my addr 172.21.15.114:0/2575944893 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d380c2530 0x7f5d380c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240884994 0 0) 0x7f5d380c2e00 con 0x7f5d3814f310 2024-02-17T12:16:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d37400640 1 --2- 172.21.15.114:0/2575944893 >> v2:172.21.15.116:3300/0 conn(0x7f5d380a7dd0 0x7f5d380c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d1c003530 con 0x7f5d3814f310 2024-02-17T12:16:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1397163056 0 0) 0x7f5d1c003530 con 0x7f5d3814f310 2024-02-17T12:16:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d380c2530 msgr2=0x7f5d380c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d380c2530 0x7f5d380c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 >> v2:172.21.15.116:3300/0 conn(0x7f5d380a7dd0 msgr2=0x7f5d380c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 --2- 172.21.15.114:0/2575944893 >> v2:172.21.15.116:3300/0 conn(0x7f5d380a7dd0 0x7f5d380c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3814f6f0 con 0x7f5d3814f310 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f5d28001680 con 0x7f5d3814f310 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 >> v1:172.21.15.114:6789/0 conn(0x7f5d3814f310 legacy=0x7f5d381524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d380c2530 0x7f5d1c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d1c003f00 0x7f5d1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d1c004d10 0x7f5d1c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380a6980 con 0x7f5d1c004d10 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380c30e0 con 0x7f5d1c003f00 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c00b990 con 0x7f5d380c2530 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d1c004d10 0x7f5d1c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d37400640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d1c003f00 0x7f5d1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d37e00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d380c2530 0x7f5d1c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ca00640 1 -- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d380c2530 msgr2=0x7f5d1c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d380c2530 0x7f5d1c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ca00640 1 -- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d1c003f00 msgr2=0x7f5d1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:21.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d1c003f00 0x7f5d1c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d3ca00640 1 -- 172.21.15.114:0/2575944893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c003530 con 0x7f5d1c004d10 2024-02-17T12:16:21.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.020+0000 7f5d37400640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d1c003f00 0x7f5d1c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:21.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d1c004d10 0x7f5d1c005190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009fc0 tx=0x7f5d3001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2685b7cd8fb5f4b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:21.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300a5c90 con 0x7f5d1c004d10 2024-02-17T12:16:21.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3000f040 con 0x7f5d1c004d10 2024-02-17T12:16:21.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d36a00640 1 -- 172.21.15.114:0/2575944893 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300ad440 con 0x7f5d1c004d10 2024-02-17T12:16:21.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d3ea00640 1 -- 172.21.15.114:0/2575944893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d1c004d10 msgr2=0x7f5d1c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:21.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d3ea00640 1 --2- 172.21.15.114:0/2575944893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d1c004d10 0x7f5d1c005190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009fc0 tx=0x7f5d3001cc20 comp rx=0 tx=0).stop 2024-02-17T12:16:21.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d3ca00640 1 -- 172.21.15.114:0/2575944893 reap_dead start 2024-02-17T12:16:21.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d3ea00640 1 -- 172.21.15.114:0/2575944893 shutdown_connections 2024-02-17T12:16:21.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d3ea00640 1 -- 172.21.15.114:0/2575944893 >> 172.21.15.114:0/2575944893 conn(0x7f5d3806b210 msgr2=0x7f5d3806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:21.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d3ea00640 1 -- 172.21.15.114:0/2575944893 shutdown_connections 2024-02-17T12:16:21.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.024+0000 7f5d3ea00640 1 -- 172.21.15.114:0/2575944893 wait complete. 2024-02-17T12:16:21.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ea00640 1 Processor -- start 2024-02-17T12:16:21.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ea00640 1 -- start start 2024-02-17T12:16:21.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ea00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d1c004d10 0x7f5d38148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ea00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d38148f40 0x7f5d38143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38151740 0x7f5d38143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d381ec270 con 0x7f5d38151740 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ea00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d381dc1e0 con 0x7f5d1c004d10 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ea00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d381ebf90 con 0x7f5d38148f40 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38151740 0x7f5d38143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38151740 0x7f5d38143980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60014/0 (socket says 172.21.15.114:60014) 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ca00640 1 -- 172.21.15.114:0/3264726730 learned_addr learned my addr 172.21.15.114:0/3264726730 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d37e00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d1c004d10 0x7f5d38148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d37400640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d38148f40 0x7f5d38143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ca00640 1 -- 172.21.15.114:0/3264726730 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d38148f40 msgr2=0x7f5d38143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d38148f40 0x7f5d38143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ca00640 1 -- 172.21.15.114:0/3264726730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d1c004d10 msgr2=0x7f5d38148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d1c004d10 0x7f5d38148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ca00640 1 -- 172.21.15.114:0/3264726730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d381dc480 con 0x7f5d38151740 2024-02-17T12:16:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38151740 0x7f5d38143980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d30002240 tx=0x7f5d30009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d2fe00640 1 -- 172.21.15.114:0/3264726730 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300039a0 con 0x7f5d38151740 2024-02-17T12:16:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d2fe00640 1 -- 172.21.15.114:0/3264726730 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d30003b00 con 0x7f5d38151740 2024-02-17T12:16:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ea00640 1 -- 172.21.15.114:0/3264726730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d381dc760 con 0x7f5d38151740 2024-02-17T12:16:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d2fe00640 1 -- 172.21.15.114:0/3264726730 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30003e90 con 0x7f5d38151740 2024-02-17T12:16:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.028+0000 7f5d3ea00640 1 -- 172.21.15.114:0/3264726730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d38155ba0 con 0x7f5d38151740 2024-02-17T12:16:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.032+0000 7f5d3ea00640 1 -- 172.21.15.114:0/3264726730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d381dc020 con 0x7f5d38151740 2024-02-17T12:16:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.032+0000 7f5d2fe00640 1 -- 172.21.15.114:0/3264726730 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f5d300b4040 con 0x7f5d38151740 2024-02-17T12:16:21.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.032+0000 7f5d2fe00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d18066e40 0x7f5d18069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.032+0000 7f5d2fe00640 1 -- 172.21.15.114:0/3264726730 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d3011e490 con 0x7f5d38151740 2024-02-17T12:16:21.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.032+0000 7f5d37e00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d18066e40 0x7f5d18069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.032+0000 7f5d37e00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d18066e40 0x7f5d18069300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d28000c10 tx=0x7f5d28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:21.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.036+0000 7f5d2fe00640 1 -- 172.21.15.114:0/3264726730 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5d300eb670 con 0x7f5d38151740 2024-02-17T12:16:21.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.192+0000 7f5d3ea00640 1 -- 172.21.15.114:0/3264726730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5d38074840 con 0x7f5d38151740 2024-02-17T12:16:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d2fe00640 1 -- 172.21.15.114:0/3264726730 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5d300eed30 con 0x7f5d38151740 2024-02-17T12:16:21.278 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-02-17T12:16:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 -- 172.21.15.114:0/3264726730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d18066e40 msgr2=0x7f5d18069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d18066e40 0x7f5d18069300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d28000c10 tx=0x7f5d28009040 comp rx=0 tx=0).stop 2024-02-17T12:16:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 -- 172.21.15.114:0/3264726730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38151740 msgr2=0x7f5d38143980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38151740 0x7f5d38143980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d30002240 tx=0x7f5d30009750 comp rx=0 tx=0).stop 2024-02-17T12:16:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 -- 172.21.15.114:0/3264726730 shutdown_connections 2024-02-17T12:16:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d18066e40 0x7f5d18069300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38151740 0x7f5d38143980 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5d38148f40 0x7f5d38143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 --2- 172.21.15.114:0/3264726730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d1c004d10 0x7f5d38148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 -- 172.21.15.114:0/3264726730 >> 172.21.15.114:0/3264726730 conn(0x7f5d3806b210 msgr2=0x7f5d38145870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 -- 172.21.15.114:0/3264726730 shutdown_connections 2024-02-17T12:16:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.276+0000 7f5d3ea00640 1 -- 172.21.15.114:0/3264726730 wait complete. 2024-02-17T12:16:21.305 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T12:16:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2c1400640 1 Processor -- start 2024-02-17T12:16:21.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2c1400640 1 -- start start 2024-02-17T12:16:21.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2c1400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc152540 0x7fd2bc06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2c1400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd2bc154e30 0x7fd2bc0aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2c1400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc155dd0 con 0x7fd2bc0c6460 2024-02-17T12:16:21.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2c1400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc1588c0 con 0x7fd2bc154e30 2024-02-17T12:16:21.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2c1400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc155810 con 0x7fd2bc152540 2024-02-17T12:16:21.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2bb200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd2bc154e30 0x7fd2bc0aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2bb200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd2bc154e30 0x7fd2bc0aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60020/0 (socket says 172.21.15.114:60020) 2024-02-17T12:16:21.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2bb200640 1 -- 172.21.15.114:0/3716005216 learned_addr learned my addr 172.21.15.114:0/3716005216 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:21.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2b1e00640 1 --1- 172.21.15.114:0/3716005216 >> v1:172.21.15.114:6789/0 conn(0x7fd2bc0c6460 0x7fd2bc158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58896/0 (socket says 172.21.15.114:58896) 2024-02-17T12:16:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2ba800640 1 --2- 172.21.15.114:0/3716005216 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc152540 0x7fd2bc06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2bb200640 1 -- 172.21.15.114:0/3716005216 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc152540 msgr2=0x7fd2bc06ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2bb200640 1 --2- 172.21.15.114:0/3716005216 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc152540 0x7fd2bc06ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2bb200640 1 -- 172.21.15.114:0/3716005216 >> v1:172.21.15.114:6789/0 conn(0x7fd2bc0c6460 legacy=0x7fd2bc158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2bb200640 1 -- 172.21.15.114:0/3716005216 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc155af0 con 0x7fd2bc154e30 2024-02-17T12:16:21.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.444+0000 7fd2ba800640 1 --2- 172.21.15.114:0/3716005216 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc152540 0x7fd2bc06ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:21.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2bb200640 1 --2- 172.21.15.114:0/3716005216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc154e30 0x7fd2bc0aa160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009e50 tx=0x7fd2b401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279aa87d16ed570e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:21.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2b9e00640 1 -- 172.21.15.114:0/3716005216 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40a56e0 con 0x7fd2bc154e30 2024-02-17T12:16:21.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2b9e00640 1 -- 172.21.15.114:0/3716005216 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b40a5840 con 0x7fd2bc154e30 2024-02-17T12:16:21.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2b9e00640 1 -- 172.21.15.114:0/3716005216 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40a5bd0 con 0x7fd2bc154e30 2024-02-17T12:16:21.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2c1400640 1 -- 172.21.15.114:0/3716005216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc154e30 msgr2=0x7fd2bc0aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:21.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2c1400640 1 --2- 172.21.15.114:0/3716005216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc154e30 0x7fd2bc0aa160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009e50 tx=0x7fd2b401c910 comp rx=0 tx=0).stop 2024-02-17T12:16:21.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2c1400640 1 -- 172.21.15.114:0/3716005216 shutdown_connections 2024-02-17T12:16:21.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2c1400640 1 --2- 172.21.15.114:0/3716005216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc154e30 0x7fd2bc0aa160 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2c1400640 1 --2- 172.21.15.114:0/3716005216 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc152540 0x7fd2bc06ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2c1400640 1 -- 172.21.15.114:0/3716005216 >> 172.21.15.114:0/3716005216 conn(0x7fd2bc0c4f20 msgr2=0x7fd2bc0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:21.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2c1400640 1 -- 172.21.15.114:0/3716005216 shutdown_connections 2024-02-17T12:16:21.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.448+0000 7fd2c1400640 1 -- 172.21.15.114:0/3716005216 wait complete. 2024-02-17T12:16:21.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 Processor -- start 2024-02-17T12:16:21.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 -- start start 2024-02-17T12:16:21.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc0c6460 0x7fd2bc14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2bc152540 0x7fd2bc1456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc154e30 0x7fd2bc145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc14aa60 con 0x7fd2bc0c6460 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc1f1560 con 0x7fd2bc152540 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc1f1840 con 0x7fd2bc154e30 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2ba800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc0c6460 0x7fd2bc14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2ba800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc0c6460 0x7fd2bc14bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60022/0 (socket says 172.21.15.114:60022) 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2ba800640 1 -- 172.21.15.114:0/313581165 learned_addr learned my addr 172.21.15.114:0/313581165 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2b1e00640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2bc152540 0x7fd2bc1456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2bb200640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc154e30 0x7fd2bc145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2ba800640 1 -- 172.21.15.114:0/313581165 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc154e30 msgr2=0x7fd2bc145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2ba800640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc154e30 0x7fd2bc145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2ba800640 1 -- 172.21.15.114:0/313581165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2bc152540 msgr2=0x7fd2bc1456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2ba800640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2bc152540 0x7fd2bc1456f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2ba800640 1 -- 172.21.15.114:0/313581165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4009b30 con 0x7fd2bc0c6460 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2bb200640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc154e30 0x7fd2bc145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:21.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2b1e00640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2bc152540 0x7fd2bc1456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:21.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2ba800640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc0c6460 0x7fd2bc14bb50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00c7c0 tx=0x7fd2ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:21.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2b3400640 1 -- 172.21.15.114:0/313581165 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac007a30 con 0x7fd2bc0c6460 2024-02-17T12:16:21.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2b3400640 1 -- 172.21.15.114:0/313581165 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac007b90 con 0x7fd2bc0c6460 2024-02-17T12:16:21.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2b3400640 1 -- 172.21.15.114:0/313581165 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00ce70 con 0x7fd2bc0c6460 2024-02-17T12:16:21.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 -- 172.21.15.114:0/313581165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc149e70 con 0x7fd2bc0c6460 2024-02-17T12:16:21.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 -- 172.21.15.114:0/313581165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc14c550 con 0x7fd2bc0c6460 2024-02-17T12:16:21.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.452+0000 7fd2c1400640 1 -- 172.21.15.114:0/313581165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc074840 con 0x7fd2bc0c6460 2024-02-17T12:16:21.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.456+0000 7fd2b3400640 1 -- 172.21.15.114:0/313581165 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd2ac0113f0 con 0x7fd2bc0c6460 2024-02-17T12:16:21.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.456+0000 7fd2b3400640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd298066e40 0x7fd298069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:21.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.456+0000 7fd2b3400640 1 -- 172.21.15.114:0/313581165 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd2ac084cf0 con 0x7fd2bc0c6460 2024-02-17T12:16:21.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.456+0000 7fd2b1e00640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd298066e40 0x7fd298069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:21.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.456+0000 7fd2b1e00640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd298066e40 0x7fd298069300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc071030 tx=0x7fd2a4007d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:21.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.460+0000 7fd2b3400640 1 -- 172.21.15.114:0/313581165 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd2ac051cb0 con 0x7fd2bc0c6460 2024-02-17T12:16:21.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:21.612+0000 7fd2c1400640 1 -- 172.21.15.114:0/313581165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd2bc06e3a0 con 0x7fd2bc0c6460 2024-02-17T12:16:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2b3400640 1 -- 172.21.15.114:0/313581165 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd2ac01e0d0 con 0x7fd2bc0c6460 2024-02-17T12:16:22.286 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-02-17T12:16:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 -- 172.21.15.114:0/313581165 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd298066e40 msgr2=0x7fd298069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd298066e40 0x7fd298069300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc071030 tx=0x7fd2a4007d70 comp rx=0 tx=0).stop 2024-02-17T12:16:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 -- 172.21.15.114:0/313581165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc0c6460 msgr2=0x7fd2bc14bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:22.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc0c6460 0x7fd2bc14bb50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00c7c0 tx=0x7fd2ac00cc80 comp rx=0 tx=0).stop 2024-02-17T12:16:22.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 -- 172.21.15.114:0/313581165 shutdown_connections 2024-02-17T12:16:22.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2bc154e30 0x7fd2bc145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:22.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2bc152540 0x7fd2bc1456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:22.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd298066e40 0x7fd298069300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:22.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 --2- 172.21.15.114:0/313581165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2bc0c6460 0x7fd2bc14bb50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:22.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 -- 172.21.15.114:0/313581165 >> 172.21.15.114:0/313581165 conn(0x7fd2bc0c4f20 msgr2=0x7fd2bc0c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:22.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 -- 172.21.15.114:0/313581165 shutdown_connections 2024-02-17T12:16:22.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.284+0000 7fd2c1400640 1 -- 172.21.15.114:0/313581165 wait complete. 2024-02-17T12:16:22.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-17T12:16:22.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52be00640 1 Processor -- start 2024-02-17T12:16:22.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52be00640 1 -- start start 2024-02-17T12:16:22.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe52c14b830 0x7fe52c0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:22.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52be00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 0x7fe52c156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:22.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52be00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c0c3ad0 con 0x7fe52c156ba0 2024-02-17T12:16:22.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52be00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c0c2e00 con 0x7fe52c14b830 2024-02-17T12:16:22.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52be00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0c30c0 con 0x7fe52c156220 2024-02-17T12:16:22.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe52c14b830 0x7fe52c0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:22.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe52c14b830 0x7fe52c0c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60036/0 (socket says 172.21.15.114:60036) 2024-02-17T12:16:22.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52aa00640 1 -- 172.21.15.114:0/3948094227 learned_addr learned my addr 172.21.15.114:0/3948094227 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:22.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52a000640 1 --2- 172.21.15.114:0/3948094227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 0x7fe52c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:22.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52aa00640 1 -- 172.21.15.114:0/3948094227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 msgr2=0x7fe52c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:22.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52aa00640 1 --2- 172.21.15.114:0/3948094227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 0x7fe52c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:22.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52aa00640 1 -- 172.21.15.114:0/3948094227 >> v1:172.21.15.116:6789/0 conn(0x7fe52c156ba0 legacy=0x7fe52c0c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:22.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.464+0000 7fe52aa00640 1 -- 172.21.15.114:0/3948094227 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c1556a0 con 0x7fe52c14b830 2024-02-17T12:16:22.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe52aa00640 1 --2- 172.21.15.114:0/3948094227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 0x7fe52c0c46c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009e50 tx=0x7fe51c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c204b560fe30688b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:22.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe529600640 1 -- 172.21.15.114:0/3948094227 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0a57f0 con 0x7fe52c14b830 2024-02-17T12:16:22.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe529600640 1 -- 172.21.15.114:0/3948094227 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c0a5950 con 0x7fe52c14b830 2024-02-17T12:16:22.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe529600640 1 -- 172.21.15.114:0/3948094227 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0a5ce0 con 0x7fe52c14b830 2024-02-17T12:16:22.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe52be00640 1 -- 172.21.15.114:0/3948094227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 msgr2=0x7fe52c0c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:22.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe52be00640 1 --2- 172.21.15.114:0/3948094227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 0x7fe52c0c46c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009e50 tx=0x7fe51c01c910 comp rx=0 tx=0).stop 2024-02-17T12:16:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe52be00640 1 -- 172.21.15.114:0/3948094227 shutdown_connections 2024-02-17T12:16:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe52be00640 1 --2- 172.21.15.114:0/3948094227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 0x7fe52c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe52be00640 1 --2- 172.21.15.114:0/3948094227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 0x7fe52c0c46c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe52be00640 1 -- 172.21.15.114:0/3948094227 >> 172.21.15.114:0/3948094227 conn(0x7fe52c066960 msgr2=0x7fe52c066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe52be00640 1 -- 172.21.15.114:0/3948094227 shutdown_connections 2024-02-17T12:16:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.468+0000 7fe52be00640 1 -- 172.21.15.114:0/3948094227 wait complete. 2024-02-17T12:16:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 Processor -- start 2024-02-17T12:16:22.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 -- start start 2024-02-17T12:16:22.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 0x7fe52c154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:22.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 0x7fe52c0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:22.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe52c156ba0 0x7fe52c0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:22.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0abf60 con 0x7fe52c14b830 2024-02-17T12:16:22.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0c7140 con 0x7fe52c156ba0 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0ad410 con 0x7fe52c156220 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 0x7fe52c154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 0x7fe52c154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60038/0 (socket says 172.21.15.114:60038) 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52aa00640 1 -- 172.21.15.114:0/213858926 learned_addr learned my addr 172.21.15.114:0/213858926 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52b400640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe52c156ba0 0x7fe52c0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52a000640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 0x7fe52c0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52aa00640 1 -- 172.21.15.114:0/213858926 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 msgr2=0x7fe52c0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52aa00640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 0x7fe52c0c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52aa00640 1 -- 172.21.15.114:0/213858926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe52c156ba0 msgr2=0x7fe52c0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52aa00640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe52c156ba0 0x7fe52c0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52aa00640 1 -- 172.21.15.114:0/213858926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c009b30 con 0x7fe52c14b830 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52a000640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 0x7fe52c0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52b400640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe52c156ba0 0x7fe52c0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:22.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52aa00640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 0x7fe52c154320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe51c01a540 tx=0x7fe51c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:22.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe522a00640 1 -- 172.21.15.114:0/213858926 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0b8670 con 0x7fe52c14b830 2024-02-17T12:16:22.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe522a00640 1 -- 172.21.15.114:0/213858926 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c0b87d0 con 0x7fe52c14b830 2024-02-17T12:16:22.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe522a00640 1 -- 172.21.15.114:0/213858926 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0b8b80 con 0x7fe52c14b830 2024-02-17T12:16:22.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 -- 172.21.15.114:0/213858926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c0ad170 con 0x7fe52c14b830 2024-02-17T12:16:22.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 -- 172.21.15.114:0/213858926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c155d60 con 0x7fe52c14b830 2024-02-17T12:16:22.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.472+0000 7fe52be00640 1 -- 172.21.15.114:0/213858926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c04eef0 con 0x7fe52c14b830 2024-02-17T12:16:22.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.476+0000 7fe522a00640 1 -- 172.21.15.114:0/213858926 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe51c0b8ce0 con 0x7fe52c14b830 2024-02-17T12:16:22.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.476+0000 7fe522a00640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe508066e70 0x7fe508069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:22.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.476+0000 7fe522a00640 1 -- 172.21.15.114:0/213858926 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe51c1201c0 con 0x7fe52c14b830 2024-02-17T12:16:22.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.476+0000 7fe52a000640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe508066e70 0x7fe508069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:22.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.476+0000 7fe52a000640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe508066e70 0x7fe508069330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe52c067e40 tx=0x7fe514008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:22.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.480+0000 7fe522a00640 1 -- 172.21.15.114:0/213858926 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe51c0ed1a0 con 0x7fe52c14b830 2024-02-17T12:16:22.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:22.668+0000 7fe52be00640 1 -- 172.21.15.114:0/213858926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe52c0c1ff0 con 0x7fe52c14b830 2024-02-17T12:16:23.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.296+0000 7fe522a00640 1 -- 172.21.15.114:0/213858926 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe51c0b53a0 con 0x7fe52c14b830 2024-02-17T12:16:23.307 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 2 and data pool 3 2024-02-17T12:16:23.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.308+0000 7fe52be00640 1 -- 172.21.15.114:0/213858926 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe508066e70 msgr2=0x7fe508069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.308+0000 7fe52be00640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe508066e70 0x7fe508069330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe52c067e40 tx=0x7fe514008040 comp rx=0 tx=0).stop 2024-02-17T12:16:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.308+0000 7fe52be00640 1 -- 172.21.15.114:0/213858926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 msgr2=0x7fe52c154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.308+0000 7fe52be00640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 0x7fe52c154320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe51c01a540 tx=0x7fe51c0196b0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.312+0000 7fe52be00640 1 -- 172.21.15.114:0/213858926 shutdown_connections 2024-02-17T12:16:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.312+0000 7fe52be00640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe52c156ba0 0x7fe52c0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.312+0000 7fe52be00640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe52c156220 0x7fe52c0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.312+0000 7fe52be00640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe508066e70 0x7fe508069330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.312+0000 7fe52be00640 1 --2- 172.21.15.114:0/213858926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe52c14b830 0x7fe52c154320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.312+0000 7fe52be00640 1 -- 172.21.15.114:0/213858926 >> 172.21.15.114:0/213858926 conn(0x7fe52c066960 msgr2=0x7fe52c15ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:23.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.312+0000 7fe52be00640 1 -- 172.21.15.114:0/213858926 shutdown_connections 2024-02-17T12:16:23.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.312+0000 7fe52be00640 1 -- 172.21.15.114:0/213858926 wait complete. 2024-02-17T12:16:23.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:23.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3640c00640 1 Processor -- start 2024-02-17T12:16:23.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3640c00640 1 -- start start 2024-02-17T12:16:23.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3640c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f363c152560 0x7f363c0c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:23.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3640c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363c0723b0 con 0x7f363c1586f0 2024-02-17T12:16:23.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3640c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363c154dc0 con 0x7f363c072b20 2024-02-17T12:16:23.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3640c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c070000 con 0x7f363c152560 2024-02-17T12:16:23.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f363a800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f363c1586f0 0x7f363c158b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58908/0 (socket says 172.21.15.114:58908) 2024-02-17T12:16:23.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f363a800640 1 -- 172.21.15.114:0/1986838368 learned_addr learned my addr 172.21.15.114:0/1986838368 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:23.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3639e00640 1 --2- 172.21.15.114:0/1986838368 >> v2:172.21.15.116:3300/0 conn(0x7f363c152560 0x7f363c0c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:23.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3639400640 1 -- 172.21.15.114:0/1986838368 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577191384 0 0) 0x7f363c0723b0 con 0x7f363c1586f0 2024-02-17T12:16:23.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3639400640 1 -- 172.21.15.114:0/1986838368 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3620003530 con 0x7f363c1586f0 2024-02-17T12:16:23.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3639e00640 1 -- 172.21.15.114:0/1986838368 >> v1:172.21.15.116:6789/0 conn(0x7f363c072b20 legacy=0x7f363c0c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3639e00640 1 -- 172.21.15.114:0/1986838368 >> v1:172.21.15.114:6789/0 conn(0x7f363c1586f0 legacy=0x7f363c158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.476+0000 7f3639e00640 1 -- 172.21.15.114:0/1986838368 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0728e0 con 0x7f363c152560 2024-02-17T12:16:23.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3639e00640 1 --2- 172.21.15.114:0/1986838368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f363c152560 0x7f363c0c17c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f362c0097c0 tx=0x7f362c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bab1394fa7914dd1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:23.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3639400640 1 -- 172.21.15.114:0/1986838368 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c0a4ea0 con 0x7f363c152560 2024-02-17T12:16:23.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3639400640 1 -- 172.21.15.114:0/1986838368 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c0a7050 con 0x7f363c152560 2024-02-17T12:16:23.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3639400640 1 -- 172.21.15.114:0/1986838368 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c0ab820 con 0x7f363c152560 2024-02-17T12:16:23.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3640c00640 1 -- 172.21.15.114:0/1986838368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f363c152560 msgr2=0x7f363c0c17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3640c00640 1 --2- 172.21.15.114:0/1986838368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f363c152560 0x7f363c0c17c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f362c0097c0 tx=0x7f362c01c410 comp rx=0 tx=0).stop 2024-02-17T12:16:23.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3640c00640 1 -- 172.21.15.114:0/1986838368 shutdown_connections 2024-02-17T12:16:23.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3640c00640 1 --2- 172.21.15.114:0/1986838368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f363c152560 0x7f363c0c17c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3640c00640 1 -- 172.21.15.114:0/1986838368 >> 172.21.15.114:0/1986838368 conn(0x7f363c06bef0 msgr2=0x7f363c06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:23.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3640c00640 1 -- 172.21.15.114:0/1986838368 shutdown_connections 2024-02-17T12:16:23.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3640c00640 1 -- 172.21.15.114:0/1986838368 wait complete. 2024-02-17T12:16:23.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3640c00640 1 Processor -- start 2024-02-17T12:16:23.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.480+0000 7f3640c00640 1 -- start start 2024-02-17T12:16:23.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3640c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f363c072b20 0x7f363c151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:23.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3640c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f363c152560 0x7f363c1f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:23.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3640c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f363c1586f0 0x7f363c14f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3640c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c156700 con 0x7f363c152560 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3640c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c151450 con 0x7f363c1586f0 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3640c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363c155ef0 con 0x7f363c072b20 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3633e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f363c152560 0x7f363c1f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3633e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f363c152560 0x7f363c1f0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60050/0 (socket says 172.21.15.114:60050) 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3633e00640 1 -- 172.21.15.114:0/3582995009 learned_addr learned my addr 172.21.15.114:0/3582995009 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f363a800640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f363c1586f0 0x7f363c14f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3639e00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f363c072b20 0x7f363c151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3633e00640 1 -- 172.21.15.114:0/3582995009 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f363c072b20 msgr2=0x7f363c151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3633e00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f363c072b20 0x7f363c151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3633e00640 1 -- 172.21.15.114:0/3582995009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f363c1586f0 msgr2=0x7f363c14f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3633e00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f363c1586f0 0x7f363c14f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3633e00640 1 -- 172.21.15.114:0/3582995009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c009420 con 0x7f363c152560 2024-02-17T12:16:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3633e00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f363c152560 0x7f363c1f0ba0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f362400c370 tx=0x7f362400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3632000640 1 -- 172.21.15.114:0/3582995009 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36240052d0 con 0x7f363c152560 2024-02-17T12:16:23.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3632000640 1 -- 172.21.15.114:0/3582995009 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3624005430 con 0x7f363c152560 2024-02-17T12:16:23.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3640c00640 1 -- 172.21.15.114:0/3582995009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c1520a0 con 0x7f363c152560 2024-02-17T12:16:23.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3632000640 1 -- 172.21.15.114:0/3582995009 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624007260 con 0x7f363c152560 2024-02-17T12:16:23.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3640c00640 1 -- 172.21.15.114:0/3582995009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c156140 con 0x7f363c152560 2024-02-17T12:16:23.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.484+0000 7f3640c00640 1 -- 172.21.15.114:0/3582995009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c067370 con 0x7f363c152560 2024-02-17T12:16:23.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.488+0000 7f3632000640 1 -- 172.21.15.114:0/3582995009 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f36240073c0 con 0x7f363c152560 2024-02-17T12:16:23.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.488+0000 7f3632000640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3618066e70 0x7f3618069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:23.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.488+0000 7f3632000640 1 -- 172.21.15.114:0/3582995009 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3624083d30 con 0x7f363c152560 2024-02-17T12:16:23.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.488+0000 7f3639e00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3618066e70 0x7f3618069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:23.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.488+0000 7f3639e00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3618066e70 0x7f3618069330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f362c0ad000 tx=0x7f362c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:23.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.492+0000 7f3632000640 1 -- 172.21.15.114:0/3582995009 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3624050c00 con 0x7f363c152560 2024-02-17T12:16:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.644+0000 7f3640c00640 1 -- 172.21.15.114:0/3582995009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f363c074840 con 0x7f363c152560 2024-02-17T12:16:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3632000640 1 -- 172.21.15.114:0/3582995009 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16630 (secure 0 0 0) 0x7f36240542c0 con 0x7f363c152560 2024-02-17T12:16:23.651 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:23.651 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:22.673540+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 -- 172.21.15.114:0/3582995009 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3618066e70 msgr2=0x7f3618069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3618066e70 0x7f3618069330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f362c0ad000 tx=0x7f362c0a6000 comp rx=0 tx=0).stop 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 -- 172.21.15.114:0/3582995009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f363c152560 msgr2=0x7f363c1f0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f363c152560 0x7f363c1f0ba0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f362400c370 tx=0x7f362400c830 comp rx=0 tx=0).stop 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 -- 172.21.15.114:0/3582995009 shutdown_connections 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f363c1586f0 0x7f363c14f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3618066e70 0x7f3618069330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f363c152560 0x7f363c1f0ba0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 --2- 172.21.15.114:0/3582995009 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f363c072b20 0x7f363c151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 -- 172.21.15.114:0/3582995009 >> 172.21.15.114:0/3582995009 conn(0x7f363c06bef0 msgr2=0x7f363c06c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 -- 172.21.15.114:0/3582995009 shutdown_connections 2024-02-17T12:16:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.648+0000 7f3640c00640 1 -- 172.21.15.114:0/3582995009 wait complete. 2024-02-17T12:16:23.671 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:23.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.800+0000 7febb3e00640 1 Processor -- start 2024-02-17T12:16:23.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.800+0000 7febb3e00640 1 -- start start 2024-02-17T12:16:23.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febb3e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 0x7febac1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:23.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febb3e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac156270 con 0x7febac0c25a0 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febb3e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac156550 con 0x7febac06db50 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febb3e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac06f090 con 0x7febac152c50 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febb1400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7febac0c25a0 0x7febac06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:58910/0 (socket says 172.21.15.114:58910) 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febb1400640 1 -- 172.21.15.114:0/2123411403 learned_addr learned my addr 172.21.15.114:0/2123411403 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febb1e00640 1 --2- 172.21.15.114:0/2123411403 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 0x7febac1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febabe00640 1 -- 172.21.15.114:0/2123411403 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959864494 0 0) 0x7febac156270 con 0x7febac0c25a0 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febabe00640 1 -- 172.21.15.114:0/2123411403 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb94003530 con 0x7febac0c25a0 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febabe00640 1 -- 172.21.15.114:0/2123411403 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310905113 0 0) 0x7febac156550 con 0x7febac06db50 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febabe00640 1 -- 172.21.15.114:0/2123411403 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febac156270 con 0x7febac06db50 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febb1e00640 1 -- 172.21.15.114:0/2123411403 >> v1:172.21.15.116:6789/0 conn(0x7febac06db50 legacy=0x7febac14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febb1e00640 1 -- 172.21.15.114:0/2123411403 >> v1:172.21.15.114:6789/0 conn(0x7febac0c25a0 legacy=0x7febac06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.804+0000 7febb1e00640 1 -- 172.21.15.114:0/2123411403 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac156830 con 0x7febac152c50 2024-02-17T12:16:23.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febb1e00640 1 --2- 172.21.15.114:0/2123411403 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 0x7febac1530c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feba40097f0 tx=0x7feba401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168588d4d79ee553 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:23.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febabe00640 1 -- 172.21.15.114:0/2123411403 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba40ab600 con 0x7febac152c50 2024-02-17T12:16:23.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febabe00640 1 -- 172.21.15.114:0/2123411403 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba40a7050 con 0x7febac152c50 2024-02-17T12:16:23.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febabe00640 1 -- 172.21.15.114:0/2123411403 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba40ab980 con 0x7febac152c50 2024-02-17T12:16:23.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febb3e00640 1 -- 172.21.15.114:0/2123411403 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 msgr2=0x7febac1530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febb3e00640 1 --2- 172.21.15.114:0/2123411403 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 0x7febac1530c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feba40097f0 tx=0x7feba401c3c0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febb3e00640 1 -- 172.21.15.114:0/2123411403 shutdown_connections 2024-02-17T12:16:23.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febb3e00640 1 --2- 172.21.15.114:0/2123411403 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 0x7febac1530c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febb3e00640 1 -- 172.21.15.114:0/2123411403 >> 172.21.15.114:0/2123411403 conn(0x7febac0a8490 msgr2=0x7febac0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:23.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febb3e00640 1 -- 172.21.15.114:0/2123411403 shutdown_connections 2024-02-17T12:16:23.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febb3e00640 1 -- 172.21.15.114:0/2123411403 wait complete. 2024-02-17T12:16:23.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febb3e00640 1 Processor -- start 2024-02-17T12:16:23.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.808+0000 7febb3e00640 1 -- start start 2024-02-17T12:16:23.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb3e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febac06db50 0x7febac1eb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:23.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febac0c25a0 0x7febac143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:23.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb3e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 0x7febac13aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:23.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb3e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c3fd0 con 0x7febac0c25a0 2024-02-17T12:16:23.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb3e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac1eb910 con 0x7febac06db50 2024-02-17T12:16:23.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb3e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac1ebbf0 con 0x7febac152c50 2024-02-17T12:16:23.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febac0c25a0 0x7febac143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:23.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febac0c25a0 0x7febac143410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60056/0 (socket says 172.21.15.114:60056) 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb0a00640 1 -- 172.21.15.114:0/1681030040 learned_addr learned my addr 172.21.15.114:0/1681030040 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb1400640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febac06db50 0x7febac1eb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb1e00640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 0x7febac13aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb0a00640 1 -- 172.21.15.114:0/1681030040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 msgr2=0x7febac13aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb0a00640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 0x7febac13aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb0a00640 1 -- 172.21.15.114:0/1681030040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febac06db50 msgr2=0x7febac1eb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb0a00640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febac06db50 0x7febac1eb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb0a00640 1 -- 172.21.15.114:0/1681030040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba4009420 con 0x7febac0c25a0 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb0a00640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febac0c25a0 0x7febac143410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c500 tx=0x7feb9800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7feba9600640 1 -- 172.21.15.114:0/1681030040 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980052d0 con 0x7febac0c25a0 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7feba9600640 1 -- 172.21.15.114:0/1681030040 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98005450 con 0x7febac0c25a0 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb3e00640 1 -- 172.21.15.114:0/1681030040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac1ebed0 con 0x7febac0c25a0 2024-02-17T12:16:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7feba9600640 1 -- 172.21.15.114:0/1681030040 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98012870 con 0x7febac0c25a0 2024-02-17T12:16:23.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb3e00640 1 -- 172.21.15.114:0/1681030040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac143950 con 0x7febac0c25a0 2024-02-17T12:16:23.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7febb3e00640 1 -- 172.21.15.114:0/1681030040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac0c4180 con 0x7febac0c25a0 2024-02-17T12:16:23.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.812+0000 7feba9600640 1 -- 172.21.15.114:0/1681030040 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7feb980129d0 con 0x7febac0c25a0 2024-02-17T12:16:23.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.816+0000 7feba9600640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb8c066e70 0x7feb8c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:23.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.816+0000 7feba9600640 1 -- 172.21.15.114:0/1681030040 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb98084680 con 0x7febac0c25a0 2024-02-17T12:16:23.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.816+0000 7febb1400640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb8c066e70 0x7feb8c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:23.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.816+0000 7febb1400640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb8c066e70 0x7feb8c069330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feba0005c10 tx=0x7feba0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:23.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.820+0000 7feba9600640 1 -- 172.21.15.114:0/1681030040 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7febac0c4180 con 0x7febac0c25a0 2024-02-17T12:16:23.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.972+0000 7febb3e00640 1 -- 172.21.15.114:0/1681030040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febac074840 con 0x7febac0c25a0 2024-02-17T12:16:23.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.972+0000 7feba9600640 1 -- 172.21.15.114:0/1681030040 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16630 (secure 0 0 0) 0x7feb98054f10 con 0x7febac0c25a0 2024-02-17T12:16:23.977 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:23.978 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:22.673540+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:23.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 -- 172.21.15.114:0/1681030040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb8c066e70 msgr2=0x7feb8c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb8c066e70 0x7feb8c069330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feba0005c10 tx=0x7feba0009040 comp rx=0 tx=0).stop 2024-02-17T12:16:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 -- 172.21.15.114:0/1681030040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febac0c25a0 msgr2=0x7febac143410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febac0c25a0 0x7febac143410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c500 tx=0x7feb9800c9c0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 -- 172.21.15.114:0/1681030040 shutdown_connections 2024-02-17T12:16:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febac152c50 0x7febac13aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb8c066e70 0x7feb8c069330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febac0c25a0 0x7febac143410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 --2- 172.21.15.114:0/1681030040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febac06db50 0x7febac1eb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 -- 172.21.15.114:0/1681030040 >> 172.21.15.114:0/1681030040 conn(0x7febac0a8490 msgr2=0x7febac06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 -- 172.21.15.114:0/1681030040 shutdown_connections 2024-02-17T12:16:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:23.976+0000 7febb3e00640 1 -- 172.21.15.114:0/1681030040 wait complete. 2024-02-17T12:16:23.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-17T12:16:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.132+0000 7f7b10000640 1 Processor -- start 2024-02-17T12:16:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.132+0000 7f7b10000640 1 -- start start 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.132+0000 7f7b10000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0814f110 0x7f7b080c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.132+0000 7f7b10000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b080c2580 0x7f7b080aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.132+0000 7f7b10000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b080a9420 con 0x7f7b080c1eb0 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.132+0000 7f7b10000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0814f4f0 con 0x7f7b080c2580 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.132+0000 7f7b10000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080aae80 con 0x7f7b0814f110 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.132+0000 7f7b0cc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b080c2580 0x7f7b080aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b0cc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b080c2580 0x7f7b080aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60062/0 (socket says 172.21.15.114:60062) 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b0cc00640 1 -- 172.21.15.114:0/388595198 learned_addr learned my addr 172.21.15.114:0/388595198 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b0d600640 1 --2- 172.21.15.114:0/388595198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0814f110 0x7f7b080c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b0cc00640 1 -- 172.21.15.114:0/388595198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0814f110 msgr2=0x7f7b080c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b0cc00640 1 --2- 172.21.15.114:0/388595198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0814f110 0x7f7b080c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:24.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b0cc00640 1 -- 172.21.15.114:0/388595198 >> v1:172.21.15.116:6789/0 conn(0x7f7b080c1eb0 legacy=0x7f7b08155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:24.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b0cc00640 1 -- 172.21.15.114:0/388595198 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b08152850 con 0x7f7b080c2580 2024-02-17T12:16:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b0cc00640 1 --2- 172.21.15.114:0/388595198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b080c2580 0x7f7b080aa150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009870 tx=0x7f7af401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b83542808439e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b07e00640 1 -- 172.21.15.114:0/388595198 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40ab620 con 0x7f7b080c2580 2024-02-17T12:16:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b07e00640 1 -- 172.21.15.114:0/388595198 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af40ab780 con 0x7f7b080c2580 2024-02-17T12:16:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.136+0000 7f7b07e00640 1 -- 172.21.15.114:0/388595198 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40abb10 con 0x7f7b080c2580 2024-02-17T12:16:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 -- 172.21.15.114:0/388595198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b080c2580 msgr2=0x7f7b080aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 --2- 172.21.15.114:0/388595198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b080c2580 0x7f7b080aa150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009870 tx=0x7f7af401c460 comp rx=0 tx=0).stop 2024-02-17T12:16:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 -- 172.21.15.114:0/388595198 shutdown_connections 2024-02-17T12:16:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 --2- 172.21.15.114:0/388595198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b080c2580 0x7f7b080aa150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 --2- 172.21.15.114:0/388595198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b0814f110 0x7f7b080c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 -- 172.21.15.114:0/388595198 >> 172.21.15.114:0/388595198 conn(0x7f7b080a8490 msgr2=0x7f7b080a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 -- 172.21.15.114:0/388595198 shutdown_connections 2024-02-17T12:16:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 -- 172.21.15.114:0/388595198 wait complete. 2024-02-17T12:16:24.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 Processor -- start 2024-02-17T12:16:24.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 -- start start 2024-02-17T12:16:24.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b080c1eb0 0x7f7b080bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b080c2580 0x7f7b08136ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b0814f110 0x7f7b08137220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0813acf0 con 0x7f7b0814f110 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08137760 con 0x7f7b080c2580 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b081f1310 con 0x7f7b080c1eb0 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b0814f110 0x7f7b08137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b0814f110 0x7f7b08137220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60076/0 (socket says 172.21.15.114:60076) 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0e000640 1 -- 172.21.15.114:0/4268735427 learned_addr learned my addr 172.21.15.114:0/4268735427 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0d600640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b080c1eb0 0x7f7b080bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0cc00640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b080c2580 0x7f7b08136ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0e000640 1 -- 172.21.15.114:0/4268735427 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b080c1eb0 msgr2=0x7f7b080bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0e000640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b080c1eb0 0x7f7b080bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0e000640 1 -- 172.21.15.114:0/4268735427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b080c2580 msgr2=0x7f7b08136ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0e000640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b080c2580 0x7f7b08136ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0e000640 1 -- 172.21.15.114:0/4268735427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af40094d0 con 0x7f7b0814f110 2024-02-17T12:16:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b0e000640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b0814f110 0x7f7b08137220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c780 tx=0x7f7b0000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b05600640 1 -- 172.21.15.114:0/4268735427 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000a9f0 con 0x7f7b0814f110 2024-02-17T12:16:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b05600640 1 -- 172.21.15.114:0/4268735427 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0000ce90 con 0x7f7b0814f110 2024-02-17T12:16:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b05600640 1 -- 172.21.15.114:0/4268735427 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000add0 con 0x7f7b0814f110 2024-02-17T12:16:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.140+0000 7f7b10000640 1 -- 172.21.15.114:0/4268735427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b081f15f0 con 0x7f7b0814f110 2024-02-17T12:16:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.144+0000 7f7b10000640 1 -- 172.21.15.114:0/4268735427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b081f1bb0 con 0x7f7b0814f110 2024-02-17T12:16:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.144+0000 7f7b10000640 1 -- 172.21.15.114:0/4268735427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b08074840 con 0x7f7b0814f110 2024-02-17T12:16:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.144+0000 7f7b05600640 1 -- 172.21.15.114:0/4268735427 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f7b00012420 con 0x7f7b0814f110 2024-02-17T12:16:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.144+0000 7f7b05600640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7ae8066e40 0x7f7ae8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.144+0000 7f7b05600640 1 -- 172.21.15.114:0/4268735427 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b00084760 con 0x7f7b0814f110 2024-02-17T12:16:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.144+0000 7f7b0d600640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7ae8066e40 0x7f7ae8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.144+0000 7f7b0d600640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7ae8066e40 0x7f7ae8069300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0079c0 tx=0x7f7afc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:24.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.148+0000 7f7b05600640 1 -- 172.21.15.114:0/4268735427 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7b000515f0 con 0x7f7b0814f110 2024-02-17T12:16:24.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:24.344+0000 7f7b10000640 1 -- 172.21.15.114:0/4268735427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7b08148f50 con 0x7f7b0814f110 2024-02-17T12:16:25.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.308+0000 7f7b05600640 1 -- 172.21.15.114:0/4268735427 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7b000160b0 con 0x7f7b0814f110 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.308+0000 7f7b10000640 1 -- 172.21.15.114:0/4268735427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7ae8066e40 msgr2=0x7f7ae8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.308+0000 7f7b10000640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7ae8066e40 0x7f7ae8069300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0079c0 tx=0x7f7afc008040 comp rx=0 tx=0).stop 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.308+0000 7f7b10000640 1 -- 172.21.15.114:0/4268735427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b0814f110 msgr2=0x7f7b08137220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.308+0000 7f7b10000640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b0814f110 0x7f7b08137220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c780 tx=0x7f7b0000cc40 comp rx=0 tx=0).stop 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.308+0000 7f7b10000640 1 -- 172.21.15.114:0/4268735427 shutdown_connections 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.312+0000 7f7b10000640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7ae8066e40 0x7f7ae8069300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.312+0000 7f7b10000640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b0814f110 0x7f7b08137220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.312+0000 7f7b10000640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7b080c2580 0x7f7b08136ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.312+0000 7f7b10000640 1 --2- 172.21.15.114:0/4268735427 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7b080c1eb0 0x7f7b080bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.312+0000 7f7b10000640 1 -- 172.21.15.114:0/4268735427 >> 172.21.15.114:0/4268735427 conn(0x7f7b080a8490 msgr2=0x7f7b080a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.312+0000 7f7b10000640 1 -- 172.21.15.114:0/4268735427 shutdown_connections 2024-02-17T12:16:25.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.312+0000 7f7b10000640 1 -- 172.21.15.114:0/4268735427 wait complete. 2024-02-17T12:16:25.335 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-17T12:16:25.335 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-17T12:16:25.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.472+0000 7fe318e00640 1 Processor -- start 2024-02-17T12:16:25.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.472+0000 7fe318e00640 1 -- start start 2024-02-17T12:16:25.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe318e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140a6360 0x7fe3141583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe318e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe314155090 con 0x7fe3140c4b30 2024-02-17T12:16:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe318e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe314159300 con 0x7fe3140c58b0 2024-02-17T12:16:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe318e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140c6110 con 0x7fe3140a6360 2024-02-17T12:16:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe311400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe3140c4b30 0x7fe314155520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45390/0 (socket says 172.21.15.114:45390) 2024-02-17T12:16:25.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe311400640 1 -- 172.21.15.114:0/969115825 learned_addr learned my addr 172.21.15.114:0/969115825 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe312800640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140a6360 0x7fe3141583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252633247 0 0) 0x7fe314155090 con 0x7fe3140c4b30 2024-02-17T12:16:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f8003530 con 0x7fe3140c4b30 2024-02-17T12:16:25.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702379200 0 0) 0x7fe314159300 con 0x7fe3140c58b0 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe314155090 con 0x7fe3140c58b0 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1706748889 0 0) 0x7fe2f8003530 con 0x7fe3140c4b30 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140a6360 msgr2=0x7fe3141583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140a6360 0x7fe3141583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 >> v1:172.21.15.116:6789/0 conn(0x7fe3140c58b0 legacy=0x7fe31406bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314158a60 con 0x7fe3140c4b30 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fe300001680 con 0x7fe3140c4b30 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 >> v1:172.21.15.114:6789/0 conn(0x7fe3140c4b30 legacy=0x7fe314155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f8003b40 0x7fe2f8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f80047d0 0x7fe2f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140a6360 0x7fe2f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f800ba40 con 0x7fe2f8003b40 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f800bb80 con 0x7fe2f80047d0 2024-02-17T12:16:25.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f800bd40 con 0x7fe3140a6360 2024-02-17T12:16:25.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe311e00640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f8003b40 0x7fe2f8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:25.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe312800640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140a6360 0x7fe2f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:25.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe311400640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f80047d0 0x7fe2f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:25.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe311e00640 1 -- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140a6360 msgr2=0x7fe2f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:25.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe311e00640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140a6360 0x7fe2f8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:25.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe311e00640 1 -- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f80047d0 msgr2=0x7fe2f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:25.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe311e00640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f80047d0 0x7fe2f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:25.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe311e00640 1 -- 172.21.15.114:0/969115825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f8003530 con 0x7fe2f8003b40 2024-02-17T12:16:25.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.476+0000 7fe312800640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140a6360 0x7fe2f8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:25.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe311e00640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f8003b40 0x7fe2f8003f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe304001fd0 tx=0x7fe30401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65e3f4dd1a6b356 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:25.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304003b80 con 0x7fe2f8003b40 2024-02-17T12:16:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304003d00 con 0x7fe2f8003b40 2024-02-17T12:16:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe310a00640 1 -- 172.21.15.114:0/969115825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304005310 con 0x7fe2f8003b40 2024-02-17T12:16:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe318e00640 1 -- 172.21.15.114:0/969115825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f8003b40 msgr2=0x7fe2f8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe318e00640 1 --2- 172.21.15.114:0/969115825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f8003b40 0x7fe2f8003f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe304001fd0 tx=0x7fe30401c8d0 comp rx=0 tx=0).stop 2024-02-17T12:16:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe312800640 1 -- 172.21.15.114:0/969115825 reap_dead start 2024-02-17T12:16:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe318e00640 1 -- 172.21.15.114:0/969115825 shutdown_connections 2024-02-17T12:16:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe318e00640 1 -- 172.21.15.114:0/969115825 >> 172.21.15.114:0/969115825 conn(0x7fe3140c3730 msgr2=0x7fe3140c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe318e00640 1 -- 172.21.15.114:0/969115825 shutdown_connections 2024-02-17T12:16:25.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe318e00640 1 -- 172.21.15.114:0/969115825 wait complete. 2024-02-17T12:16:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.480+0000 7fe318e00640 1 Processor -- start 2024-02-17T12:16:25.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe318e00640 1 -- start start 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe318e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f8003b40 0x7fe3141510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe318e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31414ee90 0x7fe31406e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe318e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140ac170 0x7fe31406e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe318e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31414ec40 con 0x7fe31414ee90 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe318e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140ac6a0 con 0x7fe2f8003b40 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe318e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31414e960 con 0x7fe3140ac170 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31414ee90 0x7fe31406e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31414ee90 0x7fe31406e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57446/0 (socket says 172.21.15.114:57446) 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311400640 1 -- 172.21.15.114:0/3468091445 learned_addr learned my addr 172.21.15.114:0/3468091445 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311e00640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f8003b40 0x7fe3141510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:25.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe312800640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140ac170 0x7fe31406e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311400640 1 -- 172.21.15.114:0/3468091445 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140ac170 msgr2=0x7fe31406e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311400640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140ac170 0x7fe31406e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311400640 1 -- 172.21.15.114:0/3468091445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f8003b40 msgr2=0x7fe3141510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311400640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f8003b40 0x7fe3141510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311400640 1 -- 172.21.15.114:0/3468091445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31406f130 con 0x7fe31414ee90 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311e00640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f8003b40 0x7fe3141510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe311400640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31414ee90 0x7fe31406e360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe300004ee0 tx=0x7fe300007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe30a000640 1 -- 172.21.15.114:0/3468091445 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300007740 con 0x7fe31414ee90 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe30a000640 1 -- 172.21.15.114:0/3468091445 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30000f990 con 0x7fe31414ee90 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe318e00640 1 -- 172.21.15.114:0/3468091445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31406f410 con 0x7fe31414ee90 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe30a000640 1 -- 172.21.15.114:0/3468091445 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000fd40 con 0x7fe31414ee90 2024-02-17T12:16:25.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe318e00640 1 -- 172.21.15.114:0/3468091445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe314151a70 con 0x7fe31414ee90 2024-02-17T12:16:25.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.484+0000 7fe318e00640 1 -- 172.21.15.114:0/3468091445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe314067170 con 0x7fe31414ee90 2024-02-17T12:16:25.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.488+0000 7fe30a000640 1 -- 172.21.15.114:0/3468091445 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe30001d460 con 0x7fe31414ee90 2024-02-17T12:16:25.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.488+0000 7fe30a000640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2f4066e70 0x7fe2f4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:25.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.488+0000 7fe30a000640 1 -- 172.21.15.114:0/3468091445 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe300084ad0 con 0x7fe31414ee90 2024-02-17T12:16:25.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.488+0000 7fe311e00640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2f4066e70 0x7fe2f4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:25.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.488+0000 7fe311e00640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2f4066e70 0x7fe2f4069330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe3040ad000 tx=0x7fe3040a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:25.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.492+0000 7fe30a000640 1 -- 172.21.15.114:0/3468091445 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe3000518b0 con 0x7fe31414ee90 2024-02-17T12:16:25.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:25.676+0000 7fe318e00640 1 -- 172.21.15.114:0/3468091445 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe314074840 con 0x7fe31414ee90 2024-02-17T12:16:26.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.308+0000 7fe30a000640 1 -- 172.21.15.114:0/3468091445 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe30000fea0 con 0x7fe31414ee90 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 -- 172.21.15.114:0/3468091445 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2f4066e70 msgr2=0x7fe2f4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2f4066e70 0x7fe2f4069330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe3040ad000 tx=0x7fe3040a7000 comp rx=0 tx=0).stop 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 -- 172.21.15.114:0/3468091445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31414ee90 msgr2=0x7fe31406e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31414ee90 0x7fe31406e360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe300004ee0 tx=0x7fe300007430 comp rx=0 tx=0).stop 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 -- 172.21.15.114:0/3468091445 shutdown_connections 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3140ac170 0x7fe31406e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2f4066e70 0x7fe2f4069330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe31414ee90 0x7fe31406e360 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 --2- 172.21.15.114:0/3468091445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f8003b40 0x7fe3141510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 -- 172.21.15.114:0/3468091445 >> 172.21.15.114:0/3468091445 conn(0x7fe3140c3730 msgr2=0x7fe3140c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 -- 172.21.15.114:0/3468091445 shutdown_connections 2024-02-17T12:16:26.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.312+0000 7fe318e00640 1 -- 172.21.15.114:0/3468091445 wait complete. 2024-02-17T12:16:26.375 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-17T12:16:26.375 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:16:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.508+0000 7f3a3a000640 1 Processor -- start 2024-02-17T12:16:26.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.508+0000 7f3a3a000640 1 -- start start 2024-02-17T12:16:26.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.508+0000 7f3a3a000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a3414f110 0x7f3a340c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a3a000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3a340c2580 0x7f3a340aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a3a000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a340c1eb0 0x7f3a34155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a3a000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a3414f4f0 con 0x7f3a340c1eb0 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a3a000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a340aae80 con 0x7f3a340c2580 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a3a000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340a9420 con 0x7f3a3414f110 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a340c1eb0 0x7f3a34155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3a340c1eb0 0x7f3a34155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57452/0 (socket says 172.21.15.114:57452) 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33e00640 1 -- 172.21.15.114:0/3029454869 learned_addr learned my addr 172.21.15.114:0/3029454869 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a2aa00640 1 --2- 172.21.15.114:0/3029454869 >> v2:172.21.15.116:3300/0 conn(0x7f3a340c2580 0x7f3a340aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33400640 1 --2- 172.21.15.114:0/3029454869 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a3414f110 0x7f3a340c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33e00640 1 -- 172.21.15.114:0/3029454869 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a3414f110 msgr2=0x7f3a340c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33e00640 1 --2- 172.21.15.114:0/3029454869 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a3414f110 0x7f3a340c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33e00640 1 -- 172.21.15.114:0/3029454869 >> v2:172.21.15.116:3300/0 conn(0x7f3a340c2580 msgr2=0x7f3a340aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:26.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33e00640 1 --2- 172.21.15.114:0/3029454869 >> v2:172.21.15.116:3300/0 conn(0x7f3a340c2580 0x7f3a340aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33e00640 1 -- 172.21.15.114:0/3029454869 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34152850 con 0x7f3a340c1eb0 2024-02-17T12:16:26.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a2aa00640 1 --2- 172.21.15.114:0/3029454869 >> v2:172.21.15.116:3300/0 conn(0x7f3a340c2580 0x7f3a340aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:26.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33400640 1 --2- 172.21.15.114:0/3029454869 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a3414f110 0x7f3a340c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a33e00640 1 --2- 172.21.15.114:0/3029454869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a340c1eb0 0x7f3a34155000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3a340a91c0 tx=0x7f3a2c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e408bbf862b9f9ba server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a32a00640 1 -- 172.21.15.114:0/3029454869 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0ab620 con 0x7f3a340c1eb0 2024-02-17T12:16:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a32a00640 1 -- 172.21.15.114:0/3029454869 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c0ab780 con 0x7f3a340c1eb0 2024-02-17T12:16:26.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.512+0000 7f3a32a00640 1 -- 172.21.15.114:0/3029454869 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0abb10 con 0x7f3a340c1eb0 2024-02-17T12:16:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 -- 172.21.15.114:0/3029454869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a340c1eb0 msgr2=0x7f3a34155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 --2- 172.21.15.114:0/3029454869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a340c1eb0 0x7f3a34155000 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3a340a91c0 tx=0x7f3a2c01c460 comp rx=0 tx=0).stop 2024-02-17T12:16:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 -- 172.21.15.114:0/3029454869 shutdown_connections 2024-02-17T12:16:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 --2- 172.21.15.114:0/3029454869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a340c1eb0 0x7f3a34155000 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 --2- 172.21.15.114:0/3029454869 >> v2:172.21.15.116:3300/0 conn(0x7f3a340c2580 0x7f3a340aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 --2- 172.21.15.114:0/3029454869 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a3414f110 0x7f3a340c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 -- 172.21.15.114:0/3029454869 >> 172.21.15.114:0/3029454869 conn(0x7f3a340a8490 msgr2=0x7f3a340a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 -- 172.21.15.114:0/3029454869 shutdown_connections 2024-02-17T12:16:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 -- 172.21.15.114:0/3029454869 wait complete. 2024-02-17T12:16:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 Processor -- start 2024-02-17T12:16:26.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 -- start start 2024-02-17T12:16:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a340c1eb0 0x7f3a341ee500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a340c2580 0x7f3a34072520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a3414f110 0x7f3a34150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3414a7e0 con 0x7f3a3414f110 2024-02-17T12:16:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a341eea40 con 0x7f3a340c2580 2024-02-17T12:16:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a3a000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a341eda50 con 0x7f3a340c1eb0 2024-02-17T12:16:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a3414f110 0x7f3a34150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a3414f110 0x7f3a34150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57460/0 (socket says 172.21.15.114:57460) 2024-02-17T12:16:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33e00640 1 -- 172.21.15.114:0/2789137412 learned_addr learned my addr 172.21.15.114:0/2789137412 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:26.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33400640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a340c1eb0 0x7f3a341ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a2aa00640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a340c2580 0x7f3a34072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33e00640 1 -- 172.21.15.114:0/2789137412 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a340c1eb0 msgr2=0x7f3a341ee500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33e00640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a340c1eb0 0x7f3a341ee500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33e00640 1 -- 172.21.15.114:0/2789137412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a340c2580 msgr2=0x7f3a34072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33e00640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a340c2580 0x7f3a34072520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33e00640 1 -- 172.21.15.114:0/2789137412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0094d0 con 0x7f3a3414f110 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33400640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a340c1eb0 0x7f3a341ee500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a2aa00640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a340c2580 0x7f3a34072520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.516+0000 7f3a33e00640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a3414f110 0x7f3a34150680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0ad040 tx=0x7f3a2c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.520+0000 7f3a2be00640 1 -- 172.21.15.114:0/2789137412 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0abe80 con 0x7f3a3414f110 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.520+0000 7f3a2be00640 1 -- 172.21.15.114:0/2789137412 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c0be3f0 con 0x7f3a3414f110 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.520+0000 7f3a2be00640 1 -- 172.21.15.114:0/2789137412 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0be780 con 0x7f3a3414f110 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.520+0000 7f3a3a000640 1 -- 172.21.15.114:0/2789137412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3414a220 con 0x7f3a3414f110 2024-02-17T12:16:26.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.520+0000 7f3a3a000640 1 -- 172.21.15.114:0/2789137412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a341edd00 con 0x7f3a3414f110 2024-02-17T12:16:26.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.520+0000 7f3a3a000640 1 -- 172.21.15.114:0/2789137412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a34074840 con 0x7f3a3414f110 2024-02-17T12:16:26.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.520+0000 7f3a2be00640 1 -- 172.21.15.114:0/2789137412 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3a2c0c7440 con 0x7f3a3414f110 2024-02-17T12:16:26.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.520+0000 7f3a2be00640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3a10066e40 0x7f3a10069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.520+0000 7f3a2be00640 1 -- 172.21.15.114:0/2789137412 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a2c11f3b0 con 0x7f3a3414f110 2024-02-17T12:16:26.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.520+0000 7f3a33400640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3a10066e40 0x7f3a10069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.524+0000 7f3a33400640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3a10066e40 0x7f3a10069300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400e3d0 tx=0x7f3a24007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:26.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.524+0000 7f3a2be00640 1 -- 172.21.15.114:0/2789137412 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3a2c0ec190 con 0x7f3a3414f110 2024-02-17T12:16:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.708+0000 7f3a3a000640 1 -- 172.21.15.114:0/2789137412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a3415c170 con 0x7f3a3414f110 2024-02-17T12:16:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a2be00640 1 -- 172.21.15.114:0/2789137412 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f3a2c0ef850 con 0x7f3a3414f110 2024-02-17T12:16:26.714 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:26.714 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4241624725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4241624725},{"type":"v1","addr":"172.21.15.114:6837","nonce":4241624725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/178899564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":178899564},{"type":"v1","addr":"172.21.15.114:6836","nonce":178899564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/3301698475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3301698475},{"type":"v1","addr":"172.21.15.116:6834","nonce":3301698475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:16:22.673862+0000","modified":"2024-02-17T12:16:25.681621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6835/4001468997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":4001468997},{"type":"v1","addr":"172.21.15.116:6835","nonce":4001468997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:16:26.715 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-02-17T12:16:26.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 -- 172.21.15.114:0/2789137412 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3a10066e40 msgr2=0x7f3a10069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3a10066e40 0x7f3a10069300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400e3d0 tx=0x7f3a24007a10 comp rx=0 tx=0).stop 2024-02-17T12:16:26.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 -- 172.21.15.114:0/2789137412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a3414f110 msgr2=0x7f3a34150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a3414f110 0x7f3a34150680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0ad040 tx=0x7f3a2c01aca0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 -- 172.21.15.114:0/2789137412 shutdown_connections 2024-02-17T12:16:26.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3a10066e40 0x7f3a10069300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a3414f110 0x7f3a34150680 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a340c2580 0x7f3a34072520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 --2- 172.21.15.114:0/2789137412 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3a340c1eb0 0x7f3a341ee500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 -- 172.21.15.114:0/2789137412 >> 172.21.15.114:0/2789137412 conn(0x7f3a340a8490 msgr2=0x7f3a340c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:26.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 -- 172.21.15.114:0/2789137412 shutdown_connections 2024-02-17T12:16:26.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.712+0000 7f3a3a000640 1 -- 172.21.15.114:0/2789137412 wait complete. 2024-02-17T12:16:26.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:26.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.864+0000 7f018ec00640 1 Processor -- start 2024-02-17T12:16:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.864+0000 7f018ec00640 1 -- start start 2024-02-17T12:16:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.864+0000 7f018ec00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f018806db50 0x7f018814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f018ec00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0188156270 con 0x7f01880c25a0 2024-02-17T12:16:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f018ec00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0188156550 con 0x7f0188150490 2024-02-17T12:16:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f018ec00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018806f090 con 0x7f018806db50 2024-02-17T12:16:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f0187e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f01880c25a0 0x7f018806e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45406/0 (socket says 172.21.15.114:45406) 2024-02-17T12:16:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f0187e00640 1 -- 172.21.15.114:0/3319270023 learned_addr learned my addr 172.21.15.114:0/3319270023 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f0187400640 1 --2- 172.21.15.114:0/3319270023 >> v2:172.21.15.116:3300/0 conn(0x7f018806db50 0x7f018814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f0186a00640 1 -- 172.21.15.114:0/3319270023 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908298978 0 0) 0x7f0188156270 con 0x7f01880c25a0 2024-02-17T12:16:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f0186a00640 1 -- 172.21.15.114:0/3319270023 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f016c003530 con 0x7f01880c25a0 2024-02-17T12:16:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f0187400640 1 -- 172.21.15.114:0/3319270023 >> v1:172.21.15.116:6789/0 conn(0x7f0188150490 legacy=0x7f0188152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f0187400640 1 -- 172.21.15.114:0/3319270023 >> v1:172.21.15.114:6789/0 conn(0x7f01880c25a0 legacy=0x7f018806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f0187400640 1 -- 172.21.15.114:0/3319270023 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188156830 con 0x7f018806db50 2024-02-17T12:16:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.868+0000 7f0187400640 1 --2- 172.21.15.114:0/3319270023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f018806db50 0x7f018814ff50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f01780097c0 tx=0x7f017801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5679f7e9e91fc6f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0186a00640 1 -- 172.21.15.114:0/3319270023 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780ab600 con 0x7f018806db50 2024-02-17T12:16:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0186a00640 1 -- 172.21.15.114:0/3319270023 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01780a7050 con 0x7f018806db50 2024-02-17T12:16:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0186a00640 1 -- 172.21.15.114:0/3319270023 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780ab960 con 0x7f018806db50 2024-02-17T12:16:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 -- 172.21.15.114:0/3319270023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f018806db50 msgr2=0x7f018814ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 --2- 172.21.15.114:0/3319270023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f018806db50 0x7f018814ff50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f01780097c0 tx=0x7f017801c380 comp rx=0 tx=0).stop 2024-02-17T12:16:26.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 -- 172.21.15.114:0/3319270023 shutdown_connections 2024-02-17T12:16:26.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 --2- 172.21.15.114:0/3319270023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f018806db50 0x7f018814ff50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 -- 172.21.15.114:0/3319270023 >> 172.21.15.114:0/3319270023 conn(0x7f01880a8490 msgr2=0x7f01880a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:26.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 -- 172.21.15.114:0/3319270023 shutdown_connections 2024-02-17T12:16:26.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 -- 172.21.15.114:0/3319270023 wait complete. 2024-02-17T12:16:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 Processor -- start 2024-02-17T12:16:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 -- start start 2024-02-17T12:16:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f018806db50 0x7f01881430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01880c25a0 0x7f01880c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0188150490 0x7f01881518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188151460 con 0x7f01880c25a0 2024-02-17T12:16:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880aa5f0 con 0x7f018806db50 2024-02-17T12:16:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018ec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01880aa890 con 0x7f0188150490 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0187400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01880c25a0 0x7f01880c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0187400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01880c25a0 0x7f01880c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57474/0 (socket says 172.21.15.114:57474) 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0187400640 1 -- 172.21.15.114:0/4111173587 learned_addr learned my addr 172.21.15.114:0/4111173587 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0187e00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f018806db50 0x7f01881430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f018cc00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0188150490 0x7f01881518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0187400640 1 -- 172.21.15.114:0/4111173587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0188150490 msgr2=0x7f01881518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0187400640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0188150490 0x7f01881518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0187400640 1 -- 172.21.15.114:0/4111173587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f018806db50 msgr2=0x7f01881430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0187400640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f018806db50 0x7f01881430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0187400640 1 -- 172.21.15.114:0/4111173587 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178009420 con 0x7f01880c25a0 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.872+0000 7f0187e00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f018806db50 0x7f01881430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f0187400640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01880c25a0 0x7f01880c47c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0178018f90 tx=0x7f017801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f017fe00640 1 -- 172.21.15.114:0/4111173587 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178003af0 con 0x7f01880c25a0 2024-02-17T12:16:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f017fe00640 1 -- 172.21.15.114:0/4111173587 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0178003c50 con 0x7f01880c25a0 2024-02-17T12:16:26.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f017fe00640 1 -- 172.21.15.114:0/4111173587 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780b5440 con 0x7f01880c25a0 2024-02-17T12:16:26.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f018ec00640 1 -- 172.21.15.114:0/4111173587 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01880a9b00 con 0x7f01880c25a0 2024-02-17T12:16:26.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f018ec00640 1 -- 172.21.15.114:0/4111173587 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01880aa0c0 con 0x7f01880c25a0 2024-02-17T12:16:26.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f018ec00640 1 -- 172.21.15.114:0/4111173587 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01881515d0 con 0x7f01880c25a0 2024-02-17T12:16:26.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f017fe00640 1 -- 172.21.15.114:0/4111173587 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f01780b55a0 con 0x7f01880c25a0 2024-02-17T12:16:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f017fe00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0164066e40 0x7f0164069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f017fe00640 1 -- 172.21.15.114:0/4111173587 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f017811e960 con 0x7f01880c25a0 2024-02-17T12:16:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.876+0000 7f0187e00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0164066e40 0x7f0164069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.880+0000 7f0187e00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0164066e40 0x7f0164069300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01700011f0 tx=0x7f0170009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:26.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:26.880+0000 7f017fe00640 1 -- 172.21.15.114:0/4111173587 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f01881515d0 con 0x7f01880c25a0 2024-02-17T12:16:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 -- 172.21.15.114:0/4111173587 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01881515a0 con 0x7f01880c25a0 2024-02-17T12:16:27.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f017fe00640 1 -- 172.21.15.114:0/4111173587 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f01780b9090 con 0x7f01880c25a0 2024-02-17T12:16:27.043 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:27.043 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:27.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 -- 172.21.15.114:0/4111173587 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0164066e40 msgr2=0x7f0164069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0164066e40 0x7f0164069300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01700011f0 tx=0x7f0170009040 comp rx=0 tx=0).stop 2024-02-17T12:16:27.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 -- 172.21.15.114:0/4111173587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01880c25a0 msgr2=0x7f01880c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01880c25a0 0x7f01880c47c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0178018f90 tx=0x7f017801abc0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 -- 172.21.15.114:0/4111173587 shutdown_connections 2024-02-17T12:16:27.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0188150490 0x7f01881518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0164066e40 0x7f0164069300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01880c25a0 0x7f01880c47c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 --2- 172.21.15.114:0/4111173587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f018806db50 0x7f01881430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 -- 172.21.15.114:0/4111173587 >> 172.21.15.114:0/4111173587 conn(0x7f01880a8490 msgr2=0x7f01880c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:27.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 -- 172.21.15.114:0/4111173587 shutdown_connections 2024-02-17T12:16:27.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.040+0000 7f018ec00640 1 -- 172.21.15.114:0/4111173587 wait complete. 2024-02-17T12:16:27.064 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T12:16:27.064 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:16:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.192+0000 7f9623e00640 1 Processor -- start 2024-02-17T12:16:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.192+0000 7f9623e00640 1 -- start start 2024-02-17T12:16:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9623e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 0x7f9624156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9623e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9624072d50 0x7f96240c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9623e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9624153250 con 0x7f9624070b60 2024-02-17T12:16:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9623e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9624156730 con 0x7f9624072d50 2024-02-17T12:16:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9623e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96240731c0 con 0x7f962413be90 2024-02-17T12:16:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f961be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9624070b60 0x7f9624152b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45414/0 (socket says 172.21.15.114:45414) 2024-02-17T12:16:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f961be00640 1 -- 172.21.15.114:0/1307526654 learned_addr learned my addr 172.21.15.114:0/1307526654 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9622a00640 1 --2- 172.21.15.114:0/1307526654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 0x7f9624156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9623400640 1 --2- 172.21.15.114:0/1307526654 >> v2:172.21.15.116:3300/0 conn(0x7f9624072d50 0x7f96240c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9622000640 1 -- 172.21.15.114:0/1307526654 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027774580 0 0) 0x7f9624153250 con 0x7f9624070b60 2024-02-17T12:16:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9622000640 1 -- 172.21.15.114:0/1307526654 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9608003530 con 0x7f9624070b60 2024-02-17T12:16:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9622a00640 1 -- 172.21.15.114:0/1307526654 >> v2:172.21.15.116:3300/0 conn(0x7f9624072d50 msgr2=0x7f96240c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9622a00640 1 --2- 172.21.15.114:0/1307526654 >> v2:172.21.15.116:3300/0 conn(0x7f9624072d50 0x7f96240c3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9622a00640 1 -- 172.21.15.114:0/1307526654 >> v1:172.21.15.114:6789/0 conn(0x7f9624070b60 legacy=0x7f9624152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.196+0000 7f9622a00640 1 -- 172.21.15.114:0/1307526654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962406e780 con 0x7f962413be90 2024-02-17T12:16:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9622a00640 1 --2- 172.21.15.114:0/1307526654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 0x7f9624156b50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f96140097c0 tx=0x7f961401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894b52b5bb1b2156 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9622000640 1 -- 172.21.15.114:0/1307526654 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96140ac640 con 0x7f962413be90 2024-02-17T12:16:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9622000640 1 -- 172.21.15.114:0/1307526654 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96140ac7a0 con 0x7f962413be90 2024-02-17T12:16:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9622000640 1 -- 172.21.15.114:0/1307526654 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96140acb30 con 0x7f962413be90 2024-02-17T12:16:27.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 -- 172.21.15.114:0/1307526654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 msgr2=0x7f9624156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 --2- 172.21.15.114:0/1307526654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 0x7f9624156b50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f96140097c0 tx=0x7f961401c3e0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 -- 172.21.15.114:0/1307526654 shutdown_connections 2024-02-17T12:16:27.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 --2- 172.21.15.114:0/1307526654 >> v2:172.21.15.116:3300/0 conn(0x7f9624072d50 0x7f96240c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 --2- 172.21.15.114:0/1307526654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 0x7f9624156b50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 -- 172.21.15.114:0/1307526654 >> 172.21.15.114:0/1307526654 conn(0x7f96240a8660 msgr2=0x7f96240a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:27.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 -- 172.21.15.114:0/1307526654 shutdown_connections 2024-02-17T12:16:27.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 -- 172.21.15.114:0/1307526654 wait complete. 2024-02-17T12:16:27.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 Processor -- start 2024-02-17T12:16:27.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 -- start start 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9624070b60 0x7f9624155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9624072d50 0x7f96241ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 0x7f96241323b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240a9600 con 0x7f9624072d50 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962414f6b0 con 0x7f9624070b60 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.200+0000 7f9623e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9624132d90 con 0x7f962413be90 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9624072d50 0x7f96241ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9624072d50 0x7f96241ed2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57478/0 (socket says 172.21.15.114:57478) 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961be00640 1 -- 172.21.15.114:0/205705793 learned_addr learned my addr 172.21.15.114:0/205705793 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f9622a00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9624070b60 0x7f9624155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f9623400640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 0x7f96241323b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961be00640 1 -- 172.21.15.114:0/205705793 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 msgr2=0x7f96241323b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961be00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 0x7f96241323b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961be00640 1 -- 172.21.15.114:0/205705793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9624070b60 msgr2=0x7f9624155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961be00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9624070b60 0x7f9624155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961be00640 1 -- 172.21.15.114:0/205705793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614009420 con 0x7f9624072d50 2024-02-17T12:16:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961be00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9624072d50 0x7f96241ed2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f960c00c3c0 tx=0x7f960c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961aa00640 1 -- 172.21.15.114:0/205705793 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c005cf0 con 0x7f9624072d50 2024-02-17T12:16:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961aa00640 1 -- 172.21.15.114:0/205705793 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c005e50 con 0x7f9624072d50 2024-02-17T12:16:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961aa00640 1 -- 172.21.15.114:0/205705793 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c0072f0 con 0x7f9624072d50 2024-02-17T12:16:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f9623e00640 1 -- 172.21.15.114:0/205705793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9624155bc0 con 0x7f9624072d50 2024-02-17T12:16:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f9623e00640 1 -- 172.21.15.114:0/205705793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96241f1580 con 0x7f9624072d50 2024-02-17T12:16:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f9623e00640 1 -- 172.21.15.114:0/205705793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962404eef0 con 0x7f9624072d50 2024-02-17T12:16:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961aa00640 1 -- 172.21.15.114:0/205705793 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f960c007450 con 0x7f9624072d50 2024-02-17T12:16:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961aa00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9600066e40 0x7f9600069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.204+0000 7f961aa00640 1 -- 172.21.15.114:0/205705793 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f960c083fa0 con 0x7f9624072d50 2024-02-17T12:16:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.208+0000 7f9622a00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9600066e40 0x7f9600069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.208+0000 7f9622a00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9600066e40 0x7f9600069300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f96140ae000 tx=0x7f96140a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:27.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.208+0000 7f961aa00640 1 -- 172.21.15.114:0/205705793 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f960c050e30 con 0x7f9624072d50 2024-02-17T12:16:27.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.364+0000 7f9623e00640 1 -- 172.21.15.114:0/205705793 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f962413c270 con 0x7f9600066e40 2024-02-17T12:16:27.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.372+0000 7f961aa00640 1 -- 172.21.15.114:0/205705793 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264637 (secure 0 0 0) 0x7f96140ba070 con 0x7f9600066e40 2024-02-17T12:16:27.378 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:27.380 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:16:27.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 -- 172.21.15.114:0/205705793 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9600066e40 msgr2=0x7f9600069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9600066e40 0x7f9600069300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f96140ae000 tx=0x7f96140a7000 comp rx=0 tx=0).stop 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 -- 172.21.15.114:0/205705793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9624072d50 msgr2=0x7f96241ed2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9624072d50 0x7f96241ed2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f960c00c3c0 tx=0x7f960c00c880 comp rx=0 tx=0).stop 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 -- 172.21.15.114:0/205705793 shutdown_connections 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f962413be90 0x7f96241323b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9600066e40 0x7f9600069300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9624072d50 0x7f96241ed2c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 --2- 172.21.15.114:0/205705793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9624070b60 0x7f9624155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 -- 172.21.15.114:0/205705793 >> 172.21.15.114:0/205705793 conn(0x7f96240a8660 msgr2=0x7f962413aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 -- 172.21.15.114:0/205705793 shutdown_connections 2024-02-17T12:16:27.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.376+0000 7f9623e00640 1 -- 172.21.15.114:0/205705793 wait complete. 2024-02-17T12:16:27.397 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-02-17T12:16:27.218253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223132,"kb_used_data":2796,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751588,"statfs":{"total":773094113280,"available":772865626112,"internally_reserved":0,"allocated":2863104,"data_stored":1734384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.939785"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.328203+0000","last_change":"2024-02-17T12:16:23.325932+0000","last_active":"2024-02-17T12:16:23.328203+0000","last_peered":"2024-02-17T12:16:23.328203+0000","last_clean":"2024-02-17T12:16:23.328203+0000","last_became_active":"2024-02-17T12:16:23.325577+0000","last_became_peered":"2024-02-17T12:16:23.325577+0000","last_unstale":"2024-02-17T12:16:23.328203+0000","last_undegraded":"2024-02-17T12:16:23.328203+0000","last_fullsized":"2024-02-17T12:16:23.328203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:00:31.347354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309102+0000","last_change":"2024-02-17T12:16:23.313730+0000","last_active":"2024-02-17T12:16:24.309102+0000","last_peered":"2024-02-17T12:16:24.309102+0000","last_clean":"2024-02-17T12:16:24.309102+0000","last_became_active":"2024-02-17T12:16:23.313417+0000","last_became_peered":"2024-02-17T12:16:23.313417+0000","last_unstale":"2024-02-17T12:16:24.309102+0000","last_undegraded":"2024-02-17T12:16:24.309102+0000","last_fullsized":"2024-02-17T12:16:24.309102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698256+0000","last_change":"2024-02-17T12:16:23.309155+0000","last_active":"2024-02-17T12:16:24.698256+0000","last_peered":"2024-02-17T12:16:24.698256+0000","last_clean":"2024-02-17T12:16:24.698256+0000","last_became_active":"2024-02-17T12:16:23.308921+0000","last_became_peered":"2024-02-17T12:16:23.308921+0000","last_unstale":"2024-02-17T12:16:24.698256+0000","last_undegraded":"2024-02-17T12:16:24.698256+0000","last_fullsized":"2024-02-17T12:16:24.698256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308527+0000","last_change":"2024-02-17T12:16:23.315338+0000","last_active":"2024-02-17T12:16:24.308527+0000","last_peered":"2024-02-17T12:16:24.308527+0000","last_clean":"2024-02-17T12:16:24.308527+0000","last_became_active":"2024-02-17T12:16:23.314200+0000","last_became_peered":"2024-02-17T12:16:23.314200+0000","last_unstale":"2024-02-17T12:16:24.308527+0000","last_undegraded":"2024-02-17T12:16:24.308527+0000","last_fullsized":"2024-02-17T12:16:24.308527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.328571+0000","last_change":"2024-02-17T12:16:23.324821+0000","last_active":"2024-02-17T12:16:23.328571+0000","last_peered":"2024-02-17T12:16:23.328571+0000","last_clean":"2024-02-17T12:16:23.328571+0000","last_became_active":"2024-02-17T12:16:23.324550+0000","last_became_peered":"2024-02-17T12:16:23.324550+0000","last_unstale":"2024-02-17T12:16:23.328571+0000","last_undegraded":"2024-02-17T12:16:23.328571+0000","last_fullsized":"2024-02-17T12:16:23.328571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:28.464918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309180+0000","last_change":"2024-02-17T12:16:23.305539+0000","last_active":"2024-02-17T12:16:24.309180+0000","last_peered":"2024-02-17T12:16:24.309180+0000","last_clean":"2024-02-17T12:16:24.309180+0000","last_became_active":"2024-02-17T12:16:23.304577+0000","last_became_peered":"2024-02-17T12:16:23.304577+0000","last_unstale":"2024-02-17T12:16:24.309180+0000","last_undegraded":"2024-02-17T12:16:24.309180+0000","last_fullsized":"2024-02-17T12:16:24.309180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:01.247987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.321171+0000","last_change":"2024-02-17T12:16:23.319882+0000","last_active":"2024-02-17T12:16:23.321171+0000","last_peered":"2024-02-17T12:16:23.321171+0000","last_clean":"2024-02-17T12:16:23.321171+0000","last_became_active":"2024-02-17T12:16:23.319575+0000","last_became_peered":"2024-02-17T12:16:23.319575+0000","last_unstale":"2024-02-17T12:16:23.321171+0000","last_undegraded":"2024-02-17T12:16:23.321171+0000","last_fullsized":"2024-02-17T12:16:23.321171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:41:23.756204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697223+0000","last_change":"2024-02-17T12:16:23.322275+0000","last_active":"2024-02-17T12:16:24.697223+0000","last_peered":"2024-02-17T12:16:24.697223+0000","last_clean":"2024-02-17T12:16:24.697223+0000","last_became_active":"2024-02-17T12:16:23.321923+0000","last_became_peered":"2024-02-17T12:16:23.321923+0000","last_unstale":"2024-02-17T12:16:24.697223+0000","last_undegraded":"2024-02-17T12:16:24.697223+0000","last_fullsized":"2024-02-17T12:16:24.697223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:05:10.254057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.329591+0000","last_change":"2024-02-17T12:16:23.326757+0000","last_active":"2024-02-17T12:16:23.329591+0000","last_peered":"2024-02-17T12:16:23.329591+0000","last_clean":"2024-02-17T12:16:23.329591+0000","last_became_active":"2024-02-17T12:16:23.326481+0000","last_became_peered":"2024-02-17T12:16:23.326481+0000","last_unstale":"2024-02-17T12:16:23.329591+0000","last_undegraded":"2024-02-17T12:16:23.329591+0000","last_fullsized":"2024-02-17T12:16:23.329591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:55:52.492849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335654+0000","last_change":"2024-02-17T12:16:23.321138+0000","last_active":"2024-02-17T12:16:24.335654+0000","last_peered":"2024-02-17T12:16:24.335654+0000","last_clean":"2024-02-17T12:16:24.335654+0000","last_became_active":"2024-02-17T12:16:23.320619+0000","last_became_peered":"2024-02-17T12:16:23.320619+0000","last_unstale":"2024-02-17T12:16:24.335654+0000","last_undegraded":"2024-02-17T12:16:24.335654+0000","last_fullsized":"2024-02-17T12:16:24.335654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335398+0000","last_change":"2024-02-17T12:16:23.318226+0000","last_active":"2024-02-17T12:16:24.335398+0000","last_peered":"2024-02-17T12:16:24.335398+0000","last_clean":"2024-02-17T12:16:24.335398+0000","last_became_active":"2024-02-17T12:16:23.317955+0000","last_became_peered":"2024-02-17T12:16:23.317955+0000","last_unstale":"2024-02-17T12:16:24.335398+0000","last_undegraded":"2024-02-17T12:16:24.335398+0000","last_fullsized":"2024-02-17T12:16:24.335398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.324095+0000","last_change":"2024-02-17T12:16:23.319482+0000","last_active":"2024-02-17T12:16:23.324095+0000","last_peered":"2024-02-17T12:16:23.324095+0000","last_clean":"2024-02-17T12:16:23.324095+0000","last_became_active":"2024-02-17T12:16:23.318713+0000","last_became_peered":"2024-02-17T12:16:23.318713+0000","last_unstale":"2024-02-17T12:16:23.324095+0000","last_undegraded":"2024-02-17T12:16:23.324095+0000","last_fullsized":"2024-02-17T12:16:23.324095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:46:26.458115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697727+0000","last_change":"2024-02-17T12:16:23.322232+0000","last_active":"2024-02-17T12:16:24.697727+0000","last_peered":"2024-02-17T12:16:24.697727+0000","last_clean":"2024-02-17T12:16:24.697727+0000","last_became_active":"2024-02-17T12:16:23.321953+0000","last_became_peered":"2024-02-17T12:16:23.321953+0000","last_unstale":"2024-02-17T12:16:24.697727+0000","last_undegraded":"2024-02-17T12:16:24.697727+0000","last_fullsized":"2024-02-17T12:16:24.697727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697309+0000","last_change":"2024-02-17T12:16:23.305025+0000","last_active":"2024-02-17T12:16:24.697309+0000","last_peered":"2024-02-17T12:16:24.697309+0000","last_clean":"2024-02-17T12:16:24.697309+0000","last_became_active":"2024-02-17T12:16:23.303792+0000","last_became_peered":"2024-02-17T12:16:23.303792+0000","last_unstale":"2024-02-17T12:16:24.697309+0000","last_undegraded":"2024-02-17T12:16:24.697309+0000","last_fullsized":"2024-02-17T12:16:24.697309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:14.503722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308712+0000","last_change":"2024-02-17T12:16:23.318017+0000","last_active":"2024-02-17T12:16:24.308712+0000","last_peered":"2024-02-17T12:16:24.308712+0000","last_clean":"2024-02-17T12:16:24.308712+0000","last_became_active":"2024-02-17T12:16:23.317749+0000","last_became_peered":"2024-02-17T12:16:23.317749+0000","last_unstale":"2024-02-17T12:16:24.308712+0000","last_undegraded":"2024-02-17T12:16:24.308712+0000","last_fullsized":"2024-02-17T12:16:24.308712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308269+0000","last_change":"2024-02-17T12:16:23.299929+0000","last_active":"2024-02-17T12:16:24.308269+0000","last_peered":"2024-02-17T12:16:24.308269+0000","last_clean":"2024-02-17T12:16:24.308269+0000","last_became_active":"2024-02-17T12:16:23.299612+0000","last_became_peered":"2024-02-17T12:16:23.299612+0000","last_unstale":"2024-02-17T12:16:24.308269+0000","last_undegraded":"2024-02-17T12:16:24.308269+0000","last_fullsized":"2024-02-17T12:16:24.308269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309347+0000","last_change":"2024-02-17T12:16:23.314723+0000","last_active":"2024-02-17T12:16:24.309347+0000","last_peered":"2024-02-17T12:16:24.309347+0000","last_clean":"2024-02-17T12:16:24.309347+0000","last_became_active":"2024-02-17T12:16:23.310139+0000","last_became_peered":"2024-02-17T12:16:23.310139+0000","last_unstale":"2024-02-17T12:16:24.309347+0000","last_undegraded":"2024-02-17T12:16:24.309347+0000","last_fullsized":"2024-02-17T12:16:24.309347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:51:35.647773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.315294+0000","last_change":"2024-02-17T12:16:23.312040+0000","last_active":"2024-02-17T12:16:23.315294+0000","last_peered":"2024-02-17T12:16:23.315294+0000","last_clean":"2024-02-17T12:16:23.315294+0000","last_became_active":"2024-02-17T12:16:23.311701+0000","last_became_peered":"2024-02-17T12:16:23.311701+0000","last_unstale":"2024-02-17T12:16:23.315294+0000","last_undegraded":"2024-02-17T12:16:23.315294+0000","last_fullsized":"2024-02-17T12:16:23.315294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:16.035071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.319903+0000","last_change":"2024-02-17T12:16:23.317094+0000","last_active":"2024-02-17T12:16:23.319903+0000","last_peered":"2024-02-17T12:16:23.319903+0000","last_clean":"2024-02-17T12:16:23.319903+0000","last_became_active":"2024-02-17T12:16:23.316715+0000","last_became_peered":"2024-02-17T12:16:23.316715+0000","last_unstale":"2024-02-17T12:16:23.319903+0000","last_undegraded":"2024-02-17T12:16:23.319903+0000","last_fullsized":"2024-02-17T12:16:23.319903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:48.589620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335321+0000","last_change":"2024-02-17T12:16:23.314602+0000","last_active":"2024-02-17T12:16:24.335321+0000","last_peered":"2024-02-17T12:16:24.335321+0000","last_clean":"2024-02-17T12:16:24.335321+0000","last_became_active":"2024-02-17T12:16:23.310646+0000","last_became_peered":"2024-02-17T12:16:23.310646+0000","last_unstale":"2024-02-17T12:16:24.335321+0000","last_undegraded":"2024-02-17T12:16:24.335321+0000","last_fullsized":"2024-02-17T12:16:24.335321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697556+0000","last_change":"2024-02-17T12:16:23.314985+0000","last_active":"2024-02-17T12:16:24.697556+0000","last_peered":"2024-02-17T12:16:24.697556+0000","last_clean":"2024-02-17T12:16:24.697556+0000","last_became_active":"2024-02-17T12:16:23.314105+0000","last_became_peered":"2024-02-17T12:16:23.314105+0000","last_unstale":"2024-02-17T12:16:24.697556+0000","last_undegraded":"2024-02-17T12:16:24.697556+0000","last_fullsized":"2024-02-17T12:16:24.697556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308459+0000","last_change":"2024-02-17T12:16:23.316273+0000","last_active":"2024-02-17T12:16:24.308459+0000","last_peered":"2024-02-17T12:16:24.308459+0000","last_clean":"2024-02-17T12:16:24.308459+0000","last_became_active":"2024-02-17T12:16:23.315991+0000","last_became_peered":"2024-02-17T12:16:23.315991+0000","last_unstale":"2024-02-17T12:16:24.308459+0000","last_undegraded":"2024-02-17T12:16:24.308459+0000","last_fullsized":"2024-02-17T12:16:24.308459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697276+0000","last_change":"2024-02-17T12:16:23.310525+0000","last_active":"2024-02-17T12:16:24.697276+0000","last_peered":"2024-02-17T12:16:24.697276+0000","last_clean":"2024-02-17T12:16:24.697276+0000","last_became_active":"2024-02-17T12:16:23.309291+0000","last_became_peered":"2024-02-17T12:16:23.309291+0000","last_unstale":"2024-02-17T12:16:24.697276+0000","last_undegraded":"2024-02-17T12:16:24.697276+0000","last_fullsized":"2024-02-17T12:16:24.697276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308457+0000","last_change":"2024-02-17T12:16:23.319218+0000","last_active":"2024-02-17T12:16:24.308457+0000","last_peered":"2024-02-17T12:16:24.308457+0000","last_clean":"2024-02-17T12:16:24.308457+0000","last_became_active":"2024-02-17T12:16:23.310787+0000","last_became_peered":"2024-02-17T12:16:23.310787+0000","last_unstale":"2024-02-17T12:16:24.308457+0000","last_undegraded":"2024-02-17T12:16:24.308457+0000","last_fullsized":"2024-02-17T12:16:24.308457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697807+0000","last_change":"2024-02-17T12:16:23.310020+0000","last_active":"2024-02-17T12:16:24.697807+0000","last_peered":"2024-02-17T12:16:24.697807+0000","last_clean":"2024-02-17T12:16:24.697807+0000","last_became_active":"2024-02-17T12:16:23.309245+0000","last_became_peered":"2024-02-17T12:16:23.309245+0000","last_unstale":"2024-02-17T12:16:24.697807+0000","last_undegraded":"2024-02-17T12:16:24.697807+0000","last_fullsized":"2024-02-17T12:16:24.697807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335664+0000","last_change":"2024-02-17T12:16:23.321247+0000","last_active":"2024-02-17T12:16:24.335664+0000","last_peered":"2024-02-17T12:16:24.335664+0000","last_clean":"2024-02-17T12:16:24.335664+0000","last_became_active":"2024-02-17T12:16:23.312610+0000","last_became_peered":"2024-02-17T12:16:23.312610+0000","last_unstale":"2024-02-17T12:16:24.335664+0000","last_undegraded":"2024-02-17T12:16:24.335664+0000","last_fullsized":"2024-02-17T12:16:24.335664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308908+0000","last_change":"2024-02-17T12:16:23.316684+0000","last_active":"2024-02-17T12:16:24.308908+0000","last_peered":"2024-02-17T12:16:24.308908+0000","last_clean":"2024-02-17T12:16:24.308908+0000","last_became_active":"2024-02-17T12:16:23.316394+0000","last_became_peered":"2024-02-17T12:16:23.316394+0000","last_unstale":"2024-02-17T12:16:24.308908+0000","last_undegraded":"2024-02-17T12:16:24.308908+0000","last_fullsized":"2024-02-17T12:16:24.308908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698031+0000","last_change":"2024-02-17T12:16:23.316206+0000","last_active":"2024-02-17T12:16:24.698031+0000","last_peered":"2024-02-17T12:16:24.698031+0000","last_clean":"2024-02-17T12:16:24.698031+0000","last_became_active":"2024-02-17T12:16:23.315874+0000","last_became_peered":"2024-02-17T12:16:23.315874+0000","last_unstale":"2024-02-17T12:16:24.698031+0000","last_undegraded":"2024-02-17T12:16:24.698031+0000","last_fullsized":"2024-02-17T12:16:24.698031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:26:24.802958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697690+0000","last_change":"2024-02-17T12:16:23.307339+0000","last_active":"2024-02-17T12:16:24.697690+0000","last_peered":"2024-02-17T12:16:24.697690+0000","last_clean":"2024-02-17T12:16:24.697690+0000","last_became_active":"2024-02-17T12:16:23.306943+0000","last_became_peered":"2024-02-17T12:16:23.306943+0000","last_unstale":"2024-02-17T12:16:24.697690+0000","last_undegraded":"2024-02-17T12:16:24.697690+0000","last_fullsized":"2024-02-17T12:16:24.697690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308650+0000","last_change":"2024-02-17T12:16:23.304998+0000","last_active":"2024-02-17T12:16:24.308650+0000","last_peered":"2024-02-17T12:16:24.308650+0000","last_clean":"2024-02-17T12:16:24.308650+0000","last_became_active":"2024-02-17T12:16:23.304059+0000","last_became_peered":"2024-02-17T12:16:23.304059+0000","last_unstale":"2024-02-17T12:16:24.308650+0000","last_undegraded":"2024-02-17T12:16:24.308650+0000","last_fullsized":"2024-02-17T12:16:24.308650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.316325+0000","last_change":"2024-02-17T12:16:23.315379+0000","last_active":"2024-02-17T12:16:23.316325+0000","last_peered":"2024-02-17T12:16:23.316325+0000","last_clean":"2024-02-17T12:16:23.316325+0000","last_became_active":"2024-02-17T12:16:23.309626+0000","last_became_peered":"2024-02-17T12:16:23.309626+0000","last_unstale":"2024-02-17T12:16:23.316325+0000","last_undegraded":"2024-02-17T12:16:23.316325+0000","last_fullsized":"2024-02-17T12:16:23.316325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:34:19.518606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335196+0000","last_change":"2024-02-17T12:16:23.320903+0000","last_active":"2024-02-17T12:16:24.335196+0000","last_peered":"2024-02-17T12:16:24.335196+0000","last_clean":"2024-02-17T12:16:24.335196+0000","last_became_active":"2024-02-17T12:16:23.312623+0000","last_became_peered":"2024-02-17T12:16:23.312623+0000","last_unstale":"2024-02-17T12:16:24.335196+0000","last_undegraded":"2024-02-17T12:16:24.335196+0000","last_fullsized":"2024-02-17T12:16:24.335196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.317596+0000","last_change":"2024-02-17T12:16:23.306808+0000","last_active":"2024-02-17T12:16:23.317596+0000","last_peered":"2024-02-17T12:16:23.317596+0000","last_clean":"2024-02-17T12:16:23.317596+0000","last_became_active":"2024-02-17T12:16:23.306117+0000","last_became_peered":"2024-02-17T12:16:23.306117+0000","last_unstale":"2024-02-17T12:16:23.317596+0000","last_undegraded":"2024-02-17T12:16:23.317596+0000","last_fullsized":"2024-02-17T12:16:23.317596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:49:53.581925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697993+0000","last_change":"2024-02-17T12:16:22.314696+0000","last_active":"2024-02-17T12:16:24.697993+0000","last_peered":"2024-02-17T12:16:24.697993+0000","last_clean":"2024-02-17T12:16:24.697993+0000","last_became_active":"2024-02-17T12:16:22.314066+0000","last_became_peered":"2024-02-17T12:16:22.314066+0000","last_unstale":"2024-02-17T12:16:24.697993+0000","last_undegraded":"2024-02-17T12:16:24.697993+0000","last_fullsized":"2024-02-17T12:16:24.697993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:07:14.946092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697825+0000","last_change":"2024-02-17T12:16:23.303172+0000","last_active":"2024-02-17T12:16:24.697825+0000","last_peered":"2024-02-17T12:16:24.697825+0000","last_clean":"2024-02-17T12:16:24.697825+0000","last_became_active":"2024-02-17T12:16:23.302807+0000","last_became_peered":"2024-02-17T12:16:23.302807+0000","last_unstale":"2024-02-17T12:16:24.697825+0000","last_undegraded":"2024-02-17T12:16:24.697825+0000","last_fullsized":"2024-02-17T12:16:24.697825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335506+0000","last_change":"2024-02-17T12:16:22.314969+0000","last_active":"2024-02-17T12:16:24.335506+0000","last_peered":"2024-02-17T12:16:24.335506+0000","last_clean":"2024-02-17T12:16:24.335506+0000","last_became_active":"2024-02-17T12:16:22.313531+0000","last_became_peered":"2024-02-17T12:16:22.313531+0000","last_unstale":"2024-02-17T12:16:24.335506+0000","last_undegraded":"2024-02-17T12:16:24.335506+0000","last_fullsized":"2024-02-17T12:16:24.335506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697645+0000","last_change":"2024-02-17T12:16:22.311648+0000","last_active":"2024-02-17T12:16:24.697645+0000","last_peered":"2024-02-17T12:16:24.697645+0000","last_clean":"2024-02-17T12:16:24.697645+0000","last_became_active":"2024-02-17T12:16:22.311355+0000","last_became_peered":"2024-02-17T12:16:22.311355+0000","last_unstale":"2024-02-17T12:16:24.697645+0000","last_undegraded":"2024-02-17T12:16:24.697645+0000","last_fullsized":"2024-02-17T12:16:24.697645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:43.722209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697379+0000","last_change":"2024-02-17T12:16:23.311561+0000","last_active":"2024-02-17T12:16:24.697379+0000","last_peered":"2024-02-17T12:16:24.697379+0000","last_clean":"2024-02-17T12:16:24.697379+0000","last_became_active":"2024-02-17T12:16:23.311338+0000","last_became_peered":"2024-02-17T12:16:23.311338+0000","last_unstale":"2024-02-17T12:16:24.697379+0000","last_undegraded":"2024-02-17T12:16:24.697379+0000","last_fullsized":"2024-02-17T12:16:24.697379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308598+0000","last_change":"2024-02-17T12:16:22.315021+0000","last_active":"2024-02-17T12:16:24.308598+0000","last_peered":"2024-02-17T12:16:24.308598+0000","last_clean":"2024-02-17T12:16:24.308598+0000","last_became_active":"2024-02-17T12:16:22.314690+0000","last_became_peered":"2024-02-17T12:16:22.314690+0000","last_unstale":"2024-02-17T12:16:24.308598+0000","last_undegraded":"2024-02-17T12:16:24.308598+0000","last_fullsized":"2024-02-17T12:16:24.308598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:49.705448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308577+0000","last_change":"2024-02-17T12:16:23.312450+0000","last_active":"2024-02-17T12:16:24.308577+0000","last_peered":"2024-02-17T12:16:24.308577+0000","last_clean":"2024-02-17T12:16:24.308577+0000","last_became_active":"2024-02-17T12:16:23.312162+0000","last_became_peered":"2024-02-17T12:16:23.312162+0000","last_unstale":"2024-02-17T12:16:24.308577+0000","last_undegraded":"2024-02-17T12:16:24.308577+0000","last_fullsized":"2024-02-17T12:16:24.308577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335521+0000","last_change":"2024-02-17T12:16:22.316581+0000","last_active":"2024-02-17T12:16:24.335521+0000","last_peered":"2024-02-17T12:16:24.335521+0000","last_clean":"2024-02-17T12:16:24.335521+0000","last_became_active":"2024-02-17T12:16:22.316238+0000","last_became_peered":"2024-02-17T12:16:22.316238+0000","last_unstale":"2024-02-17T12:16:24.335521+0000","last_undegraded":"2024-02-17T12:16:24.335521+0000","last_fullsized":"2024-02-17T12:16:24.335521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:41.148188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309008+0000","last_change":"2024-02-17T12:16:23.313962+0000","last_active":"2024-02-17T12:16:24.309008+0000","last_peered":"2024-02-17T12:16:24.309008+0000","last_clean":"2024-02-17T12:16:24.309008+0000","last_became_active":"2024-02-17T12:16:23.313661+0000","last_became_peered":"2024-02-17T12:16:23.313661+0000","last_unstale":"2024-02-17T12:16:24.309008+0000","last_undegraded":"2024-02-17T12:16:24.309008+0000","last_fullsized":"2024-02-17T12:16:24.309008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:25:31.899460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309088+0000","last_change":"2024-02-17T12:16:22.312851+0000","last_active":"2024-02-17T12:16:24.309088+0000","last_peered":"2024-02-17T12:16:24.309088+0000","last_clean":"2024-02-17T12:16:24.309088+0000","last_became_active":"2024-02-17T12:16:22.312536+0000","last_became_peered":"2024-02-17T12:16:22.312536+0000","last_unstale":"2024-02-17T12:16:24.309088+0000","last_undegraded":"2024-02-17T12:16:24.309088+0000","last_fullsized":"2024-02-17T12:16:24.309088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:49:36.146858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698343+0000","last_change":"2024-02-17T12:16:23.319340+0000","last_active":"2024-02-17T12:16:24.698343+0000","last_peered":"2024-02-17T12:16:24.698343+0000","last_clean":"2024-02-17T12:16:24.698343+0000","last_became_active":"2024-02-17T12:16:23.318684+0000","last_became_peered":"2024-02-17T12:16:23.318684+0000","last_unstale":"2024-02-17T12:16:24.698343+0000","last_undegraded":"2024-02-17T12:16:24.698343+0000","last_fullsized":"2024-02-17T12:16:24.698343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308813+0000","last_change":"2024-02-17T12:16:22.313946+0000","last_active":"2024-02-17T12:16:24.308813+0000","last_peered":"2024-02-17T12:16:24.308813+0000","last_clean":"2024-02-17T12:16:24.308813+0000","last_became_active":"2024-02-17T12:16:22.313538+0000","last_became_peered":"2024-02-17T12:16:22.313538+0000","last_unstale":"2024-02-17T12:16:24.308813+0000","last_undegraded":"2024-02-17T12:16:24.308813+0000","last_fullsized":"2024-02-17T12:16:24.308813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.324117+0000","last_change":"2024-02-17T12:16:23.319708+0000","last_active":"2024-02-17T12:16:23.324117+0000","last_peered":"2024-02-17T12:16:23.324117+0000","last_clean":"2024-02-17T12:16:23.324117+0000","last_became_active":"2024-02-17T12:16:23.319152+0000","last_became_peered":"2024-02-17T12:16:23.319152+0000","last_unstale":"2024-02-17T12:16:23.324117+0000","last_undegraded":"2024-02-17T12:16:23.324117+0000","last_fullsized":"2024-02-17T12:16:23.324117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:05:02.924461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335292+0000","last_change":"2024-02-17T12:16:22.316733+0000","last_active":"2024-02-17T12:16:24.335292+0000","last_peered":"2024-02-17T12:16:24.335292+0000","last_clean":"2024-02-17T12:16:24.335292+0000","last_became_active":"2024-02-17T12:16:22.316383+0000","last_became_peered":"2024-02-17T12:16:22.316383+0000","last_unstale":"2024-02-17T12:16:24.335292+0000","last_undegraded":"2024-02-17T12:16:24.335292+0000","last_fullsized":"2024-02-17T12:16:24.335292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:53.726477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.329035+0000","last_change":"2024-02-17T12:16:23.326192+0000","last_active":"2024-02-17T12:16:23.329035+0000","last_peered":"2024-02-17T12:16:23.329035+0000","last_clean":"2024-02-17T12:16:23.329035+0000","last_became_active":"2024-02-17T12:16:23.325827+0000","last_became_peered":"2024-02-17T12:16:23.325827+0000","last_unstale":"2024-02-17T12:16:23.329035+0000","last_undegraded":"2024-02-17T12:16:23.329035+0000","last_fullsized":"2024-02-17T12:16:23.329035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:03:04.322625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697923+0000","last_change":"2024-02-17T12:16:22.310529+0000","last_active":"2024-02-17T12:16:24.697923+0000","last_peered":"2024-02-17T12:16:24.697923+0000","last_clean":"2024-02-17T12:16:24.697923+0000","last_became_active":"2024-02-17T12:16:22.310162+0000","last_became_peered":"2024-02-17T12:16:22.310162+0000","last_unstale":"2024-02-17T12:16:24.697923+0000","last_undegraded":"2024-02-17T12:16:24.697923+0000","last_fullsized":"2024-02-17T12:16:24.697923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:43.722209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697455+0000","last_change":"2024-02-17T12:16:23.313637+0000","last_active":"2024-02-17T12:16:24.697455+0000","last_peered":"2024-02-17T12:16:24.697455+0000","last_clean":"2024-02-17T12:16:24.697455+0000","last_became_active":"2024-02-17T12:16:23.313038+0000","last_became_peered":"2024-02-17T12:16:23.313038+0000","last_unstale":"2024-02-17T12:16:24.697455+0000","last_undegraded":"2024-02-17T12:16:24.697455+0000","last_fullsized":"2024-02-17T12:16:24.697455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:05:10.254057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308728+0000","last_change":"2024-02-17T12:16:22.315490+0000","last_active":"2024-02-17T12:16:24.308728+0000","last_peered":"2024-02-17T12:16:24.308728+0000","last_clean":"2024-02-17T12:16:24.308728+0000","last_became_active":"2024-02-17T12:16:22.315194+0000","last_became_peered":"2024-02-17T12:16:22.315194+0000","last_unstale":"2024-02-17T12:16:24.308728+0000","last_undegraded":"2024-02-17T12:16:24.308728+0000","last_fullsized":"2024-02-17T12:16:24.308728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.328547+0000","last_change":"2024-02-17T12:16:23.324173+0000","last_active":"2024-02-17T12:16:23.328547+0000","last_peered":"2024-02-17T12:16:23.328547+0000","last_clean":"2024-02-17T12:16:23.328547+0000","last_became_active":"2024-02-17T12:16:23.323675+0000","last_became_peered":"2024-02-17T12:16:23.323675+0000","last_unstale":"2024-02-17T12:16:23.328547+0000","last_undegraded":"2024-02-17T12:16:23.328547+0000","last_fullsized":"2024-02-17T12:16:23.328547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:38.274099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335182+0000","last_change":"2024-02-17T12:16:22.316662+0000","last_active":"2024-02-17T12:16:24.335182+0000","last_peered":"2024-02-17T12:16:24.335182+0000","last_clean":"2024-02-17T12:16:24.335182+0000","last_became_active":"2024-02-17T12:16:22.315202+0000","last_became_peered":"2024-02-17T12:16:22.315202+0000","last_unstale":"2024-02-17T12:16:24.335182+0000","last_undegraded":"2024-02-17T12:16:24.335182+0000","last_fullsized":"2024-02-17T12:16:24.335182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335242+0000","last_change":"2024-02-17T12:16:23.320591+0000","last_active":"2024-02-17T12:16:24.335242+0000","last_peered":"2024-02-17T12:16:24.335242+0000","last_clean":"2024-02-17T12:16:24.335242+0000","last_became_active":"2024-02-17T12:16:23.312514+0000","last_became_peered":"2024-02-17T12:16:23.312514+0000","last_unstale":"2024-02-17T12:16:24.335242+0000","last_undegraded":"2024-02-17T12:16:24.335242+0000","last_fullsized":"2024-02-17T12:16:24.335242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.341575+0000","last_change":"2024-02-17T12:16:22.302813+0000","last_active":"2024-02-17T12:16:23.341575+0000","last_peered":"2024-02-17T12:16:23.341575+0000","last_clean":"2024-02-17T12:16:23.341575+0000","last_became_active":"2024-02-17T12:16:22.302538+0000","last_became_peered":"2024-02-17T12:16:22.302538+0000","last_unstale":"2024-02-17T12:16:23.341575+0000","last_undegraded":"2024-02-17T12:16:23.341575+0000","last_fullsized":"2024-02-17T12:16:23.341575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:49:52.576082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.328376+0000","last_change":"2024-02-17T12:16:23.325642+0000","last_active":"2024-02-17T12:16:23.328376+0000","last_peered":"2024-02-17T12:16:23.328376+0000","last_clean":"2024-02-17T12:16:23.328376+0000","last_became_active":"2024-02-17T12:16:23.324419+0000","last_became_peered":"2024-02-17T12:16:23.324419+0000","last_unstale":"2024-02-17T12:16:23.328376+0000","last_undegraded":"2024-02-17T12:16:23.328376+0000","last_fullsized":"2024-02-17T12:16:23.328376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:44:33.890408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.335066+0000","last_change":"2024-02-17T12:16:22.311089+0000","last_active":"2024-02-17T12:16:23.335066+0000","last_peered":"2024-02-17T12:16:23.335066+0000","last_clean":"2024-02-17T12:16:23.335066+0000","last_became_active":"2024-02-17T12:16:22.310811+0000","last_became_peered":"2024-02-17T12:16:22.310811+0000","last_unstale":"2024-02-17T12:16:23.335066+0000","last_undegraded":"2024-02-17T12:16:23.335066+0000","last_fullsized":"2024-02-17T12:16:23.335066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:21:58.929168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.331593+0000","last_change":"2024-02-17T12:16:23.327054+0000","last_active":"2024-02-17T12:16:23.331593+0000","last_peered":"2024-02-17T12:16:23.331593+0000","last_clean":"2024-02-17T12:16:23.331593+0000","last_became_active":"2024-02-17T12:16:23.325063+0000","last_became_peered":"2024-02-17T12:16:23.325063+0000","last_unstale":"2024-02-17T12:16:23.331593+0000","last_undegraded":"2024-02-17T12:16:23.331593+0000","last_fullsized":"2024-02-17T12:16:23.331593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:45:05.523772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.339442+0000","last_change":"2024-02-17T12:16:22.307414+0000","last_active":"2024-02-17T12:16:23.339442+0000","last_peered":"2024-02-17T12:16:23.339442+0000","last_clean":"2024-02-17T12:16:23.339442+0000","last_became_active":"2024-02-17T12:16:22.306916+0000","last_became_peered":"2024-02-17T12:16:22.306916+0000","last_unstale":"2024-02-17T12:16:23.339442+0000","last_undegraded":"2024-02-17T12:16:23.339442+0000","last_fullsized":"2024-02-17T12:16:23.339442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:05:01.918619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.330874+0000","last_change":"2024-02-17T12:16:23.327878+0000","last_active":"2024-02-17T12:16:23.330874+0000","last_peered":"2024-02-17T12:16:23.330874+0000","last_clean":"2024-02-17T12:16:23.330874+0000","last_became_active":"2024-02-17T12:16:23.327225+0000","last_became_peered":"2024-02-17T12:16:23.327225+0000","last_unstale":"2024-02-17T12:16:23.330874+0000","last_undegraded":"2024-02-17T12:16:23.330874+0000","last_fullsized":"2024-02-17T12:16:23.330874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:49:55.517905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308913+0000","last_change":"2024-02-17T12:16:22.314711+0000","last_active":"2024-02-17T12:16:24.308913+0000","last_peered":"2024-02-17T12:16:24.308913+0000","last_clean":"2024-02-17T12:16:24.308913+0000","last_became_active":"2024-02-17T12:16:22.314441+0000","last_became_peered":"2024-02-17T12:16:22.314441+0000","last_unstale":"2024-02-17T12:16:24.308913+0000","last_undegraded":"2024-02-17T12:16:24.308913+0000","last_fullsized":"2024-02-17T12:16:24.308913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:53.726477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308939+0000","last_change":"2024-02-17T12:16:23.315096+0000","last_active":"2024-02-17T12:16:24.308939+0000","last_peered":"2024-02-17T12:16:24.308939+0000","last_clean":"2024-02-17T12:16:24.308939+0000","last_became_active":"2024-02-17T12:16:23.309975+0000","last_became_peered":"2024-02-17T12:16:23.309975+0000","last_unstale":"2024-02-17T12:16:24.308939+0000","last_undegraded":"2024-02-17T12:16:24.308939+0000","last_fullsized":"2024-02-17T12:16:24.308939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:18:14.299788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.300089+0000","last_change":"2024-02-17T12:16:22.310563+0000","last_active":"2024-02-17T12:16:23.300089+0000","last_peered":"2024-02-17T12:16:23.300089+0000","last_clean":"2024-02-17T12:16:23.300089+0000","last_became_active":"2024-02-17T12:16:22.310275+0000","last_became_peered":"2024-02-17T12:16:22.310275+0000","last_unstale":"2024-02-17T12:16:23.300089+0000","last_undegraded":"2024-02-17T12:16:23.300089+0000","last_fullsized":"2024-02-17T12:16:23.300089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:46:25.452272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.331439+0000","last_change":"2024-02-17T12:16:23.330066+0000","last_active":"2024-02-17T12:16:23.331439+0000","last_peered":"2024-02-17T12:16:23.331439+0000","last_clean":"2024-02-17T12:16:23.331439+0000","last_became_active":"2024-02-17T12:16:23.329816+0000","last_became_peered":"2024-02-17T12:16:23.329816+0000","last_unstale":"2024-02-17T12:16:23.331439+0000","last_undegraded":"2024-02-17T12:16:23.331439+0000","last_fullsized":"2024-02-17T12:16:23.331439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:56:09.917959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.307723+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:16:23.307723+0000","last_peered":"2024-02-17T12:16:23.307723+0000","last_clean":"2024-02-17T12:16:23.307723+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:16:23.307723+0000","last_undegraded":"2024-02-17T12:16:23.307723+0000","last_fullsized":"2024-02-17T12:16:23.307723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308410+0000","last_change":"2024-02-17T12:16:22.308615+0000","last_active":"2024-02-17T12:16:24.308410+0000","last_peered":"2024-02-17T12:16:24.308410+0000","last_clean":"2024-02-17T12:16:24.308410+0000","last_became_active":"2024-02-17T12:16:22.308153+0000","last_became_peered":"2024-02-17T12:16:22.308153+0000","last_unstale":"2024-02-17T12:16:24.308410+0000","last_undegraded":"2024-02-17T12:16:24.308410+0000","last_fullsized":"2024-02-17T12:16:24.308410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:05.491487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697598+0000","last_change":"2024-02-17T12:16:23.311520+0000","last_active":"2024-02-17T12:16:24.697598+0000","last_peered":"2024-02-17T12:16:24.697598+0000","last_clean":"2024-02-17T12:16:24.697598+0000","last_became_active":"2024-02-17T12:16:23.311139+0000","last_became_peered":"2024-02-17T12:16:23.311139+0000","last_unstale":"2024-02-17T12:16:24.697598+0000","last_undegraded":"2024-02-17T12:16:24.697598+0000","last_fullsized":"2024-02-17T12:16:24.697598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.307653+0000","last_change":"2024-02-17T12:16:22.324920+0000","last_active":"2024-02-17T12:16:23.307653+0000","last_peered":"2024-02-17T12:16:23.307653+0000","last_clean":"2024-02-17T12:16:23.307653+0000","last_became_active":"2024-02-17T12:16:22.324670+0000","last_became_peered":"2024-02-17T12:16:22.324670+0000","last_unstale":"2024-02-17T12:16:23.307653+0000","last_undegraded":"2024-02-17T12:16:23.307653+0000","last_fullsized":"2024-02-17T12:16:23.307653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:44:55.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697257+0000","last_change":"2024-02-17T12:16:23.303047+0000","last_active":"2024-02-17T12:16:24.697257+0000","last_peered":"2024-02-17T12:16:24.697257+0000","last_clean":"2024-02-17T12:16:24.697257+0000","last_became_active":"2024-02-17T12:16:23.302661+0000","last_became_peered":"2024-02-17T12:16:23.302661+0000","last_unstale":"2024-02-17T12:16:24.697257+0000","last_undegraded":"2024-02-17T12:16:24.697257+0000","last_fullsized":"2024-02-17T12:16:24.697257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:44:54.619964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.300007+0000","last_change":"2024-02-17T12:16:22.308200+0000","last_active":"2024-02-17T12:16:23.300007+0000","last_peered":"2024-02-17T12:16:23.300007+0000","last_clean":"2024-02-17T12:16:23.300007+0000","last_became_active":"2024-02-17T12:16:22.307887+0000","last_became_peered":"2024-02-17T12:16:22.307887+0000","last_unstale":"2024-02-17T12:16:23.300007+0000","last_undegraded":"2024-02-17T12:16:23.300007+0000","last_fullsized":"2024-02-17T12:16:23.300007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:03.723225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308610+0000","last_change":"2024-02-17T12:16:23.312512+0000","last_active":"2024-02-17T12:16:24.308610+0000","last_peered":"2024-02-17T12:16:24.308610+0000","last_clean":"2024-02-17T12:16:24.308610+0000","last_became_active":"2024-02-17T12:16:23.312190+0000","last_became_peered":"2024-02-17T12:16:23.312190+0000","last_unstale":"2024-02-17T12:16:24.308610+0000","last_undegraded":"2024-02-17T12:16:24.308610+0000","last_fullsized":"2024-02-17T12:16:24.308610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308798+0000","last_change":"2024-02-17T12:16:22.307969+0000","last_active":"2024-02-17T12:16:24.308798+0000","last_peered":"2024-02-17T12:16:24.308798+0000","last_clean":"2024-02-17T12:16:24.308798+0000","last_became_active":"2024-02-17T12:16:22.307639+0000","last_became_peered":"2024-02-17T12:16:22.307639+0000","last_unstale":"2024-02-17T12:16:24.308798+0000","last_undegraded":"2024-02-17T12:16:24.308798+0000","last_fullsized":"2024-02-17T12:16:24.308798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.316173+0000","last_change":"2024-02-17T12:16:23.306045+0000","last_active":"2024-02-17T12:16:23.316173+0000","last_peered":"2024-02-17T12:16:23.316173+0000","last_clean":"2024-02-17T12:16:23.316173+0000","last_became_active":"2024-02-17T12:16:23.305674+0000","last_became_peered":"2024-02-17T12:16:23.305674+0000","last_unstale":"2024-02-17T12:16:23.316173+0000","last_undegraded":"2024-02-17T12:16:23.316173+0000","last_fullsized":"2024-02-17T12:16:23.316173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:41.070381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308940+0000","last_change":"2024-02-17T12:16:22.308387+0000","last_active":"2024-02-17T12:16:24.308940+0000","last_peered":"2024-02-17T12:16:24.308940+0000","last_clean":"2024-02-17T12:16:24.308940+0000","last_became_active":"2024-02-17T12:16:22.308043+0000","last_became_peered":"2024-02-17T12:16:22.308043+0000","last_unstale":"2024-02-17T12:16:24.308940+0000","last_undegraded":"2024-02-17T12:16:24.308940+0000","last_fullsized":"2024-02-17T12:16:24.308940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308982+0000","last_change":"2024-02-17T12:16:23.310304+0000","last_active":"2024-02-17T12:16:24.308982+0000","last_peered":"2024-02-17T12:16:24.308982+0000","last_clean":"2024-02-17T12:16:24.308982+0000","last_became_active":"2024-02-17T12:16:23.309898+0000","last_became_peered":"2024-02-17T12:16:23.309898+0000","last_unstale":"2024-02-17T12:16:24.308982+0000","last_undegraded":"2024-02-17T12:16:24.308982+0000","last_fullsized":"2024-02-17T12:16:24.308982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:15:22.881157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.309220+0000","last_change":"2024-02-17T12:16:22.326425+0000","last_active":"2024-02-17T12:16:23.309220+0000","last_peered":"2024-02-17T12:16:23.309220+0000","last_clean":"2024-02-17T12:16:23.309220+0000","last_became_active":"2024-02-17T12:16:22.326149+0000","last_became_peered":"2024-02-17T12:16:22.326149+0000","last_unstale":"2024-02-17T12:16:23.309220+0000","last_undegraded":"2024-02-17T12:16:23.309220+0000","last_fullsized":"2024-02-17T12:16:23.309220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:58.719013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308851+0000","last_change":"2024-02-17T12:16:23.308825+0000","last_active":"2024-02-17T12:16:24.308851+0000","last_peered":"2024-02-17T12:16:24.308851+0000","last_clean":"2024-02-17T12:16:24.308851+0000","last_became_active":"2024-02-17T12:16:23.308519+0000","last_became_peered":"2024-02-17T12:16:23.308519+0000","last_unstale":"2024-02-17T12:16:24.308851+0000","last_undegraded":"2024-02-17T12:16:24.308851+0000","last_fullsized":"2024-02-17T12:16:24.308851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.333542+0000","last_change":"2024-02-17T12:16:22.312030+0000","last_active":"2024-02-17T12:16:24.333542+0000","last_peered":"2024-02-17T12:16:24.333542+0000","last_clean":"2024-02-17T12:16:24.333542+0000","last_became_active":"2024-02-17T12:16:22.311589+0000","last_became_peered":"2024-02-17T12:16:22.311589+0000","last_unstale":"2024-02-17T12:16:24.333542+0000","last_undegraded":"2024-02-17T12:16:24.333542+0000","last_fullsized":"2024-02-17T12:16:24.333542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:41.148188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697953+0000","last_change":"2024-02-17T12:16:23.317377+0000","last_active":"2024-02-17T12:16:24.697953+0000","last_peered":"2024-02-17T12:16:24.697953+0000","last_clean":"2024-02-17T12:16:24.697953+0000","last_became_active":"2024-02-17T12:16:23.317054+0000","last_became_peered":"2024-02-17T12:16:23.317054+0000","last_unstale":"2024-02-17T12:16:24.697953+0000","last_undegraded":"2024-02-17T12:16:24.697953+0000","last_fullsized":"2024-02-17T12:16:24.697953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335600+0000","last_change":"2024-02-17T12:16:22.320467+0000","last_active":"2024-02-17T12:16:24.335600+0000","last_peered":"2024-02-17T12:16:24.335600+0000","last_clean":"2024-02-17T12:16:24.335600+0000","last_became_active":"2024-02-17T12:16:22.319418+0000","last_became_peered":"2024-02-17T12:16:22.319418+0000","last_unstale":"2024-02-17T12:16:24.335600+0000","last_undegraded":"2024-02-17T12:16:24.335600+0000","last_fullsized":"2024-02-17T12:16:24.335600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:52:32.067973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698388+0000","last_change":"2024-02-17T12:16:23.307769+0000","last_active":"2024-02-17T12:16:24.698388+0000","last_peered":"2024-02-17T12:16:24.698388+0000","last_clean":"2024-02-17T12:16:24.698388+0000","last_became_active":"2024-02-17T12:16:23.305664+0000","last_became_peered":"2024-02-17T12:16:23.305664+0000","last_unstale":"2024-02-17T12:16:24.698388+0000","last_undegraded":"2024-02-17T12:16:24.698388+0000","last_fullsized":"2024-02-17T12:16:24.698388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.306984+0000","last_change":"2024-02-17T12:16:22.324065+0000","last_active":"2024-02-17T12:16:23.306984+0000","last_peered":"2024-02-17T12:16:23.306984+0000","last_clean":"2024-02-17T12:16:23.306984+0000","last_became_active":"2024-02-17T12:16:22.323818+0000","last_became_peered":"2024-02-17T12:16:22.323818+0000","last_unstale":"2024-02-17T12:16:23.306984+0000","last_undegraded":"2024-02-17T12:16:23.306984+0000","last_fullsized":"2024-02-17T12:16:23.306984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:15.029228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.316317+0000","last_change":"2024-02-17T12:16:23.313005+0000","last_active":"2024-02-17T12:16:23.316317+0000","last_peered":"2024-02-17T12:16:23.316317+0000","last_clean":"2024-02-17T12:16:23.316317+0000","last_became_active":"2024-02-17T12:16:23.312532+0000","last_became_peered":"2024-02-17T12:16:23.312532+0000","last_unstale":"2024-02-17T12:16:23.316317+0000","last_undegraded":"2024-02-17T12:16:23.316317+0000","last_fullsized":"2024-02-17T12:16:23.316317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:04.729067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308811+0000","last_change":"2024-02-17T12:16:22.313418+0000","last_active":"2024-02-17T12:16:24.308811+0000","last_peered":"2024-02-17T12:16:24.308811+0000","last_clean":"2024-02-17T12:16:24.308811+0000","last_became_active":"2024-02-17T12:16:22.312996+0000","last_became_peered":"2024-02-17T12:16:22.312996+0000","last_unstale":"2024-02-17T12:16:24.308811+0000","last_undegraded":"2024-02-17T12:16:24.308811+0000","last_fullsized":"2024-02-17T12:16:24.308811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:49:36.146858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697537+0000","last_change":"2024-02-17T12:16:23.306549+0000","last_active":"2024-02-17T12:16:24.697537+0000","last_peered":"2024-02-17T12:16:24.697537+0000","last_clean":"2024-02-17T12:16:24.697537+0000","last_became_active":"2024-02-17T12:16:23.306251+0000","last_became_peered":"2024-02-17T12:16:23.306251+0000","last_unstale":"2024-02-17T12:16:24.697537+0000","last_undegraded":"2024-02-17T12:16:24.697537+0000","last_fullsized":"2024-02-17T12:16:24.697537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308802+0000","last_change":"2024-02-17T12:16:22.316022+0000","last_active":"2024-02-17T12:16:24.308802+0000","last_peered":"2024-02-17T12:16:24.308802+0000","last_clean":"2024-02-17T12:16:24.308802+0000","last_became_active":"2024-02-17T12:16:22.315761+0000","last_became_peered":"2024-02-17T12:16:22.315761+0000","last_unstale":"2024-02-17T12:16:24.308802+0000","last_undegraded":"2024-02-17T12:16:24.308802+0000","last_fullsized":"2024-02-17T12:16:24.308802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:49.705448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697882+0000","last_change":"2024-02-17T12:16:23.306391+0000","last_active":"2024-02-17T12:16:24.697882+0000","last_peered":"2024-02-17T12:16:24.697882+0000","last_clean":"2024-02-17T12:16:24.697882+0000","last_became_active":"2024-02-17T12:16:23.306103+0000","last_became_peered":"2024-02-17T12:16:23.306103+0000","last_unstale":"2024-02-17T12:16:24.697882+0000","last_undegraded":"2024-02-17T12:16:24.697882+0000","last_fullsized":"2024-02-17T12:16:24.697882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.338560+0000","last_change":"2024-02-17T12:16:22.323792+0000","last_active":"2024-02-17T12:16:23.338560+0000","last_peered":"2024-02-17T12:16:23.338560+0000","last_clean":"2024-02-17T12:16:23.338560+0000","last_became_active":"2024-02-17T12:16:22.323508+0000","last_became_peered":"2024-02-17T12:16:22.323508+0000","last_unstale":"2024-02-17T12:16:23.338560+0000","last_undegraded":"2024-02-17T12:16:23.338560+0000","last_fullsized":"2024-02-17T12:16:23.338560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:03.944585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335206+0000","last_change":"2024-02-17T12:16:23.320721+0000","last_active":"2024-02-17T12:16:24.335206+0000","last_peered":"2024-02-17T12:16:24.335206+0000","last_clean":"2024-02-17T12:16:24.335206+0000","last_became_active":"2024-02-17T12:16:23.312733+0000","last_became_peered":"2024-02-17T12:16:23.312733+0000","last_unstale":"2024-02-17T12:16:24.335206+0000","last_undegraded":"2024-02-17T12:16:24.335206+0000","last_fullsized":"2024-02-17T12:16:24.335206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308809+0000","last_change":"2024-02-17T12:16:23.301646+0000","last_active":"2024-02-17T12:16:24.308809+0000","last_peered":"2024-02-17T12:16:24.308809+0000","last_clean":"2024-02-17T12:16:24.308809+0000","last_became_active":"2024-02-17T12:16:23.301322+0000","last_became_peered":"2024-02-17T12:16:23.301322+0000","last_unstale":"2024-02-17T12:16:24.308809+0000","last_undegraded":"2024-02-17T12:16:24.308809+0000","last_fullsized":"2024-02-17T12:16:24.308809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:46:17.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.337218+0000","last_change":"2024-02-17T12:16:22.326677+0000","last_active":"2024-02-17T12:16:23.337218+0000","last_peered":"2024-02-17T12:16:23.337218+0000","last_clean":"2024-02-17T12:16:23.337218+0000","last_became_active":"2024-02-17T12:16:22.326136+0000","last_became_peered":"2024-02-17T12:16:22.326136+0000","last_unstale":"2024-02-17T12:16:23.337218+0000","last_undegraded":"2024-02-17T12:16:23.337218+0000","last_fullsized":"2024-02-17T12:16:23.337218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:34:18.512763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308731+0000","last_change":"2024-02-17T12:16:23.314407+0000","last_active":"2024-02-17T12:16:24.308731+0000","last_peered":"2024-02-17T12:16:24.308731+0000","last_clean":"2024-02-17T12:16:24.308731+0000","last_became_active":"2024-02-17T12:16:23.310090+0000","last_became_peered":"2024-02-17T12:16:23.310090+0000","last_unstale":"2024-02-17T12:16:24.308731+0000","last_undegraded":"2024-02-17T12:16:24.308731+0000","last_fullsized":"2024-02-17T12:16:24.308731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:26:24.802958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.338091+0000","last_change":"2024-02-17T12:16:22.326377+0000","last_active":"2024-02-17T12:16:23.338091+0000","last_peered":"2024-02-17T12:16:23.338091+0000","last_clean":"2024-02-17T12:16:23.338091+0000","last_became_active":"2024-02-17T12:16:22.326122+0000","last_became_peered":"2024-02-17T12:16:22.326122+0000","last_unstale":"2024-02-17T12:16:23.338091+0000","last_undegraded":"2024-02-17T12:16:23.338091+0000","last_fullsized":"2024-02-17T12:16:23.338091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:58.566689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698320+0000","last_change":"2024-02-17T12:16:23.319347+0000","last_active":"2024-02-17T12:16:24.698320+0000","last_peered":"2024-02-17T12:16:24.698320+0000","last_clean":"2024-02-17T12:16:24.698320+0000","last_became_active":"2024-02-17T12:16:23.319070+0000","last_became_peered":"2024-02-17T12:16:23.319070+0000","last_unstale":"2024-02-17T12:16:24.698320+0000","last_undegraded":"2024-02-17T12:16:24.698320+0000","last_fullsized":"2024-02-17T12:16:24.698320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697633+0000","last_change":"2024-02-17T12:16:22.314871+0000","last_active":"2024-02-17T12:16:24.697633+0000","last_peered":"2024-02-17T12:16:24.697633+0000","last_clean":"2024-02-17T12:16:24.697633+0000","last_became_active":"2024-02-17T12:16:22.314596+0000","last_became_peered":"2024-02-17T12:16:22.314596+0000","last_unstale":"2024-02-17T12:16:24.697633+0000","last_undegraded":"2024-02-17T12:16:24.697633+0000","last_fullsized":"2024-02-17T12:16:24.697633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:05.491487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697334+0000","last_change":"2024-02-17T12:16:23.322438+0000","last_active":"2024-02-17T12:16:24.697334+0000","last_peered":"2024-02-17T12:16:24.697334+0000","last_clean":"2024-02-17T12:16:24.697334+0000","last_became_active":"2024-02-17T12:16:23.322009+0000","last_became_peered":"2024-02-17T12:16:23.322009+0000","last_unstale":"2024-02-17T12:16:24.697334+0000","last_undegraded":"2024-02-17T12:16:24.697334+0000","last_fullsized":"2024-02-17T12:16:24.697334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698449+0000","last_change":"2024-02-17T12:16:22.317765+0000","last_active":"2024-02-17T12:16:24.698449+0000","last_peered":"2024-02-17T12:16:24.698449+0000","last_clean":"2024-02-17T12:16:24.698449+0000","last_became_active":"2024-02-17T12:16:22.317363+0000","last_became_peered":"2024-02-17T12:16:22.317363+0000","last_unstale":"2024-02-17T12:16:24.698449+0000","last_undegraded":"2024-02-17T12:16:24.698449+0000","last_fullsized":"2024-02-17T12:16:24.698449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:07:14.946092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":72631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":67853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":657247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":794624,"data_stored":657191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":66367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":196608,"data_stored":66241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:16:27.403 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:16:27.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.568+0000 7f2ccfa00640 1 Processor -- start 2024-02-17T12:16:27.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.568+0000 7f2ccfa00640 1 -- start start 2024-02-17T12:16:27.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccfa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2cc814f110 0x7f2cc80c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccfa00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc80a9420 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccfa00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc8152850 con 0x7f2cc80c2580 2024-02-17T12:16:27.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccfa00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc814f4f0 con 0x7f2cc814f110 2024-02-17T12:16:27.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccd000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2cc814f110 0x7f2cc80c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccda00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2cc80c1eb0 0x7f2cc815c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45426/0 (socket says 172.21.15.114:45426) 2024-02-17T12:16:27.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccda00640 1 -- 172.21.15.114:0/2207461949 learned_addr learned my addr 172.21.15.114:0/2207461949 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:27.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccd000640 1 -- 172.21.15.114:0/2207461949 >> v1:172.21.15.116:6789/0 conn(0x7f2cc80c2580 legacy=0x7f2cc80aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccd000640 1 -- 172.21.15.114:0/2207461949 >> v1:172.21.15.114:6789/0 conn(0x7f2cc80c1eb0 legacy=0x7f2cc815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccd000640 1 -- 172.21.15.114:0/2207461949 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80a9670 con 0x7f2cc814f110 2024-02-17T12:16:27.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2cc7400640 1 -- 172.21.15.114:0/2207461949 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700317204 0 0) 0x7f2cc80a9420 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.572+0000 7f2ccd000640 1 --2- 172.21.15.114:0/2207461949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc814f110 0x7f2cc80c65a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00097c0 tx=0x7f2cb001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf183a32a2e1cac server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:27.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2cc7400640 1 -- 172.21.15.114:0/2207461949 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb00ab600 con 0x7f2cc814f110 2024-02-17T12:16:27.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2cc7400640 1 -- 172.21.15.114:0/2207461949 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb00a7050 con 0x7f2cc814f110 2024-02-17T12:16:27.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2cc7400640 1 -- 172.21.15.114:0/2207461949 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb00ab980 con 0x7f2cc814f110 2024-02-17T12:16:27.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 -- 172.21.15.114:0/2207461949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc814f110 msgr2=0x7f2cc80c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 --2- 172.21.15.114:0/2207461949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc814f110 0x7f2cc80c65a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00097c0 tx=0x7f2cb001c410 comp rx=0 tx=0).stop 2024-02-17T12:16:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 -- 172.21.15.114:0/2207461949 shutdown_connections 2024-02-17T12:16:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 --2- 172.21.15.114:0/2207461949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc814f110 0x7f2cc80c65a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 -- 172.21.15.114:0/2207461949 >> 172.21.15.114:0/2207461949 conn(0x7f2cc80a8490 msgr2=0x7f2cc80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 -- 172.21.15.114:0/2207461949 shutdown_connections 2024-02-17T12:16:27.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 -- 172.21.15.114:0/2207461949 wait complete. 2024-02-17T12:16:27.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 Processor -- start 2024-02-17T12:16:27.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 -- start start 2024-02-17T12:16:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc80c1eb0 0x7f2cc813d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cc80c2580 0x7f2cc8141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2cc814f110 0x7f2cc8150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc80c4e90 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc814fe20 con 0x7f2cc814f110 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccfa00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc813deb0 con 0x7f2cc80c2580 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc80c1eb0 0x7f2cc813d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc80c1eb0 0x7f2cc813d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57492/0 (socket says 172.21.15.114:57492) 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccd000640 1 -- 172.21.15.114:0/4022969542 learned_addr learned my addr 172.21.15.114:0/4022969542 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccda00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2cc814f110 0x7f2cc8150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2cc7e00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cc80c2580 0x7f2cc8141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccd000640 1 -- 172.21.15.114:0/4022969542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cc80c2580 msgr2=0x7f2cc8141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccd000640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cc80c2580 0x7f2cc8141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccd000640 1 -- 172.21.15.114:0/4022969542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2cc814f110 msgr2=0x7f2cc8150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.576+0000 7f2ccd000640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2cc814f110 0x7f2cc8150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2ccd000640 1 -- 172.21.15.114:0/4022969542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb0009420 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2cc7e00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cc80c2580 0x7f2cc8141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2ccd000640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc80c1eb0 0x7f2cc813d8a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00097c0 tx=0x7f2cb001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2cc4c00640 1 -- 172.21.15.114:0/4022969542 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0004030 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2cc4c00640 1 -- 172.21.15.114:0/4022969542 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb0004190 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2ccfa00640 1 -- 172.21.15.114:0/4022969542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc813e3c0 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2cc4c00640 1 -- 172.21.15.114:0/4022969542 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0004500 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2ccfa00640 1 -- 172.21.15.114:0/4022969542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc8141660 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2ccfa00640 1 -- 172.21.15.114:0/4022969542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc8074840 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2cc4c00640 1 -- 172.21.15.114:0/4022969542 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2cb00b2050 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2cc4c00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2ca4066e40 0x7f2ca4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2cc4c00640 1 -- 172.21.15.114:0/4022969542 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cb011ed20 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.580+0000 7f2cc7e00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2ca4066e40 0x7f2ca4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.584+0000 7f2cc7e00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2ca4066e40 0x7f2ca4069300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cc813dde0 tx=0x7f2cb8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:27.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.584+0000 7f2cc4c00640 1 -- 172.21.15.114:0/4022969542 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2cb00ebb00 con 0x7f2cc80c1eb0 2024-02-17T12:16:27.613 INFO:tasks.ceph.mds.d.smithi116.stderr:2024-02-17T12:16:27.612+0000 7fe4a0800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:16:27.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.740+0000 7f2ccfa00640 1 -- 172.21.15.114:0/4022969542 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2cc8152240 con 0x7f2ca4066e40 2024-02-17T12:16:27.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.748+0000 7f2cc4c00640 1 -- 172.21.15.114:0/4022969542 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264637 (secure 0 0 0) 0x7f2cc8152240 con 0x7f2ca4066e40 2024-02-17T12:16:27.753 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:27.755 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:16:27.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 -- 172.21.15.114:0/4022969542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2ca4066e40 msgr2=0x7f2ca4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2ca4066e40 0x7f2ca4069300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cc813dde0 tx=0x7f2cb8009040 comp rx=0 tx=0).stop 2024-02-17T12:16:27.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 -- 172.21.15.114:0/4022969542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc80c1eb0 msgr2=0x7f2cc813d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc80c1eb0 0x7f2cc813d8a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00097c0 tx=0x7f2cb001ac50 comp rx=0 tx=0).stop 2024-02-17T12:16:27.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 -- 172.21.15.114:0/4022969542 shutdown_connections 2024-02-17T12:16:27.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2cc814f110 0x7f2cc8150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2cc80c2580 0x7f2cc8141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2ca4066e40 0x7f2ca4069300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 --2- 172.21.15.114:0/4022969542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2cc80c1eb0 0x7f2cc813d8a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 -- 172.21.15.114:0/4022969542 >> 172.21.15.114:0/4022969542 conn(0x7f2cc80a8490 msgr2=0x7f2cc80a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:27.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 -- 172.21.15.114:0/4022969542 shutdown_connections 2024-02-17T12:16:27.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.752+0000 7f2ccfa00640 1 -- 172.21.15.114:0/4022969542 wait complete. 2024-02-17T12:16:27.774 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-02-17T12:16:27.218253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223132,"kb_used_data":2796,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751588,"statfs":{"total":773094113280,"available":772865626112,"internally_reserved":0,"allocated":2863104,"data_stored":1734384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.939785"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.328203+0000","last_change":"2024-02-17T12:16:23.325932+0000","last_active":"2024-02-17T12:16:23.328203+0000","last_peered":"2024-02-17T12:16:23.328203+0000","last_clean":"2024-02-17T12:16:23.328203+0000","last_became_active":"2024-02-17T12:16:23.325577+0000","last_became_peered":"2024-02-17T12:16:23.325577+0000","last_unstale":"2024-02-17T12:16:23.328203+0000","last_undegraded":"2024-02-17T12:16:23.328203+0000","last_fullsized":"2024-02-17T12:16:23.328203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:00:31.347354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309102+0000","last_change":"2024-02-17T12:16:23.313730+0000","last_active":"2024-02-17T12:16:24.309102+0000","last_peered":"2024-02-17T12:16:24.309102+0000","last_clean":"2024-02-17T12:16:24.309102+0000","last_became_active":"2024-02-17T12:16:23.313417+0000","last_became_peered":"2024-02-17T12:16:23.313417+0000","last_unstale":"2024-02-17T12:16:24.309102+0000","last_undegraded":"2024-02-17T12:16:24.309102+0000","last_fullsized":"2024-02-17T12:16:24.309102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698256+0000","last_change":"2024-02-17T12:16:23.309155+0000","last_active":"2024-02-17T12:16:24.698256+0000","last_peered":"2024-02-17T12:16:24.698256+0000","last_clean":"2024-02-17T12:16:24.698256+0000","last_became_active":"2024-02-17T12:16:23.308921+0000","last_became_peered":"2024-02-17T12:16:23.308921+0000","last_unstale":"2024-02-17T12:16:24.698256+0000","last_undegraded":"2024-02-17T12:16:24.698256+0000","last_fullsized":"2024-02-17T12:16:24.698256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308527+0000","last_change":"2024-02-17T12:16:23.315338+0000","last_active":"2024-02-17T12:16:24.308527+0000","last_peered":"2024-02-17T12:16:24.308527+0000","last_clean":"2024-02-17T12:16:24.308527+0000","last_became_active":"2024-02-17T12:16:23.314200+0000","last_became_peered":"2024-02-17T12:16:23.314200+0000","last_unstale":"2024-02-17T12:16:24.308527+0000","last_undegraded":"2024-02-17T12:16:24.308527+0000","last_fullsized":"2024-02-17T12:16:24.308527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.328571+0000","last_change":"2024-02-17T12:16:23.324821+0000","last_active":"2024-02-17T12:16:23.328571+0000","last_peered":"2024-02-17T12:16:23.328571+0000","last_clean":"2024-02-17T12:16:23.328571+0000","last_became_active":"2024-02-17T12:16:23.324550+0000","last_became_peered":"2024-02-17T12:16:23.324550+0000","last_unstale":"2024-02-17T12:16:23.328571+0000","last_undegraded":"2024-02-17T12:16:23.328571+0000","last_fullsized":"2024-02-17T12:16:23.328571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:28.464918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309180+0000","last_change":"2024-02-17T12:16:23.305539+0000","last_active":"2024-02-17T12:16:24.309180+0000","last_peered":"2024-02-17T12:16:24.309180+0000","last_clean":"2024-02-17T12:16:24.309180+0000","last_became_active":"2024-02-17T12:16:23.304577+0000","last_became_peered":"2024-02-17T12:16:23.304577+0000","last_unstale":"2024-02-17T12:16:24.309180+0000","last_undegraded":"2024-02-17T12:16:24.309180+0000","last_fullsized":"2024-02-17T12:16:24.309180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:01.247987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.321171+0000","last_change":"2024-02-17T12:16:23.319882+0000","last_active":"2024-02-17T12:16:23.321171+0000","last_peered":"2024-02-17T12:16:23.321171+0000","last_clean":"2024-02-17T12:16:23.321171+0000","last_became_active":"2024-02-17T12:16:23.319575+0000","last_became_peered":"2024-02-17T12:16:23.319575+0000","last_unstale":"2024-02-17T12:16:23.321171+0000","last_undegraded":"2024-02-17T12:16:23.321171+0000","last_fullsized":"2024-02-17T12:16:23.321171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:41:23.756204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697223+0000","last_change":"2024-02-17T12:16:23.322275+0000","last_active":"2024-02-17T12:16:24.697223+0000","last_peered":"2024-02-17T12:16:24.697223+0000","last_clean":"2024-02-17T12:16:24.697223+0000","last_became_active":"2024-02-17T12:16:23.321923+0000","last_became_peered":"2024-02-17T12:16:23.321923+0000","last_unstale":"2024-02-17T12:16:24.697223+0000","last_undegraded":"2024-02-17T12:16:24.697223+0000","last_fullsized":"2024-02-17T12:16:24.697223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:05:10.254057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.329591+0000","last_change":"2024-02-17T12:16:23.326757+0000","last_active":"2024-02-17T12:16:23.329591+0000","last_peered":"2024-02-17T12:16:23.329591+0000","last_clean":"2024-02-17T12:16:23.329591+0000","last_became_active":"2024-02-17T12:16:23.326481+0000","last_became_peered":"2024-02-17T12:16:23.326481+0000","last_unstale":"2024-02-17T12:16:23.329591+0000","last_undegraded":"2024-02-17T12:16:23.329591+0000","last_fullsized":"2024-02-17T12:16:23.329591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:55:52.492849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335654+0000","last_change":"2024-02-17T12:16:23.321138+0000","last_active":"2024-02-17T12:16:24.335654+0000","last_peered":"2024-02-17T12:16:24.335654+0000","last_clean":"2024-02-17T12:16:24.335654+0000","last_became_active":"2024-02-17T12:16:23.320619+0000","last_became_peered":"2024-02-17T12:16:23.320619+0000","last_unstale":"2024-02-17T12:16:24.335654+0000","last_undegraded":"2024-02-17T12:16:24.335654+0000","last_fullsized":"2024-02-17T12:16:24.335654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335398+0000","last_change":"2024-02-17T12:16:23.318226+0000","last_active":"2024-02-17T12:16:24.335398+0000","last_peered":"2024-02-17T12:16:24.335398+0000","last_clean":"2024-02-17T12:16:24.335398+0000","last_became_active":"2024-02-17T12:16:23.317955+0000","last_became_peered":"2024-02-17T12:16:23.317955+0000","last_unstale":"2024-02-17T12:16:24.335398+0000","last_undegraded":"2024-02-17T12:16:24.335398+0000","last_fullsized":"2024-02-17T12:16:24.335398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.324095+0000","last_change":"2024-02-17T12:16:23.319482+0000","last_active":"2024-02-17T12:16:23.324095+0000","last_peered":"2024-02-17T12:16:23.324095+0000","last_clean":"2024-02-17T12:16:23.324095+0000","last_became_active":"2024-02-17T12:16:23.318713+0000","last_became_peered":"2024-02-17T12:16:23.318713+0000","last_unstale":"2024-02-17T12:16:23.324095+0000","last_undegraded":"2024-02-17T12:16:23.324095+0000","last_fullsized":"2024-02-17T12:16:23.324095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:46:26.458115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697727+0000","last_change":"2024-02-17T12:16:23.322232+0000","last_active":"2024-02-17T12:16:24.697727+0000","last_peered":"2024-02-17T12:16:24.697727+0000","last_clean":"2024-02-17T12:16:24.697727+0000","last_became_active":"2024-02-17T12:16:23.321953+0000","last_became_peered":"2024-02-17T12:16:23.321953+0000","last_unstale":"2024-02-17T12:16:24.697727+0000","last_undegraded":"2024-02-17T12:16:24.697727+0000","last_fullsized":"2024-02-17T12:16:24.697727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697309+0000","last_change":"2024-02-17T12:16:23.305025+0000","last_active":"2024-02-17T12:16:24.697309+0000","last_peered":"2024-02-17T12:16:24.697309+0000","last_clean":"2024-02-17T12:16:24.697309+0000","last_became_active":"2024-02-17T12:16:23.303792+0000","last_became_peered":"2024-02-17T12:16:23.303792+0000","last_unstale":"2024-02-17T12:16:24.697309+0000","last_undegraded":"2024-02-17T12:16:24.697309+0000","last_fullsized":"2024-02-17T12:16:24.697309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:14.503722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308712+0000","last_change":"2024-02-17T12:16:23.318017+0000","last_active":"2024-02-17T12:16:24.308712+0000","last_peered":"2024-02-17T12:16:24.308712+0000","last_clean":"2024-02-17T12:16:24.308712+0000","last_became_active":"2024-02-17T12:16:23.317749+0000","last_became_peered":"2024-02-17T12:16:23.317749+0000","last_unstale":"2024-02-17T12:16:24.308712+0000","last_undegraded":"2024-02-17T12:16:24.308712+0000","last_fullsized":"2024-02-17T12:16:24.308712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308269+0000","last_change":"2024-02-17T12:16:23.299929+0000","last_active":"2024-02-17T12:16:24.308269+0000","last_peered":"2024-02-17T12:16:24.308269+0000","last_clean":"2024-02-17T12:16:24.308269+0000","last_became_active":"2024-02-17T12:16:23.299612+0000","last_became_peered":"2024-02-17T12:16:23.299612+0000","last_unstale":"2024-02-17T12:16:24.308269+0000","last_undegraded":"2024-02-17T12:16:24.308269+0000","last_fullsized":"2024-02-17T12:16:24.308269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309347+0000","last_change":"2024-02-17T12:16:23.314723+0000","last_active":"2024-02-17T12:16:24.309347+0000","last_peered":"2024-02-17T12:16:24.309347+0000","last_clean":"2024-02-17T12:16:24.309347+0000","last_became_active":"2024-02-17T12:16:23.310139+0000","last_became_peered":"2024-02-17T12:16:23.310139+0000","last_unstale":"2024-02-17T12:16:24.309347+0000","last_undegraded":"2024-02-17T12:16:24.309347+0000","last_fullsized":"2024-02-17T12:16:24.309347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:51:35.647773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.315294+0000","last_change":"2024-02-17T12:16:23.312040+0000","last_active":"2024-02-17T12:16:23.315294+0000","last_peered":"2024-02-17T12:16:23.315294+0000","last_clean":"2024-02-17T12:16:23.315294+0000","last_became_active":"2024-02-17T12:16:23.311701+0000","last_became_peered":"2024-02-17T12:16:23.311701+0000","last_unstale":"2024-02-17T12:16:23.315294+0000","last_undegraded":"2024-02-17T12:16:23.315294+0000","last_fullsized":"2024-02-17T12:16:23.315294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:16.035071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.319903+0000","last_change":"2024-02-17T12:16:23.317094+0000","last_active":"2024-02-17T12:16:23.319903+0000","last_peered":"2024-02-17T12:16:23.319903+0000","last_clean":"2024-02-17T12:16:23.319903+0000","last_became_active":"2024-02-17T12:16:23.316715+0000","last_became_peered":"2024-02-17T12:16:23.316715+0000","last_unstale":"2024-02-17T12:16:23.319903+0000","last_undegraded":"2024-02-17T12:16:23.319903+0000","last_fullsized":"2024-02-17T12:16:23.319903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:48.589620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335321+0000","last_change":"2024-02-17T12:16:23.314602+0000","last_active":"2024-02-17T12:16:24.335321+0000","last_peered":"2024-02-17T12:16:24.335321+0000","last_clean":"2024-02-17T12:16:24.335321+0000","last_became_active":"2024-02-17T12:16:23.310646+0000","last_became_peered":"2024-02-17T12:16:23.310646+0000","last_unstale":"2024-02-17T12:16:24.335321+0000","last_undegraded":"2024-02-17T12:16:24.335321+0000","last_fullsized":"2024-02-17T12:16:24.335321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697556+0000","last_change":"2024-02-17T12:16:23.314985+0000","last_active":"2024-02-17T12:16:24.697556+0000","last_peered":"2024-02-17T12:16:24.697556+0000","last_clean":"2024-02-17T12:16:24.697556+0000","last_became_active":"2024-02-17T12:16:23.314105+0000","last_became_peered":"2024-02-17T12:16:23.314105+0000","last_unstale":"2024-02-17T12:16:24.697556+0000","last_undegraded":"2024-02-17T12:16:24.697556+0000","last_fullsized":"2024-02-17T12:16:24.697556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308459+0000","last_change":"2024-02-17T12:16:23.316273+0000","last_active":"2024-02-17T12:16:24.308459+0000","last_peered":"2024-02-17T12:16:24.308459+0000","last_clean":"2024-02-17T12:16:24.308459+0000","last_became_active":"2024-02-17T12:16:23.315991+0000","last_became_peered":"2024-02-17T12:16:23.315991+0000","last_unstale":"2024-02-17T12:16:24.308459+0000","last_undegraded":"2024-02-17T12:16:24.308459+0000","last_fullsized":"2024-02-17T12:16:24.308459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697276+0000","last_change":"2024-02-17T12:16:23.310525+0000","last_active":"2024-02-17T12:16:24.697276+0000","last_peered":"2024-02-17T12:16:24.697276+0000","last_clean":"2024-02-17T12:16:24.697276+0000","last_became_active":"2024-02-17T12:16:23.309291+0000","last_became_peered":"2024-02-17T12:16:23.309291+0000","last_unstale":"2024-02-17T12:16:24.697276+0000","last_undegraded":"2024-02-17T12:16:24.697276+0000","last_fullsized":"2024-02-17T12:16:24.697276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308457+0000","last_change":"2024-02-17T12:16:23.319218+0000","last_active":"2024-02-17T12:16:24.308457+0000","last_peered":"2024-02-17T12:16:24.308457+0000","last_clean":"2024-02-17T12:16:24.308457+0000","last_became_active":"2024-02-17T12:16:23.310787+0000","last_became_peered":"2024-02-17T12:16:23.310787+0000","last_unstale":"2024-02-17T12:16:24.308457+0000","last_undegraded":"2024-02-17T12:16:24.308457+0000","last_fullsized":"2024-02-17T12:16:24.308457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697807+0000","last_change":"2024-02-17T12:16:23.310020+0000","last_active":"2024-02-17T12:16:24.697807+0000","last_peered":"2024-02-17T12:16:24.697807+0000","last_clean":"2024-02-17T12:16:24.697807+0000","last_became_active":"2024-02-17T12:16:23.309245+0000","last_became_peered":"2024-02-17T12:16:23.309245+0000","last_unstale":"2024-02-17T12:16:24.697807+0000","last_undegraded":"2024-02-17T12:16:24.697807+0000","last_fullsized":"2024-02-17T12:16:24.697807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335664+0000","last_change":"2024-02-17T12:16:23.321247+0000","last_active":"2024-02-17T12:16:24.335664+0000","last_peered":"2024-02-17T12:16:24.335664+0000","last_clean":"2024-02-17T12:16:24.335664+0000","last_became_active":"2024-02-17T12:16:23.312610+0000","last_became_peered":"2024-02-17T12:16:23.312610+0000","last_unstale":"2024-02-17T12:16:24.335664+0000","last_undegraded":"2024-02-17T12:16:24.335664+0000","last_fullsized":"2024-02-17T12:16:24.335664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308908+0000","last_change":"2024-02-17T12:16:23.316684+0000","last_active":"2024-02-17T12:16:24.308908+0000","last_peered":"2024-02-17T12:16:24.308908+0000","last_clean":"2024-02-17T12:16:24.308908+0000","last_became_active":"2024-02-17T12:16:23.316394+0000","last_became_peered":"2024-02-17T12:16:23.316394+0000","last_unstale":"2024-02-17T12:16:24.308908+0000","last_undegraded":"2024-02-17T12:16:24.308908+0000","last_fullsized":"2024-02-17T12:16:24.308908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698031+0000","last_change":"2024-02-17T12:16:23.316206+0000","last_active":"2024-02-17T12:16:24.698031+0000","last_peered":"2024-02-17T12:16:24.698031+0000","last_clean":"2024-02-17T12:16:24.698031+0000","last_became_active":"2024-02-17T12:16:23.315874+0000","last_became_peered":"2024-02-17T12:16:23.315874+0000","last_unstale":"2024-02-17T12:16:24.698031+0000","last_undegraded":"2024-02-17T12:16:24.698031+0000","last_fullsized":"2024-02-17T12:16:24.698031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:26:24.802958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697690+0000","last_change":"2024-02-17T12:16:23.307339+0000","last_active":"2024-02-17T12:16:24.697690+0000","last_peered":"2024-02-17T12:16:24.697690+0000","last_clean":"2024-02-17T12:16:24.697690+0000","last_became_active":"2024-02-17T12:16:23.306943+0000","last_became_peered":"2024-02-17T12:16:23.306943+0000","last_unstale":"2024-02-17T12:16:24.697690+0000","last_undegraded":"2024-02-17T12:16:24.697690+0000","last_fullsized":"2024-02-17T12:16:24.697690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308650+0000","last_change":"2024-02-17T12:16:23.304998+0000","last_active":"2024-02-17T12:16:24.308650+0000","last_peered":"2024-02-17T12:16:24.308650+0000","last_clean":"2024-02-17T12:16:24.308650+0000","last_became_active":"2024-02-17T12:16:23.304059+0000","last_became_peered":"2024-02-17T12:16:23.304059+0000","last_unstale":"2024-02-17T12:16:24.308650+0000","last_undegraded":"2024-02-17T12:16:24.308650+0000","last_fullsized":"2024-02-17T12:16:24.308650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.316325+0000","last_change":"2024-02-17T12:16:23.315379+0000","last_active":"2024-02-17T12:16:23.316325+0000","last_peered":"2024-02-17T12:16:23.316325+0000","last_clean":"2024-02-17T12:16:23.316325+0000","last_became_active":"2024-02-17T12:16:23.309626+0000","last_became_peered":"2024-02-17T12:16:23.309626+0000","last_unstale":"2024-02-17T12:16:23.316325+0000","last_undegraded":"2024-02-17T12:16:23.316325+0000","last_fullsized":"2024-02-17T12:16:23.316325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:34:19.518606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335196+0000","last_change":"2024-02-17T12:16:23.320903+0000","last_active":"2024-02-17T12:16:24.335196+0000","last_peered":"2024-02-17T12:16:24.335196+0000","last_clean":"2024-02-17T12:16:24.335196+0000","last_became_active":"2024-02-17T12:16:23.312623+0000","last_became_peered":"2024-02-17T12:16:23.312623+0000","last_unstale":"2024-02-17T12:16:24.335196+0000","last_undegraded":"2024-02-17T12:16:24.335196+0000","last_fullsized":"2024-02-17T12:16:24.335196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.317596+0000","last_change":"2024-02-17T12:16:23.306808+0000","last_active":"2024-02-17T12:16:23.317596+0000","last_peered":"2024-02-17T12:16:23.317596+0000","last_clean":"2024-02-17T12:16:23.317596+0000","last_became_active":"2024-02-17T12:16:23.306117+0000","last_became_peered":"2024-02-17T12:16:23.306117+0000","last_unstale":"2024-02-17T12:16:23.317596+0000","last_undegraded":"2024-02-17T12:16:23.317596+0000","last_fullsized":"2024-02-17T12:16:23.317596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:49:53.581925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697993+0000","last_change":"2024-02-17T12:16:22.314696+0000","last_active":"2024-02-17T12:16:24.697993+0000","last_peered":"2024-02-17T12:16:24.697993+0000","last_clean":"2024-02-17T12:16:24.697993+0000","last_became_active":"2024-02-17T12:16:22.314066+0000","last_became_peered":"2024-02-17T12:16:22.314066+0000","last_unstale":"2024-02-17T12:16:24.697993+0000","last_undegraded":"2024-02-17T12:16:24.697993+0000","last_fullsized":"2024-02-17T12:16:24.697993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:07:14.946092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697825+0000","last_change":"2024-02-17T12:16:23.303172+0000","last_active":"2024-02-17T12:16:24.697825+0000","last_peered":"2024-02-17T12:16:24.697825+0000","last_clean":"2024-02-17T12:16:24.697825+0000","last_became_active":"2024-02-17T12:16:23.302807+0000","last_became_peered":"2024-02-17T12:16:23.302807+0000","last_unstale":"2024-02-17T12:16:24.697825+0000","last_undegraded":"2024-02-17T12:16:24.697825+0000","last_fullsized":"2024-02-17T12:16:24.697825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335506+0000","last_change":"2024-02-17T12:16:22.314969+0000","last_active":"2024-02-17T12:16:24.335506+0000","last_peered":"2024-02-17T12:16:24.335506+0000","last_clean":"2024-02-17T12:16:24.335506+0000","last_became_active":"2024-02-17T12:16:22.313531+0000","last_became_peered":"2024-02-17T12:16:22.313531+0000","last_unstale":"2024-02-17T12:16:24.335506+0000","last_undegraded":"2024-02-17T12:16:24.335506+0000","last_fullsized":"2024-02-17T12:16:24.335506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697645+0000","last_change":"2024-02-17T12:16:22.311648+0000","last_active":"2024-02-17T12:16:24.697645+0000","last_peered":"2024-02-17T12:16:24.697645+0000","last_clean":"2024-02-17T12:16:24.697645+0000","last_became_active":"2024-02-17T12:16:22.311355+0000","last_became_peered":"2024-02-17T12:16:22.311355+0000","last_unstale":"2024-02-17T12:16:24.697645+0000","last_undegraded":"2024-02-17T12:16:24.697645+0000","last_fullsized":"2024-02-17T12:16:24.697645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:43.722209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697379+0000","last_change":"2024-02-17T12:16:23.311561+0000","last_active":"2024-02-17T12:16:24.697379+0000","last_peered":"2024-02-17T12:16:24.697379+0000","last_clean":"2024-02-17T12:16:24.697379+0000","last_became_active":"2024-02-17T12:16:23.311338+0000","last_became_peered":"2024-02-17T12:16:23.311338+0000","last_unstale":"2024-02-17T12:16:24.697379+0000","last_undegraded":"2024-02-17T12:16:24.697379+0000","last_fullsized":"2024-02-17T12:16:24.697379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308598+0000","last_change":"2024-02-17T12:16:22.315021+0000","last_active":"2024-02-17T12:16:24.308598+0000","last_peered":"2024-02-17T12:16:24.308598+0000","last_clean":"2024-02-17T12:16:24.308598+0000","last_became_active":"2024-02-17T12:16:22.314690+0000","last_became_peered":"2024-02-17T12:16:22.314690+0000","last_unstale":"2024-02-17T12:16:24.308598+0000","last_undegraded":"2024-02-17T12:16:24.308598+0000","last_fullsized":"2024-02-17T12:16:24.308598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:49.705448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308577+0000","last_change":"2024-02-17T12:16:23.312450+0000","last_active":"2024-02-17T12:16:24.308577+0000","last_peered":"2024-02-17T12:16:24.308577+0000","last_clean":"2024-02-17T12:16:24.308577+0000","last_became_active":"2024-02-17T12:16:23.312162+0000","last_became_peered":"2024-02-17T12:16:23.312162+0000","last_unstale":"2024-02-17T12:16:24.308577+0000","last_undegraded":"2024-02-17T12:16:24.308577+0000","last_fullsized":"2024-02-17T12:16:24.308577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335521+0000","last_change":"2024-02-17T12:16:22.316581+0000","last_active":"2024-02-17T12:16:24.335521+0000","last_peered":"2024-02-17T12:16:24.335521+0000","last_clean":"2024-02-17T12:16:24.335521+0000","last_became_active":"2024-02-17T12:16:22.316238+0000","last_became_peered":"2024-02-17T12:16:22.316238+0000","last_unstale":"2024-02-17T12:16:24.335521+0000","last_undegraded":"2024-02-17T12:16:24.335521+0000","last_fullsized":"2024-02-17T12:16:24.335521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:41.148188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309008+0000","last_change":"2024-02-17T12:16:23.313962+0000","last_active":"2024-02-17T12:16:24.309008+0000","last_peered":"2024-02-17T12:16:24.309008+0000","last_clean":"2024-02-17T12:16:24.309008+0000","last_became_active":"2024-02-17T12:16:23.313661+0000","last_became_peered":"2024-02-17T12:16:23.313661+0000","last_unstale":"2024-02-17T12:16:24.309008+0000","last_undegraded":"2024-02-17T12:16:24.309008+0000","last_fullsized":"2024-02-17T12:16:24.309008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:25:31.899460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309088+0000","last_change":"2024-02-17T12:16:22.312851+0000","last_active":"2024-02-17T12:16:24.309088+0000","last_peered":"2024-02-17T12:16:24.309088+0000","last_clean":"2024-02-17T12:16:24.309088+0000","last_became_active":"2024-02-17T12:16:22.312536+0000","last_became_peered":"2024-02-17T12:16:22.312536+0000","last_unstale":"2024-02-17T12:16:24.309088+0000","last_undegraded":"2024-02-17T12:16:24.309088+0000","last_fullsized":"2024-02-17T12:16:24.309088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:49:36.146858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698343+0000","last_change":"2024-02-17T12:16:23.319340+0000","last_active":"2024-02-17T12:16:24.698343+0000","last_peered":"2024-02-17T12:16:24.698343+0000","last_clean":"2024-02-17T12:16:24.698343+0000","last_became_active":"2024-02-17T12:16:23.318684+0000","last_became_peered":"2024-02-17T12:16:23.318684+0000","last_unstale":"2024-02-17T12:16:24.698343+0000","last_undegraded":"2024-02-17T12:16:24.698343+0000","last_fullsized":"2024-02-17T12:16:24.698343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308813+0000","last_change":"2024-02-17T12:16:22.313946+0000","last_active":"2024-02-17T12:16:24.308813+0000","last_peered":"2024-02-17T12:16:24.308813+0000","last_clean":"2024-02-17T12:16:24.308813+0000","last_became_active":"2024-02-17T12:16:22.313538+0000","last_became_peered":"2024-02-17T12:16:22.313538+0000","last_unstale":"2024-02-17T12:16:24.308813+0000","last_undegraded":"2024-02-17T12:16:24.308813+0000","last_fullsized":"2024-02-17T12:16:24.308813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.324117+0000","last_change":"2024-02-17T12:16:23.319708+0000","last_active":"2024-02-17T12:16:23.324117+0000","last_peered":"2024-02-17T12:16:23.324117+0000","last_clean":"2024-02-17T12:16:23.324117+0000","last_became_active":"2024-02-17T12:16:23.319152+0000","last_became_peered":"2024-02-17T12:16:23.319152+0000","last_unstale":"2024-02-17T12:16:23.324117+0000","last_undegraded":"2024-02-17T12:16:23.324117+0000","last_fullsized":"2024-02-17T12:16:23.324117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:05:02.924461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335292+0000","last_change":"2024-02-17T12:16:22.316733+0000","last_active":"2024-02-17T12:16:24.335292+0000","last_peered":"2024-02-17T12:16:24.335292+0000","last_clean":"2024-02-17T12:16:24.335292+0000","last_became_active":"2024-02-17T12:16:22.316383+0000","last_became_peered":"2024-02-17T12:16:22.316383+0000","last_unstale":"2024-02-17T12:16:24.335292+0000","last_undegraded":"2024-02-17T12:16:24.335292+0000","last_fullsized":"2024-02-17T12:16:24.335292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:53.726477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.329035+0000","last_change":"2024-02-17T12:16:23.326192+0000","last_active":"2024-02-17T12:16:23.329035+0000","last_peered":"2024-02-17T12:16:23.329035+0000","last_clean":"2024-02-17T12:16:23.329035+0000","last_became_active":"2024-02-17T12:16:23.325827+0000","last_became_peered":"2024-02-17T12:16:23.325827+0000","last_unstale":"2024-02-17T12:16:23.329035+0000","last_undegraded":"2024-02-17T12:16:23.329035+0000","last_fullsized":"2024-02-17T12:16:23.329035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:03:04.322625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697923+0000","last_change":"2024-02-17T12:16:22.310529+0000","last_active":"2024-02-17T12:16:24.697923+0000","last_peered":"2024-02-17T12:16:24.697923+0000","last_clean":"2024-02-17T12:16:24.697923+0000","last_became_active":"2024-02-17T12:16:22.310162+0000","last_became_peered":"2024-02-17T12:16:22.310162+0000","last_unstale":"2024-02-17T12:16:24.697923+0000","last_undegraded":"2024-02-17T12:16:24.697923+0000","last_fullsized":"2024-02-17T12:16:24.697923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:43.722209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697455+0000","last_change":"2024-02-17T12:16:23.313637+0000","last_active":"2024-02-17T12:16:24.697455+0000","last_peered":"2024-02-17T12:16:24.697455+0000","last_clean":"2024-02-17T12:16:24.697455+0000","last_became_active":"2024-02-17T12:16:23.313038+0000","last_became_peered":"2024-02-17T12:16:23.313038+0000","last_unstale":"2024-02-17T12:16:24.697455+0000","last_undegraded":"2024-02-17T12:16:24.697455+0000","last_fullsized":"2024-02-17T12:16:24.697455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:05:10.254057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308728+0000","last_change":"2024-02-17T12:16:22.315490+0000","last_active":"2024-02-17T12:16:24.308728+0000","last_peered":"2024-02-17T12:16:24.308728+0000","last_clean":"2024-02-17T12:16:24.308728+0000","last_became_active":"2024-02-17T12:16:22.315194+0000","last_became_peered":"2024-02-17T12:16:22.315194+0000","last_unstale":"2024-02-17T12:16:24.308728+0000","last_undegraded":"2024-02-17T12:16:24.308728+0000","last_fullsized":"2024-02-17T12:16:24.308728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.328547+0000","last_change":"2024-02-17T12:16:23.324173+0000","last_active":"2024-02-17T12:16:23.328547+0000","last_peered":"2024-02-17T12:16:23.328547+0000","last_clean":"2024-02-17T12:16:23.328547+0000","last_became_active":"2024-02-17T12:16:23.323675+0000","last_became_peered":"2024-02-17T12:16:23.323675+0000","last_unstale":"2024-02-17T12:16:23.328547+0000","last_undegraded":"2024-02-17T12:16:23.328547+0000","last_fullsized":"2024-02-17T12:16:23.328547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:38.274099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335182+0000","last_change":"2024-02-17T12:16:22.316662+0000","last_active":"2024-02-17T12:16:24.335182+0000","last_peered":"2024-02-17T12:16:24.335182+0000","last_clean":"2024-02-17T12:16:24.335182+0000","last_became_active":"2024-02-17T12:16:22.315202+0000","last_became_peered":"2024-02-17T12:16:22.315202+0000","last_unstale":"2024-02-17T12:16:24.335182+0000","last_undegraded":"2024-02-17T12:16:24.335182+0000","last_fullsized":"2024-02-17T12:16:24.335182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335242+0000","last_change":"2024-02-17T12:16:23.320591+0000","last_active":"2024-02-17T12:16:24.335242+0000","last_peered":"2024-02-17T12:16:24.335242+0000","last_clean":"2024-02-17T12:16:24.335242+0000","last_became_active":"2024-02-17T12:16:23.312514+0000","last_became_peered":"2024-02-17T12:16:23.312514+0000","last_unstale":"2024-02-17T12:16:24.335242+0000","last_undegraded":"2024-02-17T12:16:24.335242+0000","last_fullsized":"2024-02-17T12:16:24.335242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.341575+0000","last_change":"2024-02-17T12:16:22.302813+0000","last_active":"2024-02-17T12:16:23.341575+0000","last_peered":"2024-02-17T12:16:23.341575+0000","last_clean":"2024-02-17T12:16:23.341575+0000","last_became_active":"2024-02-17T12:16:22.302538+0000","last_became_peered":"2024-02-17T12:16:22.302538+0000","last_unstale":"2024-02-17T12:16:23.341575+0000","last_undegraded":"2024-02-17T12:16:23.341575+0000","last_fullsized":"2024-02-17T12:16:23.341575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:49:52.576082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.328376+0000","last_change":"2024-02-17T12:16:23.325642+0000","last_active":"2024-02-17T12:16:23.328376+0000","last_peered":"2024-02-17T12:16:23.328376+0000","last_clean":"2024-02-17T12:16:23.328376+0000","last_became_active":"2024-02-17T12:16:23.324419+0000","last_became_peered":"2024-02-17T12:16:23.324419+0000","last_unstale":"2024-02-17T12:16:23.328376+0000","last_undegraded":"2024-02-17T12:16:23.328376+0000","last_fullsized":"2024-02-17T12:16:23.328376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:44:33.890408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.335066+0000","last_change":"2024-02-17T12:16:22.311089+0000","last_active":"2024-02-17T12:16:23.335066+0000","last_peered":"2024-02-17T12:16:23.335066+0000","last_clean":"2024-02-17T12:16:23.335066+0000","last_became_active":"2024-02-17T12:16:22.310811+0000","last_became_peered":"2024-02-17T12:16:22.310811+0000","last_unstale":"2024-02-17T12:16:23.335066+0000","last_undegraded":"2024-02-17T12:16:23.335066+0000","last_fullsized":"2024-02-17T12:16:23.335066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:21:58.929168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.331593+0000","last_change":"2024-02-17T12:16:23.327054+0000","last_active":"2024-02-17T12:16:23.331593+0000","last_peered":"2024-02-17T12:16:23.331593+0000","last_clean":"2024-02-17T12:16:23.331593+0000","last_became_active":"2024-02-17T12:16:23.325063+0000","last_became_peered":"2024-02-17T12:16:23.325063+0000","last_unstale":"2024-02-17T12:16:23.331593+0000","last_undegraded":"2024-02-17T12:16:23.331593+0000","last_fullsized":"2024-02-17T12:16:23.331593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:45:05.523772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.339442+0000","last_change":"2024-02-17T12:16:22.307414+0000","last_active":"2024-02-17T12:16:23.339442+0000","last_peered":"2024-02-17T12:16:23.339442+0000","last_clean":"2024-02-17T12:16:23.339442+0000","last_became_active":"2024-02-17T12:16:22.306916+0000","last_became_peered":"2024-02-17T12:16:22.306916+0000","last_unstale":"2024-02-17T12:16:23.339442+0000","last_undegraded":"2024-02-17T12:16:23.339442+0000","last_fullsized":"2024-02-17T12:16:23.339442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:05:01.918619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.330874+0000","last_change":"2024-02-17T12:16:23.327878+0000","last_active":"2024-02-17T12:16:23.330874+0000","last_peered":"2024-02-17T12:16:23.330874+0000","last_clean":"2024-02-17T12:16:23.330874+0000","last_became_active":"2024-02-17T12:16:23.327225+0000","last_became_peered":"2024-02-17T12:16:23.327225+0000","last_unstale":"2024-02-17T12:16:23.330874+0000","last_undegraded":"2024-02-17T12:16:23.330874+0000","last_fullsized":"2024-02-17T12:16:23.330874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:49:55.517905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308913+0000","last_change":"2024-02-17T12:16:22.314711+0000","last_active":"2024-02-17T12:16:24.308913+0000","last_peered":"2024-02-17T12:16:24.308913+0000","last_clean":"2024-02-17T12:16:24.308913+0000","last_became_active":"2024-02-17T12:16:22.314441+0000","last_became_peered":"2024-02-17T12:16:22.314441+0000","last_unstale":"2024-02-17T12:16:24.308913+0000","last_undegraded":"2024-02-17T12:16:24.308913+0000","last_fullsized":"2024-02-17T12:16:24.308913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:53.726477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308939+0000","last_change":"2024-02-17T12:16:23.315096+0000","last_active":"2024-02-17T12:16:24.308939+0000","last_peered":"2024-02-17T12:16:24.308939+0000","last_clean":"2024-02-17T12:16:24.308939+0000","last_became_active":"2024-02-17T12:16:23.309975+0000","last_became_peered":"2024-02-17T12:16:23.309975+0000","last_unstale":"2024-02-17T12:16:24.308939+0000","last_undegraded":"2024-02-17T12:16:24.308939+0000","last_fullsized":"2024-02-17T12:16:24.308939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:18:14.299788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.300089+0000","last_change":"2024-02-17T12:16:22.310563+0000","last_active":"2024-02-17T12:16:23.300089+0000","last_peered":"2024-02-17T12:16:23.300089+0000","last_clean":"2024-02-17T12:16:23.300089+0000","last_became_active":"2024-02-17T12:16:22.310275+0000","last_became_peered":"2024-02-17T12:16:22.310275+0000","last_unstale":"2024-02-17T12:16:23.300089+0000","last_undegraded":"2024-02-17T12:16:23.300089+0000","last_fullsized":"2024-02-17T12:16:23.300089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:46:25.452272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.331439+0000","last_change":"2024-02-17T12:16:23.330066+0000","last_active":"2024-02-17T12:16:23.331439+0000","last_peered":"2024-02-17T12:16:23.331439+0000","last_clean":"2024-02-17T12:16:23.331439+0000","last_became_active":"2024-02-17T12:16:23.329816+0000","last_became_peered":"2024-02-17T12:16:23.329816+0000","last_unstale":"2024-02-17T12:16:23.331439+0000","last_undegraded":"2024-02-17T12:16:23.331439+0000","last_fullsized":"2024-02-17T12:16:23.331439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:56:09.917959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.307723+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:16:23.307723+0000","last_peered":"2024-02-17T12:16:23.307723+0000","last_clean":"2024-02-17T12:16:23.307723+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:16:23.307723+0000","last_undegraded":"2024-02-17T12:16:23.307723+0000","last_fullsized":"2024-02-17T12:16:23.307723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308410+0000","last_change":"2024-02-17T12:16:22.308615+0000","last_active":"2024-02-17T12:16:24.308410+0000","last_peered":"2024-02-17T12:16:24.308410+0000","last_clean":"2024-02-17T12:16:24.308410+0000","last_became_active":"2024-02-17T12:16:22.308153+0000","last_became_peered":"2024-02-17T12:16:22.308153+0000","last_unstale":"2024-02-17T12:16:24.308410+0000","last_undegraded":"2024-02-17T12:16:24.308410+0000","last_fullsized":"2024-02-17T12:16:24.308410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:05.491487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697598+0000","last_change":"2024-02-17T12:16:23.311520+0000","last_active":"2024-02-17T12:16:24.697598+0000","last_peered":"2024-02-17T12:16:24.697598+0000","last_clean":"2024-02-17T12:16:24.697598+0000","last_became_active":"2024-02-17T12:16:23.311139+0000","last_became_peered":"2024-02-17T12:16:23.311139+0000","last_unstale":"2024-02-17T12:16:24.697598+0000","last_undegraded":"2024-02-17T12:16:24.697598+0000","last_fullsized":"2024-02-17T12:16:24.697598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.307653+0000","last_change":"2024-02-17T12:16:22.324920+0000","last_active":"2024-02-17T12:16:23.307653+0000","last_peered":"2024-02-17T12:16:23.307653+0000","last_clean":"2024-02-17T12:16:23.307653+0000","last_became_active":"2024-02-17T12:16:22.324670+0000","last_became_peered":"2024-02-17T12:16:22.324670+0000","last_unstale":"2024-02-17T12:16:23.307653+0000","last_undegraded":"2024-02-17T12:16:23.307653+0000","last_fullsized":"2024-02-17T12:16:23.307653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:44:55.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697257+0000","last_change":"2024-02-17T12:16:23.303047+0000","last_active":"2024-02-17T12:16:24.697257+0000","last_peered":"2024-02-17T12:16:24.697257+0000","last_clean":"2024-02-17T12:16:24.697257+0000","last_became_active":"2024-02-17T12:16:23.302661+0000","last_became_peered":"2024-02-17T12:16:23.302661+0000","last_unstale":"2024-02-17T12:16:24.697257+0000","last_undegraded":"2024-02-17T12:16:24.697257+0000","last_fullsized":"2024-02-17T12:16:24.697257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:44:54.619964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.300007+0000","last_change":"2024-02-17T12:16:22.308200+0000","last_active":"2024-02-17T12:16:23.300007+0000","last_peered":"2024-02-17T12:16:23.300007+0000","last_clean":"2024-02-17T12:16:23.300007+0000","last_became_active":"2024-02-17T12:16:22.307887+0000","last_became_peered":"2024-02-17T12:16:22.307887+0000","last_unstale":"2024-02-17T12:16:23.300007+0000","last_undegraded":"2024-02-17T12:16:23.300007+0000","last_fullsized":"2024-02-17T12:16:23.300007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:03.723225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308610+0000","last_change":"2024-02-17T12:16:23.312512+0000","last_active":"2024-02-17T12:16:24.308610+0000","last_peered":"2024-02-17T12:16:24.308610+0000","last_clean":"2024-02-17T12:16:24.308610+0000","last_became_active":"2024-02-17T12:16:23.312190+0000","last_became_peered":"2024-02-17T12:16:23.312190+0000","last_unstale":"2024-02-17T12:16:24.308610+0000","last_undegraded":"2024-02-17T12:16:24.308610+0000","last_fullsized":"2024-02-17T12:16:24.308610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308798+0000","last_change":"2024-02-17T12:16:22.307969+0000","last_active":"2024-02-17T12:16:24.308798+0000","last_peered":"2024-02-17T12:16:24.308798+0000","last_clean":"2024-02-17T12:16:24.308798+0000","last_became_active":"2024-02-17T12:16:22.307639+0000","last_became_peered":"2024-02-17T12:16:22.307639+0000","last_unstale":"2024-02-17T12:16:24.308798+0000","last_undegraded":"2024-02-17T12:16:24.308798+0000","last_fullsized":"2024-02-17T12:16:24.308798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.316173+0000","last_change":"2024-02-17T12:16:23.306045+0000","last_active":"2024-02-17T12:16:23.316173+0000","last_peered":"2024-02-17T12:16:23.316173+0000","last_clean":"2024-02-17T12:16:23.316173+0000","last_became_active":"2024-02-17T12:16:23.305674+0000","last_became_peered":"2024-02-17T12:16:23.305674+0000","last_unstale":"2024-02-17T12:16:23.316173+0000","last_undegraded":"2024-02-17T12:16:23.316173+0000","last_fullsized":"2024-02-17T12:16:23.316173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:38:41.070381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308940+0000","last_change":"2024-02-17T12:16:22.308387+0000","last_active":"2024-02-17T12:16:24.308940+0000","last_peered":"2024-02-17T12:16:24.308940+0000","last_clean":"2024-02-17T12:16:24.308940+0000","last_became_active":"2024-02-17T12:16:22.308043+0000","last_became_peered":"2024-02-17T12:16:22.308043+0000","last_unstale":"2024-02-17T12:16:24.308940+0000","last_undegraded":"2024-02-17T12:16:24.308940+0000","last_fullsized":"2024-02-17T12:16:24.308940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308982+0000","last_change":"2024-02-17T12:16:23.310304+0000","last_active":"2024-02-17T12:16:24.308982+0000","last_peered":"2024-02-17T12:16:24.308982+0000","last_clean":"2024-02-17T12:16:24.308982+0000","last_became_active":"2024-02-17T12:16:23.309898+0000","last_became_peered":"2024-02-17T12:16:23.309898+0000","last_unstale":"2024-02-17T12:16:24.308982+0000","last_undegraded":"2024-02-17T12:16:24.308982+0000","last_fullsized":"2024-02-17T12:16:24.308982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:15:22.881157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.309220+0000","last_change":"2024-02-17T12:16:22.326425+0000","last_active":"2024-02-17T12:16:23.309220+0000","last_peered":"2024-02-17T12:16:23.309220+0000","last_clean":"2024-02-17T12:16:23.309220+0000","last_became_active":"2024-02-17T12:16:22.326149+0000","last_became_peered":"2024-02-17T12:16:22.326149+0000","last_unstale":"2024-02-17T12:16:23.309220+0000","last_undegraded":"2024-02-17T12:16:23.309220+0000","last_fullsized":"2024-02-17T12:16:23.309220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:58.719013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308851+0000","last_change":"2024-02-17T12:16:23.308825+0000","last_active":"2024-02-17T12:16:24.308851+0000","last_peered":"2024-02-17T12:16:24.308851+0000","last_clean":"2024-02-17T12:16:24.308851+0000","last_became_active":"2024-02-17T12:16:23.308519+0000","last_became_peered":"2024-02-17T12:16:23.308519+0000","last_unstale":"2024-02-17T12:16:24.308851+0000","last_undegraded":"2024-02-17T12:16:24.308851+0000","last_fullsized":"2024-02-17T12:16:24.308851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.333542+0000","last_change":"2024-02-17T12:16:22.312030+0000","last_active":"2024-02-17T12:16:24.333542+0000","last_peered":"2024-02-17T12:16:24.333542+0000","last_clean":"2024-02-17T12:16:24.333542+0000","last_became_active":"2024-02-17T12:16:22.311589+0000","last_became_peered":"2024-02-17T12:16:22.311589+0000","last_unstale":"2024-02-17T12:16:24.333542+0000","last_undegraded":"2024-02-17T12:16:24.333542+0000","last_fullsized":"2024-02-17T12:16:24.333542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:41.148188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697953+0000","last_change":"2024-02-17T12:16:23.317377+0000","last_active":"2024-02-17T12:16:24.697953+0000","last_peered":"2024-02-17T12:16:24.697953+0000","last_clean":"2024-02-17T12:16:24.697953+0000","last_became_active":"2024-02-17T12:16:23.317054+0000","last_became_peered":"2024-02-17T12:16:23.317054+0000","last_unstale":"2024-02-17T12:16:24.697953+0000","last_undegraded":"2024-02-17T12:16:24.697953+0000","last_fullsized":"2024-02-17T12:16:24.697953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335600+0000","last_change":"2024-02-17T12:16:22.320467+0000","last_active":"2024-02-17T12:16:24.335600+0000","last_peered":"2024-02-17T12:16:24.335600+0000","last_clean":"2024-02-17T12:16:24.335600+0000","last_became_active":"2024-02-17T12:16:22.319418+0000","last_became_peered":"2024-02-17T12:16:22.319418+0000","last_unstale":"2024-02-17T12:16:24.335600+0000","last_undegraded":"2024-02-17T12:16:24.335600+0000","last_fullsized":"2024-02-17T12:16:24.335600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:52:32.067973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698388+0000","last_change":"2024-02-17T12:16:23.307769+0000","last_active":"2024-02-17T12:16:24.698388+0000","last_peered":"2024-02-17T12:16:24.698388+0000","last_clean":"2024-02-17T12:16:24.698388+0000","last_became_active":"2024-02-17T12:16:23.305664+0000","last_became_peered":"2024-02-17T12:16:23.305664+0000","last_unstale":"2024-02-17T12:16:24.698388+0000","last_undegraded":"2024-02-17T12:16:24.698388+0000","last_fullsized":"2024-02-17T12:16:24.698388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.306984+0000","last_change":"2024-02-17T12:16:22.324065+0000","last_active":"2024-02-17T12:16:23.306984+0000","last_peered":"2024-02-17T12:16:23.306984+0000","last_clean":"2024-02-17T12:16:23.306984+0000","last_became_active":"2024-02-17T12:16:22.323818+0000","last_became_peered":"2024-02-17T12:16:22.323818+0000","last_unstale":"2024-02-17T12:16:23.306984+0000","last_undegraded":"2024-02-17T12:16:23.306984+0000","last_fullsized":"2024-02-17T12:16:23.306984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:15.029228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.316317+0000","last_change":"2024-02-17T12:16:23.313005+0000","last_active":"2024-02-17T12:16:23.316317+0000","last_peered":"2024-02-17T12:16:23.316317+0000","last_clean":"2024-02-17T12:16:23.316317+0000","last_became_active":"2024-02-17T12:16:23.312532+0000","last_became_peered":"2024-02-17T12:16:23.312532+0000","last_unstale":"2024-02-17T12:16:23.316317+0000","last_undegraded":"2024-02-17T12:16:23.316317+0000","last_fullsized":"2024-02-17T12:16:23.316317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:04.729067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308811+0000","last_change":"2024-02-17T12:16:22.313418+0000","last_active":"2024-02-17T12:16:24.308811+0000","last_peered":"2024-02-17T12:16:24.308811+0000","last_clean":"2024-02-17T12:16:24.308811+0000","last_became_active":"2024-02-17T12:16:22.312996+0000","last_became_peered":"2024-02-17T12:16:22.312996+0000","last_unstale":"2024-02-17T12:16:24.308811+0000","last_undegraded":"2024-02-17T12:16:24.308811+0000","last_fullsized":"2024-02-17T12:16:24.308811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:49:36.146858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697537+0000","last_change":"2024-02-17T12:16:23.306549+0000","last_active":"2024-02-17T12:16:24.697537+0000","last_peered":"2024-02-17T12:16:24.697537+0000","last_clean":"2024-02-17T12:16:24.697537+0000","last_became_active":"2024-02-17T12:16:23.306251+0000","last_became_peered":"2024-02-17T12:16:23.306251+0000","last_unstale":"2024-02-17T12:16:24.697537+0000","last_undegraded":"2024-02-17T12:16:24.697537+0000","last_fullsized":"2024-02-17T12:16:24.697537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308802+0000","last_change":"2024-02-17T12:16:22.316022+0000","last_active":"2024-02-17T12:16:24.308802+0000","last_peered":"2024-02-17T12:16:24.308802+0000","last_clean":"2024-02-17T12:16:24.308802+0000","last_became_active":"2024-02-17T12:16:22.315761+0000","last_became_peered":"2024-02-17T12:16:22.315761+0000","last_unstale":"2024-02-17T12:16:24.308802+0000","last_undegraded":"2024-02-17T12:16:24.308802+0000","last_fullsized":"2024-02-17T12:16:24.308802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:49.705448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697882+0000","last_change":"2024-02-17T12:16:23.306391+0000","last_active":"2024-02-17T12:16:24.697882+0000","last_peered":"2024-02-17T12:16:24.697882+0000","last_clean":"2024-02-17T12:16:24.697882+0000","last_became_active":"2024-02-17T12:16:23.306103+0000","last_became_peered":"2024-02-17T12:16:23.306103+0000","last_unstale":"2024-02-17T12:16:24.697882+0000","last_undegraded":"2024-02-17T12:16:24.697882+0000","last_fullsized":"2024-02-17T12:16:24.697882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.338560+0000","last_change":"2024-02-17T12:16:22.323792+0000","last_active":"2024-02-17T12:16:23.338560+0000","last_peered":"2024-02-17T12:16:23.338560+0000","last_clean":"2024-02-17T12:16:23.338560+0000","last_became_active":"2024-02-17T12:16:22.323508+0000","last_became_peered":"2024-02-17T12:16:22.323508+0000","last_unstale":"2024-02-17T12:16:23.338560+0000","last_undegraded":"2024-02-17T12:16:23.338560+0000","last_fullsized":"2024-02-17T12:16:23.338560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:03.944585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335206+0000","last_change":"2024-02-17T12:16:23.320721+0000","last_active":"2024-02-17T12:16:24.335206+0000","last_peered":"2024-02-17T12:16:24.335206+0000","last_clean":"2024-02-17T12:16:24.335206+0000","last_became_active":"2024-02-17T12:16:23.312733+0000","last_became_peered":"2024-02-17T12:16:23.312733+0000","last_unstale":"2024-02-17T12:16:24.335206+0000","last_undegraded":"2024-02-17T12:16:24.335206+0000","last_fullsized":"2024-02-17T12:16:24.335206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308809+0000","last_change":"2024-02-17T12:16:23.301646+0000","last_active":"2024-02-17T12:16:24.308809+0000","last_peered":"2024-02-17T12:16:24.308809+0000","last_clean":"2024-02-17T12:16:24.308809+0000","last_became_active":"2024-02-17T12:16:23.301322+0000","last_became_peered":"2024-02-17T12:16:23.301322+0000","last_unstale":"2024-02-17T12:16:24.308809+0000","last_undegraded":"2024-02-17T12:16:24.308809+0000","last_fullsized":"2024-02-17T12:16:24.308809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:46:17.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.337218+0000","last_change":"2024-02-17T12:16:22.326677+0000","last_active":"2024-02-17T12:16:23.337218+0000","last_peered":"2024-02-17T12:16:23.337218+0000","last_clean":"2024-02-17T12:16:23.337218+0000","last_became_active":"2024-02-17T12:16:22.326136+0000","last_became_peered":"2024-02-17T12:16:22.326136+0000","last_unstale":"2024-02-17T12:16:23.337218+0000","last_undegraded":"2024-02-17T12:16:23.337218+0000","last_fullsized":"2024-02-17T12:16:23.337218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:34:18.512763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308731+0000","last_change":"2024-02-17T12:16:23.314407+0000","last_active":"2024-02-17T12:16:24.308731+0000","last_peered":"2024-02-17T12:16:24.308731+0000","last_clean":"2024-02-17T12:16:24.308731+0000","last_became_active":"2024-02-17T12:16:23.310090+0000","last_became_peered":"2024-02-17T12:16:23.310090+0000","last_unstale":"2024-02-17T12:16:24.308731+0000","last_undegraded":"2024-02-17T12:16:24.308731+0000","last_fullsized":"2024-02-17T12:16:24.308731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:26:24.802958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-17T12:16:23.338091+0000","last_change":"2024-02-17T12:16:22.326377+0000","last_active":"2024-02-17T12:16:23.338091+0000","last_peered":"2024-02-17T12:16:23.338091+0000","last_clean":"2024-02-17T12:16:23.338091+0000","last_became_active":"2024-02-17T12:16:22.326122+0000","last_became_peered":"2024-02-17T12:16:22.326122+0000","last_unstale":"2024-02-17T12:16:23.338091+0000","last_undegraded":"2024-02-17T12:16:23.338091+0000","last_fullsized":"2024-02-17T12:16:23.338091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:58.566689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698320+0000","last_change":"2024-02-17T12:16:23.319347+0000","last_active":"2024-02-17T12:16:24.698320+0000","last_peered":"2024-02-17T12:16:24.698320+0000","last_clean":"2024-02-17T12:16:24.698320+0000","last_became_active":"2024-02-17T12:16:23.319070+0000","last_became_peered":"2024-02-17T12:16:23.319070+0000","last_unstale":"2024-02-17T12:16:24.698320+0000","last_undegraded":"2024-02-17T12:16:24.698320+0000","last_fullsized":"2024-02-17T12:16:24.698320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697633+0000","last_change":"2024-02-17T12:16:22.314871+0000","last_active":"2024-02-17T12:16:24.697633+0000","last_peered":"2024-02-17T12:16:24.697633+0000","last_clean":"2024-02-17T12:16:24.697633+0000","last_became_active":"2024-02-17T12:16:22.314596+0000","last_became_peered":"2024-02-17T12:16:22.314596+0000","last_unstale":"2024-02-17T12:16:24.697633+0000","last_undegraded":"2024-02-17T12:16:24.697633+0000","last_fullsized":"2024-02-17T12:16:24.697633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:05.491487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697334+0000","last_change":"2024-02-17T12:16:23.322438+0000","last_active":"2024-02-17T12:16:24.697334+0000","last_peered":"2024-02-17T12:16:24.697334+0000","last_clean":"2024-02-17T12:16:24.697334+0000","last_became_active":"2024-02-17T12:16:23.322009+0000","last_became_peered":"2024-02-17T12:16:23.322009+0000","last_unstale":"2024-02-17T12:16:24.697334+0000","last_undegraded":"2024-02-17T12:16:24.697334+0000","last_fullsized":"2024-02-17T12:16:24.697334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698449+0000","last_change":"2024-02-17T12:16:22.317765+0000","last_active":"2024-02-17T12:16:24.698449+0000","last_peered":"2024-02-17T12:16:24.698449+0000","last_clean":"2024-02-17T12:16:24.698449+0000","last_became_active":"2024-02-17T12:16:22.317363+0000","last_became_peered":"2024-02-17T12:16:22.317363+0000","last_unstale":"2024-02-17T12:16:24.698449+0000","last_undegraded":"2024-02-17T12:16:24.698449+0000","last_fullsized":"2024-02-17T12:16:24.698449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:07:14.946092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":72631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":67853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":657247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":794624,"data_stored":657191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":66367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":196608,"data_stored":66241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:16:27.780 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T12:16:27.781 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-17T12:16:27.781 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-17T12:16:27.781 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-17T12:16:27.782 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-17T12:16:27.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1d1a00640 1 Processor -- start 2024-02-17T12:16:27.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1d1a00640 1 -- start start 2024-02-17T12:16:27.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1d1a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc150300 0x7fd1cc156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1d1a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc157270 con 0x7fd1cc152d30 2024-02-17T12:16:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1d1a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0c3580 con 0x7fd1cc0714c0 2024-02-17T12:16:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1d1a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c6900 con 0x7fd1cc150300 2024-02-17T12:16:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1cb400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd1cc152d30 0x7fd1cc1531c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45428/0 (socket says 172.21.15.114:45428) 2024-02-17T12:16:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1cb400640 1 -- 172.21.15.114:0/989891675 learned_addr learned my addr 172.21.15.114:0/989891675 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1caa00640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc150300 0x7fd1cc156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659902221 0 0) 0x7fd1cc157270 con 0x7fd1cc152d30 2024-02-17T12:16:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b0003530 con 0x7fd1cc152d30 2024-02-17T12:16:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953526374 0 0) 0x7fd1cc0c3580 con 0x7fd1cc0714c0 2024-02-17T12:16:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1cc157270 con 0x7fd1cc0714c0 2024-02-17T12:16:27.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2270321713 0 0) 0x7fd1b0003530 con 0x7fd1cc152d30 2024-02-17T12:16:27.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc150300 msgr2=0x7fd1cc156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:27.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc150300 0x7fd1cc156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 >> v1:172.21.15.116:6789/0 conn(0x7fd1cc0714c0 legacy=0x7fd1cc0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0c2fc0 con 0x7fd1cc152d30 2024-02-17T12:16:27.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fd1c4001680 con 0x7fd1cc152d30 2024-02-17T12:16:27.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1caa00640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc150300 0x7fd1cc156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:27.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 >> v1:172.21.15.114:6789/0 conn(0x7fd1cc152d30 legacy=0x7fd1cc1531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1b0003b40 0x7fd1b0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc150300 0x7fd1b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1b0004d10 0x7fd1b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c6900 con 0x7fd1b0004d10 2024-02-17T12:16:27.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b000ba70 con 0x7fd1b0003b40 2024-02-17T12:16:27.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b000bc30 con 0x7fd1cc150300 2024-02-17T12:16:27.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1cb400640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1b0004d10 0x7fd1b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1caa00640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1b0003b40 0x7fd1b0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1ca000640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc150300 0x7fd1b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1cb400640 1 -- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc150300 msgr2=0x7fd1b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:27.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1cb400640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc150300 0x7fd1b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1cb400640 1 -- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1b0003b40 msgr2=0x7fd1b0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:27.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1cb400640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1b0003b40 0x7fd1b0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.948+0000 7fd1cb400640 1 -- 172.21.15.114:0/989891675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc009a70 con 0x7fd1b0004d10 2024-02-17T12:16:27.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1cb400640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1b0004d10 0x7fd1b0005190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c160 tx=0x7fd1c401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95360a71c922026 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:27.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40058e0 con 0x7fd1b0004d10 2024-02-17T12:16:27.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4005a40 con 0x7fd1b0004d10 2024-02-17T12:16:27.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1c9600640 1 -- 172.21.15.114:0/989891675 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4005df0 con 0x7fd1b0004d10 2024-02-17T12:16:27.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1d1a00640 1 -- 172.21.15.114:0/989891675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1b0004d10 msgr2=0x7fd1b0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1d1a00640 1 --2- 172.21.15.114:0/989891675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1b0004d10 0x7fd1b0005190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c160 tx=0x7fd1c401cbc0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1cb400640 1 -- 172.21.15.114:0/989891675 reap_dead start 2024-02-17T12:16:27.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1d1a00640 1 -- 172.21.15.114:0/989891675 shutdown_connections 2024-02-17T12:16:27.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1d1a00640 1 -- 172.21.15.114:0/989891675 >> 172.21.15.114:0/989891675 conn(0x7fd1cc0c4f20 msgr2=0x7fd1cc0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:27.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1d1a00640 1 -- 172.21.15.114:0/989891675 shutdown_connections 2024-02-17T12:16:27.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.952+0000 7fd1d1a00640 1 -- 172.21.15.114:0/989891675 wait complete. 2024-02-17T12:16:27.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 Processor -- start 2024-02-17T12:16:27.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 -- start start 2024-02-17T12:16:27.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1b0004d10 0x7fd1cc154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1cc0a93f0 0x7fd1cc1edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc1ee080 0x7fd1cc156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc14cc40 con 0x7fd1cc0a93f0 2024-02-17T12:16:27.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc154fa0 con 0x7fd1b0004d10 2024-02-17T12:16:27.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc1ed5f0 con 0x7fd1cc1ee080 2024-02-17T12:16:27.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1ca000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1cc0a93f0 0x7fd1cc1edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1ca000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1cc0a93f0 0x7fd1cc1edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57510/0 (socket says 172.21.15.114:57510) 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1ca000640 1 -- 172.21.15.114:0/1487081501 learned_addr learned my addr 172.21.15.114:0/1487081501 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1caa00640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1b0004d10 0x7fd1cc154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1cb400640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc1ee080 0x7fd1cc156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1ca000640 1 -- 172.21.15.114:0/1487081501 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc1ee080 msgr2=0x7fd1cc156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1ca000640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc1ee080 0x7fd1cc156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1ca000640 1 -- 172.21.15.114:0/1487081501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1b0004d10 msgr2=0x7fd1cc154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1ca000640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1b0004d10 0x7fd1cc154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1ca000640 1 -- 172.21.15.114:0/1487081501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc1ee500 con 0x7fd1cc0a93f0 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1ca000640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1cc0a93f0 0x7fd1cc1edb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4005630 tx=0x7fd1b4012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1c2a00640 1 -- 172.21.15.114:0/1487081501 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4010ba0 con 0x7fd1cc0a93f0 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1c2a00640 1 -- 172.21.15.114:0/1487081501 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b4010d40 con 0x7fd1cc0a93f0 2024-02-17T12:16:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1c2a00640 1 -- 172.21.15.114:0/1487081501 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40166c0 con 0x7fd1cc0a93f0 2024-02-17T12:16:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 -- 172.21.15.114:0/1487081501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc14c5d0 con 0x7fd1cc0a93f0 2024-02-17T12:16:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 -- 172.21.15.114:0/1487081501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc14ce90 con 0x7fd1cc0a93f0 2024-02-17T12:16:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.956+0000 7fd1d1a00640 1 -- 172.21.15.114:0/1487081501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc06bac0 con 0x7fd1cc0a93f0 2024-02-17T12:16:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.960+0000 7fd1c2a00640 1 -- 172.21.15.114:0/1487081501 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd1b4016820 con 0x7fd1cc0a93f0 2024-02-17T12:16:27.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.960+0000 7fd1c2a00640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd1a8066e70 0x7fd1a8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:27.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.960+0000 7fd1c2a00640 1 -- 172.21.15.114:0/1487081501 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1b4088200 con 0x7fd1cc0a93f0 2024-02-17T12:16:27.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.960+0000 7fd1caa00640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd1a8066e70 0x7fd1a8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:27.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.960+0000 7fd1caa00640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd1a8066e70 0x7fd1a8069330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009fd0 tx=0x7fd1bc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:27.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:27.964+0000 7fd1c2a00640 1 -- 172.21.15.114:0/1487081501 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd1b4054fe0 con 0x7fd1cc0a93f0 2024-02-17T12:16:28.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.152+0000 7fd1d1a00640 1 -- 172.21.15.114:0/1487081501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd1cc074840 con 0x7fd1cc0a93f0 2024-02-17T12:16:28.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.156+0000 7fd1c2a00640 1 -- 172.21.15.114:0/1487081501 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+165197 (secure 0 0 0) 0x7fd1b40586a0 con 0x7fd1cc0a93f0 2024-02-17T12:16:28.162 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:28.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 -- 172.21.15.114:0/1487081501 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd1a8066e70 msgr2=0x7fd1a8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd1a8066e70 0x7fd1a8069330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009fd0 tx=0x7fd1bc00b040 comp rx=0 tx=0).stop 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 -- 172.21.15.114:0/1487081501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1cc0a93f0 msgr2=0x7fd1cc1edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1cc0a93f0 0x7fd1cc1edb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4005630 tx=0x7fd1b4012d00 comp rx=0 tx=0).stop 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 -- 172.21.15.114:0/1487081501 shutdown_connections 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1cc1ee080 0x7fd1cc156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd1a8066e70 0x7fd1a8069330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1cc0a93f0 0x7fd1cc1edb40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 --2- 172.21.15.114:0/1487081501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd1b0004d10 0x7fd1cc154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 -- 172.21.15.114:0/1487081501 >> 172.21.15.114:0/1487081501 conn(0x7fd1cc0c4f20 msgr2=0x7fd1cc151400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 -- 172.21.15.114:0/1487081501 shutdown_connections 2024-02-17T12:16:28.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.160+0000 7fd1d1a00640 1 -- 172.21.15.114:0/1487081501 wait complete. 2024-02-17T12:16:28.183 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3817243712},{"type":"v1","addr":"172.21.15.114:6833","nonce":3817243712}]},"active_addr":"172.21.15.114:6833/3817243712","active_change":"2024-02-17T12:16:03.204742+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3311076695}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":26194655}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":600256988}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":51280135}]}]} 2024-02-17T12:16:28.186 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-17T12:16:28.186 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-17T12:16:28.187 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe09b600640 1 Processor -- start 2024-02-17T12:16:28.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe09b600640 1 -- start start 2024-02-17T12:16:28.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe09b600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe094152540 0x7fe09406ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe09b600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0940c6460 0x7fe094158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe09b600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe094154e30 0x7fe0940aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe09b600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe094155dd0 con 0x7fe0940c6460 2024-02-17T12:16:28.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe09b600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0941588c0 con 0x7fe094152540 2024-02-17T12:16:28.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe09b600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe094155810 con 0x7fe094154e30 2024-02-17T12:16:28.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe093e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0940c6460 0x7fe094158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe093e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0940c6460 0x7fe094158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57516/0 (socket says 172.21.15.114:57516) 2024-02-17T12:16:28.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe093e00640 1 -- 172.21.15.114:0/2412645979 learned_addr learned my addr 172.21.15.114:0/2412645979 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:28.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe098c00640 1 --2- 172.21.15.114:0/2412645979 >> v2:172.21.15.116:3300/0 conn(0x7fe094152540 0x7fe09406ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe099600640 1 --2- 172.21.15.114:0/2412645979 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe094154e30 0x7fe0940aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe093e00640 1 -- 172.21.15.114:0/2412645979 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe094154e30 msgr2=0x7fe0940aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:28.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe093e00640 1 --2- 172.21.15.114:0/2412645979 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe094154e30 0x7fe0940aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe093e00640 1 -- 172.21.15.114:0/2412645979 >> v2:172.21.15.116:3300/0 conn(0x7fe094152540 msgr2=0x7fe09406ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:28.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe093e00640 1 --2- 172.21.15.114:0/2412645979 >> v2:172.21.15.116:3300/0 conn(0x7fe094152540 0x7fe09406ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.320+0000 7fe093e00640 1 -- 172.21.15.114:0/2412645979 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094155af0 con 0x7fe0940c6460 2024-02-17T12:16:28.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe093e00640 1 --2- 172.21.15.114:0/2412645979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0940c6460 0x7fe094158d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe09406dff0 tx=0x7fe08001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817086887f610d46 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:28.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe093400640 1 -- 172.21.15.114:0/2412645979 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0800ab600 con 0x7fe0940c6460 2024-02-17T12:16:28.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe093400640 1 -- 172.21.15.114:0/2412645979 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0800a7050 con 0x7fe0940c6460 2024-02-17T12:16:28.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe093400640 1 -- 172.21.15.114:0/2412645979 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0800ab980 con 0x7fe0940c6460 2024-02-17T12:16:28.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe09b600640 1 -- 172.21.15.114:0/2412645979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0940c6460 msgr2=0x7fe094158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe09b600640 1 --2- 172.21.15.114:0/2412645979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0940c6460 0x7fe094158d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe09406dff0 tx=0x7fe08001c400 comp rx=0 tx=0).stop 2024-02-17T12:16:28.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe09b600640 1 -- 172.21.15.114:0/2412645979 shutdown_connections 2024-02-17T12:16:28.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe09b600640 1 --2- 172.21.15.114:0/2412645979 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe094154e30 0x7fe0940aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe09b600640 1 --2- 172.21.15.114:0/2412645979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0940c6460 0x7fe094158d50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe09b600640 1 --2- 172.21.15.114:0/2412645979 >> v2:172.21.15.116:3300/0 conn(0x7fe094152540 0x7fe09406ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe09b600640 1 -- 172.21.15.114:0/2412645979 >> 172.21.15.114:0/2412645979 conn(0x7fe0940c4f20 msgr2=0x7fe0940c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:28.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe09b600640 1 -- 172.21.15.114:0/2412645979 shutdown_connections 2024-02-17T12:16:28.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.324+0000 7fe09b600640 1 -- 172.21.15.114:0/2412645979 wait complete. 2024-02-17T12:16:28.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 Processor -- start 2024-02-17T12:16:28.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 -- start start 2024-02-17T12:16:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe0940c6460 0x7fe09406bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe094152540 0x7fe0940ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe094154e30 0x7fe094149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09406c230 con 0x7fe094154e30 2024-02-17T12:16:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940ad4c0 con 0x7fe094152540 2024-02-17T12:16:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940ad7a0 con 0x7fe0940c6460 2024-02-17T12:16:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe099600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe094154e30 0x7fe094149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe099600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe094154e30 0x7fe094149a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57520/0 (socket says 172.21.15.114:57520) 2024-02-17T12:16:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe099600640 1 -- 172.21.15.114:0/1559871699 learned_addr learned my addr 172.21.15.114:0/1559871699 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:28.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe098c00640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe0940c6460 0x7fe09406bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe093e00640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe094152540 0x7fe0940ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe099600640 1 -- 172.21.15.114:0/1559871699 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe0940c6460 msgr2=0x7fe09406bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe099600640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe0940c6460 0x7fe09406bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe099600640 1 -- 172.21.15.114:0/1559871699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe094152540 msgr2=0x7fe0940ab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe099600640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe094152540 0x7fe0940ab730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe099600640 1 -- 172.21.15.114:0/1559871699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800094d0 con 0x7fe094154e30 2024-02-17T12:16:28.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe099600640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe094154e30 0x7fe094149a60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00e7f0 tx=0x7fe08c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:28.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe090c00640 1 -- 172.21.15.114:0/1559871699 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c009530 con 0x7fe094154e30 2024-02-17T12:16:28.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe090c00640 1 -- 172.21.15.114:0/1559871699 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c00eea0 con 0x7fe094154e30 2024-02-17T12:16:28.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe090c00640 1 -- 172.21.15.114:0/1559871699 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00cb60 con 0x7fe094154e30 2024-02-17T12:16:28.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 -- 172.21.15.114:0/1559871699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0940ada80 con 0x7fe094154e30 2024-02-17T12:16:28.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 -- 172.21.15.114:0/1559871699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0940abc70 con 0x7fe094154e30 2024-02-17T12:16:28.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.328+0000 7fe09b600640 1 -- 172.21.15.114:0/1559871699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0940c4d90 con 0x7fe094154e30 2024-02-17T12:16:28.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.332+0000 7fe090c00640 1 -- 172.21.15.114:0/1559871699 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe08c00ccc0 con 0x7fe094154e30 2024-02-17T12:16:28.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.332+0000 7fe090c00640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe074066e40 0x7fe074069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.332+0000 7fe090c00640 1 -- 172.21.15.114:0/1559871699 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe08c084aa0 con 0x7fe094154e30 2024-02-17T12:16:28.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.332+0000 7fe098c00640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe074066e40 0x7fe074069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.332+0000 7fe098c00640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe074066e40 0x7fe074069300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0840113e0 tx=0x7fe08400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:28.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.336+0000 7fe090c00640 1 -- 172.21.15.114:0/1559871699 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe08c0518a0 con 0x7fe094154e30 2024-02-17T12:16:28.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.488+0000 7fe09b600640 1 -- 172.21.15.114:0/1559871699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0940adfa0 con 0x7fe094154e30 2024-02-17T12:16:28.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe090c00640 1 -- 172.21.15.114:0/1559871699 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fe08c017090 con 0x7fe094154e30 2024-02-17T12:16:28.495 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:28.495 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:28.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 -- 172.21.15.114:0/1559871699 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe074066e40 msgr2=0x7fe074069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe074066e40 0x7fe074069300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0840113e0 tx=0x7fe08400b040 comp rx=0 tx=0).stop 2024-02-17T12:16:28.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 -- 172.21.15.114:0/1559871699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe094154e30 msgr2=0x7fe094149a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe094154e30 0x7fe094149a60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00e7f0 tx=0x7fe08c00ecb0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 -- 172.21.15.114:0/1559871699 shutdown_connections 2024-02-17T12:16:28.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe074066e40 0x7fe074069300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe094154e30 0x7fe094149a60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe094152540 0x7fe0940ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 --2- 172.21.15.114:0/1559871699 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe0940c6460 0x7fe09406bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 -- 172.21.15.114:0/1559871699 >> 172.21.15.114:0/1559871699 conn(0x7fe0940c4f20 msgr2=0x7fe0940c44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:28.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 -- 172.21.15.114:0/1559871699 shutdown_connections 2024-02-17T12:16:28.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.492+0000 7fe09b600640 1 -- 172.21.15.114:0/1559871699 wait complete. 2024-02-17T12:16:28.515 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-17T12:16:28.516 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:28.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a4d800640 1 Processor -- start 2024-02-17T12:16:28.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a4d800640 1 -- start start 2024-02-17T12:16:28.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a4d800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5a48150300 0x7f5a48156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a4d800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 0x7f5a481531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a4d800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a48157270 con 0x7f5a480714c0 2024-02-17T12:16:28.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a4d800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a480c6900 con 0x7f5a48150300 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a4d800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480c3580 con 0x7f5a48152d30 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a3fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5a480714c0 0x7f5a480aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45442/0 (socket says 172.21.15.114:45442) 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a3fe00640 1 -- 172.21.15.114:0/1368917234 learned_addr learned my addr 172.21.15.114:0/1368917234 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a46a00640 1 --2- 172.21.15.114:0/1368917234 >> v2:172.21.15.116:3300/0 conn(0x7f5a48150300 0x7f5a48156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a47400640 1 --2- 172.21.15.114:0/1368917234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 0x7f5a481531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a46000640 1 -- 172.21.15.114:0/1368917234 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269748680 0 0) 0x7f5a48157270 con 0x7f5a480714c0 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a46000640 1 -- 172.21.15.114:0/1368917234 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a2c003530 con 0x7f5a480714c0 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a46a00640 1 -- 172.21.15.114:0/1368917234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 msgr2=0x7f5a481531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a46a00640 1 --2- 172.21.15.114:0/1368917234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 0x7f5a481531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a46a00640 1 -- 172.21.15.114:0/1368917234 >> v1:172.21.15.114:6789/0 conn(0x7f5a480714c0 legacy=0x7f5a480aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a46a00640 1 -- 172.21.15.114:0/1368917234 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480c2fc0 con 0x7f5a48150300 2024-02-17T12:16:28.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.648+0000 7f5a47400640 1 --2- 172.21.15.114:0/1368917234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 0x7f5a481531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:28.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a46a00640 1 --2- 172.21.15.114:0/1368917234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a48150300 0x7f5a48156d30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a380097c0 tx=0x7f5a3801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2e51cd1d3fd43ee server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:28.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a46000640 1 -- 172.21.15.114:0/1368917234 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a380a4ea0 con 0x7f5a48150300 2024-02-17T12:16:28.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a46000640 1 -- 172.21.15.114:0/1368917234 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a380a7050 con 0x7f5a48150300 2024-02-17T12:16:28.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a46000640 1 -- 172.21.15.114:0/1368917234 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a380ab820 con 0x7f5a48150300 2024-02-17T12:16:28.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a4d800640 1 -- 172.21.15.114:0/1368917234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a48150300 msgr2=0x7f5a48156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a4d800640 1 --2- 172.21.15.114:0/1368917234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a48150300 0x7f5a48156d30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a380097c0 tx=0x7f5a3801c410 comp rx=0 tx=0).stop 2024-02-17T12:16:28.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a4d800640 1 -- 172.21.15.114:0/1368917234 shutdown_connections 2024-02-17T12:16:28.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a4d800640 1 --2- 172.21.15.114:0/1368917234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 0x7f5a481531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a4d800640 1 --2- 172.21.15.114:0/1368917234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a48150300 0x7f5a48156d30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a4d800640 1 -- 172.21.15.114:0/1368917234 >> 172.21.15.114:0/1368917234 conn(0x7f5a480c4f20 msgr2=0x7f5a480c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:28.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a4d800640 1 -- 172.21.15.114:0/1368917234 shutdown_connections 2024-02-17T12:16:28.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.652+0000 7f5a4d800640 1 -- 172.21.15.114:0/1368917234 wait complete. 2024-02-17T12:16:28.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 Processor -- start 2024-02-17T12:16:28.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 -- start start 2024-02-17T12:16:28.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a480714c0 0x7f5a480c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a48150300 0x7f5a48156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 0x7f5a48156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a481571c0 con 0x7f5a48150300 2024-02-17T12:16:28.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480ac5a0 con 0x7f5a480714c0 2024-02-17T12:16:28.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480a9330 con 0x7f5a48152d30 2024-02-17T12:16:28.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a48150300 0x7f5a48156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a48150300 0x7f5a48156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57536/0 (socket says 172.21.15.114:57536) 2024-02-17T12:16:28.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3fe00640 1 -- 172.21.15.114:0/2015528373 learned_addr learned my addr 172.21.15.114:0/2015528373 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:28.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a47400640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 0x7f5a48156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a46a00640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a480714c0 0x7f5a480c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3fe00640 1 -- 172.21.15.114:0/2015528373 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 msgr2=0x7f5a48156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3fe00640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 0x7f5a48156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3fe00640 1 -- 172.21.15.114:0/2015528373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a480714c0 msgr2=0x7f5a480c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3fe00640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a480714c0 0x7f5a480c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3fe00640 1 -- 172.21.15.114:0/2015528373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40009a70 con 0x7f5a48150300 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3fe00640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a48150300 0x7f5a48156740 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c420 tx=0x7f5a3000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3ea00640 1 -- 172.21.15.114:0/2015528373 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30005cf0 con 0x7f5a48150300 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3ea00640 1 -- 172.21.15.114:0/2015528373 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a30005e50 con 0x7f5a48150300 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a3ea00640 1 -- 172.21.15.114:0/2015528373 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300072d0 con 0x7f5a48150300 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 -- 172.21.15.114:0/2015528373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a38009420 con 0x7f5a48150300 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 -- 172.21.15.114:0/2015528373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a480a98f0 con 0x7f5a48150300 2024-02-17T12:16:28.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.656+0000 7f5a4d800640 1 -- 172.21.15.114:0/2015528373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a48074840 con 0x7f5a48150300 2024-02-17T12:16:28.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.660+0000 7f5a3ea00640 1 -- 172.21.15.114:0/2015528373 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f5a30007430 con 0x7f5a48150300 2024-02-17T12:16:28.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.660+0000 7f5a3ea00640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a24066e40 0x7f5a24069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:28.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.660+0000 7f5a3ea00640 1 -- 172.21.15.114:0/2015528373 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a30083fb0 con 0x7f5a48150300 2024-02-17T12:16:28.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.660+0000 7f5a46a00640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a24066e40 0x7f5a24069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:28.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.660+0000 7f5a46a00640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a24066e40 0x7f5a24069300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a380ad000 tx=0x7f5a380a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:28.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.664+0000 7f5a3ea00640 1 -- 172.21.15.114:0/2015528373 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5a30050d20 con 0x7f5a48150300 2024-02-17T12:16:28.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.816+0000 7f5a4d800640 1 -- 172.21.15.114:0/2015528373 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a480c93b0 con 0x7f5a48150300 2024-02-17T12:16:28.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.816+0000 7f5a3ea00640 1 -- 172.21.15.114:0/2015528373 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f5a30017020 con 0x7f5a48150300 2024-02-17T12:16:28.820 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:28.820 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:28.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 -- 172.21.15.114:0/2015528373 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a24066e40 msgr2=0x7f5a24069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a24066e40 0x7f5a24069300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a380ad000 tx=0x7f5a380a6000 comp rx=0 tx=0).stop 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 -- 172.21.15.114:0/2015528373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a48150300 msgr2=0x7f5a48156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a48150300 0x7f5a48156740 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c420 tx=0x7f5a3000c820 comp rx=0 tx=0).stop 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 -- 172.21.15.114:0/2015528373 shutdown_connections 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5a48152d30 0x7f5a48156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a24066e40 0x7f5a24069300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a48150300 0x7f5a48156740 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 --2- 172.21.15.114:0/2015528373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a480714c0 0x7f5a480c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 -- 172.21.15.114:0/2015528373 >> 172.21.15.114:0/2015528373 conn(0x7f5a480c4f20 msgr2=0x7f5a48149ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 -- 172.21.15.114:0/2015528373 shutdown_connections 2024-02-17T12:16:28.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:28.820+0000 7f5a4d800640 1 -- 172.21.15.114:0/2015528373 wait complete. 2024-02-17T12:16:28.841 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-17T12:16:28.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-17T12:16:28.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-17T12:16:28.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-17T12:16:28.843 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-17T12:16:28.843 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-17T12:16:28.843 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-17T12:16:28.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-17T12:16:29.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.076+0000 7fa5e8600640 1 Processor -- start 2024-02-17T12:16:29.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.076+0000 7fa5e8600640 1 -- start start 2024-02-17T12:16:29.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.076+0000 7fa5e8600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa5d80462f0 0x7fa5d80070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.076+0000 7fa5e8600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5d80496e0 0x7fa5d8049b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.076+0000 7fa5e5c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa5d80d3ab0 0x7fa5d80069c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45456/0 (socket says 172.21.15.114:45456) 2024-02-17T12:16:29.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.076+0000 7fa5e5c00640 1 -- 172.21.15.114:0/1100637719 learned_addr learned my addr 172.21.15.114:0/1100637719 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.076+0000 7fa5e8600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d8046820 con 0x7fa5d80d3ab0 2024-02-17T12:16:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.076+0000 7fa5e8600640 1 -- 172.21.15.114:0/1100637719 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d8046b90 con 0x7fa5d80496e0 2024-02-17T12:16:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.076+0000 7fa5e8600640 1 -- 172.21.15.114:0/1100637719 --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d80473c0 con 0x7fa5d80462f0 2024-02-17T12:16:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.076+0000 7fa5e6600640 1 --2- 172.21.15.114:0/1100637719 >> v2:172.21.15.114:3300/0 conn(0x7fa5d80496e0 0x7fa5d8049b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.080+0000 7fa5e5200640 1 --2- 172.21.15.114:0/1100637719 >> v2:172.21.15.116:3300/0 conn(0x7fa5d80462f0 0x7fa5d80070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.080+0000 7fa5dfe00640 1 -- 172.21.15.114:0/1100637719 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902056689 0 0) 0x7fa5d8046820 con 0x7fa5d80d3ab0 2024-02-17T12:16:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.080+0000 7fa5dfe00640 1 -- 172.21.15.114:0/1100637719 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5c8003530 con 0x7fa5d80d3ab0 2024-02-17T12:16:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.080+0000 7fa5e6600640 1 -- 172.21.15.114:0/1100637719 >> v2:172.21.15.116:3300/0 conn(0x7fa5d80462f0 msgr2=0x7fa5d80070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.080+0000 7fa5e6600640 1 --2- 172.21.15.114:0/1100637719 >> v2:172.21.15.116:3300/0 conn(0x7fa5d80462f0 0x7fa5d80070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.080+0000 7fa5e6600640 1 -- 172.21.15.114:0/1100637719 >> v1:172.21.15.114:6789/0 conn(0x7fa5d80d3ab0 legacy=0x7fa5d80069c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.080+0000 7fa5e6600640 1 -- 172.21.15.114:0/1100637719 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d8046fb0 con 0x7fa5d80496e0 2024-02-17T12:16:29.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.080+0000 7fa36e200640 1 Processor -- start 2024-02-17T12:16:29.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.080+0000 7fa36e200640 1 -- start start 2024-02-17T12:16:29.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7ff9c3e00640 1 Processor -- start 2024-02-17T12:16:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7ff9c3e00640 1 -- start start 2024-02-17T12:16:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa36e200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa36814ef00 0x7fa3680c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa36e200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806e1b0 0x7fa3680c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa36e200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa36806db30 0x7fa368155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa36e200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa368154e20 con 0x7fa36814ef00 2024-02-17T12:16:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa36e200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3680a9500 con 0x7fa36806db30 2024-02-17T12:16:29.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa36e200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36806ece0 con 0x7fa36806e1b0 2024-02-17T12:16:29.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa5e6600640 1 --2- 172.21.15.114:0/1100637719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d80496e0 0x7fa5d8049b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80092e0 tx=0x7fa5d401e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f6bb80dd48af96 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7ff9c3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff9b40dbd10 0x7ff9b40e2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7ff9c3e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b40e2c80 con 0x7ff9b400b0f0 2024-02-17T12:16:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7ff9c3e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b40de8a0 con 0x7ff9b40ded50 2024-02-17T12:16:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7ff9c3e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b4047650 con 0x7ff9b40dbd10 2024-02-17T12:16:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa367400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa36814ef00 0x7fa3680c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa366a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806e1b0 0x7fa3680c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa367e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa36806db30 0x7fa368155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa366a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806e1b0 0x7fa3680c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34464/0 (socket says 172.21.15.114:34464) 2024-02-17T12:16:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa366a00640 1 -- 172.21.15.114:0/373314905 learned_addr learned my addr 172.21.15.114:0/373314905 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7ff9c1e00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff9b40ded50 0x7ff9b40df200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:44582/0 (socket says 172.21.15.114:44582) 2024-02-17T12:16:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7ff9c1e00640 1 -- 172.21.15.114:0/289159872 learned_addr learned my addr 172.21.15.114:0/289159872 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa5dfe00640 1 -- 172.21.15.114:0/1100637719 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4008be0 con 0x7fa5d80496e0 2024-02-17T12:16:29.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7eff09000640 1 Processor -- start 2024-02-17T12:16:29.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7ff9c1400640 1 --2- 172.21.15.114:0/289159872 >> v2:172.21.15.114:3300/0 conn(0x7ff9b40dbd10 0x7ff9b40e2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa5dfe00640 1 -- 172.21.15.114:0/1100637719 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d4008d40 con 0x7fa5d80496e0 2024-02-17T12:16:29.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa5dfe00640 1 -- 172.21.15.114:0/1100637719 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4008be0 con 0x7fa5d80496e0 2024-02-17T12:16:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa366a00640 1 -- 172.21.15.114:0/373314905 >> v2:172.21.15.116:3300/0 conn(0x7fa36806db30 msgr2=0x7fa368155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa366a00640 1 --2- 172.21.15.114:0/373314905 >> v2:172.21.15.116:3300/0 conn(0x7fa36806db30 0x7fa368155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa366a00640 1 -- 172.21.15.114:0/373314905 >> v2:172.21.15.114:3300/0 conn(0x7fa36814ef00 msgr2=0x7fa3680c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa366a00640 1 --2- 172.21.15.114:0/373314905 >> v2:172.21.15.114:3300/0 conn(0x7fa36814ef00 0x7fa3680c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7fa366a00640 1 -- 172.21.15.114:0/373314905 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36806efc0 con 0x7fa36806e1b0 2024-02-17T12:16:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.084+0000 7eff09000640 1 -- start start 2024-02-17T12:16:29.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa103e00640 1 Processor -- start 2024-02-17T12:16:29.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa103e00640 1 -- start start 2024-02-17T12:16:29.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304160437 0 0) 0x7ff9b40de8a0 con 0x7ff9b40ded50 2024-02-17T12:16:29.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a4003530 con 0x7ff9b40ded50 2024-02-17T12:16:29.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa5e8600640 1 -- 172.21.15.114:0/1100637719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d80496e0 msgr2=0x7fa5d8049b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa5e8600640 1 --2- 172.21.15.114:0/1100637719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d80496e0 0x7fa5d8049b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80092e0 tx=0x7fa5d401e4c0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7eff09000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7eff041567e0 0x7eff0415d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7eff09000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 0x7eff040c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7eff09000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7eff040c35d0 0x7eff04159010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7eff09000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040a9a10 con 0x7eff041567e0 2024-02-17T12:16:29.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7eff09000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040aaf10 con 0x7eff040c35d0 2024-02-17T12:16:29.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7eff09000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff040731b0 con 0x7eff0406e730 2024-02-17T12:16:29.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2279349714 0 0) 0x7ff9a4003530 con 0x7ff9b40ded50 2024-02-17T12:16:29.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 >> v2:172.21.15.114:3300/0 conn(0x7ff9b40dbd10 msgr2=0x7ff9b40e2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 --2- 172.21.15.114:0/289159872 >> v2:172.21.15.114:3300/0 conn(0x7ff9b40dbd10 0x7ff9b40e2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 >> v1:172.21.15.114:6789/0 conn(0x7ff9b400b0f0 legacy=0x7ff9b4006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b4047930 con 0x7ff9b40ded50 2024-02-17T12:16:29.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 <== mon.1 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7ff9b0001680 con 0x7ff9b40ded50 2024-02-17T12:16:29.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 >> v1:172.21.15.116:6789/0 conn(0x7ff9b40ded50 legacy=0x7ff9b40df200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 --2- 172.21.15.114:0/289159872 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 0x7ff9a4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 --2- 172.21.15.114:0/289159872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9a40047d0 0x7ff9a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 --2- 172.21.15.114:0/289159872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a4005390 0x7ff9a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4047650 con 0x7ff9a4005390 2024-02-17T12:16:29.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a400c230 con 0x7ff9a40047d0 2024-02-17T12:16:29.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a400c3f0 con 0x7ff9a4003980 2024-02-17T12:16:29.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa5e8600640 1 -- 172.21.15.114:0/1100637719 shutdown_connections 2024-02-17T12:16:29.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa5e8600640 1 --2- 172.21.15.114:0/1100637719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d80496e0 0x7fa5d8049b10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa5e8600640 1 --2- 172.21.15.114:0/1100637719 >> v2:172.21.15.116:3300/0 conn(0x7fa5d80462f0 0x7fa5d80070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9c1400640 1 --2- 172.21.15.114:0/289159872 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 0x7ff9a4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa5e8600640 1 -- 172.21.15.114:0/1100637719 >> 172.21.15.114:0/1100637719 conn(0x7fa5d8005ea0 msgr2=0x7fa5d80062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9c0a00640 1 --2- 172.21.15.114:0/289159872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9a40047d0 0x7ff9a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7efefaa00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 0x7eff040c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7eff03e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7eff040c35d0 0x7eff04159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7efefaa00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 0x7eff040c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34466/0 (socket says 172.21.15.114:34466) 2024-02-17T12:16:29.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7efefaa00640 1 -- 172.21.15.114:0/328898245 learned_addr learned my addr 172.21.15.114:0/328898245 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7efefaa00640 1 -- 172.21.15.114:0/328898245 >> v2:172.21.15.116:3300/0 conn(0x7eff040c35d0 msgr2=0x7eff04159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7efefaa00640 1 --2- 172.21.15.114:0/328898245 >> v2:172.21.15.116:3300/0 conn(0x7eff040c35d0 0x7eff04159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7eff03400640 1 --2- 172.21.15.114:0/328898245 >> v2:172.21.15.114:3300/0 conn(0x7eff041567e0 0x7eff0415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7efefaa00640 1 -- 172.21.15.114:0/328898245 >> v2:172.21.15.114:3300/0 conn(0x7eff041567e0 msgr2=0x7eff0415d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa103e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0fc06dce0 0x7fa0fc06ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa103e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc14e020 0x7fa0fc14e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa103e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc154880 con 0x7fa0fc067c60 2024-02-17T12:16:29.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7efefaa00640 1 --2- 172.21.15.114:0/328898245 >> v2:172.21.15.114:3300/0 conn(0x7eff041567e0 0x7eff0415d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7efefaa00640 1 -- 172.21.15.114:0/328898245 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0415d550 con 0x7eff0406e730 2024-02-17T12:16:29.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa103e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0fc06b5f0 con 0x7fa0fc06dce0 2024-02-17T12:16:29.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa103e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc154b60 con 0x7fa0fc14e020 2024-02-17T12:16:29.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa101e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc14e020 0x7fa0fc14e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa101e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc14e020 0x7fa0fc14e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34480/0 (socket says 172.21.15.114:34480) 2024-02-17T12:16:29.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa101e00640 1 -- 172.21.15.114:0/3773625323 learned_addr learned my addr 172.21.15.114:0/3773625323 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa0fbe00640 1 -- 172.21.15.114:0/3773625323 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895410345 0 0) 0x7fa0fc154880 con 0x7fa0fc067c60 2024-02-17T12:16:29.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7fa0fbe00640 1 -- 172.21.15.114:0/3773625323 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e4003530 con 0x7fa0fc067c60 2024-02-17T12:16:29.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa101400640 1 --2- 172.21.15.114:0/3773625323 >> v2:172.21.15.114:3300/0 conn(0x7fa0fc06dce0 0x7fa0fc06ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa0fbe00640 1 -- 172.21.15.114:0/3773625323 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2447763716 0 0) 0x7fa0e4003530 con 0x7fa0fc067c60 2024-02-17T12:16:29.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa5e8600640 1 -- 172.21.15.114:0/1100637719 shutdown_connections 2024-02-17T12:16:29.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa5e8600640 1 -- 172.21.15.114:0/1100637719 wait complete. 2024-02-17T12:16:29.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa366a00640 1 --2- 172.21.15.114:0/373314905 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806e1b0 0x7fa3680c3280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa36806e840 tx=0x7fa36001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c14f2f5568a7cc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa101e00640 1 -- 172.21.15.114:0/3773625323 >> v2:172.21.15.114:3300/0 conn(0x7fa0fc06dce0 msgr2=0x7fa0fc06ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa101e00640 1 --2- 172.21.15.114:0/3773625323 >> v2:172.21.15.114:3300/0 conn(0x7fa0fc06dce0 0x7fa0fc06ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa101e00640 1 -- 172.21.15.114:0/3773625323 >> v1:172.21.15.116:6789/0 conn(0x7fa0fc067c60 legacy=0x7fa0fc0c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa101e00640 1 -- 172.21.15.114:0/3773625323 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc154e40 con 0x7fa0fc14e020 2024-02-17T12:16:29.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa101400640 1 --2- 172.21.15.114:0/3773625323 >> v2:172.21.15.114:3300/0 conn(0x7fa0fc06dce0 0x7fa0fc06ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:29.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9c1400640 1 -- 172.21.15.114:0/289159872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9a40047d0 msgr2=0x7ff9a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9c1400640 1 --2- 172.21.15.114:0/289159872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9a40047d0 0x7ff9a4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9c1400640 1 -- 172.21.15.114:0/289159872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a4005390 msgr2=0x7ff9a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9c1400640 1 --2- 172.21.15.114:0/289159872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a4005390 0x7ff9a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.088+0000 7ff9c1400640 1 -- 172.21.15.114:0/289159872 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b4047930 con 0x7ff9a4003980 2024-02-17T12:16:29.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7ff9c1e00640 1 -- 172.21.15.114:0/289159872 reap_dead start 2024-02-17T12:16:29.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fbda4a00640 1 Processor -- start 2024-02-17T12:16:29.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fbda4a00640 1 -- start start 2024-02-17T12:16:29.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa366000640 1 -- 172.21.15.114:0/373314905 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600a5750 con 0x7fa36806e1b0 2024-02-17T12:16:29.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa366000640 1 -- 172.21.15.114:0/373314905 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3600a58b0 con 0x7fa36806e1b0 2024-02-17T12:16:29.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa366000640 1 -- 172.21.15.114:0/373314905 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600a5c40 con 0x7fa36806e1b0 2024-02-17T12:16:29.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7f4010c00640 1 Processor -- start 2024-02-17T12:16:29.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7efefaa00640 1 --2- 172.21.15.114:0/328898245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 0x7eff040c3090 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7eff0406ed10 tx=0x7efeec01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d377e43d7dab36 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7f4010c00640 1 -- start start 2024-02-17T12:16:29.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa36e200640 1 -- 172.21.15.114:0/373314905 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806e1b0 msgr2=0x7fa3680c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.092+0000 7fa36e200640 1 --2- 172.21.15.114:0/373314905 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806e1b0 0x7fa3680c3280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa36806e840 tx=0x7fa36001c910 comp rx=0 tx=0).stop 2024-02-17T12:16:29.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f325ca00640 1 Processor -- start 2024-02-17T12:16:29.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbda4a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda00c6e90 0x7fbda0150b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e8600640 1 Processor -- start 2024-02-17T12:16:29.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7ff9c1400640 1 --2- 172.21.15.114:0/289159872 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 0x7ff9a4003d80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc06a590 tx=0x7ff9bc097720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d2caf554ca3cecb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff02a00640 1 -- 172.21.15.114:0/328898245 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec0ab620 con 0x7eff0406e730 2024-02-17T12:16:29.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff02a00640 1 -- 172.21.15.114:0/328898245 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec0ab780 con 0x7eff0406e730 2024-02-17T12:16:29.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff02a00640 1 -- 172.21.15.114:0/328898245 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec0abb10 con 0x7eff0406e730 2024-02-17T12:16:29.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbda4a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda0151170 con 0x7fbda00c1f20 2024-02-17T12:16:29.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbda4a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda0151450 con 0x7fbda006ac10 2024-02-17T12:16:29.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbda4a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda006d9d0 con 0x7fbda00c6e90 2024-02-17T12:16:29.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e8600640 1 -- start start 2024-02-17T12:16:29.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa36e200640 1 -- 172.21.15.114:0/373314905 shutdown_connections 2024-02-17T12:16:29.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa36e200640 1 --2- 172.21.15.114:0/373314905 >> v2:172.21.15.116:3300/0 conn(0x7fa36806db30 0x7fa368155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc12b070 con 0x7ff9a4003980 2024-02-17T12:16:29.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9de00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbda00c1f20 0x7fbda014aad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45476/0 (socket says 172.21.15.114:45476) 2024-02-17T12:16:29.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9de00640 1 -- 172.21.15.114:0/809256677 learned_addr learned my addr 172.21.15.114:0/809256677 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa36e200640 1 --2- 172.21.15.114:0/373314905 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806e1b0 0x7fa3680c3280 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa36e200640 1 --2- 172.21.15.114:0/373314905 >> v2:172.21.15.114:3300/0 conn(0x7fa36814ef00 0x7fa3680c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa36e200640 1 -- 172.21.15.114:0/373314905 >> 172.21.15.114:0/373314905 conn(0x7fa3680a8660 msgr2=0x7fa3680a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa36e200640 1 -- 172.21.15.114:0/373314905 shutdown_connections 2024-02-17T12:16:29.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa36e200640 1 -- 172.21.15.114:0/373314905 wait complete. 2024-02-17T12:16:29.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371698342 0 0) 0x7fbda0151170 con 0x7fbda00c1f20 2024-02-17T12:16:29.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e8600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5d80462f0 0x7fa5d81707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e8600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5d80496e0 0x7fa5d80428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e8600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d80d3ab0 0x7fa5d8176700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e8600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d8044db0 con 0x7fa5d80d3ab0 2024-02-17T12:16:29.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e8600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d80d8840 con 0x7fa5d80462f0 2024-02-17T12:16:29.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e8600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d8044a40 con 0x7fa5d80496e0 2024-02-17T12:16:29.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e5c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5d80462f0 0x7fa5d81707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e5c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5d80462f0 0x7fa5d81707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46526/0 (socket says 172.21.15.114:46526) 2024-02-17T12:16:29.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e5c00640 1 -- 172.21.15.114:0/1603435781 learned_addr learned my addr 172.21.15.114:0/1603435781 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e5200640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5d80496e0 0x7fa5d80428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc127460 con 0x7ff9a4003980 2024-02-17T12:16:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7ff9bbe00640 1 -- 172.21.15.114:0/289159872 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc1278b0 con 0x7ff9a4003980 2024-02-17T12:16:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff09000640 1 -- 172.21.15.114:0/328898245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 msgr2=0x7eff040c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff09000640 1 --2- 172.21.15.114:0/328898245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 0x7eff040c3090 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7eff0406ed10 tx=0x7efeec01c460 comp rx=0 tx=0).stop 2024-02-17T12:16:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff09000640 1 -- 172.21.15.114:0/328898245 shutdown_connections 2024-02-17T12:16:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff09000640 1 --2- 172.21.15.114:0/328898245 >> v2:172.21.15.116:3300/0 conn(0x7eff040c35d0 0x7eff04159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff09000640 1 --2- 172.21.15.114:0/328898245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 0x7eff040c3090 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff09000640 1 --2- 172.21.15.114:0/328898245 >> v2:172.21.15.114:3300/0 conn(0x7eff041567e0 0x7eff0415d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff09000640 1 -- 172.21.15.114:0/328898245 >> 172.21.15.114:0/328898245 conn(0x7eff040a8660 msgr2=0x7eff040a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff09000640 1 -- 172.21.15.114:0/328898245 shutdown_connections 2024-02-17T12:16:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4010c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f400c156690 0x7f400c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4010c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f400c0a9420 0x7f400c159100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4010c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400c15c6f0 con 0x7f400c0c65a0 2024-02-17T12:16:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4010c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c15ccb0 con 0x7f400c0a9420 2024-02-17T12:16:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4010c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c15d680 con 0x7f400c156690 2024-02-17T12:16:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f400a800640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f400c0c65a0 0x7f400c0c2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:44612/0 (socket says 172.21.15.114:44612) 2024-02-17T12:16:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f400a800640 1 -- 172.21.15.114:0/4254079061 learned_addr learned my addr 172.21.15.114:0/4254079061 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4009400640 1 --2- 172.21.15.114:0/4254079061 >> v2:172.21.15.116:3300/0 conn(0x7f400c0a9420 0x7f400c159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4009e00640 1 --2- 172.21.15.114:0/4254079061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f400c156690 0x7f400c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4008a00640 1 -- 172.21.15.114:0/4254079061 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037585672 0 0) 0x7f400c15c6f0 con 0x7f400c0c65a0 2024-02-17T12:16:29.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4008a00640 1 -- 172.21.15.114:0/4254079061 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff0003530 con 0x7f400c0c65a0 2024-02-17T12:16:29.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f325ca00640 1 -- start start 2024-02-17T12:16:29.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f325ca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258156600 0x7f325806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f325ca00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3258071a40 con 0x7f325806b150 2024-02-17T12:16:29.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f325ca00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3258071760 con 0x7f32580c0e20 2024-02-17T12:16:29.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f325ca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32580c2ac0 con 0x7f3258156600 2024-02-17T12:16:29.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f3255e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f325806b150 0x7f3258158fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45484/0 (socket says 172.21.15.114:45484) 2024-02-17T12:16:29.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f3255e00640 1 -- 172.21.15.114:0/3656566767 learned_addr learned my addr 172.21.15.114:0/3656566767 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd84003530 con 0x7fbda00c1f20 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9e800640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda00c6e90 0x7fbda0150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2710486603 0 0) 0x7fbd84003530 con 0x7fbda00c1f20 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda00c6e90 msgr2=0x7fbda0150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda00c6e90 0x7fbda0150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 >> v1:172.21.15.116:6789/0 conn(0x7fbda006ac10 legacy=0x7fbda006de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda0151730 con 0x7fbda00c1f20 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fbd8c001680 con 0x7fbda00c1f20 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 >> v1:172.21.15.114:6789/0 conn(0x7fbda00c1f20 legacy=0x7fbda014aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda00c6e90 0x7fbd840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd84003f30 0x7fbd840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd84004d10 0x7fbd84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda006d9d0 con 0x7fbd84003f30 2024-02-17T12:16:29.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8400fe50 con 0x7fbd84004d10 2024-02-17T12:16:29.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84010010 con 0x7fbda00c6e90 2024-02-17T12:16:29.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa36e200640 1 Processor -- start 2024-02-17T12:16:29.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7ff9c3e00640 1 -- 172.21.15.114:0/289159872 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 msgr2=0x7ff9a4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7ff9c3e00640 1 --2- 172.21.15.114:0/289159872 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 0x7ff9a4003d80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc06a590 tx=0x7ff9bc097720 comp rx=0 tx=0).stop 2024-02-17T12:16:29.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4009400640 1 -- 172.21.15.114:0/4254079061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f400c156690 msgr2=0x7f400c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4009400640 1 --2- 172.21.15.114:0/4254079061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f400c156690 0x7f400c15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4009400640 1 -- 172.21.15.114:0/4254079061 >> v1:172.21.15.116:6789/0 conn(0x7f400c0c65a0 legacy=0x7f400c0c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f3256800640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258156600 0x7f325806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684062460 0 0) 0x7f3258071a40 con 0x7f325806b150 2024-02-17T12:16:29.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f323c003530 con 0x7f325806b150 2024-02-17T12:16:29.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9e800640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda00c6e90 0x7fbd840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f4009400640 1 -- 172.21.15.114:0/4254079061 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c06eb40 con 0x7f400c0a9420 2024-02-17T12:16:29.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530019913 0 0) 0x7f3258071760 con 0x7f32580c0e20 2024-02-17T12:16:29.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3258071a40 con 0x7f32580c0e20 2024-02-17T12:16:29.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9f200640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd84004d10 0x7fbd84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa36e200640 1 -- start start 2024-02-17T12:16:29.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7eff09000640 1 -- 172.21.15.114:0/328898245 wait complete. 2024-02-17T12:16:29.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fbd9de00640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd84003f30 0x7fbd840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e5c00640 1 -- 172.21.15.114:0/1603435781 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5d80496e0 msgr2=0x7fa5d80428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e5c00640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5d80496e0 0x7fa5d80428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e5c00640 1 -- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d80d3ab0 msgr2=0x7fa5d8176700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e5c00640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d80d3ab0 0x7fa5d8176700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.096+0000 7fa5e5c00640 1 -- 172.21.15.114:0/1603435781 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d400ae50 con 0x7fa5d80462f0 2024-02-17T12:16:29.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa5e5c00640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5d80462f0 0x7fa5d81707c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c3c0 tx=0x7fa5cc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa5dd600640 1 -- 172.21.15.114:0/1603435781 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc005cf0 con 0x7fa5d80462f0 2024-02-17T12:16:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa5dd600640 1 -- 172.21.15.114:0/1603435781 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc005e50 con 0x7fa5d80462f0 2024-02-17T12:16:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d80d8b20 con 0x7fa5d80462f0 2024-02-17T12:16:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa5dd600640 1 -- 172.21.15.114:0/1603435781 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc005cf0 con 0x7fa5d80462f0 2024-02-17T12:16:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d8045240 con 0x7fa5d80462f0 2024-02-17T12:16:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7ff9c3e00640 1 -- 172.21.15.114:0/289159872 shutdown_connections 2024-02-17T12:16:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7ff9c3e00640 1 --2- 172.21.15.114:0/289159872 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 0x7ff9a4003d80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7ff9c3e00640 1 -- 172.21.15.114:0/289159872 >> 172.21.15.114:0/289159872 conn(0x7ff9b4048290 msgr2=0x7ff9b40486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7ff9c3e00640 1 -- 172.21.15.114:0/289159872 shutdown_connections 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2829250598 0 0) 0x7f3258071a40 con 0x7f32580c0e20 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258156600 msgr2=0x7f325806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258156600 0x7f325806ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 >> v1:172.21.15.114:6789/0 conn(0x7f325806b150 legacy=0x7f3258158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32580c2400 con 0x7f32580c0e20 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 <== mon.1 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f3240001680 con 0x7f32580c0e20 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 >> v1:172.21.15.116:6789/0 conn(0x7f32580c0e20 legacy=0x7f32581596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f323c004b70 0x7f323c004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f323c003770 0x7f323c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c004130 0x7f323c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32580c2ac0 con 0x7f323c004b70 2024-02-17T12:16:29.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c00c090 con 0x7f323c004130 2024-02-17T12:16:29.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c00c250 con 0x7f323c003770 2024-02-17T12:16:29.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3257200640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c004130 0x7f323c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa101e00640 1 --2- 172.21.15.114:0/3773625323 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc14e020 0x7fa0fc14e470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009e80 tx=0x7fa0f401f120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9116f5b2b05fbd77 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3255e00640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f323c003770 0x7f323c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7eff09000640 1 Processor -- start 2024-02-17T12:16:29.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fbd9e800640 1 -- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd84004d10 msgr2=0x7fbd84005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fbd9e800640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd84004d10 0x7fbd84005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fbd9e800640 1 -- 172.21.15.114:0/809256677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd84003f30 msgr2=0x7fbd840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fbd9e800640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd84003f30 0x7fbd840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fbd9e800640 1 -- 172.21.15.114:0/809256677 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda0151730 con 0x7fbda00c6e90 2024-02-17T12:16:29.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3257200640 1 -- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f323c003770 msgr2=0x7f323c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3257200640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f323c003770 0x7f323c003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3257200640 1 -- 172.21.15.114:0/3656566767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f323c004b70 msgr2=0x7f323c004f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3257200640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f323c004b70 0x7f323c004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7f3257200640 1 -- 172.21.15.114:0/3656566767 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32580c2400 con 0x7f323c004130 2024-02-17T12:16:29.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7eff09000640 1 -- start start 2024-02-17T12:16:29.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7ff9c3e00640 1 -- 172.21.15.114:0/289159872 wait complete. 2024-02-17T12:16:29.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa36e200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806db30 0x7fa3681528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa36e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa36806e1b0 0x7fa368156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa36e200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa36814ef00 0x7fa368143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7eff09000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 0x7eff04152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7eff09000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff040c35d0 0x7eff041f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa367400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806db30 0x7fa3681528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa36e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa368146780 con 0x7fa36806e1b0 2024-02-17T12:16:29.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa36e200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa368153b70 con 0x7fa36814ef00 2024-02-17T12:16:29.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa36e200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680c5db0 con 0x7fa36806db30 2024-02-17T12:16:29.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa367400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806db30 0x7fa3681528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34524/0 (socket says 172.21.15.114:34524) 2024-02-17T12:16:29.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7eff09000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff041567e0 0x7eff041f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7eff09000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0414c5f0 con 0x7eff041567e0 2024-02-17T12:16:29.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7eff09000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0414c350 con 0x7eff040c35d0 2024-02-17T12:16:29.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7eff09000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0414f4c0 con 0x7eff0406e730 2024-02-17T12:16:29.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa367400640 1 -- 172.21.15.114:0/632877634 learned_addr learned my addr 172.21.15.114:0/632877634 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa367e00640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa36814ef00 0x7fa368143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa0fbe00640 1 -- 172.21.15.114:0/3773625323 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8001680 con 0x7fa0fc14e020 2024-02-17T12:16:29.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa0fbe00640 1 -- 172.21.15.114:0/3773625323 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f40090d0 con 0x7fa0fc14e020 2024-02-17T12:16:29.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa0fbe00640 1 -- 172.21.15.114:0/3773625323 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4009240 con 0x7fa0fc14e020 2024-02-17T12:16:29.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefaa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff040c35d0 0x7eff041f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefaa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff040c35d0 0x7eff041f2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46550/0 (socket says 172.21.15.114:46550) 2024-02-17T12:16:29.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7eff03400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 0x7eff04152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefaa00640 1 -- 172.21.15.114:0/2257044841 learned_addr learned my addr 172.21.15.114:0/2257044841 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4009400640 1 --2- 172.21.15.114:0/4254079061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f400c0a9420 0x7f400c159100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4004009d90 tx=0x7f400401c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f3960a7a30cacb7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.100+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5d802b8a0 con 0x7fa5d80462f0 2024-02-17T12:16:29.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa5dd600640 1 -- 172.21.15.114:0/1603435781 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa5cc0070d0 con 0x7fa5d80462f0 2024-02-17T12:16:29.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefaa00640 1 -- 172.21.15.114:0/2257044841 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 msgr2=0x7eff04152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefaa00640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff0406e730 0x7eff04152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefaa00640 1 -- 172.21.15.114:0/2257044841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff041567e0 msgr2=0x7eff041f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefaa00640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff041567e0 0x7eff041f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefaa00640 1 -- 172.21.15.114:0/2257044841 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0094d0 con 0x7eff040c35d0 2024-02-17T12:16:29.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4008a00640 1 -- 172.21.15.114:0/4254079061 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040a5880 con 0x7f400c0a9420 2024-02-17T12:16:29.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4008a00640 1 -- 172.21.15.114:0/4254079061 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40040a59e0 con 0x7f400c0a9420 2024-02-17T12:16:29.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4008a00640 1 -- 172.21.15.114:0/4254079061 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040a5d70 con 0x7f400c0a9420 2024-02-17T12:16:29.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa367e00640 1 -- 172.21.15.114:0/632877634 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806db30 msgr2=0x7fa3681528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa367e00640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa36806db30 0x7fa3681528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa367e00640 1 -- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa36806e1b0 msgr2=0x7fa368156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa367e00640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa36806e1b0 0x7fa368156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa367e00640 1 -- 172.21.15.114:0/632877634 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360009b30 con 0x7fa36814ef00 2024-02-17T12:16:29.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa367e00640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa36814ef00 0x7fa368143d20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa35400d580 tx=0x7fa35400da40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa5dd600640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa5c0066ea0 0x7fa5c0069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa35f400640 1 -- 172.21.15.114:0/632877634 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354014620 con 0x7fa36814ef00 2024-02-17T12:16:29.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa35f400640 1 -- 172.21.15.114:0/632877634 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa354014780 con 0x7fa36814ef00 2024-02-17T12:16:29.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa35f400640 1 -- 172.21.15.114:0/632877634 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354014b10 con 0x7fa36814ef00 2024-02-17T12:16:29.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa103e00640 1 -- 172.21.15.114:0/3773625323 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc14e020 msgr2=0x7fa0fc14e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa103e00640 1 --2- 172.21.15.114:0/3773625323 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc14e020 0x7fa0fc14e470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009e80 tx=0x7fa0f401f120 comp rx=0 tx=0).stop 2024-02-17T12:16:29.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa5dd600640 1 -- 172.21.15.114:0/1603435781 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5cc083c20 con 0x7fa5d80462f0 2024-02-17T12:16:29.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefaa00640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff040c35d0 0x7eff041f2a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efeec0ad040 tx=0x7efeec01aca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4010c00640 1 -- 172.21.15.114:0/4254079061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f400c0a9420 msgr2=0x7f400c159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4010c00640 1 --2- 172.21.15.114:0/4254079061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f400c0a9420 0x7f400c159100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4004009d90 tx=0x7f400401c8b0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fbd9e800640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda00c6e90 0x7fbd840039b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009ae0 tx=0x7fbd9001cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63f1713070b83848 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa103e00640 1 -- 172.21.15.114:0/3773625323 shutdown_connections 2024-02-17T12:16:29.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa103e00640 1 --2- 172.21.15.114:0/3773625323 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc14e020 0x7fa0fc14e470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa103e00640 1 --2- 172.21.15.114:0/3773625323 >> v2:172.21.15.114:3300/0 conn(0x7fa0fc06dce0 0x7fa0fc06ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa103e00640 1 -- 172.21.15.114:0/3773625323 >> 172.21.15.114:0/3773625323 conn(0x7fa0fc0a8750 msgr2=0x7fa0fc0a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3680c6020 con 0x7fa36814ef00 2024-02-17T12:16:29.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3681463a0 con 0x7fa36814ef00 2024-02-17T12:16:29.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7ff9c3e00640 1 Processor -- start 2024-02-17T12:16:29.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa5dd600640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] conn(0x7fa5c006f040 0x7fa5c0071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa5dd600640 1 -- 172.21.15.114:0/1603435781 --> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5c0071b10 con 0x7fa5c006f040 2024-02-17T12:16:29.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa5dd600640 1 -- 172.21.15.114:0/1603435781 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5cc050a30 con 0x7fa5d80462f0 2024-02-17T12:16:29.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4010c00640 1 -- 172.21.15.114:0/4254079061 shutdown_connections 2024-02-17T12:16:29.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4010c00640 1 --2- 172.21.15.114:0/4254079061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f400c0a9420 0x7f400c159100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4010c00640 1 --2- 172.21.15.114:0/4254079061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f400c156690 0x7f400c15d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4010c00640 1 -- 172.21.15.114:0/4254079061 >> 172.21.15.114:0/4254079061 conn(0x7f400c0a8490 msgr2=0x7f400c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd900a56b0 con 0x7fbda00c6e90 2024-02-17T12:16:29.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd900a5810 con 0x7fbda00c6e90 2024-02-17T12:16:29.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fbd9d400640 1 -- 172.21.15.114:0/809256677 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd900a5c00 con 0x7fbda00c6e90 2024-02-17T12:16:29.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa5e5200640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa5c0066ea0 0x7fa5c0069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa5e6600640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] conn(0x7fa5c006f040 0x7fa5c0071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7ff9c3e00640 1 -- start start 2024-02-17T12:16:29.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa103e00640 1 -- 172.21.15.114:0/3773625323 shutdown_connections 2024-02-17T12:16:29.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefbe00640 1 -- 172.21.15.114:0/2257044841 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec0abe80 con 0x7eff040c35d0 2024-02-17T12:16:29.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefbe00640 1 -- 172.21.15.114:0/2257044841 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec0be3f0 con 0x7eff040c35d0 2024-02-17T12:16:29.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7efefbe00640 1 -- 172.21.15.114:0/2257044841 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec0be780 con 0x7eff040c35d0 2024-02-17T12:16:29.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0414f7a0 con 0x7eff040c35d0 2024-02-17T12:16:29.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f3257200640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c004130 0x7f323c00b990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f324000c110 tx=0x7f324001cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=412cca5ec2822444 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f4010c00640 1 -- 172.21.15.114:0/4254079061 shutdown_connections 2024-02-17T12:16:29.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400a5850 con 0x7f323c004130 2024-02-17T12:16:29.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32400a59d0 con 0x7f323c004130 2024-02-17T12:16:29.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7f3255400640 1 -- 172.21.15.114:0/3656566767 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400a5dc0 con 0x7f323c004130 2024-02-17T12:16:29.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa5e6600640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] conn(0x7fa5c006f040 0x7fa5c0071460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa103e00640 1 -- 172.21.15.114:0/3773625323 wait complete. 2024-02-17T12:16:29.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa368155b90 con 0x7fa36814ef00 2024-02-17T12:16:29.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c3e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 0x7ff9b40d8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0414c060 con 0x7eff040c35d0 2024-02-17T12:16:29.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7f325ca00640 1 -- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c004130 msgr2=0x7f323c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7f325ca00640 1 --2- 172.21.15.114:0/3656566767 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f323c004130 0x7f323c00b990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f324000c110 tx=0x7f324001cab0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fbda4a00640 1 -- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda00c6e90 msgr2=0x7fbd840039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.104+0000 7fbda4a00640 1 --2- 172.21.15.114:0/809256677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda00c6e90 0x7fbd840039b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009ae0 tx=0x7fbd9001cad0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fbd9f200640 1 -- 172.21.15.114:0/809256677 reap_dead start 2024-02-17T12:16:29.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c3e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9b40428e0 0x7ff9b40d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9b40d53d0 0x7ff9b40d3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c3e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4044200 con 0x7ff9b40d53d0 2024-02-17T12:16:29.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7f3257200640 1 -- 172.21.15.114:0/3656566767 reap_dead start 2024-02-17T12:16:29.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c3e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b404af20 con 0x7ff9b40428e0 2024-02-17T12:16:29.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c3e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4174fa0 con 0x7ff9a4003980 2024-02-17T12:16:29.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7f325ca00640 1 -- 172.21.15.114:0/3656566767 shutdown_connections 2024-02-17T12:16:29.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 0x7ff9b40d8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 0x7ff9b40d8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34532/0 (socket says 172.21.15.114:34532) 2024-02-17T12:16:29.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1400640 1 -- 172.21.15.114:0/3634361270 learned_addr learned my addr 172.21.15.114:0/3634361270 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c0a00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9b40428e0 0x7ff9b40d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1e00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9b40d53d0 0x7ff9b40d3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7f325ca00640 1 -- 172.21.15.114:0/3656566767 >> 172.21.15.114:0/3656566767 conn(0x7f32580c6370 msgr2=0x7f32580c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fbda4a00640 1 -- 172.21.15.114:0/809256677 shutdown_connections 2024-02-17T12:16:29.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fbda4a00640 1 -- 172.21.15.114:0/809256677 >> 172.21.15.114:0/809256677 conn(0x7fbda00c6370 msgr2=0x7fbda00c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fa5e5200640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa5c0066ea0 0x7fa5c0069360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0050830 tx=0x7fa5e006e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1400640 1 -- 172.21.15.114:0/3634361270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9b40428e0 msgr2=0x7ff9b40d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff040ab420 con 0x7eff040c35d0 2024-02-17T12:16:29.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7f4010c00640 1 -- 172.21.15.114:0/4254079061 wait complete. 2024-02-17T12:16:29.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fa35f400640 1 -- 172.21.15.114:0/632877634 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa354014c70 con 0x7fa36814ef00 2024-02-17T12:16:29.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1400640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9b40428e0 0x7ff9b40d4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1400640 1 -- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9b40d53d0 msgr2=0x7ff9b40d3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1400640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9b40d53d0 0x7ff9b40d3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1400640 1 -- 172.21.15.114:0/3634361270 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b40d63f0 con 0x7ff9a4003980 2024-02-17T12:16:29.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fbda4a00640 1 -- 172.21.15.114:0/809256677 shutdown_connections 2024-02-17T12:16:29.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fbda4a00640 1 -- 172.21.15.114:0/809256677 wait complete. 2024-02-17T12:16:29.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1e00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9b40d53d0 0x7ff9b40d3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:29.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c0a00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff9b40428e0 0x7ff9b40d4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:29.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fa5dd600640 1 -- 172.21.15.114:0/1603435781 <== osd.0 v2:172.21.15.114:6824/1061952801 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa5c0071b10 con 0x7fa5c006f040 2024-02-17T12:16:29.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7f325ca00640 1 -- 172.21.15.114:0/3656566767 shutdown_connections 2024-02-17T12:16:29.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fa35f400640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa348066f10 0x7fa3480693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c1400640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 0x7ff9b40d8fe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc064720 tx=0x7ff9bc06a7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fa103e00640 1 Processor -- start 2024-02-17T12:16:29.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7efefbe00640 1 -- 172.21.15.114:0/2257044841 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7efeec0059a0 con 0x7eff040c35d0 2024-02-17T12:16:29.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fa103e00640 1 -- start start 2024-02-17T12:16:29.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9b9600640 1 -- 172.21.15.114:0/3634361270 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc136070 con 0x7ff9a4003980 2024-02-17T12:16:29.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9b9600640 1 -- 172.21.15.114:0/3634361270 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc12c040 con 0x7ff9a4003980 2024-02-17T12:16:29.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fbda4a00640 1 Processor -- start 2024-02-17T12:16:29.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fa35f400640 1 -- 172.21.15.114:0/632877634 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa354085040 con 0x7fa36814ef00 2024-02-17T12:16:29.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fa35f400640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] conn(0x7fa34806f190 0x7fa3480715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fa35f400640 1 -- 172.21.15.114:0/632877634 --> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa348071c60 con 0x7fa34806f190 2024-02-17T12:16:29.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fa35f400640 1 -- 172.21.15.114:0/632877634 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa354087600 con 0x7fa36814ef00 2024-02-17T12:16:29.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9b9600640 1 -- 172.21.15.114:0/3634361270 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc12b050 con 0x7ff9a4003980 2024-02-17T12:16:29.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b40d66d0 con 0x7ff9a4003980 2024-02-17T12:16:29.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7fbda4a00640 1 -- start start 2024-02-17T12:16:29.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b4175240 con 0x7ff9a4003980 2024-02-17T12:16:29.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff9b4047ef0 con 0x7ff9a4003980 2024-02-17T12:16:29.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa103e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc067c60 0x7fa0fc1497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa103e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc1f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa103e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0fc14e020 0x7fa0fc1f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7efefbe00640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efee0066e90 0x7efee0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.108+0000 7f325ca00640 1 -- 172.21.15.114:0/3656566767 wait complete. 2024-02-17T12:16:29.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7f325ca00640 1 Processor -- start 2024-02-17T12:16:29.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7f325ca00640 1 -- start start 2024-02-17T12:16:29.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbda4a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbda00c6e90 0x7fbda00c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa100a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc1f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbda4a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda01e2da0 0x7fbda01f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa100a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc1f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46568/0 (socket says 172.21.15.114:46568) 2024-02-17T12:16:29.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa100a00640 1 -- 172.21.15.114:0/4260411609 learned_addr learned my addr 172.21.15.114:0/4260411609 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa101e00640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0fc14e020 0x7fa0fc1f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7efefbe00640 1 -- 172.21.15.114:0/2257044841 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efeec11fc70 con 0x7eff040c35d0 2024-02-17T12:16:29.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9e800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbda00c6e90 0x7fbda00c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9e800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbda00c6e90 0x7fbda00c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46584/0 (socket says 172.21.15.114:46584) 2024-02-17T12:16:29.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9e800640 1 -- 172.21.15.114:0/1399850727 learned_addr learned my addr 172.21.15.114:0/1399850727 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbda4a00640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda01e1e80 0x7fbda01f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7efefbe00640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] conn(0x7efee006f0b0 0x7efee00714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7efefbe00640 1 -- 172.21.15.114:0/2257044841 --> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efee0071b80 con 0x7efee006f0b0 2024-02-17T12:16:29.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7efefbe00640 1 -- 172.21.15.114:0/2257044841 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7efeec120110 con 0x7eff040c35d0 2024-02-17T12:16:29.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa101400640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc067c60 0x7fa0fc1497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda01efdc0 con 0x7fbda01e1e80 2024-02-17T12:16:29.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9de00640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda01e2da0 0x7fbda01f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7f4010c00640 1 Processor -- start 2024-02-17T12:16:29.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda01f00a0 con 0x7fbda00c6e90 2024-02-17T12:16:29.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9f200640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda01e1e80 0x7fbda01f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda01e32f0 con 0x7fbda01e2da0 2024-02-17T12:16:29.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa366a00640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] conn(0x7fa34806f190 0x7fa3480715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa367400640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa348066f10 0x7fa3480693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa103e00640 1 -- 172.21.15.114:0/4260411609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc131370 con 0x7fa0fc14e020 2024-02-17T12:16:29.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa103e00640 1 -- 172.21.15.114:0/4260411609 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc130760 con 0x7fa0fc06dce0 2024-02-17T12:16:29.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa103e00640 1 -- 172.21.15.114:0/4260411609 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc130a40 con 0x7fa0fc067c60 2024-02-17T12:16:29.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7eff03e00640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] conn(0x7efee006f0b0 0x7efee00714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7eff03400640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efee0066e90 0x7efee0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7f4010c00640 1 -- start start 2024-02-17T12:16:29.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7f325ca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3258157af0 0x7f3258157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa366a00640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] conn(0x7fa34806f190 0x7fa3480715b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fa367400640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa348066f10 0x7fa3480693d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa358007a70 tx=0x7fa358008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9e800640 1 -- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda01e2da0 msgr2=0x7fbda01f0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9e800640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda01e2da0 0x7fbda01f0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9e800640 1 -- 172.21.15.114:0/1399850727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda01e1e80 msgr2=0x7fbda01f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9e800640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda01e1e80 0x7fbda01f0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9e800640 1 -- 172.21.15.114:0/1399850727 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda01e35d0 con 0x7fbda00c6e90 2024-02-17T12:16:29.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7ff9b9600640 1 -- 172.21.15.114:0/3634361270 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff9bc067450 con 0x7ff9a4003980 2024-02-17T12:16:29.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9f200640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda01e1e80 0x7fbda01f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:29.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7fbd9de00640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbda01e2da0 0x7fbda01f0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.112+0000 7f325ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32581f5e60 0x7f3258148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3256800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3258157af0 0x7f3258157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3256800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3258157af0 0x7f3258157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46586/0 (socket says 172.21.15.114:46586) 2024-02-17T12:16:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa100a00640 1 -- 172.21.15.114:0/4260411609 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc067c60 msgr2=0x7fa0fc1497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa100a00640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0fc067c60 0x7fa0fc1497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa100a00640 1 -- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0fc14e020 msgr2=0x7fa0fc1f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa100a00640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0fc14e020 0x7fa0fc1f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa100a00640 1 -- 172.21.15.114:0/4260411609 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0009420 con 0x7fa0fc06dce0 2024-02-17T12:16:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7eff03400640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efee0066e90 0x7efee0069350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff04163710 tx=0x7efef4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7ff9b9600640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff99c066e70 0x7ff99c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3256800640 1 -- 172.21.15.114:0/1707308451 learned_addr learned my addr 172.21.15.114:0/1707308451 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f4010c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f400c0a9420 0x7f400c14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa100a00640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc1f2480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c700 tx=0x7fa0e800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f4010c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f400c0c65a0 0x7f400c14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f4010c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f400c156690 0x7f400c154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7ff9b9600640 1 -- 172.21.15.114:0/3634361270 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9bc19a560 con 0x7ff9a4003980 2024-02-17T12:16:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa0f9600640 1 -- 172.21.15.114:0/4260411609 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e800a840 con 0x7fa0fc06dce0 2024-02-17T12:16:29.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f4010c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c127bc0 con 0x7f400c0a9420 2024-02-17T12:16:29.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fbd9e800640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbda00c6e90 0x7fbda00c5210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd9001c900 tx=0x7fbd84005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa0f9600640 1 -- 172.21.15.114:0/4260411609 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e800a9c0 con 0x7fa0fc06dce0 2024-02-17T12:16:29.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa0f9600640 1 -- 172.21.15.114:0/4260411609 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e800adb0 con 0x7fa0fc06dce0 2024-02-17T12:16:29.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f4010c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c14dbe0 con 0x7f400c156690 2024-02-17T12:16:29.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f4010c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0722a0 con 0x7f400c0c65a0 2024-02-17T12:16:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f400a800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f400c156690 0x7f400c154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f325ca00640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258149170 0x7f325815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32580a9b50 con 0x7f32581f5e60 2024-02-17T12:16:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32581f53c0 con 0x7f3258157af0 2024-02-17T12:16:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32580a9870 con 0x7f3258149170 2024-02-17T12:16:29.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3257200640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258149170 0x7f325815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f400a800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f400c156690 0x7f400c154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46596/0 (socket says 172.21.15.114:46596) 2024-02-17T12:16:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f400a800640 1 -- 172.21.15.114:0/2616474471 learned_addr learned my addr 172.21.15.114:0/2616474471 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f4009e00640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f400c0a9420 0x7f400c14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3255e00640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32581f5e60 0x7f3258148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3256800640 1 -- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258149170 msgr2=0x7f325815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3256800640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3258149170 0x7f325815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3256800640 1 -- 172.21.15.114:0/1707308451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32581f5e60 msgr2=0x7f3258148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3256800640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32581f5e60 0x7f3258148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3256800640 1 -- 172.21.15.114:0/1707308451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32581f5660 con 0x7f3258157af0 2024-02-17T12:16:29.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f400a800640 1 -- 172.21.15.114:0/2616474471 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f400c0c65a0 msgr2=0x7f400c14f2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-17T12:16:29.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f400a800640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f400c0c65a0 0x7f400c14f2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f400a800640 1 -- 172.21.15.114:0/2616474471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f400c0a9420 msgr2=0x7f400c14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f400a800640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f400c0a9420 0x7f400c14ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f400a800640 1 -- 172.21.15.114:0/2616474471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4004009a70 con 0x7f400c156690 2024-02-17T12:16:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7ff9b9600640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] conn(0x7ff99c06f010 0x7ff99c071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7ff9b9600640 1 -- 172.21.15.114:0/3634361270 --> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff99c071ae0 con 0x7ff99c06f010 2024-02-17T12:16:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7ff9b9600640 1 -- 172.21.15.114:0/3634361270 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9bc19a9b0 con 0x7ff9a4003980 2024-02-17T12:16:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7ff9c0a00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff99c066e70 0x7ff99c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f4009e00640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f400c0a9420 0x7f400c14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:29.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fbd96a00640 1 -- 172.21.15.114:0/1399850727 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd900be070 con 0x7fbda00c6e90 2024-02-17T12:16:29.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa35f400640 1 -- 172.21.15.114:0/632877634 <== osd.1 v2:172.21.15.114:6808/290668090 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa348071c60 con 0x7fa34806f190 2024-02-17T12:16:29.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fbd96a00640 1 -- 172.21.15.114:0/1399850727 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd900a5e60 con 0x7fbda00c6e90 2024-02-17T12:16:29.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fbd96a00640 1 -- 172.21.15.114:0/1399850727 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90004260 con 0x7fbda00c6e90 2024-02-17T12:16:29.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f3256800640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3258157af0 0x7f3258157ed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f324800ebd0 tx=0x7f324800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7ff9c0a00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff99c066e70 0x7ff99c069330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40dccf0 tx=0x7ff9a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa103e00640 1 -- 172.21.15.114:0/4260411609 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f4009b30 con 0x7fa0fc06dce0 2024-02-17T12:16:29.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fa103e00640 1 -- 172.21.15.114:0/4260411609 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0fc131000 con 0x7fa0fc06dce0 2024-02-17T12:16:29.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7ff9c1e00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] conn(0x7ff99c06f010 0x7ff99c071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f400a800640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f400c156690 0x7f400c154fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00c3c0 tx=0x7f3ffc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f324ea00640 1 -- 172.21.15.114:0/1707308451 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800cd20 con 0x7f3258157af0 2024-02-17T12:16:29.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7eff03e00640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] conn(0x7efee006f0b0 0x7efee00714d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f324ea00640 1 -- 172.21.15.114:0/1707308451 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324800f040 con 0x7f3258157af0 2024-02-17T12:16:29.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32581f5940 con 0x7f3258157af0 2024-02-17T12:16:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda01e38b0 con 0x7fbda00c6e90 2024-02-17T12:16:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda00ac550 con 0x7fbda00c6e90 2024-02-17T12:16:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7ff9c1e00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] conn(0x7ff99c06f010 0x7ff99c071430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7fa103e00640 1 -- 172.21.15.114:0/4260411609 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0fc06b1c0 con 0x7fa0fc06dce0 2024-02-17T12:16:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbda01eff00 con 0x7fbda00c6e90 2024-02-17T12:16:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f324ea00640 1 -- 172.21.15.114:0/1707308451 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248003be0 con 0x7f3258157af0 2024-02-17T12:16:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.116+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32580a9420 con 0x7f3258157af0 2024-02-17T12:16:29.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f32581f5220 con 0x7f3258157af0 2024-02-17T12:16:29.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7f4002000640 1 -- 172.21.15.114:0/2616474471 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc005cf0 con 0x7f400c156690 2024-02-17T12:16:29.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7f4002000640 1 -- 172.21.15.114:0/2616474471 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc005e50 con 0x7f400c156690 2024-02-17T12:16:29.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7f4002000640 1 -- 172.21.15.114:0/2616474471 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc007310 con 0x7f400c156690 2024-02-17T12:16:29.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400c1574a0 con 0x7f400c156690 2024-02-17T12:16:29.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c071f30 con 0x7f400c156690 2024-02-17T12:16:29.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7efefbe00640 1 -- 172.21.15.114:0/2257044841 <== osd.4 v2:172.21.15.116:6800/621414064 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efee0071b80 con 0x7efee006f0b0 2024-02-17T12:16:29.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7ff9b9600640 1 -- 172.21.15.114:0/3634361270 <== osd.2 v2:172.21.15.114:6800/419916160 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff99c071ae0 con 0x7ff99c06f010 2024-02-17T12:16:29.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f400c156a70 con 0x7f400c156690 2024-02-17T12:16:29.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7fa0f9600640 1 -- 172.21.15.114:0/4260411609 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa0e8039580 con 0x7fa0fc06dce0 2024-02-17T12:16:29.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7fa0f9600640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0dc066e40 0x7fa0dc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fa0f9600640 1 -- 172.21.15.114:0/4260411609 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0e8084f30 con 0x7fa0fc06dce0 2024-02-17T12:16:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7fbd96a00640 1 -- 172.21.15.114:0/1399850727 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbd900b4040 con 0x7fbda00c6e90 2024-02-17T12:16:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.120+0000 7fbd96a00640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd80066f10 0x7fbd800693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fbd96a00640 1 -- 172.21.15.114:0/1399850727 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd9011ed30 con 0x7fbda00c6e90 2024-02-17T12:16:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fbd96a00640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] conn(0x7fbd8006f190 0x7fbd800715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fbd96a00640 1 -- 172.21.15.114:0/1399850727 --> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd80071c60 con 0x7fbd8006f190 2024-02-17T12:16:29.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fbd96a00640 1 -- 172.21.15.114:0/1399850727 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd9011f0e0 con 0x7fbda00c6e90 2024-02-17T12:16:29.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f324ea00640 1 -- 172.21.15.114:0/1707308451 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3248003d40 con 0x7f3258157af0 2024-02-17T12:16:29.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fa0f9600640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] conn(0x7fa0dc06f040 0x7fa0dc071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fa0f9600640 1 -- 172.21.15.114:0/4260411609 --> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0dc071b10 con 0x7fa0dc06f040 2024-02-17T12:16:29.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fa0f9600640 1 -- 172.21.15.114:0/4260411609 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0e80852e0 con 0x7fa0fc06dce0 2024-02-17T12:16:29.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f324ea00640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066f40 0x7f3234069400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fa101e00640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] conn(0x7fa0dc06f040 0x7fa0dc071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fa101400640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0dc066e40 0x7fa0dc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f324ea00640 1 -- 172.21.15.114:0/1707308451 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32480853c0 con 0x7f3258157af0 2024-02-17T12:16:29.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fbd9f200640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] conn(0x7fbd8006f190 0x7fbd800715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fbd9de00640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd80066f10 0x7fbd800693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fa101e00640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] conn(0x7fa0dc06f040 0x7fa0dc071460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fa101400640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0dc066e40 0x7fa0dc069300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009cf0 tx=0x7fa0f0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7fbd9de00640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd80066f10 0x7fbd800693d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0017b0 tx=0x7fbd8c001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f324ea00640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] conn(0x7f323406f160 0x7f3234071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f324ea00640 1 -- 172.21.15.114:0/1707308451 --> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3234071c30 con 0x7f323406f160 2024-02-17T12:16:29.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f324ea00640 1 -- 172.21.15.114:0/1707308451 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32480879e0 con 0x7f3258157af0 2024-02-17T12:16:29.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f3257200640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] conn(0x7f323406f160 0x7f3234071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f3257200640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] conn(0x7f323406f160 0x7f3234071580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f4002000640 1 -- 172.21.15.114:0/2616474471 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3ffc007470 con 0x7f400c156690 2024-02-17T12:16:29.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f4002000640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3fec066e40 0x7f3fec069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.124+0000 7f4002000640 1 -- 172.21.15.114:0/2616474471 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ffc084010 con 0x7f400c156690 2024-02-17T12:16:29.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f3255e00640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066f40 0x7f3234069400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f324ea00640 1 -- 172.21.15.114:0/1707308451 <== osd.6 v2:172.21.15.116:6810/616119485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3234071c30 con 0x7f323406f160 2024-02-17T12:16:29.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f4002000640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] conn(0x7f3fec06f060 0x7f3fec071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7fa0f9600640 1 -- 172.21.15.114:0/4260411609 <== osd.3 v2:172.21.15.114:6809/3161691811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa0dc071b10 con 0x7fa0dc06f040 2024-02-17T12:16:29.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f4009e00640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3fec066e40 0x7f3fec069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f4002000640 1 -- 172.21.15.114:0/2616474471 --> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fec071b30 con 0x7f3fec06f060 2024-02-17T12:16:29.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f4002000640 1 -- 172.21.15.114:0/2616474471 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ffc0865d0 con 0x7f400c156690 2024-02-17T12:16:29.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f3255e00640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066f40 0x7f3234069400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3250000c10 tx=0x7f3250009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f4009400640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] conn(0x7f3fec06f060 0x7f3fec071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7fbd9f200640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] conn(0x7fbd8006f190 0x7fbd800715b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f4009400640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] conn(0x7f3fec06f060 0x7f3fec071480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f4009e00640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3fec066e40 0x7f3fec069300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009bb0 tx=0x7f3ff8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7f4002000640 1 -- 172.21.15.114:0/2616474471 <== osd.5 v2:172.21.15.116:6824/3672471702 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3fec071b30 con 0x7f3fec06f060 2024-02-17T12:16:29.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.128+0000 7fbd96a00640 1 -- 172.21.15.114:0/1399850727 <== osd.7 v2:172.21.15.116:6808/2799570166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbd80071c60 con 0x7fbd8006f190 2024-02-17T12:16:29.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 --> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff9b400bad0 con 0x7ff99c06f010 2024-02-17T12:16:29.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7ff9b9600640 1 -- 172.21.15.114:0/3634361270 <== osd.2 v2:172.21.15.114:6800/419916160 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff9b000d620 con 0x7ff99c06f010 2024-02-17T12:16:29.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 --> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5d8049b80 con 0x7fa5c006f040 2024-02-17T12:16:29.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7fa5dd600640 1 -- 172.21.15.114:0/1603435781 <== osd.0 v2:172.21.15.114:6824/1061952801 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa5d8049b80 con 0x7fa5c006f040 2024-02-17T12:16:29.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] conn(0x7ff99c06f010 msgr2=0x7ff99c071430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7ff9c3e00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] conn(0x7ff99c06f010 0x7ff99c071430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff99c066e70 msgr2=0x7ff99c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7ff9c3e00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff99c066e70 0x7ff99c069330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40dccf0 tx=0x7ff9a8009040 comp rx=0 tx=0).stop 2024-02-17T12:16:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 msgr2=0x7ff9b40d8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7ff9c3e00640 1 --2- 172.21.15.114:0/3634361270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9a4003980 0x7ff9b40d8fe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc064720 tx=0x7ff9bc06a7b0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.140+0000 7ff9c1e00640 1 -- 172.21.15.114:0/3634361270 reap_dead start 2024-02-17T12:16:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 shutdown_connections 2024-02-17T12:16:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 >> 172.21.15.114:0/3634361270 conn(0x7ff9b4048290 msgr2=0x7ff9b4048670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] conn(0x7fa5c006f040 msgr2=0x7fa5c0071460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e8600640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] conn(0x7fa5c006f040 0x7fa5c0071460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 shutdown_connections 2024-02-17T12:16:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7ff9c3e00640 1 -- 172.21.15.114:0/3634361270 wait complete. 2024-02-17T12:16:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa5c0066ea0 msgr2=0x7fa5c0069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e8600640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa5c0066ea0 0x7fa5c0069360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0050830 tx=0x7fa5e006e040 comp rx=0 tx=0).stop 2024-02-17T12:16:29.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5d80462f0 msgr2=0x7fa5d81707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e8600640 1 --2- 172.21.15.114:0/1603435781 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5d80462f0 0x7fa5d81707c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c3c0 tx=0x7fa5cc00c880 comp rx=0 tx=0).stop 2024-02-17T12:16:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e6600640 1 -- 172.21.15.114:0/1603435781 reap_dead start 2024-02-17T12:16:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 shutdown_connections 2024-02-17T12:16:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 >> 172.21.15.114:0/1603435781 conn(0x7fa5d8005ea0 msgr2=0x7fa5d80d2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 shutdown_connections 2024-02-17T12:16:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.144+0000 7fa5e8600640 1 -- 172.21.15.114:0/1603435781 wait complete. 2024-02-17T12:16:29.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 --> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7eff0414f320 con 0x7efee006f0b0 2024-02-17T12:16:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7efefbe00640 1 -- 172.21.15.114:0/2257044841 <== osd.4 v2:172.21.15.116:6800/621414064 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7eff0414f320 con 0x7efee006f0b0 2024-02-17T12:16:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 >> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] conn(0x7efee006f0b0 msgr2=0x7efee00714d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] conn(0x7efee006f0b0 0x7efee00714d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efee0066e90 msgr2=0x7efee0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efee0066e90 0x7efee0069350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff04163710 tx=0x7efef4008040 comp rx=0 tx=0).stop 2024-02-17T12:16:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff040c35d0 msgr2=0x7eff041f2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 --2- 172.21.15.114:0/2257044841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff040c35d0 0x7eff041f2a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efeec0ad040 tx=0x7efeec01aca0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff03e00640 1 -- 172.21.15.114:0/2257044841 reap_dead start 2024-02-17T12:16:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 shutdown_connections 2024-02-17T12:16:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 --> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3681468c0 con 0x7fa34806f190 2024-02-17T12:16:29.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 >> 172.21.15.114:0/2257044841 conn(0x7eff040a8660 msgr2=0x7eff04156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 --> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3258165320 con 0x7f323406f160 2024-02-17T12:16:29.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 shutdown_connections 2024-02-17T12:16:29.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7eff09000640 1 -- 172.21.15.114:0/2257044841 wait complete. 2024-02-17T12:16:29.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7f324ea00640 1 -- 172.21.15.114:0/1707308451 <== osd.6 v2:172.21.15.116:6810/616119485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3258165320 con 0x7f323406f160 2024-02-17T12:16:29.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.152+0000 7fa35f400640 1 -- 172.21.15.114:0/632877634 <== osd.1 v2:172.21.15.114:6808/290668090 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3681468c0 con 0x7fa34806f190 2024-02-17T12:16:29.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] conn(0x7fa34806f190 msgr2=0x7fa3480715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7fa36e200640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] conn(0x7fa34806f190 0x7fa3480715b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] conn(0x7f323406f160 msgr2=0x7f3234071580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f325ca00640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] conn(0x7f323406f160 0x7f3234071580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066f40 msgr2=0x7f3234069400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f325ca00640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3234066f40 0x7f3234069400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3250000c10 tx=0x7f3250009040 comp rx=0 tx=0).stop 2024-02-17T12:16:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3258157af0 msgr2=0x7f3258157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f325ca00640 1 --2- 172.21.15.114:0/1707308451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3258157af0 0x7f3258157ed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f324800ebd0 tx=0x7f324800c490 comp rx=0 tx=0).stop 2024-02-17T12:16:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f3257200640 1 -- 172.21.15.114:0/1707308451 reap_dead start 2024-02-17T12:16:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 shutdown_connections 2024-02-17T12:16:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 >> 172.21.15.114:0/1707308451 conn(0x7f32580c6370 msgr2=0x7f325814a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 shutdown_connections 2024-02-17T12:16:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7f325ca00640 1 -- 172.21.15.114:0/1707308451 wait complete. 2024-02-17T12:16:29.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 --> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbda006e530 con 0x7fbd8006f190 2024-02-17T12:16:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa348066f10 msgr2=0x7fa3480693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7fa36e200640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa348066f10 0x7fa3480693d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa358007a70 tx=0x7fa358008040 comp rx=0 tx=0).stop 2024-02-17T12:16:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa36814ef00 msgr2=0x7fa368143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.156+0000 7fa36e200640 1 --2- 172.21.15.114:0/632877634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa36814ef00 0x7fa368143d20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa35400d580 tx=0x7fa35400da40 comp rx=0 tx=0).stop 2024-02-17T12:16:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fa367e00640 1 -- 172.21.15.114:0/632877634 reap_dead start 2024-02-17T12:16:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 shutdown_connections 2024-02-17T12:16:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 >> 172.21.15.114:0/632877634 conn(0x7fa3680a8660 msgr2=0x7fa368155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 shutdown_connections 2024-02-17T12:16:29.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbd96a00640 1 -- 172.21.15.114:0/1399850727 <== osd.7 v2:172.21.15.116:6808/2799570166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbd98001ff0 con 0x7fbd8006f190 2024-02-17T12:16:29.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fa36e200640 1 -- 172.21.15.114:0/632877634 wait complete. 2024-02-17T12:16:29.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fa103e00640 1 -- 172.21.15.114:0/4260411609 --> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0fc0c1e10 con 0x7fa0dc06f040 2024-02-17T12:16:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] conn(0x7fbd8006f190 msgr2=0x7fbd800715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbda4a00640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] conn(0x7fbd8006f190 0x7fbd800715b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd80066f10 msgr2=0x7fbd800693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbda4a00640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd80066f10 0x7fbd800693d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0017b0 tx=0x7fbd8c001440 comp rx=0 tx=0).stop 2024-02-17T12:16:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbda00c6e90 msgr2=0x7fbda00c5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbda4a00640 1 --2- 172.21.15.114:0/1399850727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbda00c6e90 0x7fbda00c5210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd9001c900 tx=0x7fbd84005800 comp rx=0 tx=0).stop 2024-02-17T12:16:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fa0f9600640 1 -- 172.21.15.114:0/4260411609 <== osd.3 v2:172.21.15.114:6809/3161691811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa0fc0c1e10 con 0x7fa0dc06f040 2024-02-17T12:16:29.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbd9f200640 1 -- 172.21.15.114:0/1399850727 reap_dead start 2024-02-17T12:16:29.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 shutdown_connections 2024-02-17T12:16:29.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 >> 172.21.15.114:0/1399850727 conn(0x7fbda00c6370 msgr2=0x7fbda0148560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 shutdown_connections 2024-02-17T12:16:29.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.160+0000 7fbda4a00640 1 -- 172.21.15.114:0/1399850727 wait complete. 2024-02-17T12:16:29.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa0eea00640 1 -- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] conn(0x7fa0dc06f040 msgr2=0x7fa0dc071460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa0eea00640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] conn(0x7fa0dc06f040 0x7fa0dc071460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa0eea00640 1 -- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0dc066e40 msgr2=0x7fa0dc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa0eea00640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0dc066e40 0x7fa0dc069300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009cf0 tx=0x7fa0f0009190 comp rx=0 tx=0).stop 2024-02-17T12:16:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa0eea00640 1 -- 172.21.15.114:0/4260411609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0fc06dce0 msgr2=0x7fa0fc1f2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa0eea00640 1 --2- 172.21.15.114:0/4260411609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc1f2480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c700 tx=0x7fa0e800cbc0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa101e00640 1 -- 172.21.15.114:0/4260411609 reap_dead start 2024-02-17T12:16:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa0eea00640 1 -- 172.21.15.114:0/4260411609 shutdown_connections 2024-02-17T12:16:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa0eea00640 1 -- 172.21.15.114:0/4260411609 >> 172.21.15.114:0/4260411609 conn(0x7fa0fc0a8750 msgr2=0x7fa0fc148a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa0eea00640 1 -- 172.21.15.114:0/4260411609 shutdown_connections 2024-02-17T12:16:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.164+0000 7fa0eea00640 1 -- 172.21.15.114:0/4260411609 wait complete. 2024-02-17T12:16:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.168+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 --> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f400c06da70 con 0x7f3fec06f060 2024-02-17T12:16:29.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4002000640 1 -- 172.21.15.114:0/2616474471 <== osd.5 v2:172.21.15.116:6824/3672471702 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f40040a57a0 con 0x7f3fec06f060 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 >> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] conn(0x7f3fec06f060 msgr2=0x7f3fec071480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4010c00640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] conn(0x7f3fec06f060 0x7f3fec071480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3fec066e40 msgr2=0x7f3fec069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4010c00640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3fec066e40 0x7f3fec069300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009bb0 tx=0x7f3ff8008040 comp rx=0 tx=0).stop 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f400c156690 msgr2=0x7f400c154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4010c00640 1 --2- 172.21.15.114:0/2616474471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f400c156690 0x7f400c154fc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00c3c0 tx=0x7f3ffc00c880 comp rx=0 tx=0).stop 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f400a800640 1 -- 172.21.15.114:0/2616474471 reap_dead start 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 shutdown_connections 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 >> 172.21.15.114:0/2616474471 conn(0x7f400c0a8490 msgr2=0x7f400c0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 shutdown_connections 2024-02-17T12:16:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.176+0000 7f4010c00640 1 -- 172.21.15.114:0/2616474471 wait complete. 2024-02-17T12:16:29.212 INFO:teuthology.orchestra.run.smithi114.stdout:60129542150 2024-02-17T12:16:29.213 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-17T12:16:29.214 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-02-17T12:16:29.214 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-17T12:16:29.215 INFO:teuthology.orchestra.run.smithi114.stdout:60129542151 2024-02-17T12:16:29.215 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-17T12:16:29.216 INFO:teuthology.orchestra.run.smithi114.stdout:64424509445 2024-02-17T12:16:29.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-17T12:16:29.217 INFO:teuthology.orchestra.run.smithi114.stdout:60129542149 2024-02-17T12:16:29.217 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-17T12:16:29.218 INFO:teuthology.orchestra.run.smithi114.stdout:64424509445 2024-02-17T12:16:29.218 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-17T12:16:29.219 INFO:teuthology.orchestra.run.smithi114.stdout:64424509446 2024-02-17T12:16:29.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-17T12:16:29.220 INFO:teuthology.orchestra.run.smithi114.stdout:64424509445 2024-02-17T12:16:29.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-17T12:16:29.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.496+0000 7ff43f200640 1 Processor -- start 2024-02-17T12:16:29.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.496+0000 7f1806800640 1 Processor -- start 2024-02-17T12:16:29.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.496+0000 7ff43f200640 1 -- start start 2024-02-17T12:16:29.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.496+0000 7f1806800640 1 -- start start 2024-02-17T12:16:29.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43f200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4380d46e0 0x7ff4380d7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f1806800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1800150300 0x7f1800156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f1806800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f18000714c0 0x7f18000aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f1806800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1800157270 con 0x7f18000aa6a0 2024-02-17T12:16:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43f200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff438047270 0x7ff438047700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f1806800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000c6900 con 0x7f18000714c0 2024-02-17T12:16:29.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f1806800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000c3580 con 0x7f1800150300 2024-02-17T12:16:29.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43f200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff438008a70 con 0x7ff43804a7f0 2024-02-17T12:16:29.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43f200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4380482d0 con 0x7ff438047270 2024-02-17T12:16:29.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43f200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff438007c50 con 0x7ff4380d46e0 2024-02-17T12:16:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f17ffe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f18000aa6a0 0x7f1800152d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45494/0 (socket says 172.21.15.114:45494) 2024-02-17T12:16:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43d400640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff43804a7f0 0x7ff438008f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:44640/0 (socket says 172.21.15.114:44640) 2024-02-17T12:16:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f17ffe00640 1 -- 172.21.15.114:0/2141062412 learned_addr learned my addr 172.21.15.114:0/2141062412 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f17f7e00640 1 --2- 172.21.15.114:0/2141062412 >> v2:172.21.15.114:3300/0 conn(0x7f18000714c0 0x7f18000aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43d400640 1 -- 172.21.15.114:0/891964952 learned_addr learned my addr 172.21.15.114:0/891964952 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f17f7e00640 1 -- 172.21.15.114:0/2141062412 >> v2:172.21.15.116:3300/0 conn(0x7f1800150300 msgr2=0x7f1800156d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T12:16:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f17f7e00640 1 --2- 172.21.15.114:0/2141062412 >> v2:172.21.15.116:3300/0 conn(0x7f1800150300 0x7f1800156d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f17f7e00640 1 -- 172.21.15.114:0/2141062412 >> v1:172.21.15.114:6789/0 conn(0x7f18000aa6a0 legacy=0x7f1800152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7f17f7e00640 1 -- 172.21.15.114:0/2141062412 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000c2fc0 con 0x7f18000714c0 2024-02-17T12:16:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795657474 0 0) 0x7ff438008a70 con 0x7ff43804a7f0 2024-02-17T12:16:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff424003530 con 0x7ff43804a7f0 2024-02-17T12:16:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3655205046 0 0) 0x7ff424003530 con 0x7ff43804a7f0 2024-02-17T12:16:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4380d46e0 msgr2=0x7ff4380d7050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T12:16:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4380d46e0 0x7ff4380d7050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 >> v2:172.21.15.116:3300/0 conn(0x7ff438047270 msgr2=0x7ff438047700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T12:16:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 --2- 172.21.15.114:0/891964952 >> v2:172.21.15.116:3300/0 conn(0x7ff438047270 0x7ff438047700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4380d4ac0 con 0x7ff43804a7f0 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 <== mon.1 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7ff430001660 con 0x7ff43804a7f0 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 >> v1:172.21.15.116:6789/0 conn(0x7ff43804a7f0 legacy=0x7ff438008f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4240039a0 0x7ff424003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff424004390 0x7ff424004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff424005100 0x7ff42400ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff438007c50 con 0x7ff424004390 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff424010620 con 0x7ff424005100 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.500+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240107e0 con 0x7ff4240039a0 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7ff43d400640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff424004390 0x7ff424004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7ff43de00640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4240039a0 0x7ff424003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7ff43e800640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff424005100 0x7ff42400ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7ff43d400640 1 -- 172.21.15.114:0/891964952 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4240039a0 msgr2=0x7ff424003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7ff43d400640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4240039a0 0x7ff424003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7ff43d400640 1 -- 172.21.15.114:0/891964952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff424005100 msgr2=0x7ff42400ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7ff43d400640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff424005100 0x7ff42400ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7ff43d400640 1 -- 172.21.15.114:0/891964952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424003530 con 0x7ff424004390 2024-02-17T12:16:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7f17f7e00640 1 --2- 172.21.15.114:0/2141062412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18000714c0 0x7f18000aa160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f180006dfa0 tx=0x7f17e801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63879b18a9920ceb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7f463fe00640 1 Processor -- start 2024-02-17T12:16:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7f17fea00640 1 -- 172.21.15.114:0/2141062412 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80a4ea0 con 0x7f18000714c0 2024-02-17T12:16:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7f17fea00640 1 -- 172.21.15.114:0/2141062412 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e80a7050 con 0x7f18000714c0 2024-02-17T12:16:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7f463fe00640 1 -- start start 2024-02-17T12:16:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.504+0000 7f17fea00640 1 -- 172.21.15.114:0/2141062412 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80ab820 con 0x7f18000714c0 2024-02-17T12:16:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f1806800640 1 -- 172.21.15.114:0/2141062412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18000714c0 msgr2=0x7f18000aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f1806800640 1 --2- 172.21.15.114:0/2141062412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18000714c0 0x7f18000aa160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f180006dfa0 tx=0x7f17e801c410 comp rx=0 tx=0).stop 2024-02-17T12:16:29.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f1806800640 1 -- 172.21.15.114:0/2141062412 shutdown_connections 2024-02-17T12:16:29.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f1806800640 1 --2- 172.21.15.114:0/2141062412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18000714c0 0x7f18000aa160 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f1806800640 1 --2- 172.21.15.114:0/2141062412 >> v2:172.21.15.116:3300/0 conn(0x7f1800150300 0x7f1800156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f1806800640 1 -- 172.21.15.114:0/2141062412 >> 172.21.15.114:0/2141062412 conn(0x7f18000c4f20 msgr2=0x7f18000c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f1806800640 1 -- 172.21.15.114:0/2141062412 shutdown_connections 2024-02-17T12:16:29.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f1806800640 1 -- 172.21.15.114:0/2141062412 wait complete. 2024-02-17T12:16:29.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7ff43d400640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff424004390 0x7ff424004870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff430007fa0 tx=0x7ff43001cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184f742d2f6b383e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f463fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f46400c1fe0 0x7f46400a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f463fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464006ed50 con 0x7f464014e9c0 2024-02-17T12:16:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f463fe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464006f030 con 0x7f4640155830 2024-02-17T12:16:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f463fe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464006f310 con 0x7f46400c1fe0 2024-02-17T12:16:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f463ea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f46400c1fe0 0x7f46400a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f463f400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f464014e9c0 0x7f464015c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45508/0 (socket says 172.21.15.114:45508) 2024-02-17T12:16:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f463f400640 1 -- 172.21.15.114:0/130119306 learned_addr learned my addr 172.21.15.114:0/130119306 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4300a9030 con 0x7ff424004390 2024-02-17T12:16:29.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4300073b0 con 0x7ff424004390 2024-02-17T12:16:29.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7ff43ca00640 1 -- 172.21.15.114:0/891964952 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430007740 con 0x7ff424004390 2024-02-17T12:16:29.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f463ea00640 1 -- 172.21.15.114:0/130119306 >> v1:172.21.15.116:6789/0 conn(0x7f4640155830 legacy=0x7f4640152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f463ea00640 1 -- 172.21.15.114:0/130119306 >> v1:172.21.15.114:6789/0 conn(0x7f464014e9c0 legacy=0x7f464015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7f463ea00640 1 -- 172.21.15.114:0/130119306 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4640151b80 con 0x7f46400c1fe0 2024-02-17T12:16:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7ff43f200640 1 -- 172.21.15.114:0/891964952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff424004390 msgr2=0x7ff424004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7ff43f200640 1 --2- 172.21.15.114:0/891964952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff424004390 0x7ff424004870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff430007fa0 tx=0x7ff43001cb20 comp rx=0 tx=0).stop 2024-02-17T12:16:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.508+0000 7ff43e800640 1 -- 172.21.15.114:0/891964952 reap_dead start 2024-02-17T12:16:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7ff43f200640 1 -- 172.21.15.114:0/891964952 shutdown_connections 2024-02-17T12:16:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7ff43f200640 1 -- 172.21.15.114:0/891964952 >> 172.21.15.114:0/891964952 conn(0x7ff438049370 msgr2=0x7ff438049750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fadb2800640 1 Processor -- start 2024-02-17T12:16:29.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fadb2800640 1 -- start start 2024-02-17T12:16:29.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f1806800640 1 Processor -- start 2024-02-17T12:16:29.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fc8a5000640 1 Processor -- start 2024-02-17T12:16:29.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fe3da800640 1 Processor -- start 2024-02-17T12:16:29.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7ff43f200640 1 -- 172.21.15.114:0/891964952 shutdown_connections 2024-02-17T12:16:29.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fe3da800640 1 -- start start 2024-02-17T12:16:29.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7ff43f200640 1 -- 172.21.15.114:0/891964952 wait complete. 2024-02-17T12:16:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f1806800640 1 -- start start 2024-02-17T12:16:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f1806800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18000714c0 0x7f180014a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f1806800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18000aa6a0 0x7f18001f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f1806800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1800150300 0x7f18001f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f1806800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180014d050 con 0x7f1800150300 2024-02-17T12:16:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f1806800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180014d5f0 con 0x7f18000aa6a0 2024-02-17T12:16:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f1806800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180014f460 con 0x7f18000714c0 2024-02-17T12:16:29.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fc8a5000640 1 -- start start 2024-02-17T12:16:29.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fc8a5000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc8a0156690 0x7fc8a015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f17ff400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18000714c0 0x7f180014a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f17ff400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18000714c0 0x7f180014a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34584/0 (socket says 172.21.15.114:34584) 2024-02-17T12:16:29.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f17ff400640 1 -- 172.21.15.114:0/172787546 learned_addr learned my addr 172.21.15.114:0/172787546 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f17f7e00640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18000aa6a0 0x7f18001f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fc8a5000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a015c6f0 con 0x7fc8a00a9420 2024-02-17T12:16:29.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fc8a5000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a015ccb0 con 0x7fc8a00c65a0 2024-02-17T12:16:29.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fc8a5000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a015d680 con 0x7fc8a0156690 2024-02-17T12:16:29.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fc89de00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc8a0156690 0x7fc8a015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f17ffe00640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1800150300 0x7f18001f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f17f7e00640 1 -- 172.21.15.114:0/172787546 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18000714c0 msgr2=0x7f180014a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f17f7e00640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18000714c0 0x7f180014a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f17f7e00640 1 -- 172.21.15.114:0/172787546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1800150300 msgr2=0x7f18001f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f17f7e00640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1800150300 0x7f18001f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f17f7e00640 1 -- 172.21.15.114:0/172787546 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8009420 con 0x7f18000aa6a0 2024-02-17T12:16:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fc89de00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc8a0156690 0x7fc8a015d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46644/0 (socket says 172.21.15.114:46644) 2024-02-17T12:16:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7fc89de00640 1 -- 172.21.15.114:0/2780064890 learned_addr learned my addr 172.21.15.114:0/2780064890 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.512+0000 7f463ea00640 1 --2- 172.21.15.114:0/130119306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 0x7f46400a8ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46300097f0 tx=0x7f463001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b572d343b54fa4f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadb2800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fadac152460 0x7fadac1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f17f7e00640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18000aa6a0 0x7f18001f58c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17e80ab000 tx=0x7f17e801ac50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f17f7400640 1 -- 172.21.15.114:0/172787546 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80b7650 con 0x7f18000aa6a0 2024-02-17T12:16:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f17f7400640 1 -- 172.21.15.114:0/172787546 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e80b77b0 con 0x7f18000aa6a0 2024-02-17T12:16:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f17f7400640 1 -- 172.21.15.114:0/172787546 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80b7b60 con 0x7f18000aa6a0 2024-02-17T12:16:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f1806800640 1 -- 172.21.15.114:0/172787546 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18000adde0 con 0x7f18000aa6a0 2024-02-17T12:16:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f1806800640 1 -- 172.21.15.114:0/172787546 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180014d280 con 0x7f18000aa6a0 2024-02-17T12:16:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3da800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe3d40a9420 0x7fe3d415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3d3400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe3d4156690 0x7fe3d4159100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45520/0 (socket says 172.21.15.114:45520) 2024-02-17T12:16:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3d3400640 1 -- 172.21.15.114:0/1254479332 learned_addr learned my addr 172.21.15.114:0/1254479332 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadab400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fadac152460 0x7fadac1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadab400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fadac152460 0x7fadac1558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46654/0 (socket says 172.21.15.114:46654) 2024-02-17T12:16:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadaaa00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fadac0c8790 0x7fadac06cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:44660/0 (socket says 172.21.15.114:44660) 2024-02-17T12:16:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadab400640 1 -- 172.21.15.114:0/1001513746 learned_addr learned my addr 172.21.15.114:0/1001513746 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadb2800640 1 -- 172.21.15.114:0/1001513746 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadac155e00 con 0x7fadac0c6eb0 2024-02-17T12:16:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadb2800640 1 -- 172.21.15.114:0/1001513746 --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadac0c7a00 con 0x7fadac0c8790 2024-02-17T12:16:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadb2800640 1 -- 172.21.15.114:0/1001513746 --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadac0c60b0 con 0x7fadac152460 2024-02-17T12:16:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadaa000640 1 -- 172.21.15.114:0/1001513746 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817347856 0 0) 0x7fadac0c7a00 con 0x7fadac0c8790 2024-02-17T12:16:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadaa000640 1 -- 172.21.15.114:0/1001513746 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad90003530 con 0x7fadac0c8790 2024-02-17T12:16:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fc89ca00640 1 -- 172.21.15.114:0/2780064890 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885333855 0 0) 0x7fc8a015ccb0 con 0x7fc8a00c65a0 2024-02-17T12:16:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fc89ca00640 1 -- 172.21.15.114:0/2780064890 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc884003530 con 0x7fc8a00c65a0 2024-02-17T12:16:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fc89de00640 1 -- 172.21.15.114:0/2780064890 >> v1:172.21.15.116:6789/0 conn(0x7fc8a00c65a0 legacy=0x7fc8a0163a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fc89de00640 1 -- 172.21.15.114:0/2780064890 >> v1:172.21.15.114:6789/0 conn(0x7fc8a00a9420 legacy=0x7fc8a0159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fc89de00640 1 -- 172.21.15.114:0/2780064890 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a006eb40 con 0x7fc8a0156690 2024-02-17T12:16:29.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadab400640 1 -- 172.21.15.114:0/1001513746 >> v1:172.21.15.116:6789/0 conn(0x7fadac0c8790 legacy=0x7fadac06cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadaa000640 1 -- 172.21.15.114:0/1001513746 <== mon.1 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 484901901 0 0) 0x7fad90003530 con 0x7fadac0c8790 2024-02-17T12:16:29.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3da800640 1 --2- 172.21.15.114:0/1254479332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 0x7fe3d40c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3da800640 1 -- 172.21.15.114:0/1254479332 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d415c6f0 con 0x7fe3d4156690 2024-02-17T12:16:29.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3da800640 1 -- 172.21.15.114:0/1254479332 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d415ccb0 con 0x7fe3d40a9420 2024-02-17T12:16:29.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3da800640 1 -- 172.21.15.114:0/1254479332 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d415d680 con 0x7fe3d40c65a0 2024-02-17T12:16:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f463d600640 1 -- 172.21.15.114:0/130119306 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46300ab600 con 0x7f46400c1fe0 2024-02-17T12:16:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadab400640 1 -- 172.21.15.114:0/1001513746 >> v1:172.21.15.114:6789/0 conn(0x7fadac0c6eb0 legacy=0x7fadac0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7ff43f200640 1 Processor -- start 2024-02-17T12:16:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f1806800640 1 -- 172.21.15.114:0/172787546 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d40052a0 con 0x7f18000aa6a0 2024-02-17T12:16:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7ff43f200640 1 -- start start 2024-02-17T12:16:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f463d600640 1 -- 172.21.15.114:0/130119306 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46300a7050 con 0x7f46400c1fe0 2024-02-17T12:16:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f463d600640 1 -- 172.21.15.114:0/130119306 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46300ab980 con 0x7f46400c1fe0 2024-02-17T12:16:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3d3e00640 1 --2- 172.21.15.114:0/1254479332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 0x7fe3d40c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3d2a00640 1 --2- 172.21.15.114:0/1254479332 >> v2:172.21.15.114:3300/0 conn(0x7fe3d40a9420 0x7fe3d415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fadab400640 1 -- 172.21.15.114:0/1001513746 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac06c7a0 con 0x7fadac152460 2024-02-17T12:16:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3d2000640 1 -- 172.21.15.114:0/1254479332 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497752828 0 0) 0x7fe3d415c6f0 con 0x7fe3d4156690 2024-02-17T12:16:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3d2000640 1 -- 172.21.15.114:0/1254479332 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b8003530 con 0x7fe3d4156690 2024-02-17T12:16:29.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7f35f1000640 1 Processor -- start 2024-02-17T12:16:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f17f7400640 1 -- 172.21.15.114:0/172787546 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f17e80b7cc0 con 0x7f18000aa6a0 2024-02-17T12:16:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff438031770 0x7ff438032070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43f200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4380c8df0 0x7ff43804ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43f200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff43802da30 0x7ff43816ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f463fe00640 1 -- 172.21.15.114:0/130119306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 msgr2=0x7f46400a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f463fe00640 1 --2- 172.21.15.114:0/130119306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 0x7f46400a8ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46300097f0 tx=0x7f463001c430 comp rx=0 tx=0).stop 2024-02-17T12:16:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff438031770 0x7ff438032070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff438031770 0x7ff438032070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57752/0 (socket says 172.21.15.114:57752) 2024-02-17T12:16:29.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43d400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4380c8df0 0x7ff43804ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43d400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4380c8df0 0x7ff43804ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34606/0 (socket says 172.21.15.114:34606) 2024-02-17T12:16:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f35f1000640 1 -- start start 2024-02-17T12:16:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43de00640 1 -- 172.21.15.114:0/2977666740 learned_addr learned my addr 172.21.15.114:0/2977666740 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380c8820 con 0x7ff438031770 2024-02-17T12:16:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43802f560 con 0x7ff43802da30 2024-02-17T12:16:29.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43802de80 con 0x7ff4380c8df0 2024-02-17T12:16:29.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3d2a00640 1 -- 172.21.15.114:0/1254479332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 msgr2=0x7fe3d40c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:29.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3d2a00640 1 --2- 172.21.15.114:0/1254479332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 0x7fe3d40c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3d2a00640 1 -- 172.21.15.114:0/1254479332 >> v1:172.21.15.114:6789/0 conn(0x7fe3d4156690 legacy=0x7fe3d4159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.516+0000 7fe3d2a00640 1 -- 172.21.15.114:0/1254479332 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d406eb40 con 0x7fe3d40a9420 2024-02-17T12:16:29.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7fc89de00640 1 --2- 172.21.15.114:0/2780064890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a0156690 0x7fc8a015d140 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc890009870 tx=0x7fc89001c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a9d080f0c845e49 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f463fe00640 1 -- 172.21.15.114:0/130119306 shutdown_connections 2024-02-17T12:16:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f463fe00640 1 --2- 172.21.15.114:0/130119306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 0x7f46400a8ab0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f463fe00640 1 -- 172.21.15.114:0/130119306 >> 172.21.15.114:0/130119306 conn(0x7f464006c320 msgr2=0x7f46400c7380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43e800640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff43802da30 0x7ff43816ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43d400640 1 -- 172.21.15.114:0/2977666740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff43802da30 msgr2=0x7ff43816ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43d400640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff43802da30 0x7ff43816ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43d400640 1 -- 172.21.15.114:0/2977666740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff438031770 msgr2=0x7ff438032070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43d400640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff438031770 0x7ff438032070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43d400640 1 -- 172.21.15.114:0/2977666740 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4380c8b10 con 0x7ff4380c8df0 2024-02-17T12:16:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f463fe00640 1 -- 172.21.15.114:0/130119306 shutdown_connections 2024-02-17T12:16:29.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f463fe00640 1 -- 172.21.15.114:0/130119306 wait complete. 2024-02-17T12:16:29.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f35f1000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec0714c0 0x7f35ec156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f35e9e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f35ec150300 0x7f35ec0aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45536/0 (socket says 172.21.15.114:45536) 2024-02-17T12:16:29.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43d400640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4380c8df0 0x7ff43804ac10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff430001ec0 tx=0x7ff4300198c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f17f7400640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f17dc066ec0 0x7f17dc069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f17f7400640 1 -- 172.21.15.114:0/172787546 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17e811f0f0 con 0x7f18000aa6a0 2024-02-17T12:16:29.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f17ff400640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f17dc066ec0 0x7f17dc069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f17ff400640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f17dc066ec0 0x7f17dc069380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f17f00099a0 tx=0x7f17f00090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff436000640 1 -- 172.21.15.114:0/2977666740 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4300a9020 con 0x7ff4380c8df0 2024-02-17T12:16:29.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff436000640 1 -- 172.21.15.114:0/2977666740 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4300a5820 con 0x7ff4380c8df0 2024-02-17T12:16:29.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff436000640 1 -- 172.21.15.114:0/2977666740 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4300a5bd0 con 0x7ff4380c8df0 2024-02-17T12:16:29.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43802e090 con 0x7ff4380c8df0 2024-02-17T12:16:29.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff438031b50 con 0x7ff4380c8df0 2024-02-17T12:16:29.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f35e9e00640 1 -- 172.21.15.114:0/745366200 learned_addr learned my addr 172.21.15.114:0/745366200 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f35e9400640 1 --2- 172.21.15.114:0/745366200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec0714c0 0x7f35ec156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f35f1000640 1 -- 172.21.15.114:0/745366200 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec157270 con 0x7f35ec150300 2024-02-17T12:16:29.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f35f1000640 1 -- 172.21.15.114:0/745366200 --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ec0c3580 con 0x7f35ec152d30 2024-02-17T12:16:29.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.520+0000 7f35f1000640 1 -- 172.21.15.114:0/745366200 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0c6900 con 0x7f35ec0714c0 2024-02-17T12:16:29.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3d2a00640 1 --2- 172.21.15.114:0/1254479332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3d40a9420 0x7fe3d415d140 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009a20 tx=0x7fe3c401c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a3845423fea6e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3d2000640 1 -- 172.21.15.114:0/1254479332 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40a9620 con 0x7fe3d40a9420 2024-02-17T12:16:29.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3d2000640 1 -- 172.21.15.114:0/1254479332 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c40a9780 con 0x7fe3d40a9420 2024-02-17T12:16:29.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f35e9400640 1 -- 172.21.15.114:0/745366200 >> v1:172.21.15.116:6789/0 conn(0x7f35ec152d30 legacy=0x7f35ec1531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f35e9400640 1 -- 172.21.15.114:0/745366200 >> v1:172.21.15.114:6789/0 conn(0x7f35ec150300 legacy=0x7f35ec0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f35e9400640 1 -- 172.21.15.114:0/745366200 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec0c2fc0 con 0x7f35ec0714c0 2024-02-17T12:16:29.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3d2000640 1 -- 172.21.15.114:0/1254479332 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40a9620 con 0x7fe3d40a9420 2024-02-17T12:16:29.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fadab400640 1 --2- 172.21.15.114:0/1001513746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac152460 0x7fadac1558c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad980097f0 tx=0x7fad9801c220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7e197f0b7f95a89 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f463fe00640 1 Processor -- start 2024-02-17T12:16:29.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f463fe00640 1 -- start start 2024-02-17T12:16:29.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43816c350 con 0x7ff4380c8df0 2024-02-17T12:16:29.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3da800640 1 -- 172.21.15.114:0/1254479332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3d40a9420 msgr2=0x7fe3d415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3da800640 1 --2- 172.21.15.114:0/1254479332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3d40a9420 0x7fe3d415d140 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009a20 tx=0x7fe3c401c690 comp rx=0 tx=0).stop 2024-02-17T12:16:29.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3da800640 1 -- 172.21.15.114:0/1254479332 shutdown_connections 2024-02-17T12:16:29.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3da800640 1 --2- 172.21.15.114:0/1254479332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 0x7fe3d40c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3da800640 1 --2- 172.21.15.114:0/1254479332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3d40a9420 0x7fe3d415d140 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3da800640 1 -- 172.21.15.114:0/1254479332 >> 172.21.15.114:0/1254479332 conn(0x7fe3d40a8490 msgr2=0x7fe3d40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3da800640 1 -- 172.21.15.114:0/1254479332 shutdown_connections 2024-02-17T12:16:29.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7ff436000640 1 -- 172.21.15.114:0/2977666740 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff4300ac070 con 0x7ff4380c8df0 2024-02-17T12:16:29.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7fe3da800640 1 -- 172.21.15.114:0/1254479332 wait complete. 2024-02-17T12:16:29.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f463fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 0x7f46400c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f463fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f464014e9c0 0x7f46401f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f463fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4640155830 0x7f464013dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f17f7400640 1 -- 172.21.15.114:0/172787546 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f17e80ebec0 con 0x7f18000aa6a0 2024-02-17T12:16:29.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f463fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46401f1b20 con 0x7f46400c1fe0 2024-02-17T12:16:29.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f463fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4640148290 con 0x7f4640155830 2024-02-17T12:16:29.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.524+0000 7f463fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4640148570 con 0x7f464014e9c0 2024-02-17T12:16:29.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 0x7f46400c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 0x7f46400c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57762/0 (socket says 172.21.15.114:57762) 2024-02-17T12:16:29.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463ea00640 1 -- 172.21.15.114:0/1139449638 learned_addr learned my addr 172.21.15.114:0/1139449638 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463e000640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f464014e9c0 0x7f46401f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463f400640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4640155830 0x7f464013dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fadaa000640 1 -- 172.21.15.114:0/1001513746 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada4001a00 con 0x7fadac152460 2024-02-17T12:16:29.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fadaa000640 1 -- 172.21.15.114:0/1001513746 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad980a7050 con 0x7fadac152460 2024-02-17T12:16:29.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fc89ca00640 1 -- 172.21.15.114:0/2780064890 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8900ab600 con 0x7fc8a0156690 2024-02-17T12:16:29.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fc89ca00640 1 -- 172.21.15.114:0/2780064890 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8900a7050 con 0x7fc8a0156690 2024-02-17T12:16:29.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fc89ca00640 1 -- 172.21.15.114:0/2780064890 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8900ab600 con 0x7fc8a0156690 2024-02-17T12:16:29.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7ff436000640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff420066e40 0x7ff420069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7ff436000640 1 -- 172.21.15.114:0/2977666740 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4300aa070 con 0x7ff4380c8df0 2024-02-17T12:16:29.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fadaa000640 1 -- 172.21.15.114:0/1001513746 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada4001a00 con 0x7fadac152460 2024-02-17T12:16:29.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fc8a5000640 1 -- 172.21.15.114:0/2780064890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a0156690 msgr2=0x7fc8a015d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fc8a5000640 1 --2- 172.21.15.114:0/2780064890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a0156690 0x7fc8a015d140 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc890009870 tx=0x7fc89001c490 comp rx=0 tx=0).stop 2024-02-17T12:16:29.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7ff43de00640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff420066e40 0x7ff420069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f97d9400640 1 Processor -- start 2024-02-17T12:16:29.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fc8a5000640 1 -- 172.21.15.114:0/2780064890 shutdown_connections 2024-02-17T12:16:29.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fc8a5000640 1 --2- 172.21.15.114:0/2780064890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a0156690 0x7fc8a015d140 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fc8a5000640 1 -- 172.21.15.114:0/2780064890 >> 172.21.15.114:0/2780064890 conn(0x7fc8a00a8490 msgr2=0x7fc8a00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f35e9400640 1 --2- 172.21.15.114:0/745366200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec0714c0 0x7f35ec156d30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f35d80097f0 tx=0x7f35d801c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c5f351acbb444b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f97d9400640 1 -- start start 2024-02-17T12:16:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463ea00640 1 -- 172.21.15.114:0/1139449638 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f464014e9c0 msgr2=0x7f46401f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463ea00640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f464014e9c0 0x7f46401f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463ea00640 1 -- 172.21.15.114:0/1139449638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4640155830 msgr2=0x7f464013dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fadb2800640 1 -- 172.21.15.114:0/1001513746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac152460 msgr2=0x7fadac1558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fadb2800640 1 --2- 172.21.15.114:0/1001513746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac152460 0x7fadac1558c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad980097f0 tx=0x7fad9801c220 comp rx=0 tx=0).stop 2024-02-17T12:16:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fadb2800640 1 -- 172.21.15.114:0/1001513746 shutdown_connections 2024-02-17T12:16:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fadb2800640 1 --2- 172.21.15.114:0/1001513746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac152460 0x7fadac1558c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fadb2800640 1 -- 172.21.15.114:0/1001513746 >> 172.21.15.114:0/1001513746 conn(0x7fadac0ac1e0 msgr2=0x7fadac0ac5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fc8a5000640 1 -- 172.21.15.114:0/2780064890 shutdown_connections 2024-02-17T12:16:29.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fc8a5000640 1 -- 172.21.15.114:0/2780064890 wait complete. 2024-02-17T12:16:29.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463ea00640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4640155830 0x7f464013dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463ea00640 1 -- 172.21.15.114:0/1139449638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630009420 con 0x7f46400c1fe0 2024-02-17T12:16:29.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463f400640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4640155830 0x7f464013dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fadb2800640 1 -- 172.21.15.114:0/1001513746 shutdown_connections 2024-02-17T12:16:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fadb2800640 1 -- 172.21.15.114:0/1001513746 wait complete. 2024-02-17T12:16:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f463ea00640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 0x7f46400c4f70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46300ae040 tx=0x7f46300191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fe3da800640 1 Processor -- start 2024-02-17T12:16:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f97d9400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d40aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7fe3da800640 1 -- start start 2024-02-17T12:16:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7ff43de00640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff420066e40 0x7ff420069300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff438047190 tx=0x7ff42c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f97d9400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d4155dd0 con 0x7f97d4152540 2024-02-17T12:16:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f97d9400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d41588c0 con 0x7f97d40c6460 2024-02-17T12:16:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f97d9400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4070410 con 0x7f97d406ff80 2024-02-17T12:16:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f97cbe00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f97d40c6460 0x7f97d4154e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:44680/0 (socket says 172.21.15.114:44680) 2024-02-17T12:16:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f97cbe00640 1 -- 172.21.15.114:0/4243708887 learned_addr learned my addr 172.21.15.114:0/4243708887 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f4637400640 1 -- 172.21.15.114:0/1139449638 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46300b4820 con 0x7f46400c1fe0 2024-02-17T12:16:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.528+0000 7f97d3200640 1 --2- 172.21.15.114:0/4243708887 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d40aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f4637400640 1 -- 172.21.15.114:0/1139449638 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46300b4980 con 0x7f46400c1fe0 2024-02-17T12:16:29.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f4637400640 1 -- 172.21.15.114:0/1139449638 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46300b4d30 con 0x7f46400c1fe0 2024-02-17T12:16:29.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fc8a5000640 1 Processor -- start 2024-02-17T12:16:29.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f463fe00640 1 -- 172.21.15.114:0/1139449638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46400c6c70 con 0x7f46400c1fe0 2024-02-17T12:16:29.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f463fe00640 1 -- 172.21.15.114:0/1139449638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46400c54b0 con 0x7f46400c1fe0 2024-02-17T12:16:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f97d1e00640 1 -- 172.21.15.114:0/4243708887 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648180525 0 0) 0x7f97d41588c0 con 0x7f97d40c6460 2024-02-17T12:16:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f97d1e00640 1 -- 172.21.15.114:0/4243708887 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b8003530 con 0x7f97d40c6460 2024-02-17T12:16:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f97d3200640 1 -- 172.21.15.114:0/4243708887 >> v1:172.21.15.116:6789/0 conn(0x7f97d40c6460 legacy=0x7f97d4154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f97d3200640 1 -- 172.21.15.114:0/4243708887 >> v1:172.21.15.114:6789/0 conn(0x7f97d4152540 legacy=0x7f97d4158d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-17T12:16:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadb2800640 1 Processor -- start 2024-02-17T12:16:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadb2800640 1 -- start start 2024-02-17T12:16:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadb2800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadac0c6eb0 0x7fadac1ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7ff436000640 1 -- 172.21.15.114:0/2977666740 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff4300f34b0 con 0x7ff4380c8df0 2024-02-17T12:16:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f463fe00640 1 -- 172.21.15.114:0/1139449638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464004eef0 con 0x7f46400c1fe0 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fe3da800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d40a9420 0x7fe3d41632d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fe3da800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 0x7fe3d41452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fe3da800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3d4156690 0x7fe3d41457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fe3da800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d415da50 con 0x7fe3d4156690 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fe3da800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4162250 con 0x7fe3d40a9420 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fe3da800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d41f2380 con 0x7fe3d40c65a0 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadb2800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac0c8790 0x7fadac157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadb2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadac152460 0x7fadac14af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadb2800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac1581e0 con 0x7fadac152460 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadb2800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac1578a0 con 0x7fadac0c8790 2024-02-17T12:16:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadb2800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac150130 con 0x7fadac0c6eb0 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadaaa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac0c8790 0x7fadac157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadaaa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac0c8790 0x7fadac157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46678/0 (socket says 172.21.15.114:46678) 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadaaa00640 1 -- 172.21.15.114:0/3481497204 learned_addr learned my addr 172.21.15.114:0/3481497204 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadab400640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadac0c6eb0 0x7fadac1ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadaaa00640 1 -- 172.21.15.114:0/3481497204 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadac0c6eb0 msgr2=0x7fadac1ef1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadaaa00640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadac0c6eb0 0x7fadac1ef1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadaaa00640 1 -- 172.21.15.114:0/3481497204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadac152460 msgr2=0x7fadac14af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadaaa00640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadac152460 0x7fadac14af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadaaa00640 1 -- 172.21.15.114:0/3481497204 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980094d0 con 0x7fadac0c8790 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f35e8a00640 1 -- 172.21.15.114:0/745366200 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d80ab600 con 0x7f35ec0714c0 2024-02-17T12:16:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f35e8a00640 1 -- 172.21.15.114:0/745366200 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d80a7050 con 0x7f35ec0714c0 2024-02-17T12:16:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f35e8a00640 1 -- 172.21.15.114:0/745366200 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d80ab980 con 0x7f35ec0714c0 2024-02-17T12:16:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fc8a5000640 1 -- start start 2024-02-17T12:16:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fc8a5000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8a00a9420 0x7fc8a0072a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fc8a5000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc8a00c65a0 0x7fc8a0070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fc8a5000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a0156690 0x7fc8a01553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fadab400640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadac0c6eb0 0x7fadac1ef1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:29.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7f97d3200640 1 -- 172.21.15.114:0/4243708887 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4155540 con 0x7f97d406ff80 2024-02-17T12:16:29.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fc89d400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc8a00c65a0 0x7fc8a0070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.532+0000 7fc89d400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc8a00c65a0 0x7fc8a0070cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34636/0 (socket says 172.21.15.114:34636) 2024-02-17T12:16:29.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fe3d2a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 0x7fe3d41452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fe3d2a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 0x7fe3d41452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34646/0 (socket says 172.21.15.114:34646) 2024-02-17T12:16:29.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fe3d2a00640 1 -- 172.21.15.114:0/2715268772 learned_addr learned my addr 172.21.15.114:0/2715268772 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f35f1000640 1 -- 172.21.15.114:0/745366200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec0714c0 msgr2=0x7f35ec156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f35f1000640 1 --2- 172.21.15.114:0/745366200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec0714c0 0x7f35ec156d30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f35d80097f0 tx=0x7f35d801c2e0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fe3d3400640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d40a9420 0x7fe3d41632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f35f1000640 1 -- 172.21.15.114:0/745366200 shutdown_connections 2024-02-17T12:16:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f35f1000640 1 --2- 172.21.15.114:0/745366200 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec0714c0 0x7f35ec156d30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f35f1000640 1 -- 172.21.15.114:0/745366200 >> 172.21.15.114:0/745366200 conn(0x7f35ec0c4f20 msgr2=0x7f35ec0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fe3d3e00640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3d4156690 0x7fe3d41457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f35f1000640 1 -- 172.21.15.114:0/745366200 shutdown_connections 2024-02-17T12:16:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f35f1000640 1 -- 172.21.15.114:0/745366200 wait complete. 2024-02-17T12:16:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc89de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8a00a9420 0x7fc8a0072a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc89de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8a00a9420 0x7fc8a0072a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57772/0 (socket says 172.21.15.114:57772) 2024-02-17T12:16:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fadaaa00640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac0c8790 0x7fadac157ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fada400cac0 tx=0x7fada400cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc8a5000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0072590 con 0x7fc8a00a9420 2024-02-17T12:16:29.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc8a5000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a01f2a10 con 0x7fc8a0156690 2024-02-17T12:16:29.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc8a5000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0158fd0 con 0x7fc8a00c65a0 2024-02-17T12:16:29.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc89d400640 1 -- 172.21.15.114:0/1379355277 learned_addr learned my addr 172.21.15.114:0/1379355277 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fe3d3400640 1 -- 172.21.15.114:0/2715268772 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 msgr2=0x7fe3d41452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fe3d3400640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 0x7fe3d41452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fe3d3400640 1 -- 172.21.15.114:0/2715268772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3d4156690 msgr2=0x7fe3d41457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fe3d3400640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3d4156690 0x7fe3d41457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fe3d3400640 1 -- 172.21.15.114:0/2715268772 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c4009420 con 0x7fe3d40a9420 2024-02-17T12:16:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fada3400640 1 -- 172.21.15.114:0/3481497204 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada400a700 con 0x7fadac0c8790 2024-02-17T12:16:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d3200640 1 --2- 172.21.15.114:0/4243708887 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d40aa160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009dc0 tx=0x7f97cc01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef7cf5e82c21de4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc89e800640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a0156690 0x7fc8a01553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f4637400640 1 -- 172.21.15.114:0/1139449638 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f46300b2040 con 0x7f46400c1fe0 2024-02-17T12:16:29.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d1e00640 1 -- 172.21.15.114:0/4243708887 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0a5800 con 0x7f97d406ff80 2024-02-17T12:16:29.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d1e00640 1 -- 172.21.15.114:0/4243708887 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc0a5960 con 0x7f97d406ff80 2024-02-17T12:16:29.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d1e00640 1 -- 172.21.15.114:0/4243708887 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0a5cf0 con 0x7f97d406ff80 2024-02-17T12:16:29.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc89d400640 1 -- 172.21.15.114:0/1379355277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a0156690 msgr2=0x7fc8a01553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc89d400640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a0156690 0x7fc8a01553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc89d400640 1 -- 172.21.15.114:0/1379355277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8a00a9420 msgr2=0x7fc8a0072a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc89d400640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8a00a9420 0x7fc8a0072a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc89d400640 1 -- 172.21.15.114:0/1379355277 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8900094d0 con 0x7fc8a00c65a0 2024-02-17T12:16:29.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fc89e800640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a0156690 0x7fc8a01553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:29.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d9400640 1 -- 172.21.15.114:0/4243708887 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 msgr2=0x7f97d40aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d9400640 1 --2- 172.21.15.114:0/4243708887 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d40aa160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009dc0 tx=0x7f97cc01c830 comp rx=0 tx=0).stop 2024-02-17T12:16:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d9400640 1 -- 172.21.15.114:0/4243708887 shutdown_connections 2024-02-17T12:16:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d9400640 1 --2- 172.21.15.114:0/4243708887 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d40aa160 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d9400640 1 -- 172.21.15.114:0/4243708887 >> 172.21.15.114:0/4243708887 conn(0x7f97d40c4f20 msgr2=0x7f97d40c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f35f1000640 1 Processor -- start 2024-02-17T12:16:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f4637400640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4620066f10 0x7f46200693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f4637400640 1 -- 172.21.15.114:0/1139449638 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f463011ee50 con 0x7f46400c1fe0 2024-02-17T12:16:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f35f1000640 1 -- start start 2024-02-17T12:16:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d9400640 1 -- 172.21.15.114:0/4243708887 shutdown_connections 2024-02-17T12:16:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7f97d9400640 1 -- 172.21.15.114:0/4243708887 wait complete. 2024-02-17T12:16:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d9400640 1 Processor -- start 2024-02-17T12:16:29.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d9400640 1 -- start start 2024-02-17T12:16:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35f1000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35ec0714c0 0x7f35ec1f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35f1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35ec150300 0x7f35ec1554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d9400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35f1000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec152d30 0x7f35ec0ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35e9e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35ec0714c0 0x7f35ec1f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fada3400640 1 -- 172.21.15.114:0/3481497204 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada400a860 con 0x7fadac0c8790 2024-02-17T12:16:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fada3400640 1 -- 172.21.15.114:0/3481497204 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada400ac10 con 0x7fadac0c8790 2024-02-17T12:16:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fadb2800640 1 -- 172.21.15.114:0/3481497204 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadac1561b0 con 0x7fadac0c8790 2024-02-17T12:16:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.536+0000 7fadb2800640 1 -- 172.21.15.114:0/3481497204 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadac14fdc0 con 0x7fadac0c8790 2024-02-17T12:16:29.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7fada0c00640 1 -- 172.21.15.114:0/3481497204 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad840052a0 con 0x7fadac0c8790 2024-02-17T12:16:29.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7fe3d3400640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d40a9420 0x7fe3d41632d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00cbf0 tx=0x7fe3cc00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7fe3cb400640 1 -- 172.21.15.114:0/2715268772 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00aca0 con 0x7fe3d40a9420 2024-02-17T12:16:29.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7fe3cb400640 1 -- 172.21.15.114:0/2715268772 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00ae00 con 0x7fe3d40a9420 2024-02-17T12:16:29.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35e9e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35ec0714c0 0x7f35ec1f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46698/0 (socket says 172.21.15.114:46698) 2024-02-17T12:16:29.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7fe3cb400640 1 -- 172.21.15.114:0/2715268772 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc012640 con 0x7fe3d40a9420 2024-02-17T12:16:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35e9e00640 1 -- 172.21.15.114:0/318330856 learned_addr learned my addr 172.21.15.114:0/318330856 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35f1000640 1 -- 172.21.15.114:0/318330856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec1f20c0 con 0x7f35ec150300 2024-02-17T12:16:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35f1000640 1 -- 172.21.15.114:0/318330856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec1f5370 con 0x7f35ec0714c0 2024-02-17T12:16:29.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35ea800640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec152d30 0x7f35ec0ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d40c6460 0x7f97d4150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d9400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4152540 0x7f97d41505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d9400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d414e770 con 0x7f97d40c6460 2024-02-17T12:16:29.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35f1000640 1 -- 172.21.15.114:0/318330856 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec1f25f0 con 0x7f35ec152d30 2024-02-17T12:16:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d9400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d414ef40 con 0x7f97d4152540 2024-02-17T12:16:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d9400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d414d510 con 0x7f97d406ff80 2024-02-17T12:16:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d2800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d2800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d415a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34654/0 (socket says 172.21.15.114:34654) 2024-02-17T12:16:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d2800640 1 -- 172.21.15.114:0/1281499892 learned_addr learned my addr 172.21.15.114:0/1281499892 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f463e000640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4620066f10 0x7f46200693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f97d3200640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4152540 0x7f97d41505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35e9e00640 1 -- 172.21.15.114:0/318330856 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec152d30 msgr2=0x7f35ec0ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35e9e00640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec152d30 0x7f35ec0ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35e9e00640 1 -- 172.21.15.114:0/318330856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35ec150300 msgr2=0x7f35ec1554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35e9e00640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35ec150300 0x7f35ec1554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.540+0000 7f35e9e00640 1 -- 172.21.15.114:0/318330856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d8009420 con 0x7f35ec0714c0 2024-02-17T12:16:29.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f35e9e00640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35ec0714c0 0x7f35ec1f5800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35dc00c7b0 tx=0x7f35dc00cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97d2800640 1 -- 172.21.15.114:0/1281499892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4152540 msgr2=0x7f97d41505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97d2800640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4152540 0x7f97d41505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97d2800640 1 -- 172.21.15.114:0/1281499892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d40c6460 msgr2=0x7f97d4150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97d2800640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d40c6460 0x7f97d4150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97d2800640 1 -- 172.21.15.114:0/1281499892 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009a70 con 0x7f97d406ff80 2024-02-17T12:16:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97d2800640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d415a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f97c400c490 tx=0x7f97c4001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f463e000640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4620066f10 0x7f46200693d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f464006b490 tx=0x7f462c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fe3da800640 1 -- 172.21.15.114:0/2715268772 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d40c3500 con 0x7fe3d40a9420 2024-02-17T12:16:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fe3da800640 1 -- 172.21.15.114:0/2715268772 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d415dca0 con 0x7fe3d40a9420 2024-02-17T12:16:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97caa00640 1 -- 172.21.15.114:0/1281499892 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4003600 con 0x7f97d406ff80 2024-02-17T12:16:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97caa00640 1 -- 172.21.15.114:0/1281499892 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c4003780 con 0x7f97d406ff80 2024-02-17T12:16:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97caa00640 1 -- 172.21.15.114:0/1281499892 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4003b70 con 0x7f97d406ff80 2024-02-17T12:16:29.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97d9400640 1 -- 172.21.15.114:0/1281499892 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d414e980 con 0x7f97d406ff80 2024-02-17T12:16:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fc89d400640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc8a00c65a0 0x7fc8a0070cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c3c0 tx=0x7fc88c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fc896000640 1 -- 172.21.15.114:0/1379355277 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c0052d0 con 0x7fc8a00c65a0 2024-02-17T12:16:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fc896000640 1 -- 172.21.15.114:0/1379355277 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c005430 con 0x7fc8a00c65a0 2024-02-17T12:16:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fc896000640 1 -- 172.21.15.114:0/1379355277 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c003840 con 0x7fc8a00c65a0 2024-02-17T12:16:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fc8a5000640 1 -- 172.21.15.114:0/1379355277 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a01594e0 con 0x7fc8a00c65a0 2024-02-17T12:16:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fc8a5000640 1 -- 172.21.15.114:0/1379355277 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a01f2630 con 0x7fc8a00c65a0 2024-02-17T12:16:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fc8a5000640 1 -- 172.21.15.114:0/1379355277 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8780052a0 con 0x7fc8a00c65a0 2024-02-17T12:16:29.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7f97d9400640 1 -- 172.21.15.114:0/1281499892 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d4160480 con 0x7f97d406ff80 2024-02-17T12:16:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7fc896000640 1 -- 172.21.15.114:0/1379355277 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fc88c0039a0 con 0x7fc8a00c65a0 2024-02-17T12:16:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fada3400640 1 -- 172.21.15.114:0/3481497204 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fada4007070 con 0x7fadac0c8790 2024-02-17T12:16:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.544+0000 7fada3400640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad8c066e90 0x7fad8c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7fada3400640 1 -- 172.21.15.114:0/3481497204 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fada40848c0 con 0x7fadac0c8790 2024-02-17T12:16:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7fadab400640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad8c066e90 0x7fad8c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7fe3c8c00640 1 -- 172.21.15.114:0/2715268772 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a80052a0 con 0x7fe3d40a9420 2024-02-17T12:16:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7f97d9400640 1 -- 172.21.15.114:0/1281499892 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d414fda0 con 0x7f97d406ff80 2024-02-17T12:16:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7f35e2000640 1 -- 172.21.15.114:0/318330856 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0072d0 con 0x7f35ec0714c0 2024-02-17T12:16:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7f35e2000640 1 -- 172.21.15.114:0/318330856 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc007430 con 0x7f35ec0714c0 2024-02-17T12:16:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7f35e2000640 1 -- 172.21.15.114:0/318330856 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0047f0 con 0x7f35ec0714c0 2024-02-17T12:16:29.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7fc896000640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc880066f10 0x7fc8800693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7fada3400640 1 -- 172.21.15.114:0/3481497204 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fada4051820 con 0x7fadac0c8790 2024-02-17T12:16:29.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7f97caa00640 1 -- 172.21.15.114:0/1281499892 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f97c4003cd0 con 0x7f97d406ff80 2024-02-17T12:16:29.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7fadab400640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad8c066e90 0x7fad8c069350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad980ad000 tx=0x7fad980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7fc896000640 1 -- 172.21.15.114:0/1379355277 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc88c083e90 con 0x7fc8a00c65a0 2024-02-17T12:16:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7f35f1000640 1 -- 172.21.15.114:0/318330856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec1f2310 con 0x7f35ec0714c0 2024-02-17T12:16:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7f35f1000640 1 -- 172.21.15.114:0/318330856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec1f5000 con 0x7f35ec0714c0 2024-02-17T12:16:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7fc89de00640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc880066f10 0x7fc8800693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7fc89de00640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc880066f10 0x7fc8800693d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8900ad000 tx=0x7fc8900a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7f97caa00640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f97b0066e70 0x7f97b0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.548+0000 7f97caa00640 1 -- 172.21.15.114:0/1281499892 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97c4083b80 con 0x7f97d406ff80 2024-02-17T12:16:29.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7fe3cb400640 1 -- 172.21.15.114:0/2715268772 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe3cc007070 con 0x7fe3d40a9420 2024-02-17T12:16:29.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7f35d7400640 1 -- 172.21.15.114:0/318330856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ec074840 con 0x7f35ec0714c0 2024-02-17T12:16:29.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7f4637400640 1 -- 172.21.15.114:0/1139449638 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f46300ebd60 con 0x7f46400c1fe0 2024-02-17T12:16:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7f97cbe00640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f97b0066e70 0x7f97b0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7fe3cb400640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe3b4066e40 0x7fe3b4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7fe3cb400640 1 -- 172.21.15.114:0/2715268772 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3cc084da0 con 0x7fe3d40a9420 2024-02-17T12:16:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7fc896000640 1 -- 172.21.15.114:0/1379355277 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc88c050da0 con 0x7fc8a00c65a0 2024-02-17T12:16:29.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7f97cbe00640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f97b0066e70 0x7f97b0069330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97bc007fd0 tx=0x7f97bc007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7fe3d2a00640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe3b4066e40 0x7fe3b4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7fe3d2a00640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe3b4066e40 0x7fe3b4069300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009a20 tx=0x7fe3c40b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.552+0000 7fe3cb400640 1 -- 172.21.15.114:0/2715268772 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe3cc051cb0 con 0x7fe3d40a9420 2024-02-17T12:16:29.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.556+0000 7f35e2000640 1 -- 172.21.15.114:0/318330856 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f35dc00a5e0 con 0x7f35ec0714c0 2024-02-17T12:16:29.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.556+0000 7f97caa00640 1 -- 172.21.15.114:0/1281499892 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f97d414fda0 con 0x7f97d406ff80 2024-02-17T12:16:29.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.556+0000 7f35e2000640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35cc066e90 0x7f35cc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:29.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.556+0000 7f35e2000640 1 -- 172.21.15.114:0/318330856 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35dc0844e0 con 0x7f35ec0714c0 2024-02-17T12:16:29.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.560+0000 7f35e2000640 1 -- 172.21.15.114:0/318330856 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f35dc051460 con 0x7f35ec0714c0 2024-02-17T12:16:29.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.560+0000 7f35e9400640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35cc066e90 0x7f35cc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:29.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.560+0000 7f35e9400640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35cc066e90 0x7f35cc069350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35d80ad000 tx=0x7f35d8004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:29.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.852+0000 7f1806800640 1 -- 172.21.15.114:0/172787546 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f17d4005550 con 0x7f18000aa6a0 2024-02-17T12:16:29.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.856+0000 7f17f7400640 1 -- 172.21.15.114:0/172787546 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17e8006e20 con 0x7f18000aa6a0 2024-02-17T12:16:29.861 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-02-17T12:16:29.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 -- 172.21.15.114:0/172787546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f17dc066ec0 msgr2=0x7f17dc069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f17dc066ec0 0x7f17dc069380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f17f00099a0 tx=0x7f17f00090e0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 -- 172.21.15.114:0/172787546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18000aa6a0 msgr2=0x7f18001f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18000aa6a0 0x7f18001f58c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17e80ab000 tx=0x7f17e801ac50 comp rx=0 tx=0).stop 2024-02-17T12:16:29.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 -- 172.21.15.114:0/172787546 shutdown_connections 2024-02-17T12:16:29.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f17dc066ec0 0x7f17dc069380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1800150300 0x7f18001f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f18000aa6a0 0x7f18001f58c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 --2- 172.21.15.114:0/172787546 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18000714c0 0x7f180014a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 -- 172.21.15.114:0/172787546 >> 172.21.15.114:0/172787546 conn(0x7f18000c4f20 msgr2=0x7f18000a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 -- 172.21.15.114:0/172787546 shutdown_connections 2024-02-17T12:16:29.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.864+0000 7f1806800640 1 -- 172.21.15.114:0/172787546 wait complete. 2024-02-17T12:16:29.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.876+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4380057f0 con 0x7ff4380c8df0 2024-02-17T12:16:29.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.880+0000 7fada0c00640 1 -- 172.21.15.114:0/3481497204 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fad84005820 con 0x7fadac0c8790 2024-02-17T12:16:29.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.880+0000 7fada3400640 1 -- 172.21.15.114:0/3481497204 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fada4054ee0 con 0x7fadac0c8790 2024-02-17T12:16:29.883 INFO:teuthology.orchestra.run.smithi114.stdout:60129542149 2024-02-17T12:16:29.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.880+0000 7f35d7400640 1 -- 172.21.15.114:0/318330856 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f35ec0712a0 con 0x7f35ec0714c0 2024-02-17T12:16:29.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.880+0000 7ff436000640 1 -- 172.21.15.114:0/2977666740 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4300c2090 con 0x7ff4380c8df0 2024-02-17T12:16:29.885 INFO:teuthology.orchestra.run.smithi114.stdout:60129542150 2024-02-17T12:16:29.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7f35e2000640 1 -- 172.21.15.114:0/318330856 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35dc018020 con 0x7f35ec0714c0 2024-02-17T12:16:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 -- 172.21.15.114:0/3481497204 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad8c066e90 msgr2=0x7fad8c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad8c066e90 0x7fad8c069350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad980ad000 tx=0x7fad980a6000 comp rx=0 tx=0).stop 2024-02-17T12:16:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 -- 172.21.15.114:0/3481497204 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac0c8790 msgr2=0x7fadac157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac0c8790 0x7fadac157ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fada400cac0 tx=0x7fada400cf80 comp rx=0 tx=0).stop 2024-02-17T12:16:29.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 -- 172.21.15.114:0/3481497204 shutdown_connections 2024-02-17T12:16:29.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad8c066e90 0x7fad8c069350 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadac152460 0x7fadac14af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadac0c8790 0x7fadac157ca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 --2- 172.21.15.114:0/3481497204 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadac0c6eb0 0x7fadac1ef1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 -- 172.21.15.114:0/3481497204 >> 172.21.15.114:0/3481497204 conn(0x7fadac0ac1e0 msgr2=0x7fadac14ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 -- 172.21.15.114:0/3481497204 shutdown_connections 2024-02-17T12:16:29.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7fada0c00640 1 -- 172.21.15.114:0/3481497204 wait complete. 2024-02-17T12:16:29.889 INFO:teuthology.orchestra.run.smithi114.stdout:64424509446 2024-02-17T12:16:29.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7f97d9400640 1 -- 172.21.15.114:0/1281499892 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97d414fda0 con 0x7f97d406ff80 2024-02-17T12:16:29.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.884+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff420066e40 msgr2=0x7ff420069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff420066e40 0x7ff420069300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff438047190 tx=0x7ff42c008040 comp rx=0 tx=0).stop 2024-02-17T12:16:29.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4380c8df0 msgr2=0x7ff43804ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4380c8df0 0x7ff43804ac10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff430001ec0 tx=0x7ff4300198c0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f97caa00640 1 -- 172.21.15.114:0/1281499892 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97d414fda0 con 0x7f97d406ff80 2024-02-17T12:16:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 shutdown_connections 2024-02-17T12:16:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff43802da30 0x7ff43816ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4380c8df0 0x7ff43804ac10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff420066e40 0x7ff420069300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 --2- 172.21.15.114:0/2977666740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff438031770 0x7ff438032070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 >> 172.21.15.114:0/2977666740 conn(0x7ff438049370 msgr2=0x7ff4380d1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.891 INFO:teuthology.orchestra.run.smithi114.stdout:64424509445 2024-02-17T12:16:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f463fe00640 1 -- 172.21.15.114:0/1139449638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4640074620 con 0x7f46400c1fe0 2024-02-17T12:16:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 shutdown_connections 2024-02-17T12:16:29.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7fe3c8c00640 1 -- 172.21.15.114:0/2715268772 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe3a8005820 con 0x7fe3d40a9420 2024-02-17T12:16:29.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7fc8a5000640 1 -- 172.21.15.114:0/1379355277 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc878005550 con 0x7fc8a00c65a0 2024-02-17T12:16:29.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7ff43f200640 1 -- 172.21.15.114:0/2977666740 wait complete. 2024-02-17T12:16:29.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f4637400640 1 -- 172.21.15.114:0/1139449638 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4630120020 con 0x7f46400c1fe0 2024-02-17T12:16:29.894 INFO:teuthology.orchestra.run.smithi114.stdout:60129542151 2024-02-17T12:16:29.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7fe3cb400640 1 -- 172.21.15.114:0/2715268772 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3cc017020 con 0x7fe3d40a9420 2024-02-17T12:16:29.894 INFO:teuthology.orchestra.run.smithi114.stdout:64424509445 2024-02-17T12:16:29.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7fc896000640 1 -- 172.21.15.114:0/1379355277 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc88c054460 con 0x7fc8a00c65a0 2024-02-17T12:16:29.895 INFO:teuthology.orchestra.run.smithi114.stdout:64424509445 2024-02-17T12:16:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f35d7400640 1 -- 172.21.15.114:0/318330856 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35cc066e90 msgr2=0x7f35cc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f35d7400640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35cc066e90 0x7f35cc069350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f35d80ad000 tx=0x7f35d8004740 comp rx=0 tx=0).stop 2024-02-17T12:16:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f35d7400640 1 -- 172.21.15.114:0/318330856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35ec0714c0 msgr2=0x7f35ec1f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f35d7400640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35ec0714c0 0x7f35ec1f5800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35dc00c7b0 tx=0x7f35dc00cc70 comp rx=0 tx=0).stop 2024-02-17T12:16:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f35d7400640 1 -- 172.21.15.114:0/318330856 shutdown_connections 2024-02-17T12:16:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f35d7400640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35ec152d30 0x7f35ec0ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f35d7400640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35cc066e90 0x7f35cc069350 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f35d7400640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35ec150300 0x7f35ec1554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f35d7400640 1 --2- 172.21.15.114:0/318330856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35ec0714c0 0x7f35ec1f5800 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f35dc00c7b0 tx=0x7f35dc00cc70 comp rx=0 tx=0).stop 2024-02-17T12:16:29.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.888+0000 7f35d7400640 1 -- 172.21.15.114:0/318330856 >> 172.21.15.114:0/318330856 conn(0x7f35ec0c4f20 msgr2=0x7f35ec06d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f35d7400640 1 -- 172.21.15.114:0/318330856 shutdown_connections 2024-02-17T12:16:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 -- 172.21.15.114:0/1281499892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f97b0066e70 msgr2=0x7f97b0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f97b0066e70 0x7f97b0069330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97bc007fd0 tx=0x7f97bc007900 comp rx=0 tx=0).stop 2024-02-17T12:16:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 -- 172.21.15.114:0/1281499892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 msgr2=0x7f97d415a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d415a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f97c400c490 tx=0x7f97c4001e80 comp rx=0 tx=0).stop 2024-02-17T12:16:29.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f35d7400640 1 -- 172.21.15.114:0/318330856 wait complete. 2024-02-17T12:16:29.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 -- 172.21.15.114:0/1281499892 shutdown_connections 2024-02-17T12:16:29.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97d4152540 0x7f97d41505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f97b0066e70 0x7f97b0069330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d40c6460 0x7f97d4150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 --2- 172.21.15.114:0/1281499892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97d406ff80 0x7f97d415a2e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 -- 172.21.15.114:0/1281499892 >> 172.21.15.114:0/1281499892 conn(0x7f97d40c4f20 msgr2=0x7f97d40705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 -- 172.21.15.114:0/1281499892 shutdown_connections 2024-02-17T12:16:29.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f97d9400640 1 -- 172.21.15.114:0/1281499892 wait complete. 2024-02-17T12:16:29.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 -- 172.21.15.114:0/1379355277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc880066f10 msgr2=0x7fc8800693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc880066f10 0x7fc8800693d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8900ad000 tx=0x7fc8900a6000 comp rx=0 tx=0).stop 2024-02-17T12:16:29.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 -- 172.21.15.114:0/1379355277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc8a00c65a0 msgr2=0x7fc8a0070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc8a00c65a0 0x7fc8a0070cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c3c0 tx=0x7fc88c00c880 comp rx=0 tx=0).stop 2024-02-17T12:16:29.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fe3c8c00640 1 -- 172.21.15.114:0/2715268772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe3b4066e40 msgr2=0x7fe3b4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fe3c8c00640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe3b4066e40 0x7fe3b4069300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009a20 tx=0x7fe3c40b3040 comp rx=0 tx=0).stop 2024-02-17T12:16:29.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fe3c8c00640 1 -- 172.21.15.114:0/2715268772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d40a9420 msgr2=0x7fe3d41632d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fe3c8c00640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d40a9420 0x7fe3d41632d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00cbf0 tx=0x7fe3cc00a060 comp rx=0 tx=0).stop 2024-02-17T12:16:29.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f463fe00640 1 -- 172.21.15.114:0/1139449638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4620066f10 msgr2=0x7f46200693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f463fe00640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4620066f10 0x7f46200693d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f464006b490 tx=0x7f462c009040 comp rx=0 tx=0).stop 2024-02-17T12:16:29.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f463fe00640 1 -- 172.21.15.114:0/1139449638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 msgr2=0x7f46400c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:29.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f463fe00640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 0x7f46400c4f70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46300ae040 tx=0x7f46300191d0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f463fe00640 1 -- 172.21.15.114:0/1139449638 shutdown_connections 2024-02-17T12:16:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f463fe00640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4640155830 0x7f464013dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f463fe00640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f464014e9c0 0x7f46401f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f463fe00640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4620066f10 0x7f46200693d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f463fe00640 1 --2- 172.21.15.114:0/1139449638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46400c1fe0 0x7f46400c4f70 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46300ae040 tx=0x7f46300191d0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7f463fe00640 1 -- 172.21.15.114:0/1139449638 >> 172.21.15.114:0/1139449638 conn(0x7f464006c320 msgr2=0x7f4640071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fe3c8c00640 1 -- 172.21.15.114:0/2715268772 shutdown_connections 2024-02-17T12:16:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fe3c8c00640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe3b4066e40 0x7fe3b4069300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fe3c8c00640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3d4156690 0x7fe3d41457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fe3c8c00640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe3d40c65a0 0x7fe3d41452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fe3c8c00640 1 --2- 172.21.15.114:0/2715268772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe3d40a9420 0x7fe3d41632d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fe3c8c00640 1 -- 172.21.15.114:0/2715268772 >> 172.21.15.114:0/2715268772 conn(0x7fe3d40a8490 msgr2=0x7fe3d40c49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 -- 172.21.15.114:0/1379355277 shutdown_connections 2024-02-17T12:16:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8a0156690 0x7fc8a01553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc8a00c65a0 0x7fc8a0070cd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc880066f10 0x7fc8800693d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 --2- 172.21.15.114:0/1379355277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8a00a9420 0x7fc8a0072a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 -- 172.21.15.114:0/1379355277 >> 172.21.15.114:0/1379355277 conn(0x7fc8a00a8490 msgr2=0x7fc8a00c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 -- 172.21.15.114:0/1379355277 shutdown_connections 2024-02-17T12:16:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.892+0000 7fc8a5000640 1 -- 172.21.15.114:0/1379355277 wait complete. 2024-02-17T12:16:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.896+0000 7fe3c8c00640 1 -- 172.21.15.114:0/2715268772 shutdown_connections 2024-02-17T12:16:29.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.896+0000 7fe3c8c00640 1 -- 172.21.15.114:0/2715268772 wait complete. 2024-02-17T12:16:29.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.896+0000 7f463fe00640 1 -- 172.21.15.114:0/1139449638 shutdown_connections 2024-02-17T12:16:29.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:29.896+0000 7f463fe00640 1 -- 172.21.15.114:0/1139449638 wait complete. 2024-02-17T12:16:29.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-02-17T12:16:29.905 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:29.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-02-17T12:16:29.921 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:29.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-02-17T12:16:29.937 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:29.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-02-17T12:16:29.941 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:29.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2024-02-17T12:16:29.942 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:29.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-02-17T12:16:29.943 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:29.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.5 2024-02-17T12:16:29.944 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:29.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-02-17T12:16:29.946 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:29.947 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-17T12:16:29.947 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:16:30.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f3711400640 1 Processor -- start 2024-02-17T12:16:30.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f3711400640 1 -- start start 2024-02-17T12:16:30.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f3711400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f370c0c25a0 0x7f370c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f3711400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f370c152c50 0x7f370c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f3711400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c156270 con 0x7f370c06db50 2024-02-17T12:16:30.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f3711400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c071630 con 0x7f370c152c50 2024-02-17T12:16:30.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f3711400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c156550 con 0x7f370c0c25a0 2024-02-17T12:16:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f3709e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f370c06db50 0x7f370c14ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45550/0 (socket says 172.21.15.114:45550) 2024-02-17T12:16:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f3709e00640 1 -- 172.21.15.114:0/388183232 learned_addr learned my addr 172.21.15.114:0/388183232 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f370b200640 1 --2- 172.21.15.114:0/388183232 >> v2:172.21.15.114:3300/0 conn(0x7f370c152c50 0x7f370c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f370a800640 1 --2- 172.21.15.114:0/388183232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f370c0c25a0 0x7f370c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f370b200640 1 -- 172.21.15.114:0/388183232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f370c0c25a0 msgr2=0x7f370c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f370b200640 1 --2- 172.21.15.114:0/388183232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f370c0c25a0 0x7f370c06e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f370b200640 1 -- 172.21.15.114:0/388183232 >> v1:172.21.15.114:6789/0 conn(0x7f370c06db50 legacy=0x7f370c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f370b200640 1 -- 172.21.15.114:0/388183232 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c156830 con 0x7f370c152c50 2024-02-17T12:16:30.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.124+0000 7f370a800640 1 --2- 172.21.15.114:0/388183232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f370c0c25a0 0x7f370c06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f370b200640 1 --2- 172.21.15.114:0/388183232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c152c50 0x7f370c1530e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3704009d90 tx=0x7f370401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481fb87e14951f00 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3709400640 1 -- 172.21.15.114:0/388183232 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37040a5800 con 0x7f370c152c50 2024-02-17T12:16:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3709400640 1 -- 172.21.15.114:0/388183232 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37040a5960 con 0x7f370c152c50 2024-02-17T12:16:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3709400640 1 -- 172.21.15.114:0/388183232 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37040a5cf0 con 0x7f370c152c50 2024-02-17T12:16:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3711400640 1 -- 172.21.15.114:0/388183232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c152c50 msgr2=0x7f370c1530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3711400640 1 --2- 172.21.15.114:0/388183232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c152c50 0x7f370c1530e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3704009d90 tx=0x7f370401c820 comp rx=0 tx=0).stop 2024-02-17T12:16:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3711400640 1 -- 172.21.15.114:0/388183232 shutdown_connections 2024-02-17T12:16:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3711400640 1 --2- 172.21.15.114:0/388183232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c152c50 0x7f370c1530e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3711400640 1 --2- 172.21.15.114:0/388183232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f370c0c25a0 0x7f370c06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3711400640 1 -- 172.21.15.114:0/388183232 >> 172.21.15.114:0/388183232 conn(0x7f370c0a8490 msgr2=0x7f370c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3711400640 1 -- 172.21.15.114:0/388183232 shutdown_connections 2024-02-17T12:16:30.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.128+0000 7f3711400640 1 -- 172.21.15.114:0/388183232 wait complete. 2024-02-17T12:16:30.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 Processor -- start 2024-02-17T12:16:30.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 -- start start 2024-02-17T12:16:30.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f370c06db50 0x7f370c1ee230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c0c25a0 0x7f370c140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f370c152c50 0x7f370c1f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c142890 con 0x7f370c0c25a0 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c1ee770 con 0x7f370c06db50 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c140f70 con 0x7f370c152c50 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3709e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c0c25a0 0x7f370c140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3709e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c0c25a0 0x7f370c140a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57840/0 (socket says 172.21.15.114:57840) 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3709e00640 1 -- 172.21.15.114:0/3333833935 learned_addr learned my addr 172.21.15.114:0/3333833935 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3709e00640 1 -- 172.21.15.114:0/3333833935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f370c152c50 msgr2=0x7f370c1f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3709e00640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f370c152c50 0x7f370c1f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3709e00640 1 -- 172.21.15.114:0/3333833935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f370c06db50 msgr2=0x7f370c1ee230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3709e00640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f370c06db50 0x7f370c1ee230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3709e00640 1 -- 172.21.15.114:0/3333833935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704009a70 con 0x7f370c0c25a0 2024-02-17T12:16:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3709e00640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c0c25a0 0x7f370c140a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c480 tx=0x7f36f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3702a00640 1 -- 172.21.15.114:0/3333833935 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8005cf0 con 0x7f370c0c25a0 2024-02-17T12:16:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3702a00640 1 -- 172.21.15.114:0/3333833935 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f8005e50 con 0x7f370c0c25a0 2024-02-17T12:16:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3702a00640 1 -- 172.21.15.114:0/3333833935 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8007290 con 0x7f370c0c25a0 2024-02-17T12:16:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 -- 172.21.15.114:0/3333833935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c1f0ec0 con 0x7f370c0c25a0 2024-02-17T12:16:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 -- 172.21.15.114:0/3333833935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c1425b0 con 0x7f370c0c25a0 2024-02-17T12:16:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.132+0000 7f3711400640 1 -- 172.21.15.114:0/3333833935 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c1f0d20 con 0x7f370c0c25a0 2024-02-17T12:16:30.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.136+0000 7f3702a00640 1 -- 172.21.15.114:0/3333833935 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f36f80073f0 con 0x7f370c0c25a0 2024-02-17T12:16:30.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.136+0000 7f3702a00640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f36ec066e40 0x7f36ec069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.136+0000 7f3702a00640 1 -- 172.21.15.114:0/3333833935 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36f8083ef0 con 0x7f370c0c25a0 2024-02-17T12:16:30.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.136+0000 7f370a800640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f36ec066e40 0x7f36ec069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.136+0000 7f370a800640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f36ec066e40 0x7f36ec069300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f370c1eb5f0 tx=0x7f36fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:30.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.140+0000 7f3702a00640 1 -- 172.21.15.114:0/3333833935 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f370c1f0d20 con 0x7f370c0c25a0 2024-02-17T12:16:30.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.292+0000 7f3711400640 1 -- 172.21.15.114:0/3333833935 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f370c1f0d20 con 0x7f36ec066e40 2024-02-17T12:16:30.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.300+0000 7f3702a00640 1 -- 172.21.15.114:0/3333833935 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264668 (secure 0 0 0) 0x7f370c1f0d20 con 0x7f36ec066e40 2024-02-17T12:16:30.307 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:30.309 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 -- 172.21.15.114:0/3333833935 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f36ec066e40 msgr2=0x7f36ec069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f36ec066e40 0x7f36ec069300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f370c1eb5f0 tx=0x7f36fc008040 comp rx=0 tx=0).stop 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 -- 172.21.15.114:0/3333833935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c0c25a0 msgr2=0x7f370c140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c0c25a0 0x7f370c140a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c480 tx=0x7f36f800c940 comp rx=0 tx=0).stop 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 -- 172.21.15.114:0/3333833935 shutdown_connections 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f370c152c50 0x7f370c1f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f36ec066e40 0x7f36ec069300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c0c25a0 0x7f370c140a30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 --2- 172.21.15.114:0/3333833935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f370c06db50 0x7f370c1ee230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 -- 172.21.15.114:0/3333833935 >> 172.21.15.114:0/3333833935 conn(0x7f370c0a8490 msgr2=0x7f370c142ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 -- 172.21.15.114:0/3333833935 shutdown_connections 2024-02-17T12:16:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.304+0000 7f3711400640 1 -- 172.21.15.114:0/3333833935 wait complete. 2024-02-17T12:16:30.329 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-02-17T12:16:29.218682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223200,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751520,"statfs":{"total":773094113280,"available":772865556480,"internally_reserved":0,"allocated":2924544,"data_stored":1765884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.926176"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698749+0000","last_change":"2024-02-17T12:16:23.325932+0000","last_active":"2024-02-17T12:16:24.698749+0000","last_peered":"2024-02-17T12:16:24.698749+0000","last_clean":"2024-02-17T12:16:24.698749+0000","last_became_active":"2024-02-17T12:16:23.325577+0000","last_became_peered":"2024-02-17T12:16:23.325577+0000","last_unstale":"2024-02-17T12:16:24.698749+0000","last_undegraded":"2024-02-17T12:16:24.698749+0000","last_fullsized":"2024-02-17T12:16:24.698749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:47:08.390140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309102+0000","last_change":"2024-02-17T12:16:23.313730+0000","last_active":"2024-02-17T12:16:24.309102+0000","last_peered":"2024-02-17T12:16:24.309102+0000","last_clean":"2024-02-17T12:16:24.309102+0000","last_became_active":"2024-02-17T12:16:23.313417+0000","last_became_peered":"2024-02-17T12:16:23.313417+0000","last_unstale":"2024-02-17T12:16:24.309102+0000","last_undegraded":"2024-02-17T12:16:24.309102+0000","last_fullsized":"2024-02-17T12:16:24.309102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698256+0000","last_change":"2024-02-17T12:16:23.309155+0000","last_active":"2024-02-17T12:16:24.698256+0000","last_peered":"2024-02-17T12:16:24.698256+0000","last_clean":"2024-02-17T12:16:24.698256+0000","last_became_active":"2024-02-17T12:16:23.308921+0000","last_became_peered":"2024-02-17T12:16:23.308921+0000","last_unstale":"2024-02-17T12:16:24.698256+0000","last_undegraded":"2024-02-17T12:16:24.698256+0000","last_fullsized":"2024-02-17T12:16:24.698256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308527+0000","last_change":"2024-02-17T12:16:23.315338+0000","last_active":"2024-02-17T12:16:24.308527+0000","last_peered":"2024-02-17T12:16:24.308527+0000","last_clean":"2024-02-17T12:16:24.308527+0000","last_became_active":"2024-02-17T12:16:23.314200+0000","last_became_peered":"2024-02-17T12:16:23.314200+0000","last_unstale":"2024-02-17T12:16:24.308527+0000","last_undegraded":"2024-02-17T12:16:24.308527+0000","last_fullsized":"2024-02-17T12:16:24.308527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698345+0000","last_change":"2024-02-17T12:16:23.324821+0000","last_active":"2024-02-17T12:16:24.698345+0000","last_peered":"2024-02-17T12:16:24.698345+0000","last_clean":"2024-02-17T12:16:24.698345+0000","last_became_active":"2024-02-17T12:16:23.324550+0000","last_became_peered":"2024-02-17T12:16:23.324550+0000","last_unstale":"2024-02-17T12:16:24.698345+0000","last_undegraded":"2024-02-17T12:16:24.698345+0000","last_fullsized":"2024-02-17T12:16:24.698345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:19:19.892946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309180+0000","last_change":"2024-02-17T12:16:23.305539+0000","last_active":"2024-02-17T12:16:24.309180+0000","last_peered":"2024-02-17T12:16:24.309180+0000","last_clean":"2024-02-17T12:16:24.309180+0000","last_became_active":"2024-02-17T12:16:23.304577+0000","last_became_peered":"2024-02-17T12:16:23.304577+0000","last_unstale":"2024-02-17T12:16:24.309180+0000","last_undegraded":"2024-02-17T12:16:24.309180+0000","last_fullsized":"2024-02-17T12:16:24.309180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:01.247987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698159+0000","last_change":"2024-02-17T12:16:23.319882+0000","last_active":"2024-02-17T12:16:24.698159+0000","last_peered":"2024-02-17T12:16:24.698159+0000","last_clean":"2024-02-17T12:16:24.698159+0000","last_became_active":"2024-02-17T12:16:23.319575+0000","last_became_peered":"2024-02-17T12:16:23.319575+0000","last_unstale":"2024-02-17T12:16:24.698159+0000","last_undegraded":"2024-02-17T12:16:24.698159+0000","last_fullsized":"2024-02-17T12:16:24.698159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:45.202150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697223+0000","last_change":"2024-02-17T12:16:23.322275+0000","last_active":"2024-02-17T12:16:24.697223+0000","last_peered":"2024-02-17T12:16:24.697223+0000","last_clean":"2024-02-17T12:16:24.697223+0000","last_became_active":"2024-02-17T12:16:23.321923+0000","last_became_peered":"2024-02-17T12:16:23.321923+0000","last_unstale":"2024-02-17T12:16:24.697223+0000","last_undegraded":"2024-02-17T12:16:24.697223+0000","last_fullsized":"2024-02-17T12:16:24.697223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:05:10.254057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698799+0000","last_change":"2024-02-17T12:16:23.326757+0000","last_active":"2024-02-17T12:16:24.698799+0000","last_peered":"2024-02-17T12:16:24.698799+0000","last_clean":"2024-02-17T12:16:24.698799+0000","last_became_active":"2024-02-17T12:16:23.326481+0000","last_became_peered":"2024-02-17T12:16:23.326481+0000","last_unstale":"2024-02-17T12:16:24.698799+0000","last_undegraded":"2024-02-17T12:16:24.698799+0000","last_fullsized":"2024-02-17T12:16:24.698799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:17:49.372854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335654+0000","last_change":"2024-02-17T12:16:23.321138+0000","last_active":"2024-02-17T12:16:24.335654+0000","last_peered":"2024-02-17T12:16:24.335654+0000","last_clean":"2024-02-17T12:16:24.335654+0000","last_became_active":"2024-02-17T12:16:23.320619+0000","last_became_peered":"2024-02-17T12:16:23.320619+0000","last_unstale":"2024-02-17T12:16:24.335654+0000","last_undegraded":"2024-02-17T12:16:24.335654+0000","last_fullsized":"2024-02-17T12:16:24.335654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335398+0000","last_change":"2024-02-17T12:16:23.318226+0000","last_active":"2024-02-17T12:16:24.335398+0000","last_peered":"2024-02-17T12:16:24.335398+0000","last_clean":"2024-02-17T12:16:24.335398+0000","last_became_active":"2024-02-17T12:16:23.317955+0000","last_became_peered":"2024-02-17T12:16:23.317955+0000","last_unstale":"2024-02-17T12:16:24.335398+0000","last_undegraded":"2024-02-17T12:16:24.335398+0000","last_fullsized":"2024-02-17T12:16:24.335398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.310180+0000","last_change":"2024-02-17T12:16:23.319482+0000","last_active":"2024-02-17T12:16:24.310180+0000","last_peered":"2024-02-17T12:16:24.310180+0000","last_clean":"2024-02-17T12:16:24.310180+0000","last_became_active":"2024-02-17T12:16:23.318713+0000","last_became_peered":"2024-02-17T12:16:23.318713+0000","last_unstale":"2024-02-17T12:16:24.310180+0000","last_undegraded":"2024-02-17T12:16:24.310180+0000","last_fullsized":"2024-02-17T12:16:24.310180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:04.950428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697727+0000","last_change":"2024-02-17T12:16:23.322232+0000","last_active":"2024-02-17T12:16:24.697727+0000","last_peered":"2024-02-17T12:16:24.697727+0000","last_clean":"2024-02-17T12:16:24.697727+0000","last_became_active":"2024-02-17T12:16:23.321953+0000","last_became_peered":"2024-02-17T12:16:23.321953+0000","last_unstale":"2024-02-17T12:16:24.697727+0000","last_undegraded":"2024-02-17T12:16:24.697727+0000","last_fullsized":"2024-02-17T12:16:24.697727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697309+0000","last_change":"2024-02-17T12:16:23.305025+0000","last_active":"2024-02-17T12:16:24.697309+0000","last_peered":"2024-02-17T12:16:24.697309+0000","last_clean":"2024-02-17T12:16:24.697309+0000","last_became_active":"2024-02-17T12:16:23.303792+0000","last_became_peered":"2024-02-17T12:16:23.303792+0000","last_unstale":"2024-02-17T12:16:24.697309+0000","last_undegraded":"2024-02-17T12:16:24.697309+0000","last_fullsized":"2024-02-17T12:16:24.697309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:14.503722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308712+0000","last_change":"2024-02-17T12:16:23.318017+0000","last_active":"2024-02-17T12:16:24.308712+0000","last_peered":"2024-02-17T12:16:24.308712+0000","last_clean":"2024-02-17T12:16:24.308712+0000","last_became_active":"2024-02-17T12:16:23.317749+0000","last_became_peered":"2024-02-17T12:16:23.317749+0000","last_unstale":"2024-02-17T12:16:24.308712+0000","last_undegraded":"2024-02-17T12:16:24.308712+0000","last_fullsized":"2024-02-17T12:16:24.308712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308269+0000","last_change":"2024-02-17T12:16:23.299929+0000","last_active":"2024-02-17T12:16:24.308269+0000","last_peered":"2024-02-17T12:16:24.308269+0000","last_clean":"2024-02-17T12:16:24.308269+0000","last_became_active":"2024-02-17T12:16:23.299612+0000","last_became_peered":"2024-02-17T12:16:23.299612+0000","last_unstale":"2024-02-17T12:16:24.308269+0000","last_undegraded":"2024-02-17T12:16:24.308269+0000","last_fullsized":"2024-02-17T12:16:24.308269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309347+0000","last_change":"2024-02-17T12:16:23.314723+0000","last_active":"2024-02-17T12:16:24.309347+0000","last_peered":"2024-02-17T12:16:24.309347+0000","last_clean":"2024-02-17T12:16:24.309347+0000","last_became_active":"2024-02-17T12:16:23.310139+0000","last_became_peered":"2024-02-17T12:16:23.310139+0000","last_unstale":"2024-02-17T12:16:24.309347+0000","last_undegraded":"2024-02-17T12:16:24.309347+0000","last_fullsized":"2024-02-17T12:16:24.309347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:51:35.647773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696669+0000","last_change":"2024-02-17T12:16:23.312040+0000","last_active":"2024-02-17T12:16:24.696669+0000","last_peered":"2024-02-17T12:16:24.696669+0000","last_clean":"2024-02-17T12:16:24.696669+0000","last_became_active":"2024-02-17T12:16:23.311701+0000","last_became_peered":"2024-02-17T12:16:23.311701+0000","last_unstale":"2024-02-17T12:16:24.696669+0000","last_undegraded":"2024-02-17T12:16:24.696669+0000","last_fullsized":"2024-02-17T12:16:24.696669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:04.950428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698608+0000","last_change":"2024-02-17T12:16:23.317094+0000","last_active":"2024-02-17T12:16:24.698608+0000","last_peered":"2024-02-17T12:16:24.698608+0000","last_clean":"2024-02-17T12:16:24.698608+0000","last_became_active":"2024-02-17T12:16:23.316715+0000","last_became_peered":"2024-02-17T12:16:23.316715+0000","last_unstale":"2024-02-17T12:16:24.698608+0000","last_undegraded":"2024-02-17T12:16:24.698608+0000","last_fullsized":"2024-02-17T12:16:24.698608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:30.580521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335321+0000","last_change":"2024-02-17T12:16:23.314602+0000","last_active":"2024-02-17T12:16:24.335321+0000","last_peered":"2024-02-17T12:16:24.335321+0000","last_clean":"2024-02-17T12:16:24.335321+0000","last_became_active":"2024-02-17T12:16:23.310646+0000","last_became_peered":"2024-02-17T12:16:23.310646+0000","last_unstale":"2024-02-17T12:16:24.335321+0000","last_undegraded":"2024-02-17T12:16:24.335321+0000","last_fullsized":"2024-02-17T12:16:24.335321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697556+0000","last_change":"2024-02-17T12:16:23.314985+0000","last_active":"2024-02-17T12:16:24.697556+0000","last_peered":"2024-02-17T12:16:24.697556+0000","last_clean":"2024-02-17T12:16:24.697556+0000","last_became_active":"2024-02-17T12:16:23.314105+0000","last_became_peered":"2024-02-17T12:16:23.314105+0000","last_unstale":"2024-02-17T12:16:24.697556+0000","last_undegraded":"2024-02-17T12:16:24.697556+0000","last_fullsized":"2024-02-17T12:16:24.697556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308459+0000","last_change":"2024-02-17T12:16:23.316273+0000","last_active":"2024-02-17T12:16:24.308459+0000","last_peered":"2024-02-17T12:16:24.308459+0000","last_clean":"2024-02-17T12:16:24.308459+0000","last_became_active":"2024-02-17T12:16:23.315991+0000","last_became_peered":"2024-02-17T12:16:23.315991+0000","last_unstale":"2024-02-17T12:16:24.308459+0000","last_undegraded":"2024-02-17T12:16:24.308459+0000","last_fullsized":"2024-02-17T12:16:24.308459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697276+0000","last_change":"2024-02-17T12:16:23.310525+0000","last_active":"2024-02-17T12:16:24.697276+0000","last_peered":"2024-02-17T12:16:24.697276+0000","last_clean":"2024-02-17T12:16:24.697276+0000","last_became_active":"2024-02-17T12:16:23.309291+0000","last_became_peered":"2024-02-17T12:16:23.309291+0000","last_unstale":"2024-02-17T12:16:24.697276+0000","last_undegraded":"2024-02-17T12:16:24.697276+0000","last_fullsized":"2024-02-17T12:16:24.697276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308457+0000","last_change":"2024-02-17T12:16:23.319218+0000","last_active":"2024-02-17T12:16:24.308457+0000","last_peered":"2024-02-17T12:16:24.308457+0000","last_clean":"2024-02-17T12:16:24.308457+0000","last_became_active":"2024-02-17T12:16:23.310787+0000","last_became_peered":"2024-02-17T12:16:23.310787+0000","last_unstale":"2024-02-17T12:16:24.308457+0000","last_undegraded":"2024-02-17T12:16:24.308457+0000","last_fullsized":"2024-02-17T12:16:24.308457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697807+0000","last_change":"2024-02-17T12:16:23.310020+0000","last_active":"2024-02-17T12:16:24.697807+0000","last_peered":"2024-02-17T12:16:24.697807+0000","last_clean":"2024-02-17T12:16:24.697807+0000","last_became_active":"2024-02-17T12:16:23.309245+0000","last_became_peered":"2024-02-17T12:16:23.309245+0000","last_unstale":"2024-02-17T12:16:24.697807+0000","last_undegraded":"2024-02-17T12:16:24.697807+0000","last_fullsized":"2024-02-17T12:16:24.697807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335664+0000","last_change":"2024-02-17T12:16:23.321247+0000","last_active":"2024-02-17T12:16:24.335664+0000","last_peered":"2024-02-17T12:16:24.335664+0000","last_clean":"2024-02-17T12:16:24.335664+0000","last_became_active":"2024-02-17T12:16:23.312610+0000","last_became_peered":"2024-02-17T12:16:23.312610+0000","last_unstale":"2024-02-17T12:16:24.335664+0000","last_undegraded":"2024-02-17T12:16:24.335664+0000","last_fullsized":"2024-02-17T12:16:24.335664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308908+0000","last_change":"2024-02-17T12:16:23.316684+0000","last_active":"2024-02-17T12:16:24.308908+0000","last_peered":"2024-02-17T12:16:24.308908+0000","last_clean":"2024-02-17T12:16:24.308908+0000","last_became_active":"2024-02-17T12:16:23.316394+0000","last_became_peered":"2024-02-17T12:16:23.316394+0000","last_unstale":"2024-02-17T12:16:24.308908+0000","last_undegraded":"2024-02-17T12:16:24.308908+0000","last_fullsized":"2024-02-17T12:16:24.308908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698031+0000","last_change":"2024-02-17T12:16:23.316206+0000","last_active":"2024-02-17T12:16:24.698031+0000","last_peered":"2024-02-17T12:16:24.698031+0000","last_clean":"2024-02-17T12:16:24.698031+0000","last_became_active":"2024-02-17T12:16:23.315874+0000","last_became_peered":"2024-02-17T12:16:23.315874+0000","last_unstale":"2024-02-17T12:16:24.698031+0000","last_undegraded":"2024-02-17T12:16:24.698031+0000","last_fullsized":"2024-02-17T12:16:24.698031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:26:24.802958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697690+0000","last_change":"2024-02-17T12:16:23.307339+0000","last_active":"2024-02-17T12:16:24.697690+0000","last_peered":"2024-02-17T12:16:24.697690+0000","last_clean":"2024-02-17T12:16:24.697690+0000","last_became_active":"2024-02-17T12:16:23.306943+0000","last_became_peered":"2024-02-17T12:16:23.306943+0000","last_unstale":"2024-02-17T12:16:24.697690+0000","last_undegraded":"2024-02-17T12:16:24.697690+0000","last_fullsized":"2024-02-17T12:16:24.697690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308650+0000","last_change":"2024-02-17T12:16:23.304998+0000","last_active":"2024-02-17T12:16:24.308650+0000","last_peered":"2024-02-17T12:16:24.308650+0000","last_clean":"2024-02-17T12:16:24.308650+0000","last_became_active":"2024-02-17T12:16:23.304059+0000","last_became_peered":"2024-02-17T12:16:23.304059+0000","last_unstale":"2024-02-17T12:16:24.308650+0000","last_undegraded":"2024-02-17T12:16:24.308650+0000","last_fullsized":"2024-02-17T12:16:24.308650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696623+0000","last_change":"2024-02-17T12:16:23.315379+0000","last_active":"2024-02-17T12:16:24.696623+0000","last_peered":"2024-02-17T12:16:24.696623+0000","last_clean":"2024-02-17T12:16:24.696623+0000","last_became_active":"2024-02-17T12:16:23.309626+0000","last_became_peered":"2024-02-17T12:16:23.309626+0000","last_unstale":"2024-02-17T12:16:24.696623+0000","last_undegraded":"2024-02-17T12:16:24.696623+0000","last_fullsized":"2024-02-17T12:16:24.696623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:44:56.735146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335196+0000","last_change":"2024-02-17T12:16:23.320903+0000","last_active":"2024-02-17T12:16:24.335196+0000","last_peered":"2024-02-17T12:16:24.335196+0000","last_clean":"2024-02-17T12:16:24.335196+0000","last_became_active":"2024-02-17T12:16:23.312623+0000","last_became_peered":"2024-02-17T12:16:23.312623+0000","last_unstale":"2024-02-17T12:16:24.335196+0000","last_undegraded":"2024-02-17T12:16:24.335196+0000","last_fullsized":"2024-02-17T12:16:24.335196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309854+0000","last_change":"2024-02-17T12:16:23.306808+0000","last_active":"2024-02-17T12:16:24.309854+0000","last_peered":"2024-02-17T12:16:24.309854+0000","last_clean":"2024-02-17T12:16:24.309854+0000","last_became_active":"2024-02-17T12:16:23.306117+0000","last_became_peered":"2024-02-17T12:16:23.306117+0000","last_unstale":"2024-02-17T12:16:24.309854+0000","last_undegraded":"2024-02-17T12:16:24.309854+0000","last_fullsized":"2024-02-17T12:16:24.309854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:16.035071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697993+0000","last_change":"2024-02-17T12:16:22.314696+0000","last_active":"2024-02-17T12:16:24.697993+0000","last_peered":"2024-02-17T12:16:24.697993+0000","last_clean":"2024-02-17T12:16:24.697993+0000","last_became_active":"2024-02-17T12:16:22.314066+0000","last_became_peered":"2024-02-17T12:16:22.314066+0000","last_unstale":"2024-02-17T12:16:24.697993+0000","last_undegraded":"2024-02-17T12:16:24.697993+0000","last_fullsized":"2024-02-17T12:16:24.697993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:07:14.946092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697825+0000","last_change":"2024-02-17T12:16:23.303172+0000","last_active":"2024-02-17T12:16:24.697825+0000","last_peered":"2024-02-17T12:16:24.697825+0000","last_clean":"2024-02-17T12:16:24.697825+0000","last_became_active":"2024-02-17T12:16:23.302807+0000","last_became_peered":"2024-02-17T12:16:23.302807+0000","last_unstale":"2024-02-17T12:16:24.697825+0000","last_undegraded":"2024-02-17T12:16:24.697825+0000","last_fullsized":"2024-02-17T12:16:24.697825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335506+0000","last_change":"2024-02-17T12:16:22.314969+0000","last_active":"2024-02-17T12:16:24.335506+0000","last_peered":"2024-02-17T12:16:24.335506+0000","last_clean":"2024-02-17T12:16:24.335506+0000","last_became_active":"2024-02-17T12:16:22.313531+0000","last_became_peered":"2024-02-17T12:16:22.313531+0000","last_unstale":"2024-02-17T12:16:24.335506+0000","last_undegraded":"2024-02-17T12:16:24.335506+0000","last_fullsized":"2024-02-17T12:16:24.335506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697645+0000","last_change":"2024-02-17T12:16:22.311648+0000","last_active":"2024-02-17T12:16:24.697645+0000","last_peered":"2024-02-17T12:16:24.697645+0000","last_clean":"2024-02-17T12:16:24.697645+0000","last_became_active":"2024-02-17T12:16:22.311355+0000","last_became_peered":"2024-02-17T12:16:22.311355+0000","last_unstale":"2024-02-17T12:16:24.697645+0000","last_undegraded":"2024-02-17T12:16:24.697645+0000","last_fullsized":"2024-02-17T12:16:24.697645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:43.722209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697379+0000","last_change":"2024-02-17T12:16:23.311561+0000","last_active":"2024-02-17T12:16:24.697379+0000","last_peered":"2024-02-17T12:16:24.697379+0000","last_clean":"2024-02-17T12:16:24.697379+0000","last_became_active":"2024-02-17T12:16:23.311338+0000","last_became_peered":"2024-02-17T12:16:23.311338+0000","last_unstale":"2024-02-17T12:16:24.697379+0000","last_undegraded":"2024-02-17T12:16:24.697379+0000","last_fullsized":"2024-02-17T12:16:24.697379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308598+0000","last_change":"2024-02-17T12:16:22.315021+0000","last_active":"2024-02-17T12:16:24.308598+0000","last_peered":"2024-02-17T12:16:24.308598+0000","last_clean":"2024-02-17T12:16:24.308598+0000","last_became_active":"2024-02-17T12:16:22.314690+0000","last_became_peered":"2024-02-17T12:16:22.314690+0000","last_unstale":"2024-02-17T12:16:24.308598+0000","last_undegraded":"2024-02-17T12:16:24.308598+0000","last_fullsized":"2024-02-17T12:16:24.308598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:49.705448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308577+0000","last_change":"2024-02-17T12:16:23.312450+0000","last_active":"2024-02-17T12:16:24.308577+0000","last_peered":"2024-02-17T12:16:24.308577+0000","last_clean":"2024-02-17T12:16:24.308577+0000","last_became_active":"2024-02-17T12:16:23.312162+0000","last_became_peered":"2024-02-17T12:16:23.312162+0000","last_unstale":"2024-02-17T12:16:24.308577+0000","last_undegraded":"2024-02-17T12:16:24.308577+0000","last_fullsized":"2024-02-17T12:16:24.308577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335521+0000","last_change":"2024-02-17T12:16:22.316581+0000","last_active":"2024-02-17T12:16:24.335521+0000","last_peered":"2024-02-17T12:16:24.335521+0000","last_clean":"2024-02-17T12:16:24.335521+0000","last_became_active":"2024-02-17T12:16:22.316238+0000","last_became_peered":"2024-02-17T12:16:22.316238+0000","last_unstale":"2024-02-17T12:16:24.335521+0000","last_undegraded":"2024-02-17T12:16:24.335521+0000","last_fullsized":"2024-02-17T12:16:24.335521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:41.148188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309008+0000","last_change":"2024-02-17T12:16:23.313962+0000","last_active":"2024-02-17T12:16:24.309008+0000","last_peered":"2024-02-17T12:16:24.309008+0000","last_clean":"2024-02-17T12:16:24.309008+0000","last_became_active":"2024-02-17T12:16:23.313661+0000","last_became_peered":"2024-02-17T12:16:23.313661+0000","last_unstale":"2024-02-17T12:16:24.309008+0000","last_undegraded":"2024-02-17T12:16:24.309008+0000","last_fullsized":"2024-02-17T12:16:24.309008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:25:31.899460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309088+0000","last_change":"2024-02-17T12:16:22.312851+0000","last_active":"2024-02-17T12:16:24.309088+0000","last_peered":"2024-02-17T12:16:24.309088+0000","last_clean":"2024-02-17T12:16:24.309088+0000","last_became_active":"2024-02-17T12:16:22.312536+0000","last_became_peered":"2024-02-17T12:16:22.312536+0000","last_unstale":"2024-02-17T12:16:24.309088+0000","last_undegraded":"2024-02-17T12:16:24.309088+0000","last_fullsized":"2024-02-17T12:16:24.309088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:49:36.146858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698343+0000","last_change":"2024-02-17T12:16:23.319340+0000","last_active":"2024-02-17T12:16:24.698343+0000","last_peered":"2024-02-17T12:16:24.698343+0000","last_clean":"2024-02-17T12:16:24.698343+0000","last_became_active":"2024-02-17T12:16:23.318684+0000","last_became_peered":"2024-02-17T12:16:23.318684+0000","last_unstale":"2024-02-17T12:16:24.698343+0000","last_undegraded":"2024-02-17T12:16:24.698343+0000","last_fullsized":"2024-02-17T12:16:24.698343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308813+0000","last_change":"2024-02-17T12:16:22.313946+0000","last_active":"2024-02-17T12:16:24.308813+0000","last_peered":"2024-02-17T12:16:24.308813+0000","last_clean":"2024-02-17T12:16:24.308813+0000","last_became_active":"2024-02-17T12:16:22.313538+0000","last_became_peered":"2024-02-17T12:16:22.313538+0000","last_unstale":"2024-02-17T12:16:24.308813+0000","last_undegraded":"2024-02-17T12:16:24.308813+0000","last_fullsized":"2024-02-17T12:16:24.308813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.310265+0000","last_change":"2024-02-17T12:16:23.319708+0000","last_active":"2024-02-17T12:16:24.310265+0000","last_peered":"2024-02-17T12:16:24.310265+0000","last_clean":"2024-02-17T12:16:24.310265+0000","last_became_active":"2024-02-17T12:16:23.319152+0000","last_became_peered":"2024-02-17T12:16:23.319152+0000","last_unstale":"2024-02-17T12:16:24.310265+0000","last_undegraded":"2024-02-17T12:16:24.310265+0000","last_fullsized":"2024-02-17T12:16:24.310265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:59.572532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335292+0000","last_change":"2024-02-17T12:16:22.316733+0000","last_active":"2024-02-17T12:16:24.335292+0000","last_peered":"2024-02-17T12:16:24.335292+0000","last_clean":"2024-02-17T12:16:24.335292+0000","last_became_active":"2024-02-17T12:16:22.316383+0000","last_became_peered":"2024-02-17T12:16:22.316383+0000","last_unstale":"2024-02-17T12:16:24.335292+0000","last_undegraded":"2024-02-17T12:16:24.335292+0000","last_fullsized":"2024-02-17T12:16:24.335292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:53.726477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698406+0000","last_change":"2024-02-17T12:16:23.326192+0000","last_active":"2024-02-17T12:16:24.698406+0000","last_peered":"2024-02-17T12:16:24.698406+0000","last_clean":"2024-02-17T12:16:24.698406+0000","last_became_active":"2024-02-17T12:16:23.325827+0000","last_became_peered":"2024-02-17T12:16:23.325827+0000","last_unstale":"2024-02-17T12:16:24.698406+0000","last_undegraded":"2024-02-17T12:16:24.698406+0000","last_fullsized":"2024-02-17T12:16:24.698406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:59:06.137893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697923+0000","last_change":"2024-02-17T12:16:22.310529+0000","last_active":"2024-02-17T12:16:24.697923+0000","last_peered":"2024-02-17T12:16:24.697923+0000","last_clean":"2024-02-17T12:16:24.697923+0000","last_became_active":"2024-02-17T12:16:22.310162+0000","last_became_peered":"2024-02-17T12:16:22.310162+0000","last_unstale":"2024-02-17T12:16:24.697923+0000","last_undegraded":"2024-02-17T12:16:24.697923+0000","last_fullsized":"2024-02-17T12:16:24.697923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:43.722209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697455+0000","last_change":"2024-02-17T12:16:23.313637+0000","last_active":"2024-02-17T12:16:24.697455+0000","last_peered":"2024-02-17T12:16:24.697455+0000","last_clean":"2024-02-17T12:16:24.697455+0000","last_became_active":"2024-02-17T12:16:23.313038+0000","last_became_peered":"2024-02-17T12:16:23.313038+0000","last_unstale":"2024-02-17T12:16:24.697455+0000","last_undegraded":"2024-02-17T12:16:24.697455+0000","last_fullsized":"2024-02-17T12:16:24.697455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:05:10.254057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308728+0000","last_change":"2024-02-17T12:16:22.315490+0000","last_active":"2024-02-17T12:16:24.308728+0000","last_peered":"2024-02-17T12:16:24.308728+0000","last_clean":"2024-02-17T12:16:24.308728+0000","last_became_active":"2024-02-17T12:16:22.315194+0000","last_became_peered":"2024-02-17T12:16:22.315194+0000","last_unstale":"2024-02-17T12:16:24.308728+0000","last_undegraded":"2024-02-17T12:16:24.308728+0000","last_fullsized":"2024-02-17T12:16:24.308728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698526+0000","last_change":"2024-02-17T12:16:23.324173+0000","last_active":"2024-02-17T12:16:24.698526+0000","last_peered":"2024-02-17T12:16:24.698526+0000","last_clean":"2024-02-17T12:16:24.698526+0000","last_became_active":"2024-02-17T12:16:23.323675+0000","last_became_peered":"2024-02-17T12:16:23.323675+0000","last_unstale":"2024-02-17T12:16:24.698526+0000","last_undegraded":"2024-02-17T12:16:24.698526+0000","last_fullsized":"2024-02-17T12:16:24.698526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:41:30.733177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335182+0000","last_change":"2024-02-17T12:16:22.316662+0000","last_active":"2024-02-17T12:16:24.335182+0000","last_peered":"2024-02-17T12:16:24.335182+0000","last_clean":"2024-02-17T12:16:24.335182+0000","last_became_active":"2024-02-17T12:16:22.315202+0000","last_became_peered":"2024-02-17T12:16:22.315202+0000","last_unstale":"2024-02-17T12:16:24.335182+0000","last_undegraded":"2024-02-17T12:16:24.335182+0000","last_fullsized":"2024-02-17T12:16:24.335182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335242+0000","last_change":"2024-02-17T12:16:23.320591+0000","last_active":"2024-02-17T12:16:24.335242+0000","last_peered":"2024-02-17T12:16:24.335242+0000","last_clean":"2024-02-17T12:16:24.335242+0000","last_became_active":"2024-02-17T12:16:23.312514+0000","last_became_peered":"2024-02-17T12:16:23.312514+0000","last_unstale":"2024-02-17T12:16:24.335242+0000","last_undegraded":"2024-02-17T12:16:24.335242+0000","last_fullsized":"2024-02-17T12:16:24.335242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696452+0000","last_change":"2024-02-17T12:16:22.302813+0000","last_active":"2024-02-17T12:16:24.696452+0000","last_peered":"2024-02-17T12:16:24.696452+0000","last_clean":"2024-02-17T12:16:24.696452+0000","last_became_active":"2024-02-17T12:16:22.302538+0000","last_became_peered":"2024-02-17T12:16:22.302538+0000","last_unstale":"2024-02-17T12:16:24.696452+0000","last_undegraded":"2024-02-17T12:16:24.696452+0000","last_fullsized":"2024-02-17T12:16:24.696452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:49:52.576082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698135+0000","last_change":"2024-02-17T12:16:23.325642+0000","last_active":"2024-02-17T12:16:24.698135+0000","last_peered":"2024-02-17T12:16:24.698135+0000","last_clean":"2024-02-17T12:16:24.698135+0000","last_became_active":"2024-02-17T12:16:23.324419+0000","last_became_peered":"2024-02-17T12:16:23.324419+0000","last_unstale":"2024-02-17T12:16:24.698135+0000","last_undegraded":"2024-02-17T12:16:24.698135+0000","last_fullsized":"2024-02-17T12:16:24.698135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:56.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.310158+0000","last_change":"2024-02-17T12:16:22.311089+0000","last_active":"2024-02-17T12:16:24.310158+0000","last_peered":"2024-02-17T12:16:24.310158+0000","last_clean":"2024-02-17T12:16:24.310158+0000","last_became_active":"2024-02-17T12:16:22.310811+0000","last_became_peered":"2024-02-17T12:16:22.310811+0000","last_unstale":"2024-02-17T12:16:24.310158+0000","last_undegraded":"2024-02-17T12:16:24.310158+0000","last_fullsized":"2024-02-17T12:16:24.310158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:21:58.929168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698671+0000","last_change":"2024-02-17T12:16:23.327054+0000","last_active":"2024-02-17T12:16:24.698671+0000","last_peered":"2024-02-17T12:16:24.698671+0000","last_clean":"2024-02-17T12:16:24.698671+0000","last_became_active":"2024-02-17T12:16:23.325063+0000","last_became_peered":"2024-02-17T12:16:23.325063+0000","last_unstale":"2024-02-17T12:16:24.698671+0000","last_undegraded":"2024-02-17T12:16:24.698671+0000","last_fullsized":"2024-02-17T12:16:24.698671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:48.082740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696762+0000","last_change":"2024-02-17T12:16:22.307414+0000","last_active":"2024-02-17T12:16:24.696762+0000","last_peered":"2024-02-17T12:16:24.696762+0000","last_clean":"2024-02-17T12:16:24.696762+0000","last_became_active":"2024-02-17T12:16:22.306916+0000","last_became_peered":"2024-02-17T12:16:22.306916+0000","last_unstale":"2024-02-17T12:16:24.696762+0000","last_undegraded":"2024-02-17T12:16:24.696762+0000","last_fullsized":"2024-02-17T12:16:24.696762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:05:01.918619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698853+0000","last_change":"2024-02-17T12:16:23.327878+0000","last_active":"2024-02-17T12:16:24.698853+0000","last_peered":"2024-02-17T12:16:24.698853+0000","last_clean":"2024-02-17T12:16:24.698853+0000","last_became_active":"2024-02-17T12:16:23.327225+0000","last_became_peered":"2024-02-17T12:16:23.327225+0000","last_unstale":"2024-02-17T12:16:24.698853+0000","last_undegraded":"2024-02-17T12:16:24.698853+0000","last_fullsized":"2024-02-17T12:16:24.698853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:24:19.386618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308913+0000","last_change":"2024-02-17T12:16:22.314711+0000","last_active":"2024-02-17T12:16:24.308913+0000","last_peered":"2024-02-17T12:16:24.308913+0000","last_clean":"2024-02-17T12:16:24.308913+0000","last_became_active":"2024-02-17T12:16:22.314441+0000","last_became_peered":"2024-02-17T12:16:22.314441+0000","last_unstale":"2024-02-17T12:16:24.308913+0000","last_undegraded":"2024-02-17T12:16:24.308913+0000","last_fullsized":"2024-02-17T12:16:24.308913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:53.726477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308939+0000","last_change":"2024-02-17T12:16:23.315096+0000","last_active":"2024-02-17T12:16:24.308939+0000","last_peered":"2024-02-17T12:16:24.308939+0000","last_clean":"2024-02-17T12:16:24.308939+0000","last_became_active":"2024-02-17T12:16:23.309975+0000","last_became_peered":"2024-02-17T12:16:23.309975+0000","last_unstale":"2024-02-17T12:16:24.308939+0000","last_undegraded":"2024-02-17T12:16:24.308939+0000","last_fullsized":"2024-02-17T12:16:24.308939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:18:14.299788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696630+0000","last_change":"2024-02-17T12:16:22.310563+0000","last_active":"2024-02-17T12:16:24.696630+0000","last_peered":"2024-02-17T12:16:24.696630+0000","last_clean":"2024-02-17T12:16:24.696630+0000","last_became_active":"2024-02-17T12:16:22.310275+0000","last_became_peered":"2024-02-17T12:16:22.310275+0000","last_unstale":"2024-02-17T12:16:24.696630+0000","last_undegraded":"2024-02-17T12:16:24.696630+0000","last_fullsized":"2024-02-17T12:16:24.696630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:46:25.452272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698281+0000","last_change":"2024-02-17T12:16:23.330066+0000","last_active":"2024-02-17T12:16:24.698281+0000","last_peered":"2024-02-17T12:16:24.698281+0000","last_clean":"2024-02-17T12:16:24.698281+0000","last_became_active":"2024-02-17T12:16:23.329816+0000","last_became_peered":"2024-02-17T12:16:23.329816+0000","last_unstale":"2024-02-17T12:16:24.698281+0000","last_undegraded":"2024-02-17T12:16:24.698281+0000","last_fullsized":"2024-02-17T12:16:24.698281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:04:38.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698181+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:16:24.698181+0000","last_peered":"2024-02-17T12:16:24.698181+0000","last_clean":"2024-02-17T12:16:24.698181+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:16:24.698181+0000","last_undegraded":"2024-02-17T12:16:24.698181+0000","last_fullsized":"2024-02-17T12:16:24.698181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308410+0000","last_change":"2024-02-17T12:16:22.308615+0000","last_active":"2024-02-17T12:16:24.308410+0000","last_peered":"2024-02-17T12:16:24.308410+0000","last_clean":"2024-02-17T12:16:24.308410+0000","last_became_active":"2024-02-17T12:16:22.308153+0000","last_became_peered":"2024-02-17T12:16:22.308153+0000","last_unstale":"2024-02-17T12:16:24.308410+0000","last_undegraded":"2024-02-17T12:16:24.308410+0000","last_fullsized":"2024-02-17T12:16:24.308410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:05.491487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697598+0000","last_change":"2024-02-17T12:16:23.311520+0000","last_active":"2024-02-17T12:16:24.697598+0000","last_peered":"2024-02-17T12:16:24.697598+0000","last_clean":"2024-02-17T12:16:24.697598+0000","last_became_active":"2024-02-17T12:16:23.311139+0000","last_became_peered":"2024-02-17T12:16:23.311139+0000","last_unstale":"2024-02-17T12:16:24.697598+0000","last_undegraded":"2024-02-17T12:16:24.697598+0000","last_fullsized":"2024-02-17T12:16:24.697598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698033+0000","last_change":"2024-02-17T12:16:22.324920+0000","last_active":"2024-02-17T12:16:24.698033+0000","last_peered":"2024-02-17T12:16:24.698033+0000","last_clean":"2024-02-17T12:16:24.698033+0000","last_became_active":"2024-02-17T12:16:22.324670+0000","last_became_peered":"2024-02-17T12:16:22.324670+0000","last_unstale":"2024-02-17T12:16:24.698033+0000","last_undegraded":"2024-02-17T12:16:24.698033+0000","last_fullsized":"2024-02-17T12:16:24.698033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:44:55.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697257+0000","last_change":"2024-02-17T12:16:23.303047+0000","last_active":"2024-02-17T12:16:24.697257+0000","last_peered":"2024-02-17T12:16:24.697257+0000","last_clean":"2024-02-17T12:16:24.697257+0000","last_became_active":"2024-02-17T12:16:23.302661+0000","last_became_peered":"2024-02-17T12:16:23.302661+0000","last_unstale":"2024-02-17T12:16:24.697257+0000","last_undegraded":"2024-02-17T12:16:24.697257+0000","last_fullsized":"2024-02-17T12:16:24.697257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:44:54.619964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696722+0000","last_change":"2024-02-17T12:16:22.308200+0000","last_active":"2024-02-17T12:16:24.696722+0000","last_peered":"2024-02-17T12:16:24.696722+0000","last_clean":"2024-02-17T12:16:24.696722+0000","last_became_active":"2024-02-17T12:16:22.307887+0000","last_became_peered":"2024-02-17T12:16:22.307887+0000","last_unstale":"2024-02-17T12:16:24.696722+0000","last_undegraded":"2024-02-17T12:16:24.696722+0000","last_fullsized":"2024-02-17T12:16:24.696722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:03.723225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308610+0000","last_change":"2024-02-17T12:16:23.312512+0000","last_active":"2024-02-17T12:16:24.308610+0000","last_peered":"2024-02-17T12:16:24.308610+0000","last_clean":"2024-02-17T12:16:24.308610+0000","last_became_active":"2024-02-17T12:16:23.312190+0000","last_became_peered":"2024-02-17T12:16:23.312190+0000","last_unstale":"2024-02-17T12:16:24.308610+0000","last_undegraded":"2024-02-17T12:16:24.308610+0000","last_fullsized":"2024-02-17T12:16:24.308610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308798+0000","last_change":"2024-02-17T12:16:22.307969+0000","last_active":"2024-02-17T12:16:24.308798+0000","last_peered":"2024-02-17T12:16:24.308798+0000","last_clean":"2024-02-17T12:16:24.308798+0000","last_became_active":"2024-02-17T12:16:22.307639+0000","last_became_peered":"2024-02-17T12:16:22.307639+0000","last_unstale":"2024-02-17T12:16:24.308798+0000","last_undegraded":"2024-02-17T12:16:24.308798+0000","last_fullsized":"2024-02-17T12:16:24.308798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.310056+0000","last_change":"2024-02-17T12:16:23.306045+0000","last_active":"2024-02-17T12:16:24.310056+0000","last_peered":"2024-02-17T12:16:24.310056+0000","last_clean":"2024-02-17T12:16:24.310056+0000","last_became_active":"2024-02-17T12:16:23.305674+0000","last_became_peered":"2024-02-17T12:16:23.305674+0000","last_unstale":"2024-02-17T12:16:24.310056+0000","last_undegraded":"2024-02-17T12:16:24.310056+0000","last_fullsized":"2024-02-17T12:16:24.310056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:44:56.735146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308940+0000","last_change":"2024-02-17T12:16:22.308387+0000","last_active":"2024-02-17T12:16:24.308940+0000","last_peered":"2024-02-17T12:16:24.308940+0000","last_clean":"2024-02-17T12:16:24.308940+0000","last_became_active":"2024-02-17T12:16:22.308043+0000","last_became_peered":"2024-02-17T12:16:22.308043+0000","last_unstale":"2024-02-17T12:16:24.308940+0000","last_undegraded":"2024-02-17T12:16:24.308940+0000","last_fullsized":"2024-02-17T12:16:24.308940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308982+0000","last_change":"2024-02-17T12:16:23.310304+0000","last_active":"2024-02-17T12:16:24.308982+0000","last_peered":"2024-02-17T12:16:24.308982+0000","last_clean":"2024-02-17T12:16:24.308982+0000","last_became_active":"2024-02-17T12:16:23.309898+0000","last_became_peered":"2024-02-17T12:16:23.309898+0000","last_unstale":"2024-02-17T12:16:24.308982+0000","last_undegraded":"2024-02-17T12:16:24.308982+0000","last_fullsized":"2024-02-17T12:16:24.308982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:15:22.881157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698567+0000","last_change":"2024-02-17T12:16:22.326425+0000","last_active":"2024-02-17T12:16:24.698567+0000","last_peered":"2024-02-17T12:16:24.698567+0000","last_clean":"2024-02-17T12:16:24.698567+0000","last_became_active":"2024-02-17T12:16:22.326149+0000","last_became_peered":"2024-02-17T12:16:22.326149+0000","last_unstale":"2024-02-17T12:16:24.698567+0000","last_undegraded":"2024-02-17T12:16:24.698567+0000","last_fullsized":"2024-02-17T12:16:24.698567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:58.719013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308851+0000","last_change":"2024-02-17T12:16:23.308825+0000","last_active":"2024-02-17T12:16:24.308851+0000","last_peered":"2024-02-17T12:16:24.308851+0000","last_clean":"2024-02-17T12:16:24.308851+0000","last_became_active":"2024-02-17T12:16:23.308519+0000","last_became_peered":"2024-02-17T12:16:23.308519+0000","last_unstale":"2024-02-17T12:16:24.308851+0000","last_undegraded":"2024-02-17T12:16:24.308851+0000","last_fullsized":"2024-02-17T12:16:24.308851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.333542+0000","last_change":"2024-02-17T12:16:22.312030+0000","last_active":"2024-02-17T12:16:24.333542+0000","last_peered":"2024-02-17T12:16:24.333542+0000","last_clean":"2024-02-17T12:16:24.333542+0000","last_became_active":"2024-02-17T12:16:22.311589+0000","last_became_peered":"2024-02-17T12:16:22.311589+0000","last_unstale":"2024-02-17T12:16:24.333542+0000","last_undegraded":"2024-02-17T12:16:24.333542+0000","last_fullsized":"2024-02-17T12:16:24.333542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:41.148188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697953+0000","last_change":"2024-02-17T12:16:23.317377+0000","last_active":"2024-02-17T12:16:24.697953+0000","last_peered":"2024-02-17T12:16:24.697953+0000","last_clean":"2024-02-17T12:16:24.697953+0000","last_became_active":"2024-02-17T12:16:23.317054+0000","last_became_peered":"2024-02-17T12:16:23.317054+0000","last_unstale":"2024-02-17T12:16:24.697953+0000","last_undegraded":"2024-02-17T12:16:24.697953+0000","last_fullsized":"2024-02-17T12:16:24.697953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335600+0000","last_change":"2024-02-17T12:16:22.320467+0000","last_active":"2024-02-17T12:16:24.335600+0000","last_peered":"2024-02-17T12:16:24.335600+0000","last_clean":"2024-02-17T12:16:24.335600+0000","last_became_active":"2024-02-17T12:16:22.319418+0000","last_became_peered":"2024-02-17T12:16:22.319418+0000","last_unstale":"2024-02-17T12:16:24.335600+0000","last_undegraded":"2024-02-17T12:16:24.335600+0000","last_fullsized":"2024-02-17T12:16:24.335600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:52:32.067973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698388+0000","last_change":"2024-02-17T12:16:23.307769+0000","last_active":"2024-02-17T12:16:24.698388+0000","last_peered":"2024-02-17T12:16:24.698388+0000","last_clean":"2024-02-17T12:16:24.698388+0000","last_became_active":"2024-02-17T12:16:23.305664+0000","last_became_peered":"2024-02-17T12:16:23.305664+0000","last_unstale":"2024-02-17T12:16:24.698388+0000","last_undegraded":"2024-02-17T12:16:24.698388+0000","last_fullsized":"2024-02-17T12:16:24.698388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698017+0000","last_change":"2024-02-17T12:16:22.324065+0000","last_active":"2024-02-17T12:16:24.698017+0000","last_peered":"2024-02-17T12:16:24.698017+0000","last_clean":"2024-02-17T12:16:24.698017+0000","last_became_active":"2024-02-17T12:16:22.323818+0000","last_became_peered":"2024-02-17T12:16:22.323818+0000","last_unstale":"2024-02-17T12:16:24.698017+0000","last_undegraded":"2024-02-17T12:16:24.698017+0000","last_fullsized":"2024-02-17T12:16:24.698017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:15.029228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309889+0000","last_change":"2024-02-17T12:16:23.313005+0000","last_active":"2024-02-17T12:16:24.309889+0000","last_peered":"2024-02-17T12:16:24.309889+0000","last_clean":"2024-02-17T12:16:24.309889+0000","last_became_active":"2024-02-17T12:16:23.312532+0000","last_became_peered":"2024-02-17T12:16:23.312532+0000","last_unstale":"2024-02-17T12:16:24.309889+0000","last_undegraded":"2024-02-17T12:16:24.309889+0000","last_fullsized":"2024-02-17T12:16:24.309889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:34:19.518606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308811+0000","last_change":"2024-02-17T12:16:22.313418+0000","last_active":"2024-02-17T12:16:24.308811+0000","last_peered":"2024-02-17T12:16:24.308811+0000","last_clean":"2024-02-17T12:16:24.308811+0000","last_became_active":"2024-02-17T12:16:22.312996+0000","last_became_peered":"2024-02-17T12:16:22.312996+0000","last_unstale":"2024-02-17T12:16:24.308811+0000","last_undegraded":"2024-02-17T12:16:24.308811+0000","last_fullsized":"2024-02-17T12:16:24.308811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:49:36.146858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697537+0000","last_change":"2024-02-17T12:16:23.306549+0000","last_active":"2024-02-17T12:16:24.697537+0000","last_peered":"2024-02-17T12:16:24.697537+0000","last_clean":"2024-02-17T12:16:24.697537+0000","last_became_active":"2024-02-17T12:16:23.306251+0000","last_became_peered":"2024-02-17T12:16:23.306251+0000","last_unstale":"2024-02-17T12:16:24.697537+0000","last_undegraded":"2024-02-17T12:16:24.697537+0000","last_fullsized":"2024-02-17T12:16:24.697537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308802+0000","last_change":"2024-02-17T12:16:22.316022+0000","last_active":"2024-02-17T12:16:24.308802+0000","last_peered":"2024-02-17T12:16:24.308802+0000","last_clean":"2024-02-17T12:16:24.308802+0000","last_became_active":"2024-02-17T12:16:22.315761+0000","last_became_peered":"2024-02-17T12:16:22.315761+0000","last_unstale":"2024-02-17T12:16:24.308802+0000","last_undegraded":"2024-02-17T12:16:24.308802+0000","last_fullsized":"2024-02-17T12:16:24.308802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:49.705448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697882+0000","last_change":"2024-02-17T12:16:23.306391+0000","last_active":"2024-02-17T12:16:24.697882+0000","last_peered":"2024-02-17T12:16:24.697882+0000","last_clean":"2024-02-17T12:16:24.697882+0000","last_became_active":"2024-02-17T12:16:23.306103+0000","last_became_peered":"2024-02-17T12:16:23.306103+0000","last_unstale":"2024-02-17T12:16:24.697882+0000","last_undegraded":"2024-02-17T12:16:24.697882+0000","last_fullsized":"2024-02-17T12:16:24.697882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698509+0000","last_change":"2024-02-17T12:16:22.323792+0000","last_active":"2024-02-17T12:16:24.698509+0000","last_peered":"2024-02-17T12:16:24.698509+0000","last_clean":"2024-02-17T12:16:24.698509+0000","last_became_active":"2024-02-17T12:16:22.323508+0000","last_became_peered":"2024-02-17T12:16:22.323508+0000","last_unstale":"2024-02-17T12:16:24.698509+0000","last_undegraded":"2024-02-17T12:16:24.698509+0000","last_fullsized":"2024-02-17T12:16:24.698509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:03.944585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335206+0000","last_change":"2024-02-17T12:16:23.320721+0000","last_active":"2024-02-17T12:16:24.335206+0000","last_peered":"2024-02-17T12:16:24.335206+0000","last_clean":"2024-02-17T12:16:24.335206+0000","last_became_active":"2024-02-17T12:16:23.312733+0000","last_became_peered":"2024-02-17T12:16:23.312733+0000","last_unstale":"2024-02-17T12:16:24.335206+0000","last_undegraded":"2024-02-17T12:16:24.335206+0000","last_fullsized":"2024-02-17T12:16:24.335206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308809+0000","last_change":"2024-02-17T12:16:23.301646+0000","last_active":"2024-02-17T12:16:24.308809+0000","last_peered":"2024-02-17T12:16:24.308809+0000","last_clean":"2024-02-17T12:16:24.308809+0000","last_became_active":"2024-02-17T12:16:23.301322+0000","last_became_peered":"2024-02-17T12:16:23.301322+0000","last_unstale":"2024-02-17T12:16:24.308809+0000","last_undegraded":"2024-02-17T12:16:24.308809+0000","last_fullsized":"2024-02-17T12:16:24.308809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:46:17.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698370+0000","last_change":"2024-02-17T12:16:22.326677+0000","last_active":"2024-02-17T12:16:24.698370+0000","last_peered":"2024-02-17T12:16:24.698370+0000","last_clean":"2024-02-17T12:16:24.698370+0000","last_became_active":"2024-02-17T12:16:22.326136+0000","last_became_peered":"2024-02-17T12:16:22.326136+0000","last_unstale":"2024-02-17T12:16:24.698370+0000","last_undegraded":"2024-02-17T12:16:24.698370+0000","last_fullsized":"2024-02-17T12:16:24.698370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:34:18.512763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308731+0000","last_change":"2024-02-17T12:16:23.314407+0000","last_active":"2024-02-17T12:16:24.308731+0000","last_peered":"2024-02-17T12:16:24.308731+0000","last_clean":"2024-02-17T12:16:24.308731+0000","last_became_active":"2024-02-17T12:16:23.310090+0000","last_became_peered":"2024-02-17T12:16:23.310090+0000","last_unstale":"2024-02-17T12:16:24.308731+0000","last_undegraded":"2024-02-17T12:16:24.308731+0000","last_fullsized":"2024-02-17T12:16:24.308731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:26:24.802958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698397+0000","last_change":"2024-02-17T12:16:22.326377+0000","last_active":"2024-02-17T12:16:24.698397+0000","last_peered":"2024-02-17T12:16:24.698397+0000","last_clean":"2024-02-17T12:16:24.698397+0000","last_became_active":"2024-02-17T12:16:22.326122+0000","last_became_peered":"2024-02-17T12:16:22.326122+0000","last_unstale":"2024-02-17T12:16:24.698397+0000","last_undegraded":"2024-02-17T12:16:24.698397+0000","last_fullsized":"2024-02-17T12:16:24.698397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:58.566689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698320+0000","last_change":"2024-02-17T12:16:23.319347+0000","last_active":"2024-02-17T12:16:24.698320+0000","last_peered":"2024-02-17T12:16:24.698320+0000","last_clean":"2024-02-17T12:16:24.698320+0000","last_became_active":"2024-02-17T12:16:23.319070+0000","last_became_peered":"2024-02-17T12:16:23.319070+0000","last_unstale":"2024-02-17T12:16:24.698320+0000","last_undegraded":"2024-02-17T12:16:24.698320+0000","last_fullsized":"2024-02-17T12:16:24.698320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697633+0000","last_change":"2024-02-17T12:16:22.314871+0000","last_active":"2024-02-17T12:16:24.697633+0000","last_peered":"2024-02-17T12:16:24.697633+0000","last_clean":"2024-02-17T12:16:24.697633+0000","last_became_active":"2024-02-17T12:16:22.314596+0000","last_became_peered":"2024-02-17T12:16:22.314596+0000","last_unstale":"2024-02-17T12:16:24.697633+0000","last_undegraded":"2024-02-17T12:16:24.697633+0000","last_fullsized":"2024-02-17T12:16:24.697633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:05.491487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697334+0000","last_change":"2024-02-17T12:16:23.322438+0000","last_active":"2024-02-17T12:16:24.697334+0000","last_peered":"2024-02-17T12:16:24.697334+0000","last_clean":"2024-02-17T12:16:24.697334+0000","last_became_active":"2024-02-17T12:16:23.322009+0000","last_became_peered":"2024-02-17T12:16:23.322009+0000","last_unstale":"2024-02-17T12:16:24.697334+0000","last_undegraded":"2024-02-17T12:16:24.697334+0000","last_fullsized":"2024-02-17T12:16:24.697334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698449+0000","last_change":"2024-02-17T12:16:22.317765+0000","last_active":"2024-02-17T12:16:24.698449+0000","last_peered":"2024-02-17T12:16:24.698449+0000","last_clean":"2024-02-17T12:16:24.698449+0000","last_became_active":"2024-02-17T12:16:22.317363+0000","last_became_peered":"2024-02-17T12:16:22.317363+0000","last_unstale":"2024-02-17T12:16:24.698449+0000","last_undegraded":"2024-02-17T12:16:24.698449+0000","last_fullsized":"2024-02-17T12:16:24.698449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:07:14.946092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":72631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":663547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":663491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":72667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":72541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:16:30.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:16:30.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f8306800640 1 Processor -- start 2024-02-17T12:16:30.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f8306800640 1 -- start start 2024-02-17T12:16:30.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f8306800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300152560 0x7f83000c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f8306800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8300072b20 0x7f83000c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f8306800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83000723b0 con 0x7f83000c4760 2024-02-17T12:16:30.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f8306800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8300070000 con 0x7f8300072b20 2024-02-17T12:16:30.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f8306800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8300154dc0 con 0x7f8300152560 2024-02-17T12:16:30.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f82fea00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8300072b20 0x7f83000c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f82ff400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300152560 0x7f83000c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f82ff400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300152560 0x7f83000c17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:34680/0 (socket says 172.21.15.114:34680) 2024-02-17T12:16:30.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f82ff400640 1 -- 172.21.15.114:0/1396041898 learned_addr learned my addr 172.21.15.114:0/1396041898 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:30.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f82ff400640 1 -- 172.21.15.114:0/1396041898 >> v2:172.21.15.116:3300/0 conn(0x7f8300072b20 msgr2=0x7f83000c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:30.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f82ff400640 1 --2- 172.21.15.114:0/1396041898 >> v2:172.21.15.116:3300/0 conn(0x7f8300072b20 0x7f83000c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f82ff400640 1 -- 172.21.15.114:0/1396041898 >> v1:172.21.15.116:6789/0 conn(0x7f83000c4760 legacy=0x7f83001586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f82ff400640 1 -- 172.21.15.114:0/1396041898 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83000728e0 con 0x7f8300152560 2024-02-17T12:16:30.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.504+0000 7f82fea00640 1 --2- 172.21.15.114:0/1396041898 >> v2:172.21.15.116:3300/0 conn(0x7f8300072b20 0x7f83000c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:30.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f82ff400640 1 --2- 172.21.15.114:0/1396041898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300152560 0x7f83000c17c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009870 tx=0x7f82f001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde65dc646978574 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:30.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f82fe000640 1 -- 172.21.15.114:0/1396041898 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00ab600 con 0x7f8300152560 2024-02-17T12:16:30.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f82fe000640 1 -- 172.21.15.114:0/1396041898 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f00a7050 con 0x7f8300152560 2024-02-17T12:16:30.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f82fe000640 1 -- 172.21.15.114:0/1396041898 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00ab980 con 0x7f8300152560 2024-02-17T12:16:30.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f8306800640 1 -- 172.21.15.114:0/1396041898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300152560 msgr2=0x7f83000c17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f8306800640 1 --2- 172.21.15.114:0/1396041898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300152560 0x7f83000c17c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009870 tx=0x7f82f001c4d0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f8306800640 1 -- 172.21.15.114:0/1396041898 shutdown_connections 2024-02-17T12:16:30.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f8306800640 1 --2- 172.21.15.114:0/1396041898 >> v2:172.21.15.116:3300/0 conn(0x7f8300072b20 0x7f83000c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f8306800640 1 --2- 172.21.15.114:0/1396041898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300152560 0x7f83000c17c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f8306800640 1 -- 172.21.15.114:0/1396041898 >> 172.21.15.114:0/1396041898 conn(0x7f830006bef0 msgr2=0x7f830006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:30.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f8306800640 1 -- 172.21.15.114:0/1396041898 shutdown_connections 2024-02-17T12:16:30.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.508+0000 7f8306800640 1 -- 172.21.15.114:0/1396041898 wait complete. 2024-02-17T12:16:30.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f8306800640 1 Processor -- start 2024-02-17T12:16:30.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f8306800640 1 -- start start 2024-02-17T12:16:30.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f8306800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300072b20 0x7f8300156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f8306800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83000c4760 0x7f83000a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f8306800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8300152560 0x7f83000a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f8306800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830014a9d0 con 0x7f83000c4760 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f8306800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830014acb0 con 0x7f8300152560 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f8306800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83000aaeb0 con 0x7f8300072b20 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82fea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83000c4760 0x7f83000a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82fea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83000c4760 0x7f83000a71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57856/0 (socket says 172.21.15.114:57856) 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82fea00640 1 -- 172.21.15.114:0/817011001 learned_addr learned my addr 172.21.15.114:0/817011001 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82ffe00640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8300152560 0x7f83000a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82ff400640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300072b20 0x7f8300156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82fea00640 1 -- 172.21.15.114:0/817011001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300072b20 msgr2=0x7f8300156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82fea00640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300072b20 0x7f8300156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82fea00640 1 -- 172.21.15.114:0/817011001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8300152560 msgr2=0x7f83000a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82fea00640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8300152560 0x7f83000a76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82fea00640 1 -- 172.21.15.114:0/817011001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec009420 con 0x7f83000c4760 2024-02-17T12:16:30.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82ffe00640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8300152560 0x7f83000a76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:30.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82fea00640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83000c4760 0x7f83000a71a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00e980 tx=0x7f82ec00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:30.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82f7400640 1 -- 172.21.15.114:0/817011001 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec00ca00 con 0x7f83000c4760 2024-02-17T12:16:30.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82f7400640 1 -- 172.21.15.114:0/817011001 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec00cb60 con 0x7f83000c4760 2024-02-17T12:16:30.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f8306800640 1 -- 172.21.15.114:0/817011001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f00094d0 con 0x7f83000c4760 2024-02-17T12:16:30.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f82f7400640 1 -- 172.21.15.114:0/817011001 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec013470 con 0x7f83000c4760 2024-02-17T12:16:30.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.512+0000 7f8306800640 1 -- 172.21.15.114:0/817011001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8300151d20 con 0x7f83000c4760 2024-02-17T12:16:30.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.516+0000 7f8306800640 1 -- 172.21.15.114:0/817011001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8300067370 con 0x7f83000c4760 2024-02-17T12:16:30.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.516+0000 7f82f7400640 1 -- 172.21.15.114:0/817011001 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f82ec0135d0 con 0x7f83000c4760 2024-02-17T12:16:30.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.516+0000 7f82f7400640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f82e0066e40 0x7f82e0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.516+0000 7f82f7400640 1 -- 172.21.15.114:0/817011001 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82ec084bf0 con 0x7f83000c4760 2024-02-17T12:16:30.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.516+0000 7f82ff400640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f82e0066e40 0x7f82e0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.516+0000 7f82ff400640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f82e0066e40 0x7f82e0069300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f82f00ad000 tx=0x7f82f00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:30.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.520+0000 7f82f7400640 1 -- 172.21.15.114:0/817011001 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f82ec051b20 con 0x7f83000c4760 2024-02-17T12:16:30.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.672+0000 7f8306800640 1 -- 172.21.15.114:0/817011001 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8300159210 con 0x7f82e0066e40 2024-02-17T12:16:30.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.676+0000 7f82f7400640 1 -- 172.21.15.114:0/817011001 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264668 (secure 0 0 0) 0x7f82f00ab720 con 0x7f82e0066e40 2024-02-17T12:16:30.684 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:30.686 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:16:30.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 -- 172.21.15.114:0/817011001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f82e0066e40 msgr2=0x7f82e0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f82e0066e40 0x7f82e0069300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f82f00ad000 tx=0x7f82f00a6000 comp rx=0 tx=0).stop 2024-02-17T12:16:30.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 -- 172.21.15.114:0/817011001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83000c4760 msgr2=0x7f83000a71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83000c4760 0x7f83000a71a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00e980 tx=0x7f82ec00ee40 comp rx=0 tx=0).stop 2024-02-17T12:16:30.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 -- 172.21.15.114:0/817011001 shutdown_connections 2024-02-17T12:16:30.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8300152560 0x7f83000a76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f82e0066e40 0x7f82e0069300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83000c4760 0x7f83000a71a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 --2- 172.21.15.114:0/817011001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8300072b20 0x7f8300156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 -- 172.21.15.114:0/817011001 >> 172.21.15.114:0/817011001 conn(0x7f830006bef0 msgr2=0x7f830006c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:30.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 -- 172.21.15.114:0/817011001 shutdown_connections 2024-02-17T12:16:30.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.680+0000 7f8306800640 1 -- 172.21.15.114:0/817011001 wait complete. 2024-02-17T12:16:30.705 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-02-17T12:16:29.218682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223200,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751520,"statfs":{"total":773094113280,"available":772865556480,"internally_reserved":0,"allocated":2924544,"data_stored":1765884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.926176"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698749+0000","last_change":"2024-02-17T12:16:23.325932+0000","last_active":"2024-02-17T12:16:24.698749+0000","last_peered":"2024-02-17T12:16:24.698749+0000","last_clean":"2024-02-17T12:16:24.698749+0000","last_became_active":"2024-02-17T12:16:23.325577+0000","last_became_peered":"2024-02-17T12:16:23.325577+0000","last_unstale":"2024-02-17T12:16:24.698749+0000","last_undegraded":"2024-02-17T12:16:24.698749+0000","last_fullsized":"2024-02-17T12:16:24.698749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:47:08.390140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309102+0000","last_change":"2024-02-17T12:16:23.313730+0000","last_active":"2024-02-17T12:16:24.309102+0000","last_peered":"2024-02-17T12:16:24.309102+0000","last_clean":"2024-02-17T12:16:24.309102+0000","last_became_active":"2024-02-17T12:16:23.313417+0000","last_became_peered":"2024-02-17T12:16:23.313417+0000","last_unstale":"2024-02-17T12:16:24.309102+0000","last_undegraded":"2024-02-17T12:16:24.309102+0000","last_fullsized":"2024-02-17T12:16:24.309102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698256+0000","last_change":"2024-02-17T12:16:23.309155+0000","last_active":"2024-02-17T12:16:24.698256+0000","last_peered":"2024-02-17T12:16:24.698256+0000","last_clean":"2024-02-17T12:16:24.698256+0000","last_became_active":"2024-02-17T12:16:23.308921+0000","last_became_peered":"2024-02-17T12:16:23.308921+0000","last_unstale":"2024-02-17T12:16:24.698256+0000","last_undegraded":"2024-02-17T12:16:24.698256+0000","last_fullsized":"2024-02-17T12:16:24.698256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308527+0000","last_change":"2024-02-17T12:16:23.315338+0000","last_active":"2024-02-17T12:16:24.308527+0000","last_peered":"2024-02-17T12:16:24.308527+0000","last_clean":"2024-02-17T12:16:24.308527+0000","last_became_active":"2024-02-17T12:16:23.314200+0000","last_became_peered":"2024-02-17T12:16:23.314200+0000","last_unstale":"2024-02-17T12:16:24.308527+0000","last_undegraded":"2024-02-17T12:16:24.308527+0000","last_fullsized":"2024-02-17T12:16:24.308527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698345+0000","last_change":"2024-02-17T12:16:23.324821+0000","last_active":"2024-02-17T12:16:24.698345+0000","last_peered":"2024-02-17T12:16:24.698345+0000","last_clean":"2024-02-17T12:16:24.698345+0000","last_became_active":"2024-02-17T12:16:23.324550+0000","last_became_peered":"2024-02-17T12:16:23.324550+0000","last_unstale":"2024-02-17T12:16:24.698345+0000","last_undegraded":"2024-02-17T12:16:24.698345+0000","last_fullsized":"2024-02-17T12:16:24.698345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:19:19.892946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309180+0000","last_change":"2024-02-17T12:16:23.305539+0000","last_active":"2024-02-17T12:16:24.309180+0000","last_peered":"2024-02-17T12:16:24.309180+0000","last_clean":"2024-02-17T12:16:24.309180+0000","last_became_active":"2024-02-17T12:16:23.304577+0000","last_became_peered":"2024-02-17T12:16:23.304577+0000","last_unstale":"2024-02-17T12:16:24.309180+0000","last_undegraded":"2024-02-17T12:16:24.309180+0000","last_fullsized":"2024-02-17T12:16:24.309180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:37:01.247987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698159+0000","last_change":"2024-02-17T12:16:23.319882+0000","last_active":"2024-02-17T12:16:24.698159+0000","last_peered":"2024-02-17T12:16:24.698159+0000","last_clean":"2024-02-17T12:16:24.698159+0000","last_became_active":"2024-02-17T12:16:23.319575+0000","last_became_peered":"2024-02-17T12:16:23.319575+0000","last_unstale":"2024-02-17T12:16:24.698159+0000","last_undegraded":"2024-02-17T12:16:24.698159+0000","last_fullsized":"2024-02-17T12:16:24.698159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:45.202150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697223+0000","last_change":"2024-02-17T12:16:23.322275+0000","last_active":"2024-02-17T12:16:24.697223+0000","last_peered":"2024-02-17T12:16:24.697223+0000","last_clean":"2024-02-17T12:16:24.697223+0000","last_became_active":"2024-02-17T12:16:23.321923+0000","last_became_peered":"2024-02-17T12:16:23.321923+0000","last_unstale":"2024-02-17T12:16:24.697223+0000","last_undegraded":"2024-02-17T12:16:24.697223+0000","last_fullsized":"2024-02-17T12:16:24.697223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:05:10.254057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698799+0000","last_change":"2024-02-17T12:16:23.326757+0000","last_active":"2024-02-17T12:16:24.698799+0000","last_peered":"2024-02-17T12:16:24.698799+0000","last_clean":"2024-02-17T12:16:24.698799+0000","last_became_active":"2024-02-17T12:16:23.326481+0000","last_became_peered":"2024-02-17T12:16:23.326481+0000","last_unstale":"2024-02-17T12:16:24.698799+0000","last_undegraded":"2024-02-17T12:16:24.698799+0000","last_fullsized":"2024-02-17T12:16:24.698799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:17:49.372854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335654+0000","last_change":"2024-02-17T12:16:23.321138+0000","last_active":"2024-02-17T12:16:24.335654+0000","last_peered":"2024-02-17T12:16:24.335654+0000","last_clean":"2024-02-17T12:16:24.335654+0000","last_became_active":"2024-02-17T12:16:23.320619+0000","last_became_peered":"2024-02-17T12:16:23.320619+0000","last_unstale":"2024-02-17T12:16:24.335654+0000","last_undegraded":"2024-02-17T12:16:24.335654+0000","last_fullsized":"2024-02-17T12:16:24.335654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335398+0000","last_change":"2024-02-17T12:16:23.318226+0000","last_active":"2024-02-17T12:16:24.335398+0000","last_peered":"2024-02-17T12:16:24.335398+0000","last_clean":"2024-02-17T12:16:24.335398+0000","last_became_active":"2024-02-17T12:16:23.317955+0000","last_became_peered":"2024-02-17T12:16:23.317955+0000","last_unstale":"2024-02-17T12:16:24.335398+0000","last_undegraded":"2024-02-17T12:16:24.335398+0000","last_fullsized":"2024-02-17T12:16:24.335398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.310180+0000","last_change":"2024-02-17T12:16:23.319482+0000","last_active":"2024-02-17T12:16:24.310180+0000","last_peered":"2024-02-17T12:16:24.310180+0000","last_clean":"2024-02-17T12:16:24.310180+0000","last_became_active":"2024-02-17T12:16:23.318713+0000","last_became_peered":"2024-02-17T12:16:23.318713+0000","last_unstale":"2024-02-17T12:16:24.310180+0000","last_undegraded":"2024-02-17T12:16:24.310180+0000","last_fullsized":"2024-02-17T12:16:24.310180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:04.950428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697727+0000","last_change":"2024-02-17T12:16:23.322232+0000","last_active":"2024-02-17T12:16:24.697727+0000","last_peered":"2024-02-17T12:16:24.697727+0000","last_clean":"2024-02-17T12:16:24.697727+0000","last_became_active":"2024-02-17T12:16:23.321953+0000","last_became_peered":"2024-02-17T12:16:23.321953+0000","last_unstale":"2024-02-17T12:16:24.697727+0000","last_undegraded":"2024-02-17T12:16:24.697727+0000","last_fullsized":"2024-02-17T12:16:24.697727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697309+0000","last_change":"2024-02-17T12:16:23.305025+0000","last_active":"2024-02-17T12:16:24.697309+0000","last_peered":"2024-02-17T12:16:24.697309+0000","last_clean":"2024-02-17T12:16:24.697309+0000","last_became_active":"2024-02-17T12:16:23.303792+0000","last_became_peered":"2024-02-17T12:16:23.303792+0000","last_unstale":"2024-02-17T12:16:24.697309+0000","last_undegraded":"2024-02-17T12:16:24.697309+0000","last_fullsized":"2024-02-17T12:16:24.697309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:14.503722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308712+0000","last_change":"2024-02-17T12:16:23.318017+0000","last_active":"2024-02-17T12:16:24.308712+0000","last_peered":"2024-02-17T12:16:24.308712+0000","last_clean":"2024-02-17T12:16:24.308712+0000","last_became_active":"2024-02-17T12:16:23.317749+0000","last_became_peered":"2024-02-17T12:16:23.317749+0000","last_unstale":"2024-02-17T12:16:24.308712+0000","last_undegraded":"2024-02-17T12:16:24.308712+0000","last_fullsized":"2024-02-17T12:16:24.308712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308269+0000","last_change":"2024-02-17T12:16:23.299929+0000","last_active":"2024-02-17T12:16:24.308269+0000","last_peered":"2024-02-17T12:16:24.308269+0000","last_clean":"2024-02-17T12:16:24.308269+0000","last_became_active":"2024-02-17T12:16:23.299612+0000","last_became_peered":"2024-02-17T12:16:23.299612+0000","last_unstale":"2024-02-17T12:16:24.308269+0000","last_undegraded":"2024-02-17T12:16:24.308269+0000","last_fullsized":"2024-02-17T12:16:24.308269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309347+0000","last_change":"2024-02-17T12:16:23.314723+0000","last_active":"2024-02-17T12:16:24.309347+0000","last_peered":"2024-02-17T12:16:24.309347+0000","last_clean":"2024-02-17T12:16:24.309347+0000","last_became_active":"2024-02-17T12:16:23.310139+0000","last_became_peered":"2024-02-17T12:16:23.310139+0000","last_unstale":"2024-02-17T12:16:24.309347+0000","last_undegraded":"2024-02-17T12:16:24.309347+0000","last_fullsized":"2024-02-17T12:16:24.309347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:51:35.647773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696669+0000","last_change":"2024-02-17T12:16:23.312040+0000","last_active":"2024-02-17T12:16:24.696669+0000","last_peered":"2024-02-17T12:16:24.696669+0000","last_clean":"2024-02-17T12:16:24.696669+0000","last_became_active":"2024-02-17T12:16:23.311701+0000","last_became_peered":"2024-02-17T12:16:23.311701+0000","last_unstale":"2024-02-17T12:16:24.696669+0000","last_undegraded":"2024-02-17T12:16:24.696669+0000","last_fullsized":"2024-02-17T12:16:24.696669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:04.950428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698608+0000","last_change":"2024-02-17T12:16:23.317094+0000","last_active":"2024-02-17T12:16:24.698608+0000","last_peered":"2024-02-17T12:16:24.698608+0000","last_clean":"2024-02-17T12:16:24.698608+0000","last_became_active":"2024-02-17T12:16:23.316715+0000","last_became_peered":"2024-02-17T12:16:23.316715+0000","last_unstale":"2024-02-17T12:16:24.698608+0000","last_undegraded":"2024-02-17T12:16:24.698608+0000","last_fullsized":"2024-02-17T12:16:24.698608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:30.580521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335321+0000","last_change":"2024-02-17T12:16:23.314602+0000","last_active":"2024-02-17T12:16:24.335321+0000","last_peered":"2024-02-17T12:16:24.335321+0000","last_clean":"2024-02-17T12:16:24.335321+0000","last_became_active":"2024-02-17T12:16:23.310646+0000","last_became_peered":"2024-02-17T12:16:23.310646+0000","last_unstale":"2024-02-17T12:16:24.335321+0000","last_undegraded":"2024-02-17T12:16:24.335321+0000","last_fullsized":"2024-02-17T12:16:24.335321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697556+0000","last_change":"2024-02-17T12:16:23.314985+0000","last_active":"2024-02-17T12:16:24.697556+0000","last_peered":"2024-02-17T12:16:24.697556+0000","last_clean":"2024-02-17T12:16:24.697556+0000","last_became_active":"2024-02-17T12:16:23.314105+0000","last_became_peered":"2024-02-17T12:16:23.314105+0000","last_unstale":"2024-02-17T12:16:24.697556+0000","last_undegraded":"2024-02-17T12:16:24.697556+0000","last_fullsized":"2024-02-17T12:16:24.697556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308459+0000","last_change":"2024-02-17T12:16:23.316273+0000","last_active":"2024-02-17T12:16:24.308459+0000","last_peered":"2024-02-17T12:16:24.308459+0000","last_clean":"2024-02-17T12:16:24.308459+0000","last_became_active":"2024-02-17T12:16:23.315991+0000","last_became_peered":"2024-02-17T12:16:23.315991+0000","last_unstale":"2024-02-17T12:16:24.308459+0000","last_undegraded":"2024-02-17T12:16:24.308459+0000","last_fullsized":"2024-02-17T12:16:24.308459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697276+0000","last_change":"2024-02-17T12:16:23.310525+0000","last_active":"2024-02-17T12:16:24.697276+0000","last_peered":"2024-02-17T12:16:24.697276+0000","last_clean":"2024-02-17T12:16:24.697276+0000","last_became_active":"2024-02-17T12:16:23.309291+0000","last_became_peered":"2024-02-17T12:16:23.309291+0000","last_unstale":"2024-02-17T12:16:24.697276+0000","last_undegraded":"2024-02-17T12:16:24.697276+0000","last_fullsized":"2024-02-17T12:16:24.697276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308457+0000","last_change":"2024-02-17T12:16:23.319218+0000","last_active":"2024-02-17T12:16:24.308457+0000","last_peered":"2024-02-17T12:16:24.308457+0000","last_clean":"2024-02-17T12:16:24.308457+0000","last_became_active":"2024-02-17T12:16:23.310787+0000","last_became_peered":"2024-02-17T12:16:23.310787+0000","last_unstale":"2024-02-17T12:16:24.308457+0000","last_undegraded":"2024-02-17T12:16:24.308457+0000","last_fullsized":"2024-02-17T12:16:24.308457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697807+0000","last_change":"2024-02-17T12:16:23.310020+0000","last_active":"2024-02-17T12:16:24.697807+0000","last_peered":"2024-02-17T12:16:24.697807+0000","last_clean":"2024-02-17T12:16:24.697807+0000","last_became_active":"2024-02-17T12:16:23.309245+0000","last_became_peered":"2024-02-17T12:16:23.309245+0000","last_unstale":"2024-02-17T12:16:24.697807+0000","last_undegraded":"2024-02-17T12:16:24.697807+0000","last_fullsized":"2024-02-17T12:16:24.697807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335664+0000","last_change":"2024-02-17T12:16:23.321247+0000","last_active":"2024-02-17T12:16:24.335664+0000","last_peered":"2024-02-17T12:16:24.335664+0000","last_clean":"2024-02-17T12:16:24.335664+0000","last_became_active":"2024-02-17T12:16:23.312610+0000","last_became_peered":"2024-02-17T12:16:23.312610+0000","last_unstale":"2024-02-17T12:16:24.335664+0000","last_undegraded":"2024-02-17T12:16:24.335664+0000","last_fullsized":"2024-02-17T12:16:24.335664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308908+0000","last_change":"2024-02-17T12:16:23.316684+0000","last_active":"2024-02-17T12:16:24.308908+0000","last_peered":"2024-02-17T12:16:24.308908+0000","last_clean":"2024-02-17T12:16:24.308908+0000","last_became_active":"2024-02-17T12:16:23.316394+0000","last_became_peered":"2024-02-17T12:16:23.316394+0000","last_unstale":"2024-02-17T12:16:24.308908+0000","last_undegraded":"2024-02-17T12:16:24.308908+0000","last_fullsized":"2024-02-17T12:16:24.308908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698031+0000","last_change":"2024-02-17T12:16:23.316206+0000","last_active":"2024-02-17T12:16:24.698031+0000","last_peered":"2024-02-17T12:16:24.698031+0000","last_clean":"2024-02-17T12:16:24.698031+0000","last_became_active":"2024-02-17T12:16:23.315874+0000","last_became_peered":"2024-02-17T12:16:23.315874+0000","last_unstale":"2024-02-17T12:16:24.698031+0000","last_undegraded":"2024-02-17T12:16:24.698031+0000","last_fullsized":"2024-02-17T12:16:24.698031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:26:24.802958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697690+0000","last_change":"2024-02-17T12:16:23.307339+0000","last_active":"2024-02-17T12:16:24.697690+0000","last_peered":"2024-02-17T12:16:24.697690+0000","last_clean":"2024-02-17T12:16:24.697690+0000","last_became_active":"2024-02-17T12:16:23.306943+0000","last_became_peered":"2024-02-17T12:16:23.306943+0000","last_unstale":"2024-02-17T12:16:24.697690+0000","last_undegraded":"2024-02-17T12:16:24.697690+0000","last_fullsized":"2024-02-17T12:16:24.697690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308650+0000","last_change":"2024-02-17T12:16:23.304998+0000","last_active":"2024-02-17T12:16:24.308650+0000","last_peered":"2024-02-17T12:16:24.308650+0000","last_clean":"2024-02-17T12:16:24.308650+0000","last_became_active":"2024-02-17T12:16:23.304059+0000","last_became_peered":"2024-02-17T12:16:23.304059+0000","last_unstale":"2024-02-17T12:16:24.308650+0000","last_undegraded":"2024-02-17T12:16:24.308650+0000","last_fullsized":"2024-02-17T12:16:24.308650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696623+0000","last_change":"2024-02-17T12:16:23.315379+0000","last_active":"2024-02-17T12:16:24.696623+0000","last_peered":"2024-02-17T12:16:24.696623+0000","last_clean":"2024-02-17T12:16:24.696623+0000","last_became_active":"2024-02-17T12:16:23.309626+0000","last_became_peered":"2024-02-17T12:16:23.309626+0000","last_unstale":"2024-02-17T12:16:24.696623+0000","last_undegraded":"2024-02-17T12:16:24.696623+0000","last_fullsized":"2024-02-17T12:16:24.696623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:44:56.735146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335196+0000","last_change":"2024-02-17T12:16:23.320903+0000","last_active":"2024-02-17T12:16:24.335196+0000","last_peered":"2024-02-17T12:16:24.335196+0000","last_clean":"2024-02-17T12:16:24.335196+0000","last_became_active":"2024-02-17T12:16:23.312623+0000","last_became_peered":"2024-02-17T12:16:23.312623+0000","last_unstale":"2024-02-17T12:16:24.335196+0000","last_undegraded":"2024-02-17T12:16:24.335196+0000","last_fullsized":"2024-02-17T12:16:24.335196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309854+0000","last_change":"2024-02-17T12:16:23.306808+0000","last_active":"2024-02-17T12:16:24.309854+0000","last_peered":"2024-02-17T12:16:24.309854+0000","last_clean":"2024-02-17T12:16:24.309854+0000","last_became_active":"2024-02-17T12:16:23.306117+0000","last_became_peered":"2024-02-17T12:16:23.306117+0000","last_unstale":"2024-02-17T12:16:24.309854+0000","last_undegraded":"2024-02-17T12:16:24.309854+0000","last_fullsized":"2024-02-17T12:16:24.309854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:16.035071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697993+0000","last_change":"2024-02-17T12:16:22.314696+0000","last_active":"2024-02-17T12:16:24.697993+0000","last_peered":"2024-02-17T12:16:24.697993+0000","last_clean":"2024-02-17T12:16:24.697993+0000","last_became_active":"2024-02-17T12:16:22.314066+0000","last_became_peered":"2024-02-17T12:16:22.314066+0000","last_unstale":"2024-02-17T12:16:24.697993+0000","last_undegraded":"2024-02-17T12:16:24.697993+0000","last_fullsized":"2024-02-17T12:16:24.697993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:07:14.946092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697825+0000","last_change":"2024-02-17T12:16:23.303172+0000","last_active":"2024-02-17T12:16:24.697825+0000","last_peered":"2024-02-17T12:16:24.697825+0000","last_clean":"2024-02-17T12:16:24.697825+0000","last_became_active":"2024-02-17T12:16:23.302807+0000","last_became_peered":"2024-02-17T12:16:23.302807+0000","last_unstale":"2024-02-17T12:16:24.697825+0000","last_undegraded":"2024-02-17T12:16:24.697825+0000","last_fullsized":"2024-02-17T12:16:24.697825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335506+0000","last_change":"2024-02-17T12:16:22.314969+0000","last_active":"2024-02-17T12:16:24.335506+0000","last_peered":"2024-02-17T12:16:24.335506+0000","last_clean":"2024-02-17T12:16:24.335506+0000","last_became_active":"2024-02-17T12:16:22.313531+0000","last_became_peered":"2024-02-17T12:16:22.313531+0000","last_unstale":"2024-02-17T12:16:24.335506+0000","last_undegraded":"2024-02-17T12:16:24.335506+0000","last_fullsized":"2024-02-17T12:16:24.335506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697645+0000","last_change":"2024-02-17T12:16:22.311648+0000","last_active":"2024-02-17T12:16:24.697645+0000","last_peered":"2024-02-17T12:16:24.697645+0000","last_clean":"2024-02-17T12:16:24.697645+0000","last_became_active":"2024-02-17T12:16:22.311355+0000","last_became_peered":"2024-02-17T12:16:22.311355+0000","last_unstale":"2024-02-17T12:16:24.697645+0000","last_undegraded":"2024-02-17T12:16:24.697645+0000","last_fullsized":"2024-02-17T12:16:24.697645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:43.722209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697379+0000","last_change":"2024-02-17T12:16:23.311561+0000","last_active":"2024-02-17T12:16:24.697379+0000","last_peered":"2024-02-17T12:16:24.697379+0000","last_clean":"2024-02-17T12:16:24.697379+0000","last_became_active":"2024-02-17T12:16:23.311338+0000","last_became_peered":"2024-02-17T12:16:23.311338+0000","last_unstale":"2024-02-17T12:16:24.697379+0000","last_undegraded":"2024-02-17T12:16:24.697379+0000","last_fullsized":"2024-02-17T12:16:24.697379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:50:05.379219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308598+0000","last_change":"2024-02-17T12:16:22.315021+0000","last_active":"2024-02-17T12:16:24.308598+0000","last_peered":"2024-02-17T12:16:24.308598+0000","last_clean":"2024-02-17T12:16:24.308598+0000","last_became_active":"2024-02-17T12:16:22.314690+0000","last_became_peered":"2024-02-17T12:16:22.314690+0000","last_unstale":"2024-02-17T12:16:24.308598+0000","last_undegraded":"2024-02-17T12:16:24.308598+0000","last_fullsized":"2024-02-17T12:16:24.308598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:49.705448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308577+0000","last_change":"2024-02-17T12:16:23.312450+0000","last_active":"2024-02-17T12:16:24.308577+0000","last_peered":"2024-02-17T12:16:24.308577+0000","last_clean":"2024-02-17T12:16:24.308577+0000","last_became_active":"2024-02-17T12:16:23.312162+0000","last_became_peered":"2024-02-17T12:16:23.312162+0000","last_unstale":"2024-02-17T12:16:24.308577+0000","last_undegraded":"2024-02-17T12:16:24.308577+0000","last_fullsized":"2024-02-17T12:16:24.308577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:17:45.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335521+0000","last_change":"2024-02-17T12:16:22.316581+0000","last_active":"2024-02-17T12:16:24.335521+0000","last_peered":"2024-02-17T12:16:24.335521+0000","last_clean":"2024-02-17T12:16:24.335521+0000","last_became_active":"2024-02-17T12:16:22.316238+0000","last_became_peered":"2024-02-17T12:16:22.316238+0000","last_unstale":"2024-02-17T12:16:24.335521+0000","last_undegraded":"2024-02-17T12:16:24.335521+0000","last_fullsized":"2024-02-17T12:16:24.335521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:41.148188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309008+0000","last_change":"2024-02-17T12:16:23.313962+0000","last_active":"2024-02-17T12:16:24.309008+0000","last_peered":"2024-02-17T12:16:24.309008+0000","last_clean":"2024-02-17T12:16:24.309008+0000","last_became_active":"2024-02-17T12:16:23.313661+0000","last_became_peered":"2024-02-17T12:16:23.313661+0000","last_unstale":"2024-02-17T12:16:24.309008+0000","last_undegraded":"2024-02-17T12:16:24.309008+0000","last_fullsized":"2024-02-17T12:16:24.309008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:25:31.899460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309088+0000","last_change":"2024-02-17T12:16:22.312851+0000","last_active":"2024-02-17T12:16:24.309088+0000","last_peered":"2024-02-17T12:16:24.309088+0000","last_clean":"2024-02-17T12:16:24.309088+0000","last_became_active":"2024-02-17T12:16:22.312536+0000","last_became_peered":"2024-02-17T12:16:22.312536+0000","last_unstale":"2024-02-17T12:16:24.309088+0000","last_undegraded":"2024-02-17T12:16:24.309088+0000","last_fullsized":"2024-02-17T12:16:24.309088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:49:36.146858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698343+0000","last_change":"2024-02-17T12:16:23.319340+0000","last_active":"2024-02-17T12:16:24.698343+0000","last_peered":"2024-02-17T12:16:24.698343+0000","last_clean":"2024-02-17T12:16:24.698343+0000","last_became_active":"2024-02-17T12:16:23.318684+0000","last_became_peered":"2024-02-17T12:16:23.318684+0000","last_unstale":"2024-02-17T12:16:24.698343+0000","last_undegraded":"2024-02-17T12:16:24.698343+0000","last_fullsized":"2024-02-17T12:16:24.698343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:00:08.665121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308813+0000","last_change":"2024-02-17T12:16:22.313946+0000","last_active":"2024-02-17T12:16:24.308813+0000","last_peered":"2024-02-17T12:16:24.308813+0000","last_clean":"2024-02-17T12:16:24.308813+0000","last_became_active":"2024-02-17T12:16:22.313538+0000","last_became_peered":"2024-02-17T12:16:22.313538+0000","last_unstale":"2024-02-17T12:16:24.308813+0000","last_undegraded":"2024-02-17T12:16:24.308813+0000","last_fullsized":"2024-02-17T12:16:24.308813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.310265+0000","last_change":"2024-02-17T12:16:23.319708+0000","last_active":"2024-02-17T12:16:24.310265+0000","last_peered":"2024-02-17T12:16:24.310265+0000","last_clean":"2024-02-17T12:16:24.310265+0000","last_became_active":"2024-02-17T12:16:23.319152+0000","last_became_peered":"2024-02-17T12:16:23.319152+0000","last_unstale":"2024-02-17T12:16:24.310265+0000","last_undegraded":"2024-02-17T12:16:24.310265+0000","last_fullsized":"2024-02-17T12:16:24.310265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:59.572532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335292+0000","last_change":"2024-02-17T12:16:22.316733+0000","last_active":"2024-02-17T12:16:24.335292+0000","last_peered":"2024-02-17T12:16:24.335292+0000","last_clean":"2024-02-17T12:16:24.335292+0000","last_became_active":"2024-02-17T12:16:22.316383+0000","last_became_peered":"2024-02-17T12:16:22.316383+0000","last_unstale":"2024-02-17T12:16:24.335292+0000","last_undegraded":"2024-02-17T12:16:24.335292+0000","last_fullsized":"2024-02-17T12:16:24.335292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:53.726477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698406+0000","last_change":"2024-02-17T12:16:23.326192+0000","last_active":"2024-02-17T12:16:24.698406+0000","last_peered":"2024-02-17T12:16:24.698406+0000","last_clean":"2024-02-17T12:16:24.698406+0000","last_became_active":"2024-02-17T12:16:23.325827+0000","last_became_peered":"2024-02-17T12:16:23.325827+0000","last_unstale":"2024-02-17T12:16:24.698406+0000","last_undegraded":"2024-02-17T12:16:24.698406+0000","last_fullsized":"2024-02-17T12:16:24.698406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:59:06.137893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697923+0000","last_change":"2024-02-17T12:16:22.310529+0000","last_active":"2024-02-17T12:16:24.697923+0000","last_peered":"2024-02-17T12:16:24.697923+0000","last_clean":"2024-02-17T12:16:24.697923+0000","last_became_active":"2024-02-17T12:16:22.310162+0000","last_became_peered":"2024-02-17T12:16:22.310162+0000","last_unstale":"2024-02-17T12:16:24.697923+0000","last_undegraded":"2024-02-17T12:16:24.697923+0000","last_fullsized":"2024-02-17T12:16:24.697923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:43.722209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697455+0000","last_change":"2024-02-17T12:16:23.313637+0000","last_active":"2024-02-17T12:16:24.697455+0000","last_peered":"2024-02-17T12:16:24.697455+0000","last_clean":"2024-02-17T12:16:24.697455+0000","last_became_active":"2024-02-17T12:16:23.313038+0000","last_became_peered":"2024-02-17T12:16:23.313038+0000","last_unstale":"2024-02-17T12:16:24.697455+0000","last_undegraded":"2024-02-17T12:16:24.697455+0000","last_fullsized":"2024-02-17T12:16:24.697455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:05:10.254057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308728+0000","last_change":"2024-02-17T12:16:22.315490+0000","last_active":"2024-02-17T12:16:24.308728+0000","last_peered":"2024-02-17T12:16:24.308728+0000","last_clean":"2024-02-17T12:16:24.308728+0000","last_became_active":"2024-02-17T12:16:22.315194+0000","last_became_peered":"2024-02-17T12:16:22.315194+0000","last_unstale":"2024-02-17T12:16:24.308728+0000","last_undegraded":"2024-02-17T12:16:24.308728+0000","last_fullsized":"2024-02-17T12:16:24.308728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698526+0000","last_change":"2024-02-17T12:16:23.324173+0000","last_active":"2024-02-17T12:16:24.698526+0000","last_peered":"2024-02-17T12:16:24.698526+0000","last_clean":"2024-02-17T12:16:24.698526+0000","last_became_active":"2024-02-17T12:16:23.323675+0000","last_became_peered":"2024-02-17T12:16:23.323675+0000","last_unstale":"2024-02-17T12:16:24.698526+0000","last_undegraded":"2024-02-17T12:16:24.698526+0000","last_fullsized":"2024-02-17T12:16:24.698526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:41:30.733177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335182+0000","last_change":"2024-02-17T12:16:22.316662+0000","last_active":"2024-02-17T12:16:24.335182+0000","last_peered":"2024-02-17T12:16:24.335182+0000","last_clean":"2024-02-17T12:16:24.335182+0000","last_became_active":"2024-02-17T12:16:22.315202+0000","last_became_peered":"2024-02-17T12:16:22.315202+0000","last_unstale":"2024-02-17T12:16:24.335182+0000","last_undegraded":"2024-02-17T12:16:24.335182+0000","last_fullsized":"2024-02-17T12:16:24.335182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335242+0000","last_change":"2024-02-17T12:16:23.320591+0000","last_active":"2024-02-17T12:16:24.335242+0000","last_peered":"2024-02-17T12:16:24.335242+0000","last_clean":"2024-02-17T12:16:24.335242+0000","last_became_active":"2024-02-17T12:16:23.312514+0000","last_became_peered":"2024-02-17T12:16:23.312514+0000","last_unstale":"2024-02-17T12:16:24.335242+0000","last_undegraded":"2024-02-17T12:16:24.335242+0000","last_fullsized":"2024-02-17T12:16:24.335242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696452+0000","last_change":"2024-02-17T12:16:22.302813+0000","last_active":"2024-02-17T12:16:24.696452+0000","last_peered":"2024-02-17T12:16:24.696452+0000","last_clean":"2024-02-17T12:16:24.696452+0000","last_became_active":"2024-02-17T12:16:22.302538+0000","last_became_peered":"2024-02-17T12:16:22.302538+0000","last_unstale":"2024-02-17T12:16:24.696452+0000","last_undegraded":"2024-02-17T12:16:24.696452+0000","last_fullsized":"2024-02-17T12:16:24.696452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:49:52.576082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698135+0000","last_change":"2024-02-17T12:16:23.325642+0000","last_active":"2024-02-17T12:16:24.698135+0000","last_peered":"2024-02-17T12:16:24.698135+0000","last_clean":"2024-02-17T12:16:24.698135+0000","last_became_active":"2024-02-17T12:16:23.324419+0000","last_became_peered":"2024-02-17T12:16:23.324419+0000","last_unstale":"2024-02-17T12:16:24.698135+0000","last_undegraded":"2024-02-17T12:16:24.698135+0000","last_fullsized":"2024-02-17T12:16:24.698135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:46:56.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.310158+0000","last_change":"2024-02-17T12:16:22.311089+0000","last_active":"2024-02-17T12:16:24.310158+0000","last_peered":"2024-02-17T12:16:24.310158+0000","last_clean":"2024-02-17T12:16:24.310158+0000","last_became_active":"2024-02-17T12:16:22.310811+0000","last_became_peered":"2024-02-17T12:16:22.310811+0000","last_unstale":"2024-02-17T12:16:24.310158+0000","last_undegraded":"2024-02-17T12:16:24.310158+0000","last_fullsized":"2024-02-17T12:16:24.310158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:21:58.929168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698671+0000","last_change":"2024-02-17T12:16:23.327054+0000","last_active":"2024-02-17T12:16:24.698671+0000","last_peered":"2024-02-17T12:16:24.698671+0000","last_clean":"2024-02-17T12:16:24.698671+0000","last_became_active":"2024-02-17T12:16:23.325063+0000","last_became_peered":"2024-02-17T12:16:23.325063+0000","last_unstale":"2024-02-17T12:16:24.698671+0000","last_undegraded":"2024-02-17T12:16:24.698671+0000","last_fullsized":"2024-02-17T12:16:24.698671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:50:48.082740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696762+0000","last_change":"2024-02-17T12:16:22.307414+0000","last_active":"2024-02-17T12:16:24.696762+0000","last_peered":"2024-02-17T12:16:24.696762+0000","last_clean":"2024-02-17T12:16:24.696762+0000","last_became_active":"2024-02-17T12:16:22.306916+0000","last_became_peered":"2024-02-17T12:16:22.306916+0000","last_unstale":"2024-02-17T12:16:24.696762+0000","last_undegraded":"2024-02-17T12:16:24.696762+0000","last_fullsized":"2024-02-17T12:16:24.696762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:05:01.918619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698853+0000","last_change":"2024-02-17T12:16:23.327878+0000","last_active":"2024-02-17T12:16:24.698853+0000","last_peered":"2024-02-17T12:16:24.698853+0000","last_clean":"2024-02-17T12:16:24.698853+0000","last_became_active":"2024-02-17T12:16:23.327225+0000","last_became_peered":"2024-02-17T12:16:23.327225+0000","last_unstale":"2024-02-17T12:16:24.698853+0000","last_undegraded":"2024-02-17T12:16:24.698853+0000","last_fullsized":"2024-02-17T12:16:24.698853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:24:19.386618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308913+0000","last_change":"2024-02-17T12:16:22.314711+0000","last_active":"2024-02-17T12:16:24.308913+0000","last_peered":"2024-02-17T12:16:24.308913+0000","last_clean":"2024-02-17T12:16:24.308913+0000","last_became_active":"2024-02-17T12:16:22.314441+0000","last_became_peered":"2024-02-17T12:16:22.314441+0000","last_unstale":"2024-02-17T12:16:24.308913+0000","last_undegraded":"2024-02-17T12:16:24.308913+0000","last_fullsized":"2024-02-17T12:16:24.308913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:53.726477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308939+0000","last_change":"2024-02-17T12:16:23.315096+0000","last_active":"2024-02-17T12:16:24.308939+0000","last_peered":"2024-02-17T12:16:24.308939+0000","last_clean":"2024-02-17T12:16:24.308939+0000","last_became_active":"2024-02-17T12:16:23.309975+0000","last_became_peered":"2024-02-17T12:16:23.309975+0000","last_unstale":"2024-02-17T12:16:24.308939+0000","last_undegraded":"2024-02-17T12:16:24.308939+0000","last_fullsized":"2024-02-17T12:16:24.308939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:18:14.299788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696630+0000","last_change":"2024-02-17T12:16:22.310563+0000","last_active":"2024-02-17T12:16:24.696630+0000","last_peered":"2024-02-17T12:16:24.696630+0000","last_clean":"2024-02-17T12:16:24.696630+0000","last_became_active":"2024-02-17T12:16:22.310275+0000","last_became_peered":"2024-02-17T12:16:22.310275+0000","last_unstale":"2024-02-17T12:16:24.696630+0000","last_undegraded":"2024-02-17T12:16:24.696630+0000","last_fullsized":"2024-02-17T12:16:24.696630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:46:25.452272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698281+0000","last_change":"2024-02-17T12:16:23.330066+0000","last_active":"2024-02-17T12:16:24.698281+0000","last_peered":"2024-02-17T12:16:24.698281+0000","last_clean":"2024-02-17T12:16:24.698281+0000","last_became_active":"2024-02-17T12:16:23.329816+0000","last_became_peered":"2024-02-17T12:16:23.329816+0000","last_unstale":"2024-02-17T12:16:24.698281+0000","last_undegraded":"2024-02-17T12:16:24.698281+0000","last_fullsized":"2024-02-17T12:16:24.698281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:04:38.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698181+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:16:24.698181+0000","last_peered":"2024-02-17T12:16:24.698181+0000","last_clean":"2024-02-17T12:16:24.698181+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:16:24.698181+0000","last_undegraded":"2024-02-17T12:16:24.698181+0000","last_fullsized":"2024-02-17T12:16:24.698181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308410+0000","last_change":"2024-02-17T12:16:22.308615+0000","last_active":"2024-02-17T12:16:24.308410+0000","last_peered":"2024-02-17T12:16:24.308410+0000","last_clean":"2024-02-17T12:16:24.308410+0000","last_became_active":"2024-02-17T12:16:22.308153+0000","last_became_peered":"2024-02-17T12:16:22.308153+0000","last_unstale":"2024-02-17T12:16:24.308410+0000","last_undegraded":"2024-02-17T12:16:24.308410+0000","last_fullsized":"2024-02-17T12:16:24.308410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:05.491487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697598+0000","last_change":"2024-02-17T12:16:23.311520+0000","last_active":"2024-02-17T12:16:24.697598+0000","last_peered":"2024-02-17T12:16:24.697598+0000","last_clean":"2024-02-17T12:16:24.697598+0000","last_became_active":"2024-02-17T12:16:23.311139+0000","last_became_peered":"2024-02-17T12:16:23.311139+0000","last_unstale":"2024-02-17T12:16:24.697598+0000","last_undegraded":"2024-02-17T12:16:24.697598+0000","last_fullsized":"2024-02-17T12:16:24.697598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698033+0000","last_change":"2024-02-17T12:16:22.324920+0000","last_active":"2024-02-17T12:16:24.698033+0000","last_peered":"2024-02-17T12:16:24.698033+0000","last_clean":"2024-02-17T12:16:24.698033+0000","last_became_active":"2024-02-17T12:16:22.324670+0000","last_became_peered":"2024-02-17T12:16:22.324670+0000","last_unstale":"2024-02-17T12:16:24.698033+0000","last_undegraded":"2024-02-17T12:16:24.698033+0000","last_fullsized":"2024-02-17T12:16:24.698033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:44:55.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697257+0000","last_change":"2024-02-17T12:16:23.303047+0000","last_active":"2024-02-17T12:16:24.697257+0000","last_peered":"2024-02-17T12:16:24.697257+0000","last_clean":"2024-02-17T12:16:24.697257+0000","last_became_active":"2024-02-17T12:16:23.302661+0000","last_became_peered":"2024-02-17T12:16:23.302661+0000","last_unstale":"2024-02-17T12:16:24.697257+0000","last_undegraded":"2024-02-17T12:16:24.697257+0000","last_fullsized":"2024-02-17T12:16:24.697257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:44:54.619964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.696722+0000","last_change":"2024-02-17T12:16:22.308200+0000","last_active":"2024-02-17T12:16:24.696722+0000","last_peered":"2024-02-17T12:16:24.696722+0000","last_clean":"2024-02-17T12:16:24.696722+0000","last_became_active":"2024-02-17T12:16:22.307887+0000","last_became_peered":"2024-02-17T12:16:22.307887+0000","last_unstale":"2024-02-17T12:16:24.696722+0000","last_undegraded":"2024-02-17T12:16:24.696722+0000","last_fullsized":"2024-02-17T12:16:24.696722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:03.723225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308610+0000","last_change":"2024-02-17T12:16:23.312512+0000","last_active":"2024-02-17T12:16:24.308610+0000","last_peered":"2024-02-17T12:16:24.308610+0000","last_clean":"2024-02-17T12:16:24.308610+0000","last_became_active":"2024-02-17T12:16:23.312190+0000","last_became_peered":"2024-02-17T12:16:23.312190+0000","last_unstale":"2024-02-17T12:16:24.308610+0000","last_undegraded":"2024-02-17T12:16:24.308610+0000","last_fullsized":"2024-02-17T12:16:24.308610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308798+0000","last_change":"2024-02-17T12:16:22.307969+0000","last_active":"2024-02-17T12:16:24.308798+0000","last_peered":"2024-02-17T12:16:24.308798+0000","last_clean":"2024-02-17T12:16:24.308798+0000","last_became_active":"2024-02-17T12:16:22.307639+0000","last_became_peered":"2024-02-17T12:16:22.307639+0000","last_unstale":"2024-02-17T12:16:24.308798+0000","last_undegraded":"2024-02-17T12:16:24.308798+0000","last_fullsized":"2024-02-17T12:16:24.308798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:53:38.543164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.310056+0000","last_change":"2024-02-17T12:16:23.306045+0000","last_active":"2024-02-17T12:16:24.310056+0000","last_peered":"2024-02-17T12:16:24.310056+0000","last_clean":"2024-02-17T12:16:24.310056+0000","last_became_active":"2024-02-17T12:16:23.305674+0000","last_became_peered":"2024-02-17T12:16:23.305674+0000","last_unstale":"2024-02-17T12:16:24.310056+0000","last_undegraded":"2024-02-17T12:16:24.310056+0000","last_fullsized":"2024-02-17T12:16:24.310056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:44:56.735146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308940+0000","last_change":"2024-02-17T12:16:22.308387+0000","last_active":"2024-02-17T12:16:24.308940+0000","last_peered":"2024-02-17T12:16:24.308940+0000","last_clean":"2024-02-17T12:16:24.308940+0000","last_became_active":"2024-02-17T12:16:22.308043+0000","last_became_peered":"2024-02-17T12:16:22.308043+0000","last_unstale":"2024-02-17T12:16:24.308940+0000","last_undegraded":"2024-02-17T12:16:24.308940+0000","last_fullsized":"2024-02-17T12:16:24.308940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:34.793564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308982+0000","last_change":"2024-02-17T12:16:23.310304+0000","last_active":"2024-02-17T12:16:24.308982+0000","last_peered":"2024-02-17T12:16:24.308982+0000","last_clean":"2024-02-17T12:16:24.308982+0000","last_became_active":"2024-02-17T12:16:23.309898+0000","last_became_peered":"2024-02-17T12:16:23.309898+0000","last_unstale":"2024-02-17T12:16:24.308982+0000","last_undegraded":"2024-02-17T12:16:24.308982+0000","last_fullsized":"2024-02-17T12:16:24.308982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:15:22.881157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698567+0000","last_change":"2024-02-17T12:16:22.326425+0000","last_active":"2024-02-17T12:16:24.698567+0000","last_peered":"2024-02-17T12:16:24.698567+0000","last_clean":"2024-02-17T12:16:24.698567+0000","last_became_active":"2024-02-17T12:16:22.326149+0000","last_became_peered":"2024-02-17T12:16:22.326149+0000","last_unstale":"2024-02-17T12:16:24.698567+0000","last_undegraded":"2024-02-17T12:16:24.698567+0000","last_fullsized":"2024-02-17T12:16:24.698567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:58.719013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308851+0000","last_change":"2024-02-17T12:16:23.308825+0000","last_active":"2024-02-17T12:16:24.308851+0000","last_peered":"2024-02-17T12:16:24.308851+0000","last_clean":"2024-02-17T12:16:24.308851+0000","last_became_active":"2024-02-17T12:16:23.308519+0000","last_became_peered":"2024-02-17T12:16:23.308519+0000","last_unstale":"2024-02-17T12:16:24.308851+0000","last_undegraded":"2024-02-17T12:16:24.308851+0000","last_fullsized":"2024-02-17T12:16:24.308851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.333542+0000","last_change":"2024-02-17T12:16:22.312030+0000","last_active":"2024-02-17T12:16:24.333542+0000","last_peered":"2024-02-17T12:16:24.333542+0000","last_clean":"2024-02-17T12:16:24.333542+0000","last_became_active":"2024-02-17T12:16:22.311589+0000","last_became_peered":"2024-02-17T12:16:22.311589+0000","last_unstale":"2024-02-17T12:16:24.333542+0000","last_undegraded":"2024-02-17T12:16:24.333542+0000","last_fullsized":"2024-02-17T12:16:24.333542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:41.148188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697953+0000","last_change":"2024-02-17T12:16:23.317377+0000","last_active":"2024-02-17T12:16:24.697953+0000","last_peered":"2024-02-17T12:16:24.697953+0000","last_clean":"2024-02-17T12:16:24.697953+0000","last_became_active":"2024-02-17T12:16:23.317054+0000","last_became_peered":"2024-02-17T12:16:23.317054+0000","last_unstale":"2024-02-17T12:16:24.697953+0000","last_undegraded":"2024-02-17T12:16:24.697953+0000","last_fullsized":"2024-02-17T12:16:24.697953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:41:25.154931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335600+0000","last_change":"2024-02-17T12:16:22.320467+0000","last_active":"2024-02-17T12:16:24.335600+0000","last_peered":"2024-02-17T12:16:24.335600+0000","last_clean":"2024-02-17T12:16:24.335600+0000","last_became_active":"2024-02-17T12:16:22.319418+0000","last_became_peered":"2024-02-17T12:16:22.319418+0000","last_unstale":"2024-02-17T12:16:24.335600+0000","last_undegraded":"2024-02-17T12:16:24.335600+0000","last_fullsized":"2024-02-17T12:16:24.335600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:52:32.067973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698388+0000","last_change":"2024-02-17T12:16:23.307769+0000","last_active":"2024-02-17T12:16:24.698388+0000","last_peered":"2024-02-17T12:16:24.698388+0000","last_clean":"2024-02-17T12:16:24.698388+0000","last_became_active":"2024-02-17T12:16:23.305664+0000","last_became_peered":"2024-02-17T12:16:23.305664+0000","last_unstale":"2024-02-17T12:16:24.698388+0000","last_undegraded":"2024-02-17T12:16:24.698388+0000","last_fullsized":"2024-02-17T12:16:24.698388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:09.514247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698017+0000","last_change":"2024-02-17T12:16:22.324065+0000","last_active":"2024-02-17T12:16:24.698017+0000","last_peered":"2024-02-17T12:16:24.698017+0000","last_clean":"2024-02-17T12:16:24.698017+0000","last_became_active":"2024-02-17T12:16:22.323818+0000","last_became_peered":"2024-02-17T12:16:22.323818+0000","last_unstale":"2024-02-17T12:16:24.698017+0000","last_undegraded":"2024-02-17T12:16:24.698017+0000","last_fullsized":"2024-02-17T12:16:24.698017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:15.029228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.309889+0000","last_change":"2024-02-17T12:16:23.313005+0000","last_active":"2024-02-17T12:16:24.309889+0000","last_peered":"2024-02-17T12:16:24.309889+0000","last_clean":"2024-02-17T12:16:24.309889+0000","last_became_active":"2024-02-17T12:16:23.312532+0000","last_became_peered":"2024-02-17T12:16:23.312532+0000","last_unstale":"2024-02-17T12:16:24.309889+0000","last_undegraded":"2024-02-17T12:16:24.309889+0000","last_fullsized":"2024-02-17T12:16:24.309889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:34:19.518606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308811+0000","last_change":"2024-02-17T12:16:22.313418+0000","last_active":"2024-02-17T12:16:24.308811+0000","last_peered":"2024-02-17T12:16:24.308811+0000","last_clean":"2024-02-17T12:16:24.308811+0000","last_became_active":"2024-02-17T12:16:22.312996+0000","last_became_peered":"2024-02-17T12:16:22.312996+0000","last_unstale":"2024-02-17T12:16:24.308811+0000","last_undegraded":"2024-02-17T12:16:24.308811+0000","last_fullsized":"2024-02-17T12:16:24.308811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:49:36.146858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697537+0000","last_change":"2024-02-17T12:16:23.306549+0000","last_active":"2024-02-17T12:16:24.697537+0000","last_peered":"2024-02-17T12:16:24.697537+0000","last_clean":"2024-02-17T12:16:24.697537+0000","last_became_active":"2024-02-17T12:16:23.306251+0000","last_became_peered":"2024-02-17T12:16:23.306251+0000","last_unstale":"2024-02-17T12:16:24.697537+0000","last_undegraded":"2024-02-17T12:16:24.697537+0000","last_fullsized":"2024-02-17T12:16:24.697537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308802+0000","last_change":"2024-02-17T12:16:22.316022+0000","last_active":"2024-02-17T12:16:24.308802+0000","last_peered":"2024-02-17T12:16:24.308802+0000","last_clean":"2024-02-17T12:16:24.308802+0000","last_became_active":"2024-02-17T12:16:22.315761+0000","last_became_peered":"2024-02-17T12:16:22.315761+0000","last_unstale":"2024-02-17T12:16:24.308802+0000","last_undegraded":"2024-02-17T12:16:24.308802+0000","last_fullsized":"2024-02-17T12:16:24.308802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:49.705448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697882+0000","last_change":"2024-02-17T12:16:23.306391+0000","last_active":"2024-02-17T12:16:24.697882+0000","last_peered":"2024-02-17T12:16:24.697882+0000","last_clean":"2024-02-17T12:16:24.697882+0000","last_became_active":"2024-02-17T12:16:23.306103+0000","last_became_peered":"2024-02-17T12:16:23.306103+0000","last_unstale":"2024-02-17T12:16:24.697882+0000","last_undegraded":"2024-02-17T12:16:24.697882+0000","last_fullsized":"2024-02-17T12:16:24.697882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:43.489046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698509+0000","last_change":"2024-02-17T12:16:22.323792+0000","last_active":"2024-02-17T12:16:24.698509+0000","last_peered":"2024-02-17T12:16:24.698509+0000","last_clean":"2024-02-17T12:16:24.698509+0000","last_became_active":"2024-02-17T12:16:22.323508+0000","last_became_peered":"2024-02-17T12:16:22.323508+0000","last_unstale":"2024-02-17T12:16:24.698509+0000","last_undegraded":"2024-02-17T12:16:24.698509+0000","last_fullsized":"2024-02-17T12:16:24.698509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:29:03.944585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.335206+0000","last_change":"2024-02-17T12:16:23.320721+0000","last_active":"2024-02-17T12:16:24.335206+0000","last_peered":"2024-02-17T12:16:24.335206+0000","last_clean":"2024-02-17T12:16:24.335206+0000","last_became_active":"2024-02-17T12:16:23.312733+0000","last_became_peered":"2024-02-17T12:16:23.312733+0000","last_unstale":"2024-02-17T12:16:24.335206+0000","last_undegraded":"2024-02-17T12:16:24.335206+0000","last_fullsized":"2024-02-17T12:16:24.335206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:51:54.534387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308809+0000","last_change":"2024-02-17T12:16:23.301646+0000","last_active":"2024-02-17T12:16:24.308809+0000","last_peered":"2024-02-17T12:16:24.308809+0000","last_clean":"2024-02-17T12:16:24.308809+0000","last_became_active":"2024-02-17T12:16:23.301322+0000","last_became_peered":"2024-02-17T12:16:23.301322+0000","last_unstale":"2024-02-17T12:16:24.308809+0000","last_undegraded":"2024-02-17T12:16:24.308809+0000","last_fullsized":"2024-02-17T12:16:24.308809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:46:17.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698370+0000","last_change":"2024-02-17T12:16:22.326677+0000","last_active":"2024-02-17T12:16:24.698370+0000","last_peered":"2024-02-17T12:16:24.698370+0000","last_clean":"2024-02-17T12:16:24.698370+0000","last_became_active":"2024-02-17T12:16:22.326136+0000","last_became_peered":"2024-02-17T12:16:22.326136+0000","last_unstale":"2024-02-17T12:16:24.698370+0000","last_undegraded":"2024-02-17T12:16:24.698370+0000","last_fullsized":"2024-02-17T12:16:24.698370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:34:18.512763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.308731+0000","last_change":"2024-02-17T12:16:23.314407+0000","last_active":"2024-02-17T12:16:24.308731+0000","last_peered":"2024-02-17T12:16:24.308731+0000","last_clean":"2024-02-17T12:16:24.308731+0000","last_became_active":"2024-02-17T12:16:23.310090+0000","last_became_peered":"2024-02-17T12:16:23.310090+0000","last_unstale":"2024-02-17T12:16:24.308731+0000","last_undegraded":"2024-02-17T12:16:24.308731+0000","last_fullsized":"2024-02-17T12:16:24.308731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:26:24.802958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698397+0000","last_change":"2024-02-17T12:16:22.326377+0000","last_active":"2024-02-17T12:16:24.698397+0000","last_peered":"2024-02-17T12:16:24.698397+0000","last_clean":"2024-02-17T12:16:24.698397+0000","last_became_active":"2024-02-17T12:16:22.326122+0000","last_became_peered":"2024-02-17T12:16:22.326122+0000","last_unstale":"2024-02-17T12:16:24.698397+0000","last_undegraded":"2024-02-17T12:16:24.698397+0000","last_fullsized":"2024-02-17T12:16:24.698397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:58.566689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698320+0000","last_change":"2024-02-17T12:16:23.319347+0000","last_active":"2024-02-17T12:16:24.698320+0000","last_peered":"2024-02-17T12:16:24.698320+0000","last_clean":"2024-02-17T12:16:24.698320+0000","last_became_active":"2024-02-17T12:16:23.319070+0000","last_became_peered":"2024-02-17T12:16:23.319070+0000","last_unstale":"2024-02-17T12:16:24.698320+0000","last_undegraded":"2024-02-17T12:16:24.698320+0000","last_fullsized":"2024-02-17T12:16:24.698320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:05:10.955892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697633+0000","last_change":"2024-02-17T12:16:22.314871+0000","last_active":"2024-02-17T12:16:24.697633+0000","last_peered":"2024-02-17T12:16:24.697633+0000","last_clean":"2024-02-17T12:16:24.697633+0000","last_became_active":"2024-02-17T12:16:22.314596+0000","last_became_peered":"2024-02-17T12:16:22.314596+0000","last_unstale":"2024-02-17T12:16:24.697633+0000","last_undegraded":"2024-02-17T12:16:24.697633+0000","last_fullsized":"2024-02-17T12:16:24.697633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:05.491487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.697334+0000","last_change":"2024-02-17T12:16:23.322438+0000","last_active":"2024-02-17T12:16:24.697334+0000","last_peered":"2024-02-17T12:16:24.697334+0000","last_clean":"2024-02-17T12:16:24.697334+0000","last_became_active":"2024-02-17T12:16:23.322009+0000","last_became_peered":"2024-02-17T12:16:23.322009+0000","last_unstale":"2024-02-17T12:16:24.697334+0000","last_undegraded":"2024-02-17T12:16:24.697334+0000","last_fullsized":"2024-02-17T12:16:24.697334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:22.278047+0000","last_clean_scrub_stamp":"2024-02-17T12:16:22.278047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:22.697434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-02-17T12:16:24.698449+0000","last_change":"2024-02-17T12:16:22.317765+0000","last_active":"2024-02-17T12:16:24.698449+0000","last_peered":"2024-02-17T12:16:24.698449+0000","last_clean":"2024-02-17T12:16:24.698449+0000","last_became_active":"2024-02-17T12:16:22.317363+0000","last_became_peered":"2024-02-17T12:16:22.317363+0000","last_unstale":"2024-02-17T12:16:24.698449+0000","last_undegraded":"2024-02-17T12:16:24.698449+0000","last_fullsized":"2024-02-17T12:16:24.698449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:21.272205+0000","last_clean_scrub_stamp":"2024-02-17T12:16:21.272205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:07:14.946092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":72631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":663547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":663491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":72667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":72541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:16:30.710 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-17T12:16:30.711 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-17T12:16:30.711 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-17T12:16:30.711 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-17T12:16:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb390c00640 1 Processor -- start 2024-02-17T12:16:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb390c00640 1 -- start start 2024-02-17T12:16:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb390c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb38c1586c0 0x7fb38c0c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb390c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38c0c6a70 con 0x7fb38c0c3f00 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb390c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38c158b50 con 0x7fb38c0c3b20 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb390c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c06c400 con 0x7fb38c1586c0 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb38a800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb38c0c3f00 0x7fb38c0c6f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45566/0 (socket says 172.21.15.114:45566) 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb38a800640 1 -- 172.21.15.114:0/4087813386 learned_addr learned my addr 172.21.15.114:0/4087813386 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb381400640 1 --2- 172.21.15.114:0/4087813386 >> v2:172.21.15.116:3300/0 conn(0x7fb38c1586c0 0x7fb38c0c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb389400640 1 -- 172.21.15.114:0/4087813386 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777701528 0 0) 0x7fb38c0c6a70 con 0x7fb38c0c3f00 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb389400640 1 -- 172.21.15.114:0/4087813386 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb370003530 con 0x7fb38c0c3f00 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb389400640 1 -- 172.21.15.114:0/4087813386 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422218188 0 0) 0x7fb38c158b50 con 0x7fb38c0c3b20 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb381400640 1 -- 172.21.15.114:0/4087813386 >> v1:172.21.15.116:6789/0 conn(0x7fb38c0c3b20 legacy=0x7fb38c155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb381400640 1 -- 172.21.15.114:0/4087813386 >> v1:172.21.15.114:6789/0 conn(0x7fb38c0c3f00 legacy=0x7fb38c0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.880+0000 7fb381400640 1 -- 172.21.15.114:0/4087813386 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c158e30 con 0x7fb38c1586c0 2024-02-17T12:16:30.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb381400640 1 --2- 172.21.15.114:0/4087813386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb38c1586c0 0x7fb38c0c7f60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb3740097c0 tx=0x7fb37401c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59435ff74796c634 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb389400640 1 -- 172.21.15.114:0/4087813386 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374004230 con 0x7fb38c1586c0 2024-02-17T12:16:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb389400640 1 -- 172.21.15.114:0/4087813386 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3740a7050 con 0x7fb38c1586c0 2024-02-17T12:16:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb389400640 1 -- 172.21.15.114:0/4087813386 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374003620 con 0x7fb38c1586c0 2024-02-17T12:16:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb390c00640 1 -- 172.21.15.114:0/4087813386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb38c1586c0 msgr2=0x7fb38c0c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb390c00640 1 --2- 172.21.15.114:0/4087813386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb38c1586c0 0x7fb38c0c7f60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb3740097c0 tx=0x7fb37401c350 comp rx=0 tx=0).stop 2024-02-17T12:16:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb390c00640 1 -- 172.21.15.114:0/4087813386 shutdown_connections 2024-02-17T12:16:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb390c00640 1 --2- 172.21.15.114:0/4087813386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb38c1586c0 0x7fb38c0c7f60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb390c00640 1 -- 172.21.15.114:0/4087813386 >> 172.21.15.114:0/4087813386 conn(0x7fb38c0aa2b0 msgr2=0x7fb38c0aa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb390c00640 1 -- 172.21.15.114:0/4087813386 shutdown_connections 2024-02-17T12:16:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.884+0000 7fb390c00640 1 -- 172.21.15.114:0/4087813386 wait complete. 2024-02-17T12:16:30.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 Processor -- start 2024-02-17T12:16:30.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 -- start start 2024-02-17T12:16:30.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb38c0c3b20 0x7fb38c06cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb38c0c3f00 0x7fb38c15cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb38c15e5f0 0x7fb38c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c1ee600 con 0x7fb38c0c3b20 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c15ecd0 con 0x7fb38c0c3f00 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c06f720 con 0x7fb38c15e5f0 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb389e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb38c0c3b20 0x7fb38c06cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb389e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb38c0c3b20 0x7fb38c06cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57860/0 (socket says 172.21.15.114:57860) 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb389e00640 1 -- 172.21.15.114:0/1147692282 learned_addr learned my addr 172.21.15.114:0/1147692282 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb38a800640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb38c15e5f0 0x7fb38c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb381400640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb38c0c3f00 0x7fb38c15cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb389e00640 1 -- 172.21.15.114:0/1147692282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb38c15e5f0 msgr2=0x7fb38c15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb389e00640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb38c15e5f0 0x7fb38c15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb389e00640 1 -- 172.21.15.114:0/1147692282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb38c0c3f00 msgr2=0x7fb38c15cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb389e00640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb38c0c3f00 0x7fb38c15cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:30.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb389e00640 1 -- 172.21.15.114:0/1147692282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb374009420 con 0x7fb38c0c3b20 2024-02-17T12:16:30.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb381400640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb38c0c3f00 0x7fb38c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:30.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb38a800640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb38c15e5f0 0x7fb38c15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:30.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb389e00640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb38c0c3b20 0x7fb38c06cf90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb37c001570 tx=0x7fb37c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:30.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb382a00640 1 -- 172.21.15.114:0/1147692282 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c003db0 con 0x7fb38c0c3b20 2024-02-17T12:16:30.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb382a00640 1 -- 172.21.15.114:0/1147692282 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c005070 con 0x7fb38c0c3b20 2024-02-17T12:16:30.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb382a00640 1 -- 172.21.15.114:0/1147692282 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c005420 con 0x7fb38c0c3b20 2024-02-17T12:16:30.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 -- 172.21.15.114:0/1147692282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c15ef00 con 0x7fb38c0c3b20 2024-02-17T12:16:30.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 -- 172.21.15.114:0/1147692282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c15f4c0 con 0x7fb38c0c3b20 2024-02-17T12:16:30.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.888+0000 7fb390c00640 1 -- 172.21.15.114:0/1147692282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c074840 con 0x7fb38c0c3b20 2024-02-17T12:16:30.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.892+0000 7fb382a00640 1 -- 172.21.15.114:0/1147692282 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb37c005580 con 0x7fb38c0c3b20 2024-02-17T12:16:30.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.892+0000 7fb382a00640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb368066e40 0x7fb368069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:30.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.892+0000 7fb382a00640 1 -- 172.21.15.114:0/1147692282 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb37c084450 con 0x7fb38c0c3b20 2024-02-17T12:16:30.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.892+0000 7fb381400640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb368066e40 0x7fb368069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:30.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.892+0000 7fb381400640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb368066e40 0x7fb368069300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb3740ad000 tx=0x7fb3740a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:30.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:30.896+0000 7fb382a00640 1 -- 172.21.15.114:0/1147692282 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb37c0511a0 con 0x7fb38c0c3b20 2024-02-17T12:16:31.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.080+0000 7fb390c00640 1 -- 172.21.15.114:0/1147692282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb38c1599c0 con 0x7fb38c0c3b20 2024-02-17T12:16:31.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.080+0000 7fb382a00640 1 -- 172.21.15.114:0/1147692282 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb37c054860 con 0x7fb38c0c3b20 2024-02-17T12:16:31.085 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:31.085 INFO:teuthology.orchestra.run.smithi114.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-17T12:16:31.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 -- 172.21.15.114:0/1147692282 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb368066e40 msgr2=0x7fb368069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb368066e40 0x7fb368069300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb3740ad000 tx=0x7fb3740a6000 comp rx=0 tx=0).stop 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 -- 172.21.15.114:0/1147692282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb38c0c3b20 msgr2=0x7fb38c06cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb38c0c3b20 0x7fb38c06cf90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb37c001570 tx=0x7fb37c00cd00 comp rx=0 tx=0).stop 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 -- 172.21.15.114:0/1147692282 shutdown_connections 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb38c15e5f0 0x7fb38c15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb38c0c3f00 0x7fb38c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb368066e40 0x7fb368069300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 --2- 172.21.15.114:0/1147692282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb38c0c3b20 0x7fb38c06cf90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 -- 172.21.15.114:0/1147692282 >> 172.21.15.114:0/1147692282 conn(0x7fb38c0aa2b0 msgr2=0x7fb38c15fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 -- 172.21.15.114:0/1147692282 shutdown_connections 2024-02-17T12:16:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.084+0000 7fb390c00640 1 -- 172.21.15.114:0/1147692282 wait complete. 2024-02-17T12:16:31.106 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-17T12:16:31.106 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:31.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.236+0000 7f3e0a400640 1 Processor -- start 2024-02-17T12:16:31.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.236+0000 7f3e0a400640 1 -- start start 2024-02-17T12:16:31.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e0a400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3e0406db50 0x7f3e0414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e0a400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e04156270 con 0x7f3e04150490 2024-02-17T12:16:31.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e0a400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e04156550 con 0x7f3e040c25a0 2024-02-17T12:16:31.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e0a400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0406f090 con 0x7f3e0406db50 2024-02-17T12:16:31.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e03e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3e04150490 0x7f3e04152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45580/0 (socket says 172.21.15.114:45580) 2024-02-17T12:16:31.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e03e00640 1 -- 172.21.15.114:0/1306534362 learned_addr learned my addr 172.21.15.114:0/1306534362 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:31.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3dfaa00640 1 --2- 172.21.15.114:0/1306534362 >> v2:172.21.15.116:3300/0 conn(0x7f3e0406db50 0x7f3e0414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188867386 0 0) 0x7f3e04156270 con 0x7f3e04150490 2024-02-17T12:16:31.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de8003530 con 0x7f3e04150490 2024-02-17T12:16:31.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477720600 0 0) 0x7f3de8003530 con 0x7f3e04150490 2024-02-17T12:16:31.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 >> v2:172.21.15.116:3300/0 conn(0x7f3e0406db50 msgr2=0x7f3e0414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:31.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 --2- 172.21.15.114:0/1306534362 >> v2:172.21.15.116:3300/0 conn(0x7f3e0406db50 0x7f3e0414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 >> v1:172.21.15.116:6789/0 conn(0x7f3e040c25a0 legacy=0x7f3e0406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04156830 con 0x7f3e04150490 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f3dfc001680 con 0x7f3e04150490 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 >> v1:172.21.15.114:6789/0 conn(0x7f3e04150490 legacy=0x7f3e04152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3de80052b0 0x7f3de800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0406f090 con 0x7f3de8003980 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de800c180 con 0x7f3de80052b0 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de800c340 con 0x7f3de80047d0 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3dfaa00640 1 --2- 172.21.15.114:0/1306534362 >> v2:172.21.15.116:3300/0 conn(0x7f3e0406db50 0x7f3e0414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e03400640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e03e00640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3de80052b0 0x7f3de800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3dfaa00640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e03400640 1 -- 172.21.15.114:0/1306534362 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3de80047d0 msgr2=0x7f3de8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:31.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e03400640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e03400640 1 -- 172.21.15.114:0/1306534362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3de80052b0 msgr2=0x7f3de800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:31.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e03400640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3de80052b0 0x7f3de800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e03400640 1 -- 172.21.15.114:0/1306534362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8003530 con 0x7f3de8003980 2024-02-17T12:16:31.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3e03e00640 1 -- 172.21.15.114:0/1306534362 reap_dead start 2024-02-17T12:16:31.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.240+0000 7f3dfaa00640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:31.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e03400640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3df4001e40 tx=0x7f3df401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a4100cb5a5afcc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:31.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4003b80 con 0x7f3de8003980 2024-02-17T12:16:31.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df4003ce0 con 0x7f3de8003980 2024-02-17T12:16:31.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e02a00640 1 -- 172.21.15.114:0/1306534362 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4005310 con 0x7f3de8003980 2024-02-17T12:16:31.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e0a400640 1 -- 172.21.15.114:0/1306534362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de8003980 msgr2=0x7f3de8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e0a400640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3df4001e40 tx=0x7f3df401c740 comp rx=0 tx=0).stop 2024-02-17T12:16:31.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e0a400640 1 -- 172.21.15.114:0/1306534362 shutdown_connections 2024-02-17T12:16:31.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e0a400640 1 --2- 172.21.15.114:0/1306534362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de8003980 0x7f3de8003da0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e0a400640 1 -- 172.21.15.114:0/1306534362 >> 172.21.15.114:0/1306534362 conn(0x7f3e040a8490 msgr2=0x7f3e040a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:31.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e0a400640 1 -- 172.21.15.114:0/1306534362 shutdown_connections 2024-02-17T12:16:31.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e0a400640 1 -- 172.21.15.114:0/1306534362 wait complete. 2024-02-17T12:16:31.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e0a400640 1 Processor -- start 2024-02-17T12:16:31.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.244+0000 7f3e0a400640 1 -- start start 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e0a400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3de8003980 0x7f3e040bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e0a400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e04153f20 0x7f3e041e0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e0a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e041e10a0 0x7f3e0413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e0a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040aa140 con 0x7f3e041e10a0 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e0a400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e041eec70 con 0x7f3e04153f20 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e0a400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e041e03f0 con 0x7f3de8003980 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e03e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e041e10a0 0x7f3e0413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e03e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e041e10a0 0x7f3e0413fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57880/0 (socket says 172.21.15.114:57880) 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e03e00640 1 -- 172.21.15.114:0/2628116999 learned_addr learned my addr 172.21.15.114:0/2628116999 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e03400640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3de8003980 0x7f3e040bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3dfaa00640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e04153f20 0x7f3e041e0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e03e00640 1 -- 172.21.15.114:0/2628116999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3de8003980 msgr2=0x7f3e040bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e03e00640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3de8003980 0x7f3e040bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e03e00640 1 -- 172.21.15.114:0/2628116999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e04153f20 msgr2=0x7f3e041e0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e03e00640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e04153f20 0x7f3e041e0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e03e00640 1 -- 172.21.15.114:0/2628116999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e040a96c0 con 0x7f3e041e10a0 2024-02-17T12:16:31.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3dfaa00640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e04153f20 0x7f3e041e0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:31.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e03e00640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e041e10a0 0x7f3e0413fd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3e040a91e0 tx=0x7f3dfc00e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:31.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3dfbe00640 1 -- 172.21.15.114:0/2628116999 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc010510 con 0x7f3e041e10a0 2024-02-17T12:16:31.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3dfbe00640 1 -- 172.21.15.114:0/2628116999 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc010670 con 0x7f3e041e10a0 2024-02-17T12:16:31.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e0a400640 1 -- 172.21.15.114:0/2628116999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e040a99a0 con 0x7f3e041e10a0 2024-02-17T12:16:31.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3dfbe00640 1 -- 172.21.15.114:0/2628116999 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc010a20 con 0x7f3e041e10a0 2024-02-17T12:16:31.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e0a400640 1 -- 172.21.15.114:0/2628116999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e040bff40 con 0x7f3e041e10a0 2024-02-17T12:16:31.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3e0a400640 1 -- 172.21.15.114:0/2628116999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e041e0880 con 0x7f3e041e10a0 2024-02-17T12:16:31.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.248+0000 7f3dfbe00640 1 -- 172.21.15.114:0/2628116999 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3dfc010b80 con 0x7f3e041e10a0 2024-02-17T12:16:31.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.252+0000 7f3dfbe00640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3de0066e70 0x7f3de0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.252+0000 7f3dfbe00640 1 -- 172.21.15.114:0/2628116999 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3dfc0842a0 con 0x7f3e041e10a0 2024-02-17T12:16:31.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.252+0000 7f3e03400640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3de0066e70 0x7f3de0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.252+0000 7f3e03400640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3de0066e70 0x7f3de0069330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3df40ad000 tx=0x7f3df4001520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:31.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.256+0000 7f3dfbe00640 1 -- 172.21.15.114:0/2628116999 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3e041e0880 con 0x7f3e041e10a0 2024-02-17T12:16:31.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.416+0000 7f3e0a400640 1 -- 172.21.15.114:0/2628116999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e0414f9e0 con 0x7f3e041e10a0 2024-02-17T12:16:31.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3dfbe00640 1 -- 172.21.15.114:0/2628116999 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f3dfc051080 con 0x7f3e041e10a0 2024-02-17T12:16:31.423 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:31.423 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:31.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 -- 172.21.15.114:0/2628116999 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3de0066e70 msgr2=0x7f3de0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3de0066e70 0x7f3de0069330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3df40ad000 tx=0x7f3df4001520 comp rx=0 tx=0).stop 2024-02-17T12:16:31.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 -- 172.21.15.114:0/2628116999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e041e10a0 msgr2=0x7f3e0413fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e041e10a0 0x7f3e0413fd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3e040a91e0 tx=0x7f3dfc00e980 comp rx=0 tx=0).stop 2024-02-17T12:16:31.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 -- 172.21.15.114:0/2628116999 shutdown_connections 2024-02-17T12:16:31.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3de0066e70 0x7f3de0069330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e041e10a0 0x7f3e0413fd00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e04153f20 0x7f3e041e0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 --2- 172.21.15.114:0/2628116999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3de8003980 0x7f3e040bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 -- 172.21.15.114:0/2628116999 >> 172.21.15.114:0/2628116999 conn(0x7f3e040a8490 msgr2=0x7f3e04072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:31.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 -- 172.21.15.114:0/2628116999 shutdown_connections 2024-02-17T12:16:31.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.420+0000 7f3e0a400640 1 -- 172.21.15.114:0/2628116999 wait complete. 2024-02-17T12:16:31.445 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:16:21.236908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:16:21.659009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:31.445 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:31.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.576+0000 7ff435400640 1 Processor -- start 2024-02-17T12:16:31.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff435400640 1 -- start start 2024-02-17T12:16:31.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff435400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4300c25a0 0x7ff43006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff435400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff43006db50 0x7ff43014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff435400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff430150490 0x7ff430152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff435400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff430071630 con 0x7ff43006db50 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff435400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff430156270 con 0x7ff430150490 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff435400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff430156550 con 0x7ff4300c25a0 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff42de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff43006db50 0x7ff43014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff42de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff43006db50 0x7ff43014ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57892/0 (socket says 172.21.15.114:57892) 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff42de00640 1 -- 172.21.15.114:0/1457543208 learned_addr learned my addr 172.21.15.114:0/1457543208 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff42de00640 1 -- 172.21.15.114:0/1457543208 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4300c25a0 msgr2=0x7ff43006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff42de00640 1 --2- 172.21.15.114:0/1457543208 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4300c25a0 0x7ff43006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff42de00640 1 -- 172.21.15.114:0/1457543208 >> v2:172.21.15.116:3300/0 conn(0x7ff430150490 msgr2=0x7ff430152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff42de00640 1 --2- 172.21.15.114:0/1457543208 >> v2:172.21.15.116:3300/0 conn(0x7ff430150490 0x7ff430152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.580+0000 7ff42de00640 1 -- 172.21.15.114:0/1457543208 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430156830 con 0x7ff43006db50 2024-02-17T12:16:31.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff42de00640 1 --2- 172.21.15.114:0/1457543208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff43006db50 0x7ff43014ff50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff4300c0780 tx=0x7ff41c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209ec3ab2c05b530 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:31.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff42d400640 1 -- 172.21.15.114:0/1457543208 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4301539a0 con 0x7ff43006db50 2024-02-17T12:16:31.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff42d400640 1 -- 172.21.15.114:0/1457543208 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c0a7050 con 0x7ff43006db50 2024-02-17T12:16:31.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff42d400640 1 -- 172.21.15.114:0/1457543208 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0ab820 con 0x7ff43006db50 2024-02-17T12:16:31.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 -- 172.21.15.114:0/1457543208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff43006db50 msgr2=0x7ff43014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 --2- 172.21.15.114:0/1457543208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff43006db50 0x7ff43014ff50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff4300c0780 tx=0x7ff41c01c3d0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 -- 172.21.15.114:0/1457543208 shutdown_connections 2024-02-17T12:16:31.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 --2- 172.21.15.114:0/1457543208 >> v2:172.21.15.116:3300/0 conn(0x7ff430150490 0x7ff430152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 --2- 172.21.15.114:0/1457543208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff43006db50 0x7ff43014ff50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 --2- 172.21.15.114:0/1457543208 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4300c25a0 0x7ff43006e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 -- 172.21.15.114:0/1457543208 >> 172.21.15.114:0/1457543208 conn(0x7ff4300a8490 msgr2=0x7ff4300a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:31.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 -- 172.21.15.114:0/1457543208 shutdown_connections 2024-02-17T12:16:31.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 -- 172.21.15.114:0/1457543208 wait complete. 2024-02-17T12:16:31.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 Processor -- start 2024-02-17T12:16:31.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.584+0000 7ff435400640 1 -- start start 2024-02-17T12:16:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff435400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff43006db50 0x7ff4300a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff435400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4300c25a0 0x7ff430142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff435400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff430150490 0x7ff4301413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff435400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff430152af0 con 0x7ff430150490 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff435400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300ab5f0 con 0x7ff43006db50 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff435400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff430151020 con 0x7ff4300c25a0 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff430150490 0x7ff4301413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff430150490 0x7ff4301413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57896/0 (socket says 172.21.15.114:57896) 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42f200640 1 -- 172.21.15.114:0/4029300862 learned_addr learned my addr 172.21.15.114:0/4029300862 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42de00640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4300c25a0 0x7ff430142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42e800640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff43006db50 0x7ff4300a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42f200640 1 -- 172.21.15.114:0/4029300862 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4300c25a0 msgr2=0x7ff430142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42f200640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4300c25a0 0x7ff430142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42f200640 1 -- 172.21.15.114:0/4029300862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff43006db50 msgr2=0x7ff4300a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42f200640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff43006db50 0x7ff4300a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42f200640 1 -- 172.21.15.114:0/4029300862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0094d0 con 0x7ff430150490 2024-02-17T12:16:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff42f200640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff430150490 0x7ff4301413d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff42800b3c0 tx=0x7ff42800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff426a00640 1 -- 172.21.15.114:0/4029300862 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428011830 con 0x7ff430150490 2024-02-17T12:16:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff426a00640 1 -- 172.21.15.114:0/4029300862 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff428011990 con 0x7ff430150490 2024-02-17T12:16:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff435400640 1 -- 172.21.15.114:0/4029300862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4300aade0 con 0x7ff430150490 2024-02-17T12:16:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff426a00640 1 -- 172.21.15.114:0/4029300862 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428011d40 con 0x7ff430150490 2024-02-17T12:16:31.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff435400640 1 -- 172.21.15.114:0/4029300862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff430140f40 con 0x7ff430150490 2024-02-17T12:16:31.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff435400640 1 -- 172.21.15.114:0/4029300862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4300a9e20 con 0x7ff430150490 2024-02-17T12:16:31.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.588+0000 7ff426a00640 1 -- 172.21.15.114:0/4029300862 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff42801b460 con 0x7ff430150490 2024-02-17T12:16:31.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.592+0000 7ff426a00640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff410066e40 0x7ff410069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.592+0000 7ff426a00640 1 -- 172.21.15.114:0/4029300862 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff428084590 con 0x7ff430150490 2024-02-17T12:16:31.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.592+0000 7ff42e800640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff410066e40 0x7ff410069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.592+0000 7ff42e800640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff410066e40 0x7ff410069300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff42000a400 tx=0x7ff42000d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:31.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.596+0000 7ff426a00640 1 -- 172.21.15.114:0/4029300862 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff4280514a0 con 0x7ff430150490 2024-02-17T12:16:31.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 -- 172.21.15.114:0/4029300862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff43006bba0 con 0x7ff430150490 2024-02-17T12:16:31.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff426a00640 1 -- 172.21.15.114:0/4029300862 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff428054b60 con 0x7ff430150490 2024-02-17T12:16:31.751 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 -- 172.21.15.114:0/4029300862 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff410066e40 msgr2=0x7ff410069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff410066e40 0x7ff410069300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff42000a400 tx=0x7ff42000d040 comp rx=0 tx=0).stop 2024-02-17T12:16:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 -- 172.21.15.114:0/4029300862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff430150490 msgr2=0x7ff4301413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff430150490 0x7ff4301413d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff42800b3c0 tx=0x7ff42800b880 comp rx=0 tx=0).stop 2024-02-17T12:16:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 -- 172.21.15.114:0/4029300862 shutdown_connections 2024-02-17T12:16:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff410066e40 0x7ff410069300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff430150490 0x7ff4301413d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4300c25a0 0x7ff430142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 --2- 172.21.15.114:0/4029300862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff43006db50 0x7ff4300a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 -- 172.21.15.114:0/4029300862 >> 172.21.15.114:0/4029300862 conn(0x7ff4300a8490 msgr2=0x7ff430072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:31.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 -- 172.21.15.114:0/4029300862 shutdown_connections 2024-02-17T12:16:31.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.748+0000 7ff435400640 1 -- 172.21.15.114:0/4029300862 wait complete. 2024-02-17T12:16:31.772 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:16:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.904+0000 7f62f7e00640 1 Processor -- start 2024-02-17T12:16:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.904+0000 7f62f7e00640 1 -- start start 2024-02-17T12:16:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f7e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f62f00c25a0 0x7f62f006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f7e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f006db50 0x7f62f014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f7e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f0156270 con 0x7f62f0150490 2024-02-17T12:16:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f7e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f0071630 con 0x7f62f00c25a0 2024-02-17T12:16:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f7e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0156550 con 0x7f62f006db50 2024-02-17T12:16:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f5e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f62f0150490 0x7f62f0152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45586/0 (socket says 172.21.15.114:45586) 2024-02-17T12:16:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f5e00640 1 -- 172.21.15.114:0/2171744875 learned_addr learned my addr 172.21.15.114:0/2171744875 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f4a00640 1 --2- 172.21.15.114:0/2171744875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f006db50 0x7f62f014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f5400640 1 --2- 172.21.15.114:0/2171744875 >> v2:172.21.15.116:3300/0 conn(0x7f62f00c25a0 0x7f62f006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62efe00640 1 -- 172.21.15.114:0/2171744875 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349046056 0 0) 0x7f62f0156270 con 0x7f62f0150490 2024-02-17T12:16:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62efe00640 1 -- 172.21.15.114:0/2171744875 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d8003530 con 0x7f62f0150490 2024-02-17T12:16:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f4a00640 1 -- 172.21.15.114:0/2171744875 >> v2:172.21.15.116:3300/0 conn(0x7f62f00c25a0 msgr2=0x7f62f006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f4a00640 1 --2- 172.21.15.114:0/2171744875 >> v2:172.21.15.116:3300/0 conn(0x7f62f00c25a0 0x7f62f006e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f4a00640 1 -- 172.21.15.114:0/2171744875 >> v1:172.21.15.114:6789/0 conn(0x7f62f0150490 legacy=0x7f62f0152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62efe00640 1 -- 172.21.15.114:0/2171744875 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 457328387 0 0) 0x7f62d8003530 con 0x7f62f0150490 2024-02-17T12:16:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.908+0000 7f62f4a00640 1 -- 172.21.15.114:0/2171744875 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0156830 con 0x7f62f006db50 2024-02-17T12:16:31.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f4a00640 1 --2- 172.21.15.114:0/2171744875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f006db50 0x7f62f014ff50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0097c0 tx=0x7f62dc01c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e9f7137b10bc37 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62efe00640 1 -- 172.21.15.114:0/2171744875 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8001a00 con 0x7f62f006db50 2024-02-17T12:16:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62efe00640 1 -- 172.21.15.114:0/2171744875 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc0a7050 con 0x7f62f006db50 2024-02-17T12:16:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62efe00640 1 -- 172.21.15.114:0/2171744875 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0ab620 con 0x7f62f006db50 2024-02-17T12:16:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f7e00640 1 -- 172.21.15.114:0/2171744875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f006db50 msgr2=0x7f62f014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f7e00640 1 --2- 172.21.15.114:0/2171744875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f006db50 0x7f62f014ff50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0097c0 tx=0x7f62dc01c270 comp rx=0 tx=0).stop 2024-02-17T12:16:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f7e00640 1 -- 172.21.15.114:0/2171744875 shutdown_connections 2024-02-17T12:16:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f7e00640 1 --2- 172.21.15.114:0/2171744875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f006db50 0x7f62f014ff50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f7e00640 1 --2- 172.21.15.114:0/2171744875 >> v2:172.21.15.116:3300/0 conn(0x7f62f00c25a0 0x7f62f006e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f7e00640 1 -- 172.21.15.114:0/2171744875 >> 172.21.15.114:0/2171744875 conn(0x7f62f00a8490 msgr2=0x7f62f00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f7e00640 1 -- 172.21.15.114:0/2171744875 shutdown_connections 2024-02-17T12:16:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f7e00640 1 -- 172.21.15.114:0/2171744875 wait complete. 2024-02-17T12:16:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f7e00640 1 Processor -- start 2024-02-17T12:16:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.912+0000 7f62f7e00640 1 -- start start 2024-02-17T12:16:31.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f7e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62f006db50 0x7f62f01ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c25a0 0x7f62f0143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f7e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f0150490 0x7f62f0154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01f1950 con 0x7f62f00c25a0 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f7e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0145650 con 0x7f62f006db50 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f7e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01f09f0 con 0x7f62f0150490 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c25a0 0x7f62f0143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c25a0 0x7f62f0143f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57898/0 (socket says 172.21.15.114:57898) 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f4a00640 1 -- 172.21.15.114:0/1049210087 learned_addr learned my addr 172.21.15.114:0/1049210087 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f5400640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62f006db50 0x7f62f01ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f5e00640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f0150490 0x7f62f0154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f4a00640 1 -- 172.21.15.114:0/1049210087 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f0150490 msgr2=0x7f62f0154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f4a00640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f0150490 0x7f62f0154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f4a00640 1 -- 172.21.15.114:0/1049210087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62f006db50 msgr2=0x7f62f01ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f4a00640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62f006db50 0x7f62f01ed420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f4a00640 1 -- 172.21.15.114:0/1049210087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc009420 con 0x7f62f00c25a0 2024-02-17T12:16:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f4a00640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c25a0 0x7f62f0143f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0ae040 tx=0x7f62dc019010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62ed600640 1 -- 172.21.15.114:0/1049210087 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0b4430 con 0x7f62f00c25a0 2024-02-17T12:16:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62ed600640 1 -- 172.21.15.114:0/1049210087 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc0b45b0 con 0x7f62f00c25a0 2024-02-17T12:16:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62ed600640 1 -- 172.21.15.114:0/1049210087 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0b4960 con 0x7f62f00c25a0 2024-02-17T12:16:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f7e00640 1 -- 172.21.15.114:0/1049210087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f01f0cd0 con 0x7f62f00c25a0 2024-02-17T12:16:31.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f7e00640 1 -- 172.21.15.114:0/1049210087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f01f1290 con 0x7f62f00c25a0 2024-02-17T12:16:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62f7e00640 1 -- 172.21.15.114:0/1049210087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f0074840 con 0x7f62f00c25a0 2024-02-17T12:16:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.916+0000 7f62ed600640 1 -- 172.21.15.114:0/1049210087 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f62dc0b2040 con 0x7f62f00c25a0 2024-02-17T12:16:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.920+0000 7f62ed600640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f62d0066e40 0x7f62d0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.920+0000 7f62ed600640 1 -- 172.21.15.114:0/1049210087 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62dc11e890 con 0x7f62f00c25a0 2024-02-17T12:16:31.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.920+0000 7f62f5400640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f62d0066e40 0x7f62d0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:31.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.920+0000 7f62f5400640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f62d0066e40 0x7f62d0069300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009b60 tx=0x7f62e4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:31.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:31.924+0000 7f62ed600640 1 -- 172.21.15.114:0/1049210087 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f62dc0eb720 con 0x7f62f00c25a0 2024-02-17T12:16:32.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 -- 172.21.15.114:0/1049210087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62f0155f20 con 0x7f62f00c25a0 2024-02-17T12:16:32.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62ed600640 1 -- 172.21.15.114:0/1049210087 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f62dc0b0020 con 0x7f62f00c25a0 2024-02-17T12:16:32.083 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:16:32.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 -- 172.21.15.114:0/1049210087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f62d0066e40 msgr2=0x7f62d0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f62d0066e40 0x7f62d0069300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009b60 tx=0x7f62e4009190 comp rx=0 tx=0).stop 2024-02-17T12:16:32.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 -- 172.21.15.114:0/1049210087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c25a0 msgr2=0x7f62f0143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c25a0 0x7f62f0143f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0ae040 tx=0x7f62dc019010 comp rx=0 tx=0).stop 2024-02-17T12:16:32.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 -- 172.21.15.114:0/1049210087 shutdown_connections 2024-02-17T12:16:32.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62f0150490 0x7f62f0154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f62d0066e40 0x7f62d0069300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f00c25a0 0x7f62f0143f50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 --2- 172.21.15.114:0/1049210087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62f006db50 0x7f62f01ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 -- 172.21.15.114:0/1049210087 >> 172.21.15.114:0/1049210087 conn(0x7f62f00a8490 msgr2=0x7f62f0149cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:32.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 -- 172.21.15.114:0/1049210087 shutdown_connections 2024-02-17T12:16:32.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.080+0000 7f62f7e00640 1 -- 172.21.15.114:0/1049210087 wait complete. 2024-02-17T12:16:32.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:16:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.236+0000 7fea94a00640 1 Processor -- start 2024-02-17T12:16:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.236+0000 7fea94a00640 1 -- start start 2024-02-17T12:16:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea94a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fea9006ef60 0x7fea90158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea94a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fea900c0640 0x7fea90158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea94a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9006e890 con 0x7fea90152510 2024-02-17T12:16:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea94a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea900c2670 con 0x7fea9006ef60 2024-02-17T12:16:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea94a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea90158370 con 0x7fea900c0640 2024-02-17T12:16:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea8d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fea9006ef60 0x7fea90158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea8d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fea9006ef60 0x7fea90158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57914/0 (socket says 172.21.15.114:57914) 2024-02-17T12:16:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea8d400640 1 -- 172.21.15.114:0/2609363622 learned_addr learned my addr 172.21.15.114:0/2609363622 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea8e800640 1 --2- 172.21.15.114:0/2609363622 >> v2:172.21.15.116:3300/0 conn(0x7fea900c0640 0x7fea90158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea8d400640 1 -- 172.21.15.114:0/2609363622 >> v2:172.21.15.116:3300/0 conn(0x7fea900c0640 msgr2=0x7fea90158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea8d400640 1 --2- 172.21.15.114:0/2609363622 >> v2:172.21.15.116:3300/0 conn(0x7fea900c0640 0x7fea90158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea8d400640 1 -- 172.21.15.114:0/2609363622 >> v1:172.21.15.116:6789/0 conn(0x7fea90152510 legacy=0x7fea900c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea8d400640 1 -- 172.21.15.114:0/2609363622 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90159280 con 0x7fea9006ef60 2024-02-17T12:16:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.240+0000 7fea8e800640 1 --2- 172.21.15.114:0/2609363622 >> v2:172.21.15.116:3300/0 conn(0x7fea900c0640 0x7fea90158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea8d400640 1 --2- 172.21.15.114:0/2609363622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea9006ef60 0x7fea90158800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea90070b20 tx=0x7fea7c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6c5ea029c1fb61 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea8ca00640 1 -- 172.21.15.114:0/2609363622 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0ab620 con 0x7fea9006ef60 2024-02-17T12:16:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea8ca00640 1 -- 172.21.15.114:0/2609363622 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c0ab780 con 0x7fea9006ef60 2024-02-17T12:16:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea8ca00640 1 -- 172.21.15.114:0/2609363622 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0abb10 con 0x7fea9006ef60 2024-02-17T12:16:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 -- 172.21.15.114:0/2609363622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea9006ef60 msgr2=0x7fea90158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 --2- 172.21.15.114:0/2609363622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea9006ef60 0x7fea90158800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea90070b20 tx=0x7fea7c01c420 comp rx=0 tx=0).stop 2024-02-17T12:16:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 -- 172.21.15.114:0/2609363622 shutdown_connections 2024-02-17T12:16:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 --2- 172.21.15.114:0/2609363622 >> v2:172.21.15.116:3300/0 conn(0x7fea900c0640 0x7fea90158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 --2- 172.21.15.114:0/2609363622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea9006ef60 0x7fea90158800 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 -- 172.21.15.114:0/2609363622 >> 172.21.15.114:0/2609363622 conn(0x7fea900a8490 msgr2=0x7fea900a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:32.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 -- 172.21.15.114:0/2609363622 shutdown_connections 2024-02-17T12:16:32.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 -- 172.21.15.114:0/2609363622 wait complete. 2024-02-17T12:16:32.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 Processor -- start 2024-02-17T12:16:32.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 -- start start 2024-02-17T12:16:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006ef60 0x7fea900c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea900c0640 0x7fea90154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea90152510 0x7fea900c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea90152d20 con 0x7fea900c0640 2024-02-17T12:16:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea900725f0 con 0x7fea9006ef60 2024-02-17T12:16:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.244+0000 7fea94a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea901537b0 con 0x7fea90152510 2024-02-17T12:16:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea900c0640 0x7fea90154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea900c0640 0x7fea90154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57926/0 (socket says 172.21.15.114:57926) 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8d400640 1 -- 172.21.15.114:0/3847596984 learned_addr learned my addr 172.21.15.114:0/3847596984 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8de00640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006ef60 0x7fea900c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8e800640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea90152510 0x7fea900c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8d400640 1 -- 172.21.15.114:0/3847596984 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea90152510 msgr2=0x7fea900c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8d400640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea90152510 0x7fea900c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8d400640 1 -- 172.21.15.114:0/3847596984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006ef60 msgr2=0x7fea900c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8d400640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006ef60 0x7fea900c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8d400640 1 -- 172.21.15.114:0/3847596984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c0094d0 con 0x7fea900c0640 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea8d400640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea900c0640 0x7fea90154580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea7c01a050 tx=0x7fea7c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea86000640 1 -- 172.21.15.114:0/3847596984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0be3f0 con 0x7fea900c0640 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea86000640 1 -- 172.21.15.114:0/3847596984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c0be570 con 0x7fea900c0640 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea86000640 1 -- 172.21.15.114:0/3847596984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0be920 con 0x7fea900c0640 2024-02-17T12:16:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea94a00640 1 -- 172.21.15.114:0/3847596984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea90154ac0 con 0x7fea900c0640 2024-02-17T12:16:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea94a00640 1 -- 172.21.15.114:0/3847596984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea90072030 con 0x7fea900c0640 2024-02-17T12:16:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea94a00640 1 -- 172.21.15.114:0/3847596984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea90154cb0 con 0x7fea900c0640 2024-02-17T12:16:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea86000640 1 -- 172.21.15.114:0/3847596984 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fea7c0c7440 con 0x7fea900c0640 2024-02-17T12:16:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.248+0000 7fea86000640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea70066e40 0x7fea70069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.252+0000 7fea86000640 1 -- 172.21.15.114:0/3847596984 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea7c11f1d0 con 0x7fea900c0640 2024-02-17T12:16:32.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.252+0000 7fea8de00640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea70066e40 0x7fea70069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.252+0000 7fea8de00640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea70066e40 0x7fea70069300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea80005680 tx=0x7fea80003dd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.252+0000 7fea86000640 1 -- 172.21.15.114:0/3847596984 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fea7c0ec060 con 0x7fea900c0640 2024-02-17T12:16:32.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 -- 172.21.15.114:0/3847596984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea90074840 con 0x7fea900c0640 2024-02-17T12:16:32.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea86000640 1 -- 172.21.15.114:0/3847596984 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea7c0ef720 con 0x7fea900c0640 2024-02-17T12:16:32.416 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 -- 172.21.15.114:0/3847596984 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea70066e40 msgr2=0x7fea70069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea70066e40 0x7fea70069300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea80005680 tx=0x7fea80003dd0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 -- 172.21.15.114:0/3847596984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea900c0640 msgr2=0x7fea90154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea900c0640 0x7fea90154580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea7c01a050 tx=0x7fea7c01ac60 comp rx=0 tx=0).stop 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 -- 172.21.15.114:0/3847596984 shutdown_connections 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fea90152510 0x7fea900c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea70066e40 0x7fea70069300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea900c0640 0x7fea90154580 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 --2- 172.21.15.114:0/3847596984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006ef60 0x7fea900c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 -- 172.21.15.114:0/3847596984 >> 172.21.15.114:0/3847596984 conn(0x7fea900a8490 msgr2=0x7fea900c0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 -- 172.21.15.114:0/3847596984 shutdown_connections 2024-02-17T12:16:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.412+0000 7fea94a00640 1 -- 172.21.15.114:0/3847596984 wait complete. 2024-02-17T12:16:32.436 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:16:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.564+0000 7ff057c00640 1 Processor -- start 2024-02-17T12:16:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff057c00640 1 -- start start 2024-02-17T12:16:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff057c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff0500c25a0 0x7ff05006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff057c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff05006db50 0x7ff05014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff057c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff050156270 con 0x7ff050150490 2024-02-17T12:16:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff057c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff050071630 con 0x7ff0500c25a0 2024-02-17T12:16:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff057c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff050156550 con 0x7ff05006db50 2024-02-17T12:16:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff055200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff0500c25a0 0x7ff05006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff055c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff050150490 0x7ff050152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45590/0 (socket says 172.21.15.114:45590) 2024-02-17T12:16:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff055c00640 1 -- 172.21.15.114:0/3779099792 learned_addr learned my addr 172.21.15.114:0/3779099792 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff04fe00640 1 --2- 172.21.15.114:0/3779099792 >> v2:172.21.15.116:3300/0 conn(0x7ff05006db50 0x7ff05014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff055200640 1 -- 172.21.15.114:0/3779099792 >> v2:172.21.15.116:3300/0 conn(0x7ff05006db50 msgr2=0x7ff05014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff055200640 1 --2- 172.21.15.114:0/3779099792 >> v2:172.21.15.116:3300/0 conn(0x7ff05006db50 0x7ff05014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff055200640 1 -- 172.21.15.114:0/3779099792 >> v1:172.21.15.114:6789/0 conn(0x7ff050150490 legacy=0x7ff050152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff055200640 1 -- 172.21.15.114:0/3779099792 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050156830 con 0x7ff0500c25a0 2024-02-17T12:16:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.568+0000 7ff04fe00640 1 --2- 172.21.15.114:0/3779099792 >> v2:172.21.15.116:3300/0 conn(0x7ff05006db50 0x7ff05014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff055200640 1 --2- 172.21.15.114:0/3779099792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 0x7ff05006e980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff05006e260 tx=0x7ff03801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b564aa96f305d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff04f400640 1 -- 172.21.15.114:0/3779099792 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380ab400 con 0x7ff0500c25a0 2024-02-17T12:16:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff04f400640 1 -- 172.21.15.114:0/3779099792 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0380a7050 con 0x7ff0500c25a0 2024-02-17T12:16:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff04f400640 1 -- 172.21.15.114:0/3779099792 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380ab780 con 0x7ff0500c25a0 2024-02-17T12:16:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff057c00640 1 -- 172.21.15.114:0/3779099792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 msgr2=0x7ff05006e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff057c00640 1 --2- 172.21.15.114:0/3779099792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 0x7ff05006e980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff05006e260 tx=0x7ff03801c360 comp rx=0 tx=0).stop 2024-02-17T12:16:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff057c00640 1 -- 172.21.15.114:0/3779099792 shutdown_connections 2024-02-17T12:16:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff057c00640 1 --2- 172.21.15.114:0/3779099792 >> v2:172.21.15.116:3300/0 conn(0x7ff05006db50 0x7ff05014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff057c00640 1 --2- 172.21.15.114:0/3779099792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 0x7ff05006e980 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff057c00640 1 -- 172.21.15.114:0/3779099792 >> 172.21.15.114:0/3779099792 conn(0x7ff0500a8490 msgr2=0x7ff0500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff057c00640 1 -- 172.21.15.114:0/3779099792 shutdown_connections 2024-02-17T12:16:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff057c00640 1 -- 172.21.15.114:0/3779099792 wait complete. 2024-02-17T12:16:32.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff057c00640 1 Processor -- start 2024-02-17T12:16:32.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.572+0000 7ff057c00640 1 -- start start 2024-02-17T12:16:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff057c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff05006db50 0x7ff0501551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff057c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 0x7ff05013f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff057c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff050150490 0x7ff05013fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff057c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500a98d0 con 0x7ff0500c25a0 2024-02-17T12:16:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff057c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501f1f30 con 0x7ff050150490 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff057c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501426f0 con 0x7ff05006db50 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 0x7ff05013f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 0x7ff05013f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57944/0 (socket says 172.21.15.114:57944) 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04fe00640 1 -- 172.21.15.114:0/4072703760 learned_addr learned my addr 172.21.15.114:0/4072703760 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff055c00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff050150490 0x7ff05013fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff055200640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff05006db50 0x7ff0501551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04fe00640 1 -- 172.21.15.114:0/4072703760 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff05006db50 msgr2=0x7ff0501551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04fe00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff05006db50 0x7ff0501551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04fe00640 1 -- 172.21.15.114:0/4072703760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff050150490 msgr2=0x7ff05013fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04fe00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff050150490 0x7ff05013fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04fe00640 1 -- 172.21.15.114:0/4072703760 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038009420 con 0x7ff0500c25a0 2024-02-17T12:16:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff055c00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff050150490 0x7ff05013fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04fe00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 0x7ff05013f6f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff04000e810 tx=0x7ff04000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04cc00640 1 -- 172.21.15.114:0/4072703760 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04000c8d0 con 0x7ff0500c25a0 2024-02-17T12:16:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04cc00640 1 -- 172.21.15.114:0/4072703760 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04000ca30 con 0x7ff0500c25a0 2024-02-17T12:16:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff057c00640 1 -- 172.21.15.114:0/4072703760 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0501429d0 con 0x7ff0500c25a0 2024-02-17T12:16:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04cc00640 1 -- 172.21.15.114:0/4072703760 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04000cdc0 con 0x7ff0500c25a0 2024-02-17T12:16:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff057c00640 1 -- 172.21.15.114:0/4072703760 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff050141df0 con 0x7ff0500c25a0 2024-02-17T12:16:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff057c00640 1 -- 172.21.15.114:0/4072703760 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff050074840 con 0x7ff0500c25a0 2024-02-17T12:16:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.576+0000 7ff04cc00640 1 -- 172.21.15.114:0/4072703760 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff040013410 con 0x7ff0500c25a0 2024-02-17T12:16:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.580+0000 7ff04cc00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 0x7ff02c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.580+0000 7ff04cc00640 1 -- 172.21.15.114:0/4072703760 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0400847b0 con 0x7ff0500c25a0 2024-02-17T12:16:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.580+0000 7ff055200640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 0x7ff02c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.580+0000 7ff055200640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 0x7ff02c069300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff0380ad000 tx=0x7ff038008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:32.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.580+0000 7ff04cc00640 1 -- 172.21.15.114:0/4072703760 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff040051650 con 0x7ff0500c25a0 2024-02-17T12:16:32.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 -- 172.21.15.114:0/4072703760 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff05014dfa0 con 0x7ff0500c25a0 2024-02-17T12:16:32.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff04cc00640 1 -- 172.21.15.114:0/4072703760 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7ff040009480 con 0x7ff0500c25a0 2024-02-17T12:16:32.779 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:32.780 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4241624725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4241624725},{"type":"v1","addr":"172.21.15.114:6837","nonce":4241624725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/178899564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":178899564},{"type":"v1","addr":"172.21.15.114:6836","nonce":178899564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/3301698475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3301698475},{"type":"v1","addr":"172.21.15.116:6834","nonce":3301698475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:16:22.673862+0000","modified":"2024-02-17T12:16:25.681621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6835/4001468997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":4001468997},{"type":"v1","addr":"172.21.15.116:6835","nonce":4001468997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:16:32.780 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-02-17T12:16:32.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 -- 172.21.15.114:0/4072703760 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 msgr2=0x7ff02c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 0x7ff02c069300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff0380ad000 tx=0x7ff038008040 comp rx=0 tx=0).stop 2024-02-17T12:16:32.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 -- 172.21.15.114:0/4072703760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 msgr2=0x7ff05013f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 0x7ff05013f6f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff04000e810 tx=0x7ff04000ecd0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 -- 172.21.15.114:0/4072703760 shutdown_connections 2024-02-17T12:16:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff050150490 0x7ff05013fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 0x7ff02c069300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0500c25a0 0x7ff05013f6f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 --2- 172.21.15.114:0/4072703760 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff05006db50 0x7ff0501551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 -- 172.21.15.114:0/4072703760 >> 172.21.15.114:0/4072703760 conn(0x7ff0500a8490 msgr2=0x7ff05014ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 -- 172.21.15.114:0/4072703760 shutdown_connections 2024-02-17T12:16:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.776+0000 7ff057c00640 1 -- 172.21.15.114:0/4072703760 wait complete. 2024-02-17T12:16:32.800 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:32.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23b1400640 1 Processor -- start 2024-02-17T12:16:32.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23b1400640 1 -- start start 2024-02-17T12:16:32.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23b1400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f23ac06db50 0x7f23ac14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23b1400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac156270 con 0x7f23ac150490 2024-02-17T12:16:32.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23b1400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac156550 con 0x7f23ac0c25a0 2024-02-17T12:16:32.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23b1400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac06f090 con 0x7f23ac06db50 2024-02-17T12:16:32.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23ab200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f23ac150490 0x7f23ac152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45594/0 (socket says 172.21.15.114:45594) 2024-02-17T12:16:32.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23ab200640 1 -- 172.21.15.114:0/2002611084 learned_addr learned my addr 172.21.15.114:0/2002611084 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:32.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23a9e00640 1 --2- 172.21.15.114:0/2002611084 >> v2:172.21.15.116:3300/0 conn(0x7f23ac06db50 0x7f23ac14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923290453 0 0) 0x7f23ac156270 con 0x7f23ac150490 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.932+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2390003530 con 0x7f23ac150490 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2192845729 0 0) 0x7f2390003530 con 0x7f23ac150490 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 >> v2:172.21.15.116:3300/0 conn(0x7f23ac06db50 msgr2=0x7f23ac14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 --2- 172.21.15.114:0/2002611084 >> v2:172.21.15.116:3300/0 conn(0x7f23ac06db50 0x7f23ac14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 >> v1:172.21.15.116:6789/0 conn(0x7f23ac0c25a0 legacy=0x7f23ac06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac156830 con 0x7f23ac150490 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f23a4001680 con 0x7f23ac150490 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 >> v1:172.21.15.114:6789/0 conn(0x7f23ac150490 legacy=0x7f23ac152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23900039d0 0x7f2390003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23900047d0 0x7f2390004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900052b0 0x7f239000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac06f090 con 0x7f23900047d0 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239000c1b0 con 0x7f23900039d0 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239000c370 con 0x7f23900052b0 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9e00640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23900047d0 0x7f2390004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23aa800640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23900039d0 0x7f2390003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23ab200640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900052b0 0x7f239000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9e00640 1 -- 172.21.15.114:0/2002611084 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900052b0 msgr2=0x7f239000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9e00640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900052b0 0x7f239000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9e00640 1 -- 172.21.15.114:0/2002611084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23900039d0 msgr2=0x7f2390003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9e00640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23900039d0 0x7f2390003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9e00640 1 -- 172.21.15.114:0/2002611084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2390003530 con 0x7f23900047d0 2024-02-17T12:16:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23ab200640 1 -- 172.21.15.114:0/2002611084 reap_dead start 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9e00640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23900047d0 0x7f2390004c50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2394009ae0 tx=0x7f239401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d53e11a6693647 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940a6450 con 0x7f23900047d0 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23940a65b0 con 0x7f23900047d0 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.936+0000 7f23a9400640 1 -- 172.21.15.114:0/2002611084 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940a6960 con 0x7f23900047d0 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 -- 172.21.15.114:0/2002611084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23900047d0 msgr2=0x7f2390004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23900047d0 0x7f2390004c50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2394009ae0 tx=0x7f239401ca70 comp rx=0 tx=0).stop 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 -- 172.21.15.114:0/2002611084 shutdown_connections 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 --2- 172.21.15.114:0/2002611084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23900047d0 0x7f2390004c50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 -- 172.21.15.114:0/2002611084 >> 172.21.15.114:0/2002611084 conn(0x7f23ac0a8490 msgr2=0x7f23ac0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 -- 172.21.15.114:0/2002611084 shutdown_connections 2024-02-17T12:16:32.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 -- 172.21.15.114:0/2002611084 wait complete. 2024-02-17T12:16:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 Processor -- start 2024-02-17T12:16:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 -- start start 2024-02-17T12:16:32.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900047d0 0x7f23ac1ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ac146620 0x7f23ac145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac146060 0x7f23ac155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0c42b0 con 0x7f23ac146060 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0c3f60 con 0x7f23ac146620 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23b1400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac14dd90 con 0x7f23900047d0 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23ab200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac146060 0x7f23ac155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23ab200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac146060 0x7f23ac155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57966/0 (socket says 172.21.15.114:57966) 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23ab200640 1 -- 172.21.15.114:0/145873190 learned_addr learned my addr 172.21.15.114:0/145873190 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23a9e00640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ac146620 0x7f23ac145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23aa800640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900047d0 0x7f23ac1ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23ab200640 1 -- 172.21.15.114:0/145873190 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900047d0 msgr2=0x7f23ac1ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23ab200640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900047d0 0x7f23ac1ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23ab200640 1 -- 172.21.15.114:0/145873190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ac146620 msgr2=0x7f23ac145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23ab200640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ac146620 0x7f23ac145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23ab200640 1 -- 172.21.15.114:0/145873190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0c5c80 con 0x7f23ac146060 2024-02-17T12:16:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.940+0000 7f23ab200640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac146060 0x7f23ac155760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0c0bb0 tx=0x7f23a400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.944+0000 7f23a2a00640 1 -- 172.21.15.114:0/145873190 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4001000 con 0x7f23ac146060 2024-02-17T12:16:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.944+0000 7f23a2a00640 1 -- 172.21.15.114:0/145873190 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a4010510 con 0x7f23ac146060 2024-02-17T12:16:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.944+0000 7f23b1400640 1 -- 172.21.15.114:0/145873190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0c5f60 con 0x7f23ac146060 2024-02-17T12:16:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.944+0000 7f23a2a00640 1 -- 172.21.15.114:0/145873190 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a40108a0 con 0x7f23ac146060 2024-02-17T12:16:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.944+0000 7f23b1400640 1 -- 172.21.15.114:0/145873190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac145c90 con 0x7f23ac146060 2024-02-17T12:16:32.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.944+0000 7f23b1400640 1 -- 172.21.15.114:0/145873190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac0c43f0 con 0x7f23ac146060 2024-02-17T12:16:32.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.944+0000 7f23a2a00640 1 -- 172.21.15.114:0/145873190 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f23a4010a00 con 0x7f23ac146060 2024-02-17T12:16:32.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.944+0000 7f23a2a00640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2388066e70 0x7f2388069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:32.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.944+0000 7f23a2a00640 1 -- 172.21.15.114:0/145873190 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23a4083c60 con 0x7f23ac146060 2024-02-17T12:16:32.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.944+0000 7f23aa800640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2388066e70 0x7f2388069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:32.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.948+0000 7f23aa800640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2388066e70 0x7f2388069330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f239c007e30 tx=0x7f239c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:32.952+0000 7f23a2a00640 1 -- 172.21.15.114:0/145873190 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f23ac0c43f0 con 0x7f23ac146060 2024-02-17T12:16:33.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.104+0000 7f23b1400640 1 -- 172.21.15.114:0/145873190 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23ac0c43f0 con 0x7f23ac146060 2024-02-17T12:16:33.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.104+0000 7f23a2a00640 1 -- 172.21.15.114:0/145873190 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f23ac0c43f0 con 0x7f23ac146060 2024-02-17T12:16:33.108 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:33.108 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 -- 172.21.15.114:0/145873190 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2388066e70 msgr2=0x7f2388069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2388066e70 0x7f2388069330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f239c007e30 tx=0x7f239c009040 comp rx=0 tx=0).stop 2024-02-17T12:16:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 -- 172.21.15.114:0/145873190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac146060 msgr2=0x7f23ac155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac146060 0x7f23ac155760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0c0bb0 tx=0x7f23a400e960 comp rx=0 tx=0).stop 2024-02-17T12:16:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 -- 172.21.15.114:0/145873190 shutdown_connections 2024-02-17T12:16:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2388066e70 0x7f2388069330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac146060 0x7f23ac155760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ac146620 0x7f23ac145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 --2- 172.21.15.114:0/145873190 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900047d0 0x7f23ac1ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 -- 172.21.15.114:0/145873190 >> 172.21.15.114:0/145873190 conn(0x7f23ac0a8490 msgr2=0x7f23ac0c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 -- 172.21.15.114:0/145873190 shutdown_connections 2024-02-17T12:16:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.108+0000 7f23b1400640 1 -- 172.21.15.114:0/145873190 wait complete. 2024-02-17T12:16:33.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:16:21.236908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:16:21.659009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:33.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:33.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8bc000640 1 Processor -- start 2024-02-17T12:16:33.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8bc000640 1 -- start start 2024-02-17T12:16:33.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8bc000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa8b40c1eb0 0x7fa8b415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8bc000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b40a9420 con 0x7fa8b40c2580 2024-02-17T12:16:33.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8bc000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b4152850 con 0x7fa8b414f110 2024-02-17T12:16:33.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8bc000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b414f4f0 con 0x7fa8b40c1eb0 2024-02-17T12:16:33.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8b8c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa8b40c2580 0x7fa8b40aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45608/0 (socket says 172.21.15.114:45608) 2024-02-17T12:16:33.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8b8c00640 1 -- 172.21.15.114:0/2282160806 learned_addr learned my addr 172.21.15.114:0/2282160806 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:33.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8ba000640 1 --2- 172.21.15.114:0/2282160806 >> v2:172.21.15.116:3300/0 conn(0x7fa8b40c1eb0 0x7fa8b415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8b3e00640 1 -- 172.21.15.114:0/2282160806 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794565713 0 0) 0x7fa8b40a9420 con 0x7fa8b40c2580 2024-02-17T12:16:33.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8b3e00640 1 -- 172.21.15.114:0/2282160806 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa89c005740 con 0x7fa8b40c2580 2024-02-17T12:16:33.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8ba000640 1 -- 172.21.15.114:0/2282160806 >> v1:172.21.15.116:6789/0 conn(0x7fa8b414f110 legacy=0x7fa8b40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8ba000640 1 -- 172.21.15.114:0/2282160806 >> v1:172.21.15.114:6789/0 conn(0x7fa8b40c2580 legacy=0x7fa8b40aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.264+0000 7fa8ba000640 1 -- 172.21.15.114:0/2282160806 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40a9670 con 0x7fa8b40c1eb0 2024-02-17T12:16:33.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8ba000640 1 --2- 172.21.15.114:0/2282160806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b40c1eb0 0x7fa8b415d3a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009d90 tx=0x7fa8ac01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1db801e3c066e8a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:33.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8b3e00640 1 -- 172.21.15.114:0/2282160806 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0a5790 con 0x7fa8b40c1eb0 2024-02-17T12:16:33.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8b3e00640 1 -- 172.21.15.114:0/2282160806 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac0a58f0 con 0x7fa8b40c1eb0 2024-02-17T12:16:33.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8b3e00640 1 -- 172.21.15.114:0/2282160806 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0a5c60 con 0x7fa8b40c1eb0 2024-02-17T12:16:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8bc000640 1 -- 172.21.15.114:0/2282160806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b40c1eb0 msgr2=0x7fa8b415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8bc000640 1 --2- 172.21.15.114:0/2282160806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b40c1eb0 0x7fa8b415d3a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009d90 tx=0x7fa8ac01c8e0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8bc000640 1 -- 172.21.15.114:0/2282160806 shutdown_connections 2024-02-17T12:16:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8bc000640 1 --2- 172.21.15.114:0/2282160806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b40c1eb0 0x7fa8b415d3a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8bc000640 1 -- 172.21.15.114:0/2282160806 >> 172.21.15.114:0/2282160806 conn(0x7fa8b40a8490 msgr2=0x7fa8b40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8bc000640 1 -- 172.21.15.114:0/2282160806 shutdown_connections 2024-02-17T12:16:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.268+0000 7fa8bc000640 1 -- 172.21.15.114:0/2282160806 wait complete. 2024-02-17T12:16:33.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 Processor -- start 2024-02-17T12:16:33.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 -- start start 2024-02-17T12:16:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8b40c1eb0 0x7fa8b41f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40c2580 0x7fa8b41530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b414f110 0x7fa8b4153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40c5df0 con 0x7fa8b40c2580 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b41f1ad0 con 0x7fa8b414f110 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b414c230 con 0x7fa8b40c1eb0 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40c2580 0x7fa8b41530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40c2580 0x7fa8b41530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57978/0 (socket says 172.21.15.114:57978) 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b8c00640 1 -- 172.21.15.114:0/1732693263 learned_addr learned my addr 172.21.15.114:0/1732693263 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8ba000640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b414f110 0x7fa8b4153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b9600640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8b40c1eb0 0x7fa8b41f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b8c00640 1 -- 172.21.15.114:0/1732693263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8b40c1eb0 msgr2=0x7fa8b41f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b8c00640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8b40c1eb0 0x7fa8b41f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b8c00640 1 -- 172.21.15.114:0/1732693263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b414f110 msgr2=0x7fa8b4153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b8c00640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b414f110 0x7fa8b4153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b8c00640 1 -- 172.21.15.114:0/1732693263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac009a70 con 0x7fa8b40c2580 2024-02-17T12:16:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b8c00640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40c2580 0x7fa8b41530c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c400 tx=0x7fa8a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b1600640 1 -- 172.21.15.114:0/1732693263 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0005cf0 con 0x7fa8b40c2580 2024-02-17T12:16:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b1600640 1 -- 172.21.15.114:0/1732693263 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0005e50 con 0x7fa8b40c2580 2024-02-17T12:16:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 -- 172.21.15.114:0/1732693263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b41f17f0 con 0x7fa8b40c2580 2024-02-17T12:16:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8b1600640 1 -- 172.21.15.114:0/1732693263 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00072d0 con 0x7fa8b40c2580 2024-02-17T12:16:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 -- 172.21.15.114:0/1732693263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b4152da0 con 0x7fa8b40c2580 2024-02-17T12:16:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.272+0000 7fa8bc000640 1 -- 172.21.15.114:0/1732693263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b414b890 con 0x7fa8b40c2580 2024-02-17T12:16:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.276+0000 7fa8b1600640 1 -- 172.21.15.114:0/1732693263 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa8a0007470 con 0x7fa8b40c2580 2024-02-17T12:16:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.276+0000 7fa8b1600640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa894066e40 0x7fa894069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.276+0000 7fa8b1600640 1 -- 172.21.15.114:0/1732693263 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8a0083fe0 con 0x7fa8b40c2580 2024-02-17T12:16:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.276+0000 7fa8b9600640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa894066e40 0x7fa894069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.276+0000 7fa8b9600640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa894066e40 0x7fa894069300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8000f70 tx=0x7fa8a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.280+0000 7fa8b1600640 1 -- 172.21.15.114:0/1732693263 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa8b414b890 con 0x7fa8b40c2580 2024-02-17T12:16:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 -- 172.21.15.114:0/1732693263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8b414b890 con 0x7fa8b40c2580 2024-02-17T12:16:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8b1600640 1 -- 172.21.15.114:0/1732693263 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8b414b890 con 0x7fa8b40c2580 2024-02-17T12:16:33.440 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 -- 172.21.15.114:0/1732693263 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa894066e40 msgr2=0x7fa894069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa894066e40 0x7fa894069300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8000f70 tx=0x7fa8a8009040 comp rx=0 tx=0).stop 2024-02-17T12:16:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 -- 172.21.15.114:0/1732693263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40c2580 msgr2=0x7fa8b41530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40c2580 0x7fa8b41530c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c400 tx=0x7fa8a000c8c0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 -- 172.21.15.114:0/1732693263 shutdown_connections 2024-02-17T12:16:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8b414f110 0x7fa8b4153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa894066e40 0x7fa894069300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8b40c2580 0x7fa8b41530c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 --2- 172.21.15.114:0/1732693263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa8b40c1eb0 0x7fa8b41f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 -- 172.21.15.114:0/1732693263 >> 172.21.15.114:0/1732693263 conn(0x7fa8b40a8490 msgr2=0x7fa8b40c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 -- 172.21.15.114:0/1732693263 shutdown_connections 2024-02-17T12:16:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.436+0000 7fa8bc000640 1 -- 172.21.15.114:0/1732693263 wait complete. 2024-02-17T12:16:33.459 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:16:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c2c400640 1 Processor -- start 2024-02-17T12:16:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c2c400640 1 -- start start 2024-02-17T12:16:33.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c2c400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c2406db50 0x7f8c2414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c2c400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8c24150490 0x7f8c24152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c2c400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c24156270 con 0x7f8c240c25a0 2024-02-17T12:16:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c2c400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2406f090 con 0x7f8c2406db50 2024-02-17T12:16:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c2c400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c24071630 con 0x7f8c24150490 2024-02-17T12:16:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c29a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8c240c25a0 0x7f8c2406e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45616/0 (socket says 172.21.15.114:45616) 2024-02-17T12:16:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c29000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c2406db50 0x7f8c2414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c29a00640 1 -- 172.21.15.114:0/2246231049 learned_addr learned my addr 172.21.15.114:0/2246231049 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:33.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.592+0000 7f8c2a400640 1 --2- 172.21.15.114:0/2246231049 >> v2:172.21.15.116:3300/0 conn(0x7f8c24150490 0x7f8c24152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c23e00640 1 -- 172.21.15.114:0/2246231049 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382483810 0 0) 0x7f8c24156270 con 0x7f8c240c25a0 2024-02-17T12:16:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c23e00640 1 -- 172.21.15.114:0/2246231049 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c0c003530 con 0x7f8c240c25a0 2024-02-17T12:16:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c29000640 1 -- 172.21.15.114:0/2246231049 >> v2:172.21.15.116:3300/0 conn(0x7f8c24150490 msgr2=0x7f8c24152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c29000640 1 --2- 172.21.15.114:0/2246231049 >> v2:172.21.15.116:3300/0 conn(0x7f8c24150490 0x7f8c24152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c29000640 1 -- 172.21.15.114:0/2246231049 >> v1:172.21.15.114:6789/0 conn(0x7f8c240c25a0 legacy=0x7f8c2406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c29000640 1 -- 172.21.15.114:0/2246231049 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24156550 con 0x7f8c2406db50 2024-02-17T12:16:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c29000640 1 --2- 172.21.15.114:0/2246231049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 0x7f8c2414ff50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8c24153cb0 tx=0x7f8c1801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496c94ebc998e07c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c23e00640 1 -- 172.21.15.114:0/2246231049 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c241539a0 con 0x7f8c2406db50 2024-02-17T12:16:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c23e00640 1 -- 172.21.15.114:0/2246231049 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c180a7050 con 0x7f8c2406db50 2024-02-17T12:16:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c23e00640 1 -- 172.21.15.114:0/2246231049 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c180ab820 con 0x7f8c2406db50 2024-02-17T12:16:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c2c400640 1 -- 172.21.15.114:0/2246231049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 msgr2=0x7f8c2414ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c2c400640 1 --2- 172.21.15.114:0/2246231049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 0x7f8c2414ff50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8c24153cb0 tx=0x7f8c1801c360 comp rx=0 tx=0).stop 2024-02-17T12:16:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c2c400640 1 -- 172.21.15.114:0/2246231049 shutdown_connections 2024-02-17T12:16:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c2c400640 1 --2- 172.21.15.114:0/2246231049 >> v2:172.21.15.116:3300/0 conn(0x7f8c24150490 0x7f8c24152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c2c400640 1 --2- 172.21.15.114:0/2246231049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 0x7f8c2414ff50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c2c400640 1 -- 172.21.15.114:0/2246231049 >> 172.21.15.114:0/2246231049 conn(0x7f8c240a8490 msgr2=0x7f8c240a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c2c400640 1 -- 172.21.15.114:0/2246231049 shutdown_connections 2024-02-17T12:16:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.596+0000 7f8c2c400640 1 -- 172.21.15.114:0/2246231049 wait complete. 2024-02-17T12:16:33.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2c400640 1 Processor -- start 2024-02-17T12:16:33.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2c400640 1 -- start start 2024-02-17T12:16:33.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 0x7f8c24155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2c400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c240c25a0 0x7f8c24153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2c400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c24150490 0x7f8c241499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240a9a70 con 0x7f8c2406db50 2024-02-17T12:16:33.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2c400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24154480 con 0x7f8c240c25a0 2024-02-17T12:16:33.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2c400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24155420 con 0x7f8c24150490 2024-02-17T12:16:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c29a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 0x7f8c24155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c29a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 0x7f8c24155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57992/0 (socket says 172.21.15.114:57992) 2024-02-17T12:16:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c29a00640 1 -- 172.21.15.114:0/2657116957 learned_addr learned my addr 172.21.15.114:0/2657116957 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2a400640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c24150490 0x7f8c241499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c29000640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c240c25a0 0x7f8c24153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c29a00640 1 -- 172.21.15.114:0/2657116957 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c24150490 msgr2=0x7f8c241499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c29a00640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c24150490 0x7f8c241499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c29a00640 1 -- 172.21.15.114:0/2657116957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c240c25a0 msgr2=0x7f8c24153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c29a00640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c240c25a0 0x7f8c24153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c29a00640 1 -- 172.21.15.114:0/2657116957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18009420 con 0x7f8c2406db50 2024-02-17T12:16:33.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c29a00640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 0x7f8c24155b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400c450 tx=0x7f8c1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:33.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c21600640 1 -- 172.21.15.114:0/2657116957 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14005cf0 con 0x7f8c2406db50 2024-02-17T12:16:33.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c21600640 1 -- 172.21.15.114:0/2657116957 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c14005e50 con 0x7f8c2406db50 2024-02-17T12:16:33.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2c400640 1 -- 172.21.15.114:0/2657116957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c240a9c80 con 0x7f8c2406db50 2024-02-17T12:16:33.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c21600640 1 -- 172.21.15.114:0/2657116957 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14007290 con 0x7f8c2406db50 2024-02-17T12:16:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.600+0000 7f8c2c400640 1 -- 172.21.15.114:0/2657116957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c24155670 con 0x7f8c2406db50 2024-02-17T12:16:33.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.604+0000 7f8c2c400640 1 -- 172.21.15.114:0/2657116957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c240aa1a0 con 0x7f8c2406db50 2024-02-17T12:16:33.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.604+0000 7f8c21600640 1 -- 172.21.15.114:0/2657116957 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8c140073f0 con 0x7f8c2406db50 2024-02-17T12:16:33.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.604+0000 7f8c21600640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c08066e40 0x7f8c08069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.604+0000 7f8c21600640 1 -- 172.21.15.114:0/2657116957 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c14083fe0 con 0x7f8c2406db50 2024-02-17T12:16:33.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.604+0000 7f8c29000640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c08066e40 0x7f8c08069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.604+0000 7f8c29000640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c08066e40 0x7f8c08069300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c180ad000 tx=0x7f8c18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:33.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.608+0000 7f8c21600640 1 -- 172.21.15.114:0/2657116957 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8c14050e00 con 0x7f8c2406db50 2024-02-17T12:16:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.764+0000 7f8c2c400640 1 -- 172.21.15.114:0/2657116957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c24155860 con 0x7f8c2406db50 2024-02-17T12:16:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.764+0000 7f8c21600640 1 -- 172.21.15.114:0/2657116957 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c140170a0 con 0x7f8c2406db50 2024-02-17T12:16:33.769 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 -- 172.21.15.114:0/2657116957 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c08066e40 msgr2=0x7f8c08069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c08066e40 0x7f8c08069300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c180ad000 tx=0x7f8c18008040 comp rx=0 tx=0).stop 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 -- 172.21.15.114:0/2657116957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 msgr2=0x7f8c24155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 0x7f8c24155b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400c450 tx=0x7f8c1400c910 comp rx=0 tx=0).stop 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 -- 172.21.15.114:0/2657116957 shutdown_connections 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c24150490 0x7f8c241499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c240c25a0 0x7f8c24153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c08066e40 0x7f8c08069300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 --2- 172.21.15.114:0/2657116957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c2406db50 0x7f8c24155b90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 -- 172.21.15.114:0/2657116957 >> 172.21.15.114:0/2657116957 conn(0x7f8c240a8490 msgr2=0x7f8c240c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 -- 172.21.15.114:0/2657116957 shutdown_connections 2024-02-17T12:16:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.768+0000 7f8c2c400640 1 -- 172.21.15.114:0/2657116957 wait complete. 2024-02-17T12:16:33.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:16:33.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f7870a00640 1 Processor -- start 2024-02-17T12:16:33.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f7870a00640 1 -- start start 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f7870a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f786c06ae70 0x7f786c152390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f7870a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f786c0c20e0 0x7f786c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f7870a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786c0c0d00 con 0x7f786c14f150 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f7870a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c0c1880 con 0x7f786c06ae70 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f7870a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c0c0f50 con 0x7f786c0c20e0 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f786b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f786c06ae70 0x7f786c152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f786b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f786c06ae70 0x7f786c152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58004/0 (socket says 172.21.15.114:58004) 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f786b400640 1 -- 172.21.15.114:0/1564472029 learned_addr learned my addr 172.21.15.114:0/1564472029 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f786aa00640 1 --2- 172.21.15.114:0/1564472029 >> v2:172.21.15.116:3300/0 conn(0x7f786c0c20e0 0x7f786c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f786b400640 1 -- 172.21.15.114:0/1564472029 >> v2:172.21.15.116:3300/0 conn(0x7f786c0c20e0 msgr2=0x7f786c14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f786b400640 1 --2- 172.21.15.114:0/1564472029 >> v2:172.21.15.116:3300/0 conn(0x7f786c0c20e0 0x7f786c14ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f786b400640 1 -- 172.21.15.114:0/1564472029 >> v1:172.21.15.116:6789/0 conn(0x7f786c14f150 legacy=0x7f786c152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f786b400640 1 -- 172.21.15.114:0/1564472029 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0c1230 con 0x7f786c06ae70 2024-02-17T12:16:33.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.924+0000 7f786aa00640 1 --2- 172.21.15.114:0/1564472029 >> v2:172.21.15.116:3300/0 conn(0x7f786c0c20e0 0x7f786c14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:33.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f786b400640 1 --2- 172.21.15.114:0/1564472029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c06ae70 0x7f786c152390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f786c0c2ba0 tx=0x7f785c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f7a4c2c0e85d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:33.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f786a000640 1 -- 172.21.15.114:0/1564472029 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0ac410 con 0x7f786c06ae70 2024-02-17T12:16:33.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f786a000640 1 -- 172.21.15.114:0/1564472029 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c0ac570 con 0x7f786c06ae70 2024-02-17T12:16:33.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f786a000640 1 -- 172.21.15.114:0/1564472029 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0ac900 con 0x7f786c06ae70 2024-02-17T12:16:33.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f7870a00640 1 -- 172.21.15.114:0/1564472029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c06ae70 msgr2=0x7f786c152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f7870a00640 1 --2- 172.21.15.114:0/1564472029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c06ae70 0x7f786c152390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f786c0c2ba0 tx=0x7f785c01c390 comp rx=0 tx=0).stop 2024-02-17T12:16:33.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f7870a00640 1 -- 172.21.15.114:0/1564472029 shutdown_connections 2024-02-17T12:16:33.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f7870a00640 1 --2- 172.21.15.114:0/1564472029 >> v2:172.21.15.116:3300/0 conn(0x7f786c0c20e0 0x7f786c14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f7870a00640 1 --2- 172.21.15.114:0/1564472029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c06ae70 0x7f786c152390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f7870a00640 1 -- 172.21.15.114:0/1564472029 >> 172.21.15.114:0/1564472029 conn(0x7f786c0c6300 msgr2=0x7f786c0c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:33.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f7870a00640 1 -- 172.21.15.114:0/1564472029 shutdown_connections 2024-02-17T12:16:33.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.928+0000 7f7870a00640 1 -- 172.21.15.114:0/1564472029 wait complete. 2024-02-17T12:16:33.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 Processor -- start 2024-02-17T12:16:33.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 -- start start 2024-02-17T12:16:33.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f786c06ae70 0x7f786c155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f786c0c20e0 0x7f786c1ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c14f150 0x7f786c0c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c155b90 con 0x7f786c14f150 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0aa440 con 0x7f786c06ae70 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0aa720 con 0x7f786c0c20e0 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c14f150 0x7f786c0c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c14f150 0x7f786c0c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58016/0 (socket says 172.21.15.114:58016) 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786be00640 1 -- 172.21.15.114:0/2729121874 learned_addr learned my addr 172.21.15.114:0/2729121874 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786b400640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f786c06ae70 0x7f786c155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786aa00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f786c0c20e0 0x7f786c1ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786be00640 1 -- 172.21.15.114:0/2729121874 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f786c0c20e0 msgr2=0x7f786c1ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786be00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f786c0c20e0 0x7f786c1ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786be00640 1 -- 172.21.15.114:0/2729121874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f786c06ae70 msgr2=0x7f786c155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786be00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f786c06ae70 0x7f786c155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786be00640 1 -- 172.21.15.114:0/2729121874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c0094d0 con 0x7f786c14f150 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786b400640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f786c06ae70 0x7f786c155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786aa00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f786c0c20e0 0x7f786c1ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:33.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f786be00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c14f150 0x7f786c0c4f40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f786400b970 tx=0x7f786400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:33.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7863400640 1 -- 172.21.15.114:0/2729121874 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400cb40 con 0x7f786c14f150 2024-02-17T12:16:33.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7863400640 1 -- 172.21.15.114:0/2729121874 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786400cca0 con 0x7f786c14f150 2024-02-17T12:16:33.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 -- 172.21.15.114:0/2729121874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786c0aaa00 con 0x7f786c14f150 2024-02-17T12:16:33.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7863400640 1 -- 172.21.15.114:0/2729121874 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864014680 con 0x7f786c14f150 2024-02-17T12:16:33.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 -- 172.21.15.114:0/2729121874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c1ed120 con 0x7f786c14f150 2024-02-17T12:16:33.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.932+0000 7f7870a00640 1 -- 172.21.15.114:0/2729121874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786c04eef0 con 0x7f786c14f150 2024-02-17T12:16:33.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.936+0000 7f7863400640 1 -- 172.21.15.114:0/2729121874 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f786401d3b0 con 0x7f786c14f150 2024-02-17T12:16:33.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.936+0000 7f7863400640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f784c066e70 0x7f784c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:33.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.936+0000 7f7863400640 1 -- 172.21.15.114:0/2729121874 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7864084840 con 0x7f786c14f150 2024-02-17T12:16:33.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.936+0000 7f786b400640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f784c066e70 0x7f784c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:33.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.936+0000 7f786b400640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f784c066e70 0x7f784c069330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f785c0ae000 tx=0x7f785c0a6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:33.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:33.940+0000 7f7863400640 1 -- 172.21.15.114:0/2729121874 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7864051620 con 0x7f786c14f150 2024-02-17T12:16:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 -- 172.21.15.114:0/2729121874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f786c1ed640 con 0x7f786c14f150 2024-02-17T12:16:34.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7863400640 1 -- 172.21.15.114:0/2729121874 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7864054ce0 con 0x7f786c14f150 2024-02-17T12:16:34.099 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:16:34.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 -- 172.21.15.114:0/2729121874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f784c066e70 msgr2=0x7f784c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f784c066e70 0x7f784c069330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f785c0ae000 tx=0x7f785c0a6040 comp rx=0 tx=0).stop 2024-02-17T12:16:34.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 -- 172.21.15.114:0/2729121874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c14f150 msgr2=0x7f786c0c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c14f150 0x7f786c0c4f40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f786400b970 tx=0x7f786400be30 comp rx=0 tx=0).stop 2024-02-17T12:16:34.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 -- 172.21.15.114:0/2729121874 shutdown_connections 2024-02-17T12:16:34.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f784c066e70 0x7f784c069330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f786c14f150 0x7f786c0c4f40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f786c0c20e0 0x7f786c1ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 --2- 172.21.15.114:0/2729121874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f786c06ae70 0x7f786c155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 -- 172.21.15.114:0/2729121874 >> 172.21.15.114:0/2729121874 conn(0x7f786c0c6300 msgr2=0x7f786c06e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:34.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 -- 172.21.15.114:0/2729121874 shutdown_connections 2024-02-17T12:16:34.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.096+0000 7f7870a00640 1 -- 172.21.15.114:0/2729121874 wait complete. 2024-02-17T12:16:34.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:16:34.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dd2e00640 1 Processor -- start 2024-02-17T12:16:34.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dd2e00640 1 -- start start 2024-02-17T12:16:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dd2e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2dcc06db50 0x7f2dcc14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dd2e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc156270 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dd2e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc156550 con 0x7f2dcc150490 2024-02-17T12:16:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dd2e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dcc06f090 con 0x7f2dcc06db50 2024-02-17T12:16:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dcbe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2dcc0c25a0 0x7f2dcc06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45618/0 (socket says 172.21.15.114:45618) 2024-02-17T12:16:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dcbe00640 1 -- 172.21.15.114:0/3274596383 learned_addr learned my addr 172.21.15.114:0/3274596383 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:34.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dcb400640 1 --2- 172.21.15.114:0/3274596383 >> v2:172.21.15.114:3300/0 conn(0x7f2dcc06db50 0x7f2dcc14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dcaa00640 1 -- 172.21.15.114:0/3274596383 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968822297 0 0) 0x7f2dcc156270 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dcaa00640 1 -- 172.21.15.114:0/3274596383 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db0003530 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dcb400640 1 -- 172.21.15.114:0/3274596383 >> v1:172.21.15.116:6789/0 conn(0x7f2dcc150490 legacy=0x7f2dcc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dcb400640 1 -- 172.21.15.114:0/3274596383 >> v1:172.21.15.114:6789/0 conn(0x7f2dcc0c25a0 legacy=0x7f2dcc06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.252+0000 7f2dcb400640 1 -- 172.21.15.114:0/3274596383 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc156830 con 0x7f2dcc06db50 2024-02-17T12:16:34.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dcb400640 1 --2- 172.21.15.114:0/3274596383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc06db50 0x7f2dcc14ff50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2db80097c0 tx=0x7f2db801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6853735edc2a6812 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:34.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dcaa00640 1 -- 172.21.15.114:0/3274596383 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80ab600 con 0x7f2dcc06db50 2024-02-17T12:16:34.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dcaa00640 1 -- 172.21.15.114:0/3274596383 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db80a7050 con 0x7f2dcc06db50 2024-02-17T12:16:34.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dcaa00640 1 -- 172.21.15.114:0/3274596383 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80ab980 con 0x7f2dcc06db50 2024-02-17T12:16:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3274596383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc06db50 msgr2=0x7f2dcc14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dd2e00640 1 --2- 172.21.15.114:0/3274596383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc06db50 0x7f2dcc14ff50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2db80097c0 tx=0x7f2db801c380 comp rx=0 tx=0).stop 2024-02-17T12:16:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3274596383 shutdown_connections 2024-02-17T12:16:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dd2e00640 1 --2- 172.21.15.114:0/3274596383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc06db50 0x7f2dcc14ff50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3274596383 >> 172.21.15.114:0/3274596383 conn(0x7f2dcc0a8490 msgr2=0x7f2dcc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3274596383 shutdown_connections 2024-02-17T12:16:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3274596383 wait complete. 2024-02-17T12:16:34.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.256+0000 7f2dd2e00640 1 Processor -- start 2024-02-17T12:16:34.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd2e00640 1 -- start start 2024-02-17T12:16:34.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd2e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dcc06db50 0x7f2dcc1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd2e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc0c25a0 0x7f2dcc13bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd2e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2dcc150490 0x7f2dcc1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd2e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc151930 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd2e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc13b380 con 0x7f2dcc06db50 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd2e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc13b860 con 0x7f2dcc150490 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc0c25a0 0x7f2dcc13bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc0c25a0 0x7f2dcc13bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58028/0 (socket says 172.21.15.114:58028) 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcb400640 1 -- 172.21.15.114:0/3701718253 learned_addr learned my addr 172.21.15.114:0/3701718253 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcbe00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dcc06db50 0x7f2dcc1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd0e00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2dcc150490 0x7f2dcc1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcb400640 1 -- 172.21.15.114:0/3701718253 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2dcc150490 msgr2=0x7f2dcc1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcb400640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2dcc150490 0x7f2dcc1509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcb400640 1 -- 172.21.15.114:0/3701718253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dcc06db50 msgr2=0x7f2dcc1511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcb400640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dcc06db50 0x7f2dcc1511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcb400640 1 -- 172.21.15.114:0/3701718253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db8009420 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcbe00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dcc06db50 0x7f2dcc1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dcb400640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc0c25a0 0x7f2dcc13bf70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2db8018f90 tx=0x7f2db8019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dc3e00640 1 -- 172.21.15.114:0/3701718253 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80b4410 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dc3e00640 1 -- 172.21.15.114:0/3701718253 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db80b4570 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3701718253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc13adf0 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dc3e00640 1 -- 172.21.15.114:0/3701718253 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80b4920 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3701718253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc13c4b0 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.260+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3701718253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc074840 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.264+0000 7f2dc3e00640 1 -- 172.21.15.114:0/3701718253 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2db80b2040 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.264+0000 7f2dc3e00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2dac066e40 0x7f2dac069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.264+0000 7f2dc3e00640 1 -- 172.21.15.114:0/3701718253 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2db811eb10 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.264+0000 7f2dcbe00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2dac066e40 0x7f2dac069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.264+0000 7f2dcbe00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2dac066e40 0x7f2dac069300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0011f0 tx=0x7f2dbc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:34.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.268+0000 7f2dc3e00640 1 -- 172.21.15.114:0/3701718253 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2db80eb8f0 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.452+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3701718253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2dcc153140 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.452+0000 7f2dc3e00640 1 -- 172.21.15.114:0/3701718253 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f2db80b0090 con 0x7f2dcc0c25a0 2024-02-17T12:16:34.458 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:34.458 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4241624725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4241624725},{"type":"v1","addr":"172.21.15.114:6837","nonce":4241624725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/178899564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":178899564},{"type":"v1","addr":"172.21.15.114:6836","nonce":178899564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/3301698475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3301698475},{"type":"v1","addr":"172.21.15.116:6834","nonce":3301698475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:16:22.673862+0000","modified":"2024-02-17T12:16:25.681621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6835/4001468997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":4001468997},{"type":"v1","addr":"172.21.15.116:6835","nonce":4001468997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:16:34.458 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-02-17T12:16:34.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3701718253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2dac066e40 msgr2=0x7f2dac069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2dac066e40 0x7f2dac069300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0011f0 tx=0x7f2dbc009040 comp rx=0 tx=0).stop 2024-02-17T12:16:34.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3701718253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc0c25a0 msgr2=0x7f2dcc13bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc0c25a0 0x7f2dcc13bf70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2db8018f90 tx=0x7f2db8019120 comp rx=0 tx=0).stop 2024-02-17T12:16:34.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3701718253 shutdown_connections 2024-02-17T12:16:34.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2dcc150490 0x7f2dcc1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2dac066e40 0x7f2dac069300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dcc0c25a0 0x7f2dcc13bf70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 --2- 172.21.15.114:0/3701718253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2dcc06db50 0x7f2dcc1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3701718253 >> 172.21.15.114:0/3701718253 conn(0x7f2dcc0a8490 msgr2=0x7f2dcc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3701718253 shutdown_connections 2024-02-17T12:16:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.456+0000 7f2dd2e00640 1 -- 172.21.15.114:0/3701718253 wait complete. 2024-02-17T12:16:34.478 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.608+0000 7fa1b7c00640 1 Processor -- start 2024-02-17T12:16:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.608+0000 7fa1b7c00640 1 -- start start 2024-02-17T12:16:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.608+0000 7fa1b7c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa1b014f110 0x7fa1b00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.608+0000 7fa1b7c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1b00c1eb0 0x7fa1b015c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.608+0000 7fa1b7c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b00a9420 con 0x7fa1b00c2580 2024-02-17T12:16:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.608+0000 7fa1b7c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b014f4f0 con 0x7fa1b014f110 2024-02-17T12:16:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.608+0000 7fa1b7c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b00aae80 con 0x7fa1b00c1eb0 2024-02-17T12:16:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1b5200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa1b014f110 0x7fa1b00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1b5c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1b00c1eb0 0x7fa1b015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1b5200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa1b014f110 0x7fa1b00c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:46942/0 (socket says 172.21.15.114:46942) 2024-02-17T12:16:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1b5200640 1 -- 172.21.15.114:0/4155754374 learned_addr learned my addr 172.21.15.114:0/4155754374 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1b5200640 1 -- 172.21.15.114:0/4155754374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1b00c1eb0 msgr2=0x7fa1b015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1b5200640 1 --2- 172.21.15.114:0/4155754374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1b00c1eb0 0x7fa1b015c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1b5200640 1 -- 172.21.15.114:0/4155754374 >> v1:172.21.15.116:6789/0 conn(0x7fa1b00c2580 legacy=0x7fa1b00aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1b5200640 1 -- 172.21.15.114:0/4155754374 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0152850 con 0x7fa1b014f110 2024-02-17T12:16:34.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1b5200640 1 --2- 172.21.15.114:0/4155754374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b014f110 0x7fa1b00c65a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009e50 tx=0x7fa1a001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ee9243e9d2d4b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:34.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1af400640 1 -- 172.21.15.114:0/4155754374 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00a5830 con 0x7fa1b014f110 2024-02-17T12:16:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1af400640 1 -- 172.21.15.114:0/4155754374 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a00a5990 con 0x7fa1b014f110 2024-02-17T12:16:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.612+0000 7fa1af400640 1 -- 172.21.15.114:0/4155754374 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00a5d20 con 0x7fa1b014f110 2024-02-17T12:16:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 -- 172.21.15.114:0/4155754374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b014f110 msgr2=0x7fa1b00c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 --2- 172.21.15.114:0/4155754374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b014f110 0x7fa1b00c65a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009e50 tx=0x7fa1a001c970 comp rx=0 tx=0).stop 2024-02-17T12:16:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 -- 172.21.15.114:0/4155754374 shutdown_connections 2024-02-17T12:16:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 --2- 172.21.15.114:0/4155754374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1b00c1eb0 0x7fa1b015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 --2- 172.21.15.114:0/4155754374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b014f110 0x7fa1b00c65a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 -- 172.21.15.114:0/4155754374 >> 172.21.15.114:0/4155754374 conn(0x7fa1b00a8490 msgr2=0x7fa1b00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 -- 172.21.15.114:0/4155754374 shutdown_connections 2024-02-17T12:16:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 -- 172.21.15.114:0/4155754374 wait complete. 2024-02-17T12:16:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 Processor -- start 2024-02-17T12:16:34.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 -- start start 2024-02-17T12:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1b00c1eb0 0x7fa1b01f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b00c2580 0x7fa1b013d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1b014f110 0x7fa1b01edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b01506b0 con 0x7fa1b014f110 2024-02-17T12:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b01f17a0 con 0x7fa1b00c2580 2024-02-17T12:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b7c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b013dbf0 con 0x7fa1b00c1eb0 2024-02-17T12:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1b014f110 0x7fa1b01edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1b014f110 0x7fa1b01edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58038/0 (socket says 172.21.15.114:58038) 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b5c00640 1 -- 172.21.15.114:0/3570029969 learned_addr learned my addr 172.21.15.114:0/3570029969 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1afe00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b00c2580 0x7fa1b013d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b5200640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1b00c1eb0 0x7fa1b01f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b5c00640 1 -- 172.21.15.114:0/3570029969 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1b00c1eb0 msgr2=0x7fa1b01f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b5c00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1b00c1eb0 0x7fa1b01f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b5c00640 1 -- 172.21.15.114:0/3570029969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b00c2580 msgr2=0x7fa1b013d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b5c00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b00c2580 0x7fa1b013d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b5c00640 1 -- 172.21.15.114:0/3570029969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a0009b30 con 0x7fa1b014f110 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.616+0000 7fa1b5c00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1b014f110 0x7fa1b01edb40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800e7f0 tx=0x7fa1a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1acc00640 1 -- 172.21.15.114:0/3570029969 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80094d0 con 0x7fa1b014f110 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1acc00640 1 -- 172.21.15.114:0/3570029969 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a800eea0 con 0x7fa1b014f110 2024-02-17T12:16:34.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1b7c00640 1 -- 172.21.15.114:0/3570029969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b01511e0 con 0x7fa1b014f110 2024-02-17T12:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1acc00640 1 -- 172.21.15.114:0/3570029969 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800cb60 con 0x7fa1b014f110 2024-02-17T12:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1b7c00640 1 -- 172.21.15.114:0/3570029969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b01517a0 con 0x7fa1b014f110 2024-02-17T12:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1b7c00640 1 -- 172.21.15.114:0/3570029969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b01f1950 con 0x7fa1b014f110 2024-02-17T12:16:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1acc00640 1 -- 172.21.15.114:0/3570029969 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa1a800ccc0 con 0x7fa1b014f110 2024-02-17T12:16:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1acc00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e40 0x7fa18c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1acc00640 1 -- 172.21.15.114:0/3570029969 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1a8084ac0 con 0x7fa1b014f110 2024-02-17T12:16:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1b5200640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e40 0x7fa18c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.620+0000 7fa1b5200640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e40 0x7fa18c069300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00ae000 tx=0x7fa1a00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.624+0000 7fa1acc00640 1 -- 172.21.15.114:0/3570029969 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa1b01f1950 con 0x7fa1b014f110 2024-02-17T12:16:34.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.780+0000 7fa1b7c00640 1 -- 172.21.15.114:0/3570029969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1b01f1910 con 0x7fa1b014f110 2024-02-17T12:16:34.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.780+0000 7fa1acc00640 1 -- 172.21.15.114:0/3570029969 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fa1a8017090 con 0x7fa1b014f110 2024-02-17T12:16:34.784 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:34.785 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:34.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 -- 172.21.15.114:0/3570029969 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e40 msgr2=0x7fa18c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e40 0x7fa18c069300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00ae000 tx=0x7fa1a00a7070 comp rx=0 tx=0).stop 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 -- 172.21.15.114:0/3570029969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1b014f110 msgr2=0x7fa1b01edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1b014f110 0x7fa1b01edb40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800e7f0 tx=0x7fa1a800ecb0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 -- 172.21.15.114:0/3570029969 shutdown_connections 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e40 0x7fa18c069300 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1b014f110 0x7fa1b01edb40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1b00c2580 0x7fa1b013d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 --2- 172.21.15.114:0/3570029969 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1b00c1eb0 0x7fa1b01f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 -- 172.21.15.114:0/3570029969 >> 172.21.15.114:0/3570029969 conn(0x7fa1b00a8490 msgr2=0x7fa1b013f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 -- 172.21.15.114:0/3570029969 shutdown_connections 2024-02-17T12:16:34.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.784+0000 7fa1b7c00640 1 -- 172.21.15.114:0/3570029969 wait complete. 2024-02-17T12:16:34.805 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:16:34.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f23c00640 1 Processor -- start 2024-02-17T12:16:34.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f23c00640 1 -- start start 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f23c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f1c0c2ba0 0x7f6f1c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f23c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6f1c0c5900 0x7f6f1c152b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f23c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6f1c0c5e10 0x7f6f1c0c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f23c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1c157130 con 0x7f6f1c0c5e10 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f23c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1c156130 con 0x7f6f1c0c5900 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f23c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c06ee30 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f21c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6f1c0c5e10 0x7f6f1c0c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f21c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6f1c0c5e10 0x7f6f1c0c3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58052/0 (socket says 172.21.15.114:58052) 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f21c00640 1 -- 172.21.15.114:0/2828687900 learned_addr learned my addr 172.21.15.114:0/2828687900 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f1be00640 1 --2- 172.21.15.114:0/2828687900 >> v2:172.21.15.116:3300/0 conn(0x7f6f1c0c5900 0x7f6f1c152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f21200640 1 --2- 172.21.15.114:0/2828687900 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f1c0c2ba0 0x7f6f1c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f21c00640 1 -- 172.21.15.114:0/2828687900 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f1c0c2ba0 msgr2=0x7f6f1c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:34.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f21c00640 1 --2- 172.21.15.114:0/2828687900 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f1c0c2ba0 0x7f6f1c156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f21c00640 1 -- 172.21.15.114:0/2828687900 >> v2:172.21.15.116:3300/0 conn(0x7f6f1c0c5900 msgr2=0x7f6f1c152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:34.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f21c00640 1 --2- 172.21.15.114:0/2828687900 >> v2:172.21.15.116:3300/0 conn(0x7f6f1c0c5900 0x7f6f1c152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.936+0000 7f6f21c00640 1 -- 172.21.15.114:0/2828687900 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c06f110 con 0x7f6f1c0c5e10 2024-02-17T12:16:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f21c00640 1 --2- 172.21.15.114:0/2828687900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c5e10 0x7f6f1c0c3260 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c06bbd0 tx=0x7f6f1401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473148514c41aa09 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f1b400640 1 -- 172.21.15.114:0/2828687900 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f140a56d0 con 0x7f6f1c0c5e10 2024-02-17T12:16:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f1b400640 1 -- 172.21.15.114:0/2828687900 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f140a5830 con 0x7f6f1c0c5e10 2024-02-17T12:16:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f1b400640 1 -- 172.21.15.114:0/2828687900 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f140a5bc0 con 0x7f6f1c0c5e10 2024-02-17T12:16:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f23c00640 1 -- 172.21.15.114:0/2828687900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c5e10 msgr2=0x7f6f1c0c3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f23c00640 1 --2- 172.21.15.114:0/2828687900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c5e10 0x7f6f1c0c3260 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c06bbd0 tx=0x7f6f1401c960 comp rx=0 tx=0).stop 2024-02-17T12:16:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f23c00640 1 -- 172.21.15.114:0/2828687900 shutdown_connections 2024-02-17T12:16:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f23c00640 1 --2- 172.21.15.114:0/2828687900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c5e10 0x7f6f1c0c3260 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f23c00640 1 --2- 172.21.15.114:0/2828687900 >> v2:172.21.15.116:3300/0 conn(0x7f6f1c0c5900 0x7f6f1c152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f23c00640 1 --2- 172.21.15.114:0/2828687900 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f1c0c2ba0 0x7f6f1c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f23c00640 1 -- 172.21.15.114:0/2828687900 >> 172.21.15.114:0/2828687900 conn(0x7f6f1c06b210 msgr2=0x7f6f1c0c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f23c00640 1 -- 172.21.15.114:0/2828687900 shutdown_connections 2024-02-17T12:16:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.940+0000 7f6f23c00640 1 -- 172.21.15.114:0/2828687900 wait complete. 2024-02-17T12:16:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 Processor -- start 2024-02-17T12:16:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 -- start start 2024-02-17T12:16:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c2ba0 0x7f6f1c1ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f1c0c5900 0x7f6f1c0a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f1c0c5e10 0x7f6f1c1ec080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c1efbe0 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c0aacb0 con 0x7f6f1c0c5e10 2024-02-17T12:16:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c1ebbf0 con 0x7f6f1c0c5900 2024-02-17T12:16:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f21200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c2ba0 0x7f6f1c1ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f21200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c2ba0 0x7f6f1c1ef6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58054/0 (socket says 172.21.15.114:58054) 2024-02-17T12:16:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f21200640 1 -- 172.21.15.114:0/3773200469 learned_addr learned my addr 172.21.15.114:0/3773200469 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f21c00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f1c0c5e10 0x7f6f1c1ec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f1be00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f1c0c5900 0x7f6f1c0a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f21200640 1 -- 172.21.15.114:0/3773200469 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f1c0c5900 msgr2=0x7f6f1c0a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f21200640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f1c0c5900 0x7f6f1c0a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f21200640 1 -- 172.21.15.114:0/3773200469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f1c0c5e10 msgr2=0x7f6f1c1ec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f21200640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f1c0c5e10 0x7f6f1c1ec080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f21200640 1 -- 172.21.15.114:0/3773200469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f14009b30 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f21200640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c2ba0 0x7f6f1c1ef6a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00e8b0 tx=0x7f6f0c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f18c00640 1 -- 172.21.15.114:0/3773200469 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00c940 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f18c00640 1 -- 172.21.15.114:0/3773200469 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c00caa0 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f18c00640 1 -- 172.21.15.114:0/3773200469 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00ce30 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 -- 172.21.15.114:0/3773200469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1c0a92f0 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 -- 172.21.15.114:0/3773200469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1c0a8460 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.944+0000 7f6f23c00640 1 -- 172.21.15.114:0/3773200469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1c074840 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.948+0000 7f6f18c00640 1 -- 172.21.15.114:0/3773200469 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6f0c013470 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.948+0000 7f6f18c00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6efc066e40 0x7f6efc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.948+0000 7f6f18c00640 1 -- 172.21.15.114:0/3773200469 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f0c084b30 con 0x7f6f1c0c2ba0 2024-02-17T12:16:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.948+0000 7f6f1be00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6efc066e40 0x7f6efc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.948+0000 7f6f1be00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6efc066e40 0x7f6efc069300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c1e9560 tx=0x7f6f08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:34.952+0000 7f6f18c00640 1 -- 172.21.15.114:0/3773200469 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f0c051a00 con 0x7f6f1c0c2ba0 2024-02-17T12:16:35.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 -- 172.21.15.114:0/3773200469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f1c156a40 con 0x7f6f1c0c2ba0 2024-02-17T12:16:35.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f18c00640 1 -- 172.21.15.114:0/3773200469 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f6f0c017090 con 0x7f6f1c0c2ba0 2024-02-17T12:16:35.139 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:35.140 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4241624725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4241624725},{"type":"v1","addr":"172.21.15.114:6837","nonce":4241624725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/178899564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":178899564},{"type":"v1","addr":"172.21.15.114:6836","nonce":178899564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/3301698475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3301698475},{"type":"v1","addr":"172.21.15.116:6834","nonce":3301698475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:16:22.673862+0000","modified":"2024-02-17T12:16:25.681621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6835/4001468997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":4001468997},{"type":"v1","addr":"172.21.15.116:6835","nonce":4001468997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:16:35.140 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-02-17T12:16:35.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 -- 172.21.15.114:0/3773200469 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6efc066e40 msgr2=0x7f6efc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6efc066e40 0x7f6efc069300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c1e9560 tx=0x7f6f08008040 comp rx=0 tx=0).stop 2024-02-17T12:16:35.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 -- 172.21.15.114:0/3773200469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c2ba0 msgr2=0x7f6f1c1ef6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c2ba0 0x7f6f1c1ef6a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00e8b0 tx=0x7f6f0c00ed70 comp rx=0 tx=0).stop 2024-02-17T12:16:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 -- 172.21.15.114:0/3773200469 shutdown_connections 2024-02-17T12:16:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f1c0c5e10 0x7f6f1c1ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f1c0c5900 0x7f6f1c0a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6efc066e40 0x7f6efc069300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 --2- 172.21.15.114:0/3773200469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f1c0c2ba0 0x7f6f1c1ef6a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 -- 172.21.15.114:0/3773200469 >> 172.21.15.114:0/3773200469 conn(0x7f6f1c06b210 msgr2=0x7f6f1c14dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 -- 172.21.15.114:0/3773200469 shutdown_connections 2024-02-17T12:16:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.136+0000 7f6f23c00640 1 -- 172.21.15.114:0/3773200469 wait complete. 2024-02-17T12:16:35.564 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T12:16:22.673862+0000', 'modified': '2024-02-17T12:16:25.681621+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.116:6835/4001468997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6833', 'nonce': 4001468997}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 4001468997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-17T12:16:35.564 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-17T12:16:35.564 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-02-17T12:16:35.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.695+0000 7f02eb400640 1 Processor -- start 2024-02-17T12:16:35.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.695+0000 7f02eb400640 1 -- start start 2024-02-17T12:16:35.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.695+0000 7f02eb400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c4b30 0x7f02e41583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.695+0000 7f02eb400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f02e40a6360 0x7f02e4155520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.695+0000 7f02eb400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e4155090 con 0x7f02e40c58b0 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.695+0000 7f02eb400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e40c6110 con 0x7f02e40a6360 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.695+0000 7f02eb400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e4159300 con 0x7f02e40c4b30 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e8a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f02e40c58b0 0x7f02e406bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44076/0 (socket says 172.21.15.114:44076) 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e8a00640 1 -- 172.21.15.114:0/917894103 learned_addr learned my addr 172.21.15.114:0/917894103 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e9400640 1 --2- 172.21.15.114:0/917894103 >> v2:172.21.15.116:3300/0 conn(0x7f02e40a6360 0x7f02e4155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02dbe00640 1 --2- 172.21.15.114:0/917894103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c4b30 0x7f02e41583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e3e00640 1 -- 172.21.15.114:0/917894103 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631698750 0 0) 0x7f02e4155090 con 0x7f02e40c58b0 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e3e00640 1 -- 172.21.15.114:0/917894103 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c8003530 con 0x7f02e40c58b0 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e9400640 1 -- 172.21.15.114:0/917894103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c4b30 msgr2=0x7f02e41583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:35.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e9400640 1 --2- 172.21.15.114:0/917894103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c4b30 0x7f02e41583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e3e00640 1 -- 172.21.15.114:0/917894103 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1334932744 0 0) 0x7f02c8003530 con 0x7f02e40c58b0 2024-02-17T12:16:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e9400640 1 -- 172.21.15.114:0/917894103 >> v1:172.21.15.114:6789/0 conn(0x7f02e40c58b0 legacy=0x7f02e406bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e9400640 1 -- 172.21.15.114:0/917894103 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e4158a60 con 0x7f02e40a6360 2024-02-17T12:16:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e9400640 1 --2- 172.21.15.114:0/917894103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e40a6360 0x7f02e4155520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009d90 tx=0x7f02dc01c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52b762da4099be1b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.699+0000 7f02e3e00640 1 -- 172.21.15.114:0/917894103 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4001680 con 0x7f02e40a6360 2024-02-17T12:16:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02e3e00640 1 -- 172.21.15.114:0/917894103 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc0a5570 con 0x7f02e40a6360 2024-02-17T12:16:35.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02e3e00640 1 -- 172.21.15.114:0/917894103 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0a5900 con 0x7f02e40a6360 2024-02-17T12:16:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 -- 172.21.15.114:0/917894103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e40a6360 msgr2=0x7f02e4155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 --2- 172.21.15.114:0/917894103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e40a6360 0x7f02e4155520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009d90 tx=0x7f02dc01c860 comp rx=0 tx=0).stop 2024-02-17T12:16:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 -- 172.21.15.114:0/917894103 shutdown_connections 2024-02-17T12:16:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 --2- 172.21.15.114:0/917894103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e40a6360 0x7f02e4155520 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 --2- 172.21.15.114:0/917894103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c4b30 0x7f02e41583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 -- 172.21.15.114:0/917894103 >> 172.21.15.114:0/917894103 conn(0x7f02e40c3730 msgr2=0x7f02e40c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 -- 172.21.15.114:0/917894103 shutdown_connections 2024-02-17T12:16:35.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 -- 172.21.15.114:0/917894103 wait complete. 2024-02-17T12:16:35.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 Processor -- start 2024-02-17T12:16:35.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 -- start start 2024-02-17T12:16:35.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e40a6360 0x7f02e414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02e40c4b30 0x7f02e414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c58b0 0x7f02e4156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e4158350 con 0x7f02e40c4b30 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e40c0dd0 con 0x7f02e40a6360 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02eb400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e41ed1f0 con 0x7f02e40c58b0 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02e40c4b30 0x7f02e414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02e40c4b30 0x7f02e414f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43262/0 (socket says 172.21.15.114:43262) 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02dbe00640 1 -- 172.21.15.114:0/1846323778 learned_addr learned my addr 172.21.15.114:0/1846323778 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02e8a00640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e40a6360 0x7f02e414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02e9400640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c58b0 0x7f02e4156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02dbe00640 1 -- 172.21.15.114:0/1846323778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c58b0 msgr2=0x7f02e4156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02dbe00640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c58b0 0x7f02e4156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02dbe00640 1 -- 172.21.15.114:0/1846323778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e40a6360 msgr2=0x7f02e414ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02dbe00640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e40a6360 0x7f02e414ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02dbe00640 1 -- 172.21.15.114:0/1846323778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc009a70 con 0x7f02e40c4b30 2024-02-17T12:16:35.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02e9400640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c58b0 0x7f02e4156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:35.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.703+0000 7f02dbe00640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02e40c4b30 0x7f02e414f350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00e900 tx=0x7f02cc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:35.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02e1600640 1 -- 172.21.15.114:0/1846323778 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc009690 con 0x7f02e40c4b30 2024-02-17T12:16:35.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02e1600640 1 -- 172.21.15.114:0/1846323778 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc00ca00 con 0x7f02e40c4b30 2024-02-17T12:16:35.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02eb400640 1 -- 172.21.15.114:0/1846323778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e414e050 con 0x7f02e40c4b30 2024-02-17T12:16:35.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02e1600640 1 -- 172.21.15.114:0/1846323778 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00cdb0 con 0x7f02e40c4b30 2024-02-17T12:16:35.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02eb400640 1 -- 172.21.15.114:0/1846323778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e414e610 con 0x7f02e40c4b30 2024-02-17T12:16:35.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02e1600640 1 -- 172.21.15.114:0/1846323778 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f02cc013470 con 0x7f02e40c4b30 2024-02-17T12:16:35.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02e1600640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02c0066e40 0x7f02c0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02e1600640 1 -- 172.21.15.114:0/1846323778 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02cc084bb0 con 0x7f02e40c4b30 2024-02-17T12:16:35.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02e8a00640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02c0066e40 0x7f02c0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02ee971000 1 Processor -- start 2024-02-17T12:16:35.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02ee971000 1 -- start start 2024-02-17T12:16:35.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.707+0000 7f02e8a00640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02c0066e40 0x7f02c0069300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f02d4006ae0 tx=0x7f02d4001d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:35.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x5575534086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553408bf0 0x557553408fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575532d2d00 con 0x557553409510 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557553264430 con 0x5575534082d0 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x557553261960 con 0x557553408bf0 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02e9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02e9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43270/0 (socket says 172.21.15.114:43270) 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02e9400640 1 -- 172.21.15.114:0/3401500894 learned_addr learned my addr 172.21.15.114:0/3401500894 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02e8a00640 1 --2- 172.21.15.114:0/3401500894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x5575534086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02dbe00640 1 --2- 172.21.15.114:0/3401500894 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553408bf0 0x557553408fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02e9400640 1 -- 172.21.15.114:0/3401500894 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553408bf0 msgr2=0x557553408fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02e9400640 1 --2- 172.21.15.114:0/3401500894 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553408bf0 0x557553408fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02e9400640 1 -- 172.21.15.114:0/3401500894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 msgr2=0x5575534086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02e9400640 1 --2- 172.21.15.114:0/3401500894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x5575534086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02e9400640 1 -- 172.21.15.114:0/3401500894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557552f53890 con 0x557553409510 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02e9400640 1 --2- 172.21.15.114:0/3401500894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534524b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f02dc01d100 tx=0x7f02dc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc8cde16969ed6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02d9600640 1 -- 172.21.15.114:0/3401500894 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0a5ae0 con 0x557553409510 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02d9600640 1 -- 172.21.15.114:0/3401500894 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc0a5c40 con 0x557553409510 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02d9600640 1 -- 172.21.15.114:0/3401500894 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0b8450 con 0x557553409510 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 -- 172.21.15.114:0/3401500894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 msgr2=0x5575534524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 --2- 172.21.15.114:0/3401500894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534524b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f02dc01d100 tx=0x7f02dc004ac0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 -- 172.21.15.114:0/3401500894 shutdown_connections 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 --2- 172.21.15.114:0/3401500894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534524b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 --2- 172.21.15.114:0/3401500894 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553408bf0 0x557553408fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 --2- 172.21.15.114:0/3401500894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x5575534086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 -- 172.21.15.114:0/3401500894 >> 172.21.15.114:0/3401500894 conn(0x557553446210 msgr2=0x557553448600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 -- 172.21.15.114:0/3401500894 shutdown_connections 2024-02-17T12:16:35.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 -- 172.21.15.114:0/3401500894 wait complete. 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 -- start start 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 Processor -- start 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.711+0000 7f02ee971000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x55755340e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755340e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553409510 0x55755340ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55755325d140 con 0x557553408bf0 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575531f7630 con 0x5575534082d0 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575531f72d0 con 0x557553409510 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 10 client.0 _ll_register_callbacks cb 0x55755330d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755340e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755340e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43278/0 (socket says 172.21.15.114:43278) 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02dbe00640 1 -- 172.21.15.114:0/3582703482 learned_addr learned my addr 172.21.15.114:0/3582703482 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:35.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02e8a00640 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x55755340e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02e9400640 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553409510 0x55755340ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02dbe00640 1 -- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553409510 msgr2=0x55755340ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02dbe00640 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553409510 0x55755340ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02dbe00640 1 -- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 msgr2=0x55755340e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02dbe00640 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x55755340e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02dbe00640 1 -- 172.21.15.114:0/3582703482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e4158a60 con 0x557553408bf0 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02dbe00640 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755340e830 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0554a0 tx=0x7f02cc0558d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddc4e6e9dd23bd7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02d2000640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02d2000640 1 -- 172.21.15.114:0/3582703482 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc054bf0 con 0x557553408bf0 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02d2000640 1 -- 172.21.15.114:0/3582703482 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02cc054d50 con 0x557553408bf0 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 1 -- 172.21.15.114:0/3582703482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557553210850 con 0x557553408bf0 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02d2000640 1 -- 172.21.15.114:0/3582703482 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02cc054f50 con 0x557553408bf0 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 10 client.4590 fetch_fsmap learned FSMap version 8 2024-02-17T12:16:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 1 -- 172.21.15.114:0/3582703482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55755321ce70 con 0x557553408bf0 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02d2000640 1 -- 172.21.15.114:0/3582703482 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc071080 con 0x557553408bf0 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02d2000640 1 -- 172.21.15.114:0/3582703482 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f02cc011070 con 0x557553408bf0 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 10 client.4590 fetch_fsmap finished waiting for FSMap version 8 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 10 client.4590 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 20 client.4590 populate_metadata read hostname 'smithi114' 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:6833/4001468997,v1:172.21.15.116:6835/4001468997] conn(0x55755345ace0 0x55755345d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 4 client.4590 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 1 -- 172.21.15.114:0/3582703482 --> [v2:172.21.15.116:6833/4001468997,v1:172.21.15.116:6835/4001468997] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557553259f20 con 0x55755345ace0 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02e8a00640 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:6833/4001468997,v1:172.21.15.116:6835/4001468997] conn(0x55755345ace0 0x55755345d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02d2000640 10 client.4590 ms_handle_connect on v2:172.21.15.116:6833/4001468997 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02e8a00640 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:6833/4001468997,v1:172.21.15.116:6835/4001468997] conn(0x55755345ace0 0x55755345d0d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f879e3e3b2dd5ceb server_cookie=6c0a3b18773455a6 in_seq=0 out_seq=0 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02d2000640 1 -- 172.21.15.114:0/3582703482 <== mds.0 v2:172.21.15.116:6833/4001468997 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557553259f20 con 0x55755345ace0 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02d2000640 10 client.4590 handle_command_reply: tid=0 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.715+0000 7f02ee971000 1 client.4590 shutdown 2024-02-17T12:16:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 1 -- 172.21.15.114:0/3582703482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 msgr2=0x55755340e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755340e830 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0554a0 tx=0x7f02cc0558d0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 1 -- 172.21.15.114:0/3582703482 shutdown_connections 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553409510 0x55755340ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755340e830 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:6833/4001468997,v1:172.21.15.116:6835/4001468997] conn(0x55755345ace0 0x55755345d0d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 1 --2- 172.21.15.114:0/3582703482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x55755340e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02d2000640 0 client.4590 ms_handle_reset on v2:172.21.15.116:6833/4001468997 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 1 -- 172.21.15.114:0/3582703482 >> 172.21.15.114:0/3582703482 conn(0x557553446210 msgr2=0x5575534079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 1 -- 172.21.15.114:0/3582703482 shutdown_connections 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 1 -- 172.21.15.114:0/3582703482 wait complete. 2024-02-17T12:16:35.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.719+0000 7f02ee971000 20 client.4590 trim_cache size 0 max 16384 2024-02-17T12:16:35.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.731+0000 7f02ee971000 1 Processor -- start 2024-02-17T12:16:35.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.731+0000 7f02ee971000 1 -- start start 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x55755345d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755345d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553409510 0x55755345db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557552f14940 con 0x557553408bf0 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575532572c0 con 0x5575534082d0 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x557553265c80 con 0x557553409510 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755345d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755345d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43294/0 (socket says 172.21.15.114:43294) 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02dbe00640 1 -- 172.21.15.114:0/3246560620 learned_addr learned my addr 172.21.15.114:0/3246560620 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02e9400640 1 --2- 172.21.15.114:0/3246560620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553409510 0x55755345db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02e8a00640 1 --2- 172.21.15.114:0/3246560620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x55755345d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02dbe00640 1 -- 172.21.15.114:0/3246560620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553409510 msgr2=0x55755345db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02dbe00640 1 --2- 172.21.15.114:0/3246560620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553409510 0x55755345db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02dbe00640 1 -- 172.21.15.114:0/3246560620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 msgr2=0x55755345d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02dbe00640 1 --2- 172.21.15.114:0/3246560620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x55755345d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02dbe00640 1 -- 172.21.15.114:0/3246560620 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557553448e90 con 0x557553408bf0 2024-02-17T12:16:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02e8a00640 1 --2- 172.21.15.114:0/3246560620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x55755345d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:35.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02dbe00640 1 --2- 172.21.15.114:0/3246560620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755345d610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f02cc052120 tx=0x7f02cc021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538678c974af6305 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02d8c00640 1 -- 172.21.15.114:0/3246560620 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc051540 con 0x557553408bf0 2024-02-17T12:16:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02d8c00640 1 -- 172.21.15.114:0/3246560620 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557553210850 con 0x557553408bf0 2024-02-17T12:16:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02d8c00640 1 -- 172.21.15.114:0/3246560620 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc055100 con 0x557553408bf0 2024-02-17T12:16:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- 172.21.15.114:0/3246560620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 msgr2=0x55755345d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 --2- 172.21.15.114:0/3246560620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755345d610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f02cc052120 tx=0x7f02cc021000 comp rx=0 tx=0).stop 2024-02-17T12:16:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- 172.21.15.114:0/3246560620 shutdown_connections 2024-02-17T12:16:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 --2- 172.21.15.114:0/3246560620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557553409510 0x55755345db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 --2- 172.21.15.114:0/3246560620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553408bf0 0x55755345d610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 --2- 172.21.15.114:0/3246560620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575534082d0 0x55755345d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- 172.21.15.114:0/3246560620 >> 172.21.15.114:0/3246560620 conn(0x557553446210 msgr2=0x55755340d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- 172.21.15.114:0/3246560620 shutdown_connections 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- 172.21.15.114:0/3246560620 wait complete. 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- start start 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 Processor -- start 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5575534082d0 0x5575534b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557553408bf0 0x5575534b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557553261140 con 0x557553409510 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55755325a540 con 0x557553408bf0 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x55755325b810 con 0x5575534082d0 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02ee971000 10 client.0 _ll_register_callbacks cb 0x557553206010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02e9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02e9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43306/0 (socket says 172.21.15.114:43306) 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02e9400640 1 -- 172.21.15.114:0/4271663433 learned_addr learned my addr 172.21.15.114:0/4271663433 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02dbe00640 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557553408bf0 0x5575534b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.735+0000 7f02e8a00640 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5575534082d0 0x5575534b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02e9400640 1 -- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5575534082d0 msgr2=0x5575534b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02e9400640 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5575534082d0 0x5575534b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02e9400640 1 -- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557553408bf0 msgr2=0x5575534b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02e9400640 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557553408bf0 0x5575534b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02e9400640 1 -- 172.21.15.114:0/4271663433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55755321ce70 con 0x557553409510 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02dbe00640 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557553408bf0 0x5575534b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02e9400640 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534b2120 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009d90 tx=0x7f02dc01b0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8954d3399a9dd388 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02d2000640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02d2000640 1 -- 172.21.15.114:0/4271663433 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0c8040 con 0x557553409510 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02d2000640 1 -- 172.21.15.114:0/4271663433 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02dc0a5ae0 con 0x557553409510 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 -- 172.21.15.114:0/4271663433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575531e2e80 con 0x557553409510 2024-02-17T12:16:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02d2000640 1 -- 172.21.15.114:0/4271663433 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02dc0a5ca0 con 0x557553409510 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 10 client.4596 fetch_fsmap learned FSMap version 8 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 -- 172.21.15.114:0/4271663433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x557553202e10 con 0x557553409510 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02d2000640 1 -- 172.21.15.114:0/4271663433 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5575531e2e80 con 0x557553409510 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02d2000640 1 -- 172.21.15.114:0/4271663433 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f02dc0cb070 con 0x557553409510 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 10 client.4596 fetch_fsmap finished waiting for FSMap version 8 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 10 client.4596 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 20 client.4596 populate_metadata read hostname 'smithi114' 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:6833/4001468997,v1:172.21.15.116:6835/4001468997] conn(0x5575534bbef0 0x5575534be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 4 client.4596 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 -- 172.21.15.114:0/4271663433 --> [v2:172.21.15.116:6833/4001468997,v1:172.21.15.116:6835/4001468997] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557553225fa0 con 0x5575534bbef0 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02e8a00640 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:6833/4001468997,v1:172.21.15.116:6835/4001468997] conn(0x5575534bbef0 0x5575534be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02e8a00640 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:6833/4001468997,v1:172.21.15.116:6835/4001468997] conn(0x5575534bbef0 0x5575534be2e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=588ee9a2badf538e server_cookie=e651f2b602e708ff in_seq=0 out_seq=0 2024-02-17T12:16:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02d2000640 10 client.4596 ms_handle_connect on v2:172.21.15.116:6833/4001468997 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02d2000640 1 -- 172.21.15.114:0/4271663433 <== mds.0 v2:172.21.15.116:6833/4001468997 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x557553225fa0 con 0x5575534bbef0 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02d2000640 10 client.4596 handle_command_reply: tid=0 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 client.4596 shutdown 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 -- 172.21.15.114:0/4271663433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 msgr2=0x5575534b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534b2120 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009d90 tx=0x7f02dc01b0a0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 -- 172.21.15.114:0/4271663433 shutdown_connections 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557553409510 0x5575534b2120 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:6833/4001468997,v1:172.21.15.116:6835/4001468997] conn(0x5575534bbef0 0x5575534be2e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557553408bf0 0x5575534b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 --2- 172.21.15.114:0/4271663433 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5575534082d0 0x5575534b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02d2000640 0 client.4596 ms_handle_reset on v2:172.21.15.116:6833/4001468997 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 -- 172.21.15.114:0/4271663433 >> 172.21.15.114:0/4271663433 conn(0x557553446210 msgr2=0x55755340cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 -- 172.21.15.114:0/4271663433 shutdown_connections 2024-02-17T12:16:35.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 1 -- 172.21.15.114:0/4271663433 wait complete. 2024-02-17T12:16:35.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02ee971000 20 client.4596 trim_cache size 0 max 16384 2024-02-17T12:16:35.750 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:16:35.750 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "718e3165-e11b-4138-adc9-584dcfeb6e24", 2024-02-17T12:16:35.750 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-02-17T12:16:35.750 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4294, 2024-02-17T12:16:35.750 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-02-17T12:16:35.750 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-02-17T12:16:35.750 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-02-17T12:16:35.751 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 12.42931104, 2024-02-17T12:16:35.751 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 8, 2024-02-17T12:16:35.751 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 21, 2024-02-17T12:16:35.751 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 21, 2024-02-17T12:16:35.751 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 19.123919544 2024-02-17T12:16:35.751 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:16:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 -- 172.21.15.114:0/1846323778 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02c0066e40 msgr2=0x7f02c0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02c0066e40 0x7f02c0069300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f02d4006ae0 tx=0x7f02d4001d30 comp rx=0 tx=0).stop 2024-02-17T12:16:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 -- 172.21.15.114:0/1846323778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02e40c4b30 msgr2=0x7f02e414f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02e40c4b30 0x7f02e414f350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00e900 tx=0x7f02cc00edc0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 -- 172.21.15.114:0/1846323778 shutdown_connections 2024-02-17T12:16:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f02e40c58b0 0x7f02e4156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02c0066e40 0x7f02c0069300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02e40c4b30 0x7f02e414f350 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 --2- 172.21.15.114:0/1846323778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02e40a6360 0x7f02e414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 -- 172.21.15.114:0/1846323778 >> 172.21.15.114:0/1846323778 conn(0x7f02e40c3730 msgr2=0x7f02e40c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 -- 172.21.15.114:0/1846323778 shutdown_connections 2024-02-17T12:16:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:35.739+0000 7f02eb400640 1 -- 172.21.15.114:0/1846323778 wait complete. 2024-02-17T12:16:35.763 INFO:teuthology.run_tasks:Running task kclient... 2024-02-17T12:16:35.789 INFO:tasks.kclient:Mounting kernel clients... 2024-02-17T12:16:35.789 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-02-17T12:16:35.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:35.789 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-02-17T12:16:35.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:35.799 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-02-17T12:16:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-02-17T12:16:35.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:16:35.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:35.865 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-17T12:16:35.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:35.875 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2024-02-17T12:16:35.940 INFO:teuthology.orchestra.run.smithi116.stderr:Cannot find device "ceph-brx" 2024-02-17T12:16:35.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:16:35.942 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-02-17T12:16:35.942 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T12:16:35.943 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:16:35.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:16:36.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.071+0000 7fa301200640 1 Processor -- start 2024-02-17T12:16:36.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.071+0000 7fa301200640 1 -- start start 2024-02-17T12:16:36.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.075+0000 7fa301200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa2fc0c2580 0x7fa2fc0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:36.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.075+0000 7fa301200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2fc0a9420 con 0x7fa2fc0c1eb0 2024-02-17T12:16:36.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.075+0000 7fa301200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2fc152850 con 0x7fa2fc14f110 2024-02-17T12:16:36.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.075+0000 7fa301200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2fc14f4f0 con 0x7fa2fc0c2580 2024-02-17T12:16:36.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.075+0000 7fa2f3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa2fc0c2580 0x7fa2fc0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:36.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.075+0000 7fa2fa800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa2fc0c1eb0 0x7fa2fc15c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44088/0 (socket says 172.21.15.114:44088) 2024-02-17T12:16:36.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.075+0000 7fa2fa800640 1 -- 172.21.15.114:0/4141732414 learned_addr learned my addr 172.21.15.114:0/4141732414 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:36.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.075+0000 7fa2f3e00640 1 -- 172.21.15.114:0/4141732414 >> v1:172.21.15.116:6789/0 conn(0x7fa2fc14f110 legacy=0x7fa2fc0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:36.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.075+0000 7fa2f3e00640 1 -- 172.21.15.114:0/4141732414 >> v1:172.21.15.114:6789/0 conn(0x7fa2fc0c1eb0 legacy=0x7fa2fc15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:36.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.075+0000 7fa2f3e00640 1 -- 172.21.15.114:0/4141732414 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc0a9670 con 0x7fa2fc0c2580 2024-02-17T12:16:36.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa2f3e00640 1 --2- 172.21.15.114:0/4141732414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 0x7fa2fc0aa150 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40097c0 tx=0x7fa2e401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727e5fb24381bec9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:36.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa2f9400640 1 -- 172.21.15.114:0/4141732414 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40ab600 con 0x7fa2fc0c2580 2024-02-17T12:16:36.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa2f9400640 1 -- 172.21.15.114:0/4141732414 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e40a7050 con 0x7fa2fc0c2580 2024-02-17T12:16:36.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa2f9400640 1 -- 172.21.15.114:0/4141732414 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40ab980 con 0x7fa2fc0c2580 2024-02-17T12:16:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 -- 172.21.15.114:0/4141732414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 msgr2=0x7fa2fc0aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 --2- 172.21.15.114:0/4141732414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 0x7fa2fc0aa150 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40097c0 tx=0x7fa2e401c410 comp rx=0 tx=0).stop 2024-02-17T12:16:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 -- 172.21.15.114:0/4141732414 shutdown_connections 2024-02-17T12:16:36.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 --2- 172.21.15.114:0/4141732414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 0x7fa2fc0aa150 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 -- 172.21.15.114:0/4141732414 >> 172.21.15.114:0/4141732414 conn(0x7fa2fc0a8490 msgr2=0x7fa2fc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 -- 172.21.15.114:0/4141732414 shutdown_connections 2024-02-17T12:16:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 -- 172.21.15.114:0/4141732414 wait complete. 2024-02-17T12:16:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 Processor -- start 2024-02-17T12:16:36.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 -- start start 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2fc0c1eb0 0x7fa2fc14add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 0x7fa2fc14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2fc14f110 0x7fa2fc147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc141500 con 0x7fa2fc0c2580 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc0c5be0 con 0x7fa2fc14f110 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa301200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc1eb9a0 con 0x7fa2fc0c1eb0 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa2f3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 0x7fa2fc14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa2f3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 0x7fa2fc14dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43324/0 (socket says 172.21.15.114:43324) 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.079+0000 7fa2f3e00640 1 -- 172.21.15.114:0/222611295 learned_addr learned my addr 172.21.15.114:0/222611295 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f3e00640 1 -- 172.21.15.114:0/222611295 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2fc0c1eb0 msgr2=0x7fa2fc14add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f3e00640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2fc0c1eb0 0x7fa2fc14add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:36.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f3e00640 1 -- 172.21.15.114:0/222611295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2fc14f110 msgr2=0x7fa2fc147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:36.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f3e00640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2fc14f110 0x7fa2fc147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:36.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f3e00640 1 -- 172.21.15.114:0/222611295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e4009420 con 0x7fa2fc0c2580 2024-02-17T12:16:36.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f3e00640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 0x7fa2fc14dbf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40ae040 tx=0x7fa2e40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:36.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f2000640 1 -- 172.21.15.114:0/222611295 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40b4900 con 0x7fa2fc0c2580 2024-02-17T12:16:36.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f2000640 1 -- 172.21.15.114:0/222611295 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e40b4a80 con 0x7fa2fc0c2580 2024-02-17T12:16:36.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa301200640 1 -- 172.21.15.114:0/222611295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2fc1421d0 con 0x7fa2fc0c2580 2024-02-17T12:16:36.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f2000640 1 -- 172.21.15.114:0/222611295 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40b4e30 con 0x7fa2fc0c2580 2024-02-17T12:16:36.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa301200640 1 -- 172.21.15.114:0/222611295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2fc1ec170 con 0x7fa2fc0c2580 2024-02-17T12:16:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa301200640 1 -- 172.21.15.114:0/222611295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2fc074840 con 0x7fa2fc0c2580 2024-02-17T12:16:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f2000640 1 -- 172.21.15.114:0/222611295 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa2e40b2040 con 0x7fa2fc0c2580 2024-02-17T12:16:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f2000640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa2d8066e40 0x7fa2d8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f2000640 1 -- 172.21.15.114:0/222611295 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2e411edb0 con 0x7fa2fc0c2580 2024-02-17T12:16:36.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.083+0000 7fa2f9e00640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa2d8066e40 0x7fa2d8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.087+0000 7fa2f9e00640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa2d8066e40 0x7fa2d8069300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec000f70 tx=0x7fa2ec0079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.087+0000 7fa2f2000640 1 -- 172.21.15.114:0/222611295 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa2e4123070 con 0x7fa2fc0c2580 2024-02-17T12:16:36.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 -- 172.21.15.114:0/222611295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa2fc15d890 con 0x7fa2fc0c2580 2024-02-17T12:16:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa2f2000640 1 -- 172.21.15.114:0/222611295 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa2e40b0070 con 0x7fa2fc0c2580 2024-02-17T12:16:36.280 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:16:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 -- 172.21.15.114:0/222611295 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa2d8066e40 msgr2=0x7fa2d8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa2d8066e40 0x7fa2d8069300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec000f70 tx=0x7fa2ec0079c0 comp rx=0 tx=0).stop 2024-02-17T12:16:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 -- 172.21.15.114:0/222611295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 msgr2=0x7fa2fc14dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 0x7fa2fc14dbf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40ae040 tx=0x7fa2e40191b0 comp rx=0 tx=0).stop 2024-02-17T12:16:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 -- 172.21.15.114:0/222611295 shutdown_connections 2024-02-17T12:16:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2fc14f110 0x7fa2fc147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa2d8066e40 0x7fa2d8069300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2fc0c2580 0x7fa2fc14dbf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 --2- 172.21.15.114:0/222611295 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2fc0c1eb0 0x7fa2fc14add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 -- 172.21.15.114:0/222611295 >> 172.21.15.114:0/222611295 conn(0x7fa2fc0a8490 msgr2=0x7fa2fc151b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 -- 172.21.15.114:0/222611295 shutdown_connections 2024-02-17T12:16:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:36.275+0000 7fa301200640 1 -- 172.21.15.114:0/222611295 wait complete. 2024-02-17T12:16:36.299 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-17T12:16:36.299 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:16:36.300 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-02-17T12:16:36.300 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-17T12:16:36.300 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:16:36.300 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-17T12:16:36.300 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T12:16:36.300 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:16:36.300 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:16:36.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:36.301 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-02-17T12:16:36.310 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:16:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:16:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:16:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:16:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-02-17T12:16:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:16:36.310 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:16:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:16:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42490sec preferred_lft 42490sec 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:16:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:a0:c1:dc:19 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:16:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:16:36.312 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:16:36.312 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-17T12:16:36.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:36.312 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:16:36.312 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:16:36.312 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-02-17T12:16:36.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-02-17T12:16:36.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-02-17T12:16:36.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-17T12:16:36.313 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:16:36.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:36.426 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:16:36.443 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-02-17T12:16:36.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:36.445 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-02-17T12:16:36.518 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-02-17T12:16:36.518 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:16:36.518 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:16:36.518 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:16:36.518 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:16:36.518 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:16:36.519 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:16:36.519 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:16:36.519 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:16:36.519 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:16:36.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:36.519 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:16:36.519 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:16:36.520 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:16:36.520 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:16:36.520 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:16:36.520 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:16:36.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:36.609 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-02-17T12:16:36.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:36.662 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-02-17T12:16:36.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:36.714 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:16:36.714 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:16:36.714 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:16:36.714 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-17T12:16:36.714 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:16:36.794 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-17T12:16:36.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:36.795 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:16:36.795 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:16:36.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-17T12:16:36.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-17T12:16:36.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-17T12:16:36.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-17T12:16:36.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-17T12:16:36.795 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:16:36.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:36.949 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:16:36.949 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:16:36.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-02-17T12:16:36.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-02-17T12:16:36.950 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:16:36.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:16:36.988 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T12:16:37.037 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:16:37.037 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:16:37.038 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:16:37.085 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:16:37.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:37.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:16:37.180 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:16:37.180 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:16:37.180 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:16:37.745 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:16:37.745 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:16:37.745 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:16:37.745 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:16:37.745 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:16:37.757 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:16:37.758 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:16:37.758 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:16:37.758 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:16:37.758 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:16:37.758 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:16:37.758 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:16:37.758 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:16:37.761 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:16:37.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:37.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:16:37.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:37.782 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:16:37.855 INFO:teuthology.orchestra.run.smithi114.stdout:client4608 2024-02-17T12:16:37.856 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:16:37.856 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:16:37.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:37.905 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:16:37.966 INFO:teuthology.orchestra.run.smithi114.stdout:client4608 2024-02-17T12:16:37.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:37.966 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:16:38.028 INFO:teuthology.orchestra.run.smithi114.stdout:client4608 2024-02-17T12:16:38.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:38.028 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/718e3165-e11b-4138-adc9-584dcfeb6e24.client4608/status') 2024-02-17T12:16:38.096 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4608 (3)192.168.0.1:0/2792455767 2024-02-17T12:16:38.096 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-02-17T12:16:38.096 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-02-17T12:16:38.096 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-02-17T12:16:38.096 INFO:teuthology.orchestra.run.smithi114.stderr:69 bytes copied, 4.9221e-05 s, 1.4 MB/s 2024-02-17T12:16:38.098 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-02-17T12:16:38.098 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-17T12:16:38.098 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T12:16:38.099 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:16:38.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59bc200640 1 Processor -- start 2024-02-17T12:16:38.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59bc200640 1 -- start start 2024-02-17T12:16:38.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59bc200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f59b40c2ba0 0x7f59b4156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:38.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59bc200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 0x7f59b4152b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:38.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59bc200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b4156130 con 0x7f59b40c5e10 2024-02-17T12:16:38.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59bc200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b4157130 con 0x7f59b40c2ba0 2024-02-17T12:16:38.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59bc200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b406ee30 con 0x7f59b40c5900 2024-02-17T12:16:38.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59b9800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f59b40c2ba0 0x7f59b4156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:38.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59b8e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 0x7f59b4152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:38.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59b9800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f59b40c2ba0 0x7f59b4156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:43986/0 (socket says 172.21.15.114:43986) 2024-02-17T12:16:38.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59b8e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 0x7f59b4152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:48590/0 (socket says 172.21.15.114:48590) 2024-02-17T12:16:38.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59b9800640 1 -- 172.21.15.114:0/1593753061 learned_addr learned my addr 172.21.15.114:0/1593753061 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:38.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59b9800640 1 -- 172.21.15.114:0/1593753061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 msgr2=0x7f59b4152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:38.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59b9800640 1 --2- 172.21.15.114:0/1593753061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 0x7f59b4152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:38.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59b9800640 1 -- 172.21.15.114:0/1593753061 >> v1:172.21.15.116:6789/0 conn(0x7f59b40c5e10 legacy=0x7f59b40c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:38.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59b9800640 1 -- 172.21.15.114:0/1593753061 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b406f110 con 0x7f59b40c2ba0 2024-02-17T12:16:38.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.271+0000 7f59b3e00640 1 -- 172.21.15.114:0/1593753061 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077212688 0 0) 0x7f59b4156130 con 0x7f59b40c5e10 2024-02-17T12:16:38.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59b9800640 1 --2- 172.21.15.114:0/1593753061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59b40c2ba0 0x7f59b4156bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009870 tx=0x7f59a801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a13a8cc190f66701 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:38.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59b3e00640 1 -- 172.21.15.114:0/1593753061 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80ac620 con 0x7f59b40c2ba0 2024-02-17T12:16:38.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59b3e00640 1 -- 172.21.15.114:0/1593753061 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a80ac780 con 0x7f59b40c2ba0 2024-02-17T12:16:38.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59b3e00640 1 -- 172.21.15.114:0/1593753061 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80acb10 con 0x7f59b40c2ba0 2024-02-17T12:16:38.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59bc200640 1 -- 172.21.15.114:0/1593753061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59b40c2ba0 msgr2=0x7f59b4156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:38.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59bc200640 1 --2- 172.21.15.114:0/1593753061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59b40c2ba0 0x7f59b4156bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009870 tx=0x7f59a801c4d0 comp rx=0 tx=0).stop 2024-02-17T12:16:38.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59bc200640 1 -- 172.21.15.114:0/1593753061 shutdown_connections 2024-02-17T12:16:38.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59bc200640 1 --2- 172.21.15.114:0/1593753061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 0x7f59b4152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:38.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59bc200640 1 --2- 172.21.15.114:0/1593753061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59b40c2ba0 0x7f59b4156bf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:38.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59bc200640 1 -- 172.21.15.114:0/1593753061 >> 172.21.15.114:0/1593753061 conn(0x7f59b406b210 msgr2=0x7f59b40c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:38.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59bc200640 1 -- 172.21.15.114:0/1593753061 shutdown_connections 2024-02-17T12:16:38.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.275+0000 7f59bc200640 1 -- 172.21.15.114:0/1593753061 wait complete. 2024-02-17T12:16:38.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59bc200640 1 Processor -- start 2024-02-17T12:16:38.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59bc200640 1 -- start start 2024-02-17T12:16:38.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59bc200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59b40c2ba0 0x7f59b4154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59bc200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 0x7f59b4148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59bc200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b40c5e10 0x7f59b4148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59bc200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40a9640 con 0x7f59b40c5e10 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59bc200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40ab790 con 0x7f59b40c2ba0 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59bc200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40a9820 con 0x7f59b40c5900 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59ba200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b40c5e10 0x7f59b4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59ba200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b40c5e10 0x7f59b4148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43334/0 (socket says 172.21.15.114:43334) 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59ba200640 1 -- 172.21.15.114:0/1288860040 learned_addr learned my addr 172.21.15.114:0/1288860040 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59b8e00640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 0x7f59b4148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59b9800640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59b40c2ba0 0x7f59b4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59ba200640 1 -- 172.21.15.114:0/1288860040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 msgr2=0x7f59b4148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:38.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59ba200640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 0x7f59b4148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:38.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59ba200640 1 -- 172.21.15.114:0/1288860040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59b40c2ba0 msgr2=0x7f59b4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:38.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59ba200640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59b40c2ba0 0x7f59b4154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:38.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59ba200640 1 -- 172.21.15.114:0/1288860040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80094d0 con 0x7f59b40c5e10 2024-02-17T12:16:38.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59b9800640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59b40c2ba0 0x7f59b4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:38.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59ba200640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b40c5e10 0x7f59b4148d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00c780 tx=0x7f59ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:38.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59b1600640 1 -- 172.21.15.114:0/1288860040 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac003db0 con 0x7f59b40c5e10 2024-02-17T12:16:38.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59b1600640 1 -- 172.21.15.114:0/1288860040 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac00ce90 con 0x7f59b40c5e10 2024-02-17T12:16:38.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59bc200640 1 -- 172.21.15.114:0/1288860040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b40a6590 con 0x7f59b40c5e10 2024-02-17T12:16:38.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59b1600640 1 -- 172.21.15.114:0/1288860040 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0052b0 con 0x7f59b40c5e10 2024-02-17T12:16:38.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.279+0000 7f59bc200640 1 -- 172.21.15.114:0/1288860040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b40aa500 con 0x7f59b40c5e10 2024-02-17T12:16:38.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.283+0000 7f59bc200640 1 -- 172.21.15.114:0/1288860040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b40aa720 con 0x7f59b40c5e10 2024-02-17T12:16:38.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.283+0000 7f59b1600640 1 -- 172.21.15.114:0/1288860040 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f59ac005410 con 0x7f59b40c5e10 2024-02-17T12:16:38.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.283+0000 7f59b1600640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5994066e40 0x7f5994069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:38.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.283+0000 7f59b1600640 1 -- 172.21.15.114:0/1288860040 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59ac084840 con 0x7f59b40c5e10 2024-02-17T12:16:38.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.283+0000 7f59b9800640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5994066e40 0x7f5994069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:38.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.283+0000 7f59b9800640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5994066e40 0x7f5994069300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f59a80ae000 tx=0x7f59a80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:38.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.287+0000 7f59b1600640 1 -- 172.21.15.114:0/1288860040 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f59ac051620 con 0x7f59b40c5e10 2024-02-17T12:16:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.479+0000 7f59bc200640 1 -- 172.21.15.114:0/1288860040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f59b4074840 con 0x7f59b40c5e10 2024-02-17T12:16:38.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.479+0000 7f59b1600640 1 -- 172.21.15.114:0/1288860040 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f59ac054ce0 con 0x7f59b40c5e10 2024-02-17T12:16:38.485 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:16:38.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 -- 172.21.15.114:0/1288860040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5994066e40 msgr2=0x7f5994069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:38.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5994066e40 0x7f5994069300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f59a80ae000 tx=0x7f59a80a7000 comp rx=0 tx=0).stop 2024-02-17T12:16:38.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 -- 172.21.15.114:0/1288860040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b40c5e10 msgr2=0x7f59b4148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:38.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b40c5e10 0x7f59b4148d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00c780 tx=0x7f59ac00cc40 comp rx=0 tx=0).stop 2024-02-17T12:16:38.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 -- 172.21.15.114:0/1288860040 shutdown_connections 2024-02-17T12:16:38.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5994066e40 0x7f5994069300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:38.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59b40c5e10 0x7f59b4148d60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:38.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59b40c5900 0x7f59b4148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:38.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 --2- 172.21.15.114:0/1288860040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59b40c2ba0 0x7f59b4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:38.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 -- 172.21.15.114:0/1288860040 >> 172.21.15.114:0/1288860040 conn(0x7f59b406b210 msgr2=0x7f59b414d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:38.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 -- 172.21.15.114:0/1288860040 shutdown_connections 2024-02-17T12:16:38.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:38.483+0000 7f59bc200640 1 -- 172.21.15.114:0/1288860040 wait complete. 2024-02-17T12:16:38.505 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-17T12:16:38.505 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:16:38.506 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-17T12:16:38.506 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-17T12:16:38.506 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T12:16:38.506 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-17T12:16:38.506 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-17T12:16:38.506 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:16:38.506 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:16:38.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:38.506 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-17T12:16:38.515 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:16:38.515 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:16:38.516 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:16:38.517 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:16:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:16:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:16:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42317sec preferred_lft 42317sec 2024-02-17T12:16:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-17T12:16:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:16:38.517 INFO:teuthology.orchestra.run.smithi116.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:16:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 02:42:58:59:74:79 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:16:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:16:38.517 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:16:38.518 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-17T12:16:38.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:38.518 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:16:38.518 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:16:38.518 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add name ceph-brx type bridge 2024-02-17T12:16:38.518 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr flush dev ceph-brx 2024-02-17T12:16:38.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set ceph-brx up 2024-02-17T12:16:38.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-17T12:16:38.519 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:16:38.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:38.632 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:16:38.650 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-17T12:16:38.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:38.652 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-17T12:16:38.731 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-17T12:16:38.731 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:16:38.732 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:16:38.732 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:16:38.732 INFO:teuthology.orchestra.run.smithi116.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:16:38.732 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:16:38.732 INFO:teuthology.orchestra.run.smithi116.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:16:38.732 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:16:38.732 INFO:teuthology.orchestra.run.smithi116.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:16:38.732 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:16:38.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:38.732 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:16:38.733 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:16:38.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:16:38.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:16:38.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:16:38.733 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:16:38.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:38.820 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-17T12:16:38.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:38.829 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list-id 2024-02-17T12:16:38.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:38.881 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:16:38.881 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:16:38.881 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T12:16:38.881 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-17T12:16:38.881 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:16:38.964 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-17T12:16:38.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:38.965 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:16:38.965 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:16:38.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-17T12:16:38.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-17T12:16:38.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-17T12:16:38.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-17T12:16:38.965 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-17T12:16:38.965 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:16:39.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:39.178 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:16:39.178 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:16:39.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-02-17T12:16:39.178 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set dev brx.0 master ceph-brx 2024-02-17T12:16:39.178 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:16:39.216 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:16:39.216 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-17T12:16:39.268 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:16:39.268 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:16:39.268 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:16:39.324 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:16:39.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:39.324 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:16:39.420 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:16:39.421 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:16:39.421 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:16:39.979 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:16:39.979 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:16:39.979 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:16:39.979 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:16:39.979 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:16:39.991 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:16:39.991 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:16:39.991 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:16:39.991 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:16:39.991 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:16:39.991 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:16:39.991 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:16:39.991 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:16:39.995 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:16:39.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:39.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:16:40.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:40.014 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:16:40.078 INFO:teuthology.orchestra.run.smithi116.stdout:client4484 2024-02-17T12:16:40.078 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:16:40.078 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:16:40.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:40.128 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:16:40.186 INFO:teuthology.orchestra.run.smithi116.stdout:client4484 2024-02-17T12:16:40.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:40.186 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:16:40.238 INFO:teuthology.orchestra.run.smithi116.stdout:client4484 2024-02-17T12:16:40.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:40.239 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/718e3165-e11b-4138-adc9-584dcfeb6e24.client4484/status') 2024-02-17T12:16:40.303 INFO:teuthology.orchestra.run.smithi116.stdout:instance: client.4484 (3)192.168.0.1:0/1545492967 2024-02-17T12:16:40.303 INFO:teuthology.orchestra.run.smithi116.stdout:blocklisted: false 2024-02-17T12:16:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:0+1 records in 2024-02-17T12:16:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:0+1 records out 2024-02-17T12:16:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:69 bytes copied, 4.8898e-05 s, 1.4 MB/s 2024-02-17T12:16:40.305 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-02-17T12:16:40.321 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:40.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa96c00640 1 Processor -- start 2024-02-17T12:16:40.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa96c00640 1 -- start start 2024-02-17T12:16:40.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa96c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa90152540 0x7ffa9006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa96c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa900c6460 0x7ffa90158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa96c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa90155dd0 con 0x7ffa90154e30 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa96c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa901588c0 con 0x7ffa900c6460 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa96c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa90155810 con 0x7ffa90152540 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa8f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa900c6460 0x7ffa90158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa94c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffa90154e30 0x7ffa900aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44098/0 (socket says 172.21.15.114:44098) 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa94c00640 1 -- 172.21.15.114:0/1476671002 learned_addr learned my addr 172.21.15.114:0/1476671002 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa8fe00640 1 --2- 172.21.15.114:0/1476671002 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa90152540 0x7ffa9006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa8f400640 1 -- 172.21.15.114:0/1476671002 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa90152540 msgr2=0x7ffa9006ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa8f400640 1 --2- 172.21.15.114:0/1476671002 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa90152540 0x7ffa9006ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa8f400640 1 -- 172.21.15.114:0/1476671002 >> v1:172.21.15.114:6789/0 conn(0x7ffa90154e30 legacy=0x7ffa900aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa8f400640 1 -- 172.21.15.114:0/1476671002 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90155af0 con 0x7ffa900c6460 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa8ea00640 1 -- 172.21.15.114:0/1476671002 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382296115 0 0) 0x7ffa90155dd0 con 0x7ffa90154e30 2024-02-17T12:16:40.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.459+0000 7ffa8fe00640 1 --2- 172.21.15.114:0/1476671002 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa90152540 0x7ffa9006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:40.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa8f400640 1 --2- 172.21.15.114:0/1476671002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa900c6460 0x7ffa90158d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0097c0 tx=0x7ffa7c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6420013b557884 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:40.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa8ea00640 1 -- 172.21.15.114:0/1476671002 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0ab600 con 0x7ffa900c6460 2024-02-17T12:16:40.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa8ea00640 1 -- 172.21.15.114:0/1476671002 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c0a7050 con 0x7ffa900c6460 2024-02-17T12:16:40.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa8ea00640 1 -- 172.21.15.114:0/1476671002 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0ab980 con 0x7ffa900c6460 2024-02-17T12:16:40.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa96c00640 1 -- 172.21.15.114:0/1476671002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa900c6460 msgr2=0x7ffa90158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa96c00640 1 --2- 172.21.15.114:0/1476671002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa900c6460 0x7ffa90158d50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0097c0 tx=0x7ffa7c01c380 comp rx=0 tx=0).stop 2024-02-17T12:16:40.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa96c00640 1 -- 172.21.15.114:0/1476671002 shutdown_connections 2024-02-17T12:16:40.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa96c00640 1 --2- 172.21.15.114:0/1476671002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa900c6460 0x7ffa90158d50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa96c00640 1 --2- 172.21.15.114:0/1476671002 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa90152540 0x7ffa9006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa96c00640 1 -- 172.21.15.114:0/1476671002 >> 172.21.15.114:0/1476671002 conn(0x7ffa900c4f20 msgr2=0x7ffa900c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:40.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa96c00640 1 -- 172.21.15.114:0/1476671002 shutdown_connections 2024-02-17T12:16:40.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.463+0000 7ffa96c00640 1 -- 172.21.15.114:0/1476671002 wait complete. 2024-02-17T12:16:40.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 Processor -- start 2024-02-17T12:16:40.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 -- start start 2024-02-17T12:16:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa900c6460 0x7ffa9006d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa90152540 0x7ffa901f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa90154e30 0x7ffa90146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa901f0c10 con 0x7ffa90154e30 2024-02-17T12:16:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa901f11d0 con 0x7ffa90152540 2024-02-17T12:16:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9006d640 con 0x7ffa900c6460 2024-02-17T12:16:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa94c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa90154e30 0x7ffa90146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa8fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa900c6460 0x7ffa9006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa94c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa90154e30 0x7ffa90146060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43366/0 (socket says 172.21.15.114:43366) 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa94c00640 1 -- 172.21.15.114:0/1425495458 learned_addr learned my addr 172.21.15.114:0/1425495458 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa8f400640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa90152540 0x7ffa901f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa94c00640 1 -- 172.21.15.114:0/1425495458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa900c6460 msgr2=0x7ffa9006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa94c00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa900c6460 0x7ffa9006d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa94c00640 1 -- 172.21.15.114:0/1425495458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa90152540 msgr2=0x7ffa901f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa94c00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa90152540 0x7ffa901f1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa94c00640 1 -- 172.21.15.114:0/1425495458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c009420 con 0x7ffa90154e30 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa94c00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa90154e30 0x7ffa90146060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c410 tx=0x7ffa8800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa87e00640 1 -- 172.21.15.114:0/1425495458 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880074e0 con 0x7ffa90154e30 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa87e00640 1 -- 172.21.15.114:0/1425495458 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa88007640 con 0x7ffa90154e30 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa87e00640 1 -- 172.21.15.114:0/1425495458 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88004a30 con 0x7ffa90154e30 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 -- 172.21.15.114:0/1425495458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9006d920 con 0x7ffa90154e30 2024-02-17T12:16:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 -- 172.21.15.114:0/1425495458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa901465a0 con 0x7ffa90154e30 2024-02-17T12:16:40.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.467+0000 7ffa96c00640 1 -- 172.21.15.114:0/1425495458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa901f1360 con 0x7ffa90154e30 2024-02-17T12:16:40.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.471+0000 7ffa87e00640 1 -- 172.21.15.114:0/1425495458 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ffa88004b90 con 0x7ffa90154e30 2024-02-17T12:16:40.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.471+0000 7ffa87e00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa70066e40 0x7ffa70069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.471+0000 7ffa87e00640 1 -- 172.21.15.114:0/1425495458 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa88084640 con 0x7ffa90154e30 2024-02-17T12:16:40.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.471+0000 7ffa8fe00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa70066e40 0x7ffa70069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.471+0000 7ffa8fe00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa70066e40 0x7ffa70069300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000d620 tx=0x7ffa80007810 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:40.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.475+0000 7ffa87e00640 1 -- 172.21.15.114:0/1425495458 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa88055000 con 0x7ffa90154e30 2024-02-17T12:16:40.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 -- 172.21.15.114:0/1425495458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa90074840 con 0x7ffa90154e30 2024-02-17T12:16:40.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa87e00640 1 -- 172.21.15.114:0/1425495458 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7ffa88001090 con 0x7ffa90154e30 2024-02-17T12:16:40.635 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:40.636 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:40.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 -- 172.21.15.114:0/1425495458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa70066e40 msgr2=0x7ffa70069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa70066e40 0x7ffa70069300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000d620 tx=0x7ffa80007810 comp rx=0 tx=0).stop 2024-02-17T12:16:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 -- 172.21.15.114:0/1425495458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa90154e30 msgr2=0x7ffa90146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa90154e30 0x7ffa90146060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c410 tx=0x7ffa8800c8d0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 -- 172.21.15.114:0/1425495458 shutdown_connections 2024-02-17T12:16:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa70066e40 0x7ffa70069300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa90154e30 0x7ffa90146060 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa90152540 0x7ffa901f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 --2- 172.21.15.114:0/1425495458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa900c6460 0x7ffa9006d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 -- 172.21.15.114:0/1425495458 >> 172.21.15.114:0/1425495458 conn(0x7ffa900c4f20 msgr2=0x7ffa9014a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 -- 172.21.15.114:0/1425495458 shutdown_connections 2024-02-17T12:16:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.631+0000 7ffa96c00640 1 -- 172.21.15.114:0/1425495458 wait complete. 2024-02-17T12:16:40.656 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:16:21.236908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:16:21.659009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:40.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:40.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f5231c00640 1 Processor -- start 2024-02-17T12:16:40.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f5231c00640 1 -- start start 2024-02-17T12:16:40.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f5231c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f522c14cb50 0x7f522c06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f5231c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c1538c0 con 0x7f522c06b150 2024-02-17T12:16:40.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f5231c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c0c0f20 con 0x7f522c06b740 2024-02-17T12:16:40.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f5231c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c0aa340 con 0x7f522c14cb50 2024-02-17T12:16:40.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f522be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f522c14cb50 0x7f522c06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f5223e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f522c06b150 0x7f522c06dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44114/0 (socket says 172.21.15.114:44114) 2024-02-17T12:16:40.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f5223e00640 1 -- 172.21.15.114:0/1939544813 learned_addr learned my addr 172.21.15.114:0/1939544813 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:40.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f522be00640 1 -- 172.21.15.114:0/1939544813 >> v1:172.21.15.116:6789/0 conn(0x7f522c06b740 legacy=0x7f522c06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f522be00640 1 -- 172.21.15.114:0/1939544813 >> v1:172.21.15.114:6789/0 conn(0x7f522c06b150 legacy=0x7f522c06dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f522be00640 1 -- 172.21.15.114:0/1939544813 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c152cb0 con 0x7f522c14cb50 2024-02-17T12:16:40.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.791+0000 7f522b400640 1 -- 172.21.15.114:0/1939544813 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676493389 0 0) 0x7f522c1538c0 con 0x7f522c06b150 2024-02-17T12:16:40.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f522be00640 1 --2- 172.21.15.114:0/1939544813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c14cb50 0x7f522c06ac10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f521c0097c0 tx=0x7f521c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb24abac5c9a9ff server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:40.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f522b400640 1 -- 172.21.15.114:0/1939544813 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c0ac640 con 0x7f522c14cb50 2024-02-17T12:16:40.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f522b400640 1 -- 172.21.15.114:0/1939544813 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c0ac7a0 con 0x7f522c14cb50 2024-02-17T12:16:40.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f522b400640 1 -- 172.21.15.114:0/1939544813 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c0acb30 con 0x7f522c14cb50 2024-02-17T12:16:40.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f5231c00640 1 -- 172.21.15.114:0/1939544813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c14cb50 msgr2=0x7f522c06ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f5231c00640 1 --2- 172.21.15.114:0/1939544813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c14cb50 0x7f522c06ac10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f521c0097c0 tx=0x7f521c01c3e0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f5231c00640 1 -- 172.21.15.114:0/1939544813 shutdown_connections 2024-02-17T12:16:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f5231c00640 1 --2- 172.21.15.114:0/1939544813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c14cb50 0x7f522c06ac10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f5231c00640 1 -- 172.21.15.114:0/1939544813 >> 172.21.15.114:0/1939544813 conn(0x7f522c0c6300 msgr2=0x7f522c0c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f5231c00640 1 -- 172.21.15.114:0/1939544813 shutdown_connections 2024-02-17T12:16:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f5231c00640 1 -- 172.21.15.114:0/1939544813 wait complete. 2024-02-17T12:16:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f5231c00640 1 Processor -- start 2024-02-17T12:16:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.795+0000 7f5231c00640 1 -- start start 2024-02-17T12:16:40.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5231c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c06b150 0x7f522c154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5231c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f522c06b740 0x7f522c0c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5231c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f522c14cb50 0x7f522c142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5231c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c154cd0 con 0x7f522c06b150 2024-02-17T12:16:40.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5231c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1ef2e0 con 0x7f522c06b740 2024-02-17T12:16:40.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5231c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1ee6d0 con 0x7f522c14cb50 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f522be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c06b150 0x7f522c154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f522be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c06b150 0x7f522c154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43394/0 (socket says 172.21.15.114:43394) 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f522be00640 1 -- 172.21.15.114:0/3779777305 learned_addr learned my addr 172.21.15.114:0/3779777305 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5223e00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f522c06b740 0x7f522c0c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5231200640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f522c14cb50 0x7f522c142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f522be00640 1 -- 172.21.15.114:0/3779777305 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f522c14cb50 msgr2=0x7f522c142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f522be00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f522c14cb50 0x7f522c142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f522be00640 1 -- 172.21.15.114:0/3779777305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f522c06b740 msgr2=0x7f522c0c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f522be00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f522c06b740 0x7f522c0c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f522be00640 1 -- 172.21.15.114:0/3779777305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c009420 con 0x7f522c06b150 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f522be00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c06b150 0x7f522c154590 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f521c018ff0 tx=0x7f521c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5228c00640 1 -- 172.21.15.114:0/3779777305 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c0ac640 con 0x7f522c06b150 2024-02-17T12:16:40.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5228c00640 1 -- 172.21.15.114:0/3779777305 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c0b8880 con 0x7f522c06b150 2024-02-17T12:16:40.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5228c00640 1 -- 172.21.15.114:0/3779777305 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c0b8c30 con 0x7f522c06b150 2024-02-17T12:16:40.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5231c00640 1 -- 172.21.15.114:0/3779777305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c1ee9b0 con 0x7f522c06b150 2024-02-17T12:16:40.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5231c00640 1 -- 172.21.15.114:0/3779777305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c1eef70 con 0x7f522c06b150 2024-02-17T12:16:40.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5231c00640 1 -- 172.21.15.114:0/3779777305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c04eef0 con 0x7f522c06b150 2024-02-17T12:16:40.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.799+0000 7f5228c00640 1 -- 172.21.15.114:0/3779777305 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f521c0c3460 con 0x7f522c06b150 2024-02-17T12:16:40.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.803+0000 7f5228c00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5208066e40 0x7f5208069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:40.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.803+0000 7f5228c00640 1 -- 172.21.15.114:0/3779777305 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f521c11f8f0 con 0x7f522c06b150 2024-02-17T12:16:40.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.803+0000 7f5223e00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5208066e40 0x7f5208069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.803+0000 7f5223e00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5208066e40 0x7f5208069300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f522c0c2a00 tx=0x7f5214007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.807+0000 7f5228c00640 1 -- 172.21.15.114:0/3779777305 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f521c0ec760 con 0x7f522c06b150 2024-02-17T12:16:40.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.963+0000 7f5231c00640 1 -- 172.21.15.114:0/3779777305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f522c0c0d00 con 0x7f522c06b150 2024-02-17T12:16:40.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5228c00640 1 -- 172.21.15.114:0/3779777305 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f521c0b1020 con 0x7f522c06b150 2024-02-17T12:16:40.970 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:40.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 -- 172.21.15.114:0/3779777305 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5208066e40 msgr2=0x7f5208069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5208066e40 0x7f5208069300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f522c0c2a00 tx=0x7f5214007240 comp rx=0 tx=0).stop 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 -- 172.21.15.114:0/3779777305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c06b150 msgr2=0x7f522c154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c06b150 0x7f522c154590 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f521c018ff0 tx=0x7f521c01ac20 comp rx=0 tx=0).stop 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 -- 172.21.15.114:0/3779777305 shutdown_connections 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f522c14cb50 0x7f522c142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f522c06b740 0x7f522c0c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5208066e40 0x7f5208069300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 --2- 172.21.15.114:0/3779777305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f522c06b150 0x7f522c154590 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 -- 172.21.15.114:0/3779777305 >> 172.21.15.114:0/3779777305 conn(0x7f522c0c6300 msgr2=0x7f522c152210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 -- 172.21.15.114:0/3779777305 shutdown_connections 2024-02-17T12:16:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:40.967+0000 7f5231c00640 1 -- 172.21.15.114:0/3779777305 wait complete. 2024-02-17T12:16:40.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:16:41.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f182ee00640 1 Processor -- start 2024-02-17T12:16:41.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f182ee00640 1 -- start start 2024-02-17T12:16:41.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f182ee00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1828072b20 0x7f18280c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f182ee00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18281586f0 0x7f1828158b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f182ee00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18280723b0 con 0x7f1828152560 2024-02-17T12:16:41.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f182ee00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1828070000 con 0x7f1828072b20 2024-02-17T12:16:41.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f182ee00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1828154dc0 con 0x7f18281586f0 2024-02-17T12:16:41.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f1827400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1828072b20 0x7f18280c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f1827400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1828072b20 0x7f18280c17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43408/0 (socket says 172.21.15.114:43408) 2024-02-17T12:16:41.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f1827400640 1 -- 172.21.15.114:0/3225223547 learned_addr learned my addr 172.21.15.114:0/3225223547 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:41.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f182ce00640 1 --2- 172.21.15.114:0/3225223547 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18281586f0 0x7f1828158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f1827400640 1 -- 172.21.15.114:0/3225223547 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18281586f0 msgr2=0x7f1828158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:41.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.123+0000 7f1827400640 1 --2- 172.21.15.114:0/3225223547 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18281586f0 0x7f1828158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f1827400640 1 -- 172.21.15.114:0/3225223547 >> v1:172.21.15.116:6789/0 conn(0x7f1828152560 legacy=0x7f18280c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f1827400640 1 -- 172.21.15.114:0/3225223547 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280728e0 con 0x7f1828072b20 2024-02-17T12:16:41.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f1827400640 1 --2- 172.21.15.114:0/3225223547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1828072b20 0x7f18280c17c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1814009870 tx=0x7f181401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b6f9461c76a00d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:41.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f1826a00640 1 -- 172.21.15.114:0/3225223547 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140ac620 con 0x7f1828072b20 2024-02-17T12:16:41.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f1826a00640 1 -- 172.21.15.114:0/3225223547 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18140ac780 con 0x7f1828072b20 2024-02-17T12:16:41.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f1826a00640 1 -- 172.21.15.114:0/3225223547 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140acb10 con 0x7f1828072b20 2024-02-17T12:16:41.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f182ee00640 1 -- 172.21.15.114:0/3225223547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1828072b20 msgr2=0x7f18280c17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f182ee00640 1 --2- 172.21.15.114:0/3225223547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1828072b20 0x7f18280c17c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1814009870 tx=0x7f181401c4d0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f182ee00640 1 -- 172.21.15.114:0/3225223547 shutdown_connections 2024-02-17T12:16:41.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f182ee00640 1 --2- 172.21.15.114:0/3225223547 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18281586f0 0x7f1828158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f182ee00640 1 --2- 172.21.15.114:0/3225223547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1828072b20 0x7f18280c17c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f182ee00640 1 -- 172.21.15.114:0/3225223547 >> 172.21.15.114:0/3225223547 conn(0x7f182806bef0 msgr2=0x7f182806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:41.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f182ee00640 1 -- 172.21.15.114:0/3225223547 shutdown_connections 2024-02-17T12:16:41.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.127+0000 7f182ee00640 1 -- 172.21.15.114:0/3225223547 wait complete. 2024-02-17T12:16:41.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ee00640 1 Processor -- start 2024-02-17T12:16:41.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ee00640 1 -- start start 2024-02-17T12:16:41.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ee00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1828072b20 0x7f1828152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ee00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1828152560 0x7f18280aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18281586f0 0x7f18280ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182814ade0 con 0x7f18281586f0 2024-02-17T12:16:41.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ee00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182814b600 con 0x7f1828152560 2024-02-17T12:16:41.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ee00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182814b8e0 con 0x7f1828072b20 2024-02-17T12:16:41.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18281586f0 0x7f18280ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18281586f0 0x7f18280ab400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43410/0 (socket says 172.21.15.114:43410) 2024-02-17T12:16:41.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ce00640 1 -- 172.21.15.114:0/3872918861 learned_addr learned my addr 172.21.15.114:0/3872918861 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f1827400640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1828152560 0x7f18280aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f1827e00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1828072b20 0x7f1828152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ce00640 1 -- 172.21.15.114:0/3872918861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1828072b20 msgr2=0x7f1828152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ce00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1828072b20 0x7f1828152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ce00640 1 -- 172.21.15.114:0/3872918861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1828152560 msgr2=0x7f18280aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ce00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1828152560 0x7f18280aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ce00640 1 -- 172.21.15.114:0/3872918861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18140094d0 con 0x7f18281586f0 2024-02-17T12:16:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ce00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18281586f0 0x7f18280ab400 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1820007e60 tx=0x7f182000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f181fe00640 1 -- 172.21.15.114:0/3872918861 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820014420 con 0x7f18281586f0 2024-02-17T12:16:41.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f181fe00640 1 -- 172.21.15.114:0/3872918861 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18200145a0 con 0x7f18281586f0 2024-02-17T12:16:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f181fe00640 1 -- 172.21.15.114:0/3872918861 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1820014950 con 0x7f18281586f0 2024-02-17T12:16:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ee00640 1 -- 172.21.15.114:0/3872918861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182814bbc0 con 0x7f18281586f0 2024-02-17T12:16:41.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.131+0000 7f182ee00640 1 -- 172.21.15.114:0/3872918861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182814aa70 con 0x7f18281586f0 2024-02-17T12:16:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.135+0000 7f182ee00640 1 -- 172.21.15.114:0/3872918861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1828067370 con 0x7f18281586f0 2024-02-17T12:16:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.135+0000 7f181fe00640 1 -- 172.21.15.114:0/3872918861 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1820014ab0 con 0x7f18281586f0 2024-02-17T12:16:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.135+0000 7f181fe00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1808066e40 0x7f1808069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.135+0000 7f181fe00640 1 -- 172.21.15.114:0/3872918861 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1820085210 con 0x7f18281586f0 2024-02-17T12:16:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.135+0000 7f1827e00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1808066e40 0x7f1808069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.135+0000 7f1827e00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1808066e40 0x7f1808069300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1828149900 tx=0x7f1818009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:41.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.139+0000 7f181fe00640 1 -- 172.21.15.114:0/3872918861 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f18200520a0 con 0x7f18281586f0 2024-02-17T12:16:41.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.291+0000 7f182ee00640 1 -- 172.21.15.114:0/3872918861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f182814af20 con 0x7f18281586f0 2024-02-17T12:16:41.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.291+0000 7f181fe00640 1 -- 172.21.15.114:0/3872918861 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f182814af20 con 0x7f18281586f0 2024-02-17T12:16:41.298 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:16:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 -- 172.21.15.114:0/3872918861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1808066e40 msgr2=0x7f1808069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1808066e40 0x7f1808069300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1828149900 tx=0x7f1818009040 comp rx=0 tx=0).stop 2024-02-17T12:16:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 -- 172.21.15.114:0/3872918861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18281586f0 msgr2=0x7f18280ab400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18281586f0 0x7f18280ab400 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1820007e60 tx=0x7f182000e4b0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 -- 172.21.15.114:0/3872918861 shutdown_connections 2024-02-17T12:16:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1808066e40 0x7f1808069300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18281586f0 0x7f18280ab400 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1828152560 0x7f18280aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 --2- 172.21.15.114:0/3872918861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1828072b20 0x7f1828152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 -- 172.21.15.114:0/3872918861 >> 172.21.15.114:0/3872918861 conn(0x7f182806bef0 msgr2=0x7f18280c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 -- 172.21.15.114:0/3872918861 shutdown_connections 2024-02-17T12:16:41.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.295+0000 7f182ee00640 1 -- 172.21.15.114:0/3872918861 wait complete. 2024-02-17T12:16:41.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:16:41.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.451+0000 7f35bec00640 1 Processor -- start 2024-02-17T12:16:41.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.451+0000 7f35bec00640 1 -- start start 2024-02-17T12:16:41.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.451+0000 7f35bec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35b80c2580 0x7f35b80aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.451+0000 7f35bec00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b80a9420 con 0x7f35b814f110 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.451+0000 7f35bec00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b8152850 con 0x7f35b80c1eb0 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.451+0000 7f35bec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b814f4f0 con 0x7f35b80c2580 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.451+0000 7f35b7e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f35b814f110 0x7f35b80c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44128/0 (socket says 172.21.15.114:44128) 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.451+0000 7f35b7e00640 1 -- 172.21.15.114:0/968510327 learned_addr learned my addr 172.21.15.114:0/968510327 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35af400640 1 --2- 172.21.15.114:0/968510327 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35b80c2580 0x7f35b80aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35b7400640 1 -- 172.21.15.114:0/968510327 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840761762 0 0) 0x7f35b80a9420 con 0x7f35b814f110 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35b7400640 1 -- 172.21.15.114:0/968510327 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f359c003530 con 0x7f35b814f110 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35b7400640 1 -- 172.21.15.114:0/968510327 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636126406 0 0) 0x7f35b8152850 con 0x7f35b80c1eb0 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35b7400640 1 -- 172.21.15.114:0/968510327 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35b80a9420 con 0x7f35b80c1eb0 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35af400640 1 -- 172.21.15.114:0/968510327 >> v1:172.21.15.116:6789/0 conn(0x7f35b80c1eb0 legacy=0x7f35b815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35af400640 1 -- 172.21.15.114:0/968510327 >> v1:172.21.15.114:6789/0 conn(0x7f35b814f110 legacy=0x7f35b80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35af400640 1 -- 172.21.15.114:0/968510327 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b80a9670 con 0x7f35b80c2580 2024-02-17T12:16:41.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35af400640 1 --2- 172.21.15.114:0/968510327 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35b80c2580 0x7f35b80aa150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f35a00097f0 tx=0x7f35a001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ce02750cceb98c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35b7400640 1 -- 172.21.15.114:0/968510327 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a00ab600 con 0x7f35b80c2580 2024-02-17T12:16:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35b7400640 1 -- 172.21.15.114:0/968510327 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a00a7050 con 0x7f35b80c2580 2024-02-17T12:16:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.455+0000 7f35b7400640 1 -- 172.21.15.114:0/968510327 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a00ab980 con 0x7f35b80c2580 2024-02-17T12:16:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 -- 172.21.15.114:0/968510327 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35b80c2580 msgr2=0x7f35b80aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 --2- 172.21.15.114:0/968510327 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35b80c2580 0x7f35b80aa150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f35a00097f0 tx=0x7f35a001c450 comp rx=0 tx=0).stop 2024-02-17T12:16:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 -- 172.21.15.114:0/968510327 shutdown_connections 2024-02-17T12:16:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 --2- 172.21.15.114:0/968510327 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35b80c2580 0x7f35b80aa150 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 -- 172.21.15.114:0/968510327 >> 172.21.15.114:0/968510327 conn(0x7f35b80a8490 msgr2=0x7f35b80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 -- 172.21.15.114:0/968510327 shutdown_connections 2024-02-17T12:16:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 -- 172.21.15.114:0/968510327 wait complete. 2024-02-17T12:16:41.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 Processor -- start 2024-02-17T12:16:41.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 -- start start 2024-02-17T12:16:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35b80c1eb0 0x7f35b80c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35b80c2580 0x7f35b8150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35b814f110 0x7f35b80c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80c5b00 con 0x7f35b80c1eb0 2024-02-17T12:16:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80c4090 con 0x7f35b80c2580 2024-02-17T12:16:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80c55d0 con 0x7f35b814f110 2024-02-17T12:16:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35b80c1eb0 0x7f35b80c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35b80c1eb0 0x7f35b80c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43422/0 (socket says 172.21.15.114:43422) 2024-02-17T12:16:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b7e00640 1 -- 172.21.15.114:0/1270399753 learned_addr learned my addr 172.21.15.114:0/1270399753 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b7e00640 1 -- 172.21.15.114:0/1270399753 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35b814f110 msgr2=0x7f35b80c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b7e00640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35b814f110 0x7f35b80c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b7e00640 1 -- 172.21.15.114:0/1270399753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35b80c2580 msgr2=0x7f35b8150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b7e00640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35b80c2580 0x7f35b8150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b7e00640 1 -- 172.21.15.114:0/1270399753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a0009420 con 0x7f35b80c1eb0 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b7e00640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35b80c1eb0 0x7f35b80c5c90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f35a800c4d0 tx=0x7f35a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b4c00640 1 -- 172.21.15.114:0/1270399753 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8005cf0 con 0x7f35b80c1eb0 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b4c00640 1 -- 172.21.15.114:0/1270399753 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a8005e50 con 0x7f35b80c1eb0 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35b4c00640 1 -- 172.21.15.114:0/1270399753 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8007270 con 0x7f35b80c1eb0 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.459+0000 7f35bec00640 1 -- 172.21.15.114:0/1270399753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b80c5820 con 0x7f35b80c1eb0 2024-02-17T12:16:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.463+0000 7f35bec00640 1 -- 172.21.15.114:0/1270399753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b81ed240 con 0x7f35b80c1eb0 2024-02-17T12:16:41.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.463+0000 7f35bec00640 1 -- 172.21.15.114:0/1270399753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b81ecdc0 con 0x7f35b80c1eb0 2024-02-17T12:16:41.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.463+0000 7f35b4c00640 1 -- 172.21.15.114:0/1270399753 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f35a80073d0 con 0x7f35b80c1eb0 2024-02-17T12:16:41.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.463+0000 7f35b4c00640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3594066e40 0x7f3594069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.463+0000 7f35b4c00640 1 -- 172.21.15.114:0/1270399753 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35a8083f30 con 0x7f35b80c1eb0 2024-02-17T12:16:41.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.463+0000 7f35af400640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3594066e40 0x7f3594069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.463+0000 7f35af400640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3594066e40 0x7f3594069300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35b806dc70 tx=0x7f35a00ad040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:41.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.467+0000 7f35b4c00640 1 -- 172.21.15.114:0/1270399753 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f35b81ecdc0 con 0x7f35b80c1eb0 2024-02-17T12:16:41.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 -- 172.21.15.114:0/1270399753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35b81ecdc0 con 0x7f35b80c1eb0 2024-02-17T12:16:41.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35b4c00640 1 -- 172.21.15.114:0/1270399753 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35b81ecdc0 con 0x7f35b80c1eb0 2024-02-17T12:16:41.628 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 -- 172.21.15.114:0/1270399753 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3594066e40 msgr2=0x7f3594069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3594066e40 0x7f3594069300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35b806dc70 tx=0x7f35a00ad040 comp rx=0 tx=0).stop 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 -- 172.21.15.114:0/1270399753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35b80c1eb0 msgr2=0x7f35b80c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35b80c1eb0 0x7f35b80c5c90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f35a800c4d0 tx=0x7f35a800c990 comp rx=0 tx=0).stop 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 -- 172.21.15.114:0/1270399753 shutdown_connections 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35b814f110 0x7f35b80c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35b80c2580 0x7f35b8150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3594066e40 0x7f3594069300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 --2- 172.21.15.114:0/1270399753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35b80c1eb0 0x7f35b80c5c90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 -- 172.21.15.114:0/1270399753 >> 172.21.15.114:0/1270399753 conn(0x7f35b80a8490 msgr2=0x7f35b8071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:41.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 -- 172.21.15.114:0/1270399753 shutdown_connections 2024-02-17T12:16:41.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.623+0000 7f35bec00640 1 -- 172.21.15.114:0/1270399753 wait complete. 2024-02-17T12:16:41.648 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:41.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f2810000640 1 Processor -- start 2024-02-17T12:16:41.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f2810000640 1 -- start start 2024-02-17T12:16:41.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f2810000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f28080c1eb0 0x7f280815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f2810000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28080a9420 con 0x7f28080c2580 2024-02-17T12:16:41.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f2810000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2808152850 con 0x7f280814f110 2024-02-17T12:16:41.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f2810000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280814f4f0 con 0x7f28080c1eb0 2024-02-17T12:16:41.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f280cc00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f28080c2580 0x7f28080aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44144/0 (socket says 172.21.15.114:44144) 2024-02-17T12:16:41.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f280cc00640 1 -- 172.21.15.114:0/1405452788 learned_addr learned my addr 172.21.15.114:0/1405452788 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:41.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f280e000640 1 --2- 172.21.15.114:0/1405452788 >> v2:172.21.15.116:3300/0 conn(0x7f28080c1eb0 0x7f280815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f2807e00640 1 -- 172.21.15.114:0/1405452788 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675306841 0 0) 0x7f28080a9420 con 0x7f28080c2580 2024-02-17T12:16:41.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.779+0000 7f2807e00640 1 -- 172.21.15.114:0/1405452788 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f0003530 con 0x7f28080c2580 2024-02-17T12:16:41.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f280e000640 1 -- 172.21.15.114:0/1405452788 >> v1:172.21.15.116:6789/0 conn(0x7f280814f110 legacy=0x7f28080c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f280e000640 1 -- 172.21.15.114:0/1405452788 >> v1:172.21.15.114:6789/0 conn(0x7f28080c2580 legacy=0x7f28080aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f280e000640 1 -- 172.21.15.114:0/1405452788 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28080a9670 con 0x7f28080c1eb0 2024-02-17T12:16:41.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f280e000640 1 --2- 172.21.15.114:0/1405452788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28080c1eb0 0x7f280815d3a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2800009d90 tx=0x7f280001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eaeeebbc2bc4c01 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:41.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f2807e00640 1 -- 172.21.15.114:0/1405452788 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000a5890 con 0x7f28080c1eb0 2024-02-17T12:16:41.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f2807e00640 1 -- 172.21.15.114:0/1405452788 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28000a59f0 con 0x7f28080c1eb0 2024-02-17T12:16:41.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f2807e00640 1 -- 172.21.15.114:0/1405452788 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000a5d80 con 0x7f28080c1eb0 2024-02-17T12:16:41.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f2810000640 1 -- 172.21.15.114:0/1405452788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28080c1eb0 msgr2=0x7f280815d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f2810000640 1 --2- 172.21.15.114:0/1405452788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28080c1eb0 0x7f280815d3a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2800009d90 tx=0x7f280001c8e0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f2810000640 1 -- 172.21.15.114:0/1405452788 shutdown_connections 2024-02-17T12:16:41.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f2810000640 1 --2- 172.21.15.114:0/1405452788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28080c1eb0 0x7f280815d3a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f2810000640 1 -- 172.21.15.114:0/1405452788 >> 172.21.15.114:0/1405452788 conn(0x7f28080a8490 msgr2=0x7f28080a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:41.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f2810000640 1 -- 172.21.15.114:0/1405452788 shutdown_connections 2024-02-17T12:16:41.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.783+0000 7f2810000640 1 -- 172.21.15.114:0/1405452788 wait complete. 2024-02-17T12:16:41.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2810000640 1 Processor -- start 2024-02-17T12:16:41.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2810000640 1 -- start start 2024-02-17T12:16:41.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2810000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28080c1eb0 0x7f28081ed980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2810000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28080c2580 0x7f28081f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2810000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f280814f110 0x7f28080bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2810000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28081506b0 con 0x7f280814f110 2024-02-17T12:16:41.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2810000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28081ee940 con 0x7f28080c2580 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2810000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280814fe10 con 0x7f28080c1eb0 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f280814f110 0x7f28080bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f280814f110 0x7f28080bf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43434/0 (socket says 172.21.15.114:43434) 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280e000640 1 -- 172.21.15.114:0/2947567126 learned_addr learned my addr 172.21.15.114:0/2947567126 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280d600640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28080c1eb0 0x7f28081ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280cc00640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28080c2580 0x7f28081f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280e000640 1 -- 172.21.15.114:0/2947567126 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28080c1eb0 msgr2=0x7f28081ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280e000640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28080c1eb0 0x7f28081ed980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280e000640 1 -- 172.21.15.114:0/2947567126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28080c2580 msgr2=0x7f28081f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280e000640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28080c2580 0x7f28081f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280e000640 1 -- 172.21.15.114:0/2947567126 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2800009a70 con 0x7f280814f110 2024-02-17T12:16:41.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f280e000640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f280814f110 0x7f28080bf7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f280001a510 tx=0x7f2800019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:41.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2805600640 1 -- 172.21.15.114:0/2947567126 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000b9650 con 0x7f280814f110 2024-02-17T12:16:41.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2805600640 1 -- 172.21.15.114:0/2947567126 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28000b97b0 con 0x7f280814f110 2024-02-17T12:16:41.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2805600640 1 -- 172.21.15.114:0/2947567126 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000b9b20 con 0x7f280814f110 2024-02-17T12:16:41.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.787+0000 7f2810000640 1 -- 172.21.15.114:0/2947567126 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28081500f0 con 0x7f280814f110 2024-02-17T12:16:41.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.791+0000 7f2810000640 1 -- 172.21.15.114:0/2947567126 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28081f1090 con 0x7f280814f110 2024-02-17T12:16:41.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.791+0000 7f2810000640 1 -- 172.21.15.114:0/2947567126 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28081f1280 con 0x7f280814f110 2024-02-17T12:16:41.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.791+0000 7f2805600640 1 -- 172.21.15.114:0/2947567126 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f28000b9c80 con 0x7f280814f110 2024-02-17T12:16:41.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.791+0000 7f2805600640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27e8066e40 0x7f27e8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:41.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.791+0000 7f2805600640 1 -- 172.21.15.114:0/2947567126 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f280011fb70 con 0x7f280814f110 2024-02-17T12:16:41.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.791+0000 7f280d600640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27e8066e40 0x7f27e8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:41.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.791+0000 7f280d600640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27e8066e40 0x7f27e8069300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f27fc001810 tx=0x7f27fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:41.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.795+0000 7f2805600640 1 -- 172.21.15.114:0/2947567126 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f28000eca10 con 0x7f280814f110 2024-02-17T12:16:41.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.951+0000 7f2810000640 1 -- 172.21.15.114:0/2947567126 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2808074840 con 0x7f280814f110 2024-02-17T12:16:41.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.951+0000 7f2805600640 1 -- 172.21.15.114:0/2947567126 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f28000f00d0 con 0x7f280814f110 2024-02-17T12:16:41.956 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:41.957 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:41.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.951+0000 7f2810000640 1 -- 172.21.15.114:0/2947567126 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27e8066e40 msgr2=0x7f27e8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.951+0000 7f2810000640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27e8066e40 0x7f27e8069300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f27fc001810 tx=0x7f27fc009040 comp rx=0 tx=0).stop 2024-02-17T12:16:41.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.951+0000 7f2810000640 1 -- 172.21.15.114:0/2947567126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f280814f110 msgr2=0x7f28080bf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:41.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.951+0000 7f2810000640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f280814f110 0x7f28080bf7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f280001a510 tx=0x7f2800019680 comp rx=0 tx=0).stop 2024-02-17T12:16:41.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.955+0000 7f2810000640 1 -- 172.21.15.114:0/2947567126 shutdown_connections 2024-02-17T12:16:41.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.955+0000 7f2810000640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27e8066e40 0x7f27e8069300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.955+0000 7f2810000640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f280814f110 0x7f28080bf7a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.955+0000 7f2810000640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f28080c2580 0x7f28081f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.955+0000 7f2810000640 1 --2- 172.21.15.114:0/2947567126 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f28080c1eb0 0x7f28081ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:41.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.955+0000 7f2810000640 1 -- 172.21.15.114:0/2947567126 >> 172.21.15.114:0/2947567126 conn(0x7f28080a8490 msgr2=0x7f28080c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:41.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.955+0000 7f2810000640 1 -- 172.21.15.114:0/2947567126 shutdown_connections 2024-02-17T12:16:41.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:41.955+0000 7f2810000640 1 -- 172.21.15.114:0/2947567126 wait complete. 2024-02-17T12:16:41.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:16:21.236908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:16:21.659009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:41.977 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:42.075 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:16:42.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:16:42.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.111+0000 7f2f8fe00640 1 Processor -- start 2024-02-17T12:16:42.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.111+0000 7f2f8fe00640 1 -- start start 2024-02-17T12:16:42.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.111+0000 7f2f8fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f900aa480 0x7f2f90070a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.111+0000 7f2f8fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9006f3a0 con 0x7f2f900c2d60 2024-02-17T12:16:42.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.111+0000 7f2f8fe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900aa910 con 0x7f2f900aa0a0 2024-02-17T12:16:42.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.111+0000 7f2f8fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9006fc20 con 0x7f2f900aa480 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.111+0000 7f2f8e000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2f900c2d60 0x7f2f90153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44148/0 (socket says 172.21.15.114:44148) 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.111+0000 7f2f8e000640 1 -- 172.21.15.114:0/1648506539 learned_addr learned my addr 172.21.15.114:0/1648506539 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.111+0000 7f2f8f400640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f900aa480 0x7f2f90070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637942392 0 0) 0x7f2f9006f3a0 con 0x7f2f900c2d60 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f74003530 con 0x7f2f900c2d60 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504556059 0 0) 0x7f2f80001120 con 0x7f2f900aa0a0 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f9006f3a0 con 0x7f2f900aa0a0 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2897209860 0 0) 0x7f2f74003530 con 0x7f2f900c2d60 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f900aa480 msgr2=0x7f2f90070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f900aa480 0x7f2f90070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 >> v1:172.21.15.116:6789/0 conn(0x7f2f900aa0a0 legacy=0x7f2f90152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9006ede0 con 0x7f2f900c2d60 2024-02-17T12:16:42.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f2f7c001680 con 0x7f2f900c2d60 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 >> v1:172.21.15.114:6789/0 conn(0x7f2f900c2d60 legacy=0x7f2f90153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f74003b40 0x7f2f74003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f900aa480 0x7f2f740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f74004d10 0x7f2f74005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9006fc20 con 0x7f2f74004d10 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7400ba40 con 0x7f2f74003b40 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7400bc00 con 0x7f2f900aa480 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8f400640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f74004d10 0x7f2f74005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8e000640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f900aa480 0x7f2f740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8ea00640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f74003b40 0x7f2f74003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8f400640 1 -- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f900aa480 msgr2=0x7f2f740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8f400640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f900aa480 0x7f2f740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8f400640 1 -- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f74003b40 msgr2=0x7f2f74003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:42.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8f400640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f74003b40 0x7f2f74003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8f400640 1 -- 172.21.15.114:0/1648506539 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74003530 con 0x7f2f74004d10 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.115+0000 7f2f8f400640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f74004d10 0x7f2f74005190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009fc0 tx=0x7f2f8801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3466584684c250ed server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880a5c90 con 0x7f2f74004d10 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8800f040 con 0x7f2f74004d10 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8d600640 1 -- 172.21.15.114:0/1648506539 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880ad440 con 0x7f2f74004d10 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 -- 172.21.15.114:0/1648506539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f74004d10 msgr2=0x7f2f74005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 --2- 172.21.15.114:0/1648506539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f74004d10 0x7f2f74005190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009fc0 tx=0x7f2f8801cc40 comp rx=0 tx=0).stop 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8f400640 1 -- 172.21.15.114:0/1648506539 reap_dead start 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 -- 172.21.15.114:0/1648506539 shutdown_connections 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 -- 172.21.15.114:0/1648506539 >> 172.21.15.114:0/1648506539 conn(0x7f2f900c4e60 msgr2=0x7f2f900c5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 -- 172.21.15.114:0/1648506539 shutdown_connections 2024-02-17T12:16:42.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 -- 172.21.15.114:0/1648506539 wait complete. 2024-02-17T12:16:42.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 Processor -- start 2024-02-17T12:16:42.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 -- start start 2024-02-17T12:16:42.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f74004d10 0x7f2f9014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f900c42a0 0x7f2f901edaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9006d4e0 0x7f2f901ea350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9014b960 con 0x7f2f9006d4e0 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f901555b0 con 0x7f2f900c42a0 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90155890 con 0x7f2f74004d10 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9006d4e0 0x7f2f901ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9006d4e0 0x7f2f901ea350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43442/0 (socket says 172.21.15.114:43442) 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.119+0000 7f2f8f400640 1 -- 172.21.15.114:0/2068541298 learned_addr learned my addr 172.21.15.114:0/2068541298 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8e000640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f900c42a0 0x7f2f901edaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8ea00640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f74004d10 0x7f2f9014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8f400640 1 -- 172.21.15.114:0/2068541298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f74004d10 msgr2=0x7f2f9014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8f400640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f74004d10 0x7f2f9014c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8f400640 1 -- 172.21.15.114:0/2068541298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f900c42a0 msgr2=0x7f2f901edaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8f400640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f900c42a0 0x7f2f901edaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8f400640 1 -- 172.21.15.114:0/2068541298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90155b70 con 0x7f2f9006d4e0 2024-02-17T12:16:42.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8f400640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9006d4e0 0x7f2f901ea350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2f88002240 tx=0x7f2f88009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:42.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f86a00640 1 -- 172.21.15.114:0/2068541298 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880039a0 con 0x7f2f9006d4e0 2024-02-17T12:16:42.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f86a00640 1 -- 172.21.15.114:0/2068541298 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88003b00 con 0x7f2f9006d4e0 2024-02-17T12:16:42.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f86a00640 1 -- 172.21.15.114:0/2068541298 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88003e90 con 0x7f2f9006d4e0 2024-02-17T12:16:42.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8fe00640 1 -- 172.21.15.114:0/2068541298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f901e9e30 con 0x7f2f9006d4e0 2024-02-17T12:16:42.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8fe00640 1 -- 172.21.15.114:0/2068541298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9006d960 con 0x7f2f9006d4e0 2024-02-17T12:16:42.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8fe00640 1 -- 172.21.15.114:0/2068541298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f90155d00 con 0x7f2f9006d4e0 2024-02-17T12:16:42.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f86a00640 1 -- 172.21.15.114:0/2068541298 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2f880b4040 con 0x7f2f9006d4e0 2024-02-17T12:16:42.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f86a00640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f70066e40 0x7f2f70069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f86a00640 1 -- 172.21.15.114:0/2068541298 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f8811e6e0 con 0x7f2f9006d4e0 2024-02-17T12:16:42.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.123+0000 7f2f8ea00640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f70066e40 0x7f2f70069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.127+0000 7f2f8ea00640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f70066e40 0x7f2f70069300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f80001280 tx=0x7f2f80007cd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:42.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.127+0000 7f2f86a00640 1 -- 172.21.15.114:0/2068541298 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2f880eb610 con 0x7f2f9006d4e0 2024-02-17T12:16:42.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.283+0000 7f2f8fe00640 1 -- 172.21.15.114:0/2068541298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f9006db50 con 0x7f2f9006d4e0 2024-02-17T12:16:42.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.283+0000 7f2f86a00640 1 -- 172.21.15.114:0/2068541298 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f9006db50 con 0x7f2f9006d4e0 2024-02-17T12:16:42.289 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 -- 172.21.15.114:0/2068541298 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f70066e40 msgr2=0x7f2f70069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f70066e40 0x7f2f70069300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f80001280 tx=0x7f2f80007cd0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 -- 172.21.15.114:0/2068541298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9006d4e0 msgr2=0x7f2f901ea350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9006d4e0 0x7f2f901ea350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2f88002240 tx=0x7f2f88009750 comp rx=0 tx=0).stop 2024-02-17T12:16:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 -- 172.21.15.114:0/2068541298 shutdown_connections 2024-02-17T12:16:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f70066e40 0x7f2f70069300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9006d4e0 0x7f2f901ea350 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f900c42a0 0x7f2f901edaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 --2- 172.21.15.114:0/2068541298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f74004d10 0x7f2f9014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 -- 172.21.15.114:0/2068541298 >> 172.21.15.114:0/2068541298 conn(0x7f2f900c4e60 msgr2=0x7f2f900c83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 -- 172.21.15.114:0/2068541298 shutdown_connections 2024-02-17T12:16:42.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.287+0000 7f2f8fe00640 1 -- 172.21.15.114:0/2068541298 wait complete. 2024-02-17T12:16:42.310 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:16:42.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f722dc00640 1 Processor -- start 2024-02-17T12:16:42.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f722dc00640 1 -- start start 2024-02-17T12:16:42.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f722dc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f722806db50 0x7f722814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f722dc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7228150490 0x7f7228152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f722dc00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7228156270 con 0x7f72280c25a0 2024-02-17T12:16:42.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f722dc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722806f090 con 0x7f722806db50 2024-02-17T12:16:42.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f722dc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7228071630 con 0x7f7228150490 2024-02-17T12:16:42.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f721fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f722806db50 0x7f722814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f721fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f722806db50 0x7f722814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43444/0 (socket says 172.21.15.114:43444) 2024-02-17T12:16:42.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f721fe00640 1 -- 172.21.15.114:0/987770615 learned_addr learned my addr 172.21.15.114:0/987770615 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:42.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f721fe00640 1 -- 172.21.15.114:0/987770615 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7228150490 msgr2=0x7f7228152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:42.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f7227400640 1 --2- 172.21.15.114:0/987770615 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7228150490 0x7f7228152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f721fe00640 1 --2- 172.21.15.114:0/987770615 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7228150490 0x7f7228152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f721fe00640 1 -- 172.21.15.114:0/987770615 >> v1:172.21.15.116:6789/0 conn(0x7f72280c25a0 legacy=0x7f722806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:42.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.487+0000 7f721fe00640 1 -- 172.21.15.114:0/987770615 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7228156550 con 0x7f722806db50 2024-02-17T12:16:42.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f721fe00640 1 --2- 172.21.15.114:0/987770615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f722806db50 0x7f722814ff50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7210009870 tx=0x7f721001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df1d002c559c55d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:42.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f7226000640 1 -- 172.21.15.114:0/987770615 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100a7070 con 0x7f722806db50 2024-02-17T12:16:42.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f7226000640 1 -- 172.21.15.114:0/987770615 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72100ab430 con 0x7f722806db50 2024-02-17T12:16:42.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f7226000640 1 -- 172.21.15.114:0/987770615 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72281539a0 con 0x7f722806db50 2024-02-17T12:16:42.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f722dc00640 1 -- 172.21.15.114:0/987770615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f722806db50 msgr2=0x7f722814ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f722dc00640 1 --2- 172.21.15.114:0/987770615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f722806db50 0x7f722814ff50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7210009870 tx=0x7f721001c410 comp rx=0 tx=0).stop 2024-02-17T12:16:42.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f722dc00640 1 -- 172.21.15.114:0/987770615 shutdown_connections 2024-02-17T12:16:42.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f722dc00640 1 --2- 172.21.15.114:0/987770615 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7228150490 0x7f7228152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f722dc00640 1 --2- 172.21.15.114:0/987770615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f722806db50 0x7f722814ff50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f722dc00640 1 -- 172.21.15.114:0/987770615 >> 172.21.15.114:0/987770615 conn(0x7f72280a8490 msgr2=0x7f72280a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:42.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f722dc00640 1 -- 172.21.15.114:0/987770615 shutdown_connections 2024-02-17T12:16:42.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f722dc00640 1 -- 172.21.15.114:0/987770615 wait complete. 2024-02-17T12:16:42.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f722dc00640 1 Processor -- start 2024-02-17T12:16:42.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.491+0000 7f722dc00640 1 -- start start 2024-02-17T12:16:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f722dc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f722806db50 0x7f72281463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f722dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72280c25a0 0x7f7228154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f722dc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7228150490 0x7f72280a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f722dc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7228142ab0 con 0x7f72280c25a0 2024-02-17T12:16:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f722dc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72281424f0 con 0x7f7228150490 2024-02-17T12:16:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f722dc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72281427d0 con 0x7f722806db50 2024-02-17T12:16:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72280c25a0 0x7f7228154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72280c25a0 0x7f7228154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43460/0 (socket says 172.21.15.114:43460) 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721fe00640 1 -- 172.21.15.114:0/1052702022 learned_addr learned my addr 172.21.15.114:0/1052702022 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f7227400640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7228150490 0x7f72280a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f7226a00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f722806db50 0x7f72281463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721fe00640 1 -- 172.21.15.114:0/1052702022 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f722806db50 msgr2=0x7f72281463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721fe00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f722806db50 0x7f72281463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721fe00640 1 -- 172.21.15.114:0/1052702022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7228150490 msgr2=0x7f72280a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721fe00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7228150490 0x7f72280a9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721fe00640 1 -- 172.21.15.114:0/1052702022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100094d0 con 0x7f72280c25a0 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f7227400640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7228150490 0x7f72280a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721fe00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72280c25a0 0x7f7228154150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f72100ad040 tx=0x7f72100191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721ea00640 1 -- 172.21.15.114:0/1052702022 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100ba070 con 0x7f72280c25a0 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721ea00640 1 -- 172.21.15.114:0/1052702022 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72100b4630 con 0x7f72280c25a0 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721ea00640 1 -- 172.21.15.114:0/1052702022 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100b4a00 con 0x7f72280c25a0 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f722dc00640 1 -- 172.21.15.114:0/1052702022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72281549c0 con 0x7f72280c25a0 2024-02-17T12:16:42.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f722dc00640 1 -- 172.21.15.114:0/1052702022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7228154690 con 0x7f72280c25a0 2024-02-17T12:16:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f722dc00640 1 -- 172.21.15.114:0/1052702022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7228074840 con 0x7f72280c25a0 2024-02-17T12:16:42.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.495+0000 7f721ea00640 1 -- 172.21.15.114:0/1052702022 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f72100b4b60 con 0x7f72280c25a0 2024-02-17T12:16:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.499+0000 7f721ea00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7204066e40 0x7f7204069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.499+0000 7f721ea00640 1 -- 172.21.15.114:0/1052702022 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f721011e630 con 0x7f72280c25a0 2024-02-17T12:16:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.499+0000 7f7226a00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7204066e40 0x7f7204069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.499+0000 7f7226a00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7204066e40 0x7f7204069300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7218000f70 tx=0x7f7218009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.503+0000 7f721ea00640 1 -- 172.21.15.114:0/1052702022 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72100eb4a0 con 0x7f72280c25a0 2024-02-17T12:16:42.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 -- 172.21.15.114:0/1052702022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7228154e70 con 0x7f72280c25a0 2024-02-17T12:16:42.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f721ea00640 1 -- 172.21.15.114:0/1052702022 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f72100eeb60 con 0x7f72280c25a0 2024-02-17T12:16:42.660 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:16:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 -- 172.21.15.114:0/1052702022 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7204066e40 msgr2=0x7f7204069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7204066e40 0x7f7204069300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7218000f70 tx=0x7f7218009040 comp rx=0 tx=0).stop 2024-02-17T12:16:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 -- 172.21.15.114:0/1052702022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72280c25a0 msgr2=0x7f7228154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72280c25a0 0x7f7228154150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f72100ad040 tx=0x7f72100191b0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 -- 172.21.15.114:0/1052702022 shutdown_connections 2024-02-17T12:16:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7228150490 0x7f72280a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7204066e40 0x7f7204069300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72280c25a0 0x7f7228154150 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 --2- 172.21.15.114:0/1052702022 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f722806db50 0x7f72281463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 -- 172.21.15.114:0/1052702022 >> 172.21.15.114:0/1052702022 conn(0x7f72280a8490 msgr2=0x7f72280721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 -- 172.21.15.114:0/1052702022 shutdown_connections 2024-02-17T12:16:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.655+0000 7f722dc00640 1 -- 172.21.15.114:0/1052702022 wait complete. 2024-02-17T12:16:42.681 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:16:42.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764f800640 1 Processor -- start 2024-02-17T12:16:42.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764f800640 1 -- start start 2024-02-17T12:16:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764f800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76480c4b30 0x7f76481583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764f800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7648155090 con 0x7f76480c58b0 2024-02-17T12:16:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764f800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7648159300 con 0x7f76480a6360 2024-02-17T12:16:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764f800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76480c6110 con 0x7f76480c4b30 2024-02-17T12:16:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764ce00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f76480c58b0 0x7f764806bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44152/0 (socket says 172.21.15.114:44152) 2024-02-17T12:16:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764ce00640 1 -- 172.21.15.114:0/2548547823 learned_addr learned my addr 172.21.15.114:0/2548547823 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647e00640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76480c4b30 0x7f76481583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60934062 0 0) 0x7f7648155090 con 0x7f76480c58b0 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7630003530 con 0x7f76480c58b0 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1140095577 0 0) 0x7f7630003530 con 0x7f76480c58b0 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76480c4b30 msgr2=0x7f76481583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76480c4b30 0x7f76481583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 >> v1:172.21.15.116:6789/0 conn(0x7f76480a6360 legacy=0x7f7648155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648158a60 con 0x7f76480c58b0 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f763c001680 con 0x7f76480c58b0 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 >> v1:172.21.15.114:6789/0 conn(0x7f76480c58b0 legacy=0x7f764806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 0x7f7630003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300047d0 0x7f7630004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76480c4b30 0x7f7630005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763000ba40 con 0x7f76300039b0 2024-02-17T12:16:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763000bb80 con 0x7f76300047d0 2024-02-17T12:16:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763000bd40 con 0x7f76480c4b30 2024-02-17T12:16:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764ce00640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 0x7f7630003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f7647e00640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300047d0 0x7f7630004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764d800640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76480c4b30 0x7f7630005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764ce00640 1 -- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76480c4b30 msgr2=0x7f7630005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764ce00640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f76480c4b30 0x7f7630005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764ce00640 1 -- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300047d0 msgr2=0x7f7630004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764ce00640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76300047d0 0x7f7630004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.815+0000 7f764ce00640 1 -- 172.21.15.114:0/2548547823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7630003530 con 0x7f76300039b0 2024-02-17T12:16:42.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f764ce00640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 0x7f7630003dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c210 tx=0x7f763c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fee5ad1b3611fb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c005ae0 con 0x7f76300039b0 2024-02-17T12:16:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c005c40 con 0x7f76300039b0 2024-02-17T12:16:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f7647400640 1 -- 172.21.15.114:0/2548547823 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0a57e0 con 0x7f76300039b0 2024-02-17T12:16:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f764f800640 1 -- 172.21.15.114:0/2548547823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 msgr2=0x7f7630003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f764f800640 1 --2- 172.21.15.114:0/2548547823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 0x7f7630003dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c210 tx=0x7f763c01cbf0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f764d800640 1 -- 172.21.15.114:0/2548547823 reap_dead start 2024-02-17T12:16:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f764f800640 1 -- 172.21.15.114:0/2548547823 shutdown_connections 2024-02-17T12:16:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f764f800640 1 -- 172.21.15.114:0/2548547823 >> 172.21.15.114:0/2548547823 conn(0x7f76480c3730 msgr2=0x7f76480c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f764f800640 1 -- 172.21.15.114:0/2548547823 shutdown_connections 2024-02-17T12:16:42.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.819+0000 7f764f800640 1 -- 172.21.15.114:0/2548547823 wait complete. 2024-02-17T12:16:42.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 Processor -- start 2024-02-17T12:16:42.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 -- start start 2024-02-17T12:16:42.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 0x7f76481f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764814f150 0x7f76480c2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7648155a10 0x7f7648152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76481581b0 con 0x7f76300039b0 2024-02-17T12:16:42.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764814f5d0 con 0x7f764814f150 2024-02-17T12:16:42.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764814ee70 con 0x7f7648155a10 2024-02-17T12:16:42.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 0x7f76481f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 0x7f76481f1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43470/0 (socket says 172.21.15.114:43470) 2024-02-17T12:16:42.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764ce00640 1 -- 172.21.15.114:0/1274071301 learned_addr learned my addr 172.21.15.114:0/1274071301 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f7647e00640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764814f150 0x7f76480c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764d800640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7648155a10 0x7f7648152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764ce00640 1 -- 172.21.15.114:0/1274071301 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7648155a10 msgr2=0x7f7648152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764ce00640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7648155a10 0x7f7648152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764ce00640 1 -- 172.21.15.114:0/1274071301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764814f150 msgr2=0x7f76480c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764ce00640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764814f150 0x7f76480c2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764ce00640 1 -- 172.21.15.114:0/1274071301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764806f140 con 0x7f76300039b0 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764ce00640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 0x7f76481f1390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f763c01ca20 tx=0x7f7630005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f7644c00640 1 -- 172.21.15.114:0/1274071301 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0b4070 con 0x7f76300039b0 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f7644c00640 1 -- 172.21.15.114:0/1274071301 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c005db0 con 0x7f76300039b0 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 -- 172.21.15.114:0/1274071301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764806f420 con 0x7f76300039b0 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f7644c00640 1 -- 172.21.15.114:0/1274071301 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c001660 con 0x7f76300039b0 2024-02-17T12:16:42.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 -- 172.21.15.114:0/1274071301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76480c2c70 con 0x7f76300039b0 2024-02-17T12:16:42.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.823+0000 7f764f800640 1 -- 172.21.15.114:0/1274071301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7648067170 con 0x7f76300039b0 2024-02-17T12:16:42.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.827+0000 7f7644c00640 1 -- 172.21.15.114:0/1274071301 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f763c0a57e0 con 0x7f76300039b0 2024-02-17T12:16:42.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.827+0000 7f7644c00640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7628066e70 0x7f7628069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:42.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.827+0000 7f7644c00640 1 -- 172.21.15.114:0/1274071301 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f763c11e4a0 con 0x7f76300039b0 2024-02-17T12:16:42.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.827+0000 7f7647e00640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7628066e70 0x7f7628069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:42.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.827+0000 7f7647e00640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7628066e70 0x7f7628069330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7648153d70 tx=0x7f7634009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:42.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.831+0000 7f7644c00640 1 -- 172.21.15.114:0/1274071301 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f763c0eb280 con 0x7f76300039b0 2024-02-17T12:16:42.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.983+0000 7f764f800640 1 -- 172.21.15.114:0/1274071301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7648074840 con 0x7f76300039b0 2024-02-17T12:16:42.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.983+0000 7f7644c00640 1 -- 172.21.15.114:0/1274071301 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f763c0ee940 con 0x7f76300039b0 2024-02-17T12:16:42.989 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:16:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 -- 172.21.15.114:0/1274071301 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7628066e70 msgr2=0x7f7628069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7628066e70 0x7f7628069330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7648153d70 tx=0x7f7634009190 comp rx=0 tx=0).stop 2024-02-17T12:16:42.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 -- 172.21.15.114:0/1274071301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 msgr2=0x7f76481f1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 0x7f76481f1390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f763c01ca20 tx=0x7f7630005800 comp rx=0 tx=0).stop 2024-02-17T12:16:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 -- 172.21.15.114:0/1274071301 shutdown_connections 2024-02-17T12:16:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7648155a10 0x7f7648152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764814f150 0x7f76480c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7628066e70 0x7f7628069330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 --2- 172.21.15.114:0/1274071301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76300039b0 0x7f76481f1390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 -- 172.21.15.114:0/1274071301 >> 172.21.15.114:0/1274071301 conn(0x7f76480c3730 msgr2=0x7f7648154390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 -- 172.21.15.114:0/1274071301 shutdown_connections 2024-02-17T12:16:42.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:42.987+0000 7f764f800640 1 -- 172.21.15.114:0/1274071301 wait complete. 2024-02-17T12:16:43.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:43.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d75400640 1 Processor -- start 2024-02-17T12:16:43.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d75400640 1 -- start start 2024-02-17T12:16:43.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d75400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3d70150300 0x7f3d70156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d75400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3d700714c0 0x7f3d700aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d75400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d70157270 con 0x7f3d700aa6a0 2024-02-17T12:16:43.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d75400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d700c6900 con 0x7f3d700714c0 2024-02-17T12:16:43.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d75400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d700c3580 con 0x7f3d70150300 2024-02-17T12:16:43.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d6de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3d700714c0 0x7f3d700aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d6de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3d700714c0 0x7f3d700aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43482/0 (socket says 172.21.15.114:43482) 2024-02-17T12:16:43.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d6de00640 1 -- 172.21.15.114:0/3094014424 learned_addr learned my addr 172.21.15.114:0/3094014424 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:43.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.139+0000 7f3d6f200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3d700aa6a0 0x7f3d70152d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44164/0 (socket says 172.21.15.114:44164) 2024-02-17T12:16:43.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d6e800640 1 --2- 172.21.15.114:0/3094014424 >> v2:172.21.15.116:3300/0 conn(0x7f3d70150300 0x7f3d70156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d6de00640 1 -- 172.21.15.114:0/3094014424 >> v2:172.21.15.116:3300/0 conn(0x7f3d70150300 msgr2=0x7f3d70156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:43.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d6de00640 1 --2- 172.21.15.114:0/3094014424 >> v2:172.21.15.116:3300/0 conn(0x7f3d70150300 0x7f3d70156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d6de00640 1 -- 172.21.15.114:0/3094014424 >> v1:172.21.15.114:6789/0 conn(0x7f3d700aa6a0 legacy=0x7f3d70152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d6de00640 1 -- 172.21.15.114:0/3094014424 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d700c2fc0 con 0x7f3d700714c0 2024-02-17T12:16:43.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d6de00640 1 --2- 172.21.15.114:0/3094014424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d700714c0 0x7f3d700aa160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d7006dfa0 tx=0x7f3d6001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730e43980eb81033 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:43.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d6d400640 1 -- 172.21.15.114:0/3094014424 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600a5650 con 0x7f3d700714c0 2024-02-17T12:16:43.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d6d400640 1 -- 172.21.15.114:0/3094014424 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600a57b0 con 0x7f3d700714c0 2024-02-17T12:16:43.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d6d400640 1 -- 172.21.15.114:0/3094014424 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600a5b40 con 0x7f3d700714c0 2024-02-17T12:16:43.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d75400640 1 -- 172.21.15.114:0/3094014424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d700714c0 msgr2=0x7f3d700aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.143+0000 7f3d75400640 1 --2- 172.21.15.114:0/3094014424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d700714c0 0x7f3d700aa160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d7006dfa0 tx=0x7f3d6001c7f0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 -- 172.21.15.114:0/3094014424 shutdown_connections 2024-02-17T12:16:43.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 --2- 172.21.15.114:0/3094014424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d700714c0 0x7f3d700aa160 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 --2- 172.21.15.114:0/3094014424 >> v2:172.21.15.116:3300/0 conn(0x7f3d70150300 0x7f3d70156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 -- 172.21.15.114:0/3094014424 >> 172.21.15.114:0/3094014424 conn(0x7f3d700c4f20 msgr2=0x7f3d700c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:43.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 -- 172.21.15.114:0/3094014424 shutdown_connections 2024-02-17T12:16:43.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 -- 172.21.15.114:0/3094014424 wait complete. 2024-02-17T12:16:43.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 Processor -- start 2024-02-17T12:16:43.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 -- start start 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d700714c0 0x7f3d700c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d700aa6a0 0x7f3d70156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d70150300 0x7f3d70156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d701e90c0 con 0x7f3d70150300 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700ad390 con 0x7f3d700714c0 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d701e8300 con 0x7f3d700aa6a0 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d70150300 0x7f3d70156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d70150300 0x7f3d70156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43496/0 (socket says 172.21.15.114:43496) 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6f200640 1 -- 172.21.15.114:0/3554807602 learned_addr learned my addr 172.21.15.114:0/3554807602 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6e800640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d700714c0 0x7f3d700c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6de00640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d700aa6a0 0x7f3d70156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6f200640 1 -- 172.21.15.114:0/3554807602 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d700aa6a0 msgr2=0x7f3d70156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6f200640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d700aa6a0 0x7f3d70156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6f200640 1 -- 172.21.15.114:0/3554807602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d700714c0 msgr2=0x7f3d700c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6f200640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d700714c0 0x7f3d700c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6f200640 1 -- 172.21.15.114:0/3554807602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60009b30 con 0x7f3d70150300 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d6f200640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d70150300 0x7f3d70156c70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009e90 tx=0x7f3d6800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d66a00640 1 -- 172.21.15.114:0/3554807602 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68007830 con 0x7f3d70150300 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d66a00640 1 -- 172.21.15.114:0/3554807602 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d68007990 con 0x7f3d70150300 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d66a00640 1 -- 172.21.15.114:0/3554807602 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68007d20 con 0x7f3d70150300 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.147+0000 7f3d75400640 1 -- 172.21.15.114:0/3554807602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d701e85e0 con 0x7f3d70150300 2024-02-17T12:16:43.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.151+0000 7f3d75400640 1 -- 172.21.15.114:0/3554807602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d701e8ba0 con 0x7f3d70150300 2024-02-17T12:16:43.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.151+0000 7f3d75400640 1 -- 172.21.15.114:0/3554807602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d701e8dc0 con 0x7f3d70150300 2024-02-17T12:16:43.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.151+0000 7f3d66a00640 1 -- 172.21.15.114:0/3554807602 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3d68009070 con 0x7f3d70150300 2024-02-17T12:16:43.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.151+0000 7f3d66a00640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d4c066e70 0x7f3d4c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.151+0000 7f3d66a00640 1 -- 172.21.15.114:0/3554807602 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d68086940 con 0x7f3d70150300 2024-02-17T12:16:43.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.151+0000 7f3d6e800640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d4c066e70 0x7f3d4c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.151+0000 7f3d6e800640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d4c066e70 0x7f3d4c069330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d580079c0 tx=0x7f3d58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:43.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.155+0000 7f3d66a00640 1 -- 172.21.15.114:0/3554807602 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3d68053740 con 0x7f3d70150300 2024-02-17T12:16:43.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.311+0000 7f3d75400640 1 -- 172.21.15.114:0/3554807602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d70074840 con 0x7f3d70150300 2024-02-17T12:16:43.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d66a00640 1 -- 172.21.15.114:0/3554807602 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f3d68019070 con 0x7f3d70150300 2024-02-17T12:16:43.319 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:43.319 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:43.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 -- 172.21.15.114:0/3554807602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d4c066e70 msgr2=0x7f3d4c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d4c066e70 0x7f3d4c069330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d580079c0 tx=0x7f3d58008040 comp rx=0 tx=0).stop 2024-02-17T12:16:43.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 -- 172.21.15.114:0/3554807602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d70150300 msgr2=0x7f3d70156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d70150300 0x7f3d70156c70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009e90 tx=0x7f3d6800c430 comp rx=0 tx=0).stop 2024-02-17T12:16:43.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 -- 172.21.15.114:0/3554807602 shutdown_connections 2024-02-17T12:16:43.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d4c066e70 0x7f3d4c069330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d70150300 0x7f3d70156c70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d700aa6a0 0x7f3d70156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 --2- 172.21.15.114:0/3554807602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d700714c0 0x7f3d700c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 -- 172.21.15.114:0/3554807602 >> 172.21.15.114:0/3554807602 conn(0x7f3d700c4f20 msgr2=0x7f3d700c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:43.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 -- 172.21.15.114:0/3554807602 shutdown_connections 2024-02-17T12:16:43.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.315+0000 7f3d75400640 1 -- 172.21.15.114:0/3554807602 wait complete. 2024-02-17T12:16:43.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:16:21.236908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:16:21.659009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:43.340 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:43.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c41e00640 1 Processor -- start 2024-02-17T12:16:43.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c41e00640 1 -- start start 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c41e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c152c50 0x7f8c3c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c41e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c156270 con 0x7f8c3c06db50 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c41e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c156550 con 0x7f8c3c0c25a0 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c41e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c06f090 con 0x7f8c3c152c50 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3a000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8c3c06db50 0x7f8c3c14ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44170/0 (socket says 172.21.15.114:44170) 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3a000640 1 -- 172.21.15.114:0/3898849556 learned_addr learned my addr 172.21.15.114:0/3898849556 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3b400640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c152c50 0x7f8c3c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136700390 0 0) 0x7f8c3c156270 con 0x7f8c3c06db50 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c20003530 con 0x7f8c3c06db50 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399424970 0 0) 0x7f8c3c156550 con 0x7f8c3c0c25a0 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c3c156270 con 0x7f8c3c0c25a0 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1571641769 0 0) 0x7f8c20003530 con 0x7f8c3c06db50 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c152c50 msgr2=0x7f8c3c1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:43.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c152c50 0x7f8c3c1530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 >> v1:172.21.15.116:6789/0 conn(0x7f8c3c0c25a0 legacy=0x7f8c3c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c156830 con 0x7f8c3c06db50 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f8c280016a0 con 0x7f8c3c06db50 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 >> v1:172.21.15.114:6789/0 conn(0x7f8c3c06db50 legacy=0x7f8c3c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c20003b40 0x7f8c20003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 0x7f8c20004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c152c50 0x7f8c20005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c06f090 con 0x7f8c200047d0 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2000bb50 con 0x7f8c20003b40 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2000bd10 con 0x7f8c3c152c50 2024-02-17T12:16:43.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3a000640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 0x7f8c20004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3aa00640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c20003b40 0x7f8c20003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3b400640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c152c50 0x7f8c20005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3a000640 1 -- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c152c50 msgr2=0x7f8c20005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:43.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3a000640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c152c50 0x7f8c20005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3a000640 1 -- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c20003b40 msgr2=0x7f8c20003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:43.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3a000640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c20003b40 0x7f8c20003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.475+0000 7f8c3a000640 1 -- 172.21.15.114:0/3898849556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20003530 con 0x7f8c200047d0 2024-02-17T12:16:43.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c3a000640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 0x7f8c20004c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c160 tx=0x7f8c2801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7903feae06b8b01 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:43.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280058e0 con 0x7f8c200047d0 2024-02-17T12:16:43.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28005a40 con 0x7f8c200047d0 2024-02-17T12:16:43.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c39600640 1 -- 172.21.15.114:0/3898849556 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28005df0 con 0x7f8c200047d0 2024-02-17T12:16:43.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c41e00640 1 -- 172.21.15.114:0/3898849556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 msgr2=0x7f8c20004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c41e00640 1 --2- 172.21.15.114:0/3898849556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 0x7f8c20004c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c160 tx=0x7f8c2801cb80 comp rx=0 tx=0).stop 2024-02-17T12:16:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c3b400640 1 -- 172.21.15.114:0/3898849556 reap_dead start 2024-02-17T12:16:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c41e00640 1 -- 172.21.15.114:0/3898849556 shutdown_connections 2024-02-17T12:16:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c41e00640 1 -- 172.21.15.114:0/3898849556 >> 172.21.15.114:0/3898849556 conn(0x7f8c3c0a8490 msgr2=0x7f8c3c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c41e00640 1 -- 172.21.15.114:0/3898849556 shutdown_connections 2024-02-17T12:16:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.479+0000 7f8c41e00640 1 -- 172.21.15.114:0/3898849556 wait complete. 2024-02-17T12:16:43.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c41e00640 1 Processor -- start 2024-02-17T12:16:43.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c41e00640 1 -- start start 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c41e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 0x7f8c3c1434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c41e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c145170 0x7f8c3c14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c41e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c3c13d960 0x7f8c3c14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c41e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c145760 con 0x7f8c200047d0 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c41e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0c4ee0 con 0x7f8c3c13d960 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c41e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0c56b0 con 0x7f8c3c145170 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 0x7f8c3c1434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 0x7f8c3c1434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43518/0 (socket says 172.21.15.114:43518) 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3aa00640 1 -- 172.21.15.114:0/1898543864 learned_addr learned my addr 172.21.15.114:0/1898543864 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3a000640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c145170 0x7f8c3c14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3b400640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c3c13d960 0x7f8c3c14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3aa00640 1 -- 172.21.15.114:0/1898543864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c145170 msgr2=0x7f8c3c14ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3aa00640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c145170 0x7f8c3c14ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3aa00640 1 -- 172.21.15.114:0/1898543864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c3c13d960 msgr2=0x7f8c3c14f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3aa00640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c3c13d960 0x7f8c3c14f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3aa00640 1 -- 172.21.15.114:0/1898543864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0c4390 con 0x7f8c200047d0 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c3aa00640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 0x7f8c3c1434f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00f770 tx=0x7f8c2c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c33400640 1 -- 172.21.15.114:0/1898543864 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c005110 con 0x7f8c200047d0 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c33400640 1 -- 172.21.15.114:0/1898543864 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c005270 con 0x7f8c200047d0 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c41e00640 1 -- 172.21.15.114:0/1898543864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c1ef5f0 con 0x7f8c200047d0 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c33400640 1 -- 172.21.15.114:0/1898543864 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0067e0 con 0x7f8c200047d0 2024-02-17T12:16:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.483+0000 7f8c41e00640 1 -- 172.21.15.114:0/1898543864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c0c53d0 con 0x7f8c200047d0 2024-02-17T12:16:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.487+0000 7f8c41e00640 1 -- 172.21.15.114:0/1898543864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c074840 con 0x7f8c200047d0 2024-02-17T12:16:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.487+0000 7f8c33400640 1 -- 172.21.15.114:0/1898543864 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8c2c006940 con 0x7f8c200047d0 2024-02-17T12:16:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.487+0000 7f8c33400640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c1c066e70 0x7f8c1c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.487+0000 7f8c33400640 1 -- 172.21.15.114:0/1898543864 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c2c0842e0 con 0x7f8c200047d0 2024-02-17T12:16:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.487+0000 7f8c3a000640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c1c066e70 0x7f8c1c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.487+0000 7f8c3a000640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c1c066e70 0x7f8c1c069330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8c280aa000 tx=0x7f8c280019b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:43.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.491+0000 7f8c33400640 1 -- 172.21.15.114:0/1898543864 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8c2c051170 con 0x7f8c200047d0 2024-02-17T12:16:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.643+0000 7f8c41e00640 1 -- 172.21.15.114:0/1898543864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8c3c0c3050 con 0x7f8c200047d0 2024-02-17T12:16:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c33400640 1 -- 172.21.15.114:0/1898543864 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8c2c054830 con 0x7f8c200047d0 2024-02-17T12:16:43.651 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:43.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 -- 172.21.15.114:0/1898543864 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c1c066e70 msgr2=0x7f8c1c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c1c066e70 0x7f8c1c069330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8c280aa000 tx=0x7f8c280019b0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 -- 172.21.15.114:0/1898543864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 msgr2=0x7f8c3c1434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 0x7f8c3c1434f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00f770 tx=0x7f8c2c00fc30 comp rx=0 tx=0).stop 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 -- 172.21.15.114:0/1898543864 shutdown_connections 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c3c13d960 0x7f8c3c14f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c3c145170 0x7f8c3c14ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c1c066e70 0x7f8c1c069330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 --2- 172.21.15.114:0/1898543864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c200047d0 0x7f8c3c1434f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 -- 172.21.15.114:0/1898543864 >> 172.21.15.114:0/1898543864 conn(0x7f8c3c0a8490 msgr2=0x7f8c3c1486d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 -- 172.21.15.114:0/1898543864 shutdown_connections 2024-02-17T12:16:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.647+0000 7f8c41e00640 1 -- 172.21.15.114:0/1898543864 wait complete. 2024-02-17T12:16:43.671 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:16:43.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.803+0000 7f1d73c00640 1 Processor -- start 2024-02-17T12:16:43.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.803+0000 7f1d73c00640 1 -- start start 2024-02-17T12:16:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d73c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 0x7f1d6c0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d73c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1d6c0c1eb0 0x7f1d6c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d73c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6c0a9420 con 0x7f1d6c14f110 2024-02-17T12:16:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d73c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6c14f4f0 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d73c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0aae80 con 0x7f1d6c0c2580 2024-02-17T12:16:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d71200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1d6c14f110 0x7f1d6c0c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44178/0 (socket says 172.21.15.114:44178) 2024-02-17T12:16:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d71200640 1 -- 172.21.15.114:0/1906813137 learned_addr learned my addr 172.21.15.114:0/1906813137 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d6be00640 1 --2- 172.21.15.114:0/1906813137 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 0x7f1d6c0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d71c00640 1 --2- 172.21.15.114:0/1906813137 >> v2:172.21.15.116:3300/0 conn(0x7f1d6c0c1eb0 0x7f1d6c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d6b400640 1 -- 172.21.15.114:0/1906813137 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153675786 0 0) 0x7f1d6c0a9420 con 0x7f1d6c14f110 2024-02-17T12:16:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d6b400640 1 -- 172.21.15.114:0/1906813137 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d50003530 con 0x7f1d6c14f110 2024-02-17T12:16:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d6be00640 1 -- 172.21.15.114:0/1906813137 >> v2:172.21.15.116:3300/0 conn(0x7f1d6c0c1eb0 msgr2=0x7f1d6c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d6be00640 1 --2- 172.21.15.114:0/1906813137 >> v2:172.21.15.116:3300/0 conn(0x7f1d6c0c1eb0 0x7f1d6c15c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d6be00640 1 -- 172.21.15.114:0/1906813137 >> v1:172.21.15.114:6789/0 conn(0x7f1d6c14f110 legacy=0x7f1d6c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d6b400640 1 -- 172.21.15.114:0/1906813137 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2303369728 0 0) 0x7f1d50003530 con 0x7f1d6c14f110 2024-02-17T12:16:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d6be00640 1 -- 172.21.15.114:0/1906813137 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c152850 con 0x7f1d6c0c2580 2024-02-17T12:16:43.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.807+0000 7f1d71c00640 1 --2- 172.21.15.114:0/1906813137 >> v2:172.21.15.116:3300/0 conn(0x7f1d6c0c1eb0 0x7f1d6c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:43.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d6be00640 1 --2- 172.21.15.114:0/1906813137 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 0x7f1d6c0aa150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d580097c0 tx=0x7f1d5801c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed607ffcff673bc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:43.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d6b400640 1 -- 172.21.15.114:0/1906813137 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c001680 con 0x7f1d6c0c2580 2024-02-17T12:16:43.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d6b400640 1 -- 172.21.15.114:0/1906813137 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d580a7050 con 0x7f1d6c0c2580 2024-02-17T12:16:43.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d6b400640 1 -- 172.21.15.114:0/1906813137 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d580ab620 con 0x7f1d6c0c2580 2024-02-17T12:16:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d73c00640 1 -- 172.21.15.114:0/1906813137 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 msgr2=0x7f1d6c0aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d73c00640 1 --2- 172.21.15.114:0/1906813137 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 0x7f1d6c0aa150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d580097c0 tx=0x7f1d5801c300 comp rx=0 tx=0).stop 2024-02-17T12:16:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d73c00640 1 -- 172.21.15.114:0/1906813137 shutdown_connections 2024-02-17T12:16:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d73c00640 1 --2- 172.21.15.114:0/1906813137 >> v2:172.21.15.116:3300/0 conn(0x7f1d6c0c1eb0 0x7f1d6c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d73c00640 1 --2- 172.21.15.114:0/1906813137 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 0x7f1d6c0aa150 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d73c00640 1 -- 172.21.15.114:0/1906813137 >> 172.21.15.114:0/1906813137 conn(0x7f1d6c0a8490 msgr2=0x7f1d6c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d73c00640 1 -- 172.21.15.114:0/1906813137 shutdown_connections 2024-02-17T12:16:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d73c00640 1 -- 172.21.15.114:0/1906813137 wait complete. 2024-02-17T12:16:43.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d73c00640 1 Processor -- start 2024-02-17T12:16:43.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.811+0000 7f1d73c00640 1 -- start start 2024-02-17T12:16:43.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d73c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d6c0c1eb0 0x7f1d6c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d73c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 0x7f1d6c1429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d73c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d6c14f110 0x7f1d6c142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d73c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c1ee3a0 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d73c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c1ed4d0 con 0x7f1d6c14f110 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d73c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c1ed790 con 0x7f1d6c0c2580 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d6c0c1eb0 0x7f1d6c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d6c0c1eb0 0x7f1d6c071960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43528/0 (socket says 172.21.15.114:43528) 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71200640 1 -- 172.21.15.114:0/4135490538 learned_addr learned my addr 172.21.15.114:0/4135490538 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71c00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d6c14f110 0x7f1d6c142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d6be00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 0x7f1d6c1429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71200640 1 -- 172.21.15.114:0/4135490538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 msgr2=0x7f1d6c1429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71200640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 0x7f1d6c1429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71200640 1 -- 172.21.15.114:0/4135490538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d6c14f110 msgr2=0x7f1d6c142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71200640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d6c14f110 0x7f1d6c142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71200640 1 -- 172.21.15.114:0/4135490538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d64009a70 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71c00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d6c14f110 0x7f1d6c142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d71200640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d6c0c1eb0 0x7f1d6c071960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00c750 tx=0x7f1d5c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d68c00640 1 -- 172.21.15.114:0/4135490538 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c005ae0 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d68c00640 1 -- 172.21.15.114:0/4135490538 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c005c40 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d73c00640 1 -- 172.21.15.114:0/4135490538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d58009420 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d68c00640 1 -- 172.21.15.114:0/4135490538 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c007070 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d73c00640 1 -- 172.21.15.114:0/4135490538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c1edd50 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d73c00640 1 -- 172.21.15.114:0/4135490538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6c074840 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.815+0000 7f1d68c00640 1 -- 172.21.15.114:0/4135490538 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1d5c0071d0 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.819+0000 7f1d68c00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1d4c066e40 0x7f1d4c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:43.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.819+0000 7f1d68c00640 1 -- 172.21.15.114:0/4135490538 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d5c084870 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.819+0000 7f1d6be00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1d4c066e40 0x7f1d4c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:43.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.819+0000 7f1d6be00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1d4c066e40 0x7f1d4c069300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d580ad000 tx=0x7f1d58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:43.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.823+0000 7f1d68c00640 1 -- 172.21.15.114:0/4135490538 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1d5c051650 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 -- 172.21.15.114:0/4135490538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d6c143510 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d68c00640 1 -- 172.21.15.114:0/4135490538 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d5c054d10 con 0x7f1d6c0c1eb0 2024-02-17T12:16:43.979 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:16:43.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 -- 172.21.15.114:0/4135490538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1d4c066e40 msgr2=0x7f1d4c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1d4c066e40 0x7f1d4c069300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d580ad000 tx=0x7f1d58008040 comp rx=0 tx=0).stop 2024-02-17T12:16:43.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 -- 172.21.15.114:0/4135490538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d6c0c1eb0 msgr2=0x7f1d6c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:43.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d6c0c1eb0 0x7f1d6c071960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00c750 tx=0x7f1d5c00cc10 comp rx=0 tx=0).stop 2024-02-17T12:16:43.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 -- 172.21.15.114:0/4135490538 shutdown_connections 2024-02-17T12:16:43.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d6c14f110 0x7f1d6c142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d6c0c2580 0x7f1d6c1429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1d4c066e40 0x7f1d4c069300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 --2- 172.21.15.114:0/4135490538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d6c0c1eb0 0x7f1d6c071960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:43.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 -- 172.21.15.114:0/4135490538 >> 172.21.15.114:0/4135490538 conn(0x7f1d6c0a8490 msgr2=0x7f1d6c0c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:43.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 -- 172.21.15.114:0/4135490538 shutdown_connections 2024-02-17T12:16:43.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:43.975+0000 7f1d73c00640 1 -- 172.21.15.114:0/4135490538 wait complete. 2024-02-17T12:16:44.000 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:16:44.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.131+0000 7f036b200640 1 Processor -- start 2024-02-17T12:16:44.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.131+0000 7f036b200640 1 -- start start 2024-02-17T12:16:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.131+0000 7f036b200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f036414b330 0x7f03640719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f036b200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 0x7f03641519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f036b200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0364155100 con 0x7f0364071500 2024-02-17T12:16:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f036b200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03640712c0 con 0x7f036414b330 2024-02-17T12:16:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f036b200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0364070c00 con 0x7f03640c1f30 2024-02-17T12:16:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f036a800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 0x7f03641519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f0369e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f036414b330 0x7f03640719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f0369e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f036414b330 0x7f03640719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:44134/0 (socket says 172.21.15.114:44134) 2024-02-17T12:16:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f0369e00640 1 -- 172.21.15.114:0/2031877521 learned_addr learned my addr 172.21.15.114:0/2031877521 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f0369400640 1 --1- 172.21.15.114:0/2031877521 >> v1:172.21.15.116:6789/0 conn(0x7f0364071500 0x7f03641512c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:35452/0 (socket says 172.21.15.114:35452) 2024-02-17T12:16:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f036a800640 1 -- 172.21.15.114:0/2031877521 >> v2:172.21.15.116:3300/0 conn(0x7f036414b330 msgr2=0x7f03640719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f036a800640 1 --2- 172.21.15.114:0/2031877521 >> v2:172.21.15.116:3300/0 conn(0x7f036414b330 0x7f03640719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f036a800640 1 -- 172.21.15.114:0/2031877521 >> v1:172.21.15.116:6789/0 conn(0x7f0364071500 legacy=0x7f03641512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f036a800640 1 -- 172.21.15.114:0/2031877521 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0364070ee0 con 0x7f03640c1f30 2024-02-17T12:16:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f0369e00640 1 --2- 172.21.15.114:0/2031877521 >> v2:172.21.15.116:3300/0 conn(0x7f036414b330 0x7f03640719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:44.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.135+0000 7f0368a00640 1 -- 172.21.15.114:0/2031877521 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184814173 0 0) 0x7f0364155100 con 0x7f0364071500 2024-02-17T12:16:44.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036a800640 1 --2- 172.21.15.114:0/2031877521 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 0x7f03641519d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0360009d90 tx=0x7f036001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ab1253d1d450260 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:44.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f0368a00640 1 -- 172.21.15.114:0/2031877521 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600a66e0 con 0x7f03640c1f30 2024-02-17T12:16:44.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f0368a00640 1 -- 172.21.15.114:0/2031877521 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03600a6840 con 0x7f03640c1f30 2024-02-17T12:16:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f0368a00640 1 -- 172.21.15.114:0/2031877521 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03600a6bd0 con 0x7f03640c1f30 2024-02-17T12:16:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 -- 172.21.15.114:0/2031877521 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 msgr2=0x7f03641519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 --2- 172.21.15.114:0/2031877521 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 0x7f03641519d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0360009d90 tx=0x7f036001c850 comp rx=0 tx=0).stop 2024-02-17T12:16:44.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 -- 172.21.15.114:0/2031877521 shutdown_connections 2024-02-17T12:16:44.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 --2- 172.21.15.114:0/2031877521 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 0x7f03641519d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 --2- 172.21.15.114:0/2031877521 >> v2:172.21.15.116:3300/0 conn(0x7f036414b330 0x7f03640719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 -- 172.21.15.114:0/2031877521 >> 172.21.15.114:0/2031877521 conn(0x7f03640c6300 msgr2=0x7f03640c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:44.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 -- 172.21.15.114:0/2031877521 shutdown_connections 2024-02-17T12:16:44.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 -- 172.21.15.114:0/2031877521 wait complete. 2024-02-17T12:16:44.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 Processor -- start 2024-02-17T12:16:44.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 -- start start 2024-02-17T12:16:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0364071500 0x7f0364141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 0x7f03641ebe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f036414b330 0x7f0364143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03641397d0 con 0x7f0364071500 2024-02-17T12:16:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03641ec390 con 0x7f036414b330 2024-02-17T12:16:44.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036b200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03641eb380 con 0x7f03640c1f30 2024-02-17T12:16:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f0369e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0364071500 0x7f0364141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f0369e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0364071500 0x7f0364141340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43544/0 (socket says 172.21.15.114:43544) 2024-02-17T12:16:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f0369e00640 1 -- 172.21.15.114:0/3541703970 learned_addr learned my addr 172.21.15.114:0/3541703970 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f036a800640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f036414b330 0x7f0364143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.139+0000 7f0369400640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 0x7f03641ebe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f0369e00640 1 -- 172.21.15.114:0/3541703970 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 msgr2=0x7f03641ebe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f0369e00640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 0x7f03641ebe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f0369e00640 1 -- 172.21.15.114:0/3541703970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f036414b330 msgr2=0x7f0364143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f0369e00640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f036414b330 0x7f0364143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f0369e00640 1 -- 172.21.15.114:0/3541703970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500094d0 con 0x7f0364071500 2024-02-17T12:16:44.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f0369e00640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0364071500 0x7f0364141340 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f035000e9d0 tx=0x7f035000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:44.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f035e000640 1 -- 172.21.15.114:0/3541703970 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035000ca60 con 0x7f0364071500 2024-02-17T12:16:44.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f035e000640 1 -- 172.21.15.114:0/3541703970 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035000cbc0 con 0x7f0364071500 2024-02-17T12:16:44.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f035e000640 1 -- 172.21.15.114:0/3541703970 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350013470 con 0x7f0364071500 2024-02-17T12:16:44.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f036b200640 1 -- 172.21.15.114:0/3541703970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0360009a70 con 0x7f0364071500 2024-02-17T12:16:44.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f036b200640 1 -- 172.21.15.114:0/3541703970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03640ab930 con 0x7f0364071500 2024-02-17T12:16:44.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f036b200640 1 -- 172.21.15.114:0/3541703970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036404eef0 con 0x7f0364071500 2024-02-17T12:16:44.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f035e000640 1 -- 172.21.15.114:0/3541703970 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f03500135d0 con 0x7f0364071500 2024-02-17T12:16:44.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.143+0000 7f035e000640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0344066e40 0x7f0344069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.147+0000 7f035e000640 1 -- 172.21.15.114:0/3541703970 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0350084cf0 con 0x7f0364071500 2024-02-17T12:16:44.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.147+0000 7f0369400640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0344066e40 0x7f0344069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.147+0000 7f0369400640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0344066e40 0x7f0344069300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0364151e90 tx=0x7f0358007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:44.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.151+0000 7f035e000640 1 -- 172.21.15.114:0/3541703970 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0350051b80 con 0x7f0364071500 2024-02-17T12:16:44.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.303+0000 7f036b200640 1 -- 172.21.15.114:0/3541703970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f036415b730 con 0x7f0364071500 2024-02-17T12:16:44.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.303+0000 7f035e000640 1 -- 172.21.15.114:0/3541703970 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03500170a0 con 0x7f0364071500 2024-02-17T12:16:44.310 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 -- 172.21.15.114:0/3541703970 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0344066e40 msgr2=0x7f0344069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0344066e40 0x7f0344069300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0364151e90 tx=0x7f0358007df0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 -- 172.21.15.114:0/3541703970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0364071500 msgr2=0x7f0364141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0364071500 0x7f0364141340 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f035000e9d0 tx=0x7f035000ee90 comp rx=0 tx=0).stop 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 -- 172.21.15.114:0/3541703970 shutdown_connections 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f036414b330 0x7f0364143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03640c1f30 0x7f03641ebe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0344066e40 0x7f0344069300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 --2- 172.21.15.114:0/3541703970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0364071500 0x7f0364141340 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 -- 172.21.15.114:0/3541703970 >> 172.21.15.114:0/3541703970 conn(0x7f03640c6300 msgr2=0x7f036406e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:44.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 -- 172.21.15.114:0/3541703970 shutdown_connections 2024-02-17T12:16:44.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.307+0000 7f036b200640 1 -- 172.21.15.114:0/3541703970 wait complete. 2024-02-17T12:16:44.331 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.459+0000 7f7495000640 1 Processor -- start 2024-02-17T12:16:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.459+0000 7f7495000640 1 -- start start 2024-02-17T12:16:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f7495000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f74900c58b0 0x7f74901583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f7495000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f74900c4b30 0x7f749006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f7495000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f749006c160 0x7f7490155520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f7495000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74900c6110 con 0x7f74900c58b0 2024-02-17T12:16:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f7495000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7490155090 con 0x7f74900c4b30 2024-02-17T12:16:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f7495000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7490159300 con 0x7f749006c160 2024-02-17T12:16:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f74900c58b0 0x7f74901583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f74900c58b0 0x7f74901583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43546/0 (socket says 172.21.15.114:43546) 2024-02-17T12:16:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748de00640 1 -- 172.21.15.114:0/4192493954 learned_addr learned my addr 172.21.15.114:0/4192493954 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:44.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748d400640 1 --2- 172.21.15.114:0/4192493954 >> v2:172.21.15.116:3300/0 conn(0x7f74900c4b30 0x7f749006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748e800640 1 --2- 172.21.15.114:0/4192493954 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f749006c160 0x7f7490155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748de00640 1 -- 172.21.15.114:0/4192493954 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f749006c160 msgr2=0x7f7490155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:44.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748de00640 1 --2- 172.21.15.114:0/4192493954 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f749006c160 0x7f7490155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748de00640 1 -- 172.21.15.114:0/4192493954 >> v2:172.21.15.116:3300/0 conn(0x7f74900c4b30 msgr2=0x7f749006bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:44.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748de00640 1 --2- 172.21.15.114:0/4192493954 >> v2:172.21.15.116:3300/0 conn(0x7f74900c4b30 0x7f749006bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748de00640 1 -- 172.21.15.114:0/4192493954 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7490158a60 con 0x7f74900c58b0 2024-02-17T12:16:44.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.463+0000 7f748de00640 1 --2- 172.21.15.114:0/4192493954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 0x7f74901583d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f74900acf20 tx=0x7f748001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b19b9019f1cf509 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748ca00640 1 -- 172.21.15.114:0/4192493954 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800a5840 con 0x7f74900c58b0 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748ca00640 1 -- 172.21.15.114:0/4192493954 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74800a59a0 con 0x7f74900c58b0 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748ca00640 1 -- 172.21.15.114:0/4192493954 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800a5d30 con 0x7f74900c58b0 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 -- 172.21.15.114:0/4192493954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 msgr2=0x7f74901583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 --2- 172.21.15.114:0/4192493954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 0x7f74901583d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f74900acf20 tx=0x7f748001c9c0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 -- 172.21.15.114:0/4192493954 shutdown_connections 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 --2- 172.21.15.114:0/4192493954 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f749006c160 0x7f7490155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 --2- 172.21.15.114:0/4192493954 >> v2:172.21.15.116:3300/0 conn(0x7f74900c4b30 0x7f749006bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 --2- 172.21.15.114:0/4192493954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 0x7f74901583d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 -- 172.21.15.114:0/4192493954 >> 172.21.15.114:0/4192493954 conn(0x7f74900c3730 msgr2=0x7f74900c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 -- 172.21.15.114:0/4192493954 shutdown_connections 2024-02-17T12:16:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 -- 172.21.15.114:0/4192493954 wait complete. 2024-02-17T12:16:44.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 Processor -- start 2024-02-17T12:16:44.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 -- start start 2024-02-17T12:16:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f749006c160 0x7f74900aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74900c4b30 0x7f74900aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 0x7f74901f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74900ac180 con 0x7f74900c58b0 2024-02-17T12:16:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74900abbc0 con 0x7f74900c4b30 2024-02-17T12:16:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f7495000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74900abea0 con 0x7f749006c160 2024-02-17T12:16:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 0x7f74901f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 0x7f74901f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43548/0 (socket says 172.21.15.114:43548) 2024-02-17T12:16:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748e800640 1 -- 172.21.15.114:0/3963470883 learned_addr learned my addr 172.21.15.114:0/3963470883 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748de00640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f749006c160 0x7f74900aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748d400640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74900c4b30 0x7f74900aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748e800640 1 -- 172.21.15.114:0/3963470883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f749006c160 msgr2=0x7f74900aaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748e800640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f749006c160 0x7f74900aaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748e800640 1 -- 172.21.15.114:0/3963470883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74900c4b30 msgr2=0x7f74900aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748e800640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74900c4b30 0x7f74900aafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748e800640 1 -- 172.21.15.114:0/3963470883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7480009b30 con 0x7f74900c58b0 2024-02-17T12:16:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.467+0000 7f748d400640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74900c4b30 0x7f74900aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.471+0000 7f748e800640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 0x7f74901f0df0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f748800d800 tx=0x7f748800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.471+0000 7f7486000640 1 -- 172.21.15.114:0/3963470883 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74880096c0 con 0x7f74900c58b0 2024-02-17T12:16:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.471+0000 7f7486000640 1 -- 172.21.15.114:0/3963470883 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7488009820 con 0x7f74900c58b0 2024-02-17T12:16:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.471+0000 7f7495000640 1 -- 172.21.15.114:0/3963470883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74900aa580 con 0x7f74900c58b0 2024-02-17T12:16:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.471+0000 7f7486000640 1 -- 172.21.15.114:0/3963470883 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488009bd0 con 0x7f74900c58b0 2024-02-17T12:16:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.471+0000 7f7495000640 1 -- 172.21.15.114:0/3963470883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74901f1a50 con 0x7f74900c58b0 2024-02-17T12:16:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.471+0000 7f7495000640 1 -- 172.21.15.114:0/3963470883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7490067170 con 0x7f74900c58b0 2024-02-17T12:16:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.471+0000 7f7486000640 1 -- 172.21.15.114:0/3963470883 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f7488009d30 con 0x7f74900c58b0 2024-02-17T12:16:44.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.471+0000 7f7486000640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7470066e70 0x7f7470069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.475+0000 7f7486000640 1 -- 172.21.15.114:0/3963470883 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7488085010 con 0x7f74900c58b0 2024-02-17T12:16:44.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.475+0000 7f748de00640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7470066e70 0x7f7470069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.475+0000 7f748de00640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7470066e70 0x7f7470069330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f74800ae000 tx=0x7f74800a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:44.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.479+0000 7f7486000640 1 -- 172.21.15.114:0/3963470883 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7488051e90 con 0x7f74900c58b0 2024-02-17T12:16:44.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.631+0000 7f7495000640 1 -- 172.21.15.114:0/3963470883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74900aa7c0 con 0x7f74900c58b0 2024-02-17T12:16:44.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7486000640 1 -- 172.21.15.114:0/3963470883 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f7488082100 con 0x7f74900c58b0 2024-02-17T12:16:44.639 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:44.639 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:44.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 -- 172.21.15.114:0/3963470883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7470066e70 msgr2=0x7f7470069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7470066e70 0x7f7470069330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f74800ae000 tx=0x7f74800a7070 comp rx=0 tx=0).stop 2024-02-17T12:16:44.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 -- 172.21.15.114:0/3963470883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 msgr2=0x7f74901f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 0x7f74901f0df0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f748800d800 tx=0x7f748800dcc0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 -- 172.21.15.114:0/3963470883 shutdown_connections 2024-02-17T12:16:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7470066e70 0x7f7470069330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74900c58b0 0x7f74901f0df0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74900c4b30 0x7f74900aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 --2- 172.21.15.114:0/3963470883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f749006c160 0x7f74900aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 -- 172.21.15.114:0/3963470883 >> 172.21.15.114:0/3963470883 conn(0x7f74900c3730 msgr2=0x7f749015e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 -- 172.21.15.114:0/3963470883 shutdown_connections 2024-02-17T12:16:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.635+0000 7f7495000640 1 -- 172.21.15.114:0/3963470883 wait complete. 2024-02-17T12:16:44.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:16:21.236908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:16:21.659009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:44.660 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:44.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f0926400640 1 Processor -- start 2024-02-17T12:16:44.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f0926400640 1 -- start start 2024-02-17T12:16:44.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f0926400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f09200c25a0 0x7f092006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f0926400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f092006db50 0x7f092014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f0926400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0920156270 con 0x7f0920150490 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f0926400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0920071630 con 0x7f092006db50 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f0926400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0920156550 con 0x7f09200c25a0 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f091ea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f092006db50 0x7f092014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f091fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0920150490 0x7f0920152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44180/0 (socket says 172.21.15.114:44180) 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f091ea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f092006db50 0x7f092014ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43562/0 (socket says 172.21.15.114:43562) 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f091fe00640 1 -- 172.21.15.114:0/138798116 learned_addr learned my addr 172.21.15.114:0/138798116 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f091f400640 1 --2- 172.21.15.114:0/138798116 >> v2:172.21.15.116:3300/0 conn(0x7f09200c25a0 0x7f092006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f091ea00640 1 -- 172.21.15.114:0/138798116 >> v2:172.21.15.116:3300/0 conn(0x7f09200c25a0 msgr2=0x7f092006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f091ea00640 1 --2- 172.21.15.114:0/138798116 >> v2:172.21.15.116:3300/0 conn(0x7f09200c25a0 0x7f092006e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f091ea00640 1 -- 172.21.15.114:0/138798116 >> v1:172.21.15.114:6789/0 conn(0x7f0920150490 legacy=0x7f0920152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f091ea00640 1 -- 172.21.15.114:0/138798116 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0920156830 con 0x7f092006db50 2024-02-17T12:16:44.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.795+0000 7f091e000640 1 -- 172.21.15.114:0/138798116 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085010331 0 0) 0x7f0920156270 con 0x7f0920150490 2024-02-17T12:16:44.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f091ea00640 1 --2- 172.21.15.114:0/138798116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 0x7f092014ff50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f09200ab930 tx=0x7f090c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce449ae13b194c1b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:44.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f091e000640 1 -- 172.21.15.114:0/138798116 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ab400 con 0x7f092006db50 2024-02-17T12:16:44.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f091e000640 1 -- 172.21.15.114:0/138798116 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0a7050 con 0x7f092006db50 2024-02-17T12:16:44.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f091e000640 1 -- 172.21.15.114:0/138798116 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ab780 con 0x7f092006db50 2024-02-17T12:16:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f0926400640 1 -- 172.21.15.114:0/138798116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 msgr2=0x7f092014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f0926400640 1 --2- 172.21.15.114:0/138798116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 0x7f092014ff50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f09200ab930 tx=0x7f090c01c360 comp rx=0 tx=0).stop 2024-02-17T12:16:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f0926400640 1 -- 172.21.15.114:0/138798116 shutdown_connections 2024-02-17T12:16:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f0926400640 1 --2- 172.21.15.114:0/138798116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 0x7f092014ff50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f0926400640 1 --2- 172.21.15.114:0/138798116 >> v2:172.21.15.116:3300/0 conn(0x7f09200c25a0 0x7f092006e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f0926400640 1 -- 172.21.15.114:0/138798116 >> 172.21.15.114:0/138798116 conn(0x7f09200a8490 msgr2=0x7f09200a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f0926400640 1 -- 172.21.15.114:0/138798116 shutdown_connections 2024-02-17T12:16:44.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f0926400640 1 -- 172.21.15.114:0/138798116 wait complete. 2024-02-17T12:16:44.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f0926400640 1 Processor -- start 2024-02-17T12:16:44.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.799+0000 7f0926400640 1 -- start start 2024-02-17T12:16:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0926400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 0x7f0920149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0926400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09200c25a0 0x7f09201ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0926400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0920150490 0x7f09201ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0926400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920144870 con 0x7f092006db50 2024-02-17T12:16:44.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0926400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920144b50 con 0x7f09200c25a0 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0926400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092014dbf0 con 0x7f0920150490 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 0x7f0920149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 0x7f0920149ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43566/0 (socket says 172.21.15.114:43566) 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091f400640 1 -- 172.21.15.114:0/1345638315 learned_addr learned my addr 172.21.15.114:0/1345638315 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091ea00640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09200c25a0 0x7f09201ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091fe00640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0920150490 0x7f09201ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091f400640 1 -- 172.21.15.114:0/1345638315 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0920150490 msgr2=0x7f09201ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091f400640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0920150490 0x7f09201ed810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091f400640 1 -- 172.21.15.114:0/1345638315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09200c25a0 msgr2=0x7f09201ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091f400640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09200c25a0 0x7f09201ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091f400640 1 -- 172.21.15.114:0/1345638315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c009420 con 0x7f092006db50 2024-02-17T12:16:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091ea00640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09200c25a0 0x7f09201ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091fe00640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0920150490 0x7f09201ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f091f400640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 0x7f0920149ae0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f091000d800 tx=0x7f091000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0917400640 1 -- 172.21.15.114:0/1345638315 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091000b6c0 con 0x7f092006db50 2024-02-17T12:16:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0917400640 1 -- 172.21.15.114:0/1345638315 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091000b820 con 0x7f092006db50 2024-02-17T12:16:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0917400640 1 -- 172.21.15.114:0/1345638315 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091000bb90 con 0x7f092006db50 2024-02-17T12:16:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0926400640 1 -- 172.21.15.114:0/1345638315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092014ded0 con 0x7f092006db50 2024-02-17T12:16:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0926400640 1 -- 172.21.15.114:0/1345638315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09200ab2b0 con 0x7f092006db50 2024-02-17T12:16:44.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0926400640 1 -- 172.21.15.114:0/1345638315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0920074840 con 0x7f092006db50 2024-02-17T12:16:44.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.803+0000 7f0917400640 1 -- 172.21.15.114:0/1345638315 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f091000bcf0 con 0x7f092006db50 2024-02-17T12:16:44.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.807+0000 7f0917400640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0900066e40 0x7f0900069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:44.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.807+0000 7f0917400640 1 -- 172.21.15.114:0/1345638315 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0910084fc0 con 0x7f092006db50 2024-02-17T12:16:44.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.807+0000 7f091ea00640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0900066e40 0x7f0900069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:44.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.807+0000 7f091ea00640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0900066e40 0x7f0900069300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f090c0ad000 tx=0x7f090c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:44.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.811+0000 7f0917400640 1 -- 172.21.15.114:0/1345638315 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0910051da0 con 0x7f092006db50 2024-02-17T12:16:44.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 -- 172.21.15.114:0/1345638315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f092014d7c0 con 0x7f092006db50 2024-02-17T12:16:44.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0917400640 1 -- 172.21.15.114:0/1345638315 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0910055460 con 0x7f092006db50 2024-02-17T12:16:44.971 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:44.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 -- 172.21.15.114:0/1345638315 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0900066e40 msgr2=0x7f0900069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0900066e40 0x7f0900069300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f090c0ad000 tx=0x7f090c008040 comp rx=0 tx=0).stop 2024-02-17T12:16:44.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 -- 172.21.15.114:0/1345638315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 msgr2=0x7f0920149ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:44.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 0x7f0920149ae0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f091000d800 tx=0x7f091000dcc0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 -- 172.21.15.114:0/1345638315 shutdown_connections 2024-02-17T12:16:44.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0920150490 0x7f09201ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f09200c25a0 0x7f09201ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0900066e40 0x7f0900069300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 --2- 172.21.15.114:0/1345638315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f092006db50 0x7f0920149ae0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:44.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 -- 172.21.15.114:0/1345638315 >> 172.21.15.114:0/1345638315 conn(0x7f09200a8490 msgr2=0x7f09200a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:44.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 -- 172.21.15.114:0/1345638315 shutdown_connections 2024-02-17T12:16:44.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:44.967+0000 7f0926400640 1 -- 172.21.15.114:0/1345638315 wait complete. 2024-02-17T12:16:44.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:16:45.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93ee600640 1 Processor -- start 2024-02-17T12:16:45.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93ee600640 1 -- start start 2024-02-17T12:16:45.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93ee600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93e80c25a0 0x7f93e806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93ee600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f93e806db50 0x7f93e814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93ee600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f93e8150490 0x7f93e8152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93ee600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e8071630 con 0x7f93e8150490 2024-02-17T12:16:45.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93ee600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e8156270 con 0x7f93e806db50 2024-02-17T12:16:45.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93ee600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8156550 con 0x7f93e80c25a0 2024-02-17T12:16:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93e7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f93e8150490 0x7f93e8152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93e7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f93e8150490 0x7f93e8152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43578/0 (socket says 172.21.15.114:43578) 2024-02-17T12:16:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93e7e00640 1 -- 172.21.15.114:0/220006867 learned_addr learned my addr 172.21.15.114:0/220006867 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93e6a00640 1 --2- 172.21.15.114:0/220006867 >> v2:172.21.15.116:3300/0 conn(0x7f93e806db50 0x7f93e814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.123+0000 7f93e7400640 1 --2- 172.21.15.114:0/220006867 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93e80c25a0 0x7f93e806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93e7e00640 1 -- 172.21.15.114:0/220006867 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93e80c25a0 msgr2=0x7f93e806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93e7e00640 1 --2- 172.21.15.114:0/220006867 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93e80c25a0 0x7f93e806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93e7e00640 1 -- 172.21.15.114:0/220006867 >> v2:172.21.15.116:3300/0 conn(0x7f93e806db50 msgr2=0x7f93e814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93e7e00640 1 --2- 172.21.15.114:0/220006867 >> v2:172.21.15.116:3300/0 conn(0x7f93e806db50 0x7f93e814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93e7e00640 1 -- 172.21.15.114:0/220006867 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e8156830 con 0x7f93e8150490 2024-02-17T12:16:45.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93e7e00640 1 --2- 172.21.15.114:0/220006867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e8150490 0x7f93e8152c50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f93e80a90d0 tx=0x7f93e001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a4fd46ef4f5309 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:45.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93e6000640 1 -- 172.21.15.114:0/220006867 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e81539a0 con 0x7f93e8150490 2024-02-17T12:16:45.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93e6000640 1 -- 172.21.15.114:0/220006867 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e00a5640 con 0x7f93e8150490 2024-02-17T12:16:45.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93e6000640 1 -- 172.21.15.114:0/220006867 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00a59d0 con 0x7f93e8150490 2024-02-17T12:16:45.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93ee600640 1 -- 172.21.15.114:0/220006867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e8150490 msgr2=0x7f93e8152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.127+0000 7f93ee600640 1 --2- 172.21.15.114:0/220006867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e8150490 0x7f93e8152c50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f93e80a90d0 tx=0x7f93e001c8a0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 -- 172.21.15.114:0/220006867 shutdown_connections 2024-02-17T12:16:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 --2- 172.21.15.114:0/220006867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e8150490 0x7f93e8152c50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 --2- 172.21.15.114:0/220006867 >> v2:172.21.15.116:3300/0 conn(0x7f93e806db50 0x7f93e814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 --2- 172.21.15.114:0/220006867 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93e80c25a0 0x7f93e806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 -- 172.21.15.114:0/220006867 >> 172.21.15.114:0/220006867 conn(0x7f93e80a8490 msgr2=0x7f93e80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 -- 172.21.15.114:0/220006867 shutdown_connections 2024-02-17T12:16:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 -- 172.21.15.114:0/220006867 wait complete. 2024-02-17T12:16:45.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 Processor -- start 2024-02-17T12:16:45.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 -- start start 2024-02-17T12:16:45.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93e806db50 0x7f93e80c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e80c25a0 0x7f93e80c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93e8150490 0x7f93e81551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8152050 con 0x7f93e80c25a0 2024-02-17T12:16:45.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e81f0920 con 0x7f93e8150490 2024-02-17T12:16:45.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93ee600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e81f0c00 con 0x7f93e806db50 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e80c25a0 0x7f93e80c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e80c25a0 0x7f93e80c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43584/0 (socket says 172.21.15.114:43584) 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e6a00640 1 -- 172.21.15.114:0/4013753246 learned_addr learned my addr 172.21.15.114:0/4013753246 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e7e00640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93e8150490 0x7f93e81551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e7400640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93e806db50 0x7f93e80c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e6a00640 1 -- 172.21.15.114:0/4013753246 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93e806db50 msgr2=0x7f93e80c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e6a00640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93e806db50 0x7f93e80c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e6a00640 1 -- 172.21.15.114:0/4013753246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93e8150490 msgr2=0x7f93e81551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e6a00640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93e8150490 0x7f93e81551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e6a00640 1 -- 172.21.15.114:0/4013753246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e0009b30 con 0x7f93e80c25a0 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e7e00640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93e8150490 0x7f93e81551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93e6a00640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e80c25a0 0x7f93e80c49b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f93d400e8b0 tx=0x7f93d400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:45.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93df400640 1 -- 172.21.15.114:0/4013753246 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d400c940 con 0x7f93e80c25a0 2024-02-17T12:16:45.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93df400640 1 -- 172.21.15.114:0/4013753246 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d400caa0 con 0x7f93e80c25a0 2024-02-17T12:16:45.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.131+0000 7f93df400640 1 -- 172.21.15.114:0/4013753246 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d400ce30 con 0x7f93e80c25a0 2024-02-17T12:16:45.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.135+0000 7f93ee600640 1 -- 172.21.15.114:0/4013753246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e81f0ee0 con 0x7f93e80c25a0 2024-02-17T12:16:45.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.135+0000 7f93ee600640 1 -- 172.21.15.114:0/4013753246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e81f1400 con 0x7f93e80c25a0 2024-02-17T12:16:45.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.135+0000 7f93ee600640 1 -- 172.21.15.114:0/4013753246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e81f1680 con 0x7f93e80c25a0 2024-02-17T12:16:45.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.135+0000 7f93df400640 1 -- 172.21.15.114:0/4013753246 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f93d4013470 con 0x7f93e80c25a0 2024-02-17T12:16:45.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.135+0000 7f93df400640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f93c8066e40 0x7f93c8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.135+0000 7f93df400640 1 -- 172.21.15.114:0/4013753246 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93d4084c20 con 0x7f93e80c25a0 2024-02-17T12:16:45.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.135+0000 7f93e7400640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f93c8066e40 0x7f93c8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.139+0000 7f93e7400640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f93c8066e40 0x7f93c8069300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009af0 tx=0x7f93d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:45.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.139+0000 7f93df400640 1 -- 172.21.15.114:0/4013753246 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f93e81f1680 con 0x7f93e80c25a0 2024-02-17T12:16:45.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.295+0000 7f93ee600640 1 -- 172.21.15.114:0/4013753246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93e81f0780 con 0x7f93e80c25a0 2024-02-17T12:16:45.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93df400640 1 -- 172.21.15.114:0/4013753246 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f93d4017020 con 0x7f93e80c25a0 2024-02-17T12:16:45.302 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:16:45.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 -- 172.21.15.114:0/4013753246 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f93c8066e40 msgr2=0x7f93c8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f93c8066e40 0x7f93c8069300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009af0 tx=0x7f93d8008040 comp rx=0 tx=0).stop 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 -- 172.21.15.114:0/4013753246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e80c25a0 msgr2=0x7f93e80c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e80c25a0 0x7f93e80c49b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f93d400e8b0 tx=0x7f93d400ed70 comp rx=0 tx=0).stop 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 -- 172.21.15.114:0/4013753246 shutdown_connections 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93e8150490 0x7f93e81551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f93c8066e40 0x7f93c8069300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e80c25a0 0x7f93e80c49b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 --2- 172.21.15.114:0/4013753246 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93e806db50 0x7f93e80c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 -- 172.21.15.114:0/4013753246 >> 172.21.15.114:0/4013753246 conn(0x7f93e80a8490 msgr2=0x7f93e80c1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 -- 172.21.15.114:0/4013753246 shutdown_connections 2024-02-17T12:16:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.299+0000 7f93ee600640 1 -- 172.21.15.114:0/4013753246 wait complete. 2024-02-17T12:16:45.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:16:45.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a23e00640 1 Processor -- start 2024-02-17T12:16:45.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a23e00640 1 -- start start 2024-02-17T12:16:45.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a23e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a24152280 0x7f8a24072490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a23e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a2406b730 0x7f8a240bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a23e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8a2406bc40 0x7f8a24158210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a23e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2406f740 con 0x7f8a24152280 2024-02-17T12:16:45.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a23e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a240a65c0 con 0x7f8a2406bc40 2024-02-17T12:16:45.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a23e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24152660 con 0x7f8a2406b730 2024-02-17T12:16:45.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a22a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a24152280 0x7f8a24072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a22a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a24152280 0x7f8a24072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55456/0 (socket says 172.21.15.114:55456) 2024-02-17T12:16:45.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a22a00640 1 -- 172.21.15.114:0/3990708777 learned_addr learned my addr 172.21.15.114:0/3990708777 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:45.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a22a00640 1 -- 172.21.15.114:0/3990708777 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a2406b730 msgr2=0x7f8a240bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:45.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a22a00640 1 --2- 172.21.15.114:0/3990708777 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a2406b730 0x7f8a240bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a22a00640 1 -- 172.21.15.114:0/3990708777 >> v2:172.21.15.116:3300/0 conn(0x7f8a2406bc40 msgr2=0x7f8a24158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:45.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a22a00640 1 --2- 172.21.15.114:0/3990708777 >> v2:172.21.15.116:3300/0 conn(0x7f8a2406bc40 0x7f8a24158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.459+0000 7f8a22a00640 1 -- 172.21.15.114:0/3990708777 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2406c3c0 con 0x7f8a24152280 2024-02-17T12:16:45.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a22a00640 1 --2- 172.21.15.114:0/3990708777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a24152280 0x7f8a24072490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8a2406f540 tx=0x7f8a1401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192bb25ba2e6fe11 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:45.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a21600640 1 -- 172.21.15.114:0/3990708777 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140ad640 con 0x7f8a24152280 2024-02-17T12:16:45.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a21600640 1 -- 172.21.15.114:0/3990708777 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a140ad7a0 con 0x7f8a24152280 2024-02-17T12:16:45.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a21600640 1 -- 172.21.15.114:0/3990708777 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140adb30 con 0x7f8a24152280 2024-02-17T12:16:45.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 -- 172.21.15.114:0/3990708777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a24152280 msgr2=0x7f8a24072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 --2- 172.21.15.114:0/3990708777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a24152280 0x7f8a24072490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8a2406f540 tx=0x7f8a1401c3d0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 -- 172.21.15.114:0/3990708777 shutdown_connections 2024-02-17T12:16:45.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 --2- 172.21.15.114:0/3990708777 >> v2:172.21.15.116:3300/0 conn(0x7f8a2406bc40 0x7f8a24158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 --2- 172.21.15.114:0/3990708777 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a2406b730 0x7f8a240bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 --2- 172.21.15.114:0/3990708777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a24152280 0x7f8a24072490 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 -- 172.21.15.114:0/3990708777 >> 172.21.15.114:0/3990708777 conn(0x7f8a2406ac10 msgr2=0x7f8a2406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:45.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 -- 172.21.15.114:0/3990708777 shutdown_connections 2024-02-17T12:16:45.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 -- 172.21.15.114:0/3990708777 wait complete. 2024-02-17T12:16:45.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 Processor -- start 2024-02-17T12:16:45.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.463+0000 7f8a23e00640 1 -- start start 2024-02-17T12:16:45.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a23e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a2406b730 0x7f8a24147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a23e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a2406bc40 0x7f8a24151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a23e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a24152280 0x7f8a2414ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a23e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2406f400 con 0x7f8a2406bc40 2024-02-17T12:16:45.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a23e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24151b50 con 0x7f8a2406b730 2024-02-17T12:16:45.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a23e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2406e6d0 con 0x7f8a24152280 2024-02-17T12:16:45.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a22000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a2406bc40 0x7f8a24151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a22000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a2406bc40 0x7f8a24151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55468/0 (socket says 172.21.15.114:55468) 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a22000640 1 -- 172.21.15.114:0/304828542 learned_addr learned my addr 172.21.15.114:0/304828542 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a22a00640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a2406b730 0x7f8a24147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a23400640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a24152280 0x7f8a2414ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a22000640 1 -- 172.21.15.114:0/304828542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a24152280 msgr2=0x7f8a2414ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a22000640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a24152280 0x7f8a2414ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a22000640 1 -- 172.21.15.114:0/304828542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a2406b730 msgr2=0x7f8a24147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a22000640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a2406b730 0x7f8a24147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a22000640 1 -- 172.21.15.114:0/304828542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140094d0 con 0x7f8a2406bc40 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a22000640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a2406bc40 0x7f8a24151610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00b580 tx=0x7f8a0c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a1aa00640 1 -- 172.21.15.114:0/304828542 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c010870 con 0x7f8a2406bc40 2024-02-17T12:16:45.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a1aa00640 1 -- 172.21.15.114:0/304828542 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c0109f0 con 0x7f8a2406bc40 2024-02-17T12:16:45.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a23e00640 1 -- 172.21.15.114:0/304828542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2406ee40 con 0x7f8a2406bc40 2024-02-17T12:16:45.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a1aa00640 1 -- 172.21.15.114:0/304828542 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c010da0 con 0x7f8a2406bc40 2024-02-17T12:16:45.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a23e00640 1 -- 172.21.15.114:0/304828542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2406e360 con 0x7f8a2406bc40 2024-02-17T12:16:45.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a23e00640 1 -- 172.21.15.114:0/304828542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2406e1c0 con 0x7f8a2406bc40 2024-02-17T12:16:45.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.467+0000 7f8a1aa00640 1 -- 172.21.15.114:0/304828542 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8a0c00f3c0 con 0x7f8a2406bc40 2024-02-17T12:16:45.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.471+0000 7f8a1aa00640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8a00066e40 0x7f8a00069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.471+0000 7f8a1aa00640 1 -- 172.21.15.114:0/304828542 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a0c0849f0 con 0x7f8a2406bc40 2024-02-17T12:16:45.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.471+0000 7f8a22a00640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8a00066e40 0x7f8a00069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.471+0000 7f8a22a00640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8a00066e40 0x7f8a00069300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a140af000 tx=0x7f8a14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:45.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.475+0000 7f8a1aa00640 1 -- 172.21.15.114:0/304828542 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8a2406e1c0 con 0x7f8a2406bc40 2024-02-17T12:16:45.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.627+0000 7f8a23e00640 1 -- 172.21.15.114:0/304828542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a2406e1c0 con 0x7f8a2406bc40 2024-02-17T12:16:45.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.627+0000 7f8a1aa00640 1 -- 172.21.15.114:0/304828542 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a2406e1c0 con 0x7f8a2406bc40 2024-02-17T12:16:45.633 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:16:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 -- 172.21.15.114:0/304828542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8a00066e40 msgr2=0x7f8a00069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8a00066e40 0x7f8a00069300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a140af000 tx=0x7f8a14008040 comp rx=0 tx=0).stop 2024-02-17T12:16:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 -- 172.21.15.114:0/304828542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a2406bc40 msgr2=0x7f8a24151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a2406bc40 0x7f8a24151610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00b580 tx=0x7f8a0c00ba40 comp rx=0 tx=0).stop 2024-02-17T12:16:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 -- 172.21.15.114:0/304828542 shutdown_connections 2024-02-17T12:16:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a24152280 0x7f8a2414ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8a00066e40 0x7f8a00069300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a2406bc40 0x7f8a24151610 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 --2- 172.21.15.114:0/304828542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a2406b730 0x7f8a24147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 -- 172.21.15.114:0/304828542 >> 172.21.15.114:0/304828542 conn(0x7f8a2406ac10 msgr2=0x7f8a240a67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 -- 172.21.15.114:0/304828542 shutdown_connections 2024-02-17T12:16:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.631+0000 7f8a23e00640 1 -- 172.21.15.114:0/304828542 wait complete. 2024-02-17T12:16:45.663 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-02-17T12:16:45.664 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:45.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82f200640 1 Processor -- start 2024-02-17T12:16:45.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82f200640 1 -- start start 2024-02-17T12:16:45.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82f200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe8280aa060 0x7fe8280aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82f200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe82806fdc0 0x7fe8281583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82f200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8280c5ee0 con 0x7fe828158900 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82f200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8280c2390 con 0x7fe82806fdc0 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82f200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8280706e0 con 0x7fe8280aa060 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe82806fdc0 0x7fe8281583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82e800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe828158900 0x7fe828154e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49620/0 (socket says 172.21.15.114:49620) 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82e800640 1 -- 172.21.15.114:0/1449202810 learned_addr learned my addr 172.21.15.114:0/1449202810 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82de00640 1 --2- 172.21.15.114:0/1449202810 >> v2:172.21.15.116:3300/0 conn(0x7fe8280aa060 0x7fe8280aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82d400640 1 -- 172.21.15.114:0/1449202810 >> v2:172.21.15.116:3300/0 conn(0x7fe8280aa060 msgr2=0x7fe8280aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82d400640 1 --2- 172.21.15.114:0/1449202810 >> v2:172.21.15.116:3300/0 conn(0x7fe8280aa060 0x7fe8280aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82d400640 1 -- 172.21.15.114:0/1449202810 >> v1:172.21.15.114:6789/0 conn(0x7fe828158900 legacy=0x7fe828154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82d400640 1 -- 172.21.15.114:0/1449202810 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828158d50 con 0x7fe82806fdc0 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82ca00640 1 -- 172.21.15.114:0/1449202810 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222659204 0 0) 0x7fe8280c5ee0 con 0x7fe828158900 2024-02-17T12:16:45.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.795+0000 7fe82de00640 1 --2- 172.21.15.114:0/1449202810 >> v2:172.21.15.116:3300/0 conn(0x7fe8280aa060 0x7fe8280aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:45.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82d400640 1 --2- 172.21.15.114:0/1449202810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 0x7fe8281583c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe8280ab210 tx=0x7fe81801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c294fbfa7fd625 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:45.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82ca00640 1 -- 172.21.15.114:0/1449202810 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828155d50 con 0x7fe82806fdc0 2024-02-17T12:16:45.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82ca00640 1 -- 172.21.15.114:0/1449202810 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8180a7050 con 0x7fe82806fdc0 2024-02-17T12:16:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82ca00640 1 -- 172.21.15.114:0/1449202810 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180ab820 con 0x7fe82806fdc0 2024-02-17T12:16:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82f200640 1 -- 172.21.15.114:0/1449202810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 msgr2=0x7fe8281583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82f200640 1 --2- 172.21.15.114:0/1449202810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 0x7fe8281583c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe8280ab210 tx=0x7fe81801c330 comp rx=0 tx=0).stop 2024-02-17T12:16:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82f200640 1 -- 172.21.15.114:0/1449202810 shutdown_connections 2024-02-17T12:16:45.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82f200640 1 --2- 172.21.15.114:0/1449202810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 0x7fe8281583c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82f200640 1 --2- 172.21.15.114:0/1449202810 >> v2:172.21.15.116:3300/0 conn(0x7fe8280aa060 0x7fe8280aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82f200640 1 -- 172.21.15.114:0/1449202810 >> 172.21.15.114:0/1449202810 conn(0x7fe82806ed70 msgr2=0x7fe82806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:45.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82f200640 1 -- 172.21.15.114:0/1449202810 shutdown_connections 2024-02-17T12:16:45.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82f200640 1 -- 172.21.15.114:0/1449202810 wait complete. 2024-02-17T12:16:45.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82f200640 1 Processor -- start 2024-02-17T12:16:45.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.799+0000 7fe82f200640 1 -- start start 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 0x7fe82815a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82f200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8280aa060 0x7fe828156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82f200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe828158900 0x7fe82815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe828157d00 con 0x7fe82806fdc0 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82f200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe828159e80 con 0x7fe828158900 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82f200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe828157870 con 0x7fe8280aa060 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 0x7fe82815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 0x7fe82815a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55472/0 (socket says 172.21.15.114:55472) 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82de00640 1 -- 172.21.15.114:0/3575102601 learned_addr learned my addr 172.21.15.114:0/3575102601 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82d400640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8280aa060 0x7fe828156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82e800640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe828158900 0x7fe82815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82de00640 1 -- 172.21.15.114:0/3575102601 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8280aa060 msgr2=0x7fe828156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82de00640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8280aa060 0x7fe828156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82de00640 1 -- 172.21.15.114:0/3575102601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe828158900 msgr2=0x7fe82815bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82de00640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe828158900 0x7fe82815bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82de00640 1 -- 172.21.15.114:0/3575102601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818009420 con 0x7fe82806fdc0 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82e800640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe828158900 0x7fe82815bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82d400640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8280aa060 0x7fe828156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82de00640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 0x7fe82815a100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00d860 tx=0x7fe81c00dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe822000640 1 -- 172.21.15.114:0/3575102601 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00de50 con 0x7fe82806fdc0 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe822000640 1 -- 172.21.15.114:0/3575102601 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c0098d0 con 0x7fe82806fdc0 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe822000640 1 -- 172.21.15.114:0/3575102601 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c009c80 con 0x7fe82806fdc0 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82f200640 1 -- 172.21.15.114:0/3575102601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe828157540 con 0x7fe82806fdc0 2024-02-17T12:16:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82f200640 1 -- 172.21.15.114:0/3575102601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe828159ba0 con 0x7fe82806fdc0 2024-02-17T12:16:45.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe82f200640 1 -- 172.21.15.114:0/3575102601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe828068180 con 0x7fe82806fdc0 2024-02-17T12:16:45.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.803+0000 7fe822000640 1 -- 172.21.15.114:0/3575102601 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe81c014410 con 0x7fe82806fdc0 2024-02-17T12:16:45.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.807+0000 7fe822000640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe80c066e40 0x7fe80c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:45.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.807+0000 7fe822000640 1 -- 172.21.15.114:0/3575102601 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe81c085170 con 0x7fe82806fdc0 2024-02-17T12:16:45.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.807+0000 7fe82d400640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe80c066e40 0x7fe80c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:45.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.807+0000 7fe82d400640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe80c066e40 0x7fe80c069300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8180ad000 tx=0x7fe8180a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:45.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.811+0000 7fe822000640 1 -- 172.21.15.114:0/3575102601 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe81c051f50 con 0x7fe82806fdc0 2024-02-17T12:16:45.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.963+0000 7fe82f200640 1 -- 172.21.15.114:0/3575102601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe82804eef0 con 0x7fe82806fdc0 2024-02-17T12:16:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.963+0000 7fe822000640 1 -- 172.21.15.114:0/3575102601 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fe81c055610 con 0x7fe82806fdc0 2024-02-17T12:16:45.969 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:45.969 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 -- 172.21.15.114:0/3575102601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe80c066e40 msgr2=0x7fe80c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe80c066e40 0x7fe80c069300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8180ad000 tx=0x7fe8180a6000 comp rx=0 tx=0).stop 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 -- 172.21.15.114:0/3575102601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 msgr2=0x7fe82815a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 0x7fe82815a100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00d860 tx=0x7fe81c00dd20 comp rx=0 tx=0).stop 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 -- 172.21.15.114:0/3575102601 shutdown_connections 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe828158900 0x7fe82815bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8280aa060 0x7fe828156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe80c066e40 0x7fe80c069300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 --2- 172.21.15.114:0/3575102601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe82806fdc0 0x7fe82815a100 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 -- 172.21.15.114:0/3575102601 >> 172.21.15.114:0/3575102601 conn(0x7fe82806ed70 msgr2=0x7fe82806f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 -- 172.21.15.114:0/3575102601 shutdown_connections 2024-02-17T12:16:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:45.967+0000 7fe82f200640 1 -- 172.21.15.114:0/3575102601 wait complete. 2024-02-17T12:16:45.989 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:16:21.236908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:16:21.659009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:45.990 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:46.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa21ca00640 1 Processor -- start 2024-02-17T12:16:46.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa21ca00640 1 -- start start 2024-02-17T12:16:46.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa21ca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2180c4b30 0x7fa2181583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa21ca00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa218155090 con 0x7fa2180c58b0 2024-02-17T12:16:46.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa21ca00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa218159300 con 0x7fa2180a6360 2024-02-17T12:16:46.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa21ca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180c6110 con 0x7fa2180c4b30 2024-02-17T12:16:46.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa2180c58b0 0x7fa21806bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49634/0 (socket says 172.21.15.114:49634) 2024-02-17T12:16:46.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215e00640 1 -- 172.21.15.114:0/3697426586 learned_addr learned my addr 172.21.15.114:0/3697426586 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:46.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215400640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2180c4b30 0x7fa2181583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347985143 0 0) 0x7fa218155090 con 0x7fa2180c58b0 2024-02-17T12:16:46.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1fc003530 con 0x7fa2180c58b0 2024-02-17T12:16:46.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848059126 0 0) 0x7fa218159300 con 0x7fa2180a6360 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa218155090 con 0x7fa2180a6360 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3601928758 0 0) 0x7fa1fc003530 con 0x7fa2180c58b0 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2180c4b30 msgr2=0x7fa2181583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2180c4b30 0x7fa2181583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 >> v1:172.21.15.116:6789/0 conn(0x7fa2180a6360 legacy=0x7fa218155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218158a60 con 0x7fa2180c58b0 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fa208001680 con 0x7fa2180c58b0 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215400640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2180c4b30 0x7fa2181583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 >> v1:172.21.15.114:6789/0 conn(0x7fa2180c58b0 legacy=0x7fa21806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1fc003b40 0x7fa1fc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2180c4b30 0x7fa1fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1fc004d10 0x7fa1fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc00ba40 con 0x7fa1fc003b40 2024-02-17T12:16:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc00bb80 con 0x7fa1fc004d10 2024-02-17T12:16:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc00bcc0 con 0x7fa2180c4b30 2024-02-17T12:16:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215e00640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1fc003b40 0x7fa1fc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa216800640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1fc004d10 0x7fa1fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215400640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2180c4b30 0x7fa1fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215e00640 1 -- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2180c4b30 msgr2=0x7fa1fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215e00640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2180c4b30 0x7fa1fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215e00640 1 -- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1fc004d10 msgr2=0x7fa1fc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215e00640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1fc004d10 0x7fa1fc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215e00640 1 -- 172.21.15.114:0/3697426586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200009420 con 0x7fa1fc003b40 2024-02-17T12:16:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.123+0000 7fa215400640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2180c4b30 0x7fa1fc0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa215e00640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1fc003b40 0x7fa1fc003f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c190 tx=0x7fa20801cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac3fc7246d963f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080058e0 con 0x7fa1fc003b40 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa208005a40 con 0x7fa1fc003b40 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa214a00640 1 -- 172.21.15.114:0/3697426586 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208005df0 con 0x7fa1fc003b40 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa21ca00640 1 -- 172.21.15.114:0/3697426586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1fc003b40 msgr2=0x7fa1fc003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa21ca00640 1 --2- 172.21.15.114:0/3697426586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1fc003b40 0x7fa1fc003f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c190 tx=0x7fa20801cbb0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa216800640 1 -- 172.21.15.114:0/3697426586 reap_dead start 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa21ca00640 1 -- 172.21.15.114:0/3697426586 shutdown_connections 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa21ca00640 1 -- 172.21.15.114:0/3697426586 >> 172.21.15.114:0/3697426586 conn(0x7fa2180c3730 msgr2=0x7fa2180c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa21ca00640 1 -- 172.21.15.114:0/3697426586 shutdown_connections 2024-02-17T12:16:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.127+0000 7fa21ca00640 1 -- 172.21.15.114:0/3697426586 wait complete. 2024-02-17T12:16:46.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 Processor -- start 2024-02-17T12:16:46.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 -- start start 2024-02-17T12:16:46.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1fc003b40 0x7fa2180c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2180c3210 0x7fa21814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa218150420 0x7fa2181f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21806f580 con 0x7fa218150420 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181508b0 con 0x7fa2180c3210 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21806d610 con 0x7fa1fc003b40 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa216800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa218150420 0x7fa2181f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa216800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa218150420 0x7fa2181f0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55478/0 (socket says 172.21.15.114:55478) 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa216800640 1 -- 172.21.15.114:0/1160061574 learned_addr learned my addr 172.21.15.114:0/1160061574 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa215e00640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1fc003b40 0x7fa2180c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa215400640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2180c3210 0x7fa21814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa216800640 1 -- 172.21.15.114:0/1160061574 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1fc003b40 msgr2=0x7fa2180c02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa216800640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1fc003b40 0x7fa2180c02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa216800640 1 -- 172.21.15.114:0/1160061574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2180c3210 msgr2=0x7fa21814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa216800640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2180c3210 0x7fa21814fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa216800640 1 -- 172.21.15.114:0/1160061574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21806f2a0 con 0x7fa218150420 2024-02-17T12:16:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa216800640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa218150420 0x7fa2181f0a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa2180714f0 tx=0x7fa21000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:46.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa20e000640 1 -- 172.21.15.114:0/1160061574 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210006e30 con 0x7fa218150420 2024-02-17T12:16:46.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa20e000640 1 -- 172.21.15.114:0/1160061574 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210003980 con 0x7fa218150420 2024-02-17T12:16:46.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa20e000640 1 -- 172.21.15.114:0/1160061574 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210003d30 con 0x7fa218150420 2024-02-17T12:16:46.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 -- 172.21.15.114:0/1160061574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2181ee110 con 0x7fa218150420 2024-02-17T12:16:46.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 -- 172.21.15.114:0/1160061574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2181ee3f0 con 0x7fa218150420 2024-02-17T12:16:46.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.131+0000 7fa21ca00640 1 -- 172.21.15.114:0/1160061574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa218067170 con 0x7fa218150420 2024-02-17T12:16:46.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.135+0000 7fa20e000640 1 -- 172.21.15.114:0/1160061574 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa2100050d0 con 0x7fa218150420 2024-02-17T12:16:46.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.135+0000 7fa20e000640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1f4066e70 0x7fa1f4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.135+0000 7fa20e000640 1 -- 172.21.15.114:0/1160061574 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa210084160 con 0x7fa218150420 2024-02-17T12:16:46.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.135+0000 7fa215e00640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1f4066e70 0x7fa1f4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.135+0000 7fa215e00640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1f4066e70 0x7fa1f4069330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2080aa000 tx=0x7fa208001a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:46.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.139+0000 7fa20e000640 1 -- 172.21.15.114:0/1160061574 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa210050f40 con 0x7fa218150420 2024-02-17T12:16:46.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 -- 172.21.15.114:0/1160061574 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2181edf70 con 0x7fa218150420 2024-02-17T12:16:46.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa20e000640 1 -- 172.21.15.114:0/1160061574 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2181edf70 con 0x7fa218150420 2024-02-17T12:16:46.300 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:46.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 -- 172.21.15.114:0/1160061574 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1f4066e70 msgr2=0x7fa1f4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1f4066e70 0x7fa1f4069330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2080aa000 tx=0x7fa208001a00 comp rx=0 tx=0).stop 2024-02-17T12:16:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 -- 172.21.15.114:0/1160061574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa218150420 msgr2=0x7fa2181f0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa218150420 0x7fa2181f0a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa2180714f0 tx=0x7fa21000ff70 comp rx=0 tx=0).stop 2024-02-17T12:16:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 -- 172.21.15.114:0/1160061574 shutdown_connections 2024-02-17T12:16:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1f4066e70 0x7fa1f4069330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa218150420 0x7fa2181f0a80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2180c3210 0x7fa21814fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 --2- 172.21.15.114:0/1160061574 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1fc003b40 0x7fa2180c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 -- 172.21.15.114:0/1160061574 >> 172.21.15.114:0/1160061574 conn(0x7fa2180c3730 msgr2=0x7fa218159c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 -- 172.21.15.114:0/1160061574 shutdown_connections 2024-02-17T12:16:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.295+0000 7fa21ca00640 1 -- 172.21.15.114:0/1160061574 wait complete. 2024-02-17T12:16:46.322 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:16:46.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f6745c00640 1 Processor -- start 2024-02-17T12:16:46.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f6745c00640 1 -- start start 2024-02-17T12:16:46.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f6745c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f67400c6460 0x7f674006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f6745c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740154e30 0x7f67400aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f6745c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6740155dd0 con 0x7f6740152540 2024-02-17T12:16:46.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f6745c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67401588c0 con 0x7f67400c6460 2024-02-17T12:16:46.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f6745c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6740155810 con 0x7f6740154e30 2024-02-17T12:16:46.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f673e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f67400c6460 0x7f674006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f673e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f67400c6460 0x7f674006ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55484/0 (socket says 172.21.15.114:55484) 2024-02-17T12:16:46.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f673e000640 1 -- 172.21.15.114:0/3120984143 learned_addr learned my addr 172.21.15.114:0/3120984143 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:46.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f673f400640 1 --2- 172.21.15.114:0/3120984143 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740154e30 0x7f67400aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f673e000640 1 -- 172.21.15.114:0/3120984143 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740154e30 msgr2=0x7f67400aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:46.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f673e000640 1 --2- 172.21.15.114:0/3120984143 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740154e30 0x7f67400aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f673e000640 1 -- 172.21.15.114:0/3120984143 >> v1:172.21.15.116:6789/0 conn(0x7f6740152540 legacy=0x7f6740158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f673d600640 1 -- 172.21.15.114:0/3120984143 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944292021 0 0) 0x7f6740155dd0 con 0x7f6740152540 2024-02-17T12:16:46.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.455+0000 7f673e000640 1 -- 172.21.15.114:0/3120984143 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740155af0 con 0x7f67400c6460 2024-02-17T12:16:46.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f673e000640 1 --2- 172.21.15.114:0/3120984143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 0x7f674006ff80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f672c009870 tx=0x7f672c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31a68c5c9426024 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:46.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f673d600640 1 -- 172.21.15.114:0/3120984143 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c004230 con 0x7f67400c6460 2024-02-17T12:16:46.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f673d600640 1 -- 172.21.15.114:0/3120984143 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c0a7050 con 0x7f67400c6460 2024-02-17T12:16:46.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f673d600640 1 -- 172.21.15.114:0/3120984143 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c003620 con 0x7f67400c6460 2024-02-17T12:16:46.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f6745c00640 1 -- 172.21.15.114:0/3120984143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 msgr2=0x7f674006ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f6745c00640 1 --2- 172.21.15.114:0/3120984143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 0x7f674006ff80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f672c009870 tx=0x7f672c01c440 comp rx=0 tx=0).stop 2024-02-17T12:16:46.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f6745c00640 1 -- 172.21.15.114:0/3120984143 shutdown_connections 2024-02-17T12:16:46.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f6745c00640 1 --2- 172.21.15.114:0/3120984143 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740154e30 0x7f67400aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f6745c00640 1 --2- 172.21.15.114:0/3120984143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 0x7f674006ff80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f6745c00640 1 -- 172.21.15.114:0/3120984143 >> 172.21.15.114:0/3120984143 conn(0x7f67400c4f20 msgr2=0x7f67400c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:46.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f6745c00640 1 -- 172.21.15.114:0/3120984143 shutdown_connections 2024-02-17T12:16:46.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.459+0000 7f6745c00640 1 -- 172.21.15.114:0/3120984143 wait complete. 2024-02-17T12:16:46.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 Processor -- start 2024-02-17T12:16:46.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 -- start start 2024-02-17T12:16:46.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 0x7f6740147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740152540 0x7f67401498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6740154e30 0x7f67401f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674014f100 con 0x7f67400c6460 2024-02-17T12:16:46.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674014f310 con 0x7f6740154e30 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674014bd20 con 0x7f6740152540 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 0x7f6740147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 0x7f6740147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55490/0 (socket says 172.21.15.114:55490) 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673ea00640 1 -- 172.21.15.114:0/1964267579 learned_addr learned my addr 172.21.15.114:0/1964267579 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673f400640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6740154e30 0x7f67401f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673e000640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740152540 0x7f67401498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673ea00640 1 -- 172.21.15.114:0/1964267579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740152540 msgr2=0x7f67401498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673ea00640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740152540 0x7f67401498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673ea00640 1 -- 172.21.15.114:0/1964267579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6740154e30 msgr2=0x7f67401f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673ea00640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6740154e30 0x7f67401f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673ea00640 1 -- 172.21.15.114:0/1964267579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0094d0 con 0x7f67400c6460 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673e000640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740152540 0x7f67401498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:46.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f673ea00640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 0x7f6740147ba0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f673000c480 tx=0x7f673000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6736a00640 1 -- 172.21.15.114:0/1964267579 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730005480 con 0x7f67400c6460 2024-02-17T12:16:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6736a00640 1 -- 172.21.15.114:0/1964267579 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6730003600 con 0x7f67400c6460 2024-02-17T12:16:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6736a00640 1 -- 172.21.15.114:0/1964267579 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300039b0 con 0x7f67400c6460 2024-02-17T12:16:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 -- 172.21.15.114:0/1964267579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674014c000 con 0x7f67400c6460 2024-02-17T12:16:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 -- 172.21.15.114:0/1964267579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6740149de0 con 0x7f67400c6460 2024-02-17T12:16:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.463+0000 7f6745c00640 1 -- 172.21.15.114:0/1964267579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674014c190 con 0x7f67400c6460 2024-02-17T12:16:46.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.467+0000 7f6736a00640 1 -- 172.21.15.114:0/1964267579 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6730003b10 con 0x7f67400c6460 2024-02-17T12:16:46.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.467+0000 7f6736a00640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6720066e40 0x7f6720069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.467+0000 7f6736a00640 1 -- 172.21.15.114:0/1964267579 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6730084640 con 0x7f67400c6460 2024-02-17T12:16:46.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.467+0000 7f673e000640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6720066e40 0x7f6720069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.467+0000 7f673e000640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6720066e40 0x7f6720069300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f672c0ad000 tx=0x7f672c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:46.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.471+0000 7f6736a00640 1 -- 172.21.15.114:0/1964267579 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6730051420 con 0x7f67400c6460 2024-02-17T12:16:46.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.623+0000 7f6745c00640 1 -- 172.21.15.114:0/1964267579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6740074840 con 0x7f67400c6460 2024-02-17T12:16:46.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.623+0000 7f6736a00640 1 -- 172.21.15.114:0/1964267579 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6730054ae0 con 0x7f67400c6460 2024-02-17T12:16:46.630 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:16:46.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 -- 172.21.15.114:0/1964267579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6720066e40 msgr2=0x7f6720069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6720066e40 0x7f6720069300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f672c0ad000 tx=0x7f672c008040 comp rx=0 tx=0).stop 2024-02-17T12:16:46.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 -- 172.21.15.114:0/1964267579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 msgr2=0x7f6740147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 0x7f6740147ba0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f673000c480 tx=0x7f673000c940 comp rx=0 tx=0).stop 2024-02-17T12:16:46.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 -- 172.21.15.114:0/1964267579 shutdown_connections 2024-02-17T12:16:46.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6740154e30 0x7f67401f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6740152540 0x7f67401498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6720066e40 0x7f6720069300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 --2- 172.21.15.114:0/1964267579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67400c6460 0x7f6740147ba0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 -- 172.21.15.114:0/1964267579 >> 172.21.15.114:0/1964267579 conn(0x7f67400c4f20 msgr2=0x7f67401576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:46.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 -- 172.21.15.114:0/1964267579 shutdown_connections 2024-02-17T12:16:46.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.627+0000 7f6745c00640 1 -- 172.21.15.114:0/1964267579 wait complete. 2024-02-17T12:16:46.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:16:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcfe600640 1 Processor -- start 2024-02-17T12:16:46.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcfe600640 1 -- start start 2024-02-17T12:16:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcfe600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efcf80c2c80 0x7efcf81569a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcfe600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efcf8152a20 0x7efcf8152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcfe600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf81504d0 con 0x7efcf81500f0 2024-02-17T12:16:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcfe600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf80c30e0 con 0x7efcf80c2c80 2024-02-17T12:16:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcfe600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf806f100 con 0x7efcf8152a20 2024-02-17T12:16:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcf7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efcf80c2c80 0x7efcf81569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcf7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efcf80c2c80 0x7efcf81569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55504/0 (socket says 172.21.15.114:55504) 2024-02-17T12:16:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcf7e00640 1 -- 172.21.15.114:0/4081633581 learned_addr learned my addr 172.21.15.114:0/4081633581 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcfdc00640 1 --2- 172.21.15.114:0/4081633581 >> v2:172.21.15.116:3300/0 conn(0x7efcf8152a20 0x7efcf8152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcf7e00640 1 -- 172.21.15.114:0/4081633581 >> v2:172.21.15.116:3300/0 conn(0x7efcf8152a20 msgr2=0x7efcf8152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcf7e00640 1 --2- 172.21.15.114:0/4081633581 >> v2:172.21.15.116:3300/0 conn(0x7efcf8152a20 0x7efcf8152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcf7e00640 1 -- 172.21.15.114:0/4081633581 >> v1:172.21.15.116:6789/0 conn(0x7efcf81500f0 legacy=0x7efcf80c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.783+0000 7efcf7e00640 1 -- 172.21.15.114:0/4081633581 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80c3690 con 0x7efcf80c2c80 2024-02-17T12:16:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcf7e00640 1 --2- 172.21.15.114:0/4081633581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf80c2c80 0x7efcf81569a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efcf80c6c00 tx=0x7efce401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26c5210c151d43f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcf7400640 1 -- 172.21.15.114:0/4081633581 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40ab600 con 0x7efcf80c2c80 2024-02-17T12:16:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcf7400640 1 -- 172.21.15.114:0/4081633581 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce40a7050 con 0x7efcf80c2c80 2024-02-17T12:16:46.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcf7400640 1 -- 172.21.15.114:0/4081633581 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40ab980 con 0x7efcf80c2c80 2024-02-17T12:16:46.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcfe600640 1 -- 172.21.15.114:0/4081633581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf80c2c80 msgr2=0x7efcf81569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcfe600640 1 --2- 172.21.15.114:0/4081633581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf80c2c80 0x7efcf81569a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efcf80c6c00 tx=0x7efce401c490 comp rx=0 tx=0).stop 2024-02-17T12:16:46.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcfe600640 1 -- 172.21.15.114:0/4081633581 shutdown_connections 2024-02-17T12:16:46.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcfe600640 1 --2- 172.21.15.114:0/4081633581 >> v2:172.21.15.116:3300/0 conn(0x7efcf8152a20 0x7efcf8152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcfe600640 1 --2- 172.21.15.114:0/4081633581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf80c2c80 0x7efcf81569a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcfe600640 1 -- 172.21.15.114:0/4081633581 >> 172.21.15.114:0/4081633581 conn(0x7efcf8066960 msgr2=0x7efcf8066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:46.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcfe600640 1 -- 172.21.15.114:0/4081633581 shutdown_connections 2024-02-17T12:16:46.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.787+0000 7efcfe600640 1 -- 172.21.15.114:0/4081633581 wait complete. 2024-02-17T12:16:46.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 Processor -- start 2024-02-17T12:16:46.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 -- start start 2024-02-17T12:16:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcf80c2c80 0x7efcf814b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf81500f0 0x7efcf814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcf8152a20 0x7efcf814eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80acbd0 con 0x7efcf81500f0 2024-02-17T12:16:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80ab600 con 0x7efcf80c2c80 2024-02-17T12:16:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80c5470 con 0x7efcf8152a20 2024-02-17T12:16:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf81500f0 0x7efcf814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf81500f0 0x7efcf814e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55506/0 (socket says 172.21.15.114:55506) 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf7e00640 1 -- 172.21.15.114:0/3740731213 learned_addr learned my addr 172.21.15.114:0/3740731213 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfd200640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcf80c2c80 0x7efcf814b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfdc00640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcf8152a20 0x7efcf814eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf7e00640 1 -- 172.21.15.114:0/3740731213 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcf8152a20 msgr2=0x7efcf814eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf7e00640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcf8152a20 0x7efcf814eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf7e00640 1 -- 172.21.15.114:0/3740731213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcf80c2c80 msgr2=0x7efcf814b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf7e00640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcf80c2c80 0x7efcf814b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf7e00640 1 -- 172.21.15.114:0/3740731213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce40094d0 con 0x7efcf81500f0 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf7e00640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf81500f0 0x7efcf814e620 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efce40ae040 tx=0x7efce401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf4c00640 1 -- 172.21.15.114:0/3740731213 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40b6420 con 0x7efcf81500f0 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf4c00640 1 -- 172.21.15.114:0/3740731213 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce40b65a0 con 0x7efcf81500f0 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcf4c00640 1 -- 172.21.15.114:0/3740731213 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40b6950 con 0x7efcf81500f0 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 -- 172.21.15.114:0/3740731213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf8155f50 con 0x7efcf81500f0 2024-02-17T12:16:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 -- 172.21.15.114:0/3740731213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf80ab0e0 con 0x7efcf81500f0 2024-02-17T12:16:46.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.791+0000 7efcfe600640 1 -- 172.21.15.114:0/3740731213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf804eef0 con 0x7efcf81500f0 2024-02-17T12:16:46.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.795+0000 7efcf4c00640 1 -- 172.21.15.114:0/3740731213 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7efce40b2040 con 0x7efcf81500f0 2024-02-17T12:16:46.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.795+0000 7efcf4c00640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcd8066e40 0x7efcd8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:46.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.795+0000 7efcf4c00640 1 -- 172.21.15.114:0/3740731213 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efce411ed90 con 0x7efcf81500f0 2024-02-17T12:16:46.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.795+0000 7efcfd200640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcd8066e40 0x7efcd8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:46.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.795+0000 7efcfd200640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcd8066e40 0x7efcd8069300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efce8001cb0 tx=0x7efce8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:46.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.799+0000 7efcf4c00640 1 -- 172.21.15.114:0/3740731213 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efce40ebb70 con 0x7efcf81500f0 2024-02-17T12:16:46.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.951+0000 7efcfe600640 1 -- 172.21.15.114:0/3740731213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efcf80c6c50 con 0x7efcf81500f0 2024-02-17T12:16:46.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.951+0000 7efcf4c00640 1 -- 172.21.15.114:0/3740731213 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7efce40ef230 con 0x7efcf81500f0 2024-02-17T12:16:46.956 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 -- 172.21.15.114:0/3740731213 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcd8066e40 msgr2=0x7efcd8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcd8066e40 0x7efcd8069300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efce8001cb0 tx=0x7efce8009040 comp rx=0 tx=0).stop 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 -- 172.21.15.114:0/3740731213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf81500f0 msgr2=0x7efcf814e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf81500f0 0x7efcf814e620 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efce40ae040 tx=0x7efce401acd0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 -- 172.21.15.114:0/3740731213 shutdown_connections 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcf8152a20 0x7efcf814eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcd8066e40 0x7efcd8069300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcf81500f0 0x7efcf814e620 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 --2- 172.21.15.114:0/3740731213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcf80c2c80 0x7efcf814b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 -- 172.21.15.114:0/3740731213 >> 172.21.15.114:0/3740731213 conn(0x7efcf8066960 msgr2=0x7efcf814cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 -- 172.21.15.114:0/3740731213 shutdown_connections 2024-02-17T12:16:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:46.955+0000 7efcfe600640 1 -- 172.21.15.114:0/3740731213 wait complete. 2024-02-17T12:16:46.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2024-02-17T12:16:47.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.107+0000 7f9ba9000640 1 Processor -- start 2024-02-17T12:16:47.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.107+0000 7f9ba9000640 1 -- start start 2024-02-17T12:16:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba9000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 0x7f9ba40aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba9000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba40a9420 con 0x7f9ba40c1eb0 2024-02-17T12:16:47.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba9000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba4152850 con 0x7f9ba414f110 2024-02-17T12:16:47.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba9000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba414f4f0 con 0x7f9ba40c2580 2024-02-17T12:16:47.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba2800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9ba40c1eb0 0x7f9ba415c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49648/0 (socket says 172.21.15.114:49648) 2024-02-17T12:16:47.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba2800640 1 -- 172.21.15.114:0/3529259275 learned_addr learned my addr 172.21.15.114:0/3529259275 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:47.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba1400640 1 --2- 172.21.15.114:0/3529259275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 0x7f9ba40aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba0a00640 1 -- 172.21.15.114:0/3529259275 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74521739 0 0) 0x7f9ba40a9420 con 0x7f9ba40c1eb0 2024-02-17T12:16:47.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba0a00640 1 -- 172.21.15.114:0/3529259275 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b88003530 con 0x7f9ba40c1eb0 2024-02-17T12:16:47.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba0a00640 1 -- 172.21.15.114:0/3529259275 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518290402 0 0) 0x7f9ba4152850 con 0x7f9ba414f110 2024-02-17T12:16:47.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba0a00640 1 -- 172.21.15.114:0/3529259275 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba40a9420 con 0x7f9ba414f110 2024-02-17T12:16:47.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba1400640 1 -- 172.21.15.114:0/3529259275 >> v1:172.21.15.116:6789/0 conn(0x7f9ba414f110 legacy=0x7f9ba40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba1400640 1 -- 172.21.15.114:0/3529259275 >> v1:172.21.15.114:6789/0 conn(0x7f9ba40c1eb0 legacy=0x7f9ba415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.111+0000 7f9ba1400640 1 -- 172.21.15.114:0/3529259275 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40a9670 con 0x7f9ba40c2580 2024-02-17T12:16:47.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba1400640 1 --2- 172.21.15.114:0/3529259275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 0x7f9ba40aa150 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9b900097f0 tx=0x7f9b9001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7570856106c8f1bf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:47.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba0a00640 1 -- 172.21.15.114:0/3529259275 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900ab600 con 0x7f9ba40c2580 2024-02-17T12:16:47.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba0a00640 1 -- 172.21.15.114:0/3529259275 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b900a7050 con 0x7f9ba40c2580 2024-02-17T12:16:47.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba0a00640 1 -- 172.21.15.114:0/3529259275 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900ab980 con 0x7f9ba40c2580 2024-02-17T12:16:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba9000640 1 -- 172.21.15.114:0/3529259275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 msgr2=0x7f9ba40aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba9000640 1 --2- 172.21.15.114:0/3529259275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 0x7f9ba40aa150 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9b900097f0 tx=0x7f9b9001c450 comp rx=0 tx=0).stop 2024-02-17T12:16:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba9000640 1 -- 172.21.15.114:0/3529259275 shutdown_connections 2024-02-17T12:16:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba9000640 1 --2- 172.21.15.114:0/3529259275 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 0x7f9ba40aa150 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba9000640 1 -- 172.21.15.114:0/3529259275 >> 172.21.15.114:0/3529259275 conn(0x7f9ba40a8490 msgr2=0x7f9ba40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba9000640 1 -- 172.21.15.114:0/3529259275 shutdown_connections 2024-02-17T12:16:47.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba9000640 1 -- 172.21.15.114:0/3529259275 wait complete. 2024-02-17T12:16:47.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba9000640 1 Processor -- start 2024-02-17T12:16:47.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.115+0000 7f9ba9000640 1 -- start start 2024-02-17T12:16:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba9000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ba40c1eb0 0x7f9ba414dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba9000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 0x7f9ba413f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba9000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ba414f110 0x7f9ba413fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba9000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba4142230 con 0x7f9ba414f110 2024-02-17T12:16:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba9000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40c4970 con 0x7f9ba40c1eb0 2024-02-17T12:16:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba9000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40c5cf0 con 0x7f9ba40c2580 2024-02-17T12:16:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ba414f110 0x7f9ba413fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ba414f110 0x7f9ba413fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55518/0 (socket says 172.21.15.114:55518) 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba2800640 1 -- 172.21.15.114:0/2279589675 learned_addr learned my addr 172.21.15.114:0/2279589675 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba1e00640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ba40c1eb0 0x7f9ba414dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba1400640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 0x7f9ba413f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba2800640 1 -- 172.21.15.114:0/2279589675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 msgr2=0x7f9ba413f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba2800640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 0x7f9ba413f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba2800640 1 -- 172.21.15.114:0/2279589675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ba40c1eb0 msgr2=0x7f9ba414dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba2800640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ba40c1eb0 0x7f9ba414dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba2800640 1 -- 172.21.15.114:0/2279589675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b90009420 con 0x7f9ba414f110 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba2800640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ba414f110 0x7f9ba413fef0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00ca70 tx=0x7f9b9c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9b9a000640 1 -- 172.21.15.114:0/2279589675 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00abd0 con 0x7f9ba414f110 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9b9a000640 1 -- 172.21.15.114:0/2279589675 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c00ad30 con 0x7f9ba414f110 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9b9a000640 1 -- 172.21.15.114:0/2279589675 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00aea0 con 0x7f9ba414f110 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba9000640 1 -- 172.21.15.114:0/2279589675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba40c2aa0 con 0x7f9ba414f110 2024-02-17T12:16:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba9000640 1 -- 172.21.15.114:0/2279589675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba40c4bc0 con 0x7f9ba414f110 2024-02-17T12:16:47.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9ba9000640 1 -- 172.21.15.114:0/2279589675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba40c5e80 con 0x7f9ba414f110 2024-02-17T12:16:47.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.119+0000 7f9b9a000640 1 -- 172.21.15.114:0/2279589675 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9b9c007070 con 0x7f9ba414f110 2024-02-17T12:16:47.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.123+0000 7f9b9a000640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b84066e40 0x7f9b84069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.123+0000 7f9b9a000640 1 -- 172.21.15.114:0/2279589675 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b9c084970 con 0x7f9ba414f110 2024-02-17T12:16:47.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.123+0000 7f9ba1e00640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b84066e40 0x7f9b84069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.123+0000 7f9ba1e00640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b84066e40 0x7f9b84069300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9b940011f0 tx=0x7f9b94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:47.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.127+0000 7f9b9a000640 1 -- 172.21.15.114:0/2279589675 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9b9c0516e0 con 0x7f9ba414f110 2024-02-17T12:16:47.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.339+0000 7f9ba9000640 1 -- 172.21.15.114:0/2279589675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f9ba4074840 con 0x7f9ba414f110 2024-02-17T12:16:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9b9a000640 1 -- 172.21.15.114:0/2279589675 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v49) v1 ==== 162+0+0 (secure 0 0 0) 0x7f9b9c017020 con 0x7f9ba414f110 2024-02-17T12:16:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 -- 172.21.15.114:0/2279589675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b84066e40 msgr2=0x7f9b84069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b84066e40 0x7f9b84069300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9b940011f0 tx=0x7f9b94009040 comp rx=0 tx=0).stop 2024-02-17T12:16:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 -- 172.21.15.114:0/2279589675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ba414f110 msgr2=0x7f9ba413fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ba414f110 0x7f9ba413fef0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00ca70 tx=0x7f9b9c00cf30 comp rx=0 tx=0).stop 2024-02-17T12:16:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 -- 172.21.15.114:0/2279589675 shutdown_connections 2024-02-17T12:16:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b84066e40 0x7f9b84069300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ba414f110 0x7f9ba413fef0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9ba40c2580 0x7f9ba413f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 --2- 172.21.15.114:0/2279589675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ba40c1eb0 0x7f9ba414dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 -- 172.21.15.114:0/2279589675 >> 172.21.15.114:0/2279589675 conn(0x7f9ba40a8490 msgr2=0x7f9ba40c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 -- 172.21.15.114:0/2279589675 shutdown_connections 2024-02-17T12:16:47.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.715+0000 7f9ba9000640 1 -- 172.21.15.114:0/2279589675 wait complete. 2024-02-17T12:16:47.741 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-02-17T12:16:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.875+0000 7f5962a00640 1 Processor -- start 2024-02-17T12:16:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.875+0000 7f5962a00640 1 -- start start 2024-02-17T12:16:47.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f5962a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f595c15d140 0x7f595c164a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f5962a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c15c6f0 con 0x7f595c156690 2024-02-17T12:16:47.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f5962a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c15ccb0 con 0x7f595c0a9420 2024-02-17T12:16:47.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f5962a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c06eb40 con 0x7f595c15d140 2024-02-17T12:16:47.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f595c156690 0x7f595c159100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49650/0 (socket says 172.21.15.114:49650) 2024-02-17T12:16:47.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595be00640 1 -- 172.21.15.114:0/999799234 learned_addr learned my addr 172.21.15.114:0/999799234 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422876377 0 0) 0x7f595c15c6f0 con 0x7f595c156690 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5940003530 con 0x7f595c156690 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f5960a00640 1 --2- 172.21.15.114:0/999799234 >> v2:172.21.15.116:3300/0 conn(0x7f595c15d140 0x7f595c164a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1632683014 0 0) 0x7f5940003530 con 0x7f595c156690 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 >> v2:172.21.15.116:3300/0 conn(0x7f595c15d140 msgr2=0x7f595c164a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 --2- 172.21.15.114:0/999799234 >> v2:172.21.15.116:3300/0 conn(0x7f595c15d140 0x7f595c164a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 >> v1:172.21.15.116:6789/0 conn(0x7f595c0a9420 legacy=0x7f595c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c06ee20 con 0x7f595c156690 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f594c001680 con 0x7f595c156690 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 >> v1:172.21.15.114:6789/0 conn(0x7f595c156690 legacy=0x7f595c159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f5940003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59400047d0 0x7f5940004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59400052b0 0x7f594000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c06eb40 con 0x7f5940003980 2024-02-17T12:16:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594000c180 con 0x7f59400052b0 2024-02-17T12:16:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594000c340 con 0x7f59400047d0 2024-02-17T12:16:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595be00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f5940003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f5960a00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59400052b0 0x7f594000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595b400640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59400047d0 0x7f5940004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595be00640 1 -- 172.21.15.114:0/999799234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59400047d0 msgr2=0x7f5940004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595be00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59400047d0 0x7f5940004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595be00640 1 -- 172.21.15.114:0/999799234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59400052b0 msgr2=0x7f594000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595be00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59400052b0 0x7f594000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f595be00640 1 -- 172.21.15.114:0/999799234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5940003530 con 0x7f5940003980 2024-02-17T12:16:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f5960a00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59400052b0 0x7f594000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:47.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.879+0000 7f5960a00640 1 -- 172.21.15.114:0/999799234 reap_dead start 2024-02-17T12:16:47.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f595be00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f5940003da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f594c00c190 tx=0x7f594c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1429dcc84014c1cb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:47.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c005ae0 con 0x7f5940003980 2024-02-17T12:16:47.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c005c40 con 0x7f5940003980 2024-02-17T12:16:47.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f595aa00640 1 -- 172.21.15.114:0/999799234 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0a5b10 con 0x7f5940003980 2024-02-17T12:16:47.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f5962a00640 1 -- 172.21.15.114:0/999799234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 msgr2=0x7f5940003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f5962a00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f5940003da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f594c00c190 tx=0x7f594c01cbf0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f5962a00640 1 -- 172.21.15.114:0/999799234 shutdown_connections 2024-02-17T12:16:47.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f5962a00640 1 --2- 172.21.15.114:0/999799234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f5940003da0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f5962a00640 1 -- 172.21.15.114:0/999799234 >> 172.21.15.114:0/999799234 conn(0x7f595c0a8490 msgr2=0x7f595c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:47.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f5962a00640 1 -- 172.21.15.114:0/999799234 shutdown_connections 2024-02-17T12:16:47.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f5962a00640 1 -- 172.21.15.114:0/999799234 wait complete. 2024-02-17T12:16:47.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f5962a00640 1 Processor -- start 2024-02-17T12:16:47.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.883+0000 7f5962a00640 1 -- start start 2024-02-17T12:16:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5962a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f595c1f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5962a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f595c153a10 0x7f595c0c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5962a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f595c0c4e20 0x7f595c152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5962a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c073220 con 0x7f5940003980 2024-02-17T12:16:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5962a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c1e7430 con 0x7f595c0c4e20 2024-02-17T12:16:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5962a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c1f20e0 con 0x7f595c153a10 2024-02-17T12:16:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f595c1f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f595c1f1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55528/0 (socket says 172.21.15.114:55528) 2024-02-17T12:16:47.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595be00640 1 -- 172.21.15.114:0/3529361883 learned_addr learned my addr 172.21.15.114:0/3529361883 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5960a00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f595c0c4e20 0x7f595c152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595b400640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f595c153a10 0x7f595c0c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595be00640 1 -- 172.21.15.114:0/3529361883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f595c153a10 msgr2=0x7f595c0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595be00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f595c153a10 0x7f595c0c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595be00640 1 -- 172.21.15.114:0/3529361883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f595c0c4e20 msgr2=0x7f595c152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595be00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f595c0c4e20 0x7f595c152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595be00640 1 -- 172.21.15.114:0/3529361883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c1e4f00 con 0x7f5940003980 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595b400640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f595c153a10 0x7f595c0c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5960a00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f595c0c4e20 0x7f595c152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f595be00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f595c1f1ba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f594c01c660 tx=0x7f5940005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5953e00640 1 -- 172.21.15.114:0/3529361883 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0b4070 con 0x7f5940003980 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5953e00640 1 -- 172.21.15.114:0/3529361883 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c001440 con 0x7f5940003980 2024-02-17T12:16:47.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5953e00640 1 -- 172.21.15.114:0/3529361883 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0017d0 con 0x7f5940003980 2024-02-17T12:16:47.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5962a00640 1 -- 172.21.15.114:0/3529361883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c1e4980 con 0x7f5940003980 2024-02-17T12:16:47.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5962a00640 1 -- 172.21.15.114:0/3529361883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c0c37b0 con 0x7f5940003980 2024-02-17T12:16:47.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5962a00640 1 -- 172.21.15.114:0/3529361883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c074840 con 0x7f5940003980 2024-02-17T12:16:47.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.887+0000 7f5953e00640 1 -- 172.21.15.114:0/3529361883 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f594c0a58d0 con 0x7f5940003980 2024-02-17T12:16:47.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.891+0000 7f5953e00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f593c066e70 0x7f593c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:47.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.891+0000 7f5953e00640 1 -- 172.21.15.114:0/3529361883 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f594c11e490 con 0x7f5940003980 2024-02-17T12:16:47.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.891+0000 7f595b400640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f593c066e70 0x7f593c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:47.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.891+0000 7f595b400640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f593c066e70 0x7f593c069330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5948007fd0 tx=0x7f5948009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:47.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:47.895+0000 7f5953e00640 1 -- 172.21.15.114:0/3529361883 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f594c0eb270 con 0x7f5940003980 2024-02-17T12:16:48.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.051+0000 7f5962a00640 1 -- 172.21.15.114:0/3529361883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f595c06e920 con 0x7f5940003980 2024-02-17T12:16:48.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5953e00640 1 -- 172.21.15.114:0/3529361883 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f594c0ee930 con 0x7f5940003980 2024-02-17T12:16:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 -- 172.21.15.114:0/3529361883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f593c066e70 msgr2=0x7f593c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f593c066e70 0x7f593c069330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5948007fd0 tx=0x7f5948009040 comp rx=0 tx=0).stop 2024-02-17T12:16:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 -- 172.21.15.114:0/3529361883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 msgr2=0x7f595c1f1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f595c1f1ba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f594c01c660 tx=0x7f5940005800 comp rx=0 tx=0).stop 2024-02-17T12:16:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 -- 172.21.15.114:0/3529361883 shutdown_connections 2024-02-17T12:16:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f595c0c4e20 0x7f595c152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f595c153a10 0x7f595c0c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f593c066e70 0x7f593c069330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 --2- 172.21.15.114:0/3529361883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5940003980 0x7f595c1f1ba0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 -- 172.21.15.114:0/3529361883 >> 172.21.15.114:0/3529361883 conn(0x7f595c0a8490 msgr2=0x7f595c159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:48.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 -- 172.21.15.114:0/3529361883 shutdown_connections 2024-02-17T12:16:48.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.055+0000 7f5962a00640 1 -- 172.21.15.114:0/3529361883 wait complete. 2024-02-17T12:16:48.079 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-17T12:16:48.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:16:48.160 DEBUG:teuthology.orchestra.run.smithi116:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:16:48.232 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-17T12:16:48.232 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:16:48.232 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:16:48.242 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:16:48.242 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:16:48.294 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:16:48.295 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:16:48.345 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:48.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f693f600640 1 Processor -- start 2024-02-17T12:16:48.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f693f600640 1 -- start start 2024-02-17T12:16:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f693f600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f69380c6460 0x7f693806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f693f600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6938155dd0 con 0x7f6938154e30 2024-02-17T12:16:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f693f600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69381588c0 con 0x7f6938152540 2024-02-17T12:16:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f693f600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6938155810 con 0x7f69380c6460 2024-02-17T12:16:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f693d600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6938154e30 0x7f69380aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49656/0 (socket says 172.21.15.114:49656) 2024-02-17T12:16:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f693d600640 1 -- 172.21.15.114:0/81759496 learned_addr learned my addr 172.21.15.114:0/81759496 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f6937e00640 1 --2- 172.21.15.114:0/81759496 >> v2:172.21.15.114:3300/0 conn(0x7f69380c6460 0x7f693806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:48.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f6937400640 1 -- 172.21.15.114:0/81759496 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010918024 0 0) 0x7f6938155dd0 con 0x7f6938154e30 2024-02-17T12:16:48.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f6937e00640 1 -- 172.21.15.114:0/81759496 >> v1:172.21.15.116:6789/0 conn(0x7f6938152540 legacy=0x7f6938158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f6937e00640 1 -- 172.21.15.114:0/81759496 >> v1:172.21.15.114:6789/0 conn(0x7f6938154e30 legacy=0x7f69380aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.515+0000 7f6937e00640 1 -- 172.21.15.114:0/81759496 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6938155af0 con 0x7f69380c6460 2024-02-17T12:16:48.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f6937e00640 1 --2- 172.21.15.114:0/81759496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69380c6460 0x7f693806ff80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f69240097c0 tx=0x7f692401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc47c165e4b88bed server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:48.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f6937400640 1 -- 172.21.15.114:0/81759496 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240ab600 con 0x7f69380c6460 2024-02-17T12:16:48.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f6937400640 1 -- 172.21.15.114:0/81759496 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69240a7050 con 0x7f69380c6460 2024-02-17T12:16:48.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f6937400640 1 -- 172.21.15.114:0/81759496 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240ab980 con 0x7f69380c6460 2024-02-17T12:16:48.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f693f600640 1 -- 172.21.15.114:0/81759496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69380c6460 msgr2=0x7f693806ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f693f600640 1 --2- 172.21.15.114:0/81759496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69380c6460 0x7f693806ff80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f69240097c0 tx=0x7f692401c380 comp rx=0 tx=0).stop 2024-02-17T12:16:48.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f693f600640 1 -- 172.21.15.114:0/81759496 shutdown_connections 2024-02-17T12:16:48.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f693f600640 1 --2- 172.21.15.114:0/81759496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69380c6460 0x7f693806ff80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f693f600640 1 -- 172.21.15.114:0/81759496 >> 172.21.15.114:0/81759496 conn(0x7f69380c4f20 msgr2=0x7f69380c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:48.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f693f600640 1 -- 172.21.15.114:0/81759496 shutdown_connections 2024-02-17T12:16:48.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.519+0000 7f693f600640 1 -- 172.21.15.114:0/81759496 wait complete. 2024-02-17T12:16:48.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 Processor -- start 2024-02-17T12:16:48.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 -- start start 2024-02-17T12:16:48.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69380c6460 0x7f69381422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:48.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6938152540 0x7f69381f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:48.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6938154e30 0x7f69381f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:48.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69381f19d0 con 0x7f6938152540 2024-02-17T12:16:48.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6938156160 con 0x7f6938154e30 2024-02-17T12:16:48.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693806bc50 con 0x7f69380c6460 2024-02-17T12:16:48.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6937e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6938152540 0x7f69381f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:48.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6937e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6938152540 0x7f69381f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55550/0 (socket says 172.21.15.114:55550) 2024-02-17T12:16:48.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6937e00640 1 -- 172.21.15.114:0/608519704 learned_addr learned my addr 172.21.15.114:0/608519704 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:48.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693d600640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6938154e30 0x7f69381f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6937e00640 1 -- 172.21.15.114:0/608519704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69380c6460 msgr2=0x7f69381422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693cc00640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69380c6460 0x7f69381422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6937e00640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69380c6460 0x7f69381422e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6937e00640 1 -- 172.21.15.114:0/608519704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6938154e30 msgr2=0x7f69381f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6937e00640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6938154e30 0x7f69381f13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6937e00640 1 -- 172.21.15.114:0/608519704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6924009420 con 0x7f6938152540 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693d600640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6938154e30 0x7f69381f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693cc00640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69380c6460 0x7f69381422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6937e00640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6938152540 0x7f69381f0e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6924018f90 tx=0x7f692401abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6934c00640 1 -- 172.21.15.114:0/608519704 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240b7650 con 0x7f6938152540 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6934c00640 1 -- 172.21.15.114:0/608519704 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69240abe90 con 0x7f6938152540 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f6934c00640 1 -- 172.21.15.114:0/608519704 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240b7a10 con 0x7f6938152540 2024-02-17T12:16:48.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 -- 172.21.15.114:0/608519704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6938142960 con 0x7f6938152540 2024-02-17T12:16:48.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 -- 172.21.15.114:0/608519704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693806bef0 con 0x7f6938152540 2024-02-17T12:16:48.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.523+0000 7f693f600640 1 -- 172.21.15.114:0/608519704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6938074840 con 0x7f6938152540 2024-02-17T12:16:48.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.527+0000 7f6934c00640 1 -- 172.21.15.114:0/608519704 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f69240b7b70 con 0x7f6938152540 2024-02-17T12:16:48.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.527+0000 7f6934c00640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6918066e40 0x7f6918069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:48.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.527+0000 7f6934c00640 1 -- 172.21.15.114:0/608519704 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f692411f240 con 0x7f6938152540 2024-02-17T12:16:48.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.527+0000 7f693cc00640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6918066e40 0x7f6918069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:48.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.527+0000 7f693cc00640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6918066e40 0x7f6918069300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f69381eb4d0 tx=0x7f6928009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:48.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.531+0000 7f6934c00640 1 -- 172.21.15.114:0/608519704 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f69240ec020 con 0x7f6938152540 2024-02-17T12:16:48.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.683+0000 7f693f600640 1 -- 172.21.15.114:0/608519704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6938158ef0 con 0x7f6938152540 2024-02-17T12:16:48.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.683+0000 7f6934c00640 1 -- 172.21.15.114:0/608519704 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f69240ef6e0 con 0x7f6938152540 2024-02-17T12:16:48.690 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:48.691 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:48.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 -- 172.21.15.114:0/608519704 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6918066e40 msgr2=0x7f6918069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6918066e40 0x7f6918069300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f69381eb4d0 tx=0x7f6928009040 comp rx=0 tx=0).stop 2024-02-17T12:16:48.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 -- 172.21.15.114:0/608519704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6938152540 msgr2=0x7f69381f0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6938152540 0x7f69381f0e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6924018f90 tx=0x7f692401abc0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 -- 172.21.15.114:0/608519704 shutdown_connections 2024-02-17T12:16:48.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6938154e30 0x7f69381f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6918066e40 0x7f6918069300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6938152540 0x7f69381f0e60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 --2- 172.21.15.114:0/608519704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69380c6460 0x7f69381422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 -- 172.21.15.114:0/608519704 >> 172.21.15.114:0/608519704 conn(0x7f69380c4f20 msgr2=0x7f6938154610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:48.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 -- 172.21.15.114:0/608519704 shutdown_connections 2024-02-17T12:16:48.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.687+0000 7f693f600640 1 -- 172.21.15.114:0/608519704 wait complete. 2024-02-17T12:16:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:16:21.236908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:16:21.659009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:48.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.843+0000 7fc359800640 1 Processor -- start 2024-02-17T12:16:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.843+0000 7fc359800640 1 -- start start 2024-02-17T12:16:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc359800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc3540c3760 0x7fc354155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc359800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3540c5380 con 0x7fc3540c66c0 2024-02-17T12:16:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc359800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3540c2ca0 con 0x7fc354070b50 2024-02-17T12:16:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc359800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3540c4b10 con 0x7fc3540c3760 2024-02-17T12:16:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc353e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc3540c3760 0x7fc354155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc353e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc3540c3760 0x7fc354155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55564/0 (socket says 172.21.15.114:55564) 2024-02-17T12:16:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc353e00640 1 -- 172.21.15.114:0/3654795729 learned_addr learned my addr 172.21.15.114:0/3654795729 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc353e00640 1 -- 172.21.15.114:0/3654795729 >> v1:172.21.15.116:6789/0 conn(0x7fc354070b50 legacy=0x7fc354158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc353e00640 1 -- 172.21.15.114:0/3654795729 >> v1:172.21.15.114:6789/0 conn(0x7fc3540c66c0 legacy=0x7fc354158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc353e00640 1 -- 172.21.15.114:0/3654795729 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3540c2f80 con 0x7fc3540c3760 2024-02-17T12:16:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc353e00640 1 --2- 172.21.15.114:0/3654795729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3540c3760 0x7fc354155670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc344009870 tx=0x7fc34401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ac4535773a1da3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.847+0000 7fc352a00640 1 -- 172.21.15.114:0/3654795729 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344004230 con 0x7fc3540c3760 2024-02-17T12:16:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc352a00640 1 -- 172.21.15.114:0/3654795729 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3440a7050 con 0x7fc3540c3760 2024-02-17T12:16:48.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc352a00640 1 -- 172.21.15.114:0/3654795729 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344003620 con 0x7fc3540c3760 2024-02-17T12:16:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 -- 172.21.15.114:0/3654795729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3540c3760 msgr2=0x7fc354155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 --2- 172.21.15.114:0/3654795729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3540c3760 0x7fc354155670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc344009870 tx=0x7fc34401c440 comp rx=0 tx=0).stop 2024-02-17T12:16:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 -- 172.21.15.114:0/3654795729 shutdown_connections 2024-02-17T12:16:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 --2- 172.21.15.114:0/3654795729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3540c3760 0x7fc354155670 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 -- 172.21.15.114:0/3654795729 >> 172.21.15.114:0/3654795729 conn(0x7fc3540a9f70 msgr2=0x7fc3540aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 -- 172.21.15.114:0/3654795729 shutdown_connections 2024-02-17T12:16:48.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 -- 172.21.15.114:0/3654795729 wait complete. 2024-02-17T12:16:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 Processor -- start 2024-02-17T12:16:48.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 -- start start 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc354070b50 0x7fc354159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc3540c3760 0x7fc3541f1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3540c66c0 0x7fc354070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3541532e0 con 0x7fc354070b50 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc354159b90 con 0x7fc3540c66c0 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc359800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3540a9510 con 0x7fc3540c3760 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc353e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc354070b50 0x7fc354159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc353e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc354070b50 0x7fc354159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55574/0 (socket says 172.21.15.114:55574) 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc353e00640 1 -- 172.21.15.114:0/2889772229 learned_addr learned my addr 172.21.15.114:0/2889772229 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc353400640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc3540c3760 0x7fc3541f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc358e00640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3540c66c0 0x7fc354070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:48.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc353e00640 1 -- 172.21.15.114:0/2889772229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc3540c3760 msgr2=0x7fc3541f1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc353e00640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc3540c3760 0x7fc3541f1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc353e00640 1 -- 172.21.15.114:0/2889772229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3540c66c0 msgr2=0x7fc354070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc353e00640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3540c66c0 0x7fc354070030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc353e00640 1 -- 172.21.15.114:0/2889772229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3440094d0 con 0x7fc354070b50 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.851+0000 7fc358e00640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3540c66c0 0x7fc354070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc353e00640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc354070b50 0x7fc354159650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3440ae040 tx=0x7fc3440191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc34be00640 1 -- 172.21.15.114:0/2889772229 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344003c90 con 0x7fc354070b50 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc34be00640 1 -- 172.21.15.114:0/2889772229 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc344003df0 con 0x7fc354070b50 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc34be00640 1 -- 172.21.15.114:0/2889772229 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440ab680 con 0x7fc354070b50 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc359800640 1 -- 172.21.15.114:0/2889772229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3540a97f0 con 0x7fc354070b50 2024-02-17T12:16:48.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc359800640 1 -- 172.21.15.114:0/2889772229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3541f0f10 con 0x7fc354070b50 2024-02-17T12:16:48.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc359800640 1 -- 172.21.15.114:0/2889772229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3541f0a90 con 0x7fc354070b50 2024-02-17T12:16:48.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc34be00640 1 -- 172.21.15.114:0/2889772229 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fc3440ab7e0 con 0x7fc354070b50 2024-02-17T12:16:48.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc34be00640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc334066e70 0x7fc334069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:48.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc34be00640 1 -- 172.21.15.114:0/2889772229 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc34411eef0 con 0x7fc354070b50 2024-02-17T12:16:48.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.855+0000 7fc353400640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc334066e70 0x7fc334069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:48.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.859+0000 7fc353400640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc334066e70 0x7fc334069330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc340000f70 tx=0x7fc340009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:48.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:48.859+0000 7fc34be00640 1 -- 172.21.15.114:0/2889772229 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc3541f0a90 con 0x7fc354070b50 2024-02-17T12:16:49.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 -- 172.21.15.114:0/2889772229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3541f0a90 con 0x7fc354070b50 2024-02-17T12:16:49.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc34be00640 1 -- 172.21.15.114:0/2889772229 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3541f0a90 con 0x7fc354070b50 2024-02-17T12:16:49.019 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 -- 172.21.15.114:0/2889772229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc334066e70 msgr2=0x7fc334069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc334066e70 0x7fc334069330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc340000f70 tx=0x7fc340009040 comp rx=0 tx=0).stop 2024-02-17T12:16:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 -- 172.21.15.114:0/2889772229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc354070b50 msgr2=0x7fc354159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc354070b50 0x7fc354159650 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3440ae040 tx=0x7fc3440191e0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 -- 172.21.15.114:0/2889772229 shutdown_connections 2024-02-17T12:16:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3540c66c0 0x7fc354070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc3540c3760 0x7fc3541f1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc334066e70 0x7fc334069330 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 --2- 172.21.15.114:0/2889772229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc354070b50 0x7fc354159650 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 -- 172.21.15.114:0/2889772229 >> 172.21.15.114:0/2889772229 conn(0x7fc3540a9f70 msgr2=0x7fc3540aa350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:49.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 -- 172.21.15.114:0/2889772229 shutdown_connections 2024-02-17T12:16:49.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.015+0000 7fc359800640 1 -- 172.21.15.114:0/2889772229 wait complete. 2024-02-17T12:16:49.039 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:16:49.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.171+0000 7fcd2da00640 1 Processor -- start 2024-02-17T12:16:49.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.171+0000 7fcd2da00640 1 -- start start 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.171+0000 7fcd2da00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcd280c6460 0x7fcd2806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.171+0000 7fcd2da00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd28154e30 0x7fcd280aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.171+0000 7fcd2da00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd28155dd0 con 0x7fcd28152540 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.171+0000 7fcd2da00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd281588c0 con 0x7fcd280c6460 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.171+0000 7fcd2da00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28155810 con 0x7fcd28154e30 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.171+0000 7fcd26a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcd28152540 0x7fcd28158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49678/0 (socket says 172.21.15.114:49678) 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.171+0000 7fcd26a00640 1 -- 172.21.15.114:0/1460891582 learned_addr learned my addr 172.21.15.114:0/1460891582 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.171+0000 7fcd1e000640 1 --2- 172.21.15.114:0/1460891582 >> v2:172.21.15.116:3300/0 conn(0x7fcd280c6460 0x7fcd2806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd27400640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd28154e30 0x7fcd280aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501410809 0 0) 0x7fcd28155dd0 con 0x7fcd28152540 2024-02-17T12:16:49.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd0c003530 con 0x7fcd28152540 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3030732639 0 0) 0x7fcd0c003530 con 0x7fcd28152540 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd28154e30 msgr2=0x7fcd280aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd28154e30 0x7fcd280aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 >> v2:172.21.15.116:3300/0 conn(0x7fcd280c6460 msgr2=0x7fcd2806ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 --2- 172.21.15.114:0/1460891582 >> v2:172.21.15.116:3300/0 conn(0x7fcd280c6460 0x7fcd2806ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28155af0 con 0x7fcd28152540 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fcd18001680 con 0x7fcd28152540 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd1e000640 1 --2- 172.21.15.114:0/1460891582 >> v2:172.21.15.116:3300/0 conn(0x7fcd280c6460 0x7fcd2806ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 >> v1:172.21.15.114:6789/0 conn(0x7fcd28152540 legacy=0x7fcd28158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 0x7fcd0c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd28154e30 0x7fcd0c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd0c004d10 0x7fcd0c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd281588c0 con 0x7fcd0c003980 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28155810 con 0x7fcd0c004d10 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c00ba10 con 0x7fcd28154e30 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26a00640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 0x7fcd0c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd1e000640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd28154e30 0x7fcd0c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd27400640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd0c004d10 0x7fcd0c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26a00640 1 -- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd28154e30 msgr2=0x7fcd0c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26a00640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd28154e30 0x7fcd0c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26a00640 1 -- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd0c004d10 msgr2=0x7fcd0c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26a00640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd0c004d10 0x7fcd0c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd26a00640 1 -- 172.21.15.114:0/1460891582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c003530 con 0x7fcd0c003980 2024-02-17T12:16:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.175+0000 7fcd1e000640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd28154e30 0x7fcd0c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd26a00640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 0x7fcd0c003da0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c240 tx=0x7fcd1801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08045416887efcb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180058e0 con 0x7fcd0c003980 2024-02-17T12:16:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18005a40 con 0x7fcd0c003980 2024-02-17T12:16:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd26000640 1 -- 172.21.15.114:0/1460891582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18005c10 con 0x7fcd0c003980 2024-02-17T12:16:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 -- 172.21.15.114:0/1460891582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 msgr2=0x7fcd0c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 --2- 172.21.15.114:0/1460891582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 0x7fcd0c003da0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c240 tx=0x7fcd1801cc80 comp rx=0 tx=0).stop 2024-02-17T12:16:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd27400640 1 -- 172.21.15.114:0/1460891582 reap_dead start 2024-02-17T12:16:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 -- 172.21.15.114:0/1460891582 shutdown_connections 2024-02-17T12:16:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 -- 172.21.15.114:0/1460891582 >> 172.21.15.114:0/1460891582 conn(0x7fcd280c4f20 msgr2=0x7fcd280c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 -- 172.21.15.114:0/1460891582 shutdown_connections 2024-02-17T12:16:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 -- 172.21.15.114:0/1460891582 wait complete. 2024-02-17T12:16:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 Processor -- start 2024-02-17T12:16:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 -- start start 2024-02-17T12:16:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 0x7fcd2806bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd2814fa70 0x7fcd281ee370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd280c37f0 0x7fcd2814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280719a0 con 0x7fcd0c003980 2024-02-17T12:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd281ee8b0 con 0x7fcd2814fa70 2024-02-17T12:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd2da00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2814eba0 con 0x7fcd280c37f0 2024-02-17T12:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd26a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 0x7fcd2806bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd26a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 0x7fcd2806bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55582/0 (socket says 172.21.15.114:55582) 2024-02-17T12:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd26a00640 1 -- 172.21.15.114:0/4290481546 learned_addr learned my addr 172.21.15.114:0/4290481546 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd1e000640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd2814fa70 0x7fcd281ee370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.179+0000 7fcd27400640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd280c37f0 0x7fcd2814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd26a00640 1 -- 172.21.15.114:0/4290481546 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd280c37f0 msgr2=0x7fcd2814f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd26a00640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd280c37f0 0x7fcd2814f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd26a00640 1 -- 172.21.15.114:0/4290481546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd2814fa70 msgr2=0x7fcd281ee370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd26a00640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd2814fa70 0x7fcd281ee370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd26a00640 1 -- 172.21.15.114:0/4290481546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2814df90 con 0x7fcd0c003980 2024-02-17T12:16:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd1e000640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd2814fa70 0x7fcd281ee370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd26a00640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 0x7fcd2806bc50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c240 tx=0x7fcd0c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd1f400640 1 -- 172.21.15.114:0/4290481546 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18005e70 con 0x7fcd0c003980 2024-02-17T12:16:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd1f400640 1 -- 172.21.15.114:0/4290481546 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd180a5870 con 0x7fcd0c003980 2024-02-17T12:16:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd2da00640 1 -- 172.21.15.114:0/4290481546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2814e270 con 0x7fcd0c003980 2024-02-17T12:16:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd1f400640 1 -- 172.21.15.114:0/4290481546 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180a5be0 con 0x7fcd0c003980 2024-02-17T12:16:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd2da00640 1 -- 172.21.15.114:0/4290481546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2814e830 con 0x7fcd0c003980 2024-02-17T12:16:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd2da00640 1 -- 172.21.15.114:0/4290481546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd28068180 con 0x7fcd0c003980 2024-02-17T12:16:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd1f400640 1 -- 172.21.15.114:0/4290481546 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fcd180a5d40 con 0x7fcd0c003980 2024-02-17T12:16:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd1f400640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd04066e70 0x7fcd04069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd1f400640 1 -- 172.21.15.114:0/4290481546 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd1811e490 con 0x7fcd0c003980 2024-02-17T12:16:49.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.183+0000 7fcd1e000640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd04066e70 0x7fcd04069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.187+0000 7fcd1e000640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd04066e70 0x7fcd04069330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd28153dd0 tx=0x7fcd1000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.187+0000 7fcd1f400640 1 -- 172.21.15.114:0/4290481546 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd180eb1e0 con 0x7fcd0c003980 2024-02-17T12:16:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.343+0000 7fcd2da00640 1 -- 172.21.15.114:0/4290481546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd28074840 con 0x7fcd0c003980 2024-02-17T12:16:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.343+0000 7fcd1f400640 1 -- 172.21.15.114:0/4290481546 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd180ee8a0 con 0x7fcd0c003980 2024-02-17T12:16:49.349 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:16:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 -- 172.21.15.114:0/4290481546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd04066e70 msgr2=0x7fcd04069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd04066e70 0x7fcd04069330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd28153dd0 tx=0x7fcd1000b040 comp rx=0 tx=0).stop 2024-02-17T12:16:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 -- 172.21.15.114:0/4290481546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 msgr2=0x7fcd2806bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 0x7fcd2806bc50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c240 tx=0x7fcd0c005800 comp rx=0 tx=0).stop 2024-02-17T12:16:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 -- 172.21.15.114:0/4290481546 shutdown_connections 2024-02-17T12:16:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd280c37f0 0x7fcd2814f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd2814fa70 0x7fcd281ee370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd04066e70 0x7fcd04069330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 --2- 172.21.15.114:0/4290481546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0c003980 0x7fcd2806bc50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 -- 172.21.15.114:0/4290481546 >> 172.21.15.114:0/4290481546 conn(0x7fcd280c4f20 msgr2=0x7fcd281576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 -- 172.21.15.114:0/4290481546 shutdown_connections 2024-02-17T12:16:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.347+0000 7fcd2da00640 1 -- 172.21.15.114:0/4290481546 wait complete. 2024-02-17T12:16:49.370 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:16:49.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f9106800640 1 Processor -- start 2024-02-17T12:16:49.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f9106800640 1 -- start start 2024-02-17T12:16:49.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f9106800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f910014f110 0x7f91000c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f9106800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f91000c2580 0x7f91000aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f9106800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91000a9420 con 0x7f91000c1eb0 2024-02-17T12:16:49.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f9106800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910014f4f0 con 0x7f91000c2580 2024-02-17T12:16:49.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f9106800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91000aae80 con 0x7f910014f110 2024-02-17T12:16:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90ffe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f91000c1eb0 0x7f9100155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49680/0 (socket says 172.21.15.114:49680) 2024-02-17T12:16:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90ffe00640 1 -- 172.21.15.114:0/847751704 learned_addr learned my addr 172.21.15.114:0/847751704 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90f6a00640 1 --2- 172.21.15.114:0/847751704 >> v2:172.21.15.116:3300/0 conn(0x7f91000c2580 0x7f91000aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90ff400640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f910014f110 0x7f91000c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227123331 0 0) 0x7f91000a9420 con 0x7f91000c1eb0 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90e4003530 con 0x7f91000c1eb0 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3923613187 0 0) 0x7f90e4003530 con 0x7f91000c1eb0 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f910014f110 msgr2=0x7f91000c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f910014f110 0x7f91000c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 >> v2:172.21.15.116:3300/0 conn(0x7f91000c2580 msgr2=0x7f91000aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 --2- 172.21.15.114:0/847751704 >> v2:172.21.15.116:3300/0 conn(0x7f91000c2580 0x7f91000aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9100152850 con 0x7f91000c1eb0 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f90f8001a00 con 0x7f91000c1eb0 2024-02-17T12:16:49.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 >> v1:172.21.15.114:6789/0 conn(0x7f91000c1eb0 legacy=0x7f9100155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f910014f110 0x7f90e4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90e4003f00 0x7f90e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90e4004d10 0x7f90e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910014f4f0 con 0x7f90e4003f00 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91000aae80 con 0x7f90e4004d10 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e400b9e0 con 0x7f910014f110 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90f6a00640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90e4003f00 0x7f90e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90ff400640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f910014f110 0x7f90e4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90ffe00640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90e4004d10 0x7f90e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90f6a00640 1 -- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f910014f110 msgr2=0x7f90e4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.503+0000 7f90f6a00640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f910014f110 0x7f90e4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f90f6a00640 1 -- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90e4004d10 msgr2=0x7f90e4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f90f6a00640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90e4004d10 0x7f90e4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f90f6a00640 1 -- 172.21.15.114:0/847751704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4003530 con 0x7f90e4003f00 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f90f6a00640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90e4003f00 0x7f90e40047d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009ae0 tx=0x7f90e801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8892544e5d4fdc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80a5610 con 0x7f90e4003f00 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e80a5770 con 0x7f90e4003f00 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f90fea00640 1 -- 172.21.15.114:0/847751704 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80a5b20 con 0x7f90e4003f00 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f9106800640 1 -- 172.21.15.114:0/847751704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90e4003f00 msgr2=0x7f90e40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f9106800640 1 --2- 172.21.15.114:0/847751704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90e4003f00 0x7f90e40047d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009ae0 tx=0x7f90e801ca40 comp rx=0 tx=0).stop 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f90ffe00640 1 -- 172.21.15.114:0/847751704 reap_dead start 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f9106800640 1 -- 172.21.15.114:0/847751704 shutdown_connections 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f9106800640 1 -- 172.21.15.114:0/847751704 >> 172.21.15.114:0/847751704 conn(0x7f91000a8490 msgr2=0x7f91000a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f9106800640 1 -- 172.21.15.114:0/847751704 shutdown_connections 2024-02-17T12:16:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.507+0000 7f9106800640 1 -- 172.21.15.114:0/847751704 wait complete. 2024-02-17T12:16:49.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f9106800640 1 Processor -- start 2024-02-17T12:16:49.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f9106800640 1 -- start start 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f9106800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90e4003f00 0x7f9100145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f9106800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91001ee390 0x7f910013e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f9106800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9100150350 0x7f910013e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f9106800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910014e760 con 0x7f9100150350 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f9106800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91001ee880 con 0x7f90e4003f00 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f9106800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910014de30 con 0x7f91001ee390 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9100150350 0x7f910013e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9100150350 0x7f910013e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55590/0 (socket says 172.21.15.114:55590) 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ffe00640 1 -- 172.21.15.114:0/328717869 learned_addr learned my addr 172.21.15.114:0/328717869 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90f6a00640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91001ee390 0x7f910013e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ff400640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90e4003f00 0x7f9100145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ffe00640 1 -- 172.21.15.114:0/328717869 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91001ee390 msgr2=0x7f910013e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ffe00640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91001ee390 0x7f910013e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ffe00640 1 -- 172.21.15.114:0/328717869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90e4003f00 msgr2=0x7f9100145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ffe00640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90e4003f00 0x7f9100145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ffe00640 1 -- 172.21.15.114:0/328717869 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910014e110 con 0x7f9100150350 2024-02-17T12:16:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ff400640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90e4003f00 0x7f9100145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90ffe00640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9100150350 0x7f910013e970 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90f80013e0 tx=0x7f90f8007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90f7e00640 1 -- 172.21.15.114:0/328717869 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f800ac20 con 0x7f9100150350 2024-02-17T12:16:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90f7e00640 1 -- 172.21.15.114:0/328717869 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f800ad80 con 0x7f9100150350 2024-02-17T12:16:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f9106800640 1 -- 172.21.15.114:0/328717869 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910014e3f0 con 0x7f9100150350 2024-02-17T12:16:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f90f7e00640 1 -- 172.21.15.114:0/328717869 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8013630 con 0x7f9100150350 2024-02-17T12:16:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.511+0000 7f9106800640 1 -- 172.21.15.114:0/328717869 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91001481b0 con 0x7f9100150350 2024-02-17T12:16:49.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.515+0000 7f9106800640 1 -- 172.21.15.114:0/328717869 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9100074840 con 0x7f9100150350 2024-02-17T12:16:49.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.515+0000 7f90f7e00640 1 -- 172.21.15.114:0/328717869 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f90f8013790 con 0x7f9100150350 2024-02-17T12:16:49.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.515+0000 7f90f7e00640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90dc066e40 0x7f90dc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.515+0000 7f90f7e00640 1 -- 172.21.15.114:0/328717869 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90f8085410 con 0x7f9100150350 2024-02-17T12:16:49.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.515+0000 7f90ff400640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90dc066e40 0x7f90dc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.515+0000 7f90ff400640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90dc066e40 0x7f90dc069300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009b00 tx=0x7f90f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:49.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.519+0000 7f90f7e00640 1 -- 172.21.15.114:0/328717869 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f90f80521f0 con 0x7f9100150350 2024-02-17T12:16:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.671+0000 7f9106800640 1 -- 172.21.15.114:0/328717869 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9100150ce0 con 0x7f9100150350 2024-02-17T12:16:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f90f7e00640 1 -- 172.21.15.114:0/328717869 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90f80558b0 con 0x7f9100150350 2024-02-17T12:16:49.678 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:16:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 -- 172.21.15.114:0/328717869 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90dc066e40 msgr2=0x7f90dc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90dc066e40 0x7f90dc069300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009b00 tx=0x7f90f0008040 comp rx=0 tx=0).stop 2024-02-17T12:16:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 -- 172.21.15.114:0/328717869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9100150350 msgr2=0x7f910013e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9100150350 0x7f910013e970 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90f80013e0 tx=0x7f90f8007bd0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 -- 172.21.15.114:0/328717869 shutdown_connections 2024-02-17T12:16:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90dc066e40 0x7f90dc069300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9100150350 0x7f910013e970 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91001ee390 0x7f910013e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 --2- 172.21.15.114:0/328717869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90e4003f00 0x7f9100145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 -- 172.21.15.114:0/328717869 >> 172.21.15.114:0/328717869 conn(0x7f91000a8490 msgr2=0x7f91000a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 -- 172.21.15.114:0/328717869 shutdown_connections 2024-02-17T12:16:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.675+0000 7f9106800640 1 -- 172.21.15.114:0/328717869 wait complete. 2024-02-17T12:16:49.699 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:16:49.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f8bc00640 1 Processor -- start 2024-02-17T12:16:49.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f8bc00640 1 -- start start 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f8bc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8f840c11d0 0x7f8f840c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f8bc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f84158f10 con 0x7f8f841525f0 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f8bc00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f841591f0 con 0x7f8f841558e0 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f8bc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f841594d0 con 0x7f8f840c11d0 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f89200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8f841525f0 0x7f8f840c5110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49696/0 (socket says 172.21.15.114:49696) 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f89200640 1 -- 172.21.15.114:0/1479568884 learned_addr learned my addr 172.21.15.114:0/1479568884 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f89c00640 1 --2- 172.21.15.114:0/1479568884 >> v2:172.21.15.114:3300/0 conn(0x7f8f840c11d0 0x7f8f840c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f83400640 1 -- 172.21.15.114:0/1479568884 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185037639 0 0) 0x7f8f84158f10 con 0x7f8f841525f0 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f89c00640 1 -- 172.21.15.114:0/1479568884 >> v1:172.21.15.116:6789/0 conn(0x7f8f841558e0 legacy=0x7f8f841584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f89c00640 1 -- 172.21.15.114:0/1479568884 >> v1:172.21.15.114:6789/0 conn(0x7f8f841525f0 legacy=0x7f8f840c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.831+0000 7f8f89c00640 1 -- 172.21.15.114:0/1479568884 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f841550e0 con 0x7f8f840c11d0 2024-02-17T12:16:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f89c00640 1 --2- 172.21.15.114:0/1479568884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f840c11d0 0x7f8f840c1600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009d90 tx=0x7f8f7c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc310aba1eada9b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f83400640 1 -- 172.21.15.114:0/1479568884 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0a57e0 con 0x7f8f840c11d0 2024-02-17T12:16:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f83400640 1 -- 172.21.15.114:0/1479568884 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c0a5940 con 0x7f8f840c11d0 2024-02-17T12:16:49.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f83400640 1 -- 172.21.15.114:0/1479568884 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0a5cd0 con 0x7f8f840c11d0 2024-02-17T12:16:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f8bc00640 1 -- 172.21.15.114:0/1479568884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f840c11d0 msgr2=0x7f8f840c1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f8bc00640 1 --2- 172.21.15.114:0/1479568884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f840c11d0 0x7f8f840c1600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009d90 tx=0x7f8f7c01c8a0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f8bc00640 1 -- 172.21.15.114:0/1479568884 shutdown_connections 2024-02-17T12:16:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f8bc00640 1 --2- 172.21.15.114:0/1479568884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f840c11d0 0x7f8f840c1600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f8bc00640 1 -- 172.21.15.114:0/1479568884 >> 172.21.15.114:0/1479568884 conn(0x7f8f8406b210 msgr2=0x7f8f840c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f8bc00640 1 -- 172.21.15.114:0/1479568884 shutdown_connections 2024-02-17T12:16:49.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f8bc00640 1 -- 172.21.15.114:0/1479568884 wait complete. 2024-02-17T12:16:49.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.835+0000 7f8f8bc00640 1 Processor -- start 2024-02-17T12:16:49.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f8bc00640 1 -- start start 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f8bc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f840c11d0 0x7f8f840aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f8bc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f841525f0 0x7f8f84150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f8bc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841558e0 0x7f8f841509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f8bc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f841ee850 con 0x7f8f841558e0 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f8bc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840ab770 con 0x7f8f840c11d0 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f8bc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8414fa90 con 0x7f8f841525f0 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f89c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841558e0 0x7f8f841509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f89c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841558e0 0x7f8f841509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55600/0 (socket says 172.21.15.114:55600) 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f89c00640 1 -- 172.21.15.114:0/32917677 learned_addr learned my addr 172.21.15.114:0/32917677 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f89200640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f840c11d0 0x7f8f840aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f83e00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f841525f0 0x7f8f84150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f89c00640 1 -- 172.21.15.114:0/32917677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f841525f0 msgr2=0x7f8f84150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f89c00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f841525f0 0x7f8f84150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f89c00640 1 -- 172.21.15.114:0/32917677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f840c11d0 msgr2=0x7f8f840aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f89c00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f840c11d0 0x7f8f840aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f89c00640 1 -- 172.21.15.114:0/32917677 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c009a70 con 0x7f8f841558e0 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f89c00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841558e0 0x7f8f841509a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009d90 tx=0x7f8f7c019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f80c00640 1 -- 172.21.15.114:0/32917677 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0ad850 con 0x7f8f841558e0 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f80c00640 1 -- 172.21.15.114:0/32917677 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c0ad9b0 con 0x7f8f841558e0 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f80c00640 1 -- 172.21.15.114:0/32917677 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0add60 con 0x7f8f841558e0 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f8bc00640 1 -- 172.21.15.114:0/32917677 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f840abca0 con 0x7f8f841558e0 2024-02-17T12:16:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f8bc00640 1 -- 172.21.15.114:0/32917677 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f840ab490 con 0x7f8f841558e0 2024-02-17T12:16:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f8bc00640 1 -- 172.21.15.114:0/32917677 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f84074840 con 0x7f8f841558e0 2024-02-17T12:16:49.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.839+0000 7f8f80c00640 1 -- 172.21.15.114:0/32917677 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8f7c0b4050 con 0x7f8f841558e0 2024-02-17T12:16:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.843+0000 7f8f80c00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f60066e40 0x7f8f60069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.843+0000 7f8f80c00640 1 -- 172.21.15.114:0/32917677 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f7c11f220 con 0x7f8f841558e0 2024-02-17T12:16:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.843+0000 7f8f89200640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f60066e40 0x7f8f60069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:49.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.843+0000 7f8f89200640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f60066e40 0x7f8f60069300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c000f70 tx=0x7f8f6c007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:49.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:49.847+0000 7f8f80c00640 1 -- 172.21.15.114:0/32917677 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8f7c0ec0b0 con 0x7f8f841558e0 2024-02-17T12:16:50.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.011+0000 7f8f8bc00640 1 -- 172.21.15.114:0/32917677 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f840c32b0 con 0x7f8f841558e0 2024-02-17T12:16:50.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.011+0000 7f8f80c00640 1 -- 172.21.15.114:0/32917677 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f7c0ef770 con 0x7f8f841558e0 2024-02-17T12:16:50.017 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 -- 172.21.15.114:0/32917677 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f60066e40 msgr2=0x7f8f60069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f60066e40 0x7f8f60069300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c000f70 tx=0x7f8f6c007df0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 -- 172.21.15.114:0/32917677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841558e0 msgr2=0x7f8f841509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841558e0 0x7f8f841509a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009d90 tx=0x7f8f7c019640 comp rx=0 tx=0).stop 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 -- 172.21.15.114:0/32917677 shutdown_connections 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f60066e40 0x7f8f60069300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f841558e0 0x7f8f841509a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f841525f0 0x7f8f84150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 --2- 172.21.15.114:0/32917677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f840c11d0 0x7f8f840aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 -- 172.21.15.114:0/32917677 >> 172.21.15.114:0/32917677 conn(0x7f8f8406b210 msgr2=0x7f8f84153cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:50.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 -- 172.21.15.114:0/32917677 shutdown_connections 2024-02-17T12:16:50.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.015+0000 7f8f8bc00640 1 -- 172.21.15.114:0/32917677 wait complete. 2024-02-17T12:16:50.040 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-17T12:16:50.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:50.040 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-02-17T12:16:50.075 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:16:50.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:50.075 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-17T12:16:50.139 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:16:50.140 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:16:50.148 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:16:50.148 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:16:50.200 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:16:50.200 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:16:50.248 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:50.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89ff200640 1 Processor -- start 2024-02-17T12:16:50.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89ff200640 1 -- start start 2024-02-17T12:16:50.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89ff200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a0006fdc0 0x7f8a00152d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89ff200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a000c2620 0x7f8a001532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89ff200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a00070c60 con 0x7f8a00150190 2024-02-17T12:16:50.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89ff200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a00070370 con 0x7f8a0006fdc0 2024-02-17T12:16:50.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89ff200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00070610 con 0x7f8a000c2620 2024-02-17T12:16:50.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89fd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a0006fdc0 0x7f8a00152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89fd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a0006fdc0 0x7f8a00152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55610/0 (socket says 172.21.15.114:55610) 2024-02-17T12:16:50.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89fd400640 1 -- 172.21.15.114:0/4076316598 learned_addr learned my addr 172.21.15.114:0/4076316598 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:50.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89fe800640 1 --2- 172.21.15.114:0/4076316598 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a000c2620 0x7f8a001532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89fd400640 1 -- 172.21.15.114:0/4076316598 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a000c2620 msgr2=0x7f8a001532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:50.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89fd400640 1 --2- 172.21.15.114:0/4076316598 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a000c2620 0x7f8a001532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89fca00640 1 -- 172.21.15.114:0/4076316598 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575162792 0 0) 0x7f8a00070c60 con 0x7f8a00150190 2024-02-17T12:16:50.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89fd400640 1 -- 172.21.15.114:0/4076316598 >> v1:172.21.15.116:6789/0 conn(0x7f8a00150190 legacy=0x7f8a000aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89fd400640 1 -- 172.21.15.114:0/4076316598 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a000708f0 con 0x7f8a0006fdc0 2024-02-17T12:16:50.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.383+0000 7f89fe800640 1 --2- 172.21.15.114:0/4076316598 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a000c2620 0x7f8a001532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:50.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89fd400640 1 --2- 172.21.15.114:0/4076316598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0006fdc0 0x7f8a00152d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009870 tx=0x7f89e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a240561ed2ad33ef server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:50.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89fca00640 1 -- 172.21.15.114:0/4076316598 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e80ab600 con 0x7f8a0006fdc0 2024-02-17T12:16:50.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89fca00640 1 -- 172.21.15.114:0/4076316598 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e80a7050 con 0x7f8a0006fdc0 2024-02-17T12:16:50.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89fca00640 1 -- 172.21.15.114:0/4076316598 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e80ab980 con 0x7f8a0006fdc0 2024-02-17T12:16:50.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89ff200640 1 -- 172.21.15.114:0/4076316598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0006fdc0 msgr2=0x7f8a00152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89ff200640 1 --2- 172.21.15.114:0/4076316598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0006fdc0 0x7f8a00152d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009870 tx=0x7f89e801c4d0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89ff200640 1 -- 172.21.15.114:0/4076316598 shutdown_connections 2024-02-17T12:16:50.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89ff200640 1 --2- 172.21.15.114:0/4076316598 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a000c2620 0x7f8a001532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89ff200640 1 --2- 172.21.15.114:0/4076316598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0006fdc0 0x7f8a00152d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89ff200640 1 -- 172.21.15.114:0/4076316598 >> 172.21.15.114:0/4076316598 conn(0x7f8a0006ed70 msgr2=0x7f8a0006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:50.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89ff200640 1 -- 172.21.15.114:0/4076316598 shutdown_connections 2024-02-17T12:16:50.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89ff200640 1 -- 172.21.15.114:0/4076316598 wait complete. 2024-02-17T12:16:50.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89ff200640 1 Processor -- start 2024-02-17T12:16:50.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.387+0000 7f89ff200640 1 -- start start 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89ff200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a0006fdc0 0x7f8a001eb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89ff200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a000c2620 0x7f8a00151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89ff200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a00150190 0x7f8a00154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89ff200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a001ec500 con 0x7f8a000c2620 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89ff200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a00156a70 con 0x7f8a00150190 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89ff200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a001547f0 con 0x7f8a0006fdc0 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a000c2620 0x7f8a00151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fde00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a0006fdc0 0x7f8a001eb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a000c2620 0x7f8a00151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55624/0 (socket says 172.21.15.114:55624) 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fd400640 1 -- 172.21.15.114:0/2338809836 learned_addr learned my addr 172.21.15.114:0/2338809836 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:50.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fe800640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a00150190 0x7f8a00154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fd400640 1 -- 172.21.15.114:0/2338809836 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a0006fdc0 msgr2=0x7f8a001eb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fd400640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a0006fdc0 0x7f8a001eb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fd400640 1 -- 172.21.15.114:0/2338809836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a00150190 msgr2=0x7f8a00154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fd400640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a00150190 0x7f8a00154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fd400640 1 -- 172.21.15.114:0/2338809836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f8009420 con 0x7f8a000c2620 2024-02-17T12:16:50.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fde00640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a0006fdc0 0x7f8a001eb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:50.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89fd400640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a000c2620 0x7f8a00151a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89e80ae040 tx=0x7f89e8019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:50.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89f6000640 1 -- 172.21.15.114:0/2338809836 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e80b4440 con 0x7f8a000c2620 2024-02-17T12:16:50.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89f6000640 1 -- 172.21.15.114:0/2338809836 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e80b45a0 con 0x7f8a000c2620 2024-02-17T12:16:50.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89f6000640 1 -- 172.21.15.114:0/2338809836 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e80b4950 con 0x7f8a000c2620 2024-02-17T12:16:50.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89ff200640 1 -- 172.21.15.114:0/2338809836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e80094d0 con 0x7f8a000c2620 2024-02-17T12:16:50.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89ff200640 1 -- 172.21.15.114:0/2338809836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a00156ff0 con 0x7f8a000c2620 2024-02-17T12:16:50.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.391+0000 7f89ff200640 1 -- 172.21.15.114:0/2338809836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a00068180 con 0x7f8a000c2620 2024-02-17T12:16:50.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.395+0000 7f89f6000640 1 -- 172.21.15.114:0/2338809836 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f89e80b2070 con 0x7f8a000c2620 2024-02-17T12:16:50.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.395+0000 7f89f6000640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f89dc066e40 0x7f89dc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.395+0000 7f89f6000640 1 -- 172.21.15.114:0/2338809836 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89e811e7b0 con 0x7f8a000c2620 2024-02-17T12:16:50.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.395+0000 7f89fde00640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f89dc066e40 0x7f89dc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.395+0000 7f89fde00640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f89dc066e40 0x7f89dc069300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f89f00012f0 tx=0x7f89f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:50.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.399+0000 7f89f6000640 1 -- 172.21.15.114:0/2338809836 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f89e80eb640 con 0x7f8a000c2620 2024-02-17T12:16:50.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.555+0000 7f89ff200640 1 -- 172.21.15.114:0/2338809836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a00154cf0 con 0x7f8a000c2620 2024-02-17T12:16:50.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89f6000640 1 -- 172.21.15.114:0/2338809836 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f89e80b0090 con 0x7f8a000c2620 2024-02-17T12:16:50.563 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:50.563 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 -- 172.21.15.114:0/2338809836 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f89dc066e40 msgr2=0x7f89dc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f89dc066e40 0x7f89dc069300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f89f00012f0 tx=0x7f89f0009040 comp rx=0 tx=0).stop 2024-02-17T12:16:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 -- 172.21.15.114:0/2338809836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a000c2620 msgr2=0x7f8a00151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a000c2620 0x7f8a00151a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89e80ae040 tx=0x7f89e8019270 comp rx=0 tx=0).stop 2024-02-17T12:16:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 -- 172.21.15.114:0/2338809836 shutdown_connections 2024-02-17T12:16:50.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a00150190 0x7f8a00154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f89dc066e40 0x7f89dc069300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a000c2620 0x7f8a00151a30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 --2- 172.21.15.114:0/2338809836 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8a0006fdc0 0x7f8a001eb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 -- 172.21.15.114:0/2338809836 >> 172.21.15.114:0/2338809836 conn(0x7f8a0006ed70 msgr2=0x7f8a000c6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:50.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 -- 172.21.15.114:0/2338809836 shutdown_connections 2024-02-17T12:16:50.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.559+0000 7f89ff200640 1 -- 172.21.15.114:0/2338809836 wait complete. 2024-02-17T12:16:50.585 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:16:21.236908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:16:21.659009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:50.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:50.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe822e00640 1 Processor -- start 2024-02-17T12:16:50.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe822e00640 1 -- start start 2024-02-17T12:16:50.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe822e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe81c0c58b0 0x7fe81c1583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe822e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c155090 con 0x7fe81c0c4b30 2024-02-17T12:16:50.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe822e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c159300 con 0x7fe81c0a6360 2024-02-17T12:16:50.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe822e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c0c6110 con 0x7fe81c0c58b0 2024-02-17T12:16:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe81be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe81c0c58b0 0x7fe81c1583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe81b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe81c0c4b30 0x7fe81c06bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49708/0 (socket says 172.21.15.114:49708) 2024-02-17T12:16:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe81b400640 1 -- 172.21.15.114:0/3990373289 learned_addr learned my addr 172.21.15.114:0/3990373289 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe81be00640 1 -- 172.21.15.114:0/3990373289 >> v1:172.21.15.116:6789/0 conn(0x7fe81c0a6360 legacy=0x7fe81c155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe81be00640 1 -- 172.21.15.114:0/3990373289 >> v1:172.21.15.114:6789/0 conn(0x7fe81c0c4b30 legacy=0x7fe81c06bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe81aa00640 1 -- 172.21.15.114:0/3990373289 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846707219 0 0) 0x7fe81c155090 con 0x7fe81c0c4b30 2024-02-17T12:16:50.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.719+0000 7fe81be00640 1 -- 172.21.15.114:0/3990373289 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c158a60 con 0x7fe81c0c58b0 2024-02-17T12:16:50.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.723+0000 7fe81be00640 1 --2- 172.21.15.114:0/3990373289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c58b0 0x7fe81c1583d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0097c0 tx=0x7fe80c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0c0e75c6e2ee88 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:50.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.723+0000 7fe81aa00640 1 -- 172.21.15.114:0/3990373289 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0ab670 con 0x7fe81c0c58b0 2024-02-17T12:16:50.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.723+0000 7fe81aa00640 1 -- 172.21.15.114:0/3990373289 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c0ab7d0 con 0x7fe81c0c58b0 2024-02-17T12:16:50.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.723+0000 7fe81aa00640 1 -- 172.21.15.114:0/3990373289 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0abb60 con 0x7fe81c0c58b0 2024-02-17T12:16:50.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 -- 172.21.15.114:0/3990373289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c58b0 msgr2=0x7fe81c1583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 --2- 172.21.15.114:0/3990373289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c58b0 0x7fe81c1583d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0097c0 tx=0x7fe80c01c470 comp rx=0 tx=0).stop 2024-02-17T12:16:50.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 -- 172.21.15.114:0/3990373289 shutdown_connections 2024-02-17T12:16:50.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 --2- 172.21.15.114:0/3990373289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c58b0 0x7fe81c1583d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 -- 172.21.15.114:0/3990373289 >> 172.21.15.114:0/3990373289 conn(0x7fe81c0c3730 msgr2=0x7fe81c0c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:50.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 -- 172.21.15.114:0/3990373289 shutdown_connections 2024-02-17T12:16:50.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 -- 172.21.15.114:0/3990373289 wait complete. 2024-02-17T12:16:50.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 Processor -- start 2024-02-17T12:16:50.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 -- start start 2024-02-17T12:16:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe81c0a6360 0x7fe81c14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c4b30 0x7fe81c1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0c58b0 0x7fe81c0aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0abb00 con 0x7fe81c0c4b30 2024-02-17T12:16:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1edd60 con 0x7fe81c0c58b0 2024-02-17T12:16:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe822e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1ee000 con 0x7fe81c0a6360 2024-02-17T12:16:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe81b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c4b30 0x7fe81c1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe81b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c4b30 0x7fe81c1573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55632/0 (socket says 172.21.15.114:55632) 2024-02-17T12:16:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe81b400640 1 -- 172.21.15.114:0/3631133189 learned_addr learned my addr 172.21.15.114:0/3631133189 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe81be00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe81c0a6360 0x7fe81c14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe820e00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0c58b0 0x7fe81c0aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe81b400640 1 -- 172.21.15.114:0/3631133189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe81c0a6360 msgr2=0x7fe81c14fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe81b400640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe81c0a6360 0x7fe81c14fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe81b400640 1 -- 172.21.15.114:0/3631133189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0c58b0 msgr2=0x7fe81c0aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe81b400640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0c58b0 0x7fe81c0aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.727+0000 7fe81b400640 1 -- 172.21.15.114:0/3631133189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c009420 con 0x7fe81c0c4b30 2024-02-17T12:16:50.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe81b400640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c4b30 0x7fe81c1573c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c480 tx=0x7fe80400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe813e00640 1 -- 172.21.15.114:0/3631133189 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040074e0 con 0x7fe81c0c4b30 2024-02-17T12:16:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe813e00640 1 -- 172.21.15.114:0/3631133189 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe804007640 con 0x7fe81c0c4b30 2024-02-17T12:16:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe813e00640 1 -- 172.21.15.114:0/3631133189 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804004a10 con 0x7fe81c0c4b30 2024-02-17T12:16:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe822e00640 1 -- 172.21.15.114:0/3631133189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c1ee2e0 con 0x7fe81c0c4b30 2024-02-17T12:16:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe822e00640 1 -- 172.21.15.114:0/3631133189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c0a9e50 con 0x7fe81c0c4b30 2024-02-17T12:16:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe822e00640 1 -- 172.21.15.114:0/3631133189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c067170 con 0x7fe81c0c4b30 2024-02-17T12:16:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe813e00640 1 -- 172.21.15.114:0/3631133189 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe804004b70 con 0x7fe81c0c4b30 2024-02-17T12:16:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe813e00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 0x7fe7f8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe813e00640 1 -- 172.21.15.114:0/3631133189 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe804083c10 con 0x7fe81c0c4b30 2024-02-17T12:16:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe81be00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 0x7fe7f8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:50.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.731+0000 7fe81be00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 0x7fe7f8069300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0af000 tx=0x7fe80c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.735+0000 7fe813e00640 1 -- 172.21.15.114:0/3631133189 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe804050b40 con 0x7fe81c0c4b30 2024-02-17T12:16:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.891+0000 7fe822e00640 1 -- 172.21.15.114:0/3631133189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe81c0aa070 con 0x7fe81c0c4b30 2024-02-17T12:16:50.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.891+0000 7fe813e00640 1 -- 172.21.15.114:0/3631133189 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe804018070 con 0x7fe81c0c4b30 2024-02-17T12:16:50.897 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 -- 172.21.15.114:0/3631133189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 msgr2=0x7fe7f8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 0x7fe7f8069300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0af000 tx=0x7fe80c0a7000 comp rx=0 tx=0).stop 2024-02-17T12:16:50.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 -- 172.21.15.114:0/3631133189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c4b30 msgr2=0x7fe81c1573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:50.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c4b30 0x7fe81c1573c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c480 tx=0x7fe80400c940 comp rx=0 tx=0).stop 2024-02-17T12:16:50.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 -- 172.21.15.114:0/3631133189 shutdown_connections 2024-02-17T12:16:50.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe81c0c58b0 0x7fe81c0aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 0x7fe7f8069300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe81c0c4b30 0x7fe81c1573c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 --2- 172.21.15.114:0/3631133189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe81c0a6360 0x7fe81c14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:50.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 -- 172.21.15.114:0/3631133189 >> 172.21.15.114:0/3631133189 conn(0x7fe81c0c3730 msgr2=0x7fe81c152f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:50.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 -- 172.21.15.114:0/3631133189 shutdown_connections 2024-02-17T12:16:50.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:50.895+0000 7fe822e00640 1 -- 172.21.15.114:0/3631133189 wait complete. 2024-02-17T12:16:50.918 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:16:51.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24e0e00640 1 Processor -- start 2024-02-17T12:16:51.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24e0e00640 1 -- start start 2024-02-17T12:16:51.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24e0e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f24dc06db50 0x7f24dc14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24e0e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24dc156270 con 0x7f24dc0c25a0 2024-02-17T12:16:51.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24e0e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24dc156550 con 0x7f24dc150490 2024-02-17T12:16:51.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24e0e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24dc06f090 con 0x7f24dc06db50 2024-02-17T12:16:51.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d9e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f24dc0c25a0 0x7f24dc06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49712/0 (socket says 172.21.15.114:49712) 2024-02-17T12:16:51.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d9e00640 1 -- 172.21.15.114:0/1023178691 learned_addr learned my addr 172.21.15.114:0/1023178691 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:51.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d9400640 1 --2- 172.21.15.114:0/1023178691 >> v2:172.21.15.116:3300/0 conn(0x7f24dc06db50 0x7f24dc14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309515313 0 0) 0x7f24dc156270 con 0x7f24dc0c25a0 2024-02-17T12:16:51.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c0003530 con 0x7f24dc0c25a0 2024-02-17T12:16:51.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2391278200 0 0) 0x7f24c0003530 con 0x7f24dc0c25a0 2024-02-17T12:16:51.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 >> v2:172.21.15.116:3300/0 conn(0x7f24dc06db50 msgr2=0x7f24dc14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:51.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 --2- 172.21.15.114:0/1023178691 >> v2:172.21.15.116:3300/0 conn(0x7f24dc06db50 0x7f24dc14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 >> v1:172.21.15.116:6789/0 conn(0x7f24dc150490 legacy=0x7f24dc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc156830 con 0x7f24dc0c25a0 2024-02-17T12:16:51.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f24cc001680 con 0x7f24dc0c25a0 2024-02-17T12:16:51.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 >> v1:172.21.15.114:6789/0 conn(0x7f24dc0c25a0 legacy=0x7f24dc06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c00039d0 0x7f24c0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24c00047d0 0x7f24c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f24c00052b0 0x7f24c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc06f090 con 0x7f24c00047d0 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c000c1b0 con 0x7f24c00039d0 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c000c370 con 0x7f24c00052b0 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d9400640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24c00047d0 0x7f24c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24d9e00640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c00039d0 0x7f24c0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.051+0000 7f24da800640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f24c00052b0 0x7f24c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24d9400640 1 -- 172.21.15.114:0/1023178691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f24c00052b0 msgr2=0x7f24c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24d9400640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f24c00052b0 0x7f24c000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24d9400640 1 -- 172.21.15.114:0/1023178691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c00039d0 msgr2=0x7f24c0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24d9400640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24c00039d0 0x7f24c0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24d9400640 1 -- 172.21.15.114:0/1023178691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c0003530 con 0x7f24c00047d0 2024-02-17T12:16:51.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24da800640 1 -- 172.21.15.114:0/1023178691 reap_dead start 2024-02-17T12:16:51.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24d9400640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24c00047d0 0x7f24c0004c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f24c800de10 tx=0x7f24c8020ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5966b01b63ce5cc0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:51.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c800d2d0 con 0x7f24c00047d0 2024-02-17T12:16:51.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c8013040 con 0x7f24c00047d0 2024-02-17T12:16:51.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24d8a00640 1 -- 172.21.15.114:0/1023178691 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a98f0 con 0x7f24c00047d0 2024-02-17T12:16:51.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24e0e00640 1 -- 172.21.15.114:0/1023178691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24c00047d0 msgr2=0x7f24c0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24e0e00640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24c00047d0 0x7f24c0004c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f24c800de10 tx=0x7f24c8020ac0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24e0e00640 1 -- 172.21.15.114:0/1023178691 shutdown_connections 2024-02-17T12:16:51.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24e0e00640 1 --2- 172.21.15.114:0/1023178691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24c00047d0 0x7f24c0004c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24e0e00640 1 -- 172.21.15.114:0/1023178691 >> 172.21.15.114:0/1023178691 conn(0x7f24dc0a8490 msgr2=0x7f24dc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:51.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24e0e00640 1 -- 172.21.15.114:0/1023178691 shutdown_connections 2024-02-17T12:16:51.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.055+0000 7f24e0e00640 1 -- 172.21.15.114:0/1023178691 wait complete. 2024-02-17T12:16:51.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24e0e00640 1 Processor -- start 2024-02-17T12:16:51.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24e0e00640 1 -- start start 2024-02-17T12:16:51.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24e0e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f24c00047d0 0x7f24dc1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24e0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc0c59e0 0x7f24dc1e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24e0e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24dc1ea010 0x7f24dc1dd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24e0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc14e7a0 con 0x7f24dc0c59e0 2024-02-17T12:16:51.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24e0e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc14fa50 con 0x7f24dc1ea010 2024-02-17T12:16:51.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24e0e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc143e90 con 0x7f24c00047d0 2024-02-17T12:16:51.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc0c59e0 0x7f24dc1e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc0c59e0 0x7f24dc1e9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55646/0 (socket says 172.21.15.114:55646) 2024-02-17T12:16:51.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9400640 1 -- 172.21.15.114:0/1975887087 learned_addr learned my addr 172.21.15.114:0/1975887087 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:51.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9e00640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f24c00047d0 0x7f24dc1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24da800640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24dc1ea010 0x7f24dc1dd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9400640 1 -- 172.21.15.114:0/1975887087 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f24c00047d0 msgr2=0x7f24dc1491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9400640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f24c00047d0 0x7f24dc1491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9400640 1 -- 172.21.15.114:0/1975887087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24dc1ea010 msgr2=0x7f24dc1dd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9400640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24dc1ea010 0x7f24dc1dd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9400640 1 -- 172.21.15.114:0/1975887087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc14f490 con 0x7f24dc0c59e0 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9e00640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f24c00047d0 0x7f24dc1491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24da800640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24dc1ea010 0x7f24dc1dd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d9400640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc0c59e0 0x7f24dc1e9ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f24c80b3040 tx=0x7f24c800d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d2000640 1 -- 172.21.15.114:0/1975887087 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a98b0 con 0x7f24dc0c59e0 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d2000640 1 -- 172.21.15.114:0/1975887087 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c80a9a10 con 0x7f24dc0c59e0 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24e0e00640 1 -- 172.21.15.114:0/1975887087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24dc14f770 con 0x7f24dc0c59e0 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24d2000640 1 -- 172.21.15.114:0/1975887087 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a9d80 con 0x7f24dc0c59e0 2024-02-17T12:16:51.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.059+0000 7f24e0e00640 1 -- 172.21.15.114:0/1975887087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc149700 con 0x7f24dc0c59e0 2024-02-17T12:16:51.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.063+0000 7f24e0e00640 1 -- 172.21.15.114:0/1975887087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24dc1e9410 con 0x7f24dc0c59e0 2024-02-17T12:16:51.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.063+0000 7f24d2000640 1 -- 172.21.15.114:0/1975887087 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f24c8006040 con 0x7f24dc0c59e0 2024-02-17T12:16:51.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.063+0000 7f24d2000640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f24bc066e70 0x7f24bc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.063+0000 7f24d2000640 1 -- 172.21.15.114:0/1975887087 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24c8123170 con 0x7f24dc0c59e0 2024-02-17T12:16:51.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.063+0000 7f24d9e00640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f24bc066e70 0x7f24bc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.063+0000 7f24d9e00640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f24bc066e70 0x7f24bc069330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f24dc14d740 tx=0x7f24cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:51.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.067+0000 7f24d2000640 1 -- 172.21.15.114:0/1975887087 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f24dc1e9410 con 0x7f24dc0c59e0 2024-02-17T12:16:51.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.219+0000 7f24e0e00640 1 -- 172.21.15.114:0/1975887087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24dc1e9410 con 0x7f24dc0c59e0 2024-02-17T12:16:51.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24d2000640 1 -- 172.21.15.114:0/1975887087 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24dc1e9410 con 0x7f24dc0c59e0 2024-02-17T12:16:51.226 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:16:51.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 -- 172.21.15.114:0/1975887087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f24bc066e70 msgr2=0x7f24bc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f24bc066e70 0x7f24bc069330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f24dc14d740 tx=0x7f24cc009040 comp rx=0 tx=0).stop 2024-02-17T12:16:51.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 -- 172.21.15.114:0/1975887087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc0c59e0 msgr2=0x7f24dc1e9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc0c59e0 0x7f24dc1e9ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f24c80b3040 tx=0x7f24c800d5a0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 -- 172.21.15.114:0/1975887087 shutdown_connections 2024-02-17T12:16:51.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24dc1ea010 0x7f24dc1dd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f24bc066e70 0x7f24bc069330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24dc0c59e0 0x7f24dc1e9ad0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 --2- 172.21.15.114:0/1975887087 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f24c00047d0 0x7f24dc1491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 -- 172.21.15.114:0/1975887087 >> 172.21.15.114:0/1975887087 conn(0x7f24dc0a8490 msgr2=0x7f24dc0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:51.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 -- 172.21.15.114:0/1975887087 shutdown_connections 2024-02-17T12:16:51.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.223+0000 7f24e0e00640 1 -- 172.21.15.114:0/1975887087 wait complete. 2024-02-17T12:16:51.246 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:16:51.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.379+0000 7f47c4600640 1 Processor -- start 2024-02-17T12:16:51.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.379+0000 7f47c4600640 1 -- start start 2024-02-17T12:16:51.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.379+0000 7f47c4600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc14f110 0x7f47bc0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.379+0000 7f47c4600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f47bc0c1eb0 0x7f47bc15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.379+0000 7f47c4600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc0a9420 con 0x7f47bc0c2580 2024-02-17T12:16:51.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.379+0000 7f47c4600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc14f4f0 con 0x7f47bc0c1eb0 2024-02-17T12:16:51.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.379+0000 7f47c4600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0aae80 con 0x7f47bc14f110 2024-02-17T12:16:51.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47c2600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f47bc0c1eb0 0x7f47bc15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47c1c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc14f110 0x7f47bc0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47c2600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f47bc0c1eb0 0x7f47bc15c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:45740/0 (socket says 172.21.15.114:45740) 2024-02-17T12:16:51.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47c2600640 1 -- 172.21.15.114:0/307499188 learned_addr learned my addr 172.21.15.114:0/307499188 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:51.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47c1200640 1 --1- 172.21.15.114:0/307499188 >> v1:172.21.15.116:6789/0 conn(0x7f47bc0c2580 0x7f47bc0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:50642/0 (socket says 172.21.15.114:50642) 2024-02-17T12:16:51.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47c2600640 1 -- 172.21.15.114:0/307499188 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc14f110 msgr2=0x7f47bc0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:51.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47c2600640 1 --2- 172.21.15.114:0/307499188 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc14f110 0x7f47bc0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47c2600640 1 -- 172.21.15.114:0/307499188 >> v1:172.21.15.116:6789/0 conn(0x7f47bc0c2580 legacy=0x7f47bc0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47c2600640 1 -- 172.21.15.114:0/307499188 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc152850 con 0x7f47bc0c1eb0 2024-02-17T12:16:51.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47c2600640 1 --2- 172.21.15.114:0/307499188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc0c1eb0 0x7f47bc15c390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009e50 tx=0x7f47b401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de65b22e5399107 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:51.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.383+0000 7f47bbe00640 1 -- 172.21.15.114:0/307499188 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40a5830 con 0x7f47bc0c1eb0 2024-02-17T12:16:51.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47bbe00640 1 -- 172.21.15.114:0/307499188 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b40a5990 con 0x7f47bc0c1eb0 2024-02-17T12:16:51.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47bbe00640 1 -- 172.21.15.114:0/307499188 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40a5d20 con 0x7f47bc0c1eb0 2024-02-17T12:16:51.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 -- 172.21.15.114:0/307499188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc0c1eb0 msgr2=0x7f47bc15c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 --2- 172.21.15.114:0/307499188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc0c1eb0 0x7f47bc15c390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009e50 tx=0x7f47b401c970 comp rx=0 tx=0).stop 2024-02-17T12:16:51.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 -- 172.21.15.114:0/307499188 shutdown_connections 2024-02-17T12:16:51.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 --2- 172.21.15.114:0/307499188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc0c1eb0 0x7f47bc15c390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 --2- 172.21.15.114:0/307499188 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc14f110 0x7f47bc0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 -- 172.21.15.114:0/307499188 >> 172.21.15.114:0/307499188 conn(0x7f47bc0a8490 msgr2=0x7f47bc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:51.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 -- 172.21.15.114:0/307499188 shutdown_connections 2024-02-17T12:16:51.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 -- 172.21.15.114:0/307499188 wait complete. 2024-02-17T12:16:51.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 Processor -- start 2024-02-17T12:16:51.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 -- start start 2024-02-17T12:16:51.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc0c1eb0 0x7f47bc151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0c2580 0x7f47bc1eb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc14f110 0x7f47bc149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc14ab10 con 0x7f47bc0c2580 2024-02-17T12:16:51.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc1edc20 con 0x7f47bc14f110 2024-02-17T12:16:51.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c4600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc1eebb0 con 0x7f47bc0c1eb0 2024-02-17T12:16:51.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0c2580 0x7f47bc1eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0c2580 0x7f47bc1eb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55650/0 (socket says 172.21.15.114:55650) 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c1200640 1 -- 172.21.15.114:0/478895720 learned_addr learned my addr 172.21.15.114:0/478895720 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c1c00640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc0c1eb0 0x7f47bc151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.387+0000 7f47c2600640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc14f110 0x7f47bc149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47c1200640 1 -- 172.21.15.114:0/478895720 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc0c1eb0 msgr2=0x7f47bc151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47c1200640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc0c1eb0 0x7f47bc151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47c1200640 1 -- 172.21.15.114:0/478895720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc14f110 msgr2=0x7f47bc149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47c1200640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc14f110 0x7f47bc149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47c1200640 1 -- 172.21.15.114:0/478895720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4009b30 con 0x7f47bc0c2580 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47c1200640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0c2580 0x7f47bc1eb300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c460 tx=0x7f47b000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47b9600640 1 -- 172.21.15.114:0/478895720 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0007480 con 0x7f47bc0c2580 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47b9600640 1 -- 172.21.15.114:0/478895720 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b00075e0 con 0x7f47bc0c2580 2024-02-17T12:16:51.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47b9600640 1 -- 172.21.15.114:0/478895720 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0004a30 con 0x7f47bc0c2580 2024-02-17T12:16:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47c4600640 1 -- 172.21.15.114:0/478895720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc14f730 con 0x7f47bc0c2580 2024-02-17T12:16:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47c4600640 1 -- 172.21.15.114:0/478895720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc1ede30 con 0x7f47bc0c2580 2024-02-17T12:16:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47c4600640 1 -- 172.21.15.114:0/478895720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc074840 con 0x7f47bc0c2580 2024-02-17T12:16:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47b9600640 1 -- 172.21.15.114:0/478895720 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f47b0004b90 con 0x7f47bc0c2580 2024-02-17T12:16:51.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47b9600640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f47a0066e40 0x7f47a0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47b9600640 1 -- 172.21.15.114:0/478895720 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47b0083ce0 con 0x7f47bc0c2580 2024-02-17T12:16:51.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.391+0000 7f47c1c00640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f47a0066e40 0x7f47a0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.395+0000 7f47c1c00640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f47a0066e40 0x7f47a0069300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009b60 tx=0x7f47ac009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:51.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.395+0000 7f47b9600640 1 -- 172.21.15.114:0/478895720 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f47b0050c10 con 0x7f47bc0c2580 2024-02-17T12:16:51.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.551+0000 7f47c4600640 1 -- 172.21.15.114:0/478895720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47bc0c1380 con 0x7f47bc0c2580 2024-02-17T12:16:51.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.551+0000 7f47b9600640 1 -- 172.21.15.114:0/478895720 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47b00180a0 con 0x7f47bc0c2580 2024-02-17T12:16:51.557 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:16:51.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.551+0000 7f47c4600640 1 -- 172.21.15.114:0/478895720 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f47a0066e40 msgr2=0x7f47a0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.551+0000 7f47c4600640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f47a0066e40 0x7f47a0069300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009b60 tx=0x7f47ac009190 comp rx=0 tx=0).stop 2024-02-17T12:16:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.551+0000 7f47c4600640 1 -- 172.21.15.114:0/478895720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0c2580 msgr2=0x7f47bc1eb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.551+0000 7f47c4600640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0c2580 0x7f47bc1eb300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c460 tx=0x7f47b000c920 comp rx=0 tx=0).stop 2024-02-17T12:16:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.555+0000 7f47c4600640 1 -- 172.21.15.114:0/478895720 shutdown_connections 2024-02-17T12:16:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.555+0000 7f47c4600640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc14f110 0x7f47bc149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.555+0000 7f47c4600640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f47a0066e40 0x7f47a0069300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.555+0000 7f47c4600640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0c2580 0x7f47bc1eb300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.555+0000 7f47c4600640 1 --2- 172.21.15.114:0/478895720 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc0c1eb0 0x7f47bc151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.555+0000 7f47c4600640 1 -- 172.21.15.114:0/478895720 >> 172.21.15.114:0/478895720 conn(0x7f47bc0a8490 msgr2=0x7f47bc06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.555+0000 7f47c4600640 1 -- 172.21.15.114:0/478895720 shutdown_connections 2024-02-17T12:16:51.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.555+0000 7f47c4600640 1 -- 172.21.15.114:0/478895720 wait complete. 2024-02-17T12:16:51.578 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:16:51.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.707+0000 7faf27200640 1 Processor -- start 2024-02-17T12:16:51.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.707+0000 7faf27200640 1 -- start start 2024-02-17T12:16:51.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf27200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faf280c32f0 0x7faf280a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf27200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf2814eaa0 0x7faf2814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf27200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf280c1920 con 0x7faf281522c0 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf27200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf280aaf30 con 0x7faf2814eaa0 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf27200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf280c2b10 con 0x7faf280c32f0 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf26800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf2814eaa0 0x7faf2814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf26800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf2814eaa0 0x7faf2814eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55664/0 (socket says 172.21.15.114:55664) 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf26800640 1 -- 172.21.15.114:0/1555893031 learned_addr learned my addr 172.21.15.114:0/1555893031 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf25e00640 1 --2- 172.21.15.114:0/1555893031 >> v2:172.21.15.116:3300/0 conn(0x7faf280c32f0 0x7faf280a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf26800640 1 -- 172.21.15.114:0/1555893031 >> v2:172.21.15.116:3300/0 conn(0x7faf280c32f0 msgr2=0x7faf280a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf26800640 1 --2- 172.21.15.114:0/1555893031 >> v2:172.21.15.116:3300/0 conn(0x7faf280c32f0 0x7faf280a93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf26800640 1 -- 172.21.15.114:0/1555893031 >> v1:172.21.15.116:6789/0 conn(0x7faf281522c0 legacy=0x7faf281557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.711+0000 7faf26800640 1 -- 172.21.15.114:0/1555893031 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280a98f0 con 0x7faf2814eaa0 2024-02-17T12:16:51.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf26800640 1 --2- 172.21.15.114:0/1555893031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 0x7faf2814eea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faf280c1ab0 tx=0x7faf2001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d49562c7e4e1b3e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:51.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf24a00640 1 -- 172.21.15.114:0/1555893031 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf200a56d0 con 0x7faf2814eaa0 2024-02-17T12:16:51.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf24a00640 1 -- 172.21.15.114:0/1555893031 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf200a5830 con 0x7faf2814eaa0 2024-02-17T12:16:51.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf24a00640 1 -- 172.21.15.114:0/1555893031 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf200a5bc0 con 0x7faf2814eaa0 2024-02-17T12:16:51.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 -- 172.21.15.114:0/1555893031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 msgr2=0x7faf2814eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 --2- 172.21.15.114:0/1555893031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 0x7faf2814eea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faf280c1ab0 tx=0x7faf2001c920 comp rx=0 tx=0).stop 2024-02-17T12:16:51.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 -- 172.21.15.114:0/1555893031 shutdown_connections 2024-02-17T12:16:51.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 --2- 172.21.15.114:0/1555893031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 0x7faf2814eea0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 --2- 172.21.15.114:0/1555893031 >> v2:172.21.15.116:3300/0 conn(0x7faf280c32f0 0x7faf280a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 -- 172.21.15.114:0/1555893031 >> 172.21.15.114:0/1555893031 conn(0x7faf280a8660 msgr2=0x7faf280a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:51.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 -- 172.21.15.114:0/1555893031 shutdown_connections 2024-02-17T12:16:51.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 -- 172.21.15.114:0/1555893031 wait complete. 2024-02-17T12:16:51.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 Processor -- start 2024-02-17T12:16:51.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 -- start start 2024-02-17T12:16:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf280c32f0 0x7faf28143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 0x7faf280c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf281522c0 0x7faf281ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28154c70 con 0x7faf2814eaa0 2024-02-17T12:16:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf281ed100 con 0x7faf280c32f0 2024-02-17T12:16:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf27200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf281400d0 con 0x7faf281522c0 2024-02-17T12:16:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.715+0000 7faf25400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 0x7faf280c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf25400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 0x7faf280c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55678/0 (socket says 172.21.15.114:55678) 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf25400640 1 -- 172.21.15.114:0/1408066353 learned_addr learned my addr 172.21.15.114:0/1408066353 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf25e00640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf280c32f0 0x7faf28143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf26800640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf281522c0 0x7faf281ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf25400640 1 -- 172.21.15.114:0/1408066353 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf281522c0 msgr2=0x7faf281ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf25400640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf281522c0 0x7faf281ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf25400640 1 -- 172.21.15.114:0/1408066353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf280c32f0 msgr2=0x7faf28143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf25400640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf280c32f0 0x7faf28143530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf25400640 1 -- 172.21.15.114:0/1408066353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf20009b30 con 0x7faf2814eaa0 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf25400640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 0x7faf280c63d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b410 tx=0x7faf1800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf1e000640 1 -- 172.21.15.114:0/1408066353 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18004020 con 0x7faf2814eaa0 2024-02-17T12:16:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf1e000640 1 -- 172.21.15.114:0/1408066353 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18004180 con 0x7faf2814eaa0 2024-02-17T12:16:51.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf1e000640 1 -- 172.21.15.114:0/1408066353 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18011630 con 0x7faf2814eaa0 2024-02-17T12:16:51.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf27200640 1 -- 172.21.15.114:0/1408066353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf281540f0 con 0x7faf2814eaa0 2024-02-17T12:16:51.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf27200640 1 -- 172.21.15.114:0/1408066353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf281546b0 con 0x7faf2814eaa0 2024-02-17T12:16:51.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf27200640 1 -- 172.21.15.114:0/1408066353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf281ed270 con 0x7faf2814eaa0 2024-02-17T12:16:51.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf1e000640 1 -- 172.21.15.114:0/1408066353 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7faf18011790 con 0x7faf2814eaa0 2024-02-17T12:16:51.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf1e000640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf04066e70 0x7faf04069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:51.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf1e000640 1 -- 172.21.15.114:0/1408066353 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf18084700 con 0x7faf2814eaa0 2024-02-17T12:16:51.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.719+0000 7faf25e00640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf04066e70 0x7faf04069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:51.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.723+0000 7faf25e00640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf04066e70 0x7faf04069330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faf10007a60 tx=0x7faf10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:51.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.723+0000 7faf1e000640 1 -- 172.21.15.114:0/1408066353 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faf281ed270 con 0x7faf2814eaa0 2024-02-17T12:16:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 -- 172.21.15.114:0/1408066353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf281ed270 con 0x7faf2814eaa0 2024-02-17T12:16:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf1e000640 1 -- 172.21.15.114:0/1408066353 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7faf281ed270 con 0x7faf2814eaa0 2024-02-17T12:16:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:16:51.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 -- 172.21.15.114:0/1408066353 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf04066e70 msgr2=0x7faf04069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf04066e70 0x7faf04069330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faf10007a60 tx=0x7faf10008040 comp rx=0 tx=0).stop 2024-02-17T12:16:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 -- 172.21.15.114:0/1408066353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 msgr2=0x7faf280c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 0x7faf280c63d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b410 tx=0x7faf1800b8d0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 -- 172.21.15.114:0/1408066353 shutdown_connections 2024-02-17T12:16:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf281522c0 0x7faf281ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf04066e70 0x7faf04069330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf2814eaa0 0x7faf280c63d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 --2- 172.21.15.114:0/1408066353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf280c32f0 0x7faf28143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.891+0000 7faf27200640 1 -- 172.21.15.114:0/1408066353 >> 172.21.15.114:0/1408066353 conn(0x7faf280a8660 msgr2=0x7faf281518b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.895+0000 7faf27200640 1 -- 172.21.15.114:0/1408066353 shutdown_connections 2024-02-17T12:16:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:51.895+0000 7faf27200640 1 -- 172.21.15.114:0/1408066353 wait complete. 2024-02-17T12:16:51.917 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-17T12:16:51.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:51.917 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-02-17T12:16:51.983 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:16:51.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:16:51.984 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-17T12:16:52.017 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-02-17T12:16:52.018 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:16:52.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.147+0000 7f1f19000640 1 Processor -- start 2024-02-17T12:16:52.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.147+0000 7f1f19000640 1 -- start start 2024-02-17T12:16:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f19000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14150300 0x7f1f14156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f19000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1f14152d30 0x7f1f141531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f19000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f14157270 con 0x7f1f140714c0 2024-02-17T12:16:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f19000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140c6900 con 0x7f1f14152d30 2024-02-17T12:16:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f19000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c3580 con 0x7f1f14150300 2024-02-17T12:16:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f12800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1f14152d30 0x7f1f141531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f11e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14150300 0x7f1f14156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f12800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1f14152d30 0x7f1f141531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:45782/0 (socket says 172.21.15.114:45782) 2024-02-17T12:16:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f12800640 1 -- 172.21.15.114:0/2982688771 learned_addr learned my addr 172.21.15.114:0/2982688771 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f11e00640 1 -- 172.21.15.114:0/2982688771 >> v2:172.21.15.116:3300/0 conn(0x7f1f14152d30 msgr2=0x7f1f141531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f11e00640 1 --2- 172.21.15.114:0/2982688771 >> v2:172.21.15.116:3300/0 conn(0x7f1f14152d30 0x7f1f141531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f11e00640 1 -- 172.21.15.114:0/2982688771 >> v1:172.21.15.116:6789/0 conn(0x7f1f140714c0 legacy=0x7f1f140aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f11e00640 1 -- 172.21.15.114:0/2982688771 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f140c2fc0 con 0x7f1f14150300 2024-02-17T12:16:52.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.151+0000 7f1f12800640 1 --2- 172.21.15.114:0/2982688771 >> v2:172.21.15.116:3300/0 conn(0x7f1f14152d30 0x7f1f141531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:52.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f11e00640 1 --2- 172.21.15.114:0/2982688771 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14150300 0x7f1f14156d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1f040097c0 tx=0x7f1f0401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b298d4add50548af server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:52.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f11400640 1 -- 172.21.15.114:0/2982688771 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040a4ea0 con 0x7f1f14150300 2024-02-17T12:16:52.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f11400640 1 -- 172.21.15.114:0/2982688771 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f040a7050 con 0x7f1f14150300 2024-02-17T12:16:52.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f11400640 1 -- 172.21.15.114:0/2982688771 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040ab820 con 0x7f1f14150300 2024-02-17T12:16:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f19000640 1 -- 172.21.15.114:0/2982688771 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14150300 msgr2=0x7f1f14156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f19000640 1 --2- 172.21.15.114:0/2982688771 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14150300 0x7f1f14156d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1f040097c0 tx=0x7f1f0401c410 comp rx=0 tx=0).stop 2024-02-17T12:16:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f19000640 1 -- 172.21.15.114:0/2982688771 shutdown_connections 2024-02-17T12:16:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f19000640 1 --2- 172.21.15.114:0/2982688771 >> v2:172.21.15.116:3300/0 conn(0x7f1f14152d30 0x7f1f141531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f19000640 1 --2- 172.21.15.114:0/2982688771 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14150300 0x7f1f14156d30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f19000640 1 -- 172.21.15.114:0/2982688771 >> 172.21.15.114:0/2982688771 conn(0x7f1f140c4f20 msgr2=0x7f1f140c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f19000640 1 -- 172.21.15.114:0/2982688771 shutdown_connections 2024-02-17T12:16:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f19000640 1 -- 172.21.15.114:0/2982688771 wait complete. 2024-02-17T12:16:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f19000640 1 Processor -- start 2024-02-17T12:16:52.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.155+0000 7f1f19000640 1 -- start start 2024-02-17T12:16:52.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f19000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f140714c0 0x7f1f1414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f19000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f14150300 0x7f1f1415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f19000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14152d30 0x7f1f141edca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f19000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1414a900 con 0x7f1f140714c0 2024-02-17T12:16:52.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f19000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f141ed810 con 0x7f1f14150300 2024-02-17T12:16:52.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f19000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1414c360 con 0x7f1f14152d30 2024-02-17T12:16:52.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f11e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f140714c0 0x7f1f1414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f11e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f140714c0 0x7f1f1414a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55688/0 (socket says 172.21.15.114:55688) 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f11e00640 1 -- 172.21.15.114:0/1041277992 learned_addr learned my addr 172.21.15.114:0/1041277992 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f12800640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14152d30 0x7f1f141edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f0be00640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f14150300 0x7f1f1415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f11e00640 1 -- 172.21.15.114:0/1041277992 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14152d30 msgr2=0x7f1f141edca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f11e00640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14152d30 0x7f1f141edca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f11e00640 1 -- 172.21.15.114:0/1041277992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f14150300 msgr2=0x7f1f1415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f11e00640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f14150300 0x7f1f1415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f11e00640 1 -- 172.21.15.114:0/1041277992 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c009b30 con 0x7f1f140714c0 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f12800640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14152d30 0x7f1f141edca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f0be00640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f14150300 0x7f1f1415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f11e00640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f140714c0 0x7f1f1414a3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1f0401a040 tx=0x7f1f040191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f0a000640 1 -- 172.21.15.114:0/1041277992 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040a4ea0 con 0x7f1f140714c0 2024-02-17T12:16:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f0a000640 1 -- 172.21.15.114:0/1041277992 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f040b4410 con 0x7f1f140714c0 2024-02-17T12:16:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f19000640 1 -- 172.21.15.114:0/1041277992 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f04009420 con 0x7f1f140714c0 2024-02-17T12:16:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f0a000640 1 -- 172.21.15.114:0/1041277992 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040b47c0 con 0x7f1f140714c0 2024-02-17T12:16:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f19000640 1 -- 172.21.15.114:0/1041277992 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1414c920 con 0x7f1f140714c0 2024-02-17T12:16:52.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f19000640 1 -- 172.21.15.114:0/1041277992 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f14074840 con 0x7f1f140714c0 2024-02-17T12:16:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.159+0000 7f1f0a000640 1 -- 172.21.15.114:0/1041277992 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1f040b2040 con 0x7f1f140714c0 2024-02-17T12:16:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.163+0000 7f1f0a000640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1ef0066e70 0x7f1ef0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.163+0000 7f1f0a000640 1 -- 172.21.15.114:0/1041277992 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f0411ede0 con 0x7f1f140714c0 2024-02-17T12:16:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.163+0000 7f1f0be00640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1ef0066e70 0x7f1ef0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.163+0000 7f1f0be00640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1ef0066e70 0x7f1ef0069330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1f140ae3c0 tx=0x7f1efc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:52.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.163+0000 7f1f0a000640 1 -- 172.21.15.114:0/1041277992 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1f040ebc40 con 0x7f1f140714c0 2024-02-17T12:16:52.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.355+0000 7f1f19000640 1 -- 172.21.15.114:0/1041277992 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f140c80e0 con 0x7f1f140714c0 2024-02-17T12:16:52.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.355+0000 7f1f0a000640 1 -- 172.21.15.114:0/1041277992 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f1f040ef300 con 0x7f1f140714c0 2024-02-17T12:16:52.361 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:52.361 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4241624725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4241624725},{"type":"v1","addr":"172.21.15.114:6837","nonce":4241624725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/178899564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":178899564},{"type":"v1","addr":"172.21.15.114:6836","nonce":178899564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/3301698475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3301698475},{"type":"v1","addr":"172.21.15.116:6834","nonce":3301698475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:16:22.673862+0000","modified":"2024-02-17T12:16:25.681621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6835/4001468997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":4001468997},{"type":"v1","addr":"172.21.15.116:6835","nonce":4001468997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:16:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-02-17T12:16:52.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 -- 172.21.15.114:0/1041277992 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1ef0066e70 msgr2=0x7f1ef0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1ef0066e70 0x7f1ef0069330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1f140ae3c0 tx=0x7f1efc009040 comp rx=0 tx=0).stop 2024-02-17T12:16:52.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 -- 172.21.15.114:0/1041277992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f140714c0 msgr2=0x7f1f1414a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f140714c0 0x7f1f1414a3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1f0401a040 tx=0x7f1f040191b0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 -- 172.21.15.114:0/1041277992 shutdown_connections 2024-02-17T12:16:52.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f14152d30 0x7f1f141edca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f14150300 0x7f1f1415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1ef0066e70 0x7f1ef0069330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 --2- 172.21.15.114:0/1041277992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f140714c0 0x7f1f1414a3c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 -- 172.21.15.114:0/1041277992 >> 172.21.15.114:0/1041277992 conn(0x7f1f140c4f20 msgr2=0x7f1f1414df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:52.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 -- 172.21.15.114:0/1041277992 shutdown_connections 2024-02-17T12:16:52.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.359+0000 7f1f19000640 1 -- 172.21.15.114:0/1041277992 wait complete. 2024-02-17T12:16:52.382 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:52.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.511+0000 7fda0b400640 1 Processor -- start 2024-02-17T12:16:52.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.511+0000 7fda0b400640 1 -- start start 2024-02-17T12:16:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.511+0000 7fda0b400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda0414f110 0x7fda040c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.511+0000 7fda0b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda040c1eb0 0x7fda0415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.511+0000 7fda0b400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda040a9420 con 0x7fda040c2580 2024-02-17T12:16:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.511+0000 7fda0b400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0414f4f0 con 0x7fda040c1eb0 2024-02-17T12:16:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.511+0000 7fda0b400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda040aae80 con 0x7fda0414f110 2024-02-17T12:16:52.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda09400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda040c1eb0 0x7fda0415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda09400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda040c1eb0 0x7fda0415c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55700/0 (socket says 172.21.15.114:55700) 2024-02-17T12:16:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda09400640 1 -- 172.21.15.114:0/1585610466 learned_addr learned my addr 172.21.15.114:0/1585610466 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda08a00640 1 --2- 172.21.15.114:0/1585610466 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda0414f110 0x7fda040c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda09400640 1 -- 172.21.15.114:0/1585610466 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda0414f110 msgr2=0x7fda040c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda09400640 1 --2- 172.21.15.114:0/1585610466 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda0414f110 0x7fda040c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda09400640 1 -- 172.21.15.114:0/1585610466 >> v1:172.21.15.116:6789/0 conn(0x7fda040c2580 legacy=0x7fda040aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda09400640 1 -- 172.21.15.114:0/1585610466 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04152850 con 0x7fda040c1eb0 2024-02-17T12:16:52.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda08a00640 1 --2- 172.21.15.114:0/1585610466 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda0414f110 0x7fda040c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:52.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda09400640 1 --2- 172.21.15.114:0/1585610466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 0x7fda0415c390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009870 tx=0x7fd9fc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2d5ed612a54963 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:52.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda03400640 1 -- 172.21.15.114:0/1585610466 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0a6040 con 0x7fda040c1eb0 2024-02-17T12:16:52.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda03400640 1 -- 172.21.15.114:0/1585610466 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc0aa600 con 0x7fda040c1eb0 2024-02-17T12:16:52.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.515+0000 7fda03400640 1 -- 172.21.15.114:0/1585610466 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0aa990 con 0x7fda040c1eb0 2024-02-17T12:16:52.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 -- 172.21.15.114:0/1585610466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 msgr2=0x7fda0415c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 --2- 172.21.15.114:0/1585610466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 0x7fda0415c390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009870 tx=0x7fd9fc01c4a0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 -- 172.21.15.114:0/1585610466 shutdown_connections 2024-02-17T12:16:52.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 --2- 172.21.15.114:0/1585610466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 0x7fda0415c390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 --2- 172.21.15.114:0/1585610466 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda0414f110 0x7fda040c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 -- 172.21.15.114:0/1585610466 >> 172.21.15.114:0/1585610466 conn(0x7fda040a8490 msgr2=0x7fda040a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:52.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 -- 172.21.15.114:0/1585610466 shutdown_connections 2024-02-17T12:16:52.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 -- 172.21.15.114:0/1585610466 wait complete. 2024-02-17T12:16:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 Processor -- start 2024-02-17T12:16:52.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 -- start start 2024-02-17T12:16:52.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 0x7fda041ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda040c2580 0x7fda04147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda0414f110 0x7fda041f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda041ede00 con 0x7fda040c1eb0 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda04147f80 con 0x7fda0414f110 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda0b400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0414d2b0 con 0x7fda040c2580 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda08a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 0x7fda041ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda08a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 0x7fda041ed8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55710/0 (socket says 172.21.15.114:55710) 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda08a00640 1 -- 172.21.15.114:0/1110480543 learned_addr learned my addr 172.21.15.114:0/1110480543 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda09400640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda0414f110 0x7fda041f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda03e00640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda040c2580 0x7fda04147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda08a00640 1 -- 172.21.15.114:0/1110480543 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda040c2580 msgr2=0x7fda04147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda08a00640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda040c2580 0x7fda04147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda08a00640 1 -- 172.21.15.114:0/1110480543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda0414f110 msgr2=0x7fda041f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda08a00640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda0414f110 0x7fda041f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda08a00640 1 -- 172.21.15.114:0/1110480543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc0094d0 con 0x7fda040c1eb0 2024-02-17T12:16:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.519+0000 7fda08a00640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 0x7fda041ed8c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4007ef0 tx=0x7fd9f400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:52.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda00c00640 1 -- 172.21.15.114:0/1110480543 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4003ba0 con 0x7fda040c1eb0 2024-02-17T12:16:52.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda00c00640 1 -- 172.21.15.114:0/1110480543 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f400f040 con 0x7fda040c1eb0 2024-02-17T12:16:52.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda00c00640 1 -- 172.21.15.114:0/1110480543 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400de80 con 0x7fda040c1eb0 2024-02-17T12:16:52.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda0b400640 1 -- 172.21.15.114:0/1110480543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0414d590 con 0x7fda040c1eb0 2024-02-17T12:16:52.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda0b400640 1 -- 172.21.15.114:0/1110480543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda041f0ed0 con 0x7fda040c1eb0 2024-02-17T12:16:52.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda0b400640 1 -- 172.21.15.114:0/1110480543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda04074840 con 0x7fda040c1eb0 2024-02-17T12:16:52.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda00c00640 1 -- 172.21.15.114:0/1110480543 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd9f4004030 con 0x7fda040c1eb0 2024-02-17T12:16:52.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda00c00640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd9e0066e70 0x7fd9e0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda00c00640 1 -- 172.21.15.114:0/1110480543 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9f4084c30 con 0x7fda040c1eb0 2024-02-17T12:16:52.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda03e00640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd9e0066e70 0x7fd9e0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.523+0000 7fda03e00640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd9e0066e70 0x7fd9e0069330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda0414fec0 tx=0x7fd9ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:52.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.527+0000 7fda00c00640 1 -- 172.21.15.114:0/1110480543 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd9f4051ac0 con 0x7fda040c1eb0 2024-02-17T12:16:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.683+0000 7fda0b400640 1 -- 172.21.15.114:0/1110480543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda040c1380 con 0x7fda040c1eb0 2024-02-17T12:16:52.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda00c00640 1 -- 172.21.15.114:0/1110480543 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fd9f401a090 con 0x7fda040c1eb0 2024-02-17T12:16:52.691 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:52.691 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 -- 172.21.15.114:0/1110480543 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd9e0066e70 msgr2=0x7fd9e0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd9e0066e70 0x7fd9e0069330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda0414fec0 tx=0x7fd9ec009040 comp rx=0 tx=0).stop 2024-02-17T12:16:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 -- 172.21.15.114:0/1110480543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 msgr2=0x7fda041ed8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 0x7fda041ed8c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4007ef0 tx=0x7fd9f400d4a0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 -- 172.21.15.114:0/1110480543 shutdown_connections 2024-02-17T12:16:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda0414f110 0x7fda041f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda040c2580 0x7fda04147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd9e0066e70 0x7fd9e0069330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 --2- 172.21.15.114:0/1110480543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda040c1eb0 0x7fda041ed8c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 -- 172.21.15.114:0/1110480543 >> 172.21.15.114:0/1110480543 conn(0x7fda040a8490 msgr2=0x7fda04142090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 -- 172.21.15.114:0/1110480543 shutdown_connections 2024-02-17T12:16:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.687+0000 7fda0b400640 1 -- 172.21.15.114:0/1110480543 wait complete. 2024-02-17T12:16:52.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:16:21.236908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:16:21.659009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:16:52.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:16:52.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1216a00640 1 Processor -- start 2024-02-17T12:16:52.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1216a00640 1 -- start start 2024-02-17T12:16:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1216a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f121006db50 0x7f121014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1216a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1210150490 0x7f1210152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1216a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1210156270 con 0x7f12100c25a0 2024-02-17T12:16:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1216a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121006f090 con 0x7f121006db50 2024-02-17T12:16:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1216a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1210071630 con 0x7f1210150490 2024-02-17T12:16:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f12100c25a0 0x7f121006e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49714/0 (socket says 172.21.15.114:49714) 2024-02-17T12:16:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120fe00640 1 -- 172.21.15.114:0/547542806 learned_addr learned my addr 172.21.15.114:0/547542806 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1207400640 1 --2- 172.21.15.114:0/547542806 >> v2:172.21.15.116:3300/0 conn(0x7f121006db50 0x7f121014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1214a00640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1210150490 0x7f1210152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556165075 0 0) 0x7f1210156270 con 0x7f12100c25a0 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f4003530 con 0x7f12100c25a0 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1200657725 0 0) 0x7f11f4003530 con 0x7f12100c25a0 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1210150490 msgr2=0x7f1210152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1210150490 0x7f1210152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 >> v2:172.21.15.116:3300/0 conn(0x7f121006db50 msgr2=0x7f121014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 --2- 172.21.15.114:0/547542806 >> v2:172.21.15.116:3300/0 conn(0x7f121006db50 0x7f121014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1210156550 con 0x7f12100c25a0 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f12000016a0 con 0x7f12100c25a0 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 >> v1:172.21.15.114:6789/0 conn(0x7f12100c25a0 legacy=0x7f121006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1210150490 0x7f11f4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11f4003f00 0x7f11f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11f4004d10 0x7f11f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121006f090 con 0x7f11f4004d10 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f400b9f0 con 0x7f11f4003f00 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f400bbb0 con 0x7f1210150490 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1214a00640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11f4004d10 0x7f11f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f120fe00640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1210150490 0x7f11f4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1207400640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11f4003f00 0x7f11f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1214a00640 1 -- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1210150490 msgr2=0x7f11f4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1214a00640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1210150490 0x7f11f4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1214a00640 1 -- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11f4003f00 msgr2=0x7f11f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1214a00640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11f4003f00 0x7f11f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1214a00640 1 -- 172.21.15.114:0/547542806 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f4003530 con 0x7f11f4004d10 2024-02-17T12:16:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.847+0000 7f1207400640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11f4003f00 0x7f11f40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f1214a00640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11f4004d10 0x7f11f4005190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1208009fc0 tx=0x7f120801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64109a01eb9cf7d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12080a5b50 con 0x7f11f4004d10 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120800f040 con 0x7f11f4004d10 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f120f400640 1 -- 172.21.15.114:0/547542806 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12080ad440 con 0x7f11f4004d10 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f1216a00640 1 -- 172.21.15.114:0/547542806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11f4004d10 msgr2=0x7f11f4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f1216a00640 1 --2- 172.21.15.114:0/547542806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11f4004d10 0x7f11f4005190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1208009fc0 tx=0x7f120801cc50 comp rx=0 tx=0).stop 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f1214a00640 1 -- 172.21.15.114:0/547542806 reap_dead start 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f1216a00640 1 -- 172.21.15.114:0/547542806 shutdown_connections 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f1216a00640 1 -- 172.21.15.114:0/547542806 >> 172.21.15.114:0/547542806 conn(0x7f12100a8490 msgr2=0x7f12100a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f1216a00640 1 -- 172.21.15.114:0/547542806 shutdown_connections 2024-02-17T12:16:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.851+0000 7f1216a00640 1 -- 172.21.15.114:0/547542806 wait complete. 2024-02-17T12:16:52.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1216a00640 1 Processor -- start 2024-02-17T12:16:52.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1216a00640 1 -- start start 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1216a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f12101f0920 0x7f1210142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1216a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1210144260 0x7f12100a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1216a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12100a9cf0 0x7f12101f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1216a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210143dd0 con 0x7f1210144260 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1216a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210145330 con 0x7f12100a9cf0 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1216a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1210146010 con 0x7f12101f0920 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1207400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1210144260 0x7f12100a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1207400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1210144260 0x7f12100a97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55722/0 (socket says 172.21.15.114:55722) 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1207400640 1 -- 172.21.15.114:0/3361189794 learned_addr learned my addr 172.21.15.114:0/3361189794 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1214a00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12100a9cf0 0x7f12101f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f120fe00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f12101f0920 0x7f1210142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1207400640 1 -- 172.21.15.114:0/3361189794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f12101f0920 msgr2=0x7f1210142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1207400640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f12101f0920 0x7f1210142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1207400640 1 -- 172.21.15.114:0/3361189794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12100a9cf0 msgr2=0x7f12101f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:52.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1207400640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12100a9cf0 0x7f12101f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:52.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1207400640 1 -- 172.21.15.114:0/3361189794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12101465b0 con 0x7f1210144260 2024-02-17T12:16:52.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1207400640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1210144260 0x7f12100a97b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f11f80115f0 tx=0x7f11f8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:52.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f120cc00640 1 -- 172.21.15.114:0/3361189794 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8004220 con 0x7f1210144260 2024-02-17T12:16:52.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f120cc00640 1 -- 172.21.15.114:0/3361189794 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8004380 con 0x7f1210144260 2024-02-17T12:16:52.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1216a00640 1 -- 172.21.15.114:0/3361189794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12101f1760 con 0x7f1210144260 2024-02-17T12:16:52.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f120cc00640 1 -- 172.21.15.114:0/3361189794 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800f910 con 0x7f1210144260 2024-02-17T12:16:52.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.855+0000 7f1216a00640 1 -- 172.21.15.114:0/3361189794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1210146dd0 con 0x7f1210144260 2024-02-17T12:16:52.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.859+0000 7f1216a00640 1 -- 172.21.15.114:0/3361189794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1210074840 con 0x7f1210144260 2024-02-17T12:16:52.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.859+0000 7f120cc00640 1 -- 172.21.15.114:0/3361189794 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f11f800fa70 con 0x7f1210144260 2024-02-17T12:16:52.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.859+0000 7f120cc00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f11ec066e40 0x7f11ec069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:52.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.859+0000 7f120cc00640 1 -- 172.21.15.114:0/3361189794 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11f8084fe0 con 0x7f1210144260 2024-02-17T12:16:52.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.859+0000 7f120fe00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f11ec066e40 0x7f11ec069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:52.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.859+0000 7f120fe00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f11ec066e40 0x7f11ec069300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1200004850 tx=0x7f1200009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:52.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:52.863+0000 7f120cc00640 1 -- 172.21.15.114:0/3361189794 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f11f8051dc0 con 0x7f1210144260 2024-02-17T12:16:53.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.031+0000 7f1216a00640 1 -- 172.21.15.114:0/3361189794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1210143f10 con 0x7f1210144260 2024-02-17T12:16:53.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f120cc00640 1 -- 172.21.15.114:0/3361189794 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11f80220a0 con 0x7f1210144260 2024-02-17T12:16:53.039 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:16:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 -- 172.21.15.114:0/3361189794 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f11ec066e40 msgr2=0x7f11ec069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f11ec066e40 0x7f11ec069300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1200004850 tx=0x7f1200009040 comp rx=0 tx=0).stop 2024-02-17T12:16:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 -- 172.21.15.114:0/3361189794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1210144260 msgr2=0x7f12100a97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1210144260 0x7f12100a97b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f11f80115f0 tx=0x7f11f8011ab0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 -- 172.21.15.114:0/3361189794 shutdown_connections 2024-02-17T12:16:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f12100a9cf0 0x7f12101f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f11ec066e40 0x7f11ec069300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1210144260 0x7f12100a97b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 --2- 172.21.15.114:0/3361189794 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f12101f0920 0x7f1210142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 -- 172.21.15.114:0/3361189794 >> 172.21.15.114:0/3361189794 conn(0x7f12100a8490 msgr2=0x7f1210072960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:53.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 -- 172.21.15.114:0/3361189794 shutdown_connections 2024-02-17T12:16:53.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.035+0000 7f1216a00640 1 -- 172.21.15.114:0/3361189794 wait complete. 2024-02-17T12:16:53.059 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:16:53.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd63d200640 1 Processor -- start 2024-02-17T12:16:53.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd63d200640 1 -- start start 2024-02-17T12:16:53.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd63d200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd6380c58b0 0x7fd6381583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd63d200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd6380a6360 0x7fd638155520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd63d200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd638155090 con 0x7fd6380c4b30 2024-02-17T12:16:53.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd63d200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6380c6110 con 0x7fd6380c58b0 2024-02-17T12:16:53.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd63d200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd638159300 con 0x7fd6380a6360 2024-02-17T12:16:53.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd635e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd6380c58b0 0x7fd6381583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd635400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd6380c4b30 0x7fd63806bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49726/0 (socket says 172.21.15.114:49726) 2024-02-17T12:16:53.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd635400640 1 -- 172.21.15.114:0/291188566 learned_addr learned my addr 172.21.15.114:0/291188566 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:53.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd635e00640 1 -- 172.21.15.114:0/291188566 >> v2:172.21.15.116:3300/0 conn(0x7fd6380a6360 msgr2=0x7fd638155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:53.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd636800640 1 --2- 172.21.15.114:0/291188566 >> v2:172.21.15.116:3300/0 conn(0x7fd6380a6360 0x7fd638155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd635e00640 1 --2- 172.21.15.114:0/291188566 >> v2:172.21.15.116:3300/0 conn(0x7fd6380a6360 0x7fd638155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd635e00640 1 -- 172.21.15.114:0/291188566 >> v1:172.21.15.114:6789/0 conn(0x7fd6380c4b30 legacy=0x7fd63806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd634a00640 1 -- 172.21.15.114:0/291188566 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111562399 0 0) 0x7fd638155090 con 0x7fd6380c4b30 2024-02-17T12:16:53.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd635e00640 1 -- 172.21.15.114:0/291188566 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638158a60 con 0x7fd6380c58b0 2024-02-17T12:16:53.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.191+0000 7fd636800640 1 --2- 172.21.15.114:0/291188566 >> v2:172.21.15.116:3300/0 conn(0x7fd6380a6360 0x7fd638155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:53.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd635e00640 1 --2- 172.21.15.114:0/291188566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380c58b0 0x7fd6381583d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd63806d1a0 tx=0x7fd62801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc17a3c297a53f8f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:53.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd634a00640 1 -- 172.21.15.114:0/291188566 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6280a58d0 con 0x7fd6380c58b0 2024-02-17T12:16:53.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd634a00640 1 -- 172.21.15.114:0/291188566 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6280a5a30 con 0x7fd6380c58b0 2024-02-17T12:16:53.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd634a00640 1 -- 172.21.15.114:0/291188566 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6280a5dc0 con 0x7fd6380c58b0 2024-02-17T12:16:53.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd63d200640 1 -- 172.21.15.114:0/291188566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380c58b0 msgr2=0x7fd6381583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd63d200640 1 --2- 172.21.15.114:0/291188566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380c58b0 0x7fd6381583d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd63806d1a0 tx=0x7fd62801c900 comp rx=0 tx=0).stop 2024-02-17T12:16:53.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd63d200640 1 -- 172.21.15.114:0/291188566 shutdown_connections 2024-02-17T12:16:53.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd63d200640 1 --2- 172.21.15.114:0/291188566 >> v2:172.21.15.116:3300/0 conn(0x7fd6380a6360 0x7fd638155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd63d200640 1 --2- 172.21.15.114:0/291188566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380c58b0 0x7fd6381583d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd63d200640 1 -- 172.21.15.114:0/291188566 >> 172.21.15.114:0/291188566 conn(0x7fd6380c3730 msgr2=0x7fd6380c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:53.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd63d200640 1 -- 172.21.15.114:0/291188566 shutdown_connections 2024-02-17T12:16:53.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.195+0000 7fd63d200640 1 -- 172.21.15.114:0/291188566 wait complete. 2024-02-17T12:16:53.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 Processor -- start 2024-02-17T12:16:53.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 -- start start 2024-02-17T12:16:53.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380a6360 0x7fd63806d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6380c4b30 0x7fd6381ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6380c58b0 0x7fd6381ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6381edd50 con 0x7fd6380a6360 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6380a7ea0 con 0x7fd6380c4b30 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6381f0840 con 0x7fd6380c58b0 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd635e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380a6360 0x7fd63806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd635e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380a6360 0x7fd63806d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55734/0 (socket says 172.21.15.114:55734) 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd635e00640 1 -- 172.21.15.114:0/3550789458 learned_addr learned my addr 172.21.15.114:0/3550789458 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd635400640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6380c4b30 0x7fd6381ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd636800640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6380c58b0 0x7fd6381ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd635e00640 1 -- 172.21.15.114:0/3550789458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6380c58b0 msgr2=0x7fd6381ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd635e00640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6380c58b0 0x7fd6381ed810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd635e00640 1 -- 172.21.15.114:0/3550789458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6380c4b30 msgr2=0x7fd6381ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd635e00640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6380c4b30 0x7fd6381ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd635e00640 1 -- 172.21.15.114:0/3550789458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd628009a70 con 0x7fd6380a6360 2024-02-17T12:16:53.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd635e00640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380a6360 0x7fd63806d570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd628019510 tx=0x7fd6280196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:53.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd62e000640 1 -- 172.21.15.114:0/3550789458 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6280ad850 con 0x7fd6380a6360 2024-02-17T12:16:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd62e000640 1 -- 172.21.15.114:0/3550789458 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6280ad9b0 con 0x7fd6380a6360 2024-02-17T12:16:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 -- 172.21.15.114:0/3550789458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6381f0b20 con 0x7fd6380a6360 2024-02-17T12:16:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd62e000640 1 -- 172.21.15.114:0/3550789458 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6280add40 con 0x7fd6380a6360 2024-02-17T12:16:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 -- 172.21.15.114:0/3550789458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6381f10e0 con 0x7fd6380a6360 2024-02-17T12:16:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.199+0000 7fd63d200640 1 -- 172.21.15.114:0/3550789458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd638067170 con 0x7fd6380a6360 2024-02-17T12:16:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.203+0000 7fd62e000640 1 -- 172.21.15.114:0/3550789458 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd6280b4050 con 0x7fd6380a6360 2024-02-17T12:16:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.203+0000 7fd62e000640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd618066e40 0x7fd618069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.203+0000 7fd62e000640 1 -- 172.21.15.114:0/3550789458 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd62811fb40 con 0x7fd6380a6360 2024-02-17T12:16:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.203+0000 7fd635400640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd618066e40 0x7fd618069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.203+0000 7fd635400640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd618066e40 0x7fd618069300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd624000f70 tx=0x7fd624007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:53.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.207+0000 7fd62e000640 1 -- 172.21.15.114:0/3550789458 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd6280ecae0 con 0x7fd6380a6360 2024-02-17T12:16:53.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 -- 172.21.15.114:0/3550789458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd638074840 con 0x7fd6380a6360 2024-02-17T12:16:53.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd62e000640 1 -- 172.21.15.114:0/3550789458 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6280c7020 con 0x7fd6380a6360 2024-02-17T12:16:53.368 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:16:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 -- 172.21.15.114:0/3550789458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd618066e40 msgr2=0x7fd618069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd618066e40 0x7fd618069300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd624000f70 tx=0x7fd624007b60 comp rx=0 tx=0).stop 2024-02-17T12:16:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 -- 172.21.15.114:0/3550789458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380a6360 msgr2=0x7fd63806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380a6360 0x7fd63806d570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd628019510 tx=0x7fd6280196a0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 -- 172.21.15.114:0/3550789458 shutdown_connections 2024-02-17T12:16:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6380c58b0 0x7fd6381ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6380c4b30 0x7fd6381ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd618066e40 0x7fd618069300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 --2- 172.21.15.114:0/3550789458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6380a6360 0x7fd63806d570 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 -- 172.21.15.114:0/3550789458 >> 172.21.15.114:0/3550789458 conn(0x7fd6380c3730 msgr2=0x7fd6380c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:53.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 -- 172.21.15.114:0/3550789458 shutdown_connections 2024-02-17T12:16:53.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.363+0000 7fd63d200640 1 -- 172.21.15.114:0/3550789458 wait complete. 2024-02-17T12:16:53.388 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:16:53.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.519+0000 7fbb91400640 1 Processor -- start 2024-02-17T12:16:53.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.519+0000 7fbb91400640 1 -- start start 2024-02-17T12:16:53.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.519+0000 7fbb91400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbb8c06b740 0x7fbb8c06dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.519+0000 7fbb91400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c1538c0 con 0x7fbb8c14cb50 2024-02-17T12:16:53.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.519+0000 7fbb91400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c0c0f20 con 0x7fbb8c06e100 2024-02-17T12:16:53.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.519+0000 7fbb91400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c0aa340 con 0x7fbb8c06b740 2024-02-17T12:16:53.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb8be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbb8c14cb50 0x7fbb8c06ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49728/0 (socket says 172.21.15.114:49728) 2024-02-17T12:16:53.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb8be00640 1 -- 172.21.15.114:0/3433475298 learned_addr learned my addr 172.21.15.114:0/3433475298 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:53.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb83400640 1 --2- 172.21.15.114:0/3433475298 >> v2:172.21.15.116:3300/0 conn(0x7fbb8c06b740 0x7fbb8c06dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb8b400640 1 -- 172.21.15.114:0/3433475298 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880151053 0 0) 0x7fbb8c1538c0 con 0x7fbb8c14cb50 2024-02-17T12:16:53.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb8b400640 1 -- 172.21.15.114:0/3433475298 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb70003530 con 0x7fbb8c14cb50 2024-02-17T12:16:53.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb83400640 1 -- 172.21.15.114:0/3433475298 >> v1:172.21.15.116:6789/0 conn(0x7fbb8c06e100 legacy=0x7fbb8c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb8b400640 1 -- 172.21.15.114:0/3433475298 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2118140226 0 0) 0x7fbb70003530 con 0x7fbb8c14cb50 2024-02-17T12:16:53.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb83400640 1 -- 172.21.15.114:0/3433475298 >> v1:172.21.15.114:6789/0 conn(0x7fbb8c14cb50 legacy=0x7fbb8c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb83400640 1 -- 172.21.15.114:0/3433475298 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c152cb0 con 0x7fbb8c06b740 2024-02-17T12:16:53.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb83400640 1 --2- 172.21.15.114:0/3433475298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c06b740 0x7fbb8c06dbc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbb740097c0 tx=0x7fbb7401c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e649e47a616b4c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:53.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.523+0000 7fbb8b400640 1 -- 172.21.15.114:0/3433475298 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c001680 con 0x7fbb8c06b740 2024-02-17T12:16:53.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb8b400640 1 -- 172.21.15.114:0/3433475298 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb740a7050 con 0x7fbb8c06b740 2024-02-17T12:16:53.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb8b400640 1 -- 172.21.15.114:0/3433475298 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740ab620 con 0x7fbb8c06b740 2024-02-17T12:16:53.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 -- 172.21.15.114:0/3433475298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c06b740 msgr2=0x7fbb8c06dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 --2- 172.21.15.114:0/3433475298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c06b740 0x7fbb8c06dbc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbb740097c0 tx=0x7fbb7401c300 comp rx=0 tx=0).stop 2024-02-17T12:16:53.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 -- 172.21.15.114:0/3433475298 shutdown_connections 2024-02-17T12:16:53.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 --2- 172.21.15.114:0/3433475298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c06b740 0x7fbb8c06dbc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 -- 172.21.15.114:0/3433475298 >> 172.21.15.114:0/3433475298 conn(0x7fbb8c0c6300 msgr2=0x7fbb8c0c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:53.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 -- 172.21.15.114:0/3433475298 shutdown_connections 2024-02-17T12:16:53.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 -- 172.21.15.114:0/3433475298 wait complete. 2024-02-17T12:16:53.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 Processor -- start 2024-02-17T12:16:53.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 -- start start 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c06b740 0x7fbb8c14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8c06e100 0x7fbb8c13fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb8c14cb50 0x7fbb8c13ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c152090 con 0x7fbb8c06e100 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c1f1d10 con 0x7fbb8c06b740 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb91400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c150270 con 0x7fbb8c14cb50 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb83400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8c06e100 0x7fbb8c13fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb83400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8c06e100 0x7fbb8c13fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55746/0 (socket says 172.21.15.114:55746) 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb83400640 1 -- 172.21.15.114:0/3804388489 learned_addr learned my addr 172.21.15.114:0/3804388489 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb90a00640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb8c14cb50 0x7fbb8c13ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb8be00640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c06b740 0x7fbb8c14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb83400640 1 -- 172.21.15.114:0/3804388489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb8c14cb50 msgr2=0x7fbb8c13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb83400640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb8c14cb50 0x7fbb8c13ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb83400640 1 -- 172.21.15.114:0/3804388489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c06b740 msgr2=0x7fbb8c14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb83400640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c06b740 0x7fbb8c14ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb83400640 1 -- 172.21.15.114:0/3804388489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb74009420 con 0x7fbb8c06e100 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb90a00640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb8c14cb50 0x7fbb8c13ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.527+0000 7fbb8be00640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c06b740 0x7fbb8c14ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb83400640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8c06e100 0x7fbb8c13fa40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbb740097c0 tx=0x7fbb7401ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb88c00640 1 -- 172.21.15.114:0/3804388489 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740abd80 con 0x7fbb8c06e100 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb88c00640 1 -- 172.21.15.114:0/3804388489 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74004020 con 0x7fbb8c06e100 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb91400640 1 -- 172.21.15.114:0/3804388489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c150550 con 0x7fbb8c06e100 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb88c00640 1 -- 172.21.15.114:0/3804388489 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740043d0 con 0x7fbb8c06e100 2024-02-17T12:16:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb91400640 1 -- 172.21.15.114:0/3804388489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c150830 con 0x7fbb8c06e100 2024-02-17T12:16:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb91400640 1 -- 172.21.15.114:0/3804388489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c1521d0 con 0x7fbb8c06e100 2024-02-17T12:16:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb88c00640 1 -- 172.21.15.114:0/3804388489 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbb74003620 con 0x7fbb8c06e100 2024-02-17T12:16:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb88c00640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb68066e40 0x7fbb68069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb88c00640 1 -- 172.21.15.114:0/3804388489 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb7411f1f0 con 0x7fbb8c06e100 2024-02-17T12:16:53.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb8be00640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb68066e40 0x7fbb68069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.531+0000 7fbb8be00640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb68066e40 0x7fbb68069300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0011f0 tx=0x7fbb7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:53.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.535+0000 7fbb88c00640 1 -- 172.21.15.114:0/3804388489 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb8c1521d0 con 0x7fbb8c06e100 2024-02-17T12:16:53.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.687+0000 7fbb91400640 1 -- 172.21.15.114:0/3804388489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb8c1521d0 con 0x7fbb8c06e100 2024-02-17T12:16:53.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.687+0000 7fbb88c00640 1 -- 172.21.15.114:0/3804388489 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb8c1521d0 con 0x7fbb8c06e100 2024-02-17T12:16:53.694 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:16:53.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 -- 172.21.15.114:0/3804388489 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb68066e40 msgr2=0x7fbb68069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb68066e40 0x7fbb68069300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0011f0 tx=0x7fbb7c009040 comp rx=0 tx=0).stop 2024-02-17T12:16:53.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 -- 172.21.15.114:0/3804388489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8c06e100 msgr2=0x7fbb8c13fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8c06e100 0x7fbb8c13fa40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbb740097c0 tx=0x7fbb7401ab40 comp rx=0 tx=0).stop 2024-02-17T12:16:53.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 -- 172.21.15.114:0/3804388489 shutdown_connections 2024-02-17T12:16:53.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb8c14cb50 0x7fbb8c13ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb68066e40 0x7fbb68069300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8c06e100 0x7fbb8c13fa40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 --2- 172.21.15.114:0/3804388489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb8c06b740 0x7fbb8c14ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 -- 172.21.15.114:0/3804388489 >> 172.21.15.114:0/3804388489 conn(0x7fbb8c0c6300 msgr2=0x7fbb8c140930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:53.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 -- 172.21.15.114:0/3804388489 shutdown_connections 2024-02-17T12:16:53.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.691+0000 7fbb91400640 1 -- 172.21.15.114:0/3804388489 wait complete. 2024-02-17T12:16:53.715 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:16:53.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.843+0000 7f87b1a00640 1 Processor -- start 2024-02-17T12:16:53.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.843+0000 7f87b1a00640 1 -- start start 2024-02-17T12:16:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87b1a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87ac14f110 0x7f87ac0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87b1a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c2580 0x7f87ac0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87b1a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0a9420 con 0x7f87ac0c1eb0 2024-02-17T12:16:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87b1a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac14f4f0 con 0x7f87ac14f110 2024-02-17T12:16:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87b1a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0aae80 con 0x7f87ac0c2580 2024-02-17T12:16:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87aaa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87ac14f110 0x7f87ac0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87ab400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f87ac0c1eb0 0x7f87ac155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49744/0 (socket says 172.21.15.114:49744) 2024-02-17T12:16:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87ab400640 1 -- 172.21.15.114:0/2678769274 learned_addr learned my addr 172.21.15.114:0/2678769274 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:53.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87aa000640 1 --2- 172.21.15.114:0/2678769274 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c2580 0x7f87ac0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87a9600640 1 -- 172.21.15.114:0/2678769274 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936766770 0 0) 0x7f87ac0a9420 con 0x7f87ac0c1eb0 2024-02-17T12:16:53.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87aaa00640 1 -- 172.21.15.114:0/2678769274 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c2580 msgr2=0x7f87ac0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:53.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87aaa00640 1 --2- 172.21.15.114:0/2678769274 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c2580 0x7f87ac0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87aaa00640 1 -- 172.21.15.114:0/2678769274 >> v1:172.21.15.114:6789/0 conn(0x7f87ac0c1eb0 legacy=0x7f87ac155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.847+0000 7f87aaa00640 1 -- 172.21.15.114:0/2678769274 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac152850 con 0x7f87ac14f110 2024-02-17T12:16:53.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87aaa00640 1 --2- 172.21.15.114:0/2678769274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 0x7f87ac0c65a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f879c009d90 tx=0x7f879c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78df03778f3eeb45 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:53.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87a9600640 1 -- 172.21.15.114:0/2678769274 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0a5970 con 0x7f87ac14f110 2024-02-17T12:16:53.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87a9600640 1 -- 172.21.15.114:0/2678769274 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c0a5ad0 con 0x7f87ac14f110 2024-02-17T12:16:53.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87a9600640 1 -- 172.21.15.114:0/2678769274 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0a5e60 con 0x7f87ac14f110 2024-02-17T12:16:53.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 -- 172.21.15.114:0/2678769274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 msgr2=0x7f87ac0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 --2- 172.21.15.114:0/2678769274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 0x7f87ac0c65a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f879c009d90 tx=0x7f879c01c8b0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 -- 172.21.15.114:0/2678769274 shutdown_connections 2024-02-17T12:16:53.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 --2- 172.21.15.114:0/2678769274 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c2580 0x7f87ac0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 --2- 172.21.15.114:0/2678769274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 0x7f87ac0c65a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 -- 172.21.15.114:0/2678769274 >> 172.21.15.114:0/2678769274 conn(0x7f87ac0a8490 msgr2=0x7f87ac0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:53.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 -- 172.21.15.114:0/2678769274 shutdown_connections 2024-02-17T12:16:53.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 -- 172.21.15.114:0/2678769274 wait complete. 2024-02-17T12:16:53.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 Processor -- start 2024-02-17T12:16:53.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 -- start start 2024-02-17T12:16:53.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c1eb0 0x7f87ac14ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87ac0c2580 0x7f87ac13f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 0x7f87ac13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac13f050 con 0x7f87ac14f110 2024-02-17T12:16:53.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac13f330 con 0x7f87ac0c2580 2024-02-17T12:16:53.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87b1a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac151230 con 0x7f87ac0c1eb0 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87ab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 0x7f87ac13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87ab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 0x7f87ac13fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55768/0 (socket says 172.21.15.114:55768) 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.851+0000 7f87ab400640 1 -- 172.21.15.114:0/118684336 learned_addr learned my addr 172.21.15.114:0/118684336 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87aa000640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87ac0c2580 0x7f87ac13f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87aaa00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c1eb0 0x7f87ac14ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87ab400640 1 -- 172.21.15.114:0/118684336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c1eb0 msgr2=0x7f87ac14ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87ab400640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c1eb0 0x7f87ac14ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87ab400640 1 -- 172.21.15.114:0/118684336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87ac0c2580 msgr2=0x7f87ac13f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87ab400640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87ac0c2580 0x7f87ac13f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87ab400640 1 -- 172.21.15.114:0/118684336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c009a70 con 0x7f87ac14f110 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87aaa00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c1eb0 0x7f87ac14ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87aa000640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87ac0c2580 0x7f87ac13f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:53.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87ab400640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 0x7f87ac13fd00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f87a400c480 tx=0x7f87a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:53.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87a2a00640 1 -- 172.21.15.114:0/118684336 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a40074e0 con 0x7f87ac14f110 2024-02-17T12:16:53.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87a2a00640 1 -- 172.21.15.114:0/118684336 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4007640 con 0x7f87ac14f110 2024-02-17T12:16:53.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87b1a00640 1 -- 172.21.15.114:0/118684336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac151510 con 0x7f87ac14f110 2024-02-17T12:16:53.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87a2a00640 1 -- 172.21.15.114:0/118684336 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4004a30 con 0x7f87ac14f110 2024-02-17T12:16:53.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87b1a00640 1 -- 172.21.15.114:0/118684336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac1544f0 con 0x7f87ac14f110 2024-02-17T12:16:53.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87b1a00640 1 -- 172.21.15.114:0/118684336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac074840 con 0x7f87ac14f110 2024-02-17T12:16:53.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87a2a00640 1 -- 172.21.15.114:0/118684336 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f87a4004b90 con 0x7f87ac14f110 2024-02-17T12:16:53.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87a2a00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8788066e40 0x7f8788069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:53.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87a2a00640 1 -- 172.21.15.114:0/118684336 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87a4083ef0 con 0x7f87ac14f110 2024-02-17T12:16:53.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.855+0000 7f87aaa00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8788066e40 0x7f8788069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:53.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.859+0000 7f87aaa00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8788066e40 0x7f8788069300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f879c0af000 tx=0x7f879c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:53.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:53.859+0000 7f87a2a00640 1 -- 172.21.15.114:0/118684336 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f87a4050d70 con 0x7f87ac14f110 2024-02-17T12:16:54.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 -- 172.21.15.114:0/118684336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87ac0c1380 con 0x7f87ac14f110 2024-02-17T12:16:54.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87a2a00640 1 -- 172.21.15.114:0/118684336 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f87a4018090 con 0x7f87ac14f110 2024-02-17T12:16:54.052 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:54.052 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4241624725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4241624725},{"type":"v1","addr":"172.21.15.114:6837","nonce":4241624725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/178899564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":178899564},{"type":"v1","addr":"172.21.15.114:6836","nonce":178899564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/3301698475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3301698475},{"type":"v1","addr":"172.21.15.116:6834","nonce":3301698475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:16:22.673862+0000","modified":"2024-02-17T12:16:25.681621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6835/4001468997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":4001468997},{"type":"v1","addr":"172.21.15.116:6835","nonce":4001468997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:16:54.053 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-02-17T12:16:54.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 -- 172.21.15.114:0/118684336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8788066e40 msgr2=0x7f8788069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8788066e40 0x7f8788069300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f879c0af000 tx=0x7f879c0a7070 comp rx=0 tx=0).stop 2024-02-17T12:16:54.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 -- 172.21.15.114:0/118684336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 msgr2=0x7f87ac13fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 0x7f87ac13fd00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f87a400c480 tx=0x7f87a400c940 comp rx=0 tx=0).stop 2024-02-17T12:16:54.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 -- 172.21.15.114:0/118684336 shutdown_connections 2024-02-17T12:16:54.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8788066e40 0x7f8788069300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ac14f110 0x7f87ac13fd00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87ac0c2580 0x7f87ac13f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 --2- 172.21.15.114:0/118684336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87ac0c1eb0 0x7f87ac14ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 -- 172.21.15.114:0/118684336 >> 172.21.15.114:0/118684336 conn(0x7f87ac0a8490 msgr2=0x7f87ac071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:54.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 -- 172.21.15.114:0/118684336 shutdown_connections 2024-02-17T12:16:54.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.047+0000 7f87b1a00640 1 -- 172.21.15.114:0/118684336 wait complete. 2024-02-17T12:16:54.074 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c69a00640 1 Processor -- start 2024-02-17T12:16:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c69a00640 1 -- start start 2024-02-17T12:16:54.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c69a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9c640c25a0 0x7f9c6406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c69a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9c6406db50 0x7f9c6414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c69a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c64156270 con 0x7f9c64150490 2024-02-17T12:16:54.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c69a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c64071630 con 0x7f9c640c25a0 2024-02-17T12:16:54.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c69a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c64156550 con 0x7f9c6406db50 2024-02-17T12:16:54.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c62a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9c640c25a0 0x7f9c6406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c63400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9c64150490 0x7f9c64152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49760/0 (socket says 172.21.15.114:49760) 2024-02-17T12:16:54.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c63400640 1 -- 172.21.15.114:0/215050589 learned_addr learned my addr 172.21.15.114:0/215050589 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:54.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c62000640 1 --2- 172.21.15.114:0/215050589 >> v2:172.21.15.116:3300/0 conn(0x7f9c6406db50 0x7f9c6414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c62a00640 1 -- 172.21.15.114:0/215050589 >> v2:172.21.15.116:3300/0 conn(0x7f9c6406db50 msgr2=0x7f9c6414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:54.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c62a00640 1 --2- 172.21.15.114:0/215050589 >> v2:172.21.15.116:3300/0 conn(0x7f9c6406db50 0x7f9c6414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c62a00640 1 -- 172.21.15.114:0/215050589 >> v1:172.21.15.114:6789/0 conn(0x7f9c64150490 legacy=0x7f9c64152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c62a00640 1 -- 172.21.15.114:0/215050589 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c64156830 con 0x7f9c640c25a0 2024-02-17T12:16:54.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.203+0000 7f9c61600640 1 -- 172.21.15.114:0/215050589 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232678921 0 0) 0x7f9c64156270 con 0x7f9c64150490 2024-02-17T12:16:54.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c62a00640 1 --2- 172.21.15.114:0/215050589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640c25a0 0x7f9c6406e980 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9c6406e260 tx=0x7f9c5401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f320e98e9f0b3a37 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:54.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c61600640 1 -- 172.21.15.114:0/215050589 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c540a66f0 con 0x7f9c640c25a0 2024-02-17T12:16:54.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c61600640 1 -- 172.21.15.114:0/215050589 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c540a6850 con 0x7f9c640c25a0 2024-02-17T12:16:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c61600640 1 -- 172.21.15.114:0/215050589 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c540a6be0 con 0x7f9c640c25a0 2024-02-17T12:16:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c69a00640 1 -- 172.21.15.114:0/215050589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640c25a0 msgr2=0x7f9c6406e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c69a00640 1 --2- 172.21.15.114:0/215050589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640c25a0 0x7f9c6406e980 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9c6406e260 tx=0x7f9c5401c810 comp rx=0 tx=0).stop 2024-02-17T12:16:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c69a00640 1 -- 172.21.15.114:0/215050589 shutdown_connections 2024-02-17T12:16:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c69a00640 1 --2- 172.21.15.114:0/215050589 >> v2:172.21.15.116:3300/0 conn(0x7f9c6406db50 0x7f9c6414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c69a00640 1 --2- 172.21.15.114:0/215050589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640c25a0 0x7f9c6406e980 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c69a00640 1 -- 172.21.15.114:0/215050589 >> 172.21.15.114:0/215050589 conn(0x7f9c640a8490 msgr2=0x7f9c640a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c69a00640 1 -- 172.21.15.114:0/215050589 shutdown_connections 2024-02-17T12:16:54.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.207+0000 7f9c69a00640 1 -- 172.21.15.114:0/215050589 wait complete. 2024-02-17T12:16:54.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 Processor -- start 2024-02-17T12:16:54.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 -- start start 2024-02-17T12:16:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9c6406db50 0x7f9c64151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c640c25a0 0x7f9c641476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c64150490 0x7f9c64147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640aa0c0 con 0x7f9c64150490 2024-02-17T12:16:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c641431b0 con 0x7f9c640c25a0 2024-02-17T12:16:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c64144820 con 0x7f9c6406db50 2024-02-17T12:16:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c63400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c64150490 0x7f9c64147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c63400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c64150490 0x7f9c64147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55782/0 (socket says 172.21.15.114:55782) 2024-02-17T12:16:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c63400640 1 -- 172.21.15.114:0/3793975432 learned_addr learned my addr 172.21.15.114:0/3793975432 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c63400640 1 -- 172.21.15.114:0/3793975432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9c6406db50 msgr2=0x7f9c64151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c63400640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9c6406db50 0x7f9c64151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c63400640 1 -- 172.21.15.114:0/3793975432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c640c25a0 msgr2=0x7f9c641476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c62000640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c640c25a0 0x7f9c641476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c63400640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c640c25a0 0x7f9c641476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c63400640 1 -- 172.21.15.114:0/3793975432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54009a70 con 0x7f9c64150490 2024-02-17T12:16:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c62000640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c640c25a0 0x7f9c641476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c63400640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c64150490 0x7f9c64147be0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c3e0 tx=0x7f9c5c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c5aa00640 1 -- 172.21.15.114:0/3793975432 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0074e0 con 0x7f9c64150490 2024-02-17T12:16:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c5aa00640 1 -- 172.21.15.114:0/3793975432 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c007660 con 0x7f9c64150490 2024-02-17T12:16:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 -- 172.21.15.114:0/3793975432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c64144b00 con 0x7f9c64150490 2024-02-17T12:16:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c5aa00640 1 -- 172.21.15.114:0/3793975432 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c004a30 con 0x7f9c64150490 2024-02-17T12:16:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 -- 172.21.15.114:0/3793975432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c641436a0 con 0x7f9c64150490 2024-02-17T12:16:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.211+0000 7f9c69a00640 1 -- 172.21.15.114:0/3793975432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c641438c0 con 0x7f9c64150490 2024-02-17T12:16:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.215+0000 7f9c5aa00640 1 -- 172.21.15.114:0/3793975432 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9c5c004b90 con 0x7f9c64150490 2024-02-17T12:16:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.215+0000 7f9c5aa00640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9c44066e40 0x7f9c44069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.215+0000 7f9c5aa00640 1 -- 172.21.15.114:0/3793975432 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c5c0847c0 con 0x7f9c64150490 2024-02-17T12:16:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.215+0000 7f9c62a00640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9c44066e40 0x7f9c44069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.215+0000 7f9c62a00640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9c44066e40 0x7f9c44069300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9c540af000 tx=0x7f9c54004ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.219+0000 7f9c5aa00640 1 -- 172.21.15.114:0/3793975432 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9c5c0515a0 con 0x7f9c64150490 2024-02-17T12:16:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.375+0000 7f9c69a00640 1 -- 172.21.15.114:0/3793975432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c64144cf0 con 0x7f9c64150490 2024-02-17T12:16:54.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c5aa00640 1 -- 172.21.15.114:0/3793975432 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f9c5c001090 con 0x7f9c64150490 2024-02-17T12:16:54.383 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:54.383 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:54.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 -- 172.21.15.114:0/3793975432 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9c44066e40 msgr2=0x7f9c44069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9c44066e40 0x7f9c44069300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9c540af000 tx=0x7f9c54004ac0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 -- 172.21.15.114:0/3793975432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c64150490 msgr2=0x7f9c64147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c64150490 0x7f9c64147be0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c3e0 tx=0x7f9c5c00c8a0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 -- 172.21.15.114:0/3793975432 shutdown_connections 2024-02-17T12:16:54.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9c44066e40 0x7f9c44069300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c64150490 0x7f9c64147be0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9c640c25a0 0x7f9c641476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 --2- 172.21.15.114:0/3793975432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9c6406db50 0x7f9c64151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 -- 172.21.15.114:0/3793975432 >> 172.21.15.114:0/3793975432 conn(0x7f9c640a8490 msgr2=0x7f9c64148e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 -- 172.21.15.114:0/3793975432 shutdown_connections 2024-02-17T12:16:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.379+0000 7f9c69a00640 1 -- 172.21.15.114:0/3793975432 wait complete. 2024-02-17T12:16:54.404 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-17T12:16:54.404 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:16:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.531+0000 7fb57a800640 1 Processor -- start 2024-02-17T12:16:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb57a800640 1 -- start start 2024-02-17T12:16:54.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb57a800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb5741521d0 0x7fb57406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb57a800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb574071d80 0x7fb57406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb57a800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5740c0820 con 0x7fb57406f390 2024-02-17T12:16:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb57a800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57406bab0 con 0x7fb5741521d0 2024-02-17T12:16:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb57a800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5740722d0 con 0x7fb574071d80 2024-02-17T12:16:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb579400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb5741521d0 0x7fb57406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb579400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb5741521d0 0x7fb57406ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55794/0 (socket says 172.21.15.114:55794) 2024-02-17T12:16:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb579400640 1 -- 172.21.15.114:0/1308203874 learned_addr learned my addr 172.21.15.114:0/1308203874 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb579e00640 1 --2- 172.21.15.114:0/1308203874 >> v2:172.21.15.116:3300/0 conn(0x7fb574071d80 0x7fb57406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb579400640 1 -- 172.21.15.114:0/1308203874 >> v2:172.21.15.116:3300/0 conn(0x7fb574071d80 msgr2=0x7fb57406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb579400640 1 --2- 172.21.15.114:0/1308203874 >> v2:172.21.15.116:3300/0 conn(0x7fb574071d80 0x7fb57406b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb579400640 1 -- 172.21.15.114:0/1308203874 >> v1:172.21.15.116:6789/0 conn(0x7fb57406f390 legacy=0x7fb574154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.535+0000 7fb579400640 1 -- 172.21.15.114:0/1308203874 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740c0a70 con 0x7fb5741521d0 2024-02-17T12:16:54.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb579400640 1 --2- 172.21.15.114:0/1308203874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5741521d0 0x7fb57406ac10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb5740aa240 tx=0x7fb56801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bf05f401474e3a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:54.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb573e00640 1 -- 172.21.15.114:0/1308203874 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5680ab600 con 0x7fb5741521d0 2024-02-17T12:16:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb573e00640 1 -- 172.21.15.114:0/1308203874 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5680a7050 con 0x7fb5741521d0 2024-02-17T12:16:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb573e00640 1 -- 172.21.15.114:0/1308203874 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5680ab980 con 0x7fb5741521d0 2024-02-17T12:16:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb57a800640 1 -- 172.21.15.114:0/1308203874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5741521d0 msgr2=0x7fb57406ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb57a800640 1 --2- 172.21.15.114:0/1308203874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5741521d0 0x7fb57406ac10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb5740aa240 tx=0x7fb56801c3c0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb57a800640 1 -- 172.21.15.114:0/1308203874 shutdown_connections 2024-02-17T12:16:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb57a800640 1 --2- 172.21.15.114:0/1308203874 >> v2:172.21.15.116:3300/0 conn(0x7fb574071d80 0x7fb57406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb57a800640 1 --2- 172.21.15.114:0/1308203874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5741521d0 0x7fb57406ac10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb57a800640 1 -- 172.21.15.114:0/1308203874 >> 172.21.15.114:0/1308203874 conn(0x7fb574066f60 msgr2=0x7fb5740c73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb57a800640 1 -- 172.21.15.114:0/1308203874 shutdown_connections 2024-02-17T12:16:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb57a800640 1 -- 172.21.15.114:0/1308203874 wait complete. 2024-02-17T12:16:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb57a800640 1 Processor -- start 2024-02-17T12:16:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.539+0000 7fb57a800640 1 -- start start 2024-02-17T12:16:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb57a800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb57406f390 0x7fb5740aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb57a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb574071d80 0x7fb5740c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb57a800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5741521d0 0x7fb574149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb57a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57414b6c0 con 0x7fb574071d80 2024-02-17T12:16:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb57a800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740c2090 con 0x7fb5741521d0 2024-02-17T12:16:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb57a800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb574148fe0 con 0x7fb57406f390 2024-02-17T12:16:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb578a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb574071d80 0x7fb5740c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb578a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb574071d80 0x7fb5740c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55806/0 (socket says 172.21.15.114:55806) 2024-02-17T12:16:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb578a00640 1 -- 172.21.15.114:0/3144208522 learned_addr learned my addr 172.21.15.114:0/3144208522 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb579400640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb57406f390 0x7fb5740aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb579e00640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5741521d0 0x7fb574149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb578a00640 1 -- 172.21.15.114:0/3144208522 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb57406f390 msgr2=0x7fb5740aa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb578a00640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb57406f390 0x7fb5740aa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb578a00640 1 -- 172.21.15.114:0/3144208522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5741521d0 msgr2=0x7fb574149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb578a00640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5741521d0 0x7fb574149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb578a00640 1 -- 172.21.15.114:0/3144208522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680094d0 con 0x7fb574071d80 2024-02-17T12:16:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb578a00640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb574071d80 0x7fb5740c6290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb56000b410 tx=0x7fb56000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb571600640 1 -- 172.21.15.114:0/3144208522 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560004020 con 0x7fb574071d80 2024-02-17T12:16:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb571600640 1 -- 172.21.15.114:0/3144208522 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560004180 con 0x7fb574071d80 2024-02-17T12:16:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb571600640 1 -- 172.21.15.114:0/3144208522 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560011630 con 0x7fb574071d80 2024-02-17T12:16:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb57a800640 1 -- 172.21.15.114:0/3144208522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5740c1b60 con 0x7fb574071d80 2024-02-17T12:16:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb57a800640 1 -- 172.21.15.114:0/3144208522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5740c67d0 con 0x7fb574071d80 2024-02-17T12:16:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb57a800640 1 -- 172.21.15.114:0/3144208522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57414b870 con 0x7fb574071d80 2024-02-17T12:16:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.543+0000 7fb571600640 1 -- 172.21.15.114:0/3144208522 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb560011790 con 0x7fb574071d80 2024-02-17T12:16:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.547+0000 7fb571600640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb554066e70 0x7fb554069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.547+0000 7fb571600640 1 -- 172.21.15.114:0/3144208522 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb560084660 con 0x7fb574071d80 2024-02-17T12:16:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.547+0000 7fb579400640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb554066e70 0x7fb554069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.547+0000 7fb579400640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb554066e70 0x7fb554069330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb5680ad000 tx=0x7fb568008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:54.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.551+0000 7fb571600640 1 -- 172.21.15.114:0/3144208522 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb57414b870 con 0x7fb574071d80 2024-02-17T12:16:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 -- 172.21.15.114:0/3144208522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb574149500 con 0x7fb574071d80 2024-02-17T12:16:54.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb571600640 1 -- 172.21.15.114:0/3144208522 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fb560051500 con 0x7fb574071d80 2024-02-17T12:16:54.740 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:54.740 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4241624725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4241624725},{"type":"v1","addr":"172.21.15.114:6837","nonce":4241624725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/178899564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":178899564},{"type":"v1","addr":"172.21.15.114:6836","nonce":178899564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/3301698475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3301698475},{"type":"v1","addr":"172.21.15.116:6834","nonce":3301698475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:16:22.673862+0000","modified":"2024-02-17T12:16:25.681621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6835/4001468997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":4001468997},{"type":"v1","addr":"172.21.15.116:6835","nonce":4001468997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:16:54.741 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-02-17T12:16:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 -- 172.21.15.114:0/3144208522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb554066e70 msgr2=0x7fb554069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb554066e70 0x7fb554069330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb5680ad000 tx=0x7fb568008040 comp rx=0 tx=0).stop 2024-02-17T12:16:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 -- 172.21.15.114:0/3144208522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb574071d80 msgr2=0x7fb5740c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb574071d80 0x7fb5740c6290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb56000b410 tx=0x7fb56000b8d0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 -- 172.21.15.114:0/3144208522 shutdown_connections 2024-02-17T12:16:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5741521d0 0x7fb574149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb554066e70 0x7fb554069330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb574071d80 0x7fb5740c6290 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 --2- 172.21.15.114:0/3144208522 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb57406f390 0x7fb5740aa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 -- 172.21.15.114:0/3144208522 >> 172.21.15.114:0/3144208522 conn(0x7fb574066f60 msgr2=0x7fb5741533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.735+0000 7fb57a800640 1 -- 172.21.15.114:0/3144208522 shutdown_connections 2024-02-17T12:16:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.739+0000 7fb57a800640 1 -- 172.21.15.114:0/3144208522 wait complete. 2024-02-17T12:16:54.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:16:54.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf39c00640 1 Processor -- start 2024-02-17T12:16:54.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf39c00640 1 -- start start 2024-02-17T12:16:54.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf39c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf340c2580 0x7faf340aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf39c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf340c1eb0 0x7faf3415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf39c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340a9420 con 0x7faf3414f110 2024-02-17T12:16:54.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf39c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3414f4f0 con 0x7faf340c2580 2024-02-17T12:16:54.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf39c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340aae80 con 0x7faf340c1eb0 2024-02-17T12:16:54.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf32000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf340c2580 0x7faf340aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf32000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf340c2580 0x7faf340aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55812/0 (socket says 172.21.15.114:55812) 2024-02-17T12:16:54.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf32000640 1 -- 172.21.15.114:0/2828506508 learned_addr learned my addr 172.21.15.114:0/2828506508 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:54.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf33400640 1 --2- 172.21.15.114:0/2828506508 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf340c1eb0 0x7faf3415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf32000640 1 -- 172.21.15.114:0/2828506508 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf340c1eb0 msgr2=0x7faf3415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:54.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf32000640 1 --2- 172.21.15.114:0/2828506508 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf340c1eb0 0x7faf3415c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf32000640 1 -- 172.21.15.114:0/2828506508 >> v1:172.21.15.116:6789/0 conn(0x7faf3414f110 legacy=0x7faf340c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.891+0000 7faf32000640 1 -- 172.21.15.114:0/2828506508 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf34152850 con 0x7faf340c2580 2024-02-17T12:16:54.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf32000640 1 --2- 172.21.15.114:0/2828506508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf340c2580 0x7faf340aa150 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faf2000bb10 tx=0x7faf2001eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78bc78075822c4a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:54.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf31600640 1 -- 172.21.15.114:0/2828506508 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf200a7b40 con 0x7faf340c2580 2024-02-17T12:16:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf31600640 1 -- 172.21.15.114:0/2828506508 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf200a7ca0 con 0x7faf340c2580 2024-02-17T12:16:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf31600640 1 -- 172.21.15.114:0/2828506508 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf200af660 con 0x7faf340c2580 2024-02-17T12:16:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf39c00640 1 -- 172.21.15.114:0/2828506508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf340c2580 msgr2=0x7faf340aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf39c00640 1 --2- 172.21.15.114:0/2828506508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf340c2580 0x7faf340aa150 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faf2000bb10 tx=0x7faf2001eb70 comp rx=0 tx=0).stop 2024-02-17T12:16:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf39c00640 1 -- 172.21.15.114:0/2828506508 shutdown_connections 2024-02-17T12:16:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf39c00640 1 --2- 172.21.15.114:0/2828506508 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf340c1eb0 0x7faf3415c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf39c00640 1 --2- 172.21.15.114:0/2828506508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf340c2580 0x7faf340aa150 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf39c00640 1 -- 172.21.15.114:0/2828506508 >> 172.21.15.114:0/2828506508 conn(0x7faf340a8490 msgr2=0x7faf340a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf39c00640 1 -- 172.21.15.114:0/2828506508 shutdown_connections 2024-02-17T12:16:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.895+0000 7faf39c00640 1 -- 172.21.15.114:0/2828506508 wait complete. 2024-02-17T12:16:54.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf39c00640 1 Processor -- start 2024-02-17T12:16:54.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf39c00640 1 -- start start 2024-02-17T12:16:54.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf39c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf340c1eb0 0x7faf34141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf39c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf340c2580 0x7faf340c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf39c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf3414f110 0x7faf340c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf39c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3414cf30 con 0x7faf3414f110 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf39c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3413dbb0 con 0x7faf340c2580 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf39c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf34151830 con 0x7faf340c1eb0 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf33400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf3414f110 0x7faf340c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf33400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf3414f110 0x7faf340c4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55814/0 (socket says 172.21.15.114:55814) 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf33400640 1 -- 172.21.15.114:0/565315946 learned_addr learned my addr 172.21.15.114:0/565315946 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf32000640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf340c2580 0x7faf340c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf32a00640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf340c1eb0 0x7faf34141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf33400640 1 -- 172.21.15.114:0/565315946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf340c1eb0 msgr2=0x7faf34141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf33400640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf340c1eb0 0x7faf34141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf33400640 1 -- 172.21.15.114:0/565315946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf340c2580 msgr2=0x7faf340c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf33400640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf340c2580 0x7faf340c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf33400640 1 -- 172.21.15.114:0/565315946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2000b770 con 0x7faf3414f110 2024-02-17T12:16:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf33400640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf3414f110 0x7faf340c4d40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faf2c006e90 tx=0x7faf2c00d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf2aa00640 1 -- 172.21.15.114:0/565315946 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0125f0 con 0x7faf3414f110 2024-02-17T12:16:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf2aa00640 1 -- 172.21.15.114:0/565315946 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c012750 con 0x7faf3414f110 2024-02-17T12:16:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf39c00640 1 -- 172.21.15.114:0/565315946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3413d8d0 con 0x7faf3414f110 2024-02-17T12:16:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf2aa00640 1 -- 172.21.15.114:0/565315946 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c012b00 con 0x7faf3414f110 2024-02-17T12:16:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.899+0000 7faf39c00640 1 -- 172.21.15.114:0/565315946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf340c42e0 con 0x7faf3414f110 2024-02-17T12:16:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.903+0000 7faf39c00640 1 -- 172.21.15.114:0/565315946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf340c44d0 con 0x7faf3414f110 2024-02-17T12:16:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.903+0000 7faf2aa00640 1 -- 172.21.15.114:0/565315946 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7faf2c012c60 con 0x7faf3414f110 2024-02-17T12:16:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.903+0000 7faf2aa00640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf14066e40 0x7faf14069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.903+0000 7faf2aa00640 1 -- 172.21.15.114:0/565315946 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf2c084c30 con 0x7faf3414f110 2024-02-17T12:16:54.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.903+0000 7faf32a00640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf14066e40 0x7faf14069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:54.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.903+0000 7faf32a00640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf14066e40 0x7faf14069300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf24001ea0 tx=0x7faf24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:54.907+0000 7faf2aa00640 1 -- 172.21.15.114:0/565315946 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faf2c051b60 con 0x7faf3414f110 2024-02-17T12:16:55.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.091+0000 7faf39c00640 1 -- 172.21.15.114:0/565315946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf34074840 con 0x7faf3414f110 2024-02-17T12:16:55.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.091+0000 7faf2aa00640 1 -- 172.21.15.114:0/565315946 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7faf2c055220 con 0x7faf3414f110 2024-02-17T12:16:55.098 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:55.098 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4241624725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4241624725},{"type":"v1","addr":"172.21.15.114:6837","nonce":4241624725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/178899564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":178899564},{"type":"v1","addr":"172.21.15.114:6836","nonce":178899564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/3301698475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":3301698475},{"type":"v1","addr":"172.21.15.116:6834","nonce":3301698475}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:16:22.673862+0000","modified":"2024-02-17T12:16:25.681621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.116:6835/4001468997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":4001468997},{"type":"v1","addr":"172.21.15.116:6835","nonce":4001468997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-17T12:16:55.098 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-02-17T12:16:55.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 -- 172.21.15.114:0/565315946 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf14066e40 msgr2=0x7faf14069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf14066e40 0x7faf14069300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf24001ea0 tx=0x7faf24009040 comp rx=0 tx=0).stop 2024-02-17T12:16:55.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 -- 172.21.15.114:0/565315946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf3414f110 msgr2=0x7faf340c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf3414f110 0x7faf340c4d40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faf2c006e90 tx=0x7faf2c00d9e0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 -- 172.21.15.114:0/565315946 shutdown_connections 2024-02-17T12:16:55.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faf14066e40 0x7faf14069300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf3414f110 0x7faf340c4d40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faf340c2580 0x7faf340c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 --2- 172.21.15.114:0/565315946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7faf340c1eb0 0x7faf34141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 -- 172.21.15.114:0/565315946 >> 172.21.15.114:0/565315946 conn(0x7faf340a8490 msgr2=0x7faf340c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:55.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 -- 172.21.15.114:0/565315946 shutdown_connections 2024-02-17T12:16:55.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.095+0000 7faf39c00640 1 -- 172.21.15.114:0/565315946 wait complete. 2024-02-17T12:16:55.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:16:55.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.247+0000 7f3621c00640 1 Processor -- start 2024-02-17T12:16:55.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.247+0000 7f3621c00640 1 -- start start 2024-02-17T12:16:55.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f3621c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f361c14f110 0x7f361c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f3621c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0a9420 con 0x7f361c0c2580 2024-02-17T12:16:55.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f3621c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c152850 con 0x7f361c0c1eb0 2024-02-17T12:16:55.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f3621c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361c14f4f0 con 0x7f361c14f110 2024-02-17T12:16:55.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f3613e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f361c0c2580 0x7f361c0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56358/0 (socket says 172.21.15.114:56358) 2024-02-17T12:16:55.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f361aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f361c14f110 0x7f361c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f3613e00640 1 -- 172.21.15.114:0/1646160677 learned_addr learned my addr 172.21.15.114:0/1646160677 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:55.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f361aa00640 1 -- 172.21.15.114:0/1646160677 >> v1:172.21.15.116:6789/0 conn(0x7f361c0c1eb0 legacy=0x7f361c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:55.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f361aa00640 1 -- 172.21.15.114:0/1646160677 >> v1:172.21.15.114:6789/0 conn(0x7f361c0c2580 legacy=0x7f361c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f361aa00640 1 -- 172.21.15.114:0/1646160677 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c0a9670 con 0x7f361c14f110 2024-02-17T12:16:55.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.251+0000 7f361a000640 1 -- 172.21.15.114:0/1646160677 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211134893 0 0) 0x7f361c0a9420 con 0x7f361c0c2580 2024-02-17T12:16:55.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f361aa00640 1 --2- 172.21.15.114:0/1646160677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 0x7f361c0c65a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f360c0097c0 tx=0x7f360c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b66ab58155c3f41 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:55.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f361a000640 1 -- 172.21.15.114:0/1646160677 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c0ab600 con 0x7f361c14f110 2024-02-17T12:16:55.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f361a000640 1 -- 172.21.15.114:0/1646160677 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c0a7050 con 0x7f361c14f110 2024-02-17T12:16:55.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f361a000640 1 -- 172.21.15.114:0/1646160677 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c0ab980 con 0x7f361c14f110 2024-02-17T12:16:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f3621c00640 1 -- 172.21.15.114:0/1646160677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 msgr2=0x7f361c0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f3621c00640 1 --2- 172.21.15.114:0/1646160677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 0x7f361c0c65a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f360c0097c0 tx=0x7f360c01c3d0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f3621c00640 1 -- 172.21.15.114:0/1646160677 shutdown_connections 2024-02-17T12:16:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f3621c00640 1 --2- 172.21.15.114:0/1646160677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 0x7f361c0c65a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f3621c00640 1 -- 172.21.15.114:0/1646160677 >> 172.21.15.114:0/1646160677 conn(0x7f361c0a8490 msgr2=0x7f361c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f3621c00640 1 -- 172.21.15.114:0/1646160677 shutdown_connections 2024-02-17T12:16:55.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f3621c00640 1 -- 172.21.15.114:0/1646160677 wait complete. 2024-02-17T12:16:55.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f3621c00640 1 Processor -- start 2024-02-17T12:16:55.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.255+0000 7f3621c00640 1 -- start start 2024-02-17T12:16:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3621c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f361c0c1eb0 0x7f361c14a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3621c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f361c0c2580 0x7f361c13e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3621c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 0x7f361c13eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3621c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0c01e0 con 0x7f361c14f110 2024-02-17T12:16:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3621c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0c45e0 con 0x7f361c0c2580 2024-02-17T12:16:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3621c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1515a0 con 0x7f361c0c1eb0 2024-02-17T12:16:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f361b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 0x7f361c13eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3613e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f361c0c2580 0x7f361c13e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f361b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 0x7f361c13eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45524/0 (socket says 172.21.15.114:45524) 2024-02-17T12:16:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f361b400640 1 -- 172.21.15.114:0/2519697986 learned_addr learned my addr 172.21.15.114:0/2519697986 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f361aa00640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f361c0c1eb0 0x7f361c14a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f361b400640 1 -- 172.21.15.114:0/2519697986 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f361c0c1eb0 msgr2=0x7f361c14a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f361b400640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f361c0c1eb0 0x7f361c14a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f361b400640 1 -- 172.21.15.114:0/2519697986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f361c0c2580 msgr2=0x7f361c13e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f361b400640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f361c0c2580 0x7f361c13e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f361b400640 1 -- 172.21.15.114:0/2519697986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c009420 con 0x7f361c14f110 2024-02-17T12:16:55.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f361b400640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 0x7f361c13eee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f361400b970 tx=0x7f361400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:55.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3612a00640 1 -- 172.21.15.114:0/2519697986 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361400cb40 con 0x7f361c14f110 2024-02-17T12:16:55.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3612a00640 1 -- 172.21.15.114:0/2519697986 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361400cca0 con 0x7f361c14f110 2024-02-17T12:16:55.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3621c00640 1 -- 172.21.15.114:0/2519697986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c151860 con 0x7f361c14f110 2024-02-17T12:16:55.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3612a00640 1 -- 172.21.15.114:0/2519697986 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614014680 con 0x7f361c14f110 2024-02-17T12:16:55.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3621c00640 1 -- 172.21.15.114:0/2519697986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c0bfe70 con 0x7f361c14f110 2024-02-17T12:16:55.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3621c00640 1 -- 172.21.15.114:0/2519697986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c0c5110 con 0x7f361c14f110 2024-02-17T12:16:55.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.259+0000 7f3612a00640 1 -- 172.21.15.114:0/2519697986 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f361401d3b0 con 0x7f361c14f110 2024-02-17T12:16:55.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.263+0000 7f3612a00640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35f8066e70 0x7f35f8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.263+0000 7f3612a00640 1 -- 172.21.15.114:0/2519697986 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36140847e0 con 0x7f361c14f110 2024-02-17T12:16:55.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.263+0000 7f361aa00640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35f8066e70 0x7f35f8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.263+0000 7f361aa00640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35f8066e70 0x7f35f8069330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f360c0ad000 tx=0x7f360c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:55.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.267+0000 7f3612a00640 1 -- 172.21.15.114:0/2519697986 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f361c0c5110 con 0x7f361c14f110 2024-02-17T12:16:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.423+0000 7f3621c00640 1 -- 172.21.15.114:0/2519697986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f361c0c5110 con 0x7f361c14f110 2024-02-17T12:16:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3612a00640 1 -- 172.21.15.114:0/2519697986 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f361c0c5110 con 0x7f361c14f110 2024-02-17T12:16:55.431 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:16:55.431 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:24.297756+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:16:21.236908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-17T12:16:21.659009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:16:55.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 -- 172.21.15.114:0/2519697986 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35f8066e70 msgr2=0x7f35f8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35f8066e70 0x7f35f8069330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f360c0ad000 tx=0x7f360c0a6000 comp rx=0 tx=0).stop 2024-02-17T12:16:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 -- 172.21.15.114:0/2519697986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 msgr2=0x7f361c13eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 0x7f361c13eee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f361400b970 tx=0x7f361400be30 comp rx=0 tx=0).stop 2024-02-17T12:16:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 -- 172.21.15.114:0/2519697986 shutdown_connections 2024-02-17T12:16:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f35f8066e70 0x7f35f8069330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f361c14f110 0x7f361c13eee0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f361c0c2580 0x7f361c13e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 --2- 172.21.15.114:0/2519697986 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f361c0c1eb0 0x7f361c14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 -- 172.21.15.114:0/2519697986 >> 172.21.15.114:0/2519697986 conn(0x7f361c0a8490 msgr2=0x7f361c142230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 -- 172.21.15.114:0/2519697986 shutdown_connections 2024-02-17T12:16:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.427+0000 7f3621c00640 1 -- 172.21.15.114:0/2519697986 wait complete. 2024-02-17T12:16:55.452 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-17T12:16:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cca600640 1 Processor -- start 2024-02-17T12:16:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cca600640 1 -- start start 2024-02-17T12:16:55.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cca600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cc40c25a0 0x7f0cc406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cca600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0cc4152c50 0x7f0cc41530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cca600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc4156270 con 0x7f0cc406db50 2024-02-17T12:16:55.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cca600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc4071630 con 0x7f0cc4152c50 2024-02-17T12:16:55.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cca600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4156550 con 0x7f0cc40c25a0 2024-02-17T12:16:55.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cc2a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0cc406db50 0x7f0cc414ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56366/0 (socket says 172.21.15.114:56366) 2024-02-17T12:16:55.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cc2a00640 1 -- 172.21.15.114:0/1559081234 learned_addr learned my addr 172.21.15.114:0/1559081234 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:55.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cc3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0cc4152c50 0x7f0cc41530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cc3400640 1 --2- 172.21.15.114:0/1559081234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cc40c25a0 0x7f0cc406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cc3e00640 1 -- 172.21.15.114:0/1559081234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cc40c25a0 msgr2=0x7f0cc406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cc3e00640 1 --2- 172.21.15.114:0/1559081234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cc40c25a0 0x7f0cc406e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cc3e00640 1 -- 172.21.15.114:0/1559081234 >> v1:172.21.15.114:6789/0 conn(0x7f0cc406db50 legacy=0x7f0cc414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cc3e00640 1 -- 172.21.15.114:0/1559081234 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc4156830 con 0x7f0cc4152c50 2024-02-17T12:16:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.583+0000 7f0cc2000640 1 -- 172.21.15.114:0/1559081234 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317897914 0 0) 0x7f0cc4156270 con 0x7f0cc406db50 2024-02-17T12:16:55.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cc3e00640 1 --2- 172.21.15.114:0/1559081234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc4152c50 0x7f0cc41530e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0097c0 tx=0x7f0cbc01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28b0fc805495044 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:55.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cc2000640 1 -- 172.21.15.114:0/1559081234 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0ab600 con 0x7f0cc4152c50 2024-02-17T12:16:55.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cc2000640 1 -- 172.21.15.114:0/1559081234 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc0a7050 con 0x7f0cc4152c50 2024-02-17T12:16:55.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cc2000640 1 -- 172.21.15.114:0/1559081234 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0ab980 con 0x7f0cc4152c50 2024-02-17T12:16:55.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cca600640 1 -- 172.21.15.114:0/1559081234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc4152c50 msgr2=0x7f0cc41530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cca600640 1 --2- 172.21.15.114:0/1559081234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc4152c50 0x7f0cc41530e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0097c0 tx=0x7f0cbc01c350 comp rx=0 tx=0).stop 2024-02-17T12:16:55.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cca600640 1 -- 172.21.15.114:0/1559081234 shutdown_connections 2024-02-17T12:16:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cca600640 1 --2- 172.21.15.114:0/1559081234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc4152c50 0x7f0cc41530e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cca600640 1 --2- 172.21.15.114:0/1559081234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cc40c25a0 0x7f0cc406e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cca600640 1 -- 172.21.15.114:0/1559081234 >> 172.21.15.114:0/1559081234 conn(0x7f0cc40a8490 msgr2=0x7f0cc40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cca600640 1 -- 172.21.15.114:0/1559081234 shutdown_connections 2024-02-17T12:16:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.587+0000 7f0cca600640 1 -- 172.21.15.114:0/1559081234 wait complete. 2024-02-17T12:16:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cca600640 1 Processor -- start 2024-02-17T12:16:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cca600640 1 -- start start 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cca600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc406db50 0x7f0cc40aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cca600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc40c25a0 0x7f0cc41497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cca600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cc4152c50 0x7f0cc41ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cca600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc41ecff0 con 0x7f0cc40c25a0 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cca600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4140570 con 0x7f0cc406db50 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cca600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc41f0960 con 0x7f0cc4152c50 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc40c25a0 0x7f0cc41497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc40c25a0 0x7f0cc41497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45538/0 (socket says 172.21.15.114:45538) 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc2a00640 1 -- 172.21.15.114:0/4032940001 learned_addr learned my addr 172.21.15.114:0/4032940001 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc3400640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc406db50 0x7f0cc40aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc3e00640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cc4152c50 0x7f0cc41ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc2a00640 1 -- 172.21.15.114:0/4032940001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cc4152c50 msgr2=0x7f0cc41ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc2a00640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cc4152c50 0x7f0cc41ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc2a00640 1 -- 172.21.15.114:0/4032940001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc406db50 msgr2=0x7f0cc40aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc2a00640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc406db50 0x7f0cc40aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc2a00640 1 -- 172.21.15.114:0/4032940001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc009420 con 0x7f0cc40c25a0 2024-02-17T12:16:55.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cc2a00640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc40c25a0 0x7f0cc41497b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00011f0 tx=0x7f0cb000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:55.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cbb400640 1 -- 172.21.15.114:0/4032940001 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00074e0 con 0x7f0cc40c25a0 2024-02-17T12:16:55.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cbb400640 1 -- 172.21.15.114:0/4032940001 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0007640 con 0x7f0cc40c25a0 2024-02-17T12:16:55.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cca600640 1 -- 172.21.15.114:0/4032940001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc41f0c40 con 0x7f0cc40c25a0 2024-02-17T12:16:55.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cbb400640 1 -- 172.21.15.114:0/4032940001 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0004a10 con 0x7f0cc40c25a0 2024-02-17T12:16:55.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.591+0000 7f0cca600640 1 -- 172.21.15.114:0/4032940001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc41f1200 con 0x7f0cc40c25a0 2024-02-17T12:16:55.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.595+0000 7f0cca600640 1 -- 172.21.15.114:0/4032940001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc41ed160 con 0x7f0cc40c25a0 2024-02-17T12:16:55.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.595+0000 7f0cbb400640 1 -- 172.21.15.114:0/4032940001 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0cb0004b70 con 0x7f0cc40c25a0 2024-02-17T12:16:55.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.595+0000 7f0cbb400640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ca4066e40 0x7f0ca4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.595+0000 7f0cbb400640 1 -- 172.21.15.114:0/4032940001 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cb0083ff0 con 0x7f0cc40c25a0 2024-02-17T12:16:55.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.595+0000 7f0cc3400640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ca4066e40 0x7f0ca4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.595+0000 7f0cc3400640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ca4066e40 0x7f0ca4069300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40113e0 tx=0x7f0cb400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:55.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.599+0000 7f0cbb400640 1 -- 172.21.15.114:0/4032940001 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0cb00b5cb0 con 0x7f0cc40c25a0 2024-02-17T12:16:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.787+0000 7f0cca600640 1 -- 172.21.15.114:0/4032940001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0cc4074840 con 0x7f0cc40c25a0 2024-02-17T12:16:55.791 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-02-17T12:16:55.787+0000 7f5091a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-17T12:16:55.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.787+0000 7f0cbb400640 1 -- 172.21.15.114:0/4032940001 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0cb0018090 con 0x7f0cc40c25a0 2024-02-17T12:16:55.793 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-17T12:16:55.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 -- 172.21.15.114:0/4032940001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ca4066e40 msgr2=0x7f0ca4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ca4066e40 0x7f0ca4069300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40113e0 tx=0x7f0cb400b040 comp rx=0 tx=0).stop 2024-02-17T12:16:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 -- 172.21.15.114:0/4032940001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc40c25a0 msgr2=0x7f0cc41497b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc40c25a0 0x7f0cc41497b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00011f0 tx=0x7f0cb000c9b0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 -- 172.21.15.114:0/4032940001 shutdown_connections 2024-02-17T12:16:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cc4152c50 0x7f0cc41ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ca4066e40 0x7f0ca4069300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cc40c25a0 0x7f0cc41497b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 --2- 172.21.15.114:0/4032940001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc406db50 0x7f0cc40aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 -- 172.21.15.114:0/4032940001 >> 172.21.15.114:0/4032940001 conn(0x7f0cc40a8490 msgr2=0x7f0cc406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 -- 172.21.15.114:0/4032940001 shutdown_connections 2024-02-17T12:16:55.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.791+0000 7f0cca600640 1 -- 172.21.15.114:0/4032940001 wait complete. 2024-02-17T12:16:55.807 INFO:tasks.ceph.mds.d.smithi116.stderr: -5440> 2024-02-17T12:16:27.612+0000 7fe4a0800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:16:55.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-17T12:16:55.857 INFO:tasks.ceph.mds.d.smithi116.stdout:starting mds.d at 2024-02-17T12:16:55.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc3a800640 1 Processor -- start 2024-02-17T12:16:55.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc3a800640 1 -- start start 2024-02-17T12:16:55.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc3a800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efc34071500 0x7efc341512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc3a800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc340c1f30 0x7efc34151800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc3a800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc34155100 con 0x7efc3414b330 2024-02-17T12:16:55.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc3a800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc340712c0 con 0x7efc34071500 2024-02-17T12:16:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc3a800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc34070c00 con 0x7efc340c1f30 2024-02-17T12:16:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc39e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc340c1f30 0x7efc34151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc39400640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7efc3414b330 0x7efc340719a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:58942/0 (socket says 172.21.15.114:58942) 2024-02-17T12:16:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc39400640 1 -- 172.21.15.114:0/436617891 learned_addr learned my addr 172.21.15.114:0/436617891 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.947+0000 7efc38a00640 1 --2- 172.21.15.114:0/436617891 >> v2:172.21.15.116:3300/0 conn(0x7efc34071500 0x7efc341512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc33e00640 1 -- 172.21.15.114:0/436617891 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147121816 0 0) 0x7efc34155100 con 0x7efc3414b330 2024-02-17T12:16:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc39e00640 1 -- 172.21.15.114:0/436617891 >> v2:172.21.15.116:3300/0 conn(0x7efc34071500 msgr2=0x7efc341512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc39e00640 1 --2- 172.21.15.114:0/436617891 >> v2:172.21.15.116:3300/0 conn(0x7efc34071500 0x7efc341512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc39e00640 1 -- 172.21.15.114:0/436617891 >> v1:172.21.15.116:6789/0 conn(0x7efc3414b330 legacy=0x7efc340719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc39e00640 1 -- 172.21.15.114:0/436617891 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc34070ee0 con 0x7efc340c1f30 2024-02-17T12:16:55.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc39e00640 1 --2- 172.21.15.114:0/436617891 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc340c1f30 0x7efc34151800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00bfa0 tx=0x7efc2c01e730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7910dffe2181bf7f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:55.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc33e00640 1 -- 172.21.15.114:0/436617891 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0a6e60 con 0x7efc340c1f30 2024-02-17T12:16:55.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc33e00640 1 -- 172.21.15.114:0/436617891 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c00b0d0 con 0x7efc340c1f30 2024-02-17T12:16:55.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc33e00640 1 -- 172.21.15.114:0/436617891 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c009540 con 0x7efc340c1f30 2024-02-17T12:16:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc3a800640 1 -- 172.21.15.114:0/436617891 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc340c1f30 msgr2=0x7efc34151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc3a800640 1 --2- 172.21.15.114:0/436617891 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc340c1f30 0x7efc34151800 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00bfa0 tx=0x7efc2c01e730 comp rx=0 tx=0).stop 2024-02-17T12:16:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc3a800640 1 -- 172.21.15.114:0/436617891 shutdown_connections 2024-02-17T12:16:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc3a800640 1 --2- 172.21.15.114:0/436617891 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc340c1f30 0x7efc34151800 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc3a800640 1 --2- 172.21.15.114:0/436617891 >> v2:172.21.15.116:3300/0 conn(0x7efc34071500 0x7efc341512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc3a800640 1 -- 172.21.15.114:0/436617891 >> 172.21.15.114:0/436617891 conn(0x7efc340c6300 msgr2=0x7efc340c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.951+0000 7efc3a800640 1 -- 172.21.15.114:0/436617891 shutdown_connections 2024-02-17T12:16:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 -- 172.21.15.114:0/436617891 wait complete. 2024-02-17T12:16:55.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 Processor -- start 2024-02-17T12:16:55.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 -- start start 2024-02-17T12:16:55.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc34071500 0x7efc340c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc340c1f30 0x7efc34143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3414b330 0x7efc34135aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc341f2b10 con 0x7efc34071500 2024-02-17T12:16:55.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc340c4020 con 0x7efc340c1f30 2024-02-17T12:16:55.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc340c60a0 con 0x7efc3414b330 2024-02-17T12:16:55.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc39400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc34071500 0x7efc340c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc39400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc34071500 0x7efc340c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45548/0 (socket says 172.21.15.114:45548) 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc39400640 1 -- 172.21.15.114:0/4066286824 learned_addr learned my addr 172.21.15.114:0/4066286824 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc39e00640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3414b330 0x7efc34135aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc38a00640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc340c1f30 0x7efc34143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc39400640 1 -- 172.21.15.114:0/4066286824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3414b330 msgr2=0x7efc34135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc39400640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3414b330 0x7efc34135aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc39400640 1 -- 172.21.15.114:0/4066286824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc340c1f30 msgr2=0x7efc34143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc39400640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc340c1f30 0x7efc34143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc39400640 1 -- 172.21.15.114:0/4066286824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c00bc80 con 0x7efc34071500 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc38a00640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc340c1f30 0x7efc34143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc39400640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc34071500 0x7efc340c5b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c480 tx=0x7efc2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc31600640 1 -- 172.21.15.114:0/4066286824 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc280074e0 con 0x7efc34071500 2024-02-17T12:16:55.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc31600640 1 -- 172.21.15.114:0/4066286824 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc28007660 con 0x7efc34071500 2024-02-17T12:16:55.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 -- 172.21.15.114:0/4066286824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc34144eb0 con 0x7efc34071500 2024-02-17T12:16:55.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc31600640 1 -- 172.21.15.114:0/4066286824 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28004a30 con 0x7efc34071500 2024-02-17T12:16:55.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.955+0000 7efc3a800640 1 -- 172.21.15.114:0/4066286824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc34144980 con 0x7efc34071500 2024-02-17T12:16:55.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.959+0000 7efc3a800640 1 -- 172.21.15.114:0/4066286824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3404eef0 con 0x7efc34071500 2024-02-17T12:16:55.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.959+0000 7efc31600640 1 -- 172.21.15.114:0/4066286824 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7efc28004b90 con 0x7efc34071500 2024-02-17T12:16:55.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.959+0000 7efc31600640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc14066e70 0x7efc14069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:55.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.959+0000 7efc31600640 1 -- 172.21.15.114:0/4066286824 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efc28083d50 con 0x7efc34071500 2024-02-17T12:16:55.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.959+0000 7efc38a00640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc14066e70 0x7efc14069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:55.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.959+0000 7efc38a00640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc14066e70 0x7efc14069330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc340c0240 tx=0x7efc20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:55.963+0000 7efc31600640 1 -- 172.21.15.114:0/4066286824 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efc280546b0 con 0x7efc34071500 2024-02-17T12:16:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.151+0000 7efc3a800640 1 -- 172.21.15.114:0/4066286824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efc34144eb0 con 0x7efc34071500 2024-02-17T12:16:56.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.791+0000 7efc31600640 1 -- 172.21.15.114:0/4066286824 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7efc34144eb0 con 0x7efc34071500 2024-02-17T12:16:56.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 -- 172.21.15.114:0/4066286824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc14066e70 msgr2=0x7efc14069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:56.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc14066e70 0x7efc14069330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc340c0240 tx=0x7efc20008040 comp rx=0 tx=0).stop 2024-02-17T12:16:56.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 -- 172.21.15.114:0/4066286824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc34071500 msgr2=0x7efc340c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:56.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc34071500 0x7efc340c5b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c480 tx=0x7efc2800c940 comp rx=0 tx=0).stop 2024-02-17T12:16:56.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 -- 172.21.15.114:0/4066286824 shutdown_connections 2024-02-17T12:16:56.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3414b330 0x7efc34135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:56.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc340c1f30 0x7efc34143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:56.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc14066e70 0x7efc14069330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:56.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 --2- 172.21.15.114:0/4066286824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc34071500 0x7efc340c5b60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:56.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 -- 172.21.15.114:0/4066286824 >> 172.21.15.114:0/4066286824 conn(0x7efc340c6300 msgr2=0x7efc3406b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:56.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 -- 172.21.15.114:0/4066286824 shutdown_connections 2024-02-17T12:16:56.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.795+0000 7efc3a800640 1 -- 172.21.15.114:0/4066286824 wait complete. 2024-02-17T12:16:56.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-17T12:16:56.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47c0e00640 1 Processor -- start 2024-02-17T12:16:56.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47c0e00640 1 -- start start 2024-02-17T12:16:56.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47c0e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 0x7f47bc155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:56.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47c0e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc0c3a40 con 0x7f47bc0709d0 2024-02-17T12:16:56.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47c0e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc0c3d20 con 0x7f47bc152350 2024-02-17T12:16:56.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47c0e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc1584b0 con 0x7f47bc159010 2024-02-17T12:16:56.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47b9400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f47bc0709d0 0x7f47bc158900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56372/0 (socket says 172.21.15.114:56372) 2024-02-17T12:16:56.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47b9400640 1 -- 172.21.15.114:0/635373554 learned_addr learned my addr 172.21.15.114:0/635373554 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:56.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47ba800640 1 --2- 172.21.15.114:0/635373554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 0x7f47bc155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:56.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47b8a00640 1 -- 172.21.15.114:0/635373554 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536192497 0 0) 0x7f47bc0c3a40 con 0x7f47bc0709d0 2024-02-17T12:16:56.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47b8a00640 1 -- 172.21.15.114:0/635373554 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a0003530 con 0x7f47bc0709d0 2024-02-17T12:16:56.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47b8a00640 1 -- 172.21.15.114:0/635373554 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224771380 0 0) 0x7f47bc0c3d20 con 0x7f47bc152350 2024-02-17T12:16:56.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47b8a00640 1 -- 172.21.15.114:0/635373554 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47bc0c3a40 con 0x7f47bc152350 2024-02-17T12:16:56.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47ba800640 1 -- 172.21.15.114:0/635373554 >> v1:172.21.15.116:6789/0 conn(0x7f47bc152350 legacy=0x7f47bc0c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:56.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47ba800640 1 -- 172.21.15.114:0/635373554 >> v1:172.21.15.114:6789/0 conn(0x7f47bc0709d0 legacy=0x7f47bc158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:56.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.963+0000 7f47ba800640 1 -- 172.21.15.114:0/635373554 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0c3580 con 0x7f47bc159010 2024-02-17T12:16:56.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47ba800640 1 --2- 172.21.15.114:0/635373554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 0x7f47bc155890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009dc0 tx=0x7f47b401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e1eec6fa7ef1fee server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47b8a00640 1 -- 172.21.15.114:0/635373554 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40a5880 con 0x7f47bc159010 2024-02-17T12:16:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47b8a00640 1 -- 172.21.15.114:0/635373554 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b40a59e0 con 0x7f47bc159010 2024-02-17T12:16:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47b8a00640 1 -- 172.21.15.114:0/635373554 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40a5d70 con 0x7f47bc159010 2024-02-17T12:16:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47c0e00640 1 -- 172.21.15.114:0/635373554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 msgr2=0x7f47bc155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47c0e00640 1 --2- 172.21.15.114:0/635373554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 0x7f47bc155890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009dc0 tx=0x7f47b401c990 comp rx=0 tx=0).stop 2024-02-17T12:16:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47c0e00640 1 -- 172.21.15.114:0/635373554 shutdown_connections 2024-02-17T12:16:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47c0e00640 1 --2- 172.21.15.114:0/635373554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 0x7f47bc155890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47c0e00640 1 -- 172.21.15.114:0/635373554 >> 172.21.15.114:0/635373554 conn(0x7f47bc0aa260 msgr2=0x7f47bc0aa670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47c0e00640 1 -- 172.21.15.114:0/635373554 shutdown_connections 2024-02-17T12:16:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.967+0000 7f47c0e00640 1 -- 172.21.15.114:0/635373554 wait complete. 2024-02-17T12:16:56.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47c0e00640 1 Processor -- start 2024-02-17T12:16:56.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47c0e00640 1 -- start start 2024-02-17T12:16:56.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47c0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0709d0 0x7f47bc15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47c0e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc152350 0x7f47bc15fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47c0e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 0x7f47bc1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47c0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc15a920 con 0x7f47bc0709d0 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47c0e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0ad550 con 0x7f47bc152350 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47c0e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc15a490 con 0x7f47bc159010 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0709d0 0x7f47bc15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0709d0 0x7f47bc15efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45564/0 (socket says 172.21.15.114:45564) 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b9e00640 1 -- 172.21.15.114:0/2638759237 learned_addr learned my addr 172.21.15.114:0/2638759237 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b9400640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc152350 0x7f47bc15fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47ba800640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 0x7f47bc1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b9e00640 1 -- 172.21.15.114:0/2638759237 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 msgr2=0x7f47bc1596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b9e00640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 0x7f47bc1596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b9e00640 1 -- 172.21.15.114:0/2638759237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc152350 msgr2=0x7f47bc15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b9e00640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc152350 0x7f47bc15fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b9e00640 1 -- 172.21.15.114:0/2638759237 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4009a70 con 0x7f47bc0709d0 2024-02-17T12:16:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b9e00640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0709d0 0x7f47bc15efd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c530 tx=0x7f47ac00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b2000640 1 -- 172.21.15.114:0/2638759237 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0052d0 con 0x7f47bc0709d0 2024-02-17T12:16:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b2000640 1 -- 172.21.15.114:0/2638759237 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac005450 con 0x7f47bc0709d0 2024-02-17T12:16:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47b2000640 1 -- 172.21.15.114:0/2638759237 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac012870 con 0x7f47bc0709d0 2024-02-17T12:16:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47c0e00640 1 -- 172.21.15.114:0/2638759237 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc15a190 con 0x7f47bc0709d0 2024-02-17T12:16:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.971+0000 7f47c0e00640 1 -- 172.21.15.114:0/2638759237 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc0ad7a0 con 0x7f47bc0709d0 2024-02-17T12:16:56.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.975+0000 7f47c0e00640 1 -- 172.21.15.114:0/2638759237 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc074840 con 0x7f47bc0709d0 2024-02-17T12:16:56.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.975+0000 7f47b2000640 1 -- 172.21.15.114:0/2638759237 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f47ac0129d0 con 0x7f47bc0709d0 2024-02-17T12:16:56.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.975+0000 7f47b2000640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f479c066e40 0x7f479c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.975+0000 7f47b2000640 1 -- 172.21.15.114:0/2638759237 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f47ac084630 con 0x7f47bc0709d0 2024-02-17T12:16:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.975+0000 7f47b9400640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f479c066e40 0x7f479c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.975+0000 7f47b9400640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f479c066e40 0x7f479c069300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0ac5c0 tx=0x7f47a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:56.979+0000 7f47b2000640 1 -- 172.21.15.114:0/2638759237 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f47ac0513d0 con 0x7f47bc0709d0 2024-02-17T12:16:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.131+0000 7f47c0e00640 1 -- 172.21.15.114:0/2638759237 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f47bc0c67e0 con 0x7f47bc0709d0 2024-02-17T12:16:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.795+0000 7f47b2000640 1 -- 172.21.15.114:0/2638759237 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f47ac054a90 con 0x7f47bc0709d0 2024-02-17T12:16:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-02-17T12:16:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 -- 172.21.15.114:0/2638759237 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f479c066e40 msgr2=0x7f479c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f479c066e40 0x7f479c069300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0ac5c0 tx=0x7f47a8009040 comp rx=0 tx=0).stop 2024-02-17T12:16:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 -- 172.21.15.114:0/2638759237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0709d0 msgr2=0x7f47bc15efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0709d0 0x7f47bc15efd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c530 tx=0x7f47ac00c9f0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 -- 172.21.15.114:0/2638759237 shutdown_connections 2024-02-17T12:16:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47bc159010 0x7f47bc1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47bc152350 0x7f47bc15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f479c066e40 0x7f479c069300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 --2- 172.21.15.114:0/2638759237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47bc0709d0 0x7f47bc15efd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 -- 172.21.15.114:0/2638759237 >> 172.21.15.114:0/2638759237 conn(0x7f47bc0aa260 msgr2=0x7f47bc0a9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 -- 172.21.15.114:0/2638759237 shutdown_connections 2024-02-17T12:16:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.799+0000 7f47c0e00640 1 -- 172.21.15.114:0/2638759237 wait complete. 2024-02-17T12:16:57.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-17T12:16:57.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07d5400640 1 Processor -- start 2024-02-17T12:16:57.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07d5400640 1 -- start start 2024-02-17T12:16:57.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07d5400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07d014f310 0x7f07d01524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07d5400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f07d00a7dd0 0x7f07d00c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07d5400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f07d00c2530 0x7f07d00c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07d5400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d00a6980 con 0x7f07d00c2530 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07d5400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d00c2e00 con 0x7f07d00a7dd0 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07d5400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00c30e0 con 0x7f07d014f310 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07cf200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f07d00c2530 0x7f07d00c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07cf200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f07d00c2530 0x7f07d00c3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45566/0 (socket says 172.21.15.114:45566) 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.963+0000 7f07cf200640 1 -- 172.21.15.114:0/3152172416 learned_addr learned my addr 172.21.15.114:0/3152172416 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cde00640 1 --2- 172.21.15.114:0/3152172416 >> v2:172.21.15.116:3300/0 conn(0x7f07d00a7dd0 0x7f07d00c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07ce800640 1 --2- 172.21.15.114:0/3152172416 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07d014f310 0x7f07d01524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:57.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cf200640 1 -- 172.21.15.114:0/3152172416 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07d014f310 msgr2=0x7f07d01524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:57.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cf200640 1 --2- 172.21.15.114:0/3152172416 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07d014f310 0x7f07d01524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cf200640 1 -- 172.21.15.114:0/3152172416 >> v2:172.21.15.116:3300/0 conn(0x7f07d00a7dd0 msgr2=0x7f07d00c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:57.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cf200640 1 --2- 172.21.15.114:0/3152172416 >> v2:172.21.15.116:3300/0 conn(0x7f07d00a7dd0 0x7f07d00c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cf200640 1 -- 172.21.15.114:0/3152172416 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d014f6f0 con 0x7f07d00c2530 2024-02-17T12:16:57.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cde00640 1 --2- 172.21.15.114:0/3152172416 >> v2:172.21.15.116:3300/0 conn(0x7f07d00a7dd0 0x7f07d00c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:57.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07ce800640 1 --2- 172.21.15.114:0/3152172416 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07d014f310 0x7f07d01524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:57.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cf200640 1 --2- 172.21.15.114:0/3152172416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00c2530 0x7f07d00c3570 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f07d006eda0 tx=0x7f07c801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e172bd78e4deb9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:57.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cd400640 1 -- 172.21.15.114:0/3152172416 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c80a5760 con 0x7f07d00c2530 2024-02-17T12:16:57.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cd400640 1 -- 172.21.15.114:0/3152172416 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c80a58c0 con 0x7f07d00c2530 2024-02-17T12:16:57.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07cd400640 1 -- 172.21.15.114:0/3152172416 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c80a5c50 con 0x7f07d00c2530 2024-02-17T12:16:57.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07d5400640 1 -- 172.21.15.114:0/3152172416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00c2530 msgr2=0x7f07d00c3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:57.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07d5400640 1 --2- 172.21.15.114:0/3152172416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00c2530 0x7f07d00c3570 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f07d006eda0 tx=0x7f07c801c9f0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07d5400640 1 -- 172.21.15.114:0/3152172416 shutdown_connections 2024-02-17T12:16:57.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07d5400640 1 --2- 172.21.15.114:0/3152172416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00c2530 0x7f07d00c3570 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07d5400640 1 --2- 172.21.15.114:0/3152172416 >> v2:172.21.15.116:3300/0 conn(0x7f07d00a7dd0 0x7f07d00c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07d5400640 1 --2- 172.21.15.114:0/3152172416 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07d014f310 0x7f07d01524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07d5400640 1 -- 172.21.15.114:0/3152172416 >> 172.21.15.114:0/3152172416 conn(0x7f07d006b210 msgr2=0x7f07d006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:57.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.967+0000 7f07d5400640 1 -- 172.21.15.114:0/3152172416 shutdown_connections 2024-02-17T12:16:57.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 -- 172.21.15.114:0/3152172416 wait complete. 2024-02-17T12:16:57.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 Processor -- start 2024-02-17T12:16:57.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 -- start start 2024-02-17T12:16:57.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00a7dd0 0x7f07d01ee4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:57.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07d00c2530 0x7f07d00bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:57.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07d014f310 0x7f07d01f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:57.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d0154be0 con 0x7f07d00a7dd0 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00a9d00 con 0x7f07d00c2530 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00a9a20 con 0x7f07d014f310 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07ce800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00a7dd0 0x7f07d01ee4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07ce800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00a7dd0 0x7f07d01ee4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45570/0 (socket says 172.21.15.114:45570) 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07ce800640 1 -- 172.21.15.114:0/2836528115 learned_addr learned my addr 172.21.15.114:0/2836528115 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07ce800640 1 -- 172.21.15.114:0/2836528115 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07d014f310 msgr2=0x7f07d01f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07ce800640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07d014f310 0x7f07d01f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07ce800640 1 -- 172.21.15.114:0/2836528115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07d00c2530 msgr2=0x7f07d00bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07ce800640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07d00c2530 0x7f07d00bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07ce800640 1 -- 172.21.15.114:0/2836528115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c8009b30 con 0x7f07d00a7dd0 2024-02-17T12:16:57.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07ce800640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00a7dd0 0x7f07d01ee4b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f07c000c7f0 tx=0x7f07c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:57.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07c6a00640 1 -- 172.21.15.114:0/2836528115 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0007820 con 0x7f07d00a7dd0 2024-02-17T12:16:57.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07c6a00640 1 -- 172.21.15.114:0/2836528115 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c0007980 con 0x7f07d00a7dd0 2024-02-17T12:16:57.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07c6a00640 1 -- 172.21.15.114:0/2836528115 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0007d30 con 0x7f07d00a7dd0 2024-02-17T12:16:57.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 -- 172.21.15.114:0/2836528115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d01ed9d0 con 0x7f07d00a7dd0 2024-02-17T12:16:57.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.971+0000 7f07d5400640 1 -- 172.21.15.114:0/2836528115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d01edf90 con 0x7f07d00a7dd0 2024-02-17T12:16:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.975+0000 7f07d5400640 1 -- 172.21.15.114:0/2836528115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d0074840 con 0x7f07d00a7dd0 2024-02-17T12:16:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.975+0000 7f07c6a00640 1 -- 172.21.15.114:0/2836528115 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f07c00113f0 con 0x7f07d00a7dd0 2024-02-17T12:16:57.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.975+0000 7f07c6a00640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07b0066e40 0x7f07b0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:57.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.975+0000 7f07c6a00640 1 -- 172.21.15.114:0/2836528115 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f07c0084ba0 con 0x7f07d00a7dd0 2024-02-17T12:16:57.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.975+0000 7f07cde00640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07b0066e40 0x7f07b0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:57.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.975+0000 7f07cde00640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07b0066e40 0x7f07b0069300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07d014c770 tx=0x7f07bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:57.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:57.979+0000 7f07c6a00640 1 -- 172.21.15.114:0/2836528115 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f07c0051ae0 con 0x7f07d00a7dd0 2024-02-17T12:16:58.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.139+0000 7f07d5400640 1 -- 172.21.15.114:0/2836528115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f07d00c0bc0 con 0x7f07d00a7dd0 2024-02-17T12:16:58.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.799+0000 7f07c6a00640 1 -- 172.21.15.114:0/2836528115 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f07c00551a0 con 0x7f07d00a7dd0 2024-02-17T12:16:58.804 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-02-17T12:16:58.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 -- 172.21.15.114:0/2836528115 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07b0066e40 msgr2=0x7f07b0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:58.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07b0066e40 0x7f07b0069300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07d014c770 tx=0x7f07bc008040 comp rx=0 tx=0).stop 2024-02-17T12:16:58.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 -- 172.21.15.114:0/2836528115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00a7dd0 msgr2=0x7f07d01ee4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:58.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00a7dd0 0x7f07d01ee4b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f07c000c7f0 tx=0x7f07c000ccb0 comp rx=0 tx=0).stop 2024-02-17T12:16:58.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 -- 172.21.15.114:0/2836528115 shutdown_connections 2024-02-17T12:16:58.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07d014f310 0x7f07d01f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:58.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07d00c2530 0x7f07d00bfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:58.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07b0066e40 0x7f07b0069300 secure :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07d014c770 tx=0x7f07bc008040 comp rx=0 tx=0).stop 2024-02-17T12:16:58.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 --2- 172.21.15.114:0/2836528115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07d00a7dd0 0x7f07d01ee4b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:58.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 -- 172.21.15.114:0/2836528115 >> 172.21.15.114:0/2836528115 conn(0x7f07d006b210 msgr2=0x7f07d0151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:58.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 -- 172.21.15.114:0/2836528115 shutdown_connections 2024-02-17T12:16:58.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:58.803+0000 7f07d5400640 1 -- 172.21.15.114:0/2836528115 wait complete. 2024-02-17T12:16:58.837 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-17T12:16:58.837 INFO:tasks.ceph.mds.a:Stopping old one... 2024-02-17T12:16:58.837 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-17T12:16:58.837 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:16:58.837 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-17T12:16:58.838 INFO:tasks.ceph.mds.c:Stopping old one... 2024-02-17T12:16:58.838 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-17T12:16:58.838 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:16:58.838 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-17T12:16:58.838 INFO:tasks.ceph.mds.b:Stopping old one... 2024-02-17T12:16:58.838 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-17T12:16:58.838 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:16:58.839 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-17T12:16:58.839 INFO:tasks.ceph.mds.d:Stopping old one... 2024-02-17T12:16:58.839 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-17T12:16:58.839 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:16:58.850 INFO:tasks.ceph.mds.a:Stopped 2024-02-17T12:16:58.850 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-17T12:16:58.852 INFO:tasks.ceph.mds.c:Stopped 2024-02-17T12:16:58.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-17T12:16:58.853 INFO:tasks.ceph.mds.d:Stopped 2024-02-17T12:16:58.853 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-17T12:16:58.854 INFO:tasks.ceph.mds.b:Stopped 2024-02-17T12:16:58.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-17T12:16:58.899 INFO:tasks.ceph.mds.d:Started 2024-02-17T12:16:58.899 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:58.900 INFO:tasks.ceph.mds.a:Started 2024-02-17T12:16:58.901 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:58.901 INFO:tasks.ceph.mds.b:Started 2024-02-17T12:16:58.901 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:58.903 INFO:tasks.ceph.mds.c:Started 2024-02-17T12:16:58.903 DEBUG:teuthology.parallel:result is None 2024-02-17T12:16:58.903 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-02-17T12:16:58.989 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-02-17T12:16:58.990 INFO:tasks.ceph.mds.b.smithi116.stdout:starting mds.b at 2024-02-17T12:16:58.990 INFO:tasks.ceph.mds.d.smithi116.stdout:starting mds.d at 2024-02-17T12:16:58.990 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-02-17T12:16:59.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d36600640 1 Processor -- start 2024-02-17T12:16:59.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d36600640 1 -- start start 2024-02-17T12:16:59.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d36600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d3014f110 0x7f4d300c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d36600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d300a9420 con 0x7f4d300c2580 2024-02-17T12:16:59.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d36600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d30152850 con 0x7f4d300c1eb0 2024-02-17T12:16:59.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d36600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3014f4f0 con 0x7f4d3014f110 2024-02-17T12:16:59.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d2f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d3014f110 0x7f4d300c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d2ea00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4d300c2580 0x7f4d300aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56392/0 (socket says 172.21.15.114:56392) 2024-02-17T12:16:59.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d2ea00640 1 -- 172.21.15.114:0/1508849684 learned_addr learned my addr 172.21.15.114:0/1508849684 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:59.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d2f400640 1 -- 172.21.15.114:0/1508849684 >> v1:172.21.15.116:6789/0 conn(0x7f4d300c1eb0 legacy=0x7f4d3015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d2f400640 1 -- 172.21.15.114:0/1508849684 >> v1:172.21.15.114:6789/0 conn(0x7f4d300c2580 legacy=0x7f4d300aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d2e000640 1 -- 172.21.15.114:0/1508849684 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143082778 0 0) 0x7f4d300a9420 con 0x7f4d300c2580 2024-02-17T12:16:59.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.043+0000 7f4d2f400640 1 -- 172.21.15.114:0/1508849684 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300a9670 con 0x7f4d3014f110 2024-02-17T12:16:59.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d2f400640 1 --2- 172.21.15.114:0/1508849684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 0x7f4d300c65a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d200097c0 tx=0x7f4d2001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892e50da5ad6f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:59.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d2e000640 1 -- 172.21.15.114:0/1508849684 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d200ab600 con 0x7f4d3014f110 2024-02-17T12:16:59.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d2e000640 1 -- 172.21.15.114:0/1508849684 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d200a7050 con 0x7f4d3014f110 2024-02-17T12:16:59.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d2e000640 1 -- 172.21.15.114:0/1508849684 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d200ab980 con 0x7f4d3014f110 2024-02-17T12:16:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d36600640 1 -- 172.21.15.114:0/1508849684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 msgr2=0x7f4d300c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d36600640 1 --2- 172.21.15.114:0/1508849684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 0x7f4d300c65a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d200097c0 tx=0x7f4d2001c410 comp rx=0 tx=0).stop 2024-02-17T12:16:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d36600640 1 -- 172.21.15.114:0/1508849684 shutdown_connections 2024-02-17T12:16:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d36600640 1 --2- 172.21.15.114:0/1508849684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 0x7f4d300c65a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d36600640 1 -- 172.21.15.114:0/1508849684 >> 172.21.15.114:0/1508849684 conn(0x7f4d300a8490 msgr2=0x7f4d300a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:59.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d36600640 1 -- 172.21.15.114:0/1508849684 shutdown_connections 2024-02-17T12:16:59.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.047+0000 7f4d36600640 1 -- 172.21.15.114:0/1508849684 wait complete. 2024-02-17T12:16:59.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d36600640 1 Processor -- start 2024-02-17T12:16:59.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d36600640 1 -- start start 2024-02-17T12:16:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d36600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d300c1eb0 0x7f4d3014d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d36600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d300c2580 0x7f4d30150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d36600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 0x7f4d301513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d36600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300c0230 con 0x7f4d3014f110 2024-02-17T12:16:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d36600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3015d8c0 con 0x7f4d300c2580 2024-02-17T12:16:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d36600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300bf8d0 con 0x7f4d300c1eb0 2024-02-17T12:16:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 0x7f4d301513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2f400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d300c1eb0 0x7f4d3014d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2ea00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d300c2580 0x7f4d30150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2ea00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d300c2580 0x7f4d30150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:41134/0 (socket says 172.21.15.114:41134) 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2f400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d300c1eb0 0x7f4d3014d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:54720/0 (socket says 172.21.15.114:54720) 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2ea00640 1 -- 172.21.15.114:0/94960785 learned_addr learned my addr 172.21.15.114:0/94960785 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 0x7f4d301513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45600/0 (socket says 172.21.15.114:45600) 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2ea00640 1 -- 172.21.15.114:0/94960785 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d300c1eb0 msgr2=0x7f4d3014d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2ea00640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d300c1eb0 0x7f4d3014d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2ea00640 1 -- 172.21.15.114:0/94960785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 msgr2=0x7f4d301513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2ea00640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 0x7f4d301513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2ea00640 1 -- 172.21.15.114:0/94960785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d20009420 con 0x7f4d300c2580 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2fe00640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 0x7f4d301513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d2ea00640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d300c2580 0x7f4d30150e90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00c440 tx=0x7f4d1c00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d27400640 1 -- 172.21.15.114:0/94960785 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0074e0 con 0x7f4d300c2580 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d27400640 1 -- 172.21.15.114:0/94960785 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c007640 con 0x7f4d300c2580 2024-02-17T12:16:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d36600640 1 -- 172.21.15.114:0/94960785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d30151910 con 0x7f4d300c2580 2024-02-17T12:16:59.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d27400640 1 -- 172.21.15.114:0/94960785 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c004a30 con 0x7f4d300c2580 2024-02-17T12:16:59.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.051+0000 7f4d36600640 1 -- 172.21.15.114:0/94960785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d300bfb70 con 0x7f4d300c2580 2024-02-17T12:16:59.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.055+0000 7f4d36600640 1 -- 172.21.15.114:0/94960785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d30150c90 con 0x7f4d300c2580 2024-02-17T12:16:59.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.055+0000 7f4d27400640 1 -- 172.21.15.114:0/94960785 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4d1c004b90 con 0x7f4d300c2580 2024-02-17T12:16:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.055+0000 7f4d27400640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d10066e40 0x7f4d10069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.055+0000 7f4d27400640 1 -- 172.21.15.114:0/94960785 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4d1c0841b0 con 0x7f4d300c2580 2024-02-17T12:16:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.055+0000 7f4d2f400640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d10066e40 0x7f4d10069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.055+0000 7f4d2f400640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d10066e40 0x7f4d10069300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4d200ad000 tx=0x7f4d200a4f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.059+0000 7f4d27400640 1 -- 172.21.15.114:0/94960785 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4d1c0513c0 con 0x7f4d300c2580 2024-02-17T12:16:59.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.223+0000 7f4d36600640 1 -- 172.21.15.114:0/94960785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4d30074840 con 0x7f4d300c2580 2024-02-17T12:16:59.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d27400640 1 -- 172.21.15.114:0/94960785 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4d1c054a80 con 0x7f4d300c2580 2024-02-17T12:16:59.828 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-02-17T12:16:59.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d36600640 1 -- 172.21.15.114:0/94960785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d10066e40 msgr2=0x7f4d10069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d36600640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d10066e40 0x7f4d10069300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4d200ad000 tx=0x7f4d200a4f90 comp rx=0 tx=0).stop 2024-02-17T12:16:59.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d36600640 1 -- 172.21.15.114:0/94960785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d300c2580 msgr2=0x7f4d30150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d36600640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d300c2580 0x7f4d30150e90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00c440 tx=0x7f4d1c00c900 comp rx=0 tx=0).stop 2024-02-17T12:16:59.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d36600640 1 -- 172.21.15.114:0/94960785 shutdown_connections 2024-02-17T12:16:59.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d36600640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d10066e40 0x7f4d10069300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d36600640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d3014f110 0x7f4d301513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d36600640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d300c2580 0x7f4d30150e90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d36600640 1 --2- 172.21.15.114:0/94960785 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d300c1eb0 0x7f4d3014d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.823+0000 7f4d36600640 1 -- 172.21.15.114:0/94960785 >> 172.21.15.114:0/94960785 conn(0x7f4d300a8490 msgr2=0x7f4d30145420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:59.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.827+0000 7f4d36600640 1 -- 172.21.15.114:0/94960785 shutdown_connections 2024-02-17T12:16:59.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.827+0000 7f4d36600640 1 -- 172.21.15.114:0/94960785 wait complete. 2024-02-17T12:16:59.851 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-02-17T12:16:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.979+0000 7fa220a00640 1 Processor -- start 2024-02-17T12:16:59.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.979+0000 7fa220a00640 1 -- start start 2024-02-17T12:16:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa220a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c070b60 0x7fa21c156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa220a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21c153250 con 0x7fa21c13be90 2024-02-17T12:16:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa220a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21c0731c0 con 0x7fa21c072d50 2024-02-17T12:16:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa220a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c156730 con 0x7fa21c070b60 2024-02-17T12:16:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa21a800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa21c13be90 0x7fa21c152b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56402/0 (socket says 172.21.15.114:56402) 2024-02-17T12:16:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa21a800640 1 -- 172.21.15.114:0/1619148686 learned_addr learned my addr 172.21.15.114:0/1619148686 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:16:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003240807 0 0) 0x7fa21c153250 con 0x7fa21c13be90 2024-02-17T12:16:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa200003530 con 0x7fa21c13be90 2024-02-17T12:16:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219e00640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c070b60 0x7fa21c156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2400040641 0 0) 0x7fa200003530 con 0x7fa21c13be90 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c070b60 msgr2=0x7fa21c156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c070b60 0x7fa21c156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 >> v1:172.21.15.116:6789/0 conn(0x7fa21c072d50 legacy=0x7fa21c0c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c06e780 con 0x7fa21c13be90 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fa20c001a00 con 0x7fa21c13be90 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219e00640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c070b60 0x7fa21c156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 >> v1:172.21.15.114:6789/0 conn(0x7fa21c13be90 legacy=0x7fa21c152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 0x7fa200003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c070b60 0x7fa2000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa200004d10 0x7fa200005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c156730 con 0x7fa200004d10 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20000bb50 con 0x7fa2000039b0 2024-02-17T12:16:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20000bd10 con 0x7fa21c070b60 2024-02-17T12:16:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa21b200640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa200004d10 0x7fa200005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa21a800640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 0x7fa200003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219e00640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c070b60 0x7fa2000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa21a800640 1 -- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c070b60 msgr2=0x7fa2000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa21a800640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c070b60 0x7fa2000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa21a800640 1 -- 172.21.15.114:0/1619148686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa200004d10 msgr2=0x7fa200005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:16:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa21a800640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa200004d10 0x7fa200005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa21a800640 1 -- 172.21.15.114:0/1619148686 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200003530 con 0x7fa2000039b0 2024-02-17T12:16:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa21b200640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa200004d10 0x7fa200005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.983+0000 7fa219e00640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c070b60 0x7fa2000047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:16:59.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa21a800640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 0x7fa200003dd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00a830 tx=0x7fa20c01fac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f9fa2ced4ac816 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:59.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0aa6f0 con 0x7fa2000039b0 2024-02-17T12:16:59.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c0aa850 con 0x7fa2000039b0 2024-02-17T12:16:59.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa219400640 1 -- 172.21.15.114:0/1619148686 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0aac40 con 0x7fa2000039b0 2024-02-17T12:16:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa220a00640 1 -- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 msgr2=0x7fa200003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa220a00640 1 --2- 172.21.15.114:0/1619148686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 0x7fa200003dd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00a830 tx=0x7fa20c01fac0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa21b200640 1 -- 172.21.15.114:0/1619148686 reap_dead start 2024-02-17T12:16:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa220a00640 1 -- 172.21.15.114:0/1619148686 shutdown_connections 2024-02-17T12:16:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa220a00640 1 -- 172.21.15.114:0/1619148686 >> 172.21.15.114:0/1619148686 conn(0x7fa21c0a8660 msgr2=0x7fa21c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:16:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa220a00640 1 -- 172.21.15.114:0/1619148686 shutdown_connections 2024-02-17T12:16:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa220a00640 1 -- 172.21.15.114:0/1619148686 wait complete. 2024-02-17T12:16:59.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa220a00640 1 Processor -- start 2024-02-17T12:16:59.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.987+0000 7fa220a00640 1 -- start start 2024-02-17T12:16:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa220a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 0x7fa21c1e1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa220a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c0a9e40 0x7fa21c1edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa220a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa21c0aa2c0 0x7fa21c1ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:16:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa220a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c1dc640 con 0x7fa21c0aa2c0 2024-02-17T12:16:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa220a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c1eb480 con 0x7fa2000039b0 2024-02-17T12:16:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa220a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c0aa7b0 con 0x7fa21c0a9e40 2024-02-17T12:16:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa21c0aa2c0 0x7fa21c1ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa21c0aa2c0 0x7fa21c1ee4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45624/0 (socket says 172.21.15.114:45624) 2024-02-17T12:16:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21b200640 1 -- 172.21.15.114:0/71001726 learned_addr learned my addr 172.21.15.114:0/71001726 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:16:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21b200640 1 -- 172.21.15.114:0/71001726 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c0a9e40 msgr2=0x7fa21c1edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa219e00640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c0a9e40 0x7fa21c1edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21a800640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 0x7fa21c1e1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21b200640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c0a9e40 0x7fa21c1edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21b200640 1 -- 172.21.15.114:0/71001726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 msgr2=0x7fa21c1e1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21b200640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 0x7fa21c1e1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21b200640 1 -- 172.21.15.114:0/71001726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c1eab90 con 0x7fa21c0aa2c0 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21a800640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 0x7fa21c1e1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa219e00640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c0a9e40 0x7fa21c1edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa21b200640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa21c0aa2c0 0x7fa21c1ee4a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa21c0c0420 tx=0x7fa21400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa212a00640 1 -- 172.21.15.114:0/71001726 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2140050d0 con 0x7fa21c0aa2c0 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa212a00640 1 -- 172.21.15.114:0/71001726 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa214005230 con 0x7fa21c0aa2c0 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa220a00640 1 -- 172.21.15.114:0/71001726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21c1ee9e0 con 0x7fa21c0aa2c0 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa212a00640 1 -- 172.21.15.114:0/71001726 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400d680 con 0x7fa21c0aa2c0 2024-02-17T12:16:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa220a00640 1 -- 172.21.15.114:0/71001726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21c1eae30 con 0x7fa21c0aa2c0 2024-02-17T12:16:59.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa220a00640 1 -- 172.21.15.114:0/71001726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21c1eb5f0 con 0x7fa21c0aa2c0 2024-02-17T12:16:59.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.991+0000 7fa212a00640 1 -- 172.21.15.114:0/71001726 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa21400d7e0 con 0x7fa21c0aa2c0 2024-02-17T12:17:00.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.995+0000 7fa212a00640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1fc066e70 0x7fa1fc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.995+0000 7fa212a00640 1 -- 172.21.15.114:0/71001726 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa214084230 con 0x7fa21c0aa2c0 2024-02-17T12:17:00.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.995+0000 7fa21a800640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1fc066e70 0x7fa1fc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.995+0000 7fa21a800640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1fc066e70 0x7fa1fc069330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0b1000 tx=0x7fa20c0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:00.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:16:59.999+0000 7fa212a00640 1 -- 172.21.15.114:0/71001726 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa214051360 con 0x7fa21c0aa2c0 2024-02-17T12:17:00.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.203+0000 7fa220a00640 1 -- 172.21.15.114:0/71001726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa21c04eef0 con 0x7fa21c0aa2c0 2024-02-17T12:17:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.203+0000 7fa212a00640 1 -- 172.21.15.114:0/71001726 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6065 (secure 0 0 0) 0x7fa214054a20 con 0x7fa21c0aa2c0 2024-02-17T12:17:00.210 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:17:00.210 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-02-17T12:17:00.210 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlC5lYABAA6azd56jLhAjZE9g08V7QEg==", 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-02-17T12:17:00.211 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlN91JDBAA39pNGkFXITBkFPknKh80Zg==", 2024-02-17T12:17:00.212 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.212 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:00.212 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:17:00.212 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:17:00.212 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.212 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.212 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.212 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-02-17T12:17:00.212 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlcfWBBxAAcGpOI9tt2XFAE53Z5D3IGQ==", 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9Bl6zR5ExAAhNGl0iGdaBXJGCuUW+v7mg==", 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.213 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBVo9BlIUGPHxAAYFvkX6XSdQ2zrMlbG0tyLQ==", 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.214 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBYo9BlhFOpJRAAw6abcA91k7UIqP7ZI0DJXw==", 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBbo9BlcGMaLBAAowE5MXll20j9H2Bu9ENlHA==", 2024-02-17T12:17:00.215 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBeo9BlCjw4MxAAj8jUcH+AdAKzUGE1FV93AA==", 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:00.216 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBko9BleeA4OxAAyqyptyDYwOEwVuofLJ2FIA==", 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-02-17T12:17:00.217 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBoo9BlDQvsBBAARlmMLmSs370Rf6QXYzUURw==", 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBro9Bl/IOLCxAACdC11z4y11nLvXVOngFJJA==", 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.218 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBuo9Bl2traERAAej15lW/SHoN/AF0WWZUHQA==", 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.219 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.220 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.220 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.220 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-02-17T12:17:00.220 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlaXt+FxAAn4YhbPPnUC6y0giRDPuYyQ==", 2024-02-17T12:17:00.220 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.220 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:00.220 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-02-17T12:17:00.220 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-02-17T12:17:00.220 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-02-17T12:17:00.220 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlffPTGhAA6uMply4Nxw6KXsGwVHriZg==", 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBRo9Bl3p5kIBAAlqg+W5lq86eSDqVE/pYx9Q==", 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.222 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mds", 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB+o9BlMb5bAhAATi2PnO0LQ6h0EiQxbi1PEA==", 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mds" 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mgr", 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB+o9Bl6MhbAhAA+866bJ/s0tJntp/z4/Q49g==", 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mgr" 2024-02-17T12:17:00.223 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-osd", 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB+o9Blw9VbAhAAPjkrgqMC7qtOeMARKD77lg==", 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-osd" 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd", 2024-02-17T12:17:00.224 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB+o9Bl5t5bAhAAnZmOCdmVfBY/4qFO5cvASw==", 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd" 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB+o9BldOdbAhAAKLG6e20yAqdKmrZKtg6PDw==", 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rgw", 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB+o9BlT/BbAhAAWkUlUUbYmJecQckil6DkeA==", 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rgw" 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBRo9BlkgiBNxAAv1cRMj0JAsCW3C1QET2fxg==", 2024-02-17T12:17:00.226 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBRo9Bl3bHCMxAAWLsuBBXWkaHkJFObZxBxpQ==", 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-02-17T12:17:00.227 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-02-17T12:17:00.228 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:00.228 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.228 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:00.228 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-02-17T12:17:00.228 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:17:00.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 -- 172.21.15.114:0/71001726 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1fc066e70 msgr2=0x7fa1fc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1fc066e70 0x7fa1fc069330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0b1000 tx=0x7fa20c0b6040 comp rx=0 tx=0).stop 2024-02-17T12:17:00.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 -- 172.21.15.114:0/71001726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa21c0aa2c0 msgr2=0x7fa21c1ee4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa21c0aa2c0 0x7fa21c1ee4a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa21c0c0420 tx=0x7fa21400fc00 comp rx=0 tx=0).stop 2024-02-17T12:17:00.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 -- 172.21.15.114:0/71001726 shutdown_connections 2024-02-17T12:17:00.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa1fc066e70 0x7fa1fc069330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa21c0aa2c0 0x7fa21c1ee4a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa21c0a9e40 0x7fa21c1edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 --2- 172.21.15.114:0/71001726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2000039b0 0x7fa21c1e1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 -- 172.21.15.114:0/71001726 >> 172.21.15.114:0/71001726 conn(0x7fa21c0a8660 msgr2=0x7fa21c1547c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:00.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 -- 172.21.15.114:0/71001726 shutdown_connections 2024-02-17T12:17:00.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.207+0000 7fa220a00640 1 -- 172.21.15.114:0/71001726 wait complete. 2024-02-17T12:17:00.231 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-02-17T12:17:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc43e00640 1 Processor -- start 2024-02-17T12:17:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc43e00640 1 -- start start 2024-02-17T12:17:00.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc43e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c06db50 0x7efc3c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc43e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c156270 con 0x7efc3c150490 2024-02-17T12:17:00.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc43e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c156550 con 0x7efc3c0c25a0 2024-02-17T12:17:00.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc43e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c06f090 con 0x7efc3c06db50 2024-02-17T12:17:00.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc41e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efc3c150490 0x7efc3c152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56414/0 (socket says 172.21.15.114:56414) 2024-02-17T12:17:00.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc41e00640 1 -- 172.21.15.114:0/1946710712 learned_addr learned my addr 172.21.15.114:0/1946710712 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc40a00640 1 --2- 172.21.15.114:0/1946710712 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c06db50 0x7efc3c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc3be00640 1 -- 172.21.15.114:0/1946710712 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260903668 0 0) 0x7efc3c156270 con 0x7efc3c150490 2024-02-17T12:17:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc3be00640 1 -- 172.21.15.114:0/1946710712 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc24003530 con 0x7efc3c150490 2024-02-17T12:17:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc3be00640 1 -- 172.21.15.114:0/1946710712 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858146981 0 0) 0x7efc3c156550 con 0x7efc3c0c25a0 2024-02-17T12:17:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc3be00640 1 -- 172.21.15.114:0/1946710712 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc3c156270 con 0x7efc3c0c25a0 2024-02-17T12:17:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc40a00640 1 -- 172.21.15.114:0/1946710712 >> v1:172.21.15.116:6789/0 conn(0x7efc3c0c25a0 legacy=0x7efc3c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc40a00640 1 -- 172.21.15.114:0/1946710712 >> v1:172.21.15.114:6789/0 conn(0x7efc3c150490 legacy=0x7efc3c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.362+0000 7efc40a00640 1 -- 172.21.15.114:0/1946710712 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c156830 con 0x7efc3c06db50 2024-02-17T12:17:00.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc40a00640 1 --2- 172.21.15.114:0/1946710712 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c06db50 0x7efc3c14ff50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efc280097f0 tx=0x7efc2801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f83b51f41c344a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc3be00640 1 -- 172.21.15.114:0/1946710712 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc280ab600 con 0x7efc3c06db50 2024-02-17T12:17:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc3be00640 1 -- 172.21.15.114:0/1946710712 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc280a7050 con 0x7efc3c06db50 2024-02-17T12:17:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc3be00640 1 -- 172.21.15.114:0/1946710712 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc280ab960 con 0x7efc3c06db50 2024-02-17T12:17:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc43e00640 1 -- 172.21.15.114:0/1946710712 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c06db50 msgr2=0x7efc3c14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc43e00640 1 --2- 172.21.15.114:0/1946710712 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c06db50 0x7efc3c14ff50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efc280097f0 tx=0x7efc2801c3c0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc43e00640 1 -- 172.21.15.114:0/1946710712 shutdown_connections 2024-02-17T12:17:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc43e00640 1 --2- 172.21.15.114:0/1946710712 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c06db50 0x7efc3c14ff50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc43e00640 1 -- 172.21.15.114:0/1946710712 >> 172.21.15.114:0/1946710712 conn(0x7efc3c0a8490 msgr2=0x7efc3c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc43e00640 1 -- 172.21.15.114:0/1946710712 shutdown_connections 2024-02-17T12:17:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc43e00640 1 -- 172.21.15.114:0/1946710712 wait complete. 2024-02-17T12:17:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc43e00640 1 Processor -- start 2024-02-17T12:17:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.366+0000 7efc43e00640 1 -- start start 2024-02-17T12:17:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc43e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c06db50 0x7efc3c13eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc43e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc3c0c25a0 0x7efc3c13cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc43e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c150490 0x7efc3c14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc43e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c1efc40 con 0x7efc3c06db50 2024-02-17T12:17:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc43e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c1ef6d0 con 0x7efc3c0c25a0 2024-02-17T12:17:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc43e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0c5d10 con 0x7efc3c150490 2024-02-17T12:17:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc41400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c06db50 0x7efc3c13eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc41400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c06db50 0x7efc3c13eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45630/0 (socket says 172.21.15.114:45630) 2024-02-17T12:17:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc41400640 1 -- 172.21.15.114:0/3166712191 learned_addr learned my addr 172.21.15.114:0/3166712191 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc40a00640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc3c0c25a0 0x7efc3c13cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc41e00640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c150490 0x7efc3c14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc41400640 1 -- 172.21.15.114:0/3166712191 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c150490 msgr2=0x7efc3c14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc41400640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c150490 0x7efc3c14dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc41400640 1 -- 172.21.15.114:0/3166712191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc3c0c25a0 msgr2=0x7efc3c13cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc41400640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc3c0c25a0 0x7efc3c13cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc41400640 1 -- 172.21.15.114:0/3166712191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc28009420 con 0x7efc3c06db50 2024-02-17T12:17:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc41400640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c06db50 0x7efc3c13eed0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efc3000c500 tx=0x7efc3000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc39600640 1 -- 172.21.15.114:0/3166712191 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc300052d0 con 0x7efc3c06db50 2024-02-17T12:17:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc39600640 1 -- 172.21.15.114:0/3166712191 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc30005450 con 0x7efc3c06db50 2024-02-17T12:17:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc39600640 1 -- 172.21.15.114:0/3166712191 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc30012870 con 0x7efc3c06db50 2024-02-17T12:17:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc43e00640 1 -- 172.21.15.114:0/3166712191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c0c5fb0 con 0x7efc3c06db50 2024-02-17T12:17:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc43e00640 1 -- 172.21.15.114:0/3166712191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c13d260 con 0x7efc3c06db50 2024-02-17T12:17:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc43e00640 1 -- 172.21.15.114:0/3166712191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c14da70 con 0x7efc3c06db50 2024-02-17T12:17:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.370+0000 7efc39600640 1 -- 172.21.15.114:0/3166712191 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7efc300129d0 con 0x7efc3c06db50 2024-02-17T12:17:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.374+0000 7efc39600640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc1c066e40 0x7efc1c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.374+0000 7efc39600640 1 -- 172.21.15.114:0/3166712191 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efc30084310 con 0x7efc3c06db50 2024-02-17T12:17:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.374+0000 7efc40a00640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc1c066e40 0x7efc1c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.374+0000 7efc40a00640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc1c066e40 0x7efc1c069300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc280ad000 tx=0x7efc28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:00.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.378+0000 7efc39600640 1 -- 172.21.15.114:0/3166712191 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efc3c14da70 con 0x7efc3c06db50 2024-02-17T12:17:00.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.586+0000 7efc43e00640 1 -- 172.21.15.114:0/3166712191 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7efc3c074840 con 0x7efc3c06db50 2024-02-17T12:17:00.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.586+0000 7efc39600640 1 -- 172.21.15.114:0/3166712191 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7efc30054f70 con 0x7efc3c06db50 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 -- 172.21.15.114:0/3166712191 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc1c066e40 msgr2=0x7efc1c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc1c066e40 0x7efc1c069300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc280ad000 tx=0x7efc28008040 comp rx=0 tx=0).stop 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 -- 172.21.15.114:0/3166712191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c06db50 msgr2=0x7efc3c13eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c06db50 0x7efc3c13eed0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efc3000c500 tx=0x7efc3000c9c0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 -- 172.21.15.114:0/3166712191 shutdown_connections 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efc3c150490 0x7efc3c14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc3c0c25a0 0x7efc3c13cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efc1c066e40 0x7efc1c069300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 --2- 172.21.15.114:0/3166712191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c06db50 0x7efc3c13eed0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 -- 172.21.15.114:0/3166712191 >> 172.21.15.114:0/3166712191 conn(0x7efc3c0a8490 msgr2=0x7efc3c0c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 -- 172.21.15.114:0/3166712191 shutdown_connections 2024-02-17T12:17:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.590+0000 7efc43e00640 1 -- 172.21.15.114:0/3166712191 wait complete. 2024-02-17T12:17:00.616 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-02-17T12:17:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0def200640 1 Processor -- start 2024-02-17T12:17:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0def200640 1 -- start start 2024-02-17T12:17:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0def200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0df00c0e90 0x7f0df006c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0def200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df006e460 con 0x7f0df006b1d0 2024-02-17T12:17:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0def200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00a6580 con 0x7f0df00a61a0 2024-02-17T12:17:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0def200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df0071f50 con 0x7f0df00c0e90 2024-02-17T12:17:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0ded400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0df00c0e90 0x7f0df006c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0dee800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0df006b1d0 0x7f0df006b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56422/0 (socket says 172.21.15.114:56422) 2024-02-17T12:17:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0dee800640 1 -- 172.21.15.114:0/869124633 learned_addr learned my addr 172.21.15.114:0/869124633 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0ded400640 1 -- 172.21.15.114:0/869124633 >> v1:172.21.15.116:6789/0 conn(0x7f0df00a61a0 legacy=0x7f0df00bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0ded400640 1 -- 172.21.15.114:0/869124633 >> v1:172.21.15.114:6789/0 conn(0x7f0df006b1d0 legacy=0x7f0df006b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.746+0000 7f0ded400640 1 -- 172.21.15.114:0/869124633 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df0155960 con 0x7f0df00c0e90 2024-02-17T12:17:00.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0ded400640 1 --2- 172.21.15.114:0/869124633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df00c0e90 0x7f0df006c080 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0097c0 tx=0x7f0ddc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801ce010cf038539 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:00.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0deca00640 1 -- 172.21.15.114:0/869124633 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0a8050 con 0x7f0df00c0e90 2024-02-17T12:17:00.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0deca00640 1 -- 172.21.15.114:0/869124633 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc0ac5f0 con 0x7f0df00c0e90 2024-02-17T12:17:00.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0deca00640 1 -- 172.21.15.114:0/869124633 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0ac980 con 0x7f0df00c0e90 2024-02-17T12:17:00.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0def200640 1 -- 172.21.15.114:0/869124633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df00c0e90 msgr2=0x7f0df006c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0def200640 1 --2- 172.21.15.114:0/869124633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df00c0e90 0x7f0df006c080 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0097c0 tx=0x7f0ddc01c4a0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0def200640 1 -- 172.21.15.114:0/869124633 shutdown_connections 2024-02-17T12:17:00.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0def200640 1 --2- 172.21.15.114:0/869124633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df00c0e90 0x7f0df006c080 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0def200640 1 -- 172.21.15.114:0/869124633 >> 172.21.15.114:0/869124633 conn(0x7f0df00a8840 msgr2=0x7f0df00a8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:00.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0def200640 1 -- 172.21.15.114:0/869124633 shutdown_connections 2024-02-17T12:17:00.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.750+0000 7f0def200640 1 -- 172.21.15.114:0/869124633 wait complete. 2024-02-17T12:17:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 Processor -- start 2024-02-17T12:17:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 -- start start 2024-02-17T12:17:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df006b1d0 0x7f0df0153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0df00a61a0 0x7f0df01ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0df00c0e90 0x7f0df01edc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df01f1870 con 0x7f0df006b1d0 2024-02-17T12:17:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df01f1320 con 0x7f0df00c0e90 2024-02-17T12:17:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df01f1590 con 0x7f0df00a61a0 2024-02-17T12:17:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0dede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df006b1d0 0x7f0df0153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0dede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df006b1d0 0x7f0df0153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45652/0 (socket says 172.21.15.114:45652) 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0dede00640 1 -- 172.21.15.114:0/1791848265 learned_addr learned my addr 172.21.15.114:0/1791848265 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0ded400640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0df00a61a0 0x7f0df01ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0dee800640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0df00c0e90 0x7f0df01edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0dede00640 1 -- 172.21.15.114:0/1791848265 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0df00a61a0 msgr2=0x7f0df01ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0dede00640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0df00a61a0 0x7f0df01ed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0dede00640 1 -- 172.21.15.114:0/1791848265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0df00c0e90 msgr2=0x7f0df01edc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0dede00640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0df00c0e90 0x7f0df01edc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0dede00640 1 -- 172.21.15.114:0/1791848265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc009420 con 0x7f0df006b1d0 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0dede00640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df006b1d0 0x7f0df0153d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0de000c7c0 tx=0x7f0de000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0de6000640 1 -- 172.21.15.114:0/1791848265 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0006d60 con 0x7f0df006b1d0 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0de6000640 1 -- 172.21.15.114:0/1791848265 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de0003980 con 0x7f0df006b1d0 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0de6000640 1 -- 172.21.15.114:0/1791848265 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0003d30 con 0x7f0df006b1d0 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 -- 172.21.15.114:0/1791848265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df0158320 con 0x7f0df006b1d0 2024-02-17T12:17:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 -- 172.21.15.114:0/1791848265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df01542d0 con 0x7f0df006b1d0 2024-02-17T12:17:00.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.754+0000 7f0def200640 1 -- 172.21.15.114:0/1791848265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df004eef0 con 0x7f0df006b1d0 2024-02-17T12:17:00.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.758+0000 7f0de6000640 1 -- 172.21.15.114:0/1791848265 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0de000a850 con 0x7f0df006b1d0 2024-02-17T12:17:00.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.758+0000 7f0de6000640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0dd0066e40 0x7f0dd0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:00.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.758+0000 7f0de6000640 1 -- 172.21.15.114:0/1791848265 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0de0084230 con 0x7f0df006b1d0 2024-02-17T12:17:00.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.758+0000 7f0ded400640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0dd0066e40 0x7f0dd0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.758+0000 7f0ded400640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0dd0066e40 0x7f0dd0069300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0ae000 tx=0x7f0ddc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:00.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.762+0000 7f0de6000640 1 -- 172.21.15.114:0/1791848265 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0de0051410 con 0x7f0df006b1d0 2024-02-17T12:17:00.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.982+0000 7f0def200640 1 -- 172.21.15.114:0/1791848265 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0df006be60 con 0x7f0df006b1d0 2024-02-17T12:17:00.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.986+0000 7f0de6000640 1 -- 172.21.15.114:0/1791848265 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0de0054ad0 con 0x7f0df006b1d0 2024-02-17T12:17:00.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 -- 172.21.15.114:0/1791848265 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0dd0066e40 msgr2=0x7f0dd0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0dd0066e40 0x7f0dd0069300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0ae000 tx=0x7f0ddc0a7000 comp rx=0 tx=0).stop 2024-02-17T12:17:00.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 -- 172.21.15.114:0/1791848265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df006b1d0 msgr2=0x7f0df0153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:00.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df006b1d0 0x7f0df0153d90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0de000c7c0 tx=0x7f0de000cc80 comp rx=0 tx=0).stop 2024-02-17T12:17:00.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 -- 172.21.15.114:0/1791848265 shutdown_connections 2024-02-17T12:17:00.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0df00c0e90 0x7f0df01edc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0df00a61a0 0x7f0df01ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0dd0066e40 0x7f0dd0069300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 --2- 172.21.15.114:0/1791848265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0df006b1d0 0x7f0df0153d90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:00.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 -- 172.21.15.114:0/1791848265 >> 172.21.15.114:0/1791848265 conn(0x7f0df00a8840 msgr2=0x7f0df006b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:00.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 -- 172.21.15.114:0/1791848265 shutdown_connections 2024-02-17T12:17:00.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:00.990+0000 7f0def200640 1 -- 172.21.15.114:0/1791848265 wait complete. 2024-02-17T12:17:01.013 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-02-17T12:17:01.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.142+0000 7f45f9400640 1 Processor -- start 2024-02-17T12:17:01.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.142+0000 7f45f9400640 1 -- start start 2024-02-17T12:17:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.142+0000 7f45f9400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f45f414f110 0x7f45f40c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.142+0000 7f45f9400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45f40c2580 0x7f45f40aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.142+0000 7f45f9400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f40a9420 con 0x7f45f40c1eb0 2024-02-17T12:17:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.142+0000 7f45f9400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f414f4f0 con 0x7f45f40c2580 2024-02-17T12:17:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.142+0000 7f45f9400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f40aae80 con 0x7f45f414f110 2024-02-17T12:17:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45f40c2580 0x7f45f40aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45f40c2580 0x7f45f40aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45662/0 (socket says 172.21.15.114:45662) 2024-02-17T12:17:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1e00640 1 -- 172.21.15.114:0/2946473220 learned_addr learned my addr 172.21.15.114:0/2946473220 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f2800640 1 --2- 172.21.15.114:0/2946473220 >> v2:172.21.15.116:3300/0 conn(0x7f45f414f110 0x7f45f40c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1e00640 1 -- 172.21.15.114:0/2946473220 >> v2:172.21.15.116:3300/0 conn(0x7f45f414f110 msgr2=0x7f45f40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1e00640 1 --2- 172.21.15.114:0/2946473220 >> v2:172.21.15.116:3300/0 conn(0x7f45f414f110 0x7f45f40c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1e00640 1 -- 172.21.15.114:0/2946473220 >> v1:172.21.15.116:6789/0 conn(0x7f45f40c1eb0 legacy=0x7f45f4155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1e00640 1 -- 172.21.15.114:0/2946473220 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f4152850 con 0x7f45f40c2580 2024-02-17T12:17:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f2800640 1 --2- 172.21.15.114:0/2946473220 >> v2:172.21.15.116:3300/0 conn(0x7f45f414f110 0x7f45f40c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1e00640 1 --2- 172.21.15.114:0/2946473220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 0x7f45f40aa150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f45f406dc70 tx=0x7f45e001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17cd6f8901b06c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1400640 1 -- 172.21.15.114:0/2946473220 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00ab620 con 0x7f45f40c2580 2024-02-17T12:17:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1400640 1 -- 172.21.15.114:0/2946473220 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e00ab780 con 0x7f45f40c2580 2024-02-17T12:17:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.146+0000 7f45f1400640 1 -- 172.21.15.114:0/2946473220 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00abb10 con 0x7f45f40c2580 2024-02-17T12:17:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 -- 172.21.15.114:0/2946473220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 msgr2=0x7f45f40aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 --2- 172.21.15.114:0/2946473220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 0x7f45f40aa150 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f45f406dc70 tx=0x7f45e001c420 comp rx=0 tx=0).stop 2024-02-17T12:17:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 -- 172.21.15.114:0/2946473220 shutdown_connections 2024-02-17T12:17:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 --2- 172.21.15.114:0/2946473220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 0x7f45f40aa150 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 --2- 172.21.15.114:0/2946473220 >> v2:172.21.15.116:3300/0 conn(0x7f45f414f110 0x7f45f40c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 -- 172.21.15.114:0/2946473220 >> 172.21.15.114:0/2946473220 conn(0x7f45f40a8490 msgr2=0x7f45f40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 -- 172.21.15.114:0/2946473220 shutdown_connections 2024-02-17T12:17:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 -- 172.21.15.114:0/2946473220 wait complete. 2024-02-17T12:17:01.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 Processor -- start 2024-02-17T12:17:01.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 -- start start 2024-02-17T12:17:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f45f40c1eb0 0x7f45f41ee240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 0x7f45f40bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45f414f110 0x7f45f414db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c5b70 con 0x7f45f40c2580 2024-02-17T12:17:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f41ee780 con 0x7f45f414f110 2024-02-17T12:17:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f9400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f415e5a0 con 0x7f45f40c1eb0 2024-02-17T12:17:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 0x7f45f40bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 0x7f45f40bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45676/0 (socket says 172.21.15.114:45676) 2024-02-17T12:17:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f1e00640 1 -- 172.21.15.114:0/388874499 learned_addr learned my addr 172.21.15.114:0/388874499 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f3200640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45f414f110 0x7f45f414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f2800640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f45f40c1eb0 0x7f45f41ee240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f1e00640 1 -- 172.21.15.114:0/388874499 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f45f40c1eb0 msgr2=0x7f45f41ee240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f1e00640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f45f40c1eb0 0x7f45f41ee240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f1e00640 1 -- 172.21.15.114:0/388874499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45f414f110 msgr2=0x7f45f414db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f1e00640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45f414f110 0x7f45f414db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f1e00640 1 -- 172.21.15.114:0/388874499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00094d0 con 0x7f45f40c2580 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.150+0000 7f45f1e00640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 0x7f45f40bfa00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f45e001a050 tx=0x7f45e001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45eaa00640 1 -- 172.21.15.114:0/388874499 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00be3f0 con 0x7f45f40c2580 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45eaa00640 1 -- 172.21.15.114:0/388874499 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e00be550 con 0x7f45f40c2580 2024-02-17T12:17:01.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45f9400640 1 -- 172.21.15.114:0/388874499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f40c4ff0 con 0x7f45f40c2580 2024-02-17T12:17:01.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45eaa00640 1 -- 172.21.15.114:0/388874499 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00be8c0 con 0x7f45f40c2580 2024-02-17T12:17:01.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45f9400640 1 -- 172.21.15.114:0/388874499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f40c55b0 con 0x7f45f40c2580 2024-02-17T12:17:01.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45f9400640 1 -- 172.21.15.114:0/388874499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f41f0e30 con 0x7f45f40c2580 2024-02-17T12:17:01.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45eaa00640 1 -- 172.21.15.114:0/388874499 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f45e00c7440 con 0x7f45f40c2580 2024-02-17T12:17:01.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45eaa00640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f45d4066e40 0x7f45d4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45eaa00640 1 -- 172.21.15.114:0/388874499 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f45e011ef30 con 0x7f45f40c2580 2024-02-17T12:17:01.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45f2800640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f45d4066e40 0x7f45d4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.154+0000 7f45f2800640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f45d4066e40 0x7f45d4069300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f45f415d9e0 tx=0x7f45e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.158+0000 7f45eaa00640 1 -- 172.21.15.114:0/388874499 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f45f41f0e30 con 0x7f45f40c2580 2024-02-17T12:17:01.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.366+0000 7f45f9400640 1 -- 172.21.15.114:0/388874499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f45f41f0e30 con 0x7f45f40c2580 2024-02-17T12:17:01.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.370+0000 7f45eaa00640 1 -- 172.21.15.114:0/388874499 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f45f41f0e30 con 0x7f45f40c2580 2024-02-17T12:17:01.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 -- 172.21.15.114:0/388874499 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f45d4066e40 msgr2=0x7f45d4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f45d4066e40 0x7f45d4069300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f45f415d9e0 tx=0x7f45e4008040 comp rx=0 tx=0).stop 2024-02-17T12:17:01.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 -- 172.21.15.114:0/388874499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 msgr2=0x7f45f40bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 0x7f45f40bfa00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f45e001a050 tx=0x7f45e001ac60 comp rx=0 tx=0).stop 2024-02-17T12:17:01.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 -- 172.21.15.114:0/388874499 shutdown_connections 2024-02-17T12:17:01.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45f414f110 0x7f45f414db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f45d4066e40 0x7f45d4069300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45f40c2580 0x7f45f40bfa00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 --2- 172.21.15.114:0/388874499 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f45f40c1eb0 0x7f45f41ee240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 -- 172.21.15.114:0/388874499 >> 172.21.15.114:0/388874499 conn(0x7f45f40a8490 msgr2=0x7f45f40c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:01.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 -- 172.21.15.114:0/388874499 shutdown_connections 2024-02-17T12:17:01.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.374+0000 7f45f9400640 1 -- 172.21.15.114:0/388874499 wait complete. 2024-02-17T12:17:01.399 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-02-17T12:17:01.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.526+0000 7f6e2a800640 1 Processor -- start 2024-02-17T12:17:01.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.526+0000 7f6e2a800640 1 -- start start 2024-02-17T12:17:01.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e2a800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6e2414f110 0x7f6e240c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e2a800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e240a9420 con 0x7f6e240c1eb0 2024-02-17T12:17:01.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e2a800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e24152850 con 0x7f6e240c2580 2024-02-17T12:17:01.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e2a800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2414f4f0 con 0x7f6e2414f110 2024-02-17T12:17:01.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e23e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6e240c1eb0 0x7f6e2415c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56426/0 (socket says 172.21.15.114:56426) 2024-02-17T12:17:01.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e23e00640 1 -- 172.21.15.114:0/3856663669 learned_addr learned my addr 172.21.15.114:0/3856663669 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:01.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e23400640 1 --2- 172.21.15.114:0/3856663669 >> v2:172.21.15.116:3300/0 conn(0x7f6e2414f110 0x7f6e240c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e22000640 1 -- 172.21.15.114:0/3856663669 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973112711 0 0) 0x7f6e240a9420 con 0x7f6e240c1eb0 2024-02-17T12:17:01.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e22000640 1 -- 172.21.15.114:0/3856663669 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e08003530 con 0x7f6e240c1eb0 2024-02-17T12:17:01.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e22000640 1 -- 172.21.15.114:0/3856663669 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011988948 0 0) 0x7f6e24152850 con 0x7f6e240c2580 2024-02-17T12:17:01.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e22000640 1 -- 172.21.15.114:0/3856663669 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e240a9420 con 0x7f6e240c2580 2024-02-17T12:17:01.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e23400640 1 -- 172.21.15.114:0/3856663669 >> v1:172.21.15.116:6789/0 conn(0x7f6e240c2580 legacy=0x7f6e240aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e22000640 1 -- 172.21.15.114:0/3856663669 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192167041 0 0) 0x7f6e08003530 con 0x7f6e240c1eb0 2024-02-17T12:17:01.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e23400640 1 -- 172.21.15.114:0/3856663669 >> v1:172.21.15.114:6789/0 conn(0x7f6e240c1eb0 legacy=0x7f6e2415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.530+0000 7f6e23400640 1 -- 172.21.15.114:0/3856663669 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e240a9670 con 0x7f6e2414f110 2024-02-17T12:17:01.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e23400640 1 --2- 172.21.15.114:0/3856663669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e2414f110 0x7f6e240c65a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6e140097c0 tx=0x7f6e1401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d3b06f667a1ef74 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:01.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e22000640 1 -- 172.21.15.114:0/3856663669 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c001a00 con 0x7f6e2414f110 2024-02-17T12:17:01.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e22000640 1 -- 172.21.15.114:0/3856663669 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e140a7050 con 0x7f6e2414f110 2024-02-17T12:17:01.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e22000640 1 -- 172.21.15.114:0/3856663669 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e140ab600 con 0x7f6e2414f110 2024-02-17T12:17:01.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e2a800640 1 -- 172.21.15.114:0/3856663669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e2414f110 msgr2=0x7f6e240c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e2a800640 1 --2- 172.21.15.114:0/3856663669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e2414f110 0x7f6e240c65a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6e140097c0 tx=0x7f6e1401c330 comp rx=0 tx=0).stop 2024-02-17T12:17:01.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e2a800640 1 -- 172.21.15.114:0/3856663669 shutdown_connections 2024-02-17T12:17:01.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e2a800640 1 --2- 172.21.15.114:0/3856663669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e2414f110 0x7f6e240c65a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e2a800640 1 -- 172.21.15.114:0/3856663669 >> 172.21.15.114:0/3856663669 conn(0x7f6e240a8490 msgr2=0x7f6e240a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:01.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e2a800640 1 -- 172.21.15.114:0/3856663669 shutdown_connections 2024-02-17T12:17:01.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e2a800640 1 -- 172.21.15.114:0/3856663669 wait complete. 2024-02-17T12:17:01.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e2a800640 1 Processor -- start 2024-02-17T12:17:01.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.534+0000 7f6e2a800640 1 -- start start 2024-02-17T12:17:01.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e2a800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e240c1eb0 0x7f6e24145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e2a800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e240c2580 0x7f6e24150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e2a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2414f110 0x7f6e24147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e2a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2414c470 con 0x7f6e2414f110 2024-02-17T12:17:01.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e2a800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2414c6e0 con 0x7f6e240c2580 2024-02-17T12:17:01.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e2a800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2414b420 con 0x7f6e240c1eb0 2024-02-17T12:17:01.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e23e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2414f110 0x7f6e24147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e23e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2414f110 0x7f6e24147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45688/0 (socket says 172.21.15.114:45688) 2024-02-17T12:17:01.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e23e00640 1 -- 172.21.15.114:0/264009129 learned_addr learned my addr 172.21.15.114:0/264009129 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:01.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e22a00640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e240c2580 0x7f6e24150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e23400640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e240c1eb0 0x7f6e24145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e23e00640 1 -- 172.21.15.114:0/264009129 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e240c1eb0 msgr2=0x7f6e24145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e23e00640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e240c1eb0 0x7f6e24145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e23e00640 1 -- 172.21.15.114:0/264009129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e240c2580 msgr2=0x7f6e24150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e23e00640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e240c2580 0x7f6e24150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e23e00640 1 -- 172.21.15.114:0/264009129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14009420 con 0x7f6e2414f110 2024-02-17T12:17:01.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e23e00640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2414f110 0x7f6e24147790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c001f90 tx=0x7f6e1c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:01.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e1b400640 1 -- 172.21.15.114:0/264009129 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c012400 con 0x7f6e2414f110 2024-02-17T12:17:01.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e1b400640 1 -- 172.21.15.114:0/264009129 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c012560 con 0x7f6e2414f110 2024-02-17T12:17:01.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e1b400640 1 -- 172.21.15.114:0/264009129 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0128f0 con 0x7f6e2414f110 2024-02-17T12:17:01.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e2a800640 1 -- 172.21.15.114:0/264009129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e24147010 con 0x7f6e2414f110 2024-02-17T12:17:01.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e2a800640 1 -- 172.21.15.114:0/264009129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24144b00 con 0x7f6e2414f110 2024-02-17T12:17:01.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e2a800640 1 -- 172.21.15.114:0/264009129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e24144d20 con 0x7f6e2414f110 2024-02-17T12:17:01.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.538+0000 7f6e1b400640 1 -- 172.21.15.114:0/264009129 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6e1c012a50 con 0x7f6e2414f110 2024-02-17T12:17:01.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.542+0000 7f6e1b400640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6e04066e40 0x7f6e04069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.542+0000 7f6e1b400640 1 -- 172.21.15.114:0/264009129 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e1c084ed0 con 0x7f6e2414f110 2024-02-17T12:17:01.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.542+0000 7f6e23400640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6e04066e40 0x7f6e04069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.542+0000 7f6e23400640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6e04066e40 0x7f6e04069300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6e140ad000 tx=0x7f6e140a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.546+0000 7f6e1b400640 1 -- 172.21.15.114:0/264009129 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6e1c052000 con 0x7f6e2414f110 2024-02-17T12:17:01.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.754+0000 7f6e2a800640 1 -- 172.21.15.114:0/264009129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6e24144940 con 0x7f6e2414f110 2024-02-17T12:17:01.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.754+0000 7f6e1b400640 1 -- 172.21.15.114:0/264009129 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6e1c0556c0 con 0x7f6e2414f110 2024-02-17T12:17:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 -- 172.21.15.114:0/264009129 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6e04066e40 msgr2=0x7f6e04069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6e04066e40 0x7f6e04069300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6e140ad000 tx=0x7f6e140a6000 comp rx=0 tx=0).stop 2024-02-17T12:17:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 -- 172.21.15.114:0/264009129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2414f110 msgr2=0x7f6e24147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2414f110 0x7f6e24147790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c001f90 tx=0x7f6e1c00a430 comp rx=0 tx=0).stop 2024-02-17T12:17:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 -- 172.21.15.114:0/264009129 shutdown_connections 2024-02-17T12:17:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6e04066e40 0x7f6e04069300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e2414f110 0x7f6e24147790 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e240c2580 0x7f6e24150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 --2- 172.21.15.114:0/264009129 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e240c1eb0 0x7f6e24145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 -- 172.21.15.114:0/264009129 >> 172.21.15.114:0/264009129 conn(0x7f6e240a8490 msgr2=0x7f6e240aa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 -- 172.21.15.114:0/264009129 shutdown_connections 2024-02-17T12:17:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.758+0000 7f6e2a800640 1 -- 172.21.15.114:0/264009129 wait complete. 2024-02-17T12:17:01.783 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-02-17T12:17:01.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe64f200640 1 Processor -- start 2024-02-17T12:17:01.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe64f200640 1 -- start start 2024-02-17T12:17:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe64f200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe648072b20 0x7fe6480c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe64f200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6481586f0 0x7fe648158b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe64f200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6480723b0 con 0x7fe648152560 2024-02-17T12:17:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe64f200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe648070000 con 0x7fe648072b20 2024-02-17T12:17:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe64f200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe648154dc0 con 0x7fe6481586f0 2024-02-17T12:17:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe647e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe648152560 0x7fe6480c4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56436/0 (socket says 172.21.15.114:56436) 2024-02-17T12:17:01.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe647e00640 1 -- 172.21.15.114:0/3833745159 learned_addr learned my addr 172.21.15.114:0/3833745159 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:01.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe647400640 1 --2- 172.21.15.114:0/3833745159 >> v2:172.21.15.116:3300/0 conn(0x7fe648072b20 0x7fe6480c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe64d200640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6481586f0 0x7fe648158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137803501 0 0) 0x7fe6480723b0 con 0x7fe648152560 2024-02-17T12:17:01.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe62c003530 con 0x7fe648152560 2024-02-17T12:17:01.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2489167375 0 0) 0x7fe62c003530 con 0x7fe648152560 2024-02-17T12:17:01.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6481586f0 msgr2=0x7fe648158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:01.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6481586f0 0x7fe648158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 >> v2:172.21.15.116:3300/0 conn(0x7fe648072b20 msgr2=0x7fe6480c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 --2- 172.21.15.114:0/3833745159 >> v2:172.21.15.116:3300/0 conn(0x7fe648072b20 0x7fe6480c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6480728e0 con 0x7fe648152560 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fe638001a00 con 0x7fe648152560 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 >> v1:172.21.15.114:6789/0 conn(0x7fe648152560 legacy=0x7fe6480c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c003980 0x7fe62c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6481586f0 0x7fe62c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe62c004d10 0x7fe62c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe648070000 con 0x7fe62c003980 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe648154dc0 con 0x7fe62c004d10 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.914+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c00b9c0 con 0x7fe6481586f0 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe647e00640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c003980 0x7fe62c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe647400640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6481586f0 0x7fe62c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe64d200640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe62c004d10 0x7fe62c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe647e00640 1 -- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6481586f0 msgr2=0x7fe62c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:01.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe647e00640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6481586f0 0x7fe62c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe647e00640 1 -- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe62c004d10 msgr2=0x7fe62c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:01.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe647e00640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe62c004d10 0x7fe62c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe647e00640 1 -- 172.21.15.114:0/3833745159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c003530 con 0x7fe62c003980 2024-02-17T12:17:01.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe647e00640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c003980 0x7fe62c003da0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe63800a860 tx=0x7fe63801d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20914f59c5c7346 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:01.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380ad630 con 0x7fe62c003980 2024-02-17T12:17:01.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6380a8070 con 0x7fe62c003980 2024-02-17T12:17:01.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe646a00640 1 -- 172.21.15.114:0/3833745159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380ad9f0 con 0x7fe62c003980 2024-02-17T12:17:01.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe64f200640 1 -- 172.21.15.114:0/3833745159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c003980 msgr2=0x7fe62c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.918+0000 7fe64f200640 1 --2- 172.21.15.114:0/3833745159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe62c003980 0x7fe62c003da0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe63800a860 tx=0x7fe63801d380 comp rx=0 tx=0).stop 2024-02-17T12:17:01.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64d200640 1 -- 172.21.15.114:0/3833745159 reap_dead start 2024-02-17T12:17:01.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 -- 172.21.15.114:0/3833745159 shutdown_connections 2024-02-17T12:17:01.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 -- 172.21.15.114:0/3833745159 >> 172.21.15.114:0/3833745159 conn(0x7fe64806bef0 msgr2=0x7fe64806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:01.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 -- 172.21.15.114:0/3833745159 shutdown_connections 2024-02-17T12:17:01.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 -- 172.21.15.114:0/3833745159 wait complete. 2024-02-17T12:17:01.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 Processor -- start 2024-02-17T12:17:01.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 -- start start 2024-02-17T12:17:01.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe62c003980 0x7fe6480a8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6480a8b80 0x7fe6481eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64814bdc0 0x7fe6481ee310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6481f0d00 con 0x7fe64814bdc0 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64814bb50 con 0x7fe62c003980 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64f200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64814b870 con 0x7fe6480a8b80 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64814bdc0 0x7fe6481ee310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64814bdc0 0x7fe6481ee310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45710/0 (socket says 172.21.15.114:45710) 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64d200640 1 -- 172.21.15.114:0/3893447822 learned_addr learned my addr 172.21.15.114:0/3893447822 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe647e00640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe62c003980 0x7fe6480a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe647400640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6480a8b80 0x7fe6481eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64d200640 1 -- 172.21.15.114:0/3893447822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6480a8b80 msgr2=0x7fe6481eddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64d200640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6480a8b80 0x7fe6481eddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64d200640 1 -- 172.21.15.114:0/3893447822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe62c003980 msgr2=0x7fe6480a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64d200640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe62c003980 0x7fe6480a8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64d200640 1 -- 172.21.15.114:0/3893447822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64815b5f0 con 0x7fe64814bdc0 2024-02-17T12:17:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe64d200640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64814bdc0 0x7fe6481ee310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe648158ad0 tx=0x7fe640011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.922+0000 7fe63fe00640 1 -- 172.21.15.114:0/3893447822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640004030 con 0x7fe64814bdc0 2024-02-17T12:17:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.926+0000 7fe63fe00640 1 -- 172.21.15.114:0/3893447822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe640004190 con 0x7fe64814bdc0 2024-02-17T12:17:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.926+0000 7fe63fe00640 1 -- 172.21.15.114:0/3893447822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64000f770 con 0x7fe64814bdc0 2024-02-17T12:17:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.926+0000 7fe64f200640 1 -- 172.21.15.114:0/3893447822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64815b8d0 con 0x7fe64814bdc0 2024-02-17T12:17:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.926+0000 7fe64f200640 1 -- 172.21.15.114:0/3893447822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64815a930 con 0x7fe64814bdc0 2024-02-17T12:17:01.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.926+0000 7fe64f200640 1 -- 172.21.15.114:0/3893447822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe648067370 con 0x7fe64814bdc0 2024-02-17T12:17:01.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.926+0000 7fe63fe00640 1 -- 172.21.15.114:0/3893447822 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe64000f8d0 con 0x7fe64814bdc0 2024-02-17T12:17:01.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.926+0000 7fe63fe00640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe628066e70 0x7fe628069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:01.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.926+0000 7fe63fe00640 1 -- 172.21.15.114:0/3893447822 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6400849a0 con 0x7fe64814bdc0 2024-02-17T12:17:01.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.926+0000 7fe647e00640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe628066e70 0x7fe628069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:01.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.926+0000 7fe647e00640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe628066e70 0x7fe628069330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe6380ad000 tx=0x7fe638001e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:01.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:01.930+0000 7fe63fe00640 1 -- 172.21.15.114:0/3893447822 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe640051b70 con 0x7fe64814bdc0 2024-02-17T12:17:02.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.142+0000 7fe64f200640 1 -- 172.21.15.114:0/3893447822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe648074840 con 0x7fe64814bdc0 2024-02-17T12:17:02.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe63fe00640 1 -- 172.21.15.114:0/3893447822 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe6400190a0 con 0x7fe64814bdc0 2024-02-17T12:17:02.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 -- 172.21.15.114:0/3893447822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe628066e70 msgr2=0x7fe628069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe628066e70 0x7fe628069330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe6380ad000 tx=0x7fe638001e00 comp rx=0 tx=0).stop 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 -- 172.21.15.114:0/3893447822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64814bdc0 msgr2=0x7fe6481ee310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64814bdc0 0x7fe6481ee310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe648158ad0 tx=0x7fe640011c30 comp rx=0 tx=0).stop 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 -- 172.21.15.114:0/3893447822 shutdown_connections 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe628066e70 0x7fe628069330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe64814bdc0 0x7fe6481ee310 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6480a8b80 0x7fe6481eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 --2- 172.21.15.114:0/3893447822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe62c003980 0x7fe6480a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 -- 172.21.15.114:0/3893447822 >> 172.21.15.114:0/3893447822 conn(0x7fe64806bef0 msgr2=0x7fe6480c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 -- 172.21.15.114:0/3893447822 shutdown_connections 2024-02-17T12:17:02.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.146+0000 7fe64f200640 1 -- 172.21.15.114:0/3893447822 wait complete. 2024-02-17T12:17:02.173 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-02-17T12:17:02.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa398c00640 1 Processor -- start 2024-02-17T12:17:02.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa398c00640 1 -- start start 2024-02-17T12:17:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa398c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa39414f110 0x7fa3940c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa398c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3940c1eb0 0x7fa39415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa398c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3940a9420 con 0x7fa3940c2580 2024-02-17T12:17:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa398c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39414f4f0 con 0x7fa3940c1eb0 2024-02-17T12:17:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa398c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3940aae80 con 0x7fa39414f110 2024-02-17T12:17:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa392800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3940c1eb0 0x7fa39415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa392800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3940c1eb0 0x7fa39415c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45720/0 (socket says 172.21.15.114:45720) 2024-02-17T12:17:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa392800640 1 -- 172.21.15.114:0/2863586496 learned_addr learned my addr 172.21.15.114:0/2863586496 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa391e00640 1 --2- 172.21.15.114:0/2863586496 >> v2:172.21.15.116:3300/0 conn(0x7fa39414f110 0x7fa3940c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:02.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa392800640 1 -- 172.21.15.114:0/2863586496 >> v2:172.21.15.116:3300/0 conn(0x7fa39414f110 msgr2=0x7fa3940c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:02.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa392800640 1 --2- 172.21.15.114:0/2863586496 >> v2:172.21.15.116:3300/0 conn(0x7fa39414f110 0x7fa3940c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa392800640 1 -- 172.21.15.114:0/2863586496 >> v1:172.21.15.116:6789/0 conn(0x7fa3940c2580 legacy=0x7fa3940aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.302+0000 7fa392800640 1 -- 172.21.15.114:0/2863586496 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394152850 con 0x7fa3940c1eb0 2024-02-17T12:17:02.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa392800640 1 --2- 172.21.15.114:0/2863586496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 0x7fa39415c390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa39406dc70 tx=0x7fa38c01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6548d13b8a1f9dd6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:02.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa390a00640 1 -- 172.21.15.114:0/2863586496 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0a7910 con 0x7fa3940c1eb0 2024-02-17T12:17:02.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa390a00640 1 -- 172.21.15.114:0/2863586496 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c0a7a70 con 0x7fa3940c1eb0 2024-02-17T12:17:02.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa390a00640 1 -- 172.21.15.114:0/2863586496 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0a7e00 con 0x7fa3940c1eb0 2024-02-17T12:17:02.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa398c00640 1 -- 172.21.15.114:0/2863586496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 msgr2=0x7fa39415c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa398c00640 1 --2- 172.21.15.114:0/2863586496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 0x7fa39415c390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa39406dc70 tx=0x7fa38c01eb40 comp rx=0 tx=0).stop 2024-02-17T12:17:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa398c00640 1 -- 172.21.15.114:0/2863586496 shutdown_connections 2024-02-17T12:17:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa398c00640 1 --2- 172.21.15.114:0/2863586496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 0x7fa39415c390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa398c00640 1 --2- 172.21.15.114:0/2863586496 >> v2:172.21.15.116:3300/0 conn(0x7fa39414f110 0x7fa3940c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa398c00640 1 -- 172.21.15.114:0/2863586496 >> 172.21.15.114:0/2863586496 conn(0x7fa3940a8490 msgr2=0x7fa3940a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa398c00640 1 -- 172.21.15.114:0/2863586496 shutdown_connections 2024-02-17T12:17:02.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.306+0000 7fa398c00640 1 -- 172.21.15.114:0/2863586496 wait complete. 2024-02-17T12:17:02.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 Processor -- start 2024-02-17T12:17:02.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 -- start start 2024-02-17T12:17:02.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 0x7fa3940bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3940c2580 0x7fa394150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa39414f110 0x7fa394151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941ee5e0 con 0x7fa3940c1eb0 2024-02-17T12:17:02.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941ee8c0 con 0x7fa39414f110 2024-02-17T12:17:02.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39414ac40 con 0x7fa3940c2580 2024-02-17T12:17:02.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa391e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 0x7fa3940bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa391e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 0x7fa3940bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45726/0 (socket says 172.21.15.114:45726) 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa391e00640 1 -- 172.21.15.114:0/831877210 learned_addr learned my addr 172.21.15.114:0/831877210 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa391e00640 1 -- 172.21.15.114:0/831877210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3940c2580 msgr2=0x7fa394150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa391e00640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3940c2580 0x7fa394150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa391e00640 1 -- 172.21.15.114:0/831877210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa39414f110 msgr2=0x7fa394151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa391e00640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa39414f110 0x7fa394151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa391e00640 1 -- 172.21.15.114:0/831877210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c009b30 con 0x7fa3940c1eb0 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa391e00640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 0x7fa3940bfa00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa38400e930 tx=0x7fa38400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa38a000640 1 -- 172.21.15.114:0/831877210 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384009690 con 0x7fa3940c1eb0 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa38a000640 1 -- 172.21.15.114:0/831877210 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38400ca00 con 0x7fa3940c1eb0 2024-02-17T12:17:02.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa38a000640 1 -- 172.21.15.114:0/831877210 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38400cd70 con 0x7fa3940c1eb0 2024-02-17T12:17:02.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 -- 172.21.15.114:0/831877210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39414af20 con 0x7fa3940c1eb0 2024-02-17T12:17:02.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 -- 172.21.15.114:0/831877210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3940bff40 con 0x7fa3940c1eb0 2024-02-17T12:17:02.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.310+0000 7fa398c00640 1 -- 172.21.15.114:0/831877210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3941493c0 con 0x7fa3940c1eb0 2024-02-17T12:17:02.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.314+0000 7fa38a000640 1 -- 172.21.15.114:0/831877210 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa384013470 con 0x7fa3940c1eb0 2024-02-17T12:17:02.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.314+0000 7fa38a000640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa374066e40 0x7fa374069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.314+0000 7fa38a000640 1 -- 172.21.15.114:0/831877210 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa384084980 con 0x7fa3940c1eb0 2024-02-17T12:17:02.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.314+0000 7fa391400640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa374066e40 0x7fa374069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:02.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.314+0000 7fa391400640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa374066e40 0x7fa374069300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa380000f70 tx=0x7fa3800079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:02.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.318+0000 7fa38a000640 1 -- 172.21.15.114:0/831877210 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa3941493c0 con 0x7fa3940c1eb0 2024-02-17T12:17:02.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.526+0000 7fa398c00640 1 -- 172.21.15.114:0/831877210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fa3941493c0 con 0x7fa3940c1eb0 2024-02-17T12:17:02.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.530+0000 7fa38a000640 1 -- 172.21.15.114:0/831877210 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa3941493c0 con 0x7fa3940c1eb0 2024-02-17T12:17:02.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 -- 172.21.15.114:0/831877210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa374066e40 msgr2=0x7fa374069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa374066e40 0x7fa374069300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa380000f70 tx=0x7fa3800079e0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 -- 172.21.15.114:0/831877210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 msgr2=0x7fa3940bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 0x7fa3940bfa00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa38400e930 tx=0x7fa38400edf0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 -- 172.21.15.114:0/831877210 shutdown_connections 2024-02-17T12:17:02.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa39414f110 0x7fa394151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3940c2580 0x7fa394150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa374066e40 0x7fa374069300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 --2- 172.21.15.114:0/831877210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3940c1eb0 0x7fa3940bfa00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 -- 172.21.15.114:0/831877210 >> 172.21.15.114:0/831877210 conn(0x7fa3940a8490 msgr2=0x7fa3940c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 -- 172.21.15.114:0/831877210 shutdown_connections 2024-02-17T12:17:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.534+0000 7fa398c00640 1 -- 172.21.15.114:0/831877210 wait complete. 2024-02-17T12:17:02.559 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:02.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.686+0000 7fa598800640 1 Processor -- start 2024-02-17T12:17:02.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.686+0000 7fa598800640 1 -- start start 2024-02-17T12:17:02.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa598800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c2580 0x7fa5900aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa598800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5900a9420 con 0x7fa59014f110 2024-02-17T12:17:02.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa598800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa590152850 con 0x7fa5900c1eb0 2024-02-17T12:17:02.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa598800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59014f4f0 con 0x7fa5900c2580 2024-02-17T12:17:02.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa595e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa59014f110 0x7fa5900c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56442/0 (socket says 172.21.15.114:56442) 2024-02-17T12:17:02.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa595e00640 1 -- 172.21.15.114:0/2876629924 learned_addr learned my addr 172.21.15.114:0/2876629924 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:02.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa595400640 1 --2- 172.21.15.114:0/2876629924 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c2580 0x7fa5900aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:02.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa594a00640 1 -- 172.21.15.114:0/2876629924 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262823765 0 0) 0x7fa5900a9420 con 0x7fa59014f110 2024-02-17T12:17:02.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa594a00640 1 -- 172.21.15.114:0/2876629924 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa578003530 con 0x7fa59014f110 2024-02-17T12:17:02.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa594a00640 1 -- 172.21.15.114:0/2876629924 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770494983 0 0) 0x7fa590152850 con 0x7fa5900c1eb0 2024-02-17T12:17:02.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa594a00640 1 -- 172.21.15.114:0/2876629924 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5900a9420 con 0x7fa5900c1eb0 2024-02-17T12:17:02.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa595400640 1 -- 172.21.15.114:0/2876629924 >> v1:172.21.15.116:6789/0 conn(0x7fa5900c1eb0 legacy=0x7fa59015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa595400640 1 -- 172.21.15.114:0/2876629924 >> v1:172.21.15.114:6789/0 conn(0x7fa59014f110 legacy=0x7fa5900c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.690+0000 7fa595400640 1 -- 172.21.15.114:0/2876629924 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900a9670 con 0x7fa5900c2580 2024-02-17T12:17:02.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa595400640 1 --2- 172.21.15.114:0/2876629924 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c2580 0x7fa5900aa150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa5840097f0 tx=0x7fa58401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aecb6eeaa09edd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:02.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa594a00640 1 -- 172.21.15.114:0/2876629924 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5840ab600 con 0x7fa5900c2580 2024-02-17T12:17:02.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa594a00640 1 -- 172.21.15.114:0/2876629924 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5840a7050 con 0x7fa5900c2580 2024-02-17T12:17:02.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa594a00640 1 -- 172.21.15.114:0/2876629924 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5840ab980 con 0x7fa5900c2580 2024-02-17T12:17:02.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa598800640 1 -- 172.21.15.114:0/2876629924 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c2580 msgr2=0x7fa5900aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa598800640 1 --2- 172.21.15.114:0/2876629924 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c2580 0x7fa5900aa150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa5840097f0 tx=0x7fa58401c450 comp rx=0 tx=0).stop 2024-02-17T12:17:02.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa598800640 1 -- 172.21.15.114:0/2876629924 shutdown_connections 2024-02-17T12:17:02.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa598800640 1 --2- 172.21.15.114:0/2876629924 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c2580 0x7fa5900aa150 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa598800640 1 -- 172.21.15.114:0/2876629924 >> 172.21.15.114:0/2876629924 conn(0x7fa5900a8490 msgr2=0x7fa5900a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:02.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa598800640 1 -- 172.21.15.114:0/2876629924 shutdown_connections 2024-02-17T12:17:02.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa598800640 1 -- 172.21.15.114:0/2876629924 wait complete. 2024-02-17T12:17:02.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa598800640 1 Processor -- start 2024-02-17T12:17:02.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.694+0000 7fa598800640 1 -- start start 2024-02-17T12:17:02.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa598800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c1eb0 0x7fa59014a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa598800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5900c2580 0x7fa590141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa598800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa59014f110 0x7fa5901420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa598800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901ec850 con 0x7fa5900c2580 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa598800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901ec2e0 con 0x7fa59014f110 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa598800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901ec570 con 0x7fa5900c1eb0 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa595400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5900c2580 0x7fa590141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa595400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5900c2580 0x7fa590141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45734/0 (socket says 172.21.15.114:45734) 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa595400640 1 -- 172.21.15.114:0/581230826 learned_addr learned my addr 172.21.15.114:0/581230826 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa595e00640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c1eb0 0x7fa59014a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa596800640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa59014f110 0x7fa5901420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa595400640 1 -- 172.21.15.114:0/581230826 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c1eb0 msgr2=0x7fa59014a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa595400640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c1eb0 0x7fa59014a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa595400640 1 -- 172.21.15.114:0/581230826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa59014f110 msgr2=0x7fa5901420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa595400640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa59014f110 0x7fa5901420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa595400640 1 -- 172.21.15.114:0/581230826 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa584009420 con 0x7fa5900c2580 2024-02-17T12:17:02.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa595400640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5900c2580 0x7fa590141b70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa5840097f0 tx=0x7fa5840191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:02.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa58a000640 1 -- 172.21.15.114:0/581230826 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5840b4400 con 0x7fa5900c2580 2024-02-17T12:17:02.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa58a000640 1 -- 172.21.15.114:0/581230826 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5840b4560 con 0x7fa5900c2580 2024-02-17T12:17:02.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa58a000640 1 -- 172.21.15.114:0/581230826 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5840b48f0 con 0x7fa5900c2580 2024-02-17T12:17:02.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa598800640 1 -- 172.21.15.114:0/581230826 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5901494f0 con 0x7fa5900c2580 2024-02-17T12:17:02.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa598800640 1 -- 172.21.15.114:0/581230826 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa590149ab0 con 0x7fa5900c2580 2024-02-17T12:17:02.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa598800640 1 -- 172.21.15.114:0/581230826 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa590074840 con 0x7fa5900c2580 2024-02-17T12:17:02.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.698+0000 7fa58a000640 1 -- 172.21.15.114:0/581230826 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa5840b2040 con 0x7fa5900c2580 2024-02-17T12:17:02.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.702+0000 7fa58a000640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa570066e40 0x7fa570069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:02.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.702+0000 7fa58a000640 1 -- 172.21.15.114:0/581230826 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa58411e790 con 0x7fa5900c2580 2024-02-17T12:17:02.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.702+0000 7fa595e00640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa570066e40 0x7fa570069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:02.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.702+0000 7fa595e00640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa570066e40 0x7fa570069300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa57c000f70 tx=0x7fa57c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:02.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.706+0000 7fa58a000640 1 -- 172.21.15.114:0/581230826 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa5840eb8c0 con 0x7fa5900c2580 2024-02-17T12:17:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 -- 172.21.15.114:0/581230826 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa59015d440 con 0x7fa5900c2580 2024-02-17T12:17:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa58a000640 1 -- 172.21.15.114:0/581230826 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12903 (secure 0 0 0) 0x7fa5840eef80 con 0x7fa5900c2580 2024-02-17T12:17:02.868 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:02.868 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:16:59.831048+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:02.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 -- 172.21.15.114:0/581230826 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa570066e40 msgr2=0x7fa570069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa570066e40 0x7fa570069300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa57c000f70 tx=0x7fa57c009040 comp rx=0 tx=0).stop 2024-02-17T12:17:02.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 -- 172.21.15.114:0/581230826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5900c2580 msgr2=0x7fa590141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:02.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5900c2580 0x7fa590141b70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa5840097f0 tx=0x7fa5840191f0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 -- 172.21.15.114:0/581230826 shutdown_connections 2024-02-17T12:17:02.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa59014f110 0x7fa5901420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa570066e40 0x7fa570069300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5900c2580 0x7fa590141b70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 --2- 172.21.15.114:0/581230826 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5900c1eb0 0x7fa59014a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 -- 172.21.15.114:0/581230826 >> 172.21.15.114:0/581230826 conn(0x7fa5900a8490 msgr2=0x7fa5901559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 -- 172.21.15.114:0/581230826 shutdown_connections 2024-02-17T12:17:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:02.862+0000 7fa598800640 1 -- 172.21.15.114:0/581230826 wait complete. 2024-02-17T12:17:02.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:17:02.889 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:17:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2b6600640 1 Processor -- start 2024-02-17T12:17:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2b6600640 1 -- start start 2024-02-17T12:17:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2b6600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2b00c1eb0 0x7fa2b015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2b6600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b00a9420 con 0x7fa2b014f110 2024-02-17T12:17:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2b6600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b0152850 con 0x7fa2b00c2580 2024-02-17T12:17:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2b6600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b014f4f0 con 0x7fa2b00c1eb0 2024-02-17T12:17:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2af400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa2b014f110 0x7fa2b00c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56456/0 (socket says 172.21.15.114:56456) 2024-02-17T12:17:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2af400640 1 -- 172.21.15.114:0/2286073149 learned_addr learned my addr 172.21.15.114:0/2286073149 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910766378 0 0) 0x7fa2b00a9420 con 0x7fa2b014f110 2024-02-17T12:17:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa294005740 con 0x7fa2b014f110 2024-02-17T12:17:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2afe00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2b00c1eb0 0x7fa2b015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 160009767 0 0) 0x7fa294005740 con 0x7fa2b014f110 2024-02-17T12:17:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2b00c1eb0 msgr2=0x7fa2b015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2b00c1eb0 0x7fa2b015d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 >> v1:172.21.15.116:6789/0 conn(0x7fa2b00c2580 legacy=0x7fa2b00aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b00a9670 con 0x7fa2b014f110 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fa2a0001680 con 0x7fa2b014f110 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 >> v1:172.21.15.114:6789/0 conn(0x7fa2b014f110 legacy=0x7fa2b00c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa294005bc0 0x7fa294005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2b00c1eb0 0x7fa2940069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa294006f20 0x7fa2940073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b014f4f0 con 0x7fa294006f20 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29400dcd0 con 0x7fa294005bc0 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29400de90 con 0x7fa2b00c1eb0 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2afe00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa294006f20 0x7fa2940073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2af400640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa294005bc0 0x7fa294005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2a7e00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2b00c1eb0 0x7fa2940069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2afe00640 1 -- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2b00c1eb0 msgr2=0x7fa2940069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2afe00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2b00c1eb0 0x7fa2940069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2afe00640 1 -- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa294005bc0 msgr2=0x7fa294005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2afe00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa294005bc0 0x7fa294005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2afe00640 1 -- 172.21.15.114:0/2286073149 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294005740 con 0x7fa294006f20 2024-02-17T12:17:03.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.022+0000 7fa2a7e00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa2b00c1eb0 0x7fa2940069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2afe00640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa294006f20 0x7fa2940073a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009f90 tx=0x7fa2a801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda0d455bd2884a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80a5b50 con 0x7fa294006f20 2024-02-17T12:17:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a800f040 con 0x7fa294006f20 2024-02-17T12:17:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2aea00640 1 -- 172.21.15.114:0/2286073149 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80ad440 con 0x7fa294006f20 2024-02-17T12:17:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2b6600640 1 -- 172.21.15.114:0/2286073149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa294006f20 msgr2=0x7fa2940073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2b6600640 1 --2- 172.21.15.114:0/2286073149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa294006f20 0x7fa2940073a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009f90 tx=0x7fa2a801cc40 comp rx=0 tx=0).stop 2024-02-17T12:17:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2afe00640 1 -- 172.21.15.114:0/2286073149 reap_dead start 2024-02-17T12:17:03.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2b6600640 1 -- 172.21.15.114:0/2286073149 shutdown_connections 2024-02-17T12:17:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2b6600640 1 -- 172.21.15.114:0/2286073149 >> 172.21.15.114:0/2286073149 conn(0x7fa2b00a8490 msgr2=0x7fa2b00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2b6600640 1 -- 172.21.15.114:0/2286073149 shutdown_connections 2024-02-17T12:17:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.026+0000 7fa2b6600640 1 -- 172.21.15.114:0/2286073149 wait complete. 2024-02-17T12:17:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2b6600640 1 Processor -- start 2024-02-17T12:17:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2b6600640 1 -- start start 2024-02-17T12:17:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2b6600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa294006f20 0x7fa2b0149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2b6600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2b0149220 0x7fa2b01ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2b6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2b0149ff0 0x7fa2b01edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2b6600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0151530 con 0x7fa2b0149ff0 2024-02-17T12:17:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2b6600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b0155800 con 0x7fa2b0149220 2024-02-17T12:17:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2b6600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b01ee720 con 0x7fa294006f20 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2afe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2b0149ff0 0x7fa2b01edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2afe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2b0149ff0 0x7fa2b01edcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45762/0 (socket says 172.21.15.114:45762) 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2afe00640 1 -- 172.21.15.114:0/2768402602 learned_addr learned my addr 172.21.15.114:0/2768402602 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2af400640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa294006f20 0x7fa2b0149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2a7e00640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2b0149220 0x7fa2b01ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2afe00640 1 -- 172.21.15.114:0/2768402602 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa294006f20 msgr2=0x7fa2b0149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2afe00640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa294006f20 0x7fa2b0149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2afe00640 1 -- 172.21.15.114:0/2768402602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2b0149220 msgr2=0x7fa2b01ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2afe00640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2b0149220 0x7fa2b01ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2afe00640 1 -- 172.21.15.114:0/2768402602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b01ee210 con 0x7fa2b0149ff0 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2a7e00640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2b0149220 0x7fa2b01ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2af400640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa294006f20 0x7fa2b0149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2afe00640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2b0149ff0 0x7fa2b01edcd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8002240 tx=0x7fa2a8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2a7400640 1 -- 172.21.15.114:0/2768402602 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80ad650 con 0x7fa2b0149ff0 2024-02-17T12:17:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2a7400640 1 -- 172.21.15.114:0/2768402602 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a80ad7d0 con 0x7fa2b0149ff0 2024-02-17T12:17:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2b6600640 1 -- 172.21.15.114:0/2768402602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b014fff0 con 0x7fa2b0149ff0 2024-02-17T12:17:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2a7400640 1 -- 172.21.15.114:0/2768402602 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80adb80 con 0x7fa2b0149ff0 2024-02-17T12:17:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.030+0000 7fa2b6600640 1 -- 172.21.15.114:0/2768402602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b01ee440 con 0x7fa2b0149ff0 2024-02-17T12:17:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.034+0000 7fa2b6600640 1 -- 172.21.15.114:0/2768402602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b0155970 con 0x7fa2b0149ff0 2024-02-17T12:17:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.034+0000 7fa2a7400640 1 -- 172.21.15.114:0/2768402602 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa2a80b4040 con 0x7fa2b0149ff0 2024-02-17T12:17:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.034+0000 7fa2a7400640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa28c066e40 0x7fa28c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.034+0000 7fa2a7400640 1 -- 172.21.15.114:0/2768402602 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa2a811ebd0 con 0x7fa2b0149ff0 2024-02-17T12:17:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.034+0000 7fa2af400640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa28c066e40 0x7fa28c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.034+0000 7fa2af400640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa28c066e40 0x7fa28c069300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0001ca0 tx=0x7fa2a00047f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:03.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.038+0000 7fa2a7400640 1 -- 172.21.15.114:0/2768402602 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa2a80ebbe0 con 0x7fa2b0149ff0 2024-02-17T12:17:03.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.190+0000 7fa2b6600640 1 -- 172.21.15.114:0/2768402602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2b0155970 con 0x7fa2b0149ff0 2024-02-17T12:17:03.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2a7400640 1 -- 172.21.15.114:0/2768402602 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2a80b2070 con 0x7fa2b0149ff0 2024-02-17T12:17:03.199 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:17:03.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 -- 172.21.15.114:0/2768402602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa28c066e40 msgr2=0x7fa28c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa28c066e40 0x7fa28c069300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0001ca0 tx=0x7fa2a00047f0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 -- 172.21.15.114:0/2768402602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2b0149ff0 msgr2=0x7fa2b01edcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2b0149ff0 0x7fa2b01edcd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8002240 tx=0x7fa2a8009750 comp rx=0 tx=0).stop 2024-02-17T12:17:03.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 -- 172.21.15.114:0/2768402602 shutdown_connections 2024-02-17T12:17:03.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa28c066e40 0x7fa28c069300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2b0149ff0 0x7fa2b01edcd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2b0149220 0x7fa2b01ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 --2- 172.21.15.114:0/2768402602 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa294006f20 0x7fa2b0149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 -- 172.21.15.114:0/2768402602 >> 172.21.15.114:0/2768402602 conn(0x7fa2b00a8490 msgr2=0x7fa2b00c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 -- 172.21.15.114:0/2768402602 shutdown_connections 2024-02-17T12:17:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.194+0000 7fa2b6600640 1 -- 172.21.15.114:0/2768402602 wait complete. 2024-02-17T12:17:03.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T12:17:03.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1449800640 1 Processor -- start 2024-02-17T12:17:03.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1449800640 1 -- start start 2024-02-17T12:17:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1449800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f144406ff80 0x7f14440aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1449800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1444155dd0 con 0x7f1444152540 2024-02-17T12:17:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1449800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14441588c0 con 0x7f14440c6460 2024-02-17T12:17:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1449800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14440703d0 con 0x7f144406ff80 2024-02-17T12:17:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1442a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1444152540 0x7f1444158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56468/0 (socket says 172.21.15.114:56468) 2024-02-17T12:17:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1442a00640 1 -- 172.21.15.114:0/2483387702 learned_addr learned my addr 172.21.15.114:0/2483387702 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:03.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1443400640 1 --2- 172.21.15.114:0/2483387702 >> v2:172.21.15.114:3300/0 conn(0x7f144406ff80 0x7f14440aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1441600640 1 -- 172.21.15.114:0/2483387702 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727437353 0 0) 0x7f1444155dd0 con 0x7f1444152540 2024-02-17T12:17:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1441600640 1 -- 172.21.15.114:0/2483387702 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1428003530 con 0x7f1444152540 2024-02-17T12:17:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1443400640 1 -- 172.21.15.114:0/2483387702 >> v1:172.21.15.116:6789/0 conn(0x7f14440c6460 legacy=0x7f1444154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1443400640 1 -- 172.21.15.114:0/2483387702 >> v1:172.21.15.114:6789/0 conn(0x7f1444152540 legacy=0x7f1444158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.350+0000 7f1443400640 1 -- 172.21.15.114:0/2483387702 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1444155540 con 0x7f144406ff80 2024-02-17T12:17:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1443400640 1 --2- 172.21.15.114:0/2483387702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f144406ff80 0x7f14440aa160 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f143c009d90 tx=0x7f143c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1aea65b9bab67d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1441600640 1 -- 172.21.15.114:0/2483387702 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c0a5820 con 0x7f144406ff80 2024-02-17T12:17:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1441600640 1 -- 172.21.15.114:0/2483387702 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c0a5980 con 0x7f144406ff80 2024-02-17T12:17:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1441600640 1 -- 172.21.15.114:0/2483387702 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c0a5d10 con 0x7f144406ff80 2024-02-17T12:17:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1449800640 1 -- 172.21.15.114:0/2483387702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f144406ff80 msgr2=0x7f14440aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1449800640 1 --2- 172.21.15.114:0/2483387702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f144406ff80 0x7f14440aa160 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f143c009d90 tx=0x7f143c01c850 comp rx=0 tx=0).stop 2024-02-17T12:17:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1449800640 1 -- 172.21.15.114:0/2483387702 shutdown_connections 2024-02-17T12:17:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1449800640 1 --2- 172.21.15.114:0/2483387702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f144406ff80 0x7f14440aa160 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1449800640 1 -- 172.21.15.114:0/2483387702 >> 172.21.15.114:0/2483387702 conn(0x7f14440c4f20 msgr2=0x7f14440c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1449800640 1 -- 172.21.15.114:0/2483387702 shutdown_connections 2024-02-17T12:17:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.354+0000 7f1449800640 1 -- 172.21.15.114:0/2483387702 wait complete. 2024-02-17T12:17:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 Processor -- start 2024-02-17T12:17:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 -- start start 2024-02-17T12:17:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f144406ff80 0x7f14440ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14440c6460 0x7f14440aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1444152540 0x7f1444153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14440ac520 con 0x7f14440c6460 2024-02-17T12:17:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1444153100 con 0x7f144406ff80 2024-02-17T12:17:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14441572e0 con 0x7f1444152540 2024-02-17T12:17:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1442000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14440c6460 0x7f14440aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1442000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14440c6460 0x7f14440aba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45786/0 (socket says 172.21.15.114:45786) 2024-02-17T12:17:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1442000640 1 -- 172.21.15.114:0/2467114996 learned_addr learned my addr 172.21.15.114:0/2467114996 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1443400640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1444152540 0x7f1444153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1442a00640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f144406ff80 0x7f14440ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1442000640 1 -- 172.21.15.114:0/2467114996 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1444152540 msgr2=0x7f1444153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1442000640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1444152540 0x7f1444153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1442000640 1 -- 172.21.15.114:0/2467114996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f144406ff80 msgr2=0x7f14440ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1442000640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f144406ff80 0x7f14440ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1442000640 1 -- 172.21.15.114:0/2467114996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c009a70 con 0x7f14440c6460 2024-02-17T12:17:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1442000640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14440c6460 0x7f14440aba10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f143400c450 tx=0x7f143400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f143aa00640 1 -- 172.21.15.114:0/2467114996 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14340052d0 con 0x7f14440c6460 2024-02-17T12:17:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f143aa00640 1 -- 172.21.15.114:0/2467114996 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1434005430 con 0x7f14440c6460 2024-02-17T12:17:03.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f143aa00640 1 -- 172.21.15.114:0/2467114996 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434007260 con 0x7f14440c6460 2024-02-17T12:17:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 -- 172.21.15.114:0/2467114996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1444146930 con 0x7f14440c6460 2024-02-17T12:17:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 -- 172.21.15.114:0/2467114996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14441551d0 con 0x7f14440c6460 2024-02-17T12:17:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.358+0000 7f1449800640 1 -- 172.21.15.114:0/2467114996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1444154d50 con 0x7f14440c6460 2024-02-17T12:17:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.362+0000 7f143aa00640 1 -- 172.21.15.114:0/2467114996 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f14340073c0 con 0x7f14440c6460 2024-02-17T12:17:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.362+0000 7f143aa00640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1420066e40 0x7f1420069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.362+0000 7f143aa00640 1 -- 172.21.15.114:0/2467114996 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1434083e40 con 0x7f14440c6460 2024-02-17T12:17:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.362+0000 7f1442a00640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1420066e40 0x7f1420069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.362+0000 7f1442a00640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1420066e40 0x7f1420069300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f142c0011f0 tx=0x7f142c007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:03.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.366+0000 7f143aa00640 1 -- 172.21.15.114:0/2467114996 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1444154d50 con 0x7f14440c6460 2024-02-17T12:17:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.518+0000 7f1449800640 1 -- 172.21.15.114:0/2467114996 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f14441532b0 con 0x7f14440c6460 2024-02-17T12:17:03.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.518+0000 7f143aa00640 1 -- 172.21.15.114:0/2467114996 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f14441532b0 con 0x7f14440c6460 2024-02-17T12:17:03.527 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:03.527 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-02-17T12:17:03.527 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:03.527 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-02-17T12:17:03.527 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-02-17T12:17:03.527 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:03.527 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 -- 172.21.15.114:0/2467114996 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1420066e40 msgr2=0x7f1420069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1420066e40 0x7f1420069300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f142c0011f0 tx=0x7f142c007d40 comp rx=0 tx=0).stop 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 -- 172.21.15.114:0/2467114996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14440c6460 msgr2=0x7f14440aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14440c6460 0x7f14440aba10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f143400c450 tx=0x7f143400c910 comp rx=0 tx=0).stop 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 -- 172.21.15.114:0/2467114996 shutdown_connections 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1444152540 0x7f1444153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1420066e40 0x7f1420069300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14440c6460 0x7f14440aba10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 --2- 172.21.15.114:0/2467114996 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f144406ff80 0x7f14440ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 -- 172.21.15.114:0/2467114996 >> 172.21.15.114:0/2467114996 conn(0x7f14440c4f20 msgr2=0x7f1444158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 -- 172.21.15.114:0/2467114996 shutdown_connections 2024-02-17T12:17:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.522+0000 7f1449800640 1 -- 172.21.15.114:0/2467114996 wait complete. 2024-02-17T12:17:03.548 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-17T12:17:03.548 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-17T12:17:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.678+0000 7f61a8000640 1 Processor -- start 2024-02-17T12:17:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.678+0000 7f61a8000640 1 -- start start 2024-02-17T12:17:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a8000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f61a00a7dd0 0x7f61a00c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a8000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a00c2530 0x7f61a00c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a8000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a00c2e00 con 0x7f61a014f310 2024-02-17T12:17:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a8000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a00a6980 con 0x7f61a00a7dd0 2024-02-17T12:17:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a8000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00c30e0 con 0x7f61a00c2530 2024-02-17T12:17:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a4c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f61a00a7dd0 0x7f61a00c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a6000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a00c2530 0x7f61a00c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a4c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f61a00a7dd0 0x7f61a00c1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:41292/0 (socket says 172.21.15.114:41292) 2024-02-17T12:17:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a4c00640 1 -- 172.21.15.114:0/2977346210 learned_addr learned my addr 172.21.15.114:0/2977346210 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f619fe00640 1 -- 172.21.15.114:0/2977346210 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733252633 0 0) 0x7f61a00c2e00 con 0x7f61a014f310 2024-02-17T12:17:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a4c00640 1 -- 172.21.15.114:0/2977346210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a00c2530 msgr2=0x7f61a00c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a4c00640 1 --2- 172.21.15.114:0/2977346210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a00c2530 0x7f61a00c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a4c00640 1 -- 172.21.15.114:0/2977346210 >> v1:172.21.15.116:6789/0 conn(0x7f61a014f310 legacy=0x7f61a01524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.682+0000 7f61a4c00640 1 -- 172.21.15.114:0/2977346210 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a014f6f0 con 0x7f61a00a7dd0 2024-02-17T12:17:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a4c00640 1 --2- 172.21.15.114:0/2977346210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61a00a7dd0 0x7f61a00c1ff0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f618c009870 tx=0x7f618c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=929ac5a193e1271b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:03.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f619fe00640 1 -- 172.21.15.114:0/2977346210 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0ab650 con 0x7f61a00a7dd0 2024-02-17T12:17:03.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f619fe00640 1 -- 172.21.15.114:0/2977346210 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c0ab7b0 con 0x7f61a00a7dd0 2024-02-17T12:17:03.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f619fe00640 1 -- 172.21.15.114:0/2977346210 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0abb40 con 0x7f61a00a7dd0 2024-02-17T12:17:03.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a8000640 1 -- 172.21.15.114:0/2977346210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61a00a7dd0 msgr2=0x7f61a00c1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a8000640 1 --2- 172.21.15.114:0/2977346210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61a00a7dd0 0x7f61a00c1ff0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f618c009870 tx=0x7f618c01c560 comp rx=0 tx=0).stop 2024-02-17T12:17:03.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a8000640 1 -- 172.21.15.114:0/2977346210 shutdown_connections 2024-02-17T12:17:03.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a8000640 1 --2- 172.21.15.114:0/2977346210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a00c2530 0x7f61a00c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a8000640 1 --2- 172.21.15.114:0/2977346210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61a00a7dd0 0x7f61a00c1ff0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a8000640 1 -- 172.21.15.114:0/2977346210 >> 172.21.15.114:0/2977346210 conn(0x7f61a006b210 msgr2=0x7f61a006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:03.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a8000640 1 -- 172.21.15.114:0/2977346210 shutdown_connections 2024-02-17T12:17:03.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a8000640 1 -- 172.21.15.114:0/2977346210 wait complete. 2024-02-17T12:17:03.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a8000640 1 Processor -- start 2024-02-17T12:17:03.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.686+0000 7f61a8000640 1 -- start start 2024-02-17T12:17:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a8000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61a00a7dd0 0x7f61a013a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a8000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00c2530 0x7f61a01433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a8000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a014f310 0x7f61a01eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a8000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a015f750 con 0x7f61a00c2530 2024-02-17T12:17:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a8000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a01f0df0 con 0x7f61a00a7dd0 2024-02-17T12:17:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a8000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a01f1690 con 0x7f61a014f310 2024-02-17T12:17:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00c2530 0x7f61a01433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00c2530 0x7f61a01433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45790/0 (socket says 172.21.15.114:45790) 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a4c00640 1 -- 172.21.15.114:0/4255351627 learned_addr learned my addr 172.21.15.114:0/4255351627 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a5600640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61a00a7dd0 0x7f61a013a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a6000640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a014f310 0x7f61a01eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a4c00640 1 -- 172.21.15.114:0/4255351627 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a014f310 msgr2=0x7f61a01eecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a4c00640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a014f310 0x7f61a01eecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a4c00640 1 -- 172.21.15.114:0/4255351627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61a00a7dd0 msgr2=0x7f61a013a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a4c00640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61a00a7dd0 0x7f61a013a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a4c00640 1 -- 172.21.15.114:0/4255351627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0094d0 con 0x7f61a00c2530 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a6000640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a014f310 0x7f61a01eecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a4c00640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00c2530 0x7f61a01433d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f618c0ad040 tx=0x7f618c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f619d600640 1 -- 172.21.15.114:0/4255351627 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0b4800 con 0x7f61a00c2530 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f619d600640 1 -- 172.21.15.114:0/4255351627 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c0b4960 con 0x7f61a00c2530 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f619d600640 1 -- 172.21.15.114:0/4255351627 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0b4d10 con 0x7f61a00c2530 2024-02-17T12:17:03.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a8000640 1 -- 172.21.15.114:0/4255351627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a013a670 con 0x7f61a00c2530 2024-02-17T12:17:03.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a8000640 1 -- 172.21.15.114:0/4255351627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a01f1040 con 0x7f61a00c2530 2024-02-17T12:17:03.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f61a8000640 1 -- 172.21.15.114:0/4255351627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a006e5e0 con 0x7f61a00c2530 2024-02-17T12:17:03.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.690+0000 7f619d600640 1 -- 172.21.15.114:0/4255351627 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f618c0c7440 con 0x7f61a00c2530 2024-02-17T12:17:03.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.694+0000 7f619d600640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6180066e40 0x7f6180069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:03.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.694+0000 7f619d600640 1 -- 172.21.15.114:0/4255351627 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f618c11f390 con 0x7f61a00c2530 2024-02-17T12:17:03.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.694+0000 7f61a5600640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6180066e40 0x7f6180069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:03.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.694+0000 7f61a5600640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6180066e40 0x7f6180069300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f61940012f0 tx=0x7f6194009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:03.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.698+0000 7f619d600640 1 -- 172.21.15.114:0/4255351627 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f618c0ec570 con 0x7f61a00c2530 2024-02-17T12:17:03.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.850+0000 7f61a8000640 1 -- 172.21.15.114:0/4255351627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f61a0074840 con 0x7f61a00c2530 2024-02-17T12:17:04.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:03.998+0000 7f619d600640 1 -- 172.21.15.114:0/4255351627 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f618c0efc30 con 0x7f61a00c2530 2024-02-17T12:17:04.006 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-02-17T12:17:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 -- 172.21.15.114:0/4255351627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6180066e40 msgr2=0x7f6180069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6180066e40 0x7f6180069300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f61940012f0 tx=0x7f6194009040 comp rx=0 tx=0).stop 2024-02-17T12:17:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 -- 172.21.15.114:0/4255351627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00c2530 msgr2=0x7f61a01433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00c2530 0x7f61a01433d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f618c0ad040 tx=0x7f618c01ada0 comp rx=0 tx=0).stop 2024-02-17T12:17:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 -- 172.21.15.114:0/4255351627 shutdown_connections 2024-02-17T12:17:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61a014f310 0x7f61a01eecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6180066e40 0x7f6180069300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00c2530 0x7f61a01433d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 --2- 172.21.15.114:0/4255351627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61a00a7dd0 0x7f61a013a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 -- 172.21.15.114:0/4255351627 >> 172.21.15.114:0/4255351627 conn(0x7f61a006b210 msgr2=0x7f61a014a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 -- 172.21.15.114:0/4255351627 shutdown_connections 2024-02-17T12:17:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.002+0000 7f61a8000640 1 -- 172.21.15.114:0/4255351627 wait complete. 2024-02-17T12:17:04.033 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T12:17:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb2b800640 1 Processor -- start 2024-02-17T12:17:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb2b800640 1 -- start start 2024-02-17T12:17:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb2406db50 0x7fbb2414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb2b800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb24156270 con 0x7fbb240c25a0 2024-02-17T12:17:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb2b800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb24156550 con 0x7fbb24150490 2024-02-17T12:17:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb2b800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2406f090 con 0x7fbb2406db50 2024-02-17T12:17:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb28e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbb240c25a0 0x7fbb2406e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56478/0 (socket says 172.21.15.114:56478) 2024-02-17T12:17:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb28e00640 1 -- 172.21.15.114:0/1910406518 learned_addr learned my addr 172.21.15.114:0/1910406518 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23e00640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb2406db50 0x7fbb2414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391020066 0 0) 0x7fbb24156270 con 0x7fbb240c25a0 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb08003530 con 0x7fbb240c25a0 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4271393827 0 0) 0x7fbb08003530 con 0x7fbb240c25a0 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb2406db50 msgr2=0x7fbb2414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb2406db50 0x7fbb2414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 >> v1:172.21.15.116:6789/0 conn(0x7fbb24150490 legacy=0x7fbb24152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb24156830 con 0x7fbb240c25a0 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fbb14001a00 con 0x7fbb240c25a0 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 >> v1:172.21.15.114:6789/0 conn(0x7fbb240c25a0 legacy=0x7fbb2406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 0x7fbb08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb2406db50 0x7fbb080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb08004d10 0x7fbb08005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2406f090 con 0x7fbb080039b0 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0800bb50 con 0x7fbb08004d10 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0800bd10 con 0x7fbb2406db50 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb28e00640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 0x7fbb08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23e00640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb2406db50 0x7fbb080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb29800640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb08004d10 0x7fbb08005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb28e00640 1 -- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb2406db50 msgr2=0x7fbb080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb28e00640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb2406db50 0x7fbb080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb28e00640 1 -- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb08004d10 msgr2=0x7fbb08005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb28e00640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb08004d10 0x7fbb08005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:04.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb28e00640 1 -- 172.21.15.114:0/1910406518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08003530 con 0x7fbb080039b0 2024-02-17T12:17:04.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.170+0000 7fbb23e00640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb2406db50 0x7fbb080047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb28e00640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 0x7fbb08003dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400a820 tx=0x7fbb1401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8b387a082790e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb140072d0 con 0x7fbb080039b0 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb140a8070 con 0x7fbb080039b0 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb23400640 1 -- 172.21.15.114:0/1910406518 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14007690 con 0x7fbb080039b0 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb2b800640 1 -- 172.21.15.114:0/1910406518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 msgr2=0x7fbb08003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb2b800640 1 --2- 172.21.15.114:0/1910406518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 0x7fbb08003dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400a820 tx=0x7fbb1401d340 comp rx=0 tx=0).stop 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb29800640 1 -- 172.21.15.114:0/1910406518 reap_dead start 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb2b800640 1 -- 172.21.15.114:0/1910406518 shutdown_connections 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb2b800640 1 -- 172.21.15.114:0/1910406518 >> 172.21.15.114:0/1910406518 conn(0x7fbb240a8490 msgr2=0x7fbb240a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb2b800640 1 -- 172.21.15.114:0/1910406518 shutdown_connections 2024-02-17T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.174+0000 7fbb2b800640 1 -- 172.21.15.114:0/1910406518 wait complete. 2024-02-17T12:17:04.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb2b800640 1 Processor -- start 2024-02-17T12:17:04.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb2b800640 1 -- start start 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 0x7fbb2415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb24146890 0x7fbb24072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb24143e40 0x7fbb241ef1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb2b800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2414dc80 con 0x7fbb080039b0 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb2b800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb241436d0 con 0x7fbb24143e40 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb2b800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb241439b0 con 0x7fbb24146890 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb28e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 0x7fbb2415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb28e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 0x7fbb2415b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45800/0 (socket says 172.21.15.114:45800) 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb28e00640 1 -- 172.21.15.114:0/574761740 learned_addr learned my addr 172.21.15.114:0/574761740 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb23e00640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb24146890 0x7fbb24072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb29800640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb24143e40 0x7fbb241ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:04.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb28e00640 1 -- 172.21.15.114:0/574761740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb24146890 msgr2=0x7fbb24072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb28e00640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb24146890 0x7fbb24072450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb28e00640 1 -- 172.21.15.114:0/574761740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb24143e40 msgr2=0x7fbb241ef1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb28e00640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb24143e40 0x7fbb241ef1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb28e00640 1 -- 172.21.15.114:0/574761740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb24145d60 con 0x7fbb080039b0 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb29800640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb24143e40 0x7fbb241ef1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb28e00640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 0x7fbb2415b4c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbb14001cc0 tx=0x7fbb08005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb20c00640 1 -- 172.21.15.114:0/574761740 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb140bb070 con 0x7fbb080039b0 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb20c00640 1 -- 172.21.15.114:0/574761740 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb14004c30 con 0x7fbb080039b0 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb20c00640 1 -- 172.21.15.114:0/574761740 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14004dc0 con 0x7fbb080039b0 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb2b800640 1 -- 172.21.15.114:0/574761740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb24146000 con 0x7fbb080039b0 2024-02-17T12:17:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.178+0000 7fbb2b800640 1 -- 172.21.15.114:0/574761740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb24072990 con 0x7fbb080039b0 2024-02-17T12:17:04.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.182+0000 7fbb2b800640 1 -- 172.21.15.114:0/574761740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb24074840 con 0x7fbb080039b0 2024-02-17T12:17:04.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.182+0000 7fbb20c00640 1 -- 172.21.15.114:0/574761740 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbb140aa030 con 0x7fbb080039b0 2024-02-17T12:17:04.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.182+0000 7fbb20c00640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb04066e70 0x7fbb04069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:04.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.182+0000 7fbb20c00640 1 -- 172.21.15.114:0/574761740 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fbb1411eff0 con 0x7fbb080039b0 2024-02-17T12:17:04.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.182+0000 7fbb23e00640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb04066e70 0x7fbb04069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:04.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.182+0000 7fbb23e00640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb04066e70 0x7fbb04069330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbb241ecda0 tx=0x7fbb10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:04.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.186+0000 7fbb20c00640 1 -- 172.21.15.114:0/574761740 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb140ec000 con 0x7fbb080039b0 2024-02-17T12:17:04.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:04.342+0000 7fbb2b800640 1 -- 172.21.15.114:0/574761740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbb2414d590 con 0x7fbb080039b0 2024-02-17T12:17:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.002+0000 7fbb20c00640 1 -- 172.21.15.114:0/574761740 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbb140ef6c0 con 0x7fbb080039b0 2024-02-17T12:17:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-02-17T12:17:05.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 -- 172.21.15.114:0/574761740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb04066e70 msgr2=0x7fbb04069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:05.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb04066e70 0x7fbb04069330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbb241ecda0 tx=0x7fbb10008040 comp rx=0 tx=0).stop 2024-02-17T12:17:05.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 -- 172.21.15.114:0/574761740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 msgr2=0x7fbb2415b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 0x7fbb2415b4c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbb14001cc0 tx=0x7fbb08005800 comp rx=0 tx=0).stop 2024-02-17T12:17:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 -- 172.21.15.114:0/574761740 shutdown_connections 2024-02-17T12:17:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb24143e40 0x7fbb241ef1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb24146890 0x7fbb24072450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb04066e70 0x7fbb04069330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 --2- 172.21.15.114:0/574761740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb080039b0 0x7fbb2415b4c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 -- 172.21.15.114:0/574761740 >> 172.21.15.114:0/574761740 conn(0x7fbb240a8490 msgr2=0x7fbb2406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 -- 172.21.15.114:0/574761740 shutdown_connections 2024-02-17T12:17:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.006+0000 7fbb2b800640 1 -- 172.21.15.114:0/574761740 wait complete. 2024-02-17T12:17:05.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-17T12:17:05.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6d01200640 1 Processor -- start 2024-02-17T12:17:05.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6d01200640 1 -- start start 2024-02-17T12:17:05.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6d01200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6cfc156d30 0x7f6cfc153440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:05.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6d01200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc0c3580 con 0x7f6cfc150300 2024-02-17T12:17:05.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6d01200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc0c2fc0 con 0x7f6cfc0714c0 2024-02-17T12:17:05.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6d01200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c6900 con 0x7f6cfc156d30 2024-02-17T12:17:05.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf9e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6cfc150300 0x7f6cfc0aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50742/0 (socket says 172.21.15.114:50742) 2024-02-17T12:17:05.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf9e00640 1 -- 172.21.15.114:0/3783799873 learned_addr learned my addr 172.21.15.114:0/3783799873 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cfa800640 1 --2- 172.21.15.114:0/3783799873 >> v2:172.21.15.116:3300/0 conn(0x7f6cfc156d30 0x7f6cfc153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502012957 0 0) 0x7f6cfc0c3580 con 0x7f6cfc150300 2024-02-17T12:17:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ce0003530 con 0x7f6cfc150300 2024-02-17T12:17:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3273010030 0 0) 0x7f6ce0003530 con 0x7f6cfc150300 2024-02-17T12:17:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 >> v2:172.21.15.116:3300/0 conn(0x7f6cfc156d30 msgr2=0x7f6cfc153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf8a00640 1 --2- 172.21.15.114:0/3783799873 >> v2:172.21.15.116:3300/0 conn(0x7f6cfc156d30 0x7f6cfc153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 >> v1:172.21.15.116:6789/0 conn(0x7f6cfc0714c0 legacy=0x7f6cfc152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc0c32a0 con 0x7f6cfc150300 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f6cec001680 con 0x7f6cfc150300 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cfa800640 1 --2- 172.21.15.114:0/3783799873 >> v2:172.21.15.116:3300/0 conn(0x7f6cfc156d30 0x7f6cfc153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.186+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 >> v1:172.21.15.114:6789/0 conn(0x7f6cfc150300 legacy=0x7f6cfc0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf8a00640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ce0003980 0x7f6ce0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf8a00640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce00047d0 0x7f6ce0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf8a00640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6ce000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c6900 con 0x7f6ce0005190 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce000c130 con 0x7f6ce00047d0 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce000c2f0 con 0x7f6ce0003980 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cfa800640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6ce000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf9e00640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ce0003980 0x7f6ce0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf9400640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce00047d0 0x7f6ce0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cfa800640 1 -- 172.21.15.114:0/3783799873 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ce0003980 msgr2=0x7f6ce0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:05.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cfa800640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ce0003980 0x7f6ce0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:05.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cfa800640 1 -- 172.21.15.114:0/3783799873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce00047d0 msgr2=0x7f6ce0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:05.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cfa800640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce00047d0 0x7f6ce0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:05.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cfa800640 1 -- 172.21.15.114:0/3783799873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce0003530 con 0x7f6ce0005190 2024-02-17T12:17:05.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf9400640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce00047d0 0x7f6ce0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:05.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cfa800640 1 -- 172.21.15.114:0/3783799873 reap_dead start 2024-02-17T12:17:05.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cfa800640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6ce000b990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400e350 tx=0x7f6cf401ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54c7b15cb1b41a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:05.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf40a5d90 con 0x7f6ce0005190 2024-02-17T12:17:05.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf400f040 con 0x7f6ce0005190 2024-02-17T12:17:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.190+0000 7f6cf8a00640 1 -- 172.21.15.114:0/3783799873 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf40ad680 con 0x7f6ce0005190 2024-02-17T12:17:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 -- 172.21.15.114:0/3783799873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 msgr2=0x7f6ce000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6ce000b990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400e350 tx=0x7f6cf401ce80 comp rx=0 tx=0).stop 2024-02-17T12:17:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 -- 172.21.15.114:0/3783799873 shutdown_connections 2024-02-17T12:17:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 --2- 172.21.15.114:0/3783799873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6ce000b990 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 -- 172.21.15.114:0/3783799873 >> 172.21.15.114:0/3783799873 conn(0x7f6cfc0c4f20 msgr2=0x7f6cfc0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 -- 172.21.15.114:0/3783799873 shutdown_connections 2024-02-17T12:17:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 -- 172.21.15.114:0/3783799873 wait complete. 2024-02-17T12:17:05.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 Processor -- start 2024-02-17T12:17:05.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 -- start start 2024-02-17T12:17:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6cfc154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cfc1ec020 0x7f6cfc151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6cfc14ab50 0x7f6cfc146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc155140 con 0x7f6ce0005190 2024-02-17T12:17:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc1558a0 con 0x7f6cfc1ec020 2024-02-17T12:17:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6d01200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc155b80 con 0x7f6cfc14ab50 2024-02-17T12:17:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cf9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6cfc154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cf9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6cfc154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42562/0 (socket says 172.21.15.114:42562) 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cf9e00640 1 -- 172.21.15.114:0/2140158256 learned_addr learned my addr 172.21.15.114:0/2140158256 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cf9400640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cfc1ec020 0x7f6cfc151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cfa800640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6cfc14ab50 0x7f6cfc146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cf9e00640 1 -- 172.21.15.114:0/2140158256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6cfc14ab50 msgr2=0x7f6cfc146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cf9e00640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6cfc14ab50 0x7f6cfc146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cf9e00640 1 -- 172.21.15.114:0/2140158256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cfc1ec020 msgr2=0x7f6cfc151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cf9e00640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cfc1ec020 0x7f6cfc151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cf9e00640 1 -- 172.21.15.114:0/2140158256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc154120 con 0x7f6ce0005190 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.194+0000 7f6cf9400640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cfc1ec020 0x7f6cfc151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6cf9e00640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6cfc154c00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0124c0 tx=0x7f6cec012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6cf2000640 1 -- 172.21.15.114:0/2140158256 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec014810 con 0x7f6ce0005190 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6cf2000640 1 -- 172.21.15.114:0/2140158256 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec014990 con 0x7f6ce0005190 2024-02-17T12:17:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6d01200640 1 -- 172.21.15.114:0/2140158256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc154400 con 0x7f6ce0005190 2024-02-17T12:17:05.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6cf2000640 1 -- 172.21.15.114:0/2140158256 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec014d40 con 0x7f6ce0005190 2024-02-17T12:17:05.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6d01200640 1 -- 172.21.15.114:0/2140158256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cfc153cc0 con 0x7f6ce0005190 2024-02-17T12:17:05.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6d01200640 1 -- 172.21.15.114:0/2140158256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cfc074840 con 0x7f6ce0005190 2024-02-17T12:17:05.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6cf2000640 1 -- 172.21.15.114:0/2140158256 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6cec0153e0 con 0x7f6ce0005190 2024-02-17T12:17:05.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6cf2000640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6cdc066e40 0x7f6cdc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:05.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6cf2000640 1 -- 172.21.15.114:0/2140158256 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6cec0878a0 con 0x7f6ce0005190 2024-02-17T12:17:05.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.198+0000 7f6cf9400640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6cdc066e40 0x7f6cdc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:05.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.202+0000 7f6cf9400640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6cdc066e40 0x7f6cdc069300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8000c10 tx=0x7f6ce8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:05.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.202+0000 7f6cf2000640 1 -- 172.21.15.114:0/2140158256 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6cec0546e0 con 0x7f6ce0005190 2024-02-17T12:17:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:05.390+0000 7f6d01200640 1 -- 172.21.15.114:0/2140158256 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6cfc0c2970 con 0x7f6ce0005190 2024-02-17T12:17:06.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.034+0000 7f6cf2000640 1 -- 172.21.15.114:0/2140158256 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6cec01c070 con 0x7f6ce0005190 2024-02-17T12:17:06.047 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 4 and data pool 5 2024-02-17T12:17:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.050+0000 7f6d01200640 1 -- 172.21.15.114:0/2140158256 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6cdc066e40 msgr2=0x7f6cdc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.050+0000 7f6d01200640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6cdc066e40 0x7f6cdc069300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8000c10 tx=0x7f6ce8009040 comp rx=0 tx=0).stop 2024-02-17T12:17:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.050+0000 7f6d01200640 1 -- 172.21.15.114:0/2140158256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 msgr2=0x7f6cfc154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.050+0000 7f6d01200640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6cfc154c00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0124c0 tx=0x7f6cec012980 comp rx=0 tx=0).stop 2024-02-17T12:17:06.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.054+0000 7f6d01200640 1 -- 172.21.15.114:0/2140158256 shutdown_connections 2024-02-17T12:17:06.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.054+0000 7f6d01200640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6cfc14ab50 0x7f6cfc146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.054+0000 7f6d01200640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cfc1ec020 0x7f6cfc151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.054+0000 7f6d01200640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6cdc066e40 0x7f6cdc069300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.054+0000 7f6d01200640 1 --2- 172.21.15.114:0/2140158256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce0005190 0x7f6cfc154c00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.054+0000 7f6d01200640 1 -- 172.21.15.114:0/2140158256 >> 172.21.15.114:0/2140158256 conn(0x7f6cfc0c4f20 msgr2=0x7f6cfc0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:06.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.054+0000 7f6d01200640 1 -- 172.21.15.114:0/2140158256 shutdown_connections 2024-02-17T12:17:06.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.054+0000 7f6d01200640 1 -- 172.21.15.114:0/2140158256 wait complete. 2024-02-17T12:17:06.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4d1e00640 1 Processor -- start 2024-02-17T12:17:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4d1e00640 1 -- start start 2024-02-17T12:17:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4d1e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc150300 0x7fe4cc156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4d1e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe4cc0714c0 0x7fe4cc0aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4d1e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc157270 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4d1e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc0c6900 con 0x7fe4cc0714c0 2024-02-17T12:17:06.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4d1e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0c3580 con 0x7fe4cc150300 2024-02-17T12:17:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4caa00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc150300 0x7fe4cc156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4ca000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe4cc0714c0 0x7fe4cc0aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4cb400640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe4cc0aa6a0 0x7fe4cc152d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:50504/0 (socket says 172.21.15.114:50504) 2024-02-17T12:17:06.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4cb400640 1 -- 172.21.15.114:0/673751928 learned_addr learned my addr 172.21.15.114:0/673751928 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4c9600640 1 -- 172.21.15.114:0/673751928 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233964228 0 0) 0x7fe4cc157270 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4c9600640 1 -- 172.21.15.114:0/673751928 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b0003530 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4ca000640 1 -- 172.21.15.114:0/673751928 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc150300 msgr2=0x7fe4cc156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4ca000640 1 --2- 172.21.15.114:0/673751928 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc150300 0x7fe4cc156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4ca000640 1 -- 172.21.15.114:0/673751928 >> v1:172.21.15.116:6789/0 conn(0x7fe4cc0aa6a0 legacy=0x7fe4cc152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4ca000640 1 -- 172.21.15.114:0/673751928 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0c2fc0 con 0x7fe4cc0714c0 2024-02-17T12:17:06.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.222+0000 7fe4caa00640 1 --2- 172.21.15.114:0/673751928 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc150300 0x7fe4cc156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:06.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4ca000640 1 --2- 172.21.15.114:0/673751928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4cc0714c0 0x7fe4cc0aa160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40097c0 tx=0x7fe4b401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a9f6121a0c78b53 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:06.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4c9600640 1 -- 172.21.15.114:0/673751928 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40ab600 con 0x7fe4cc0714c0 2024-02-17T12:17:06.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4c9600640 1 -- 172.21.15.114:0/673751928 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b40a7050 con 0x7fe4cc0714c0 2024-02-17T12:17:06.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4c9600640 1 -- 172.21.15.114:0/673751928 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40ab980 con 0x7fe4cc0714c0 2024-02-17T12:17:06.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4d1e00640 1 -- 172.21.15.114:0/673751928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4cc0714c0 msgr2=0x7fe4cc0aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/673751928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4cc0714c0 0x7fe4cc0aa160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40097c0 tx=0x7fe4b401c410 comp rx=0 tx=0).stop 2024-02-17T12:17:06.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4d1e00640 1 -- 172.21.15.114:0/673751928 shutdown_connections 2024-02-17T12:17:06.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/673751928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4cc0714c0 0x7fe4cc0aa160 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/673751928 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc150300 0x7fe4cc156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4d1e00640 1 -- 172.21.15.114:0/673751928 >> 172.21.15.114:0/673751928 conn(0x7fe4cc0c4f20 msgr2=0x7fe4cc0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:06.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4d1e00640 1 -- 172.21.15.114:0/673751928 shutdown_connections 2024-02-17T12:17:06.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.226+0000 7fe4d1e00640 1 -- 172.21.15.114:0/673751928 wait complete. 2024-02-17T12:17:06.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 Processor -- start 2024-02-17T12:17:06.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 -- start start 2024-02-17T12:17:06.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc0714c0 0x7fe4cc147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0aa6a0 0x7fe4cc1eb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4cc150300 0x7fe4cc1446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc14d3f0 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc1eb250 con 0x7fe4cc150300 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc14ad10 con 0x7fe4cc0714c0 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4ca000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0aa6a0 0x7fe4cc1eb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4ca000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0aa6a0 0x7fe4cc1eb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42572/0 (socket says 172.21.15.114:42572) 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4ca000640 1 -- 172.21.15.114:0/2367241870 learned_addr learned my addr 172.21.15.114:0/2367241870 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4caa00640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc0714c0 0x7fe4cc147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4cb400640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4cc150300 0x7fe4cc1446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4ca000640 1 -- 172.21.15.114:0/2367241870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc0714c0 msgr2=0x7fe4cc147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4ca000640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc0714c0 0x7fe4cc147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4ca000640 1 -- 172.21.15.114:0/2367241870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4cc150300 msgr2=0x7fe4cc1446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4ca000640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4cc150300 0x7fe4cc1446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4ca000640 1 -- 172.21.15.114:0/2367241870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc009a70 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4caa00640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc0714c0 0x7fe4cc147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:06.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4cb400640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4cc150300 0x7fe4cc1446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:06.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4ca000640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0aa6a0 0x7fe4cc1eb940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe4b401a040 tx=0x7fe4b401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:06.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4c3400640 1 -- 172.21.15.114:0/2367241870 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40b7450 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4c3400640 1 -- 172.21.15.114:0/2367241870 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b40b75d0 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 -- 172.21.15.114:0/2367241870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b4009420 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4c3400640 1 -- 172.21.15.114:0/2367241870 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40b7980 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 -- 172.21.15.114:0/2367241870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc150c60 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.230+0000 7fe4d1e00640 1 -- 172.21.15.114:0/2367241870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc074840 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.234+0000 7fe4c3400640 1 -- 172.21.15.114:0/2367241870 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe4b40b7ae0 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.234+0000 7fe4c3400640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe4a8066e70 0x7fe4a8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.234+0000 7fe4c3400640 1 -- 172.21.15.114:0/2367241870 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4b411f110 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.234+0000 7fe4caa00640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe4a8066e70 0x7fe4a8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.234+0000 7fe4caa00640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe4a8066e70 0x7fe4a8069330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc007640 tx=0x7fe4bc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:06.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.238+0000 7fe4c3400640 1 -- 172.21.15.114:0/2367241870 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe4b40ebef0 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.394+0000 7fe4d1e00640 1 -- 172.21.15.114:0/2367241870 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4cc14d6e0 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.394+0000 7fe4c3400640 1 -- 172.21.15.114:0/2367241870 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16694 (secure 0 0 0) 0x7fe4b40ef5b0 con 0x7fe4cc0aa6a0 2024-02-17T12:17:06.402 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:06.402 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":31,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:05.397273+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:06.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 -- 172.21.15.114:0/2367241870 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe4a8066e70 msgr2=0x7fe4a8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe4a8066e70 0x7fe4a8069330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc007640 tx=0x7fe4bc00b040 comp rx=0 tx=0).stop 2024-02-17T12:17:06.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 -- 172.21.15.114:0/2367241870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0aa6a0 msgr2=0x7fe4cc1eb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0aa6a0 0x7fe4cc1eb940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe4b401a040 tx=0x7fe4b401ac50 comp rx=0 tx=0).stop 2024-02-17T12:17:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 -- 172.21.15.114:0/2367241870 shutdown_connections 2024-02-17T12:17:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4cc150300 0x7fe4cc1446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe4a8066e70 0x7fe4a8069330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0aa6a0 0x7fe4cc1eb940 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/2367241870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe4cc0714c0 0x7fe4cc147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 -- 172.21.15.114:0/2367241870 >> 172.21.15.114:0/2367241870 conn(0x7fe4cc0c4f20 msgr2=0x7fe4cc0a9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 -- 172.21.15.114:0/2367241870 shutdown_connections 2024-02-17T12:17:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.398+0000 7fe4d1e00640 1 -- 172.21.15.114:0/2367241870 wait complete. 2024-02-17T12:17:06.423 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.550+0000 7f086c800640 1 Processor -- start 2024-02-17T12:17:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.550+0000 7f086c800640 1 -- start start 2024-02-17T12:17:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.550+0000 7f086c800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086414e9b0 0x7f08640ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.550+0000 7f086c800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f08641519b0 0x7f086406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.550+0000 7f086c800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08640aa150 con 0x7f086406ef50 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f086c800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086414ed90 con 0x7f08641519b0 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f086c800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08640c1e90 con 0x7f086414e9b0 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0869400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f086406ef50 0x7f08641512a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50756/0 (socket says 172.21.15.114:50756) 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0869400640 1 -- 172.21.15.114:0/1360590033 learned_addr learned my addr 172.21.15.114:0/1360590033 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0869e00640 1 --2- 172.21.15.114:0/1360590033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086414e9b0 0x7f08640ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f086a800640 1 --2- 172.21.15.114:0/1360590033 >> v2:172.21.15.116:3300/0 conn(0x7f08641519b0 0x7f086406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0868a00640 1 -- 172.21.15.114:0/1360590033 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745161164 0 0) 0x7f08640aa150 con 0x7f086406ef50 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0868a00640 1 -- 172.21.15.114:0/1360590033 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f084c003530 con 0x7f086406ef50 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0869e00640 1 -- 172.21.15.114:0/1360590033 >> v2:172.21.15.116:3300/0 conn(0x7f08641519b0 msgr2=0x7f086406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0869e00640 1 --2- 172.21.15.114:0/1360590033 >> v2:172.21.15.116:3300/0 conn(0x7f08641519b0 0x7f086406dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0869e00640 1 -- 172.21.15.114:0/1360590033 >> v1:172.21.15.114:6789/0 conn(0x7f086406ef50 legacy=0x7f08641512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0868a00640 1 -- 172.21.15.114:0/1360590033 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1205024868 0 0) 0x7f084c003530 con 0x7f086406ef50 2024-02-17T12:17:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0869e00640 1 -- 172.21.15.114:0/1360590033 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864152000 con 0x7f086414e9b0 2024-02-17T12:17:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.554+0000 7f0869e00640 1 --2- 172.21.15.114:0/1360590033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086414e9b0 0x7f08640ab5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f08500097c0 tx=0x7f085001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=511ec8f733bdd634 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0868a00640 1 -- 172.21.15.114:0/1360590033 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858001680 con 0x7f086414e9b0 2024-02-17T12:17:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0868a00640 1 -- 172.21.15.114:0/1360590033 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08500a7050 con 0x7f086414e9b0 2024-02-17T12:17:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0868a00640 1 -- 172.21.15.114:0/1360590033 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08500ab620 con 0x7f086414e9b0 2024-02-17T12:17:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 -- 172.21.15.114:0/1360590033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086414e9b0 msgr2=0x7f08640ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 --2- 172.21.15.114:0/1360590033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086414e9b0 0x7f08640ab5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f08500097c0 tx=0x7f085001c3c0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 -- 172.21.15.114:0/1360590033 shutdown_connections 2024-02-17T12:17:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 --2- 172.21.15.114:0/1360590033 >> v2:172.21.15.116:3300/0 conn(0x7f08641519b0 0x7f086406dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 --2- 172.21.15.114:0/1360590033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f086414e9b0 0x7f08640ab5d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 -- 172.21.15.114:0/1360590033 >> 172.21.15.114:0/1360590033 conn(0x7f08640a8490 msgr2=0x7f08640a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 -- 172.21.15.114:0/1360590033 shutdown_connections 2024-02-17T12:17:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 -- 172.21.15.114:0/1360590033 wait complete. 2024-02-17T12:17:06.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 Processor -- start 2024-02-17T12:17:06.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 -- start start 2024-02-17T12:17:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086406ef50 0x7f0864148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086414e9b0 0x7f0864150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08641519b0 0x7f0864154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08641ee3d0 con 0x7f086414e9b0 2024-02-17T12:17:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08641ed850 con 0x7f086406ef50 2024-02-17T12:17:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086c800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08641edb30 con 0x7f08641519b0 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0869400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086414e9b0 0x7f0864150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0869400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086414e9b0 0x7f0864150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42574/0 (socket says 172.21.15.114:42574) 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0869400640 1 -- 172.21.15.114:0/2085375505 learned_addr learned my addr 172.21.15.114:0/2085375505 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0869e00640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086406ef50 0x7f0864148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f086a800640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08641519b0 0x7f0864154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0869400640 1 -- 172.21.15.114:0/2085375505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08641519b0 msgr2=0x7f0864154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0869400640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08641519b0 0x7f0864154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0869400640 1 -- 172.21.15.114:0/2085375505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086406ef50 msgr2=0x7f0864148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0869400640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086406ef50 0x7f0864148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.558+0000 7f0869400640 1 -- 172.21.15.114:0/2085375505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0850009420 con 0x7f086414e9b0 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.562+0000 7f0869400640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086414e9b0 0x7f0864150e20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f08580017b0 tx=0x7f085800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.562+0000 7f085e000640 1 -- 172.21.15.114:0/2085375505 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858005ae0 con 0x7f086414e9b0 2024-02-17T12:17:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.562+0000 7f085e000640 1 -- 172.21.15.114:0/2085375505 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0858005c40 con 0x7f086414e9b0 2024-02-17T12:17:06.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.562+0000 7f085e000640 1 -- 172.21.15.114:0/2085375505 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858007290 con 0x7f086414e9b0 2024-02-17T12:17:06.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.562+0000 7f086c800640 1 -- 172.21.15.114:0/2085375505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08641ede10 con 0x7f086414e9b0 2024-02-17T12:17:06.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.562+0000 7f086c800640 1 -- 172.21.15.114:0/2085375505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08641486a0 con 0x7f086414e9b0 2024-02-17T12:17:06.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.562+0000 7f086c800640 1 -- 172.21.15.114:0/2085375505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0864074840 con 0x7f086414e9b0 2024-02-17T12:17:06.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.562+0000 7f085e000640 1 -- 172.21.15.114:0/2085375505 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f08580073f0 con 0x7f086414e9b0 2024-02-17T12:17:06.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.562+0000 7f085e000640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0844066e40 0x7f0844069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.562+0000 7f085e000640 1 -- 172.21.15.114:0/2085375505 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08580847d0 con 0x7f086414e9b0 2024-02-17T12:17:06.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.566+0000 7f0869e00640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0844066e40 0x7f0844069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.566+0000 7f0869e00640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0844066e40 0x7f0844069300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f08500ad000 tx=0x7f08500a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.566+0000 7f085e000640 1 -- 172.21.15.114:0/2085375505 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f08580515c0 con 0x7f086414e9b0 2024-02-17T12:17:06.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 -- 172.21.15.114:0/2085375505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08640c3f60 con 0x7f086414e9b0 2024-02-17T12:17:06.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f085e000640 1 -- 172.21.15.114:0/2085375505 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16694 (secure 0 0 0) 0x7f0858054c80 con 0x7f086414e9b0 2024-02-17T12:17:06.732 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:06.732 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":31,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:05.397273+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 -- 172.21.15.114:0/2085375505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0844066e40 msgr2=0x7f0844069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0844066e40 0x7f0844069300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f08500ad000 tx=0x7f08500a6000 comp rx=0 tx=0).stop 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 -- 172.21.15.114:0/2085375505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086414e9b0 msgr2=0x7f0864150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086414e9b0 0x7f0864150e20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f08580017b0 tx=0x7f085800cbe0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 -- 172.21.15.114:0/2085375505 shutdown_connections 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08641519b0 0x7f0864154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0844066e40 0x7f0844069300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f086414e9b0 0x7f0864150e20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 --2- 172.21.15.114:0/2085375505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f086406ef50 0x7f0864148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 -- 172.21.15.114:0/2085375505 >> 172.21.15.114:0/2085375505 conn(0x7f08640a8490 msgr2=0x7f086414a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:06.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.726+0000 7f086c800640 1 -- 172.21.15.114:0/2085375505 shutdown_connections 2024-02-17T12:17:06.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.730+0000 7f086c800640 1 -- 172.21.15.114:0/2085375505 wait complete. 2024-02-17T12:17:06.753 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-17T12:17:06.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.882+0000 7fe6d2e00640 1 Processor -- start 2024-02-17T12:17:06.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.882+0000 7fe6d2e00640 1 -- start start 2024-02-17T12:17:06.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6d2e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6cc0c2580 0x7fe6cc0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6d2e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc0a9420 con 0x7fe6cc14f110 2024-02-17T12:17:06.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6d2e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc152850 con 0x7fe6cc0c1eb0 2024-02-17T12:17:06.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6d2e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc14f4f0 con 0x7fe6cc0c2580 2024-02-17T12:17:06.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6cbe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe6cc14f110 0x7fe6cc0c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50758/0 (socket says 172.21.15.114:50758) 2024-02-17T12:17:06.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6cbe00640 1 -- 172.21.15.114:0/1897571562 learned_addr learned my addr 172.21.15.114:0/1897571562 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6cb400640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6cc0c2580 0x7fe6cc0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78357772 0 0) 0x7fe6cc0a9420 con 0x7fe6cc14f110 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b0003530 con 0x7fe6cc14f110 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 714451616 0 0) 0x7fe6b0003530 con 0x7fe6cc14f110 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6cc0c2580 msgr2=0x7fe6cc0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6cc0c2580 0x7fe6cc0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 >> v1:172.21.15.116:6789/0 conn(0x7fe6cc0c1eb0 legacy=0x7fe6cc15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc0a9670 con 0x7fe6cc14f110 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fe6bc001680 con 0x7fe6cc14f110 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 >> v1:172.21.15.114:6789/0 conn(0x7fe6cc14f110 legacy=0x7fe6cc0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6cc0c2580 0x7fe6b00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6b0003f80 0x7fe6b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6b0004d10 0x7fe6b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc14f4f0 con 0x7fe6b0004d10 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b000bb80 con 0x7fe6b0003f80 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b000df50 con 0x7fe6cc0c2580 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6d0e00640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6b0004d10 0x7fe6b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6cbe00640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6cc0c2580 0x7fe6b00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6cb400640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6b0003f80 0x7fe6b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6d0e00640 1 -- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6cc0c2580 msgr2=0x7fe6b00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6d0e00640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6cc0c2580 0x7fe6b00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6d0e00640 1 -- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6b0003f80 msgr2=0x7fe6b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6d0e00640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6b0003f80 0x7fe6b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.886+0000 7fe6d0e00640 1 -- 172.21.15.114:0/1897571562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b0003530 con 0x7fe6b0004d10 2024-02-17T12:17:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6d0e00640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6b0004d10 0x7fe6b0005190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4001e40 tx=0x7fe6c401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8d56bf5441e074 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4003b80 con 0x7fe6b0004d10 2024-02-17T12:17:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c4003ce0 con 0x7fe6b0004d10 2024-02-17T12:17:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6caa00640 1 -- 172.21.15.114:0/1897571562 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c40052c0 con 0x7fe6b0004d10 2024-02-17T12:17:06.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6d2e00640 1 -- 172.21.15.114:0/1897571562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6b0004d10 msgr2=0x7fe6b0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6d2e00640 1 --2- 172.21.15.114:0/1897571562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6b0004d10 0x7fe6b0005190 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4001e40 tx=0x7fe6c401c760 comp rx=0 tx=0).stop 2024-02-17T12:17:06.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6d0e00640 1 -- 172.21.15.114:0/1897571562 reap_dead start 2024-02-17T12:17:06.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6d2e00640 1 -- 172.21.15.114:0/1897571562 shutdown_connections 2024-02-17T12:17:06.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6d2e00640 1 -- 172.21.15.114:0/1897571562 >> 172.21.15.114:0/1897571562 conn(0x7fe6cc0a8490 msgr2=0x7fe6cc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:06.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6d2e00640 1 -- 172.21.15.114:0/1897571562 shutdown_connections 2024-02-17T12:17:06.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6d2e00640 1 -- 172.21.15.114:0/1897571562 wait complete. 2024-02-17T12:17:06.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6d2e00640 1 Processor -- start 2024-02-17T12:17:06.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.890+0000 7fe6d2e00640 1 -- start start 2024-02-17T12:17:06.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d2e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6b0004d10 0x7fe6cc0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d2e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6cc14fc70 0x7fe6cc13fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d2e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6cc1559a0 0x7fe6cc140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d2e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc1405c0 con 0x7fe6cc1559a0 2024-02-17T12:17:06.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d2e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc1eded0 con 0x7fe6cc14fc70 2024-02-17T12:17:06.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d2e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc1ee1b0 con 0x7fe6b0004d10 2024-02-17T12:17:06.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6cc1559a0 0x7fe6cc140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6cc1559a0 0x7fe6cc140080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42600/0 (socket says 172.21.15.114:42600) 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d0e00640 1 -- 172.21.15.114:0/2060533189 learned_addr learned my addr 172.21.15.114:0/2060533189 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6cbe00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6b0004d10 0x7fe6cc0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6cb400640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6cc14fc70 0x7fe6cc13fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d0e00640 1 -- 172.21.15.114:0/2060533189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6b0004d10 msgr2=0x7fe6cc0bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d0e00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6b0004d10 0x7fe6cc0bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d0e00640 1 -- 172.21.15.114:0/2060533189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6cc14fc70 msgr2=0x7fe6cc13fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d0e00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6cc14fc70 0x7fe6cc13fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d0e00640 1 -- 172.21.15.114:0/2060533189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc1ee490 con 0x7fe6cc1559a0 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d0e00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6cc1559a0 0x7fe6cc140080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe6c401cc40 tx=0x7fe6b0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6c3e00640 1 -- 172.21.15.114:0/2060533189 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4005810 con 0x7fe6cc1559a0 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6c3e00640 1 -- 172.21.15.114:0/2060533189 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c4007dc0 con 0x7fe6cc1559a0 2024-02-17T12:17:06.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6c3e00640 1 -- 172.21.15.114:0/2060533189 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4006d60 con 0x7fe6cc1559a0 2024-02-17T12:17:06.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d2e00640 1 -- 172.21.15.114:0/2060533189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6cc1ee770 con 0x7fe6cc1559a0 2024-02-17T12:17:06.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d2e00640 1 -- 172.21.15.114:0/2060533189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc0bff40 con 0x7fe6cc1559a0 2024-02-17T12:17:06.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.894+0000 7fe6d2e00640 1 -- 172.21.15.114:0/2060533189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6cc074840 con 0x7fe6cc1559a0 2024-02-17T12:17:06.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.898+0000 7fe6c3e00640 1 -- 172.21.15.114:0/2060533189 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe6c4007030 con 0x7fe6cc1559a0 2024-02-17T12:17:06.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.898+0000 7fe6c3e00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe6ac066e70 0x7fe6ac069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:06.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.898+0000 7fe6c3e00640 1 -- 172.21.15.114:0/2060533189 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6c411de50 con 0x7fe6cc1559a0 2024-02-17T12:17:06.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.898+0000 7fe6cbe00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe6ac066e70 0x7fe6ac069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:06.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.898+0000 7fe6cbe00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe6ac066e70 0x7fe6ac069330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc000c10 tx=0x7fe6bc000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:06.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:06.902+0000 7fe6c3e00640 1 -- 172.21.15.114:0/2060533189 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe6c40eac50 con 0x7fe6cc1559a0 2024-02-17T12:17:07.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:07.094+0000 7fe6d2e00640 1 -- 172.21.15.114:0/2060533189 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe6cc1405c0 con 0x7fe6cc1559a0 2024-02-17T12:17:08.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.050+0000 7fe6c3e00640 1 -- 172.21.15.114:0/2060533189 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe6c40ba020 con 0x7fe6cc1559a0 2024-02-17T12:17:08.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 -- 172.21.15.114:0/2060533189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe6ac066e70 msgr2=0x7fe6ac069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:08.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe6ac066e70 0x7fe6ac069330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc000c10 tx=0x7fe6bc000f90 comp rx=0 tx=0).stop 2024-02-17T12:17:08.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 -- 172.21.15.114:0/2060533189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6cc1559a0 msgr2=0x7fe6cc140080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:08.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6cc1559a0 0x7fe6cc140080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe6c401cc40 tx=0x7fe6b0005800 comp rx=0 tx=0).stop 2024-02-17T12:17:08.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 -- 172.21.15.114:0/2060533189 shutdown_connections 2024-02-17T12:17:08.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe6ac066e70 0x7fe6ac069330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:08.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6cc1559a0 0x7fe6cc140080 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:08.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6cc14fc70 0x7fe6cc13fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:08.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 --2- 172.21.15.114:0/2060533189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe6b0004d10 0x7fe6cc0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:08.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 -- 172.21.15.114:0/2060533189 >> 172.21.15.114:0/2060533189 conn(0x7fe6cc0a8490 msgr2=0x7fe6cc06e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:08.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 -- 172.21.15.114:0/2060533189 shutdown_connections 2024-02-17T12:17:08.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.054+0000 7fe6d2e00640 1 -- 172.21.15.114:0/2060533189 wait complete. 2024-02-17T12:17:08.082 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-17T12:17:08.082 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-17T12:17:08.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e7200640 1 Processor -- start 2024-02-17T12:17:08.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e7200640 1 -- start start 2024-02-17T12:17:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e7200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34e80c7d30 0x7f34e80709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e7200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34e80c6e70 0x7f34e80c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e7200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e80c62d0 con 0x7f34e80c4e60 2024-02-17T12:17:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e7200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e806ee00 con 0x7f34e80c7d30 2024-02-17T12:17:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e7200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c2dd0 con 0x7f34e80c6e70 2024-02-17T12:17:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e5e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f34e80c4e60 0x7f34e80c6760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50764/0 (socket says 172.21.15.114:50764) 2024-02-17T12:17:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e5e00640 1 -- 172.21.15.114:0/1816035028 learned_addr learned my addr 172.21.15.114:0/1816035028 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:08.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e5400640 1 --2- 172.21.15.114:0/1816035028 >> v2:172.21.15.114:3300/0 conn(0x7f34e80c7d30 0x7f34e80709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:08.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e6800640 1 --2- 172.21.15.114:0/1816035028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34e80c6e70 0x7f34e80c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:08.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e4a00640 1 -- 172.21.15.114:0/1816035028 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535433762 0 0) 0x7f34e80c62d0 con 0x7f34e80c4e60 2024-02-17T12:17:08.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e4a00640 1 -- 172.21.15.114:0/1816035028 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34cc003530 con 0x7f34e80c4e60 2024-02-17T12:17:08.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e5400640 1 -- 172.21.15.114:0/1816035028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34e80c6e70 msgr2=0x7f34e80c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:08.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e5400640 1 --2- 172.21.15.114:0/1816035028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34e80c6e70 0x7f34e80c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:08.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e5400640 1 -- 172.21.15.114:0/1816035028 >> v1:172.21.15.114:6789/0 conn(0x7f34e80c4e60 legacy=0x7f34e80c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:08.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.218+0000 7f34e5400640 1 -- 172.21.15.114:0/1816035028 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e81537f0 con 0x7f34e80c7d30 2024-02-17T12:17:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e5400640 1 --2- 172.21.15.114:0/1816035028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c7d30 0x7f34e80709f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f34d40097c0 tx=0x7f34d401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e2fcd9a30207d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e4a00640 1 -- 172.21.15.114:0/1816035028 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d40ab600 con 0x7f34e80c7d30 2024-02-17T12:17:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e4a00640 1 -- 172.21.15.114:0/1816035028 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d40a7050 con 0x7f34e80c7d30 2024-02-17T12:17:08.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e4a00640 1 -- 172.21.15.114:0/1816035028 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d40ab980 con 0x7f34e80c7d30 2024-02-17T12:17:08.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e7200640 1 -- 172.21.15.114:0/1816035028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c7d30 msgr2=0x7f34e80709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e7200640 1 --2- 172.21.15.114:0/1816035028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c7d30 0x7f34e80709f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f34d40097c0 tx=0x7f34d401c410 comp rx=0 tx=0).stop 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e7200640 1 -- 172.21.15.114:0/1816035028 shutdown_connections 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e7200640 1 --2- 172.21.15.114:0/1816035028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34e80c6e70 0x7f34e80c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e7200640 1 --2- 172.21.15.114:0/1816035028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c7d30 0x7f34e80709f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e7200640 1 -- 172.21.15.114:0/1816035028 >> 172.21.15.114:0/1816035028 conn(0x7f34e80c83d0 msgr2=0x7f34e80c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e7200640 1 -- 172.21.15.114:0/1816035028 shutdown_connections 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.222+0000 7f34e7200640 1 -- 172.21.15.114:0/1816035028 wait complete. 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 Processor -- start 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 -- start start 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c4e60 0x7f34e8153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80c6e70 0x7f34e81ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34e80c7d30 0x7f34e81eda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e81f1750 con 0x7f34e80c4e60 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8149ed0 con 0x7f34e80c6e70 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e81f0b10 con 0x7f34e80c7d30 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c4e60 0x7f34e8153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c4e60 0x7f34e8153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42628/0 (socket says 172.21.15.114:42628) 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e5e00640 1 -- 172.21.15.114:0/4162243242 learned_addr learned my addr 172.21.15.114:0/4162243242 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e5e00640 1 -- 172.21.15.114:0/4162243242 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34e80c7d30 msgr2=0x7f34e81eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e5e00640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34e80c7d30 0x7f34e81eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e5e00640 1 -- 172.21.15.114:0/4162243242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80c6e70 msgr2=0x7f34e81ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e5e00640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80c6e70 0x7f34e81ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e5e00640 1 -- 172.21.15.114:0/4162243242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d4009420 con 0x7f34e80c4e60 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e5e00640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c4e60 0x7f34e8153e30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f34d800caa0 tx=0x7f34d800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34de000640 1 -- 172.21.15.114:0/4162243242 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d800ac00 con 0x7f34e80c4e60 2024-02-17T12:17:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34de000640 1 -- 172.21.15.114:0/4162243242 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d800ad60 con 0x7f34e80c4e60 2024-02-17T12:17:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34de000640 1 -- 172.21.15.114:0/4162243242 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8012620 con 0x7f34e80c4e60 2024-02-17T12:17:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 -- 172.21.15.114:0/4162243242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e81f0db0 con 0x7f34e80c4e60 2024-02-17T12:17:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 -- 172.21.15.114:0/4162243242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e81f1370 con 0x7f34e80c4e60 2024-02-17T12:17:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.226+0000 7f34e7200640 1 -- 172.21.15.114:0/4162243242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e804eef0 con 0x7f34e80c4e60 2024-02-17T12:17:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.230+0000 7f34de000640 1 -- 172.21.15.114:0/4162243242 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f34d8007070 con 0x7f34e80c4e60 2024-02-17T12:17:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.230+0000 7f34de000640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f34c8066e40 0x7f34c8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.230+0000 7f34de000640 1 -- 172.21.15.114:0/4162243242 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34d8084a10 con 0x7f34e80c4e60 2024-02-17T12:17:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.230+0000 7f34e5400640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f34c8066e40 0x7f34c8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.230+0000 7f34e5400640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f34c8066e40 0x7f34c8069300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f34d40ad000 tx=0x7f34d4004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:08.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.234+0000 7f34de000640 1 -- 172.21.15.114:0/4162243242 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f34d80517f0 con 0x7f34e80c4e60 2024-02-17T12:17:08.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:08.422+0000 7f34e7200640 1 -- 172.21.15.114:0/4162243242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f34e806ff60 con 0x7f34e80c4e60 2024-02-17T12:17:09.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.050+0000 7f34de000640 1 -- 172.21.15.114:0/4162243242 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f34d8017070 con 0x7f34e80c4e60 2024-02-17T12:17:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 -- 172.21.15.114:0/4162243242 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f34c8066e40 msgr2=0x7f34c8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f34c8066e40 0x7f34c8069300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f34d40ad000 tx=0x7f34d4004740 comp rx=0 tx=0).stop 2024-02-17T12:17:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 -- 172.21.15.114:0/4162243242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c4e60 msgr2=0x7f34e8153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c4e60 0x7f34e8153e30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f34d800caa0 tx=0x7f34d800cf60 comp rx=0 tx=0).stop 2024-02-17T12:17:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 -- 172.21.15.114:0/4162243242 shutdown_connections 2024-02-17T12:17:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f34e80c7d30 0x7f34e81eda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e80c6e70 0x7f34e81ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f34c8066e40 0x7f34c8069300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 --2- 172.21.15.114:0/4162243242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34e80c4e60 0x7f34e8153e30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 -- 172.21.15.114:0/4162243242 >> 172.21.15.114:0/4162243242 conn(0x7f34e80c83d0 msgr2=0x7f34e81508b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:09.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 -- 172.21.15.114:0/4162243242 shutdown_connections 2024-02-17T12:17:09.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.054+0000 7f34e7200640 1 -- 172.21.15.114:0/4162243242 wait complete. 2024-02-17T12:17:09.084 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-17T12:17:09.084 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:09.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.214+0000 7f2b8da00640 1 Processor -- start 2024-02-17T12:17:09.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.214+0000 7f2b8da00640 1 -- start start 2024-02-17T12:17:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.214+0000 7f2b8da00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2b8813be90 0x7f2b88156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.214+0000 7f2b8da00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88070b60 0x7f2b88072d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.214+0000 7f2b8da00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8806e780 con 0x7f2b88152b40 2024-02-17T12:17:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.214+0000 7f2b8da00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b88156730 con 0x7f2b8813be90 2024-02-17T12:17:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.214+0000 7f2b8da00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b88073290 con 0x7f2b88070b60 2024-02-17T12:17:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b8d000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2b88152b40 0x7f2b880c3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50778/0 (socket says 172.21.15.114:50778) 2024-02-17T12:17:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b8d000640 1 -- 172.21.15.114:0/1451883756 learned_addr learned my addr 172.21.15.114:0/1451883756 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:09.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b87e00640 1 --2- 172.21.15.114:0/1451883756 >> v2:172.21.15.116:3300/0 conn(0x7f2b8813be90 0x7f2b88156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b87400640 1 --2- 172.21.15.114:0/1451883756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88070b60 0x7f2b88072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b86a00640 1 -- 172.21.15.114:0/1451883756 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698806881 0 0) 0x7f2b8806e780 con 0x7f2b88152b40 2024-02-17T12:17:09.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b86a00640 1 -- 172.21.15.114:0/1451883756 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b6c003530 con 0x7f2b88152b40 2024-02-17T12:17:09.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b86a00640 1 -- 172.21.15.114:0/1451883756 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2760600740 0 0) 0x7f2b6c003530 con 0x7f2b88152b40 2024-02-17T12:17:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b87400640 1 -- 172.21.15.114:0/1451883756 >> v2:172.21.15.116:3300/0 conn(0x7f2b8813be90 msgr2=0x7f2b88156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b87400640 1 --2- 172.21.15.114:0/1451883756 >> v2:172.21.15.116:3300/0 conn(0x7f2b8813be90 0x7f2b88156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b87400640 1 -- 172.21.15.114:0/1451883756 >> v1:172.21.15.114:6789/0 conn(0x7f2b88152b40 legacy=0x7f2b880c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.218+0000 7f2b87400640 1 -- 172.21.15.114:0/1451883756 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8806ea60 con 0x7f2b88070b60 2024-02-17T12:17:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b87400640 1 --2- 172.21.15.114:0/1451883756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88070b60 0x7f2b88072d50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b740097c0 tx=0x7f2b7401c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13d1797debb8ee67 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b86a00640 1 -- 172.21.15.114:0/1451883756 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80001a00 con 0x7f2b88070b60 2024-02-17T12:17:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b86a00640 1 -- 172.21.15.114:0/1451883756 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b740a7050 con 0x7f2b88070b60 2024-02-17T12:17:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b86a00640 1 -- 172.21.15.114:0/1451883756 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b740ab620 con 0x7f2b88070b60 2024-02-17T12:17:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 -- 172.21.15.114:0/1451883756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88070b60 msgr2=0x7f2b88072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 --2- 172.21.15.114:0/1451883756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88070b60 0x7f2b88072d50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b740097c0 tx=0x7f2b7401c300 comp rx=0 tx=0).stop 2024-02-17T12:17:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 -- 172.21.15.114:0/1451883756 shutdown_connections 2024-02-17T12:17:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 --2- 172.21.15.114:0/1451883756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88070b60 0x7f2b88072d50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 --2- 172.21.15.114:0/1451883756 >> v2:172.21.15.116:3300/0 conn(0x7f2b8813be90 0x7f2b88156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 -- 172.21.15.114:0/1451883756 >> 172.21.15.114:0/1451883756 conn(0x7f2b880a8660 msgr2=0x7f2b880a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 -- 172.21.15.114:0/1451883756 shutdown_connections 2024-02-17T12:17:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 -- 172.21.15.114:0/1451883756 wait complete. 2024-02-17T12:17:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 Processor -- start 2024-02-17T12:17:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 -- start start 2024-02-17T12:17:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88070b60 0x7f2b88132b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.222+0000 7f2b8da00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b8813be90 0x7f2b88137ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b8da00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88152b40 0x7f2b88134140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b8da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b881eb190 con 0x7f2b88070b60 2024-02-17T12:17:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b8da00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b88133cb0 con 0x7f2b8813be90 2024-02-17T12:17:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b8da00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b881339b0 con 0x7f2b88152b40 2024-02-17T12:17:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88070b60 0x7f2b88132b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88070b60 0x7f2b88132b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42630/0 (socket says 172.21.15.114:42630) 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87e00640 1 -- 172.21.15.114:0/1569605168 learned_addr learned my addr 172.21.15.114:0/1569605168 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87400640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b8813be90 0x7f2b88137ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b8d000640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88152b40 0x7f2b88134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87e00640 1 -- 172.21.15.114:0/1569605168 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88152b40 msgr2=0x7f2b88134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87e00640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88152b40 0x7f2b88134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87e00640 1 -- 172.21.15.114:0/1569605168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b8813be90 msgr2=0x7f2b88137ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87e00640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b8813be90 0x7f2b88137ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87e00640 1 -- 172.21.15.114:0/1569605168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74009420 con 0x7f2b88070b60 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87400640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b8813be90 0x7f2b88137ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b87e00640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88070b60 0x7f2b88132b80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800e8a0 tx=0x7f2b7800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:09.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b7fe00640 1 -- 172.21.15.114:0/1569605168 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78009510 con 0x7f2b88070b60 2024-02-17T12:17:09.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b7fe00640 1 -- 172.21.15.114:0/1569605168 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7800c8e0 con 0x7f2b88070b60 2024-02-17T12:17:09.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b7fe00640 1 -- 172.21.15.114:0/1569605168 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800cc50 con 0x7f2b88070b60 2024-02-17T12:17:09.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b8da00640 1 -- 172.21.15.114:0/1569605168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b880aaff0 con 0x7f2b88070b60 2024-02-17T12:17:09.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b8da00640 1 -- 172.21.15.114:0/1569605168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b880ab2d0 con 0x7f2b88070b60 2024-02-17T12:17:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b8da00640 1 -- 172.21.15.114:0/1569605168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8804eef0 con 0x7f2b88070b60 2024-02-17T12:17:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.226+0000 7f2b7fe00640 1 -- 172.21.15.114:0/1569605168 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2b78013470 con 0x7f2b88070b60 2024-02-17T12:17:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.230+0000 7f2b7fe00640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b68066e70 0x7f2b68069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.230+0000 7f2b7fe00640 1 -- 172.21.15.114:0/1569605168 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b78084b00 con 0x7f2b88070b60 2024-02-17T12:17:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.230+0000 7f2b87400640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b68066e70 0x7f2b68069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.230+0000 7f2b87400640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b68066e70 0x7f2b68069330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b740ad000 tx=0x7f2b74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.234+0000 7f2b7fe00640 1 -- 172.21.15.114:0/1569605168 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2b78086e60 con 0x7f2b88070b60 2024-02-17T12:17:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.418+0000 7f2b8da00640 1 -- 172.21.15.114:0/1569605168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b88133af0 con 0x7f2b88070b60 2024-02-17T12:17:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b7fe00640 1 -- 172.21.15.114:0/1569605168 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f2b88133af0 con 0x7f2b88070b60 2024-02-17T12:17:09.427 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:09.427 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2833741536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2833741536},{"type":"v1","addr":"172.21.15.114:6836","nonce":2833741536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:05.397716+0000","modified":"2024-02-17T12:17:08.427075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1473468479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1473468479},{"type":"v1","addr":"172.21.15.114:6837","nonce":1473468479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-17T12:17:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 17 2024-02-17T12:17:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 -- 172.21.15.114:0/1569605168 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b68066e70 msgr2=0x7f2b68069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b68066e70 0x7f2b68069330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b740ad000 tx=0x7f2b74008040 comp rx=0 tx=0).stop 2024-02-17T12:17:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 -- 172.21.15.114:0/1569605168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88070b60 msgr2=0x7f2b88132b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88070b60 0x7f2b88132b80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800e8a0 tx=0x7f2b7800eca0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 -- 172.21.15.114:0/1569605168 shutdown_connections 2024-02-17T12:17:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b88152b40 0x7f2b88134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b8813be90 0x7f2b88137ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b68066e70 0x7f2b68069330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 --2- 172.21.15.114:0/1569605168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b88070b60 0x7f2b88132b80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 -- 172.21.15.114:0/1569605168 >> 172.21.15.114:0/1569605168 conn(0x7f2b880a8660 msgr2=0x7f2b88072390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 -- 172.21.15.114:0/1569605168 shutdown_connections 2024-02-17T12:17:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.422+0000 7f2b8da00640 1 -- 172.21.15.114:0/1569605168 wait complete. 2024-02-17T12:17:09.448 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:09.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.574+0000 7f3365000640 1 Processor -- start 2024-02-17T12:17:09.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.574+0000 7f3365000640 1 -- start start 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f3365000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f336006ef60 0x7f3360158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f3365000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f33600c0640 0x7f3360158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f3365000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336006e890 con 0x7f3360152510 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f3365000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33600c2670 con 0x7f33600c0640 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f3365000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3360158370 con 0x7f336006ef60 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335de00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3360152510 0x7f33600c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50782/0 (socket says 172.21.15.114:50782) 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335de00640 1 -- 172.21.15.114:0/2639306096 learned_addr learned my addr 172.21.15.114:0/2639306096 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335e800640 1 --2- 172.21.15.114:0/2639306096 >> v2:172.21.15.114:3300/0 conn(0x7f33600c0640 0x7f3360158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335d400640 1 --2- 172.21.15.114:0/2639306096 >> v2:172.21.15.116:3300/0 conn(0x7f336006ef60 0x7f3360158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335ca00640 1 -- 172.21.15.114:0/2639306096 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244550599 0 0) 0x7f336006e890 con 0x7f3360152510 2024-02-17T12:17:09.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335ca00640 1 -- 172.21.15.114:0/2639306096 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3344003530 con 0x7f3360152510 2024-02-17T12:17:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335e800640 1 -- 172.21.15.114:0/2639306096 >> v2:172.21.15.116:3300/0 conn(0x7f336006ef60 msgr2=0x7f3360158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335e800640 1 --2- 172.21.15.114:0/2639306096 >> v2:172.21.15.116:3300/0 conn(0x7f336006ef60 0x7f3360158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335e800640 1 -- 172.21.15.114:0/2639306096 >> v1:172.21.15.114:6789/0 conn(0x7f3360152510 legacy=0x7f33600c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335e800640 1 -- 172.21.15.114:0/2639306096 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3360159280 con 0x7f33600c0640 2024-02-17T12:17:09.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.578+0000 7f335e800640 1 --2- 172.21.15.114:0/2639306096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33600c0640 0x7f3360158d40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f336006ced0 tx=0x7f335801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4d7e4e3609c169 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:09.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f335ca00640 1 -- 172.21.15.114:0/2639306096 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580a5930 con 0x7f33600c0640 2024-02-17T12:17:09.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f335ca00640 1 -- 172.21.15.114:0/2639306096 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33580a5a90 con 0x7f33600c0640 2024-02-17T12:17:09.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f335ca00640 1 -- 172.21.15.114:0/2639306096 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580a5e20 con 0x7f33600c0640 2024-02-17T12:17:09.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 -- 172.21.15.114:0/2639306096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33600c0640 msgr2=0x7f3360158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 --2- 172.21.15.114:0/2639306096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33600c0640 0x7f3360158d40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f336006ced0 tx=0x7f335801c870 comp rx=0 tx=0).stop 2024-02-17T12:17:09.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 -- 172.21.15.114:0/2639306096 shutdown_connections 2024-02-17T12:17:09.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 --2- 172.21.15.114:0/2639306096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33600c0640 0x7f3360158d40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 --2- 172.21.15.114:0/2639306096 >> v2:172.21.15.116:3300/0 conn(0x7f336006ef60 0x7f3360158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 -- 172.21.15.114:0/2639306096 >> 172.21.15.114:0/2639306096 conn(0x7f33600a8490 msgr2=0x7f33600a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:09.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 -- 172.21.15.114:0/2639306096 shutdown_connections 2024-02-17T12:17:09.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 -- 172.21.15.114:0/2639306096 wait complete. 2024-02-17T12:17:09.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 Processor -- start 2024-02-17T12:17:09.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 -- start start 2024-02-17T12:17:09.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f336006ef60 0x7f33600c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33600c0640 0x7f3360150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360152510 0x7f33601388b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33601491f0 con 0x7f3360152510 2024-02-17T12:17:09.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33601edc70 con 0x7f336006ef60 2024-02-17T12:17:09.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f3365000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33601ed340 con 0x7f33600c0640 2024-02-17T12:17:09.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f335e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360152510 0x7f33601388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f335e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360152510 0x7f33601388b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42638/0 (socket says 172.21.15.114:42638) 2024-02-17T12:17:09.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.582+0000 7f335e800640 1 -- 172.21.15.114:0/1803203500 learned_addr learned my addr 172.21.15.114:0/1803203500 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:09.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335de00640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f336006ef60 0x7f33600c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335d400640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33600c0640 0x7f3360150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335e800640 1 -- 172.21.15.114:0/1803203500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33600c0640 msgr2=0x7f3360150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335e800640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33600c0640 0x7f3360150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335e800640 1 -- 172.21.15.114:0/1803203500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f336006ef60 msgr2=0x7f33600c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335e800640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f336006ef60 0x7f33600c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335e800640 1 -- 172.21.15.114:0/1803203500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3358009a70 con 0x7f3360152510 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335de00640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f336006ef60 0x7f33600c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335d400640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33600c0640 0x7f3360150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335e800640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360152510 0x7f33601388b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3358019480 tx=0x7f3358019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f3356000640 1 -- 172.21.15.114:0/1803203500 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580adca0 con 0x7f3360152510 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f3356000640 1 -- 172.21.15.114:0/1803203500 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33580ade00 con 0x7f3360152510 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f3365000640 1 -- 172.21.15.114:0/1803203500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33601ed620 con 0x7f3360152510 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f3356000640 1 -- 172.21.15.114:0/1803203500 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580b9690 con 0x7f3360152510 2024-02-17T12:17:09.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f3365000640 1 -- 172.21.15.114:0/1803203500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33600c59a0 con 0x7f3360152510 2024-02-17T12:17:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f3365000640 1 -- 172.21.15.114:0/1803203500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33601ede00 con 0x7f3360152510 2024-02-17T12:17:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f3356000640 1 -- 172.21.15.114:0/1803203500 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f33580b97f0 con 0x7f3360152510 2024-02-17T12:17:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f3356000640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3340066e40 0x7f3340069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f3356000640 1 -- 172.21.15.114:0/1803203500 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3358120160 con 0x7f3360152510 2024-02-17T12:17:09.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.586+0000 7f335de00640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3340066e40 0x7f3340069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.590+0000 7f335de00640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3340066e40 0x7f3340069300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3350005890 tx=0x7f3350009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.590+0000 7f3356000640 1 -- 172.21.15.114:0/1803203500 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f33580ecf40 con 0x7f3360152510 2024-02-17T12:17:09.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.746+0000 7f3365000640 1 -- 172.21.15.114:0/1803203500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3360074840 con 0x7f3360152510 2024-02-17T12:17:09.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.746+0000 7f3356000640 1 -- 172.21.15.114:0/1803203500 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f3358009450 con 0x7f3360152510 2024-02-17T12:17:09.754 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:09.754 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:07.026009+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:09.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 -- 172.21.15.114:0/1803203500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3340066e40 msgr2=0x7f3340069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3340066e40 0x7f3340069300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3350005890 tx=0x7f3350009040 comp rx=0 tx=0).stop 2024-02-17T12:17:09.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 -- 172.21.15.114:0/1803203500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360152510 msgr2=0x7f33601388b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360152510 0x7f33601388b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3358019480 tx=0x7f3358019610 comp rx=0 tx=0).stop 2024-02-17T12:17:09.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 -- 172.21.15.114:0/1803203500 shutdown_connections 2024-02-17T12:17:09.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3340066e40 0x7f3340069300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3360152510 0x7f33601388b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33600c0640 0x7f3360150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 --2- 172.21.15.114:0/1803203500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f336006ef60 0x7f33600c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 -- 172.21.15.114:0/1803203500 >> 172.21.15.114:0/1803203500 conn(0x7f33600a8490 msgr2=0x7f33600c2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:09.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 -- 172.21.15.114:0/1803203500 shutdown_connections 2024-02-17T12:17:09.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.750+0000 7f3365000640 1 -- 172.21.15.114:0/1803203500 wait complete. 2024-02-17T12:17:09.775 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T12:17:09.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:17:09.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.902+0000 7f2bada00640 1 Processor -- start 2024-02-17T12:17:09.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.902+0000 7f2bada00640 1 -- start start 2024-02-17T12:17:09.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.902+0000 7f2bada00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2ba814f110 0x7f2ba80c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.902+0000 7f2bada00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ba80c1eb0 0x7f2ba815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.902+0000 7f2bada00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba80a9420 con 0x7f2ba80c2580 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.902+0000 7f2bada00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba814f4f0 con 0x7f2ba814f110 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.902+0000 7f2bada00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80aae80 con 0x7f2ba80c1eb0 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba6a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2ba814f110 0x7f2ba80c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba6000640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f2ba80c2580 0x7f2ba80aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:50526/0 (socket says 172.21.15.114:50526) 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba6a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2ba814f110 0x7f2ba80c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:57168/0 (socket says 172.21.15.114:57168) 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba6000640 1 -- 172.21.15.114:0/2210562291 learned_addr learned my addr 172.21.15.114:0/2210562291 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba7400640 1 --2- 172.21.15.114:0/2210562291 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ba80c1eb0 0x7f2ba815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba6a00640 1 -- 172.21.15.114:0/2210562291 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ba80c1eb0 msgr2=0x7f2ba815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba6a00640 1 --2- 172.21.15.114:0/2210562291 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ba80c1eb0 0x7f2ba815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba6a00640 1 -- 172.21.15.114:0/2210562291 >> v1:172.21.15.116:6789/0 conn(0x7f2ba80c2580 legacy=0x7f2ba80aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba6a00640 1 -- 172.21.15.114:0/2210562291 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba8152850 con 0x7f2ba814f110 2024-02-17T12:17:09.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba6a00640 1 --2- 172.21.15.114:0/2210562291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ba814f110 0x7f2ba80c65a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b980097c0 tx=0x7f2b9801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30f59e34d6f58fd7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:09.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba5600640 1 -- 172.21.15.114:0/2210562291 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980ac640 con 0x7f2ba814f110 2024-02-17T12:17:09.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba5600640 1 -- 172.21.15.114:0/2210562291 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b980ac7a0 con 0x7f2ba814f110 2024-02-17T12:17:09.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.906+0000 7f2ba5600640 1 -- 172.21.15.114:0/2210562291 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980acb30 con 0x7f2ba814f110 2024-02-17T12:17:09.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 -- 172.21.15.114:0/2210562291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ba814f110 msgr2=0x7f2ba80c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 --2- 172.21.15.114:0/2210562291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ba814f110 0x7f2ba80c65a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b980097c0 tx=0x7f2b9801c3e0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 -- 172.21.15.114:0/2210562291 shutdown_connections 2024-02-17T12:17:09.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 --2- 172.21.15.114:0/2210562291 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ba80c1eb0 0x7f2ba815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 --2- 172.21.15.114:0/2210562291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ba814f110 0x7f2ba80c65a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 -- 172.21.15.114:0/2210562291 >> 172.21.15.114:0/2210562291 conn(0x7f2ba80a8490 msgr2=0x7f2ba80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:09.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 -- 172.21.15.114:0/2210562291 shutdown_connections 2024-02-17T12:17:09.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 -- 172.21.15.114:0/2210562291 wait complete. 2024-02-17T12:17:09.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 Processor -- start 2024-02-17T12:17:09.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 -- start start 2024-02-17T12:17:09.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ba80c1eb0 0x7f2ba8144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ba80c2580 0x7f2ba8154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba814f110 0x7f2ba8154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba81f1270 con 0x7f2ba814f110 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba81ee250 con 0x7f2ba80c1eb0 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2bada00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba81ed980 con 0x7f2ba80c2580 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2ba7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba814f110 0x7f2ba8154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2ba7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba814f110 0x7f2ba8154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42640/0 (socket says 172.21.15.114:42640) 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2ba7400640 1 -- 172.21.15.114:0/3842204666 learned_addr learned my addr 172.21.15.114:0/3842204666 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2ba6000640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ba80c2580 0x7f2ba8154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2ba6a00640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ba80c1eb0 0x7f2ba8144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2ba7400640 1 -- 172.21.15.114:0/3842204666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ba80c2580 msgr2=0x7f2ba8154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2ba7400640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ba80c2580 0x7f2ba8154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2ba7400640 1 -- 172.21.15.114:0/3842204666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ba80c1eb0 msgr2=0x7f2ba8144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2ba7400640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ba80c1eb0 0x7f2ba8144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.910+0000 7f2ba7400640 1 -- 172.21.15.114:0/3842204666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98009420 con 0x7f2ba814f110 2024-02-17T12:17:09.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2ba7400640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba814f110 0x7f2ba8154790 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000efc0 tx=0x7f2ba000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:09.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2b9ea00640 1 -- 172.21.15.114:0/3842204666 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0009b20 con 0x7f2ba814f110 2024-02-17T12:17:09.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2b9ea00640 1 -- 172.21.15.114:0/3842204666 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba000f040 con 0x7f2ba814f110 2024-02-17T12:17:09.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2bada00640 1 -- 172.21.15.114:0/3842204666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba81f0f90 con 0x7f2ba814f110 2024-02-17T12:17:09.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2b9ea00640 1 -- 172.21.15.114:0/3842204666 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00146c0 con 0x7f2ba814f110 2024-02-17T12:17:09.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2bada00640 1 -- 172.21.15.114:0/3842204666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba81ede70 con 0x7f2ba814f110 2024-02-17T12:17:09.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2bada00640 1 -- 172.21.15.114:0/3842204666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba81ee390 con 0x7f2ba814f110 2024-02-17T12:17:09.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2b9ea00640 1 -- 172.21.15.114:0/3842204666 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2ba0014820 con 0x7f2ba814f110 2024-02-17T12:17:09.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2b9ea00640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b88066e40 0x7f2b88069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:09.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2b9ea00640 1 -- 172.21.15.114:0/3842204666 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ba00856d0 con 0x7f2ba814f110 2024-02-17T12:17:09.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.914+0000 7f2ba6a00640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b88066e40 0x7f2b88069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:09.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.918+0000 7f2ba6a00640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b88066e40 0x7f2b88069300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b980ae000 tx=0x7f2b98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:09.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:09.918+0000 7f2b9ea00640 1 -- 172.21.15.114:0/3842204666 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2ba81ee390 con 0x7f2ba814f110 2024-02-17T12:17:10.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.070+0000 7f2bada00640 1 -- 172.21.15.114:0/3842204666 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ba8152440 con 0x7f2b88066e40 2024-02-17T12:17:10.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.078+0000 7f2b9ea00640 1 -- 172.21.15.114:0/3842204666 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256747 (secure 0 0 0) 0x7f2b980ac910 con 0x7f2b88066e40 2024-02-17T12:17:10.088 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:10.091 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:17:10.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 -- 172.21.15.114:0/3842204666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b88066e40 msgr2=0x7f2b88069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b88066e40 0x7f2b88069300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b980ae000 tx=0x7f2b98008040 comp rx=0 tx=0).stop 2024-02-17T12:17:10.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 -- 172.21.15.114:0/3842204666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba814f110 msgr2=0x7f2ba8154790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba814f110 0x7f2ba8154790 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000efc0 tx=0x7f2ba000c490 comp rx=0 tx=0).stop 2024-02-17T12:17:10.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 -- 172.21.15.114:0/3842204666 shutdown_connections 2024-02-17T12:17:10.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b88066e40 0x7f2b88069300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba814f110 0x7f2ba8154790 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ba80c2580 0x7f2ba8154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 --2- 172.21.15.114:0/3842204666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ba80c1eb0 0x7f2ba8144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 -- 172.21.15.114:0/3842204666 >> 172.21.15.114:0/3842204666 conn(0x7f2ba80a8490 msgr2=0x7f2ba80c3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:10.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 -- 172.21.15.114:0/3842204666 shutdown_connections 2024-02-17T12:17:10.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.082+0000 7f2bada00640 1 -- 172.21.15.114:0/3842204666 wait complete. 2024-02-17T12:17:10.108 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-02-17T12:17:09.226076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":140,"acting":140,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223980,"kb_used_data":3636,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750740,"statfs":{"total":773094113280,"available":772864757760,"internally_reserved":0,"allocated":3723264,"data_stored":2118581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.220497"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021999+0000","last_change":"2024-02-17T12:17:05.021999+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021999+0000","last_undegraded":"2024-02-17T12:17:05.021999+0000","last_fullsized":"2024-02-17T12:17:05.021999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.023424+0000","last_change":"2024-02-17T12:17:05.023424+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.023424+0000","last_undegraded":"2024-02-17T12:17:05.023424+0000","last_fullsized":"2024-02-17T12:17:05.023424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015930+0000","last_change":"2024-02-17T12:17:05.015930+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015930+0000","last_undegraded":"2024-02-17T12:17:05.015930+0000","last_fullsized":"2024-02-17T12:17:05.015930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021531+0000","last_change":"2024-02-17T12:17:05.021531+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021531+0000","last_undegraded":"2024-02-17T12:17:05.021531+0000","last_fullsized":"2024-02-17T12:17:05.021531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.023173+0000","last_change":"2024-02-17T12:17:05.023173+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.023173+0000","last_undegraded":"2024-02-17T12:17:05.023173+0000","last_fullsized":"2024-02-17T12:17:05.023173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020903+0000","last_change":"2024-02-17T12:17:05.020903+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020903+0000","last_undegraded":"2024-02-17T12:17:05.020903+0000","last_fullsized":"2024-02-17T12:17:05.020903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.016508+0000","last_change":"2024-02-17T12:17:05.016508+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.016508+0000","last_undegraded":"2024-02-17T12:17:05.016508+0000","last_fullsized":"2024-02-17T12:17:05.016508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.022619+0000","last_change":"2024-02-17T12:17:05.022619+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.022619+0000","last_undegraded":"2024-02-17T12:17:05.022619+0000","last_fullsized":"2024-02-17T12:17:05.022619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015643+0000","last_change":"2024-02-17T12:17:05.015643+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015643+0000","last_undegraded":"2024-02-17T12:17:05.015643+0000","last_fullsized":"2024-02-17T12:17:05.015643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021207+0000","last_change":"2024-02-17T12:17:05.021207+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021207+0000","last_undegraded":"2024-02-17T12:17:05.021207+0000","last_fullsized":"2024-02-17T12:17:05.021207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020746+0000","last_change":"2024-02-17T12:17:05.020746+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020746+0000","last_undegraded":"2024-02-17T12:17:05.020746+0000","last_fullsized":"2024-02-17T12:17:05.020746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.024948+0000","last_change":"2024-02-17T12:17:05.024948+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.024948+0000","last_undegraded":"2024-02-17T12:17:05.024948+0000","last_fullsized":"2024-02-17T12:17:05.024948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015857+0000","last_change":"2024-02-17T12:17:05.015857+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015857+0000","last_undegraded":"2024-02-17T12:17:05.015857+0000","last_fullsized":"2024-02-17T12:17:05.015857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018823+0000","last_change":"2024-02-17T12:17:05.018823+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018823+0000","last_undegraded":"2024-02-17T12:17:05.018823+0000","last_fullsized":"2024-02-17T12:17:05.018823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020119+0000","last_change":"2024-02-17T12:17:05.020119+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020119+0000","last_undegraded":"2024-02-17T12:17:05.020119+0000","last_fullsized":"2024-02-17T12:17:05.020119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019781+0000","last_change":"2024-02-17T12:17:05.019781+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019781+0000","last_undegraded":"2024-02-17T12:17:05.019781+0000","last_fullsized":"2024-02-17T12:17:05.019781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015108+0000","last_change":"2024-02-17T12:17:05.015108+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015108+0000","last_undegraded":"2024-02-17T12:17:05.015108+0000","last_fullsized":"2024-02-17T12:17:05.015108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021688+0000","last_change":"2024-02-17T12:17:05.021688+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021688+0000","last_undegraded":"2024-02-17T12:17:05.021688+0000","last_fullsized":"2024-02-17T12:17:05.021688+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.027129+0000","last_change":"2024-02-17T12:17:05.027129+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.027129+0000","last_undegraded":"2024-02-17T12:17:05.027129+0000","last_fullsized":"2024-02-17T12:17:05.027129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.034976+0000","last_change":"2024-02-17T12:17:05.029800+0000","last_active":"2024-02-17T12:17:05.034976+0000","last_peered":"2024-02-17T12:17:05.034976+0000","last_clean":"2024-02-17T12:17:05.034976+0000","last_became_active":"2024-02-17T12:17:05.029482+0000","last_became_peered":"2024-02-17T12:17:05.029482+0000","last_unstale":"2024-02-17T12:17:05.034976+0000","last_undegraded":"2024-02-17T12:17:05.034976+0000","last_fullsized":"2024-02-17T12:17:05.034976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:01:36.502802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021555+0000","last_change":"2024-02-17T12:17:05.021555+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021555+0000","last_undegraded":"2024-02-17T12:17:05.021555+0000","last_fullsized":"2024-02-17T12:17:05.021555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044604+0000","last_change":"2024-02-17T12:17:05.039687+0000","last_active":"2024-02-17T12:17:05.044604+0000","last_peered":"2024-02-17T12:17:05.044604+0000","last_clean":"2024-02-17T12:17:05.044604+0000","last_became_active":"2024-02-17T12:17:05.039381+0000","last_became_peered":"2024-02-17T12:17:05.039381+0000","last_unstale":"2024-02-17T12:17:05.044604+0000","last_undegraded":"2024-02-17T12:17:05.044604+0000","last_fullsized":"2024-02-17T12:17:05.044604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:36:34.983677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041802+0000","last_change":"2024-02-17T12:17:05.033787+0000","last_active":"2024-02-17T12:17:05.041802+0000","last_peered":"2024-02-17T12:17:05.041802+0000","last_clean":"2024-02-17T12:17:05.041802+0000","last_became_active":"2024-02-17T12:17:05.033470+0000","last_became_peered":"2024-02-17T12:17:05.033470+0000","last_unstale":"2024-02-17T12:17:05.041802+0000","last_undegraded":"2024-02-17T12:17:05.041802+0000","last_fullsized":"2024-02-17T12:17:05.041802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019217+0000","last_change":"2024-02-17T12:17:05.019217+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019217+0000","last_undegraded":"2024-02-17T12:17:05.019217+0000","last_fullsized":"2024-02-17T12:17:05.019217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.011402+0000","last_change":"2024-02-17T12:17:04.011402+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.011402+0000","last_undegraded":"2024-02-17T12:17:04.011402+0000","last_fullsized":"2024-02-17T12:17:04.011402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.011438+0000","last_change":"2024-02-17T12:17:04.011438+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.011438+0000","last_undegraded":"2024-02-17T12:17:04.011438+0000","last_fullsized":"2024-02-17T12:17:04.011438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015155+0000","last_change":"2024-02-17T12:17:05.015155+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015155+0000","last_undegraded":"2024-02-17T12:17:05.015155+0000","last_fullsized":"2024-02-17T12:17:05.015155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009681+0000","last_change":"2024-02-17T12:17:04.009681+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009681+0000","last_undegraded":"2024-02-17T12:17:04.009681+0000","last_fullsized":"2024-02-17T12:17:04.009681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.040125+0000","last_change":"2024-02-17T12:17:05.030240+0000","last_active":"2024-02-17T12:17:05.040125+0000","last_peered":"2024-02-17T12:17:05.040125+0000","last_clean":"2024-02-17T12:17:05.040125+0000","last_became_active":"2024-02-17T12:17:05.029142+0000","last_became_peered":"2024-02-17T12:17:05.029142+0000","last_unstale":"2024-02-17T12:17:05.040125+0000","last_undegraded":"2024-02-17T12:17:05.040125+0000","last_fullsized":"2024-02-17T12:17:05.040125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:01:36.502802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019933+0000","last_change":"2024-02-17T12:17:05.019933+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019933+0000","last_undegraded":"2024-02-17T12:17:05.019933+0000","last_fullsized":"2024-02-17T12:17:05.019933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.010789+0000","last_change":"2024-02-17T12:17:04.010789+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.010789+0000","last_undegraded":"2024-02-17T12:17:04.010789+0000","last_fullsized":"2024-02-17T12:17:04.010789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015802+0000","last_change":"2024-02-17T12:17:05.015802+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015802+0000","last_undegraded":"2024-02-17T12:17:05.015802+0000","last_fullsized":"2024-02-17T12:17:05.015802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044118+0000","last_change":"2024-02-17T12:17:05.040696+0000","last_active":"2024-02-17T12:17:05.044118+0000","last_peered":"2024-02-17T12:17:05.044118+0000","last_clean":"2024-02-17T12:17:05.044118+0000","last_became_active":"2024-02-17T12:17:05.040185+0000","last_became_peered":"2024-02-17T12:17:05.040185+0000","last_unstale":"2024-02-17T12:17:05.044118+0000","last_undegraded":"2024-02-17T12:17:05.044118+0000","last_fullsized":"2024-02-17T12:17:05.044118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:29.147863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018515+0000","last_change":"2024-02-17T12:17:05.018515+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018515+0000","last_undegraded":"2024-02-17T12:17:05.018515+0000","last_fullsized":"2024-02-17T12:17:05.018515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044613+0000","last_change":"2024-02-17T12:17:05.042848+0000","last_active":"2024-02-17T12:17:05.044613+0000","last_peered":"2024-02-17T12:17:05.044613+0000","last_clean":"2024-02-17T12:17:05.044613+0000","last_became_active":"2024-02-17T12:17:05.042537+0000","last_became_peered":"2024-02-17T12:17:05.042537+0000","last_unstale":"2024-02-17T12:17:05.044613+0000","last_undegraded":"2024-02-17T12:17:05.044613+0000","last_fullsized":"2024-02-17T12:17:05.044613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:19.010045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019403+0000","last_change":"2024-02-17T12:17:05.019403+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019403+0000","last_undegraded":"2024-02-17T12:17:05.019403+0000","last_fullsized":"2024-02-17T12:17:05.019403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041975+0000","last_change":"2024-02-17T12:17:05.038559+0000","last_active":"2024-02-17T12:17:05.041975+0000","last_peered":"2024-02-17T12:17:05.041975+0000","last_clean":"2024-02-17T12:17:05.041975+0000","last_became_active":"2024-02-17T12:17:05.038388+0000","last_became_peered":"2024-02-17T12:17:05.038388+0000","last_unstale":"2024-02-17T12:17:05.041975+0000","last_undegraded":"2024-02-17T12:17:05.041975+0000","last_fullsized":"2024-02-17T12:17:05.041975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:29.147863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.016475+0000","last_change":"2024-02-17T12:17:05.016475+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.016475+0000","last_undegraded":"2024-02-17T12:17:05.016475+0000","last_fullsized":"2024-02-17T12:17:05.016475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041893+0000","last_change":"2024-02-17T12:17:05.034049+0000","last_active":"2024-02-17T12:17:05.041893+0000","last_peered":"2024-02-17T12:17:05.041893+0000","last_clean":"2024-02-17T12:17:05.041893+0000","last_became_active":"2024-02-17T12:17:05.033414+0000","last_became_peered":"2024-02-17T12:17:05.033414+0000","last_unstale":"2024-02-17T12:17:05.041893+0000","last_undegraded":"2024-02-17T12:17:05.041893+0000","last_fullsized":"2024-02-17T12:17:05.041893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018784+0000","last_change":"2024-02-17T12:17:05.018784+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018784+0000","last_undegraded":"2024-02-17T12:17:05.018784+0000","last_fullsized":"2024-02-17T12:17:05.018784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009350+0000","last_change":"2024-02-17T12:17:04.009350+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009350+0000","last_undegraded":"2024-02-17T12:17:04.009350+0000","last_fullsized":"2024-02-17T12:17:04.009350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.017776+0000","last_change":"2024-02-17T12:17:05.017776+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.017776+0000","last_undegraded":"2024-02-17T12:17:05.017776+0000","last_fullsized":"2024-02-17T12:17:05.017776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.040889+0000","last_change":"2024-02-17T12:17:05.032388+0000","last_active":"2024-02-17T12:17:05.040889+0000","last_peered":"2024-02-17T12:17:05.040889+0000","last_clean":"2024-02-17T12:17:05.040889+0000","last_became_active":"2024-02-17T12:17:05.032055+0000","last_became_peered":"2024-02-17T12:17:05.032055+0000","last_unstale":"2024-02-17T12:17:05.040889+0000","last_undegraded":"2024-02-17T12:17:05.040889+0000","last_fullsized":"2024-02-17T12:17:05.040889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:50:37.528650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041986+0000","last_change":"2024-02-17T12:17:05.037345+0000","last_active":"2024-02-17T12:17:05.041986+0000","last_peered":"2024-02-17T12:17:05.041986+0000","last_clean":"2024-02-17T12:17:05.041986+0000","last_became_active":"2024-02-17T12:17:05.037076+0000","last_became_peered":"2024-02-17T12:17:05.037076+0000","last_unstale":"2024-02-17T12:17:05.041986+0000","last_undegraded":"2024-02-17T12:17:05.041986+0000","last_fullsized":"2024-02-17T12:17:05.041986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020422+0000","last_change":"2024-02-17T12:17:05.020422+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020422+0000","last_undegraded":"2024-02-17T12:17:05.020422+0000","last_fullsized":"2024-02-17T12:17:05.020422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041843+0000","last_change":"2024-02-17T12:17:05.033809+0000","last_active":"2024-02-17T12:17:05.041843+0000","last_peered":"2024-02-17T12:17:05.041843+0000","last_clean":"2024-02-17T12:17:05.041843+0000","last_became_active":"2024-02-17T12:17:05.033434+0000","last_became_peered":"2024-02-17T12:17:05.033434+0000","last_unstale":"2024-02-17T12:17:05.041843+0000","last_undegraded":"2024-02-17T12:17:05.041843+0000","last_fullsized":"2024-02-17T12:17:05.041843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044094+0000","last_change":"2024-02-17T12:17:05.039589+0000","last_active":"2024-02-17T12:17:05.044094+0000","last_peered":"2024-02-17T12:17:05.044094+0000","last_clean":"2024-02-17T12:17:05.044094+0000","last_became_active":"2024-02-17T12:17:05.039353+0000","last_became_peered":"2024-02-17T12:17:05.039353+0000","last_unstale":"2024-02-17T12:17:05.044094+0000","last_undegraded":"2024-02-17T12:17:05.044094+0000","last_fullsized":"2024-02-17T12:17:05.044094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:19.010045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.016834+0000","last_change":"2024-02-17T12:17:05.016834+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.016834+0000","last_undegraded":"2024-02-17T12:17:05.016834+0000","last_fullsized":"2024-02-17T12:17:05.016834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.010365+0000","last_change":"2024-02-17T12:17:04.010365+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.010365+0000","last_undegraded":"2024-02-17T12:17:04.010365+0000","last_fullsized":"2024-02-17T12:17:04.010365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018360+0000","last_change":"2024-02-17T12:17:05.018360+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018360+0000","last_undegraded":"2024-02-17T12:17:05.018360+0000","last_fullsized":"2024-02-17T12:17:05.018360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009312+0000","last_change":"2024-02-17T12:17:04.009312+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009312+0000","last_undegraded":"2024-02-17T12:17:04.009312+0000","last_fullsized":"2024-02-17T12:17:04.009312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009289+0000","last_change":"2024-02-17T12:17:04.009289+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009289+0000","last_undegraded":"2024-02-17T12:17:04.009289+0000","last_fullsized":"2024-02-17T12:17:04.009289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.043793+0000","last_change":"2024-02-17T12:17:05.038848+0000","last_active":"2024-02-17T12:17:05.043793+0000","last_peered":"2024-02-17T12:17:05.043793+0000","last_clean":"2024-02-17T12:17:05.043793+0000","last_became_active":"2024-02-17T12:17:05.038528+0000","last_became_peered":"2024-02-17T12:17:05.038528+0000","last_unstale":"2024-02-17T12:17:05.043793+0000","last_undegraded":"2024-02-17T12:17:05.043793+0000","last_fullsized":"2024-02-17T12:17:05.043793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:33:08.214296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.037557+0000","last_change":"2024-02-17T12:17:05.035457+0000","last_active":"2024-02-17T12:17:05.037557+0000","last_peered":"2024-02-17T12:17:05.037557+0000","last_clean":"2024-02-17T12:17:05.037557+0000","last_became_active":"2024-02-17T12:17:05.035024+0000","last_became_peered":"2024-02-17T12:17:05.035024+0000","last_unstale":"2024-02-17T12:17:05.037557+0000","last_undegraded":"2024-02-17T12:17:05.037557+0000","last_fullsized":"2024-02-17T12:17:05.037557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.010291+0000","last_change":"2024-02-17T12:17:04.010291+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.010291+0000","last_undegraded":"2024-02-17T12:17:04.010291+0000","last_fullsized":"2024-02-17T12:17:04.010291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041953+0000","last_change":"2024-02-17T12:17:05.037887+0000","last_active":"2024-02-17T12:17:05.041953+0000","last_peered":"2024-02-17T12:17:05.041953+0000","last_clean":"2024-02-17T12:17:05.041953+0000","last_became_active":"2024-02-17T12:17:05.037587+0000","last_became_peered":"2024-02-17T12:17:05.037587+0000","last_unstale":"2024-02-17T12:17:05.041953+0000","last_undegraded":"2024-02-17T12:17:05.041953+0000","last_fullsized":"2024-02-17T12:17:05.041953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.030942+0000","last_change":"2024-02-17T12:17:05.025815+0000","last_active":"2024-02-17T12:17:05.030942+0000","last_peered":"2024-02-17T12:17:05.030942+0000","last_clean":"2024-02-17T12:17:05.030942+0000","last_became_active":"2024-02-17T12:17:05.025568+0000","last_became_peered":"2024-02-17T12:17:05.025568+0000","last_unstale":"2024-02-17T12:17:05.030942+0000","last_undegraded":"2024-02-17T12:17:05.030942+0000","last_fullsized":"2024-02-17T12:17:05.030942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:16:15.107694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015310+0000","last_change":"2024-02-17T12:17:05.015310+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015310+0000","last_undegraded":"2024-02-17T12:17:05.015310+0000","last_fullsized":"2024-02-17T12:17:05.015310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044585+0000","last_change":"2024-02-17T12:17:05.039517+0000","last_active":"2024-02-17T12:17:05.044585+0000","last_peered":"2024-02-17T12:17:05.044585+0000","last_clean":"2024-02-17T12:17:05.044585+0000","last_became_active":"2024-02-17T12:17:05.039209+0000","last_became_peered":"2024-02-17T12:17:05.039209+0000","last_unstale":"2024-02-17T12:17:05.044585+0000","last_undegraded":"2024-02-17T12:17:05.044585+0000","last_fullsized":"2024-02-17T12:17:05.044585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:50:37.528650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.026078+0000","last_change":"2024-02-17T12:17:05.026078+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.026078+0000","last_undegraded":"2024-02-17T12:17:05.026078+0000","last_fullsized":"2024-02-17T12:17:05.026078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.042032+0000","last_change":"2024-02-17T12:17:05.037708+0000","last_active":"2024-02-17T12:17:05.042032+0000","last_peered":"2024-02-17T12:17:05.042032+0000","last_clean":"2024-02-17T12:17:05.042032+0000","last_became_active":"2024-02-17T12:17:05.037213+0000","last_became_peered":"2024-02-17T12:17:05.037213+0000","last_unstale":"2024-02-17T12:17:05.042032+0000","last_undegraded":"2024-02-17T12:17:05.042032+0000","last_fullsized":"2024-02-17T12:17:05.042032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:36:34.983677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020596+0000","last_change":"2024-02-17T12:17:05.020596+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020596+0000","last_undegraded":"2024-02-17T12:17:05.020596+0000","last_fullsized":"2024-02-17T12:17:05.020596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041747+0000","last_change":"2024-02-17T12:17:05.034917+0000","last_active":"2024-02-17T12:17:05.041747+0000","last_peered":"2024-02-17T12:17:05.041747+0000","last_clean":"2024-02-17T12:17:05.041747+0000","last_became_active":"2024-02-17T12:17:05.034653+0000","last_became_peered":"2024-02-17T12:17:05.034653+0000","last_unstale":"2024-02-17T12:17:05.041747+0000","last_undegraded":"2024-02-17T12:17:05.041747+0000","last_fullsized":"2024-02-17T12:17:05.041747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:16:15.107694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.028102+0000","last_change":"2024-02-17T12:17:05.028102+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.028102+0000","last_undegraded":"2024-02-17T12:17:05.028102+0000","last_fullsized":"2024-02-17T12:17:05.028102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.031171+0000","last_change":"2024-02-17T12:17:05.026508+0000","last_active":"2024-02-17T12:17:05.031171+0000","last_peered":"2024-02-17T12:17:05.031171+0000","last_clean":"2024-02-17T12:17:05.031171+0000","last_became_active":"2024-02-17T12:17:05.026238+0000","last_became_peered":"2024-02-17T12:17:05.026238+0000","last_unstale":"2024-02-17T12:17:05.031171+0000","last_undegraded":"2024-02-17T12:17:05.031171+0000","last_fullsized":"2024-02-17T12:17:05.031171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:33:08.214296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021248+0000","last_change":"2024-02-17T12:17:05.021248+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021248+0000","last_undegraded":"2024-02-17T12:17:05.021248+0000","last_fullsized":"2024-02-17T12:17:05.021248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009717+0000","last_change":"2024-02-17T12:17:04.009717+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009717+0000","last_undegraded":"2024-02-17T12:17:04.009717+0000","last_fullsized":"2024-02-17T12:17:04.009717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041960+0000","last_change":"2024-02-17T12:17:05.036670+0000","last_active":"2024-02-17T12:17:05.041960+0000","last_peered":"2024-02-17T12:17:05.041960+0000","last_clean":"2024-02-17T12:17:05.041960+0000","last_became_active":"2024-02-17T12:17:05.036395+0000","last_became_peered":"2024-02-17T12:17:05.036395+0000","last_unstale":"2024-02-17T12:17:05.041960+0000","last_undegraded":"2024-02-17T12:17:05.041960+0000","last_fullsized":"2024-02-17T12:17:05.041960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.040343+0000","last_change":"2024-02-17T12:17:05.036734+0000","last_active":"2024-02-17T12:17:05.040343+0000","last_peered":"2024-02-17T12:17:05.040343+0000","last_clean":"2024-02-17T12:17:05.040343+0000","last_became_active":"2024-02-17T12:17:05.036453+0000","last_became_peered":"2024-02-17T12:17:05.036453+0000","last_unstale":"2024-02-17T12:17:05.040343+0000","last_undegraded":"2024-02-17T12:17:05.040343+0000","last_fullsized":"2024-02-17T12:17:05.040343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-17T12:17:04.014249+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:17:04.014249+0000","last_peered":"2024-02-17T12:17:04.014249+0000","last_clean":"2024-02-17T12:17:04.014249+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:17:04.014249+0000","last_undegraded":"2024-02-17T12:17:04.014249+0000","last_fullsized":"2024-02-17T12:17:04.014249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":74,"acting":74,"num_store_stats":5},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":122658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":122658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":706759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":706759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":303104,"data_stored":110574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":116391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:17:10.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:17:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc9a0c00640 1 Processor -- start 2024-02-17T12:17:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc9a0c00640 1 -- start start 2024-02-17T12:17:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc9a0c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c14f110 0x7fc99c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc9a0c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c0a9420 con 0x7fc99c0c2580 2024-02-17T12:17:10.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc9a0c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c152850 con 0x7fc99c0c1eb0 2024-02-17T12:17:10.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc9a0c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c14f4f0 con 0x7fc99c14f110 2024-02-17T12:17:10.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc999400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc99c0c2580 0x7fc99c0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50798/0 (socket says 172.21.15.114:50798) 2024-02-17T12:17:10.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc999400640 1 -- 172.21.15.114:0/2581644332 learned_addr learned my addr 172.21.15.114:0/2581644332 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc999e00640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c14f110 0x7fc99c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566040140 0 0) 0x7fc99c0a9420 con 0x7fc99c0c2580 2024-02-17T12:17:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc980003530 con 0x7fc99c0c2580 2024-02-17T12:17:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784978309 0 0) 0x7fc980003530 con 0x7fc99c0c2580 2024-02-17T12:17:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c14f110 msgr2=0x7fc99c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc998a00640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c14f110 0x7fc99c0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 >> v1:172.21.15.116:6789/0 conn(0x7fc99c0c1eb0 legacy=0x7fc99c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0a9670 con 0x7fc99c0c2580 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.278+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fc988001680 con 0x7fc99c0c2580 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 >> v1:172.21.15.114:6789/0 conn(0x7fc99c0c2580 legacy=0x7fc99c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc998a00640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c14f110 0x7fc9800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc998a00640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc980003f80 0x7fc9800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc998a00640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980004d10 0x7fc980005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c14f4f0 con 0x7fc980004d10 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98000bb80 con 0x7fc980003f80 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98000df50 con 0x7fc99c14f110 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc99a800640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980004d10 0x7fc980005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc999400640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc980003f80 0x7fc9800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc999e00640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c14f110 0x7fc9800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc99a800640 1 -- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c14f110 msgr2=0x7fc9800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc99a800640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c14f110 0x7fc9800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc99a800640 1 -- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc980003f80 msgr2=0x7fc9800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc99a800640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc980003f80 0x7fc9800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc99a800640 1 -- 172.21.15.114:0/2581644332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980003530 con 0x7fc980004d10 2024-02-17T12:17:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc99a800640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980004d10 0x7fc980005190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc994001e40 tx=0x7fc99401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b081fbdf8a34e8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:10.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994003b80 con 0x7fc980004d10 2024-02-17T12:17:10.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994003ce0 con 0x7fc980004d10 2024-02-17T12:17:10.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.282+0000 7fc998a00640 1 -- 172.21.15.114:0/2581644332 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940052c0 con 0x7fc980004d10 2024-02-17T12:17:10.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 -- 172.21.15.114:0/2581644332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980004d10 msgr2=0x7fc980005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 --2- 172.21.15.114:0/2581644332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc980004d10 0x7fc980005190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc994001e40 tx=0x7fc99401c760 comp rx=0 tx=0).stop 2024-02-17T12:17:10.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc99a800640 1 -- 172.21.15.114:0/2581644332 reap_dead start 2024-02-17T12:17:10.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 -- 172.21.15.114:0/2581644332 shutdown_connections 2024-02-17T12:17:10.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 -- 172.21.15.114:0/2581644332 >> 172.21.15.114:0/2581644332 conn(0x7fc99c0a8490 msgr2=0x7fc99c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:10.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 -- 172.21.15.114:0/2581644332 shutdown_connections 2024-02-17T12:17:10.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 -- 172.21.15.114:0/2581644332 wait complete. 2024-02-17T12:17:10.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 Processor -- start 2024-02-17T12:17:10.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 -- start start 2024-02-17T12:17:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c146b30 0x7fc99c1ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc99c146f10 0x7fc99c14bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc99c14c170 0x7fc99c14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0c5000 con 0x7fc99c14c170 2024-02-17T12:17:10.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c14cd60 con 0x7fc99c146f10 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc9a0c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0bfcc0 con 0x7fc99c146b30 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc99a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc99c14c170 0x7fc99c14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc99a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc99c14c170 0x7fc99c14d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42652/0 (socket says 172.21.15.114:42652) 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc99a800640 1 -- 172.21.15.114:0/3033863210 learned_addr learned my addr 172.21.15.114:0/3033863210 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc999400640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc99c146f10 0x7fc99c14bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc999e00640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c146b30 0x7fc99c1ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc99a800640 1 -- 172.21.15.114:0/3033863210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c146b30 msgr2=0x7fc99c1ee4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc99a800640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c146b30 0x7fc99c1ee4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc99a800640 1 -- 172.21.15.114:0/3033863210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc99c146f10 msgr2=0x7fc99c14bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc99a800640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc99c146f10 0x7fc99c14bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.286+0000 7fc99a800640 1 -- 172.21.15.114:0/3033863210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0c44c0 con 0x7fc99c14c170 2024-02-17T12:17:10.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc99a800640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc99c14c170 0x7fc99c14d1b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc99401cc40 tx=0x7fc980005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:10.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc992000640 1 -- 172.21.15.114:0/3033863210 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994005810 con 0x7fc99c14c170 2024-02-17T12:17:10.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc992000640 1 -- 172.21.15.114:0/3033863210 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994007dc0 con 0x7fc99c14c170 2024-02-17T12:17:10.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc992000640 1 -- 172.21.15.114:0/3033863210 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994006d60 con 0x7fc99c14c170 2024-02-17T12:17:10.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc9a0c00640 1 -- 172.21.15.114:0/3033863210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c0c4760 con 0x7fc99c14c170 2024-02-17T12:17:10.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc9a0c00640 1 -- 172.21.15.114:0/3033863210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c0c4d20 con 0x7fc99c14c170 2024-02-17T12:17:10.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc9a0c00640 1 -- 172.21.15.114:0/3033863210 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c14ced0 con 0x7fc99c14c170 2024-02-17T12:17:10.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc992000640 1 -- 172.21.15.114:0/3033863210 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fc994007030 con 0x7fc99c14c170 2024-02-17T12:17:10.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc992000640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc97c066e70 0x7fc97c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc992000640 1 -- 172.21.15.114:0/3033863210 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc99411d6c0 con 0x7fc99c14c170 2024-02-17T12:17:10.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.290+0000 7fc999e00640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc97c066e70 0x7fc97c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.294+0000 7fc999e00640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc97c066e70 0x7fc97c069330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009be0 tx=0x7fc98c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:10.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.294+0000 7fc992000640 1 -- 172.21.15.114:0/3033863210 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc99c14ced0 con 0x7fc99c14c170 2024-02-17T12:17:10.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.450+0000 7fc9a0c00640 1 -- 172.21.15.114:0/3033863210 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc99c0a9c30 con 0x7fc97c066e70 2024-02-17T12:17:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.454+0000 7fc992000640 1 -- 172.21.15.114:0/3033863210 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256747 (secure 0 0 0) 0x7fc98c019070 con 0x7fc97c066e70 2024-02-17T12:17:10.465 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:10.467 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:17:10.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 -- 172.21.15.114:0/3033863210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc97c066e70 msgr2=0x7fc97c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc97c066e70 0x7fc97c069330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009be0 tx=0x7fc98c009190 comp rx=0 tx=0).stop 2024-02-17T12:17:10.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 -- 172.21.15.114:0/3033863210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc99c14c170 msgr2=0x7fc99c14d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc99c14c170 0x7fc99c14d1b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc99401cc40 tx=0x7fc980005800 comp rx=0 tx=0).stop 2024-02-17T12:17:10.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 -- 172.21.15.114:0/3033863210 shutdown_connections 2024-02-17T12:17:10.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc97c066e70 0x7fc97c069330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc99c14c170 0x7fc99c14d1b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc99c146f10 0x7fc99c14bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 --2- 172.21.15.114:0/3033863210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc99c146b30 0x7fc99c1ee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 -- 172.21.15.114:0/3033863210 >> 172.21.15.114:0/3033863210 conn(0x7fc99c0a8490 msgr2=0x7fc99c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:10.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 -- 172.21.15.114:0/3033863210 shutdown_connections 2024-02-17T12:17:10.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.458+0000 7fc9a0c00640 1 -- 172.21.15.114:0/3033863210 wait complete. 2024-02-17T12:17:10.485 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-02-17T12:17:09.226076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":140,"acting":140,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223980,"kb_used_data":3636,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750740,"statfs":{"total":773094113280,"available":772864757760,"internally_reserved":0,"allocated":3723264,"data_stored":2118581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.220497"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021999+0000","last_change":"2024-02-17T12:17:05.021999+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021999+0000","last_undegraded":"2024-02-17T12:17:05.021999+0000","last_fullsized":"2024-02-17T12:17:05.021999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.023424+0000","last_change":"2024-02-17T12:17:05.023424+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.023424+0000","last_undegraded":"2024-02-17T12:17:05.023424+0000","last_fullsized":"2024-02-17T12:17:05.023424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015930+0000","last_change":"2024-02-17T12:17:05.015930+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015930+0000","last_undegraded":"2024-02-17T12:17:05.015930+0000","last_fullsized":"2024-02-17T12:17:05.015930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021531+0000","last_change":"2024-02-17T12:17:05.021531+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021531+0000","last_undegraded":"2024-02-17T12:17:05.021531+0000","last_fullsized":"2024-02-17T12:17:05.021531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.023173+0000","last_change":"2024-02-17T12:17:05.023173+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.023173+0000","last_undegraded":"2024-02-17T12:17:05.023173+0000","last_fullsized":"2024-02-17T12:17:05.023173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020903+0000","last_change":"2024-02-17T12:17:05.020903+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020903+0000","last_undegraded":"2024-02-17T12:17:05.020903+0000","last_fullsized":"2024-02-17T12:17:05.020903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.016508+0000","last_change":"2024-02-17T12:17:05.016508+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.016508+0000","last_undegraded":"2024-02-17T12:17:05.016508+0000","last_fullsized":"2024-02-17T12:17:05.016508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.022619+0000","last_change":"2024-02-17T12:17:05.022619+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.022619+0000","last_undegraded":"2024-02-17T12:17:05.022619+0000","last_fullsized":"2024-02-17T12:17:05.022619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015643+0000","last_change":"2024-02-17T12:17:05.015643+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015643+0000","last_undegraded":"2024-02-17T12:17:05.015643+0000","last_fullsized":"2024-02-17T12:17:05.015643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021207+0000","last_change":"2024-02-17T12:17:05.021207+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021207+0000","last_undegraded":"2024-02-17T12:17:05.021207+0000","last_fullsized":"2024-02-17T12:17:05.021207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020746+0000","last_change":"2024-02-17T12:17:05.020746+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020746+0000","last_undegraded":"2024-02-17T12:17:05.020746+0000","last_fullsized":"2024-02-17T12:17:05.020746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.024948+0000","last_change":"2024-02-17T12:17:05.024948+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.024948+0000","last_undegraded":"2024-02-17T12:17:05.024948+0000","last_fullsized":"2024-02-17T12:17:05.024948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015857+0000","last_change":"2024-02-17T12:17:05.015857+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015857+0000","last_undegraded":"2024-02-17T12:17:05.015857+0000","last_fullsized":"2024-02-17T12:17:05.015857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018823+0000","last_change":"2024-02-17T12:17:05.018823+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018823+0000","last_undegraded":"2024-02-17T12:17:05.018823+0000","last_fullsized":"2024-02-17T12:17:05.018823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020119+0000","last_change":"2024-02-17T12:17:05.020119+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020119+0000","last_undegraded":"2024-02-17T12:17:05.020119+0000","last_fullsized":"2024-02-17T12:17:05.020119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019781+0000","last_change":"2024-02-17T12:17:05.019781+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019781+0000","last_undegraded":"2024-02-17T12:17:05.019781+0000","last_fullsized":"2024-02-17T12:17:05.019781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015108+0000","last_change":"2024-02-17T12:17:05.015108+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015108+0000","last_undegraded":"2024-02-17T12:17:05.015108+0000","last_fullsized":"2024-02-17T12:17:05.015108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021688+0000","last_change":"2024-02-17T12:17:05.021688+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021688+0000","last_undegraded":"2024-02-17T12:17:05.021688+0000","last_fullsized":"2024-02-17T12:17:05.021688+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.027129+0000","last_change":"2024-02-17T12:17:05.027129+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.027129+0000","last_undegraded":"2024-02-17T12:17:05.027129+0000","last_fullsized":"2024-02-17T12:17:05.027129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.034976+0000","last_change":"2024-02-17T12:17:05.029800+0000","last_active":"2024-02-17T12:17:05.034976+0000","last_peered":"2024-02-17T12:17:05.034976+0000","last_clean":"2024-02-17T12:17:05.034976+0000","last_became_active":"2024-02-17T12:17:05.029482+0000","last_became_peered":"2024-02-17T12:17:05.029482+0000","last_unstale":"2024-02-17T12:17:05.034976+0000","last_undegraded":"2024-02-17T12:17:05.034976+0000","last_fullsized":"2024-02-17T12:17:05.034976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:01:36.502802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021555+0000","last_change":"2024-02-17T12:17:05.021555+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021555+0000","last_undegraded":"2024-02-17T12:17:05.021555+0000","last_fullsized":"2024-02-17T12:17:05.021555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044604+0000","last_change":"2024-02-17T12:17:05.039687+0000","last_active":"2024-02-17T12:17:05.044604+0000","last_peered":"2024-02-17T12:17:05.044604+0000","last_clean":"2024-02-17T12:17:05.044604+0000","last_became_active":"2024-02-17T12:17:05.039381+0000","last_became_peered":"2024-02-17T12:17:05.039381+0000","last_unstale":"2024-02-17T12:17:05.044604+0000","last_undegraded":"2024-02-17T12:17:05.044604+0000","last_fullsized":"2024-02-17T12:17:05.044604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:36:34.983677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041802+0000","last_change":"2024-02-17T12:17:05.033787+0000","last_active":"2024-02-17T12:17:05.041802+0000","last_peered":"2024-02-17T12:17:05.041802+0000","last_clean":"2024-02-17T12:17:05.041802+0000","last_became_active":"2024-02-17T12:17:05.033470+0000","last_became_peered":"2024-02-17T12:17:05.033470+0000","last_unstale":"2024-02-17T12:17:05.041802+0000","last_undegraded":"2024-02-17T12:17:05.041802+0000","last_fullsized":"2024-02-17T12:17:05.041802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019217+0000","last_change":"2024-02-17T12:17:05.019217+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019217+0000","last_undegraded":"2024-02-17T12:17:05.019217+0000","last_fullsized":"2024-02-17T12:17:05.019217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.011402+0000","last_change":"2024-02-17T12:17:04.011402+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.011402+0000","last_undegraded":"2024-02-17T12:17:04.011402+0000","last_fullsized":"2024-02-17T12:17:04.011402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.011438+0000","last_change":"2024-02-17T12:17:04.011438+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.011438+0000","last_undegraded":"2024-02-17T12:17:04.011438+0000","last_fullsized":"2024-02-17T12:17:04.011438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015155+0000","last_change":"2024-02-17T12:17:05.015155+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015155+0000","last_undegraded":"2024-02-17T12:17:05.015155+0000","last_fullsized":"2024-02-17T12:17:05.015155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009681+0000","last_change":"2024-02-17T12:17:04.009681+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009681+0000","last_undegraded":"2024-02-17T12:17:04.009681+0000","last_fullsized":"2024-02-17T12:17:04.009681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.040125+0000","last_change":"2024-02-17T12:17:05.030240+0000","last_active":"2024-02-17T12:17:05.040125+0000","last_peered":"2024-02-17T12:17:05.040125+0000","last_clean":"2024-02-17T12:17:05.040125+0000","last_became_active":"2024-02-17T12:17:05.029142+0000","last_became_peered":"2024-02-17T12:17:05.029142+0000","last_unstale":"2024-02-17T12:17:05.040125+0000","last_undegraded":"2024-02-17T12:17:05.040125+0000","last_fullsized":"2024-02-17T12:17:05.040125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:01:36.502802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019933+0000","last_change":"2024-02-17T12:17:05.019933+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019933+0000","last_undegraded":"2024-02-17T12:17:05.019933+0000","last_fullsized":"2024-02-17T12:17:05.019933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.010789+0000","last_change":"2024-02-17T12:17:04.010789+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.010789+0000","last_undegraded":"2024-02-17T12:17:04.010789+0000","last_fullsized":"2024-02-17T12:17:04.010789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015802+0000","last_change":"2024-02-17T12:17:05.015802+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015802+0000","last_undegraded":"2024-02-17T12:17:05.015802+0000","last_fullsized":"2024-02-17T12:17:05.015802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044118+0000","last_change":"2024-02-17T12:17:05.040696+0000","last_active":"2024-02-17T12:17:05.044118+0000","last_peered":"2024-02-17T12:17:05.044118+0000","last_clean":"2024-02-17T12:17:05.044118+0000","last_became_active":"2024-02-17T12:17:05.040185+0000","last_became_peered":"2024-02-17T12:17:05.040185+0000","last_unstale":"2024-02-17T12:17:05.044118+0000","last_undegraded":"2024-02-17T12:17:05.044118+0000","last_fullsized":"2024-02-17T12:17:05.044118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:29.147863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018515+0000","last_change":"2024-02-17T12:17:05.018515+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018515+0000","last_undegraded":"2024-02-17T12:17:05.018515+0000","last_fullsized":"2024-02-17T12:17:05.018515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044613+0000","last_change":"2024-02-17T12:17:05.042848+0000","last_active":"2024-02-17T12:17:05.044613+0000","last_peered":"2024-02-17T12:17:05.044613+0000","last_clean":"2024-02-17T12:17:05.044613+0000","last_became_active":"2024-02-17T12:17:05.042537+0000","last_became_peered":"2024-02-17T12:17:05.042537+0000","last_unstale":"2024-02-17T12:17:05.044613+0000","last_undegraded":"2024-02-17T12:17:05.044613+0000","last_fullsized":"2024-02-17T12:17:05.044613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:19.010045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019403+0000","last_change":"2024-02-17T12:17:05.019403+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019403+0000","last_undegraded":"2024-02-17T12:17:05.019403+0000","last_fullsized":"2024-02-17T12:17:05.019403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041975+0000","last_change":"2024-02-17T12:17:05.038559+0000","last_active":"2024-02-17T12:17:05.041975+0000","last_peered":"2024-02-17T12:17:05.041975+0000","last_clean":"2024-02-17T12:17:05.041975+0000","last_became_active":"2024-02-17T12:17:05.038388+0000","last_became_peered":"2024-02-17T12:17:05.038388+0000","last_unstale":"2024-02-17T12:17:05.041975+0000","last_undegraded":"2024-02-17T12:17:05.041975+0000","last_fullsized":"2024-02-17T12:17:05.041975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:29.147863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.016475+0000","last_change":"2024-02-17T12:17:05.016475+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.016475+0000","last_undegraded":"2024-02-17T12:17:05.016475+0000","last_fullsized":"2024-02-17T12:17:05.016475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041893+0000","last_change":"2024-02-17T12:17:05.034049+0000","last_active":"2024-02-17T12:17:05.041893+0000","last_peered":"2024-02-17T12:17:05.041893+0000","last_clean":"2024-02-17T12:17:05.041893+0000","last_became_active":"2024-02-17T12:17:05.033414+0000","last_became_peered":"2024-02-17T12:17:05.033414+0000","last_unstale":"2024-02-17T12:17:05.041893+0000","last_undegraded":"2024-02-17T12:17:05.041893+0000","last_fullsized":"2024-02-17T12:17:05.041893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018784+0000","last_change":"2024-02-17T12:17:05.018784+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018784+0000","last_undegraded":"2024-02-17T12:17:05.018784+0000","last_fullsized":"2024-02-17T12:17:05.018784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009350+0000","last_change":"2024-02-17T12:17:04.009350+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009350+0000","last_undegraded":"2024-02-17T12:17:04.009350+0000","last_fullsized":"2024-02-17T12:17:04.009350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.017776+0000","last_change":"2024-02-17T12:17:05.017776+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.017776+0000","last_undegraded":"2024-02-17T12:17:05.017776+0000","last_fullsized":"2024-02-17T12:17:05.017776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.040889+0000","last_change":"2024-02-17T12:17:05.032388+0000","last_active":"2024-02-17T12:17:05.040889+0000","last_peered":"2024-02-17T12:17:05.040889+0000","last_clean":"2024-02-17T12:17:05.040889+0000","last_became_active":"2024-02-17T12:17:05.032055+0000","last_became_peered":"2024-02-17T12:17:05.032055+0000","last_unstale":"2024-02-17T12:17:05.040889+0000","last_undegraded":"2024-02-17T12:17:05.040889+0000","last_fullsized":"2024-02-17T12:17:05.040889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:50:37.528650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041986+0000","last_change":"2024-02-17T12:17:05.037345+0000","last_active":"2024-02-17T12:17:05.041986+0000","last_peered":"2024-02-17T12:17:05.041986+0000","last_clean":"2024-02-17T12:17:05.041986+0000","last_became_active":"2024-02-17T12:17:05.037076+0000","last_became_peered":"2024-02-17T12:17:05.037076+0000","last_unstale":"2024-02-17T12:17:05.041986+0000","last_undegraded":"2024-02-17T12:17:05.041986+0000","last_fullsized":"2024-02-17T12:17:05.041986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020422+0000","last_change":"2024-02-17T12:17:05.020422+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020422+0000","last_undegraded":"2024-02-17T12:17:05.020422+0000","last_fullsized":"2024-02-17T12:17:05.020422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041843+0000","last_change":"2024-02-17T12:17:05.033809+0000","last_active":"2024-02-17T12:17:05.041843+0000","last_peered":"2024-02-17T12:17:05.041843+0000","last_clean":"2024-02-17T12:17:05.041843+0000","last_became_active":"2024-02-17T12:17:05.033434+0000","last_became_peered":"2024-02-17T12:17:05.033434+0000","last_unstale":"2024-02-17T12:17:05.041843+0000","last_undegraded":"2024-02-17T12:17:05.041843+0000","last_fullsized":"2024-02-17T12:17:05.041843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044094+0000","last_change":"2024-02-17T12:17:05.039589+0000","last_active":"2024-02-17T12:17:05.044094+0000","last_peered":"2024-02-17T12:17:05.044094+0000","last_clean":"2024-02-17T12:17:05.044094+0000","last_became_active":"2024-02-17T12:17:05.039353+0000","last_became_peered":"2024-02-17T12:17:05.039353+0000","last_unstale":"2024-02-17T12:17:05.044094+0000","last_undegraded":"2024-02-17T12:17:05.044094+0000","last_fullsized":"2024-02-17T12:17:05.044094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:19.010045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.016834+0000","last_change":"2024-02-17T12:17:05.016834+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.016834+0000","last_undegraded":"2024-02-17T12:17:05.016834+0000","last_fullsized":"2024-02-17T12:17:05.016834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.010365+0000","last_change":"2024-02-17T12:17:04.010365+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.010365+0000","last_undegraded":"2024-02-17T12:17:04.010365+0000","last_fullsized":"2024-02-17T12:17:04.010365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018360+0000","last_change":"2024-02-17T12:17:05.018360+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018360+0000","last_undegraded":"2024-02-17T12:17:05.018360+0000","last_fullsized":"2024-02-17T12:17:05.018360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009312+0000","last_change":"2024-02-17T12:17:04.009312+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009312+0000","last_undegraded":"2024-02-17T12:17:04.009312+0000","last_fullsized":"2024-02-17T12:17:04.009312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009289+0000","last_change":"2024-02-17T12:17:04.009289+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009289+0000","last_undegraded":"2024-02-17T12:17:04.009289+0000","last_fullsized":"2024-02-17T12:17:04.009289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.043793+0000","last_change":"2024-02-17T12:17:05.038848+0000","last_active":"2024-02-17T12:17:05.043793+0000","last_peered":"2024-02-17T12:17:05.043793+0000","last_clean":"2024-02-17T12:17:05.043793+0000","last_became_active":"2024-02-17T12:17:05.038528+0000","last_became_peered":"2024-02-17T12:17:05.038528+0000","last_unstale":"2024-02-17T12:17:05.043793+0000","last_undegraded":"2024-02-17T12:17:05.043793+0000","last_fullsized":"2024-02-17T12:17:05.043793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:33:08.214296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.037557+0000","last_change":"2024-02-17T12:17:05.035457+0000","last_active":"2024-02-17T12:17:05.037557+0000","last_peered":"2024-02-17T12:17:05.037557+0000","last_clean":"2024-02-17T12:17:05.037557+0000","last_became_active":"2024-02-17T12:17:05.035024+0000","last_became_peered":"2024-02-17T12:17:05.035024+0000","last_unstale":"2024-02-17T12:17:05.037557+0000","last_undegraded":"2024-02-17T12:17:05.037557+0000","last_fullsized":"2024-02-17T12:17:05.037557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.010291+0000","last_change":"2024-02-17T12:17:04.010291+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.010291+0000","last_undegraded":"2024-02-17T12:17:04.010291+0000","last_fullsized":"2024-02-17T12:17:04.010291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041953+0000","last_change":"2024-02-17T12:17:05.037887+0000","last_active":"2024-02-17T12:17:05.041953+0000","last_peered":"2024-02-17T12:17:05.041953+0000","last_clean":"2024-02-17T12:17:05.041953+0000","last_became_active":"2024-02-17T12:17:05.037587+0000","last_became_peered":"2024-02-17T12:17:05.037587+0000","last_unstale":"2024-02-17T12:17:05.041953+0000","last_undegraded":"2024-02-17T12:17:05.041953+0000","last_fullsized":"2024-02-17T12:17:05.041953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.030942+0000","last_change":"2024-02-17T12:17:05.025815+0000","last_active":"2024-02-17T12:17:05.030942+0000","last_peered":"2024-02-17T12:17:05.030942+0000","last_clean":"2024-02-17T12:17:05.030942+0000","last_became_active":"2024-02-17T12:17:05.025568+0000","last_became_peered":"2024-02-17T12:17:05.025568+0000","last_unstale":"2024-02-17T12:17:05.030942+0000","last_undegraded":"2024-02-17T12:17:05.030942+0000","last_fullsized":"2024-02-17T12:17:05.030942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:16:15.107694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015310+0000","last_change":"2024-02-17T12:17:05.015310+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015310+0000","last_undegraded":"2024-02-17T12:17:05.015310+0000","last_fullsized":"2024-02-17T12:17:05.015310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044585+0000","last_change":"2024-02-17T12:17:05.039517+0000","last_active":"2024-02-17T12:17:05.044585+0000","last_peered":"2024-02-17T12:17:05.044585+0000","last_clean":"2024-02-17T12:17:05.044585+0000","last_became_active":"2024-02-17T12:17:05.039209+0000","last_became_peered":"2024-02-17T12:17:05.039209+0000","last_unstale":"2024-02-17T12:17:05.044585+0000","last_undegraded":"2024-02-17T12:17:05.044585+0000","last_fullsized":"2024-02-17T12:17:05.044585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:50:37.528650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.026078+0000","last_change":"2024-02-17T12:17:05.026078+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.026078+0000","last_undegraded":"2024-02-17T12:17:05.026078+0000","last_fullsized":"2024-02-17T12:17:05.026078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.042032+0000","last_change":"2024-02-17T12:17:05.037708+0000","last_active":"2024-02-17T12:17:05.042032+0000","last_peered":"2024-02-17T12:17:05.042032+0000","last_clean":"2024-02-17T12:17:05.042032+0000","last_became_active":"2024-02-17T12:17:05.037213+0000","last_became_peered":"2024-02-17T12:17:05.037213+0000","last_unstale":"2024-02-17T12:17:05.042032+0000","last_undegraded":"2024-02-17T12:17:05.042032+0000","last_fullsized":"2024-02-17T12:17:05.042032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:36:34.983677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020596+0000","last_change":"2024-02-17T12:17:05.020596+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020596+0000","last_undegraded":"2024-02-17T12:17:05.020596+0000","last_fullsized":"2024-02-17T12:17:05.020596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041747+0000","last_change":"2024-02-17T12:17:05.034917+0000","last_active":"2024-02-17T12:17:05.041747+0000","last_peered":"2024-02-17T12:17:05.041747+0000","last_clean":"2024-02-17T12:17:05.041747+0000","last_became_active":"2024-02-17T12:17:05.034653+0000","last_became_peered":"2024-02-17T12:17:05.034653+0000","last_unstale":"2024-02-17T12:17:05.041747+0000","last_undegraded":"2024-02-17T12:17:05.041747+0000","last_fullsized":"2024-02-17T12:17:05.041747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:16:15.107694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.028102+0000","last_change":"2024-02-17T12:17:05.028102+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.028102+0000","last_undegraded":"2024-02-17T12:17:05.028102+0000","last_fullsized":"2024-02-17T12:17:05.028102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.031171+0000","last_change":"2024-02-17T12:17:05.026508+0000","last_active":"2024-02-17T12:17:05.031171+0000","last_peered":"2024-02-17T12:17:05.031171+0000","last_clean":"2024-02-17T12:17:05.031171+0000","last_became_active":"2024-02-17T12:17:05.026238+0000","last_became_peered":"2024-02-17T12:17:05.026238+0000","last_unstale":"2024-02-17T12:17:05.031171+0000","last_undegraded":"2024-02-17T12:17:05.031171+0000","last_fullsized":"2024-02-17T12:17:05.031171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:33:08.214296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021248+0000","last_change":"2024-02-17T12:17:05.021248+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021248+0000","last_undegraded":"2024-02-17T12:17:05.021248+0000","last_fullsized":"2024-02-17T12:17:05.021248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009717+0000","last_change":"2024-02-17T12:17:04.009717+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009717+0000","last_undegraded":"2024-02-17T12:17:04.009717+0000","last_fullsized":"2024-02-17T12:17:04.009717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041960+0000","last_change":"2024-02-17T12:17:05.036670+0000","last_active":"2024-02-17T12:17:05.041960+0000","last_peered":"2024-02-17T12:17:05.041960+0000","last_clean":"2024-02-17T12:17:05.041960+0000","last_became_active":"2024-02-17T12:17:05.036395+0000","last_became_peered":"2024-02-17T12:17:05.036395+0000","last_unstale":"2024-02-17T12:17:05.041960+0000","last_undegraded":"2024-02-17T12:17:05.041960+0000","last_fullsized":"2024-02-17T12:17:05.041960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.040343+0000","last_change":"2024-02-17T12:17:05.036734+0000","last_active":"2024-02-17T12:17:05.040343+0000","last_peered":"2024-02-17T12:17:05.040343+0000","last_clean":"2024-02-17T12:17:05.040343+0000","last_became_active":"2024-02-17T12:17:05.036453+0000","last_became_peered":"2024-02-17T12:17:05.036453+0000","last_unstale":"2024-02-17T12:17:05.040343+0000","last_undegraded":"2024-02-17T12:17:05.040343+0000","last_fullsized":"2024-02-17T12:17:05.040343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-17T12:17:04.014249+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:17:04.014249+0000","last_peered":"2024-02-17T12:17:04.014249+0000","last_clean":"2024-02-17T12:17:04.014249+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:17:04.014249+0000","last_undegraded":"2024-02-17T12:17:04.014249+0000","last_fullsized":"2024-02-17T12:17:04.014249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":74,"acting":74,"num_store_stats":5},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":122658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":122658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":706759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":706759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":303104,"data_stored":110574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":116391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:17:10.490 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:17:10.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe11000640 1 Processor -- start 2024-02-17T12:17:10.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe11000640 1 -- start start 2024-02-17T12:17:10.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe11000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efe0c150300 0x7efe0c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe11000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c0714c0 0x7efe0c0aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe11000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c157270 con 0x7efe0c0aa6a0 2024-02-17T12:17:10.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe11000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c0c6900 con 0x7efe0c150300 2024-02-17T12:17:10.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe11000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0c3580 con 0x7efe0c0714c0 2024-02-17T12:17:10.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe09e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efe0c150300 0x7efe0c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe09400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c0714c0 0x7efe0c0aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe09400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c0714c0 0x7efe0c0aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:37588/0 (socket says 172.21.15.114:37588) 2024-02-17T12:17:10.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe09400640 1 -- 172.21.15.114:0/2934358389 learned_addr learned my addr 172.21.15.114:0/2934358389 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:10.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe0a800640 1 --1- 172.21.15.114:0/2934358389 >> v1:172.21.15.116:6789/0 conn(0x7efe0c0aa6a0 0x7efe0c152d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:50544/0 (socket says 172.21.15.114:50544) 2024-02-17T12:17:10.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe09e00640 1 -- 172.21.15.114:0/2934358389 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c0714c0 msgr2=0x7efe0c0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:10.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe09e00640 1 --2- 172.21.15.114:0/2934358389 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c0714c0 0x7efe0c0aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe09e00640 1 -- 172.21.15.114:0/2934358389 >> v1:172.21.15.116:6789/0 conn(0x7efe0c0aa6a0 legacy=0x7efe0c152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe08a00640 1 -- 172.21.15.114:0/2934358389 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231694028 0 0) 0x7efe0c157270 con 0x7efe0c0aa6a0 2024-02-17T12:17:10.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.654+0000 7efe09e00640 1 -- 172.21.15.114:0/2934358389 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c0c2fc0 con 0x7efe0c150300 2024-02-17T12:17:10.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe09e00640 1 --2- 172.21.15.114:0/2934358389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0c150300 0x7efe0c156d30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0097c0 tx=0x7efdfc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d851cee064861cc6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:10.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe08a00640 1 -- 172.21.15.114:0/2934358389 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0ab600 con 0x7efe0c150300 2024-02-17T12:17:10.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe08a00640 1 -- 172.21.15.114:0/2934358389 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc0a7050 con 0x7efe0c150300 2024-02-17T12:17:10.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe08a00640 1 -- 172.21.15.114:0/2934358389 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0ab980 con 0x7efe0c150300 2024-02-17T12:17:10.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe11000640 1 -- 172.21.15.114:0/2934358389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0c150300 msgr2=0x7efe0c156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe11000640 1 --2- 172.21.15.114:0/2934358389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0c150300 0x7efe0c156d30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0097c0 tx=0x7efdfc01c410 comp rx=0 tx=0).stop 2024-02-17T12:17:10.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe11000640 1 -- 172.21.15.114:0/2934358389 shutdown_connections 2024-02-17T12:17:10.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe11000640 1 --2- 172.21.15.114:0/2934358389 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c0714c0 0x7efe0c0aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe11000640 1 --2- 172.21.15.114:0/2934358389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0c150300 0x7efe0c156d30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe11000640 1 -- 172.21.15.114:0/2934358389 >> 172.21.15.114:0/2934358389 conn(0x7efe0c0c4f20 msgr2=0x7efe0c0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:10.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe11000640 1 -- 172.21.15.114:0/2934358389 shutdown_connections 2024-02-17T12:17:10.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.658+0000 7efe11000640 1 -- 172.21.15.114:0/2934358389 wait complete. 2024-02-17T12:17:10.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe11000640 1 Processor -- start 2024-02-17T12:17:10.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe11000640 1 -- start start 2024-02-17T12:17:10.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe11000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe0c0714c0 0x7efe0c1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe11000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0c0aa6a0 0x7efe0c14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe11000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c150300 0x7efe0c0ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe11000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c14a920 con 0x7efe0c0714c0 2024-02-17T12:17:10.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe11000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c14ac00 con 0x7efe0c0aa6a0 2024-02-17T12:17:10.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe11000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c14aee0 con 0x7efe0c150300 2024-02-17T12:17:10.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe09e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe0c0714c0 0x7efe0c1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe09400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0c0aa6a0 0x7efe0c14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe09e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe0c0714c0 0x7efe0c1565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42656/0 (socket says 172.21.15.114:42656) 2024-02-17T12:17:10.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe09e00640 1 -- 172.21.15.114:0/1860490698 learned_addr learned my addr 172.21.15.114:0/1860490698 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:10.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe0a800640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c150300 0x7efe0c0ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe09e00640 1 -- 172.21.15.114:0/1860490698 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c150300 msgr2=0x7efe0c0ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe09e00640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c150300 0x7efe0c0ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe09e00640 1 -- 172.21.15.114:0/1860490698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0c0aa6a0 msgr2=0x7efe0c14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe09e00640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0c0aa6a0 0x7efe0c14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe09e00640 1 -- 172.21.15.114:0/1860490698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc009420 con 0x7efe0c0714c0 2024-02-17T12:17:10.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe09e00640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe0c0714c0 0x7efe0c1565f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efdfc01a040 tx=0x7efdfc01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:10.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe02000640 1 -- 172.21.15.114:0/1860490698 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0b7450 con 0x7efe0c0714c0 2024-02-17T12:17:10.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe02000640 1 -- 172.21.15.114:0/1860490698 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc0b75b0 con 0x7efe0c0714c0 2024-02-17T12:17:10.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe02000640 1 -- 172.21.15.114:0/1860490698 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0b7960 con 0x7efe0c0714c0 2024-02-17T12:17:10.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe11000640 1 -- 172.21.15.114:0/1860490698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c14b1c0 con 0x7efe0c0714c0 2024-02-17T12:17:10.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.662+0000 7efe11000640 1 -- 172.21.15.114:0/1860490698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c14a5b0 con 0x7efe0c0714c0 2024-02-17T12:17:10.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.666+0000 7efe11000640 1 -- 172.21.15.114:0/1860490698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c14b670 con 0x7efe0c0714c0 2024-02-17T12:17:10.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.666+0000 7efe02000640 1 -- 172.21.15.114:0/1860490698 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7efdfc0b7ac0 con 0x7efe0c0714c0 2024-02-17T12:17:10.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.666+0000 7efe02000640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efdec066e70 0x7efdec069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:10.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.666+0000 7efe02000640 1 -- 172.21.15.114:0/1860490698 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdfc11f060 con 0x7efe0c0714c0 2024-02-17T12:17:10.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.666+0000 7efe09400640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efdec066e70 0x7efdec069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:10.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.666+0000 7efe09400640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efdec066e70 0x7efdec069330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efe0c14b900 tx=0x7efdf8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:10.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.670+0000 7efe02000640 1 -- 172.21.15.114:0/1860490698 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efdfc150cb0 con 0x7efe0c0714c0 2024-02-17T12:17:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.822+0000 7efe11000640 1 -- 172.21.15.114:0/1860490698 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe0c074840 con 0x7efdec066e70 2024-02-17T12:17:10.832 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-02-17T12:17:10.826+0000 7fba33400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:17:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.826+0000 7efe02000640 1 -- 172.21.15.114:0/1860490698 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+256747 (secure 0 0 0) 0x7efe0c074840 con 0x7efdec066e70 2024-02-17T12:17:10.837 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:10.838 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:17:10.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 -- 172.21.15.114:0/1860490698 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efdec066e70 msgr2=0x7efdec069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efdec066e70 0x7efdec069330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efe0c14b900 tx=0x7efdf8009240 comp rx=0 tx=0).stop 2024-02-17T12:17:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 -- 172.21.15.114:0/1860490698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe0c0714c0 msgr2=0x7efe0c1565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe0c0714c0 0x7efe0c1565f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efdfc01a040 tx=0x7efdfc01ac50 comp rx=0 tx=0).stop 2024-02-17T12:17:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 -- 172.21.15.114:0/1860490698 shutdown_connections 2024-02-17T12:17:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0c150300 0x7efe0c0ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0c0aa6a0 0x7efe0c14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efdec066e70 0x7efdec069330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 --2- 172.21.15.114:0/1860490698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe0c0714c0 0x7efe0c1565f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 -- 172.21.15.114:0/1860490698 >> 172.21.15.114:0/1860490698 conn(0x7efe0c0c4f20 msgr2=0x7efe0c15c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 -- 172.21.15.114:0/1860490698 shutdown_connections 2024-02-17T12:17:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:10.830+0000 7efe11000640 1 -- 172.21.15.114:0/1860490698 wait complete. 2024-02-17T12:17:10.857 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-02-17T12:17:09.226076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":140,"acting":140,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223980,"kb_used_data":3636,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750740,"statfs":{"total":773094113280,"available":772864757760,"internally_reserved":0,"allocated":3723264,"data_stored":2118581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.220497"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021999+0000","last_change":"2024-02-17T12:17:05.021999+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021999+0000","last_undegraded":"2024-02-17T12:17:05.021999+0000","last_fullsized":"2024-02-17T12:17:05.021999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.023424+0000","last_change":"2024-02-17T12:17:05.023424+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.023424+0000","last_undegraded":"2024-02-17T12:17:05.023424+0000","last_fullsized":"2024-02-17T12:17:05.023424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015930+0000","last_change":"2024-02-17T12:17:05.015930+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015930+0000","last_undegraded":"2024-02-17T12:17:05.015930+0000","last_fullsized":"2024-02-17T12:17:05.015930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021531+0000","last_change":"2024-02-17T12:17:05.021531+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021531+0000","last_undegraded":"2024-02-17T12:17:05.021531+0000","last_fullsized":"2024-02-17T12:17:05.021531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.023173+0000","last_change":"2024-02-17T12:17:05.023173+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.023173+0000","last_undegraded":"2024-02-17T12:17:05.023173+0000","last_fullsized":"2024-02-17T12:17:05.023173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020903+0000","last_change":"2024-02-17T12:17:05.020903+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020903+0000","last_undegraded":"2024-02-17T12:17:05.020903+0000","last_fullsized":"2024-02-17T12:17:05.020903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.016508+0000","last_change":"2024-02-17T12:17:05.016508+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.016508+0000","last_undegraded":"2024-02-17T12:17:05.016508+0000","last_fullsized":"2024-02-17T12:17:05.016508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.022619+0000","last_change":"2024-02-17T12:17:05.022619+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.022619+0000","last_undegraded":"2024-02-17T12:17:05.022619+0000","last_fullsized":"2024-02-17T12:17:05.022619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015643+0000","last_change":"2024-02-17T12:17:05.015643+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015643+0000","last_undegraded":"2024-02-17T12:17:05.015643+0000","last_fullsized":"2024-02-17T12:17:05.015643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021207+0000","last_change":"2024-02-17T12:17:05.021207+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021207+0000","last_undegraded":"2024-02-17T12:17:05.021207+0000","last_fullsized":"2024-02-17T12:17:05.021207+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020746+0000","last_change":"2024-02-17T12:17:05.020746+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020746+0000","last_undegraded":"2024-02-17T12:17:05.020746+0000","last_fullsized":"2024-02-17T12:17:05.020746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.024948+0000","last_change":"2024-02-17T12:17:05.024948+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.024948+0000","last_undegraded":"2024-02-17T12:17:05.024948+0000","last_fullsized":"2024-02-17T12:17:05.024948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015857+0000","last_change":"2024-02-17T12:17:05.015857+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015857+0000","last_undegraded":"2024-02-17T12:17:05.015857+0000","last_fullsized":"2024-02-17T12:17:05.015857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018823+0000","last_change":"2024-02-17T12:17:05.018823+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018823+0000","last_undegraded":"2024-02-17T12:17:05.018823+0000","last_fullsized":"2024-02-17T12:17:05.018823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020119+0000","last_change":"2024-02-17T12:17:05.020119+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020119+0000","last_undegraded":"2024-02-17T12:17:05.020119+0000","last_fullsized":"2024-02-17T12:17:05.020119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019781+0000","last_change":"2024-02-17T12:17:05.019781+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019781+0000","last_undegraded":"2024-02-17T12:17:05.019781+0000","last_fullsized":"2024-02-17T12:17:05.019781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015108+0000","last_change":"2024-02-17T12:17:05.015108+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015108+0000","last_undegraded":"2024-02-17T12:17:05.015108+0000","last_fullsized":"2024-02-17T12:17:05.015108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021688+0000","last_change":"2024-02-17T12:17:05.021688+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021688+0000","last_undegraded":"2024-02-17T12:17:05.021688+0000","last_fullsized":"2024-02-17T12:17:05.021688+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.027129+0000","last_change":"2024-02-17T12:17:05.027129+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.027129+0000","last_undegraded":"2024-02-17T12:17:05.027129+0000","last_fullsized":"2024-02-17T12:17:05.027129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.034976+0000","last_change":"2024-02-17T12:17:05.029800+0000","last_active":"2024-02-17T12:17:05.034976+0000","last_peered":"2024-02-17T12:17:05.034976+0000","last_clean":"2024-02-17T12:17:05.034976+0000","last_became_active":"2024-02-17T12:17:05.029482+0000","last_became_peered":"2024-02-17T12:17:05.029482+0000","last_unstale":"2024-02-17T12:17:05.034976+0000","last_undegraded":"2024-02-17T12:17:05.034976+0000","last_fullsized":"2024-02-17T12:17:05.034976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:01:36.502802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021555+0000","last_change":"2024-02-17T12:17:05.021555+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021555+0000","last_undegraded":"2024-02-17T12:17:05.021555+0000","last_fullsized":"2024-02-17T12:17:05.021555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044604+0000","last_change":"2024-02-17T12:17:05.039687+0000","last_active":"2024-02-17T12:17:05.044604+0000","last_peered":"2024-02-17T12:17:05.044604+0000","last_clean":"2024-02-17T12:17:05.044604+0000","last_became_active":"2024-02-17T12:17:05.039381+0000","last_became_peered":"2024-02-17T12:17:05.039381+0000","last_unstale":"2024-02-17T12:17:05.044604+0000","last_undegraded":"2024-02-17T12:17:05.044604+0000","last_fullsized":"2024-02-17T12:17:05.044604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:36:34.983677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041802+0000","last_change":"2024-02-17T12:17:05.033787+0000","last_active":"2024-02-17T12:17:05.041802+0000","last_peered":"2024-02-17T12:17:05.041802+0000","last_clean":"2024-02-17T12:17:05.041802+0000","last_became_active":"2024-02-17T12:17:05.033470+0000","last_became_peered":"2024-02-17T12:17:05.033470+0000","last_unstale":"2024-02-17T12:17:05.041802+0000","last_undegraded":"2024-02-17T12:17:05.041802+0000","last_fullsized":"2024-02-17T12:17:05.041802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019217+0000","last_change":"2024-02-17T12:17:05.019217+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019217+0000","last_undegraded":"2024-02-17T12:17:05.019217+0000","last_fullsized":"2024-02-17T12:17:05.019217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.011402+0000","last_change":"2024-02-17T12:17:04.011402+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.011402+0000","last_undegraded":"2024-02-17T12:17:04.011402+0000","last_fullsized":"2024-02-17T12:17:04.011402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.011438+0000","last_change":"2024-02-17T12:17:04.011438+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.011438+0000","last_undegraded":"2024-02-17T12:17:04.011438+0000","last_fullsized":"2024-02-17T12:17:04.011438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015155+0000","last_change":"2024-02-17T12:17:05.015155+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015155+0000","last_undegraded":"2024-02-17T12:17:05.015155+0000","last_fullsized":"2024-02-17T12:17:05.015155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009681+0000","last_change":"2024-02-17T12:17:04.009681+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009681+0000","last_undegraded":"2024-02-17T12:17:04.009681+0000","last_fullsized":"2024-02-17T12:17:04.009681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.040125+0000","last_change":"2024-02-17T12:17:05.030240+0000","last_active":"2024-02-17T12:17:05.040125+0000","last_peered":"2024-02-17T12:17:05.040125+0000","last_clean":"2024-02-17T12:17:05.040125+0000","last_became_active":"2024-02-17T12:17:05.029142+0000","last_became_peered":"2024-02-17T12:17:05.029142+0000","last_unstale":"2024-02-17T12:17:05.040125+0000","last_undegraded":"2024-02-17T12:17:05.040125+0000","last_fullsized":"2024-02-17T12:17:05.040125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:01:36.502802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019933+0000","last_change":"2024-02-17T12:17:05.019933+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019933+0000","last_undegraded":"2024-02-17T12:17:05.019933+0000","last_fullsized":"2024-02-17T12:17:05.019933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.010789+0000","last_change":"2024-02-17T12:17:04.010789+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.010789+0000","last_undegraded":"2024-02-17T12:17:04.010789+0000","last_fullsized":"2024-02-17T12:17:04.010789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015802+0000","last_change":"2024-02-17T12:17:05.015802+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015802+0000","last_undegraded":"2024-02-17T12:17:05.015802+0000","last_fullsized":"2024-02-17T12:17:05.015802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044118+0000","last_change":"2024-02-17T12:17:05.040696+0000","last_active":"2024-02-17T12:17:05.044118+0000","last_peered":"2024-02-17T12:17:05.044118+0000","last_clean":"2024-02-17T12:17:05.044118+0000","last_became_active":"2024-02-17T12:17:05.040185+0000","last_became_peered":"2024-02-17T12:17:05.040185+0000","last_unstale":"2024-02-17T12:17:05.044118+0000","last_undegraded":"2024-02-17T12:17:05.044118+0000","last_fullsized":"2024-02-17T12:17:05.044118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:29.147863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018515+0000","last_change":"2024-02-17T12:17:05.018515+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018515+0000","last_undegraded":"2024-02-17T12:17:05.018515+0000","last_fullsized":"2024-02-17T12:17:05.018515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044613+0000","last_change":"2024-02-17T12:17:05.042848+0000","last_active":"2024-02-17T12:17:05.044613+0000","last_peered":"2024-02-17T12:17:05.044613+0000","last_clean":"2024-02-17T12:17:05.044613+0000","last_became_active":"2024-02-17T12:17:05.042537+0000","last_became_peered":"2024-02-17T12:17:05.042537+0000","last_unstale":"2024-02-17T12:17:05.044613+0000","last_undegraded":"2024-02-17T12:17:05.044613+0000","last_fullsized":"2024-02-17T12:17:05.044613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:19.010045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.019403+0000","last_change":"2024-02-17T12:17:05.019403+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.019403+0000","last_undegraded":"2024-02-17T12:17:05.019403+0000","last_fullsized":"2024-02-17T12:17:05.019403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041975+0000","last_change":"2024-02-17T12:17:05.038559+0000","last_active":"2024-02-17T12:17:05.041975+0000","last_peered":"2024-02-17T12:17:05.041975+0000","last_clean":"2024-02-17T12:17:05.041975+0000","last_became_active":"2024-02-17T12:17:05.038388+0000","last_became_peered":"2024-02-17T12:17:05.038388+0000","last_unstale":"2024-02-17T12:17:05.041975+0000","last_undegraded":"2024-02-17T12:17:05.041975+0000","last_fullsized":"2024-02-17T12:17:05.041975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:09:29.147863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.016475+0000","last_change":"2024-02-17T12:17:05.016475+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.016475+0000","last_undegraded":"2024-02-17T12:17:05.016475+0000","last_fullsized":"2024-02-17T12:17:05.016475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041893+0000","last_change":"2024-02-17T12:17:05.034049+0000","last_active":"2024-02-17T12:17:05.041893+0000","last_peered":"2024-02-17T12:17:05.041893+0000","last_clean":"2024-02-17T12:17:05.041893+0000","last_became_active":"2024-02-17T12:17:05.033414+0000","last_became_peered":"2024-02-17T12:17:05.033414+0000","last_unstale":"2024-02-17T12:17:05.041893+0000","last_undegraded":"2024-02-17T12:17:05.041893+0000","last_fullsized":"2024-02-17T12:17:05.041893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018784+0000","last_change":"2024-02-17T12:17:05.018784+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018784+0000","last_undegraded":"2024-02-17T12:17:05.018784+0000","last_fullsized":"2024-02-17T12:17:05.018784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009350+0000","last_change":"2024-02-17T12:17:04.009350+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009350+0000","last_undegraded":"2024-02-17T12:17:04.009350+0000","last_fullsized":"2024-02-17T12:17:04.009350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.017776+0000","last_change":"2024-02-17T12:17:05.017776+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.017776+0000","last_undegraded":"2024-02-17T12:17:05.017776+0000","last_fullsized":"2024-02-17T12:17:05.017776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.040889+0000","last_change":"2024-02-17T12:17:05.032388+0000","last_active":"2024-02-17T12:17:05.040889+0000","last_peered":"2024-02-17T12:17:05.040889+0000","last_clean":"2024-02-17T12:17:05.040889+0000","last_became_active":"2024-02-17T12:17:05.032055+0000","last_became_peered":"2024-02-17T12:17:05.032055+0000","last_unstale":"2024-02-17T12:17:05.040889+0000","last_undegraded":"2024-02-17T12:17:05.040889+0000","last_fullsized":"2024-02-17T12:17:05.040889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:50:37.528650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041986+0000","last_change":"2024-02-17T12:17:05.037345+0000","last_active":"2024-02-17T12:17:05.041986+0000","last_peered":"2024-02-17T12:17:05.041986+0000","last_clean":"2024-02-17T12:17:05.041986+0000","last_became_active":"2024-02-17T12:17:05.037076+0000","last_became_peered":"2024-02-17T12:17:05.037076+0000","last_unstale":"2024-02-17T12:17:05.041986+0000","last_undegraded":"2024-02-17T12:17:05.041986+0000","last_fullsized":"2024-02-17T12:17:05.041986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020422+0000","last_change":"2024-02-17T12:17:05.020422+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020422+0000","last_undegraded":"2024-02-17T12:17:05.020422+0000","last_fullsized":"2024-02-17T12:17:05.020422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041843+0000","last_change":"2024-02-17T12:17:05.033809+0000","last_active":"2024-02-17T12:17:05.041843+0000","last_peered":"2024-02-17T12:17:05.041843+0000","last_clean":"2024-02-17T12:17:05.041843+0000","last_became_active":"2024-02-17T12:17:05.033434+0000","last_became_peered":"2024-02-17T12:17:05.033434+0000","last_unstale":"2024-02-17T12:17:05.041843+0000","last_undegraded":"2024-02-17T12:17:05.041843+0000","last_fullsized":"2024-02-17T12:17:05.041843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044094+0000","last_change":"2024-02-17T12:17:05.039589+0000","last_active":"2024-02-17T12:17:05.044094+0000","last_peered":"2024-02-17T12:17:05.044094+0000","last_clean":"2024-02-17T12:17:05.044094+0000","last_became_active":"2024-02-17T12:17:05.039353+0000","last_became_peered":"2024-02-17T12:17:05.039353+0000","last_unstale":"2024-02-17T12:17:05.044094+0000","last_undegraded":"2024-02-17T12:17:05.044094+0000","last_fullsized":"2024-02-17T12:17:05.044094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:19.010045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.016834+0000","last_change":"2024-02-17T12:17:05.016834+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.016834+0000","last_undegraded":"2024-02-17T12:17:05.016834+0000","last_fullsized":"2024-02-17T12:17:05.016834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.010365+0000","last_change":"2024-02-17T12:17:04.010365+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.010365+0000","last_undegraded":"2024-02-17T12:17:04.010365+0000","last_fullsized":"2024-02-17T12:17:04.010365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.018360+0000","last_change":"2024-02-17T12:17:05.018360+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.018360+0000","last_undegraded":"2024-02-17T12:17:05.018360+0000","last_fullsized":"2024-02-17T12:17:05.018360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009312+0000","last_change":"2024-02-17T12:17:04.009312+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009312+0000","last_undegraded":"2024-02-17T12:17:04.009312+0000","last_fullsized":"2024-02-17T12:17:04.009312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009289+0000","last_change":"2024-02-17T12:17:04.009289+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009289+0000","last_undegraded":"2024-02-17T12:17:04.009289+0000","last_fullsized":"2024-02-17T12:17:04.009289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.043793+0000","last_change":"2024-02-17T12:17:05.038848+0000","last_active":"2024-02-17T12:17:05.043793+0000","last_peered":"2024-02-17T12:17:05.043793+0000","last_clean":"2024-02-17T12:17:05.043793+0000","last_became_active":"2024-02-17T12:17:05.038528+0000","last_became_peered":"2024-02-17T12:17:05.038528+0000","last_unstale":"2024-02-17T12:17:05.043793+0000","last_undegraded":"2024-02-17T12:17:05.043793+0000","last_fullsized":"2024-02-17T12:17:05.043793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:33:08.214296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.037557+0000","last_change":"2024-02-17T12:17:05.035457+0000","last_active":"2024-02-17T12:17:05.037557+0000","last_peered":"2024-02-17T12:17:05.037557+0000","last_clean":"2024-02-17T12:17:05.037557+0000","last_became_active":"2024-02-17T12:17:05.035024+0000","last_became_peered":"2024-02-17T12:17:05.035024+0000","last_unstale":"2024-02-17T12:17:05.037557+0000","last_undegraded":"2024-02-17T12:17:05.037557+0000","last_fullsized":"2024-02-17T12:17:05.037557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.010291+0000","last_change":"2024-02-17T12:17:04.010291+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.010291+0000","last_undegraded":"2024-02-17T12:17:04.010291+0000","last_fullsized":"2024-02-17T12:17:04.010291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041953+0000","last_change":"2024-02-17T12:17:05.037887+0000","last_active":"2024-02-17T12:17:05.041953+0000","last_peered":"2024-02-17T12:17:05.041953+0000","last_clean":"2024-02-17T12:17:05.041953+0000","last_became_active":"2024-02-17T12:17:05.037587+0000","last_became_peered":"2024-02-17T12:17:05.037587+0000","last_unstale":"2024-02-17T12:17:05.041953+0000","last_undegraded":"2024-02-17T12:17:05.041953+0000","last_fullsized":"2024-02-17T12:17:05.041953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.030942+0000","last_change":"2024-02-17T12:17:05.025815+0000","last_active":"2024-02-17T12:17:05.030942+0000","last_peered":"2024-02-17T12:17:05.030942+0000","last_clean":"2024-02-17T12:17:05.030942+0000","last_became_active":"2024-02-17T12:17:05.025568+0000","last_became_peered":"2024-02-17T12:17:05.025568+0000","last_unstale":"2024-02-17T12:17:05.030942+0000","last_undegraded":"2024-02-17T12:17:05.030942+0000","last_fullsized":"2024-02-17T12:17:05.030942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:16:15.107694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.015310+0000","last_change":"2024-02-17T12:17:05.015310+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.015310+0000","last_undegraded":"2024-02-17T12:17:05.015310+0000","last_fullsized":"2024-02-17T12:17:05.015310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.044585+0000","last_change":"2024-02-17T12:17:05.039517+0000","last_active":"2024-02-17T12:17:05.044585+0000","last_peered":"2024-02-17T12:17:05.044585+0000","last_clean":"2024-02-17T12:17:05.044585+0000","last_became_active":"2024-02-17T12:17:05.039209+0000","last_became_peered":"2024-02-17T12:17:05.039209+0000","last_unstale":"2024-02-17T12:17:05.044585+0000","last_undegraded":"2024-02-17T12:17:05.044585+0000","last_fullsized":"2024-02-17T12:17:05.044585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:50:37.528650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.026078+0000","last_change":"2024-02-17T12:17:05.026078+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.026078+0000","last_undegraded":"2024-02-17T12:17:05.026078+0000","last_fullsized":"2024-02-17T12:17:05.026078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.042032+0000","last_change":"2024-02-17T12:17:05.037708+0000","last_active":"2024-02-17T12:17:05.042032+0000","last_peered":"2024-02-17T12:17:05.042032+0000","last_clean":"2024-02-17T12:17:05.042032+0000","last_became_active":"2024-02-17T12:17:05.037213+0000","last_became_peered":"2024-02-17T12:17:05.037213+0000","last_unstale":"2024-02-17T12:17:05.042032+0000","last_undegraded":"2024-02-17T12:17:05.042032+0000","last_fullsized":"2024-02-17T12:17:05.042032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:36:34.983677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.020596+0000","last_change":"2024-02-17T12:17:05.020596+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.020596+0000","last_undegraded":"2024-02-17T12:17:05.020596+0000","last_fullsized":"2024-02-17T12:17:05.020596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041747+0000","last_change":"2024-02-17T12:17:05.034917+0000","last_active":"2024-02-17T12:17:05.041747+0000","last_peered":"2024-02-17T12:17:05.041747+0000","last_clean":"2024-02-17T12:17:05.041747+0000","last_became_active":"2024-02-17T12:17:05.034653+0000","last_became_peered":"2024-02-17T12:17:05.034653+0000","last_unstale":"2024-02-17T12:17:05.041747+0000","last_undegraded":"2024-02-17T12:17:05.041747+0000","last_fullsized":"2024-02-17T12:17:05.041747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:16:15.107694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.028102+0000","last_change":"2024-02-17T12:17:05.028102+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.028102+0000","last_undegraded":"2024-02-17T12:17:05.028102+0000","last_fullsized":"2024-02-17T12:17:05.028102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.031171+0000","last_change":"2024-02-17T12:17:05.026508+0000","last_active":"2024-02-17T12:17:05.031171+0000","last_peered":"2024-02-17T12:17:05.031171+0000","last_clean":"2024-02-17T12:17:05.031171+0000","last_became_active":"2024-02-17T12:17:05.026238+0000","last_became_peered":"2024-02-17T12:17:05.026238+0000","last_unstale":"2024-02-17T12:17:05.031171+0000","last_undegraded":"2024-02-17T12:17:05.031171+0000","last_fullsized":"2024-02-17T12:17:05.031171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:33:08.214296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-02-17T12:17:05.021248+0000","last_change":"2024-02-17T12:17:05.021248+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.021248+0000","last_undegraded":"2024-02-17T12:17:05.021248+0000","last_fullsized":"2024-02-17T12:17:05.021248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-17T12:17:04.009717+0000","last_change":"2024-02-17T12:17:04.009717+0000","last_active":"2024-02-17T12:17:03.997307+0000","last_peered":"2024-02-17T12:17:03.997307+0000","last_clean":"2024-02-17T12:17:03.997307+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:04.009717+0000","last_undegraded":"2024-02-17T12:17:04.009717+0000","last_fullsized":"2024-02-17T12:17:04.009717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.041960+0000","last_change":"2024-02-17T12:17:05.036670+0000","last_active":"2024-02-17T12:17:05.041960+0000","last_peered":"2024-02-17T12:17:05.041960+0000","last_clean":"2024-02-17T12:17:05.041960+0000","last_became_active":"2024-02-17T12:17:05.036395+0000","last_became_peered":"2024-02-17T12:17:05.036395+0000","last_unstale":"2024-02-17T12:17:05.041960+0000","last_undegraded":"2024-02-17T12:17:05.041960+0000","last_fullsized":"2024-02-17T12:17:05.041960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:17:05.004567+0000","last_change":"2024-02-17T12:17:05.004567+0000","last_active":"2024-02-17T12:17:05.004567+0000","last_peered":"2024-02-17T12:17:05.004567+0000","last_clean":"2024-02-17T12:17:05.004567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:17:05.004567+0000","last_undegraded":"2024-02-17T12:17:05.004567+0000","last_fullsized":"2024-02-17T12:17:05.004567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-17T12:17:05.040343+0000","last_change":"2024-02-17T12:17:05.036734+0000","last_active":"2024-02-17T12:17:05.040343+0000","last_peered":"2024-02-17T12:17:05.040343+0000","last_clean":"2024-02-17T12:17:05.040343+0000","last_became_active":"2024-02-17T12:17:05.036453+0000","last_became_peered":"2024-02-17T12:17:05.036453+0000","last_unstale":"2024-02-17T12:17:05.040343+0000","last_undegraded":"2024-02-17T12:17:05.040343+0000","last_fullsized":"2024-02-17T12:17:05.040343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-17T12:17:04.014249+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:17:04.014249+0000","last_peered":"2024-02-17T12:17:04.014249+0000","last_clean":"2024-02-17T12:17:04.014249+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:17:04.014249+0000","last_undegraded":"2024-02-17T12:17:04.014249+0000","last_fullsized":"2024-02-17T12:17:04.014249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":74,"acting":74,"num_store_stats":5},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":122658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":122658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":706759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":706759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":303104,"data_stored":110574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":116391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:17:10.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-02-17T12:17:10.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.021999+0000', 'last_change': '2024-02-17T12:17:05.021999+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.021999+0000', 'last_undegraded': '2024-02-17T12:17:05.021999+0000', 'last_fullsized': '2024-02-17T12:17:05.021999+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:17:10.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-02-17T12:17:10.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.023424+0000', 'last_change': '2024-02-17T12:17:05.023424+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.023424+0000', 'last_undegraded': '2024-02-17T12:17:05.023424+0000', 'last_fullsized': '2024-02-17T12:17:05.023424+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:17:10.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-02-17T12:17:10.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.015930+0000', 'last_change': '2024-02-17T12:17:05.015930+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.015930+0000', 'last_undegraded': '2024-02-17T12:17:05.015930+0000', 'last_fullsized': '2024-02-17T12:17:05.015930+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:17:10.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-02-17T12:17:10.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.021531+0000', 'last_change': '2024-02-17T12:17:05.021531+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.021531+0000', 'last_undegraded': '2024-02-17T12:17:05.021531+0000', 'last_fullsized': '2024-02-17T12:17:05.021531+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:17:10.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-02-17T12:17:10.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-02-17T12:17:10.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.023173+0000', 'last_change': '2024-02-17T12:17:05.023173+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.023173+0000', 'last_undegraded': '2024-02-17T12:17:05.023173+0000', 'last_fullsized': '2024-02-17T12:17:05.023173+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:17:10.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-02-17T12:17:10.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-02-17T12:17:10.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-02-17T12:17:10.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.020903+0000', 'last_change': '2024-02-17T12:17:05.020903+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.020903+0000', 'last_undegraded': '2024-02-17T12:17:05.020903+0000', 'last_fullsized': '2024-02-17T12:17:05.020903+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.016508+0000', 'last_change': '2024-02-17T12:17:05.016508+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.016508+0000', 'last_undegraded': '2024-02-17T12:17:05.016508+0000', 'last_fullsized': '2024-02-17T12:17:05.016508+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.022619+0000', 'last_change': '2024-02-17T12:17:05.022619+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.022619+0000', 'last_undegraded': '2024-02-17T12:17:05.022619+0000', 'last_fullsized': '2024-02-17T12:17:05.022619+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-02-17T12:17:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.015643+0000', 'last_change': '2024-02-17T12:17:05.015643+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.015643+0000', 'last_undegraded': '2024-02-17T12:17:05.015643+0000', 'last_fullsized': '2024-02-17T12:17:05.015643+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:17:10.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-02-17T12:17:10.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-02-17T12:17:10.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-02-17T12:17:10.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.021207+0000', 'last_change': '2024-02-17T12:17:05.021207+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.021207+0000', 'last_undegraded': '2024-02-17T12:17:05.021207+0000', 'last_fullsized': '2024-02-17T12:17:05.021207+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:17:10.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-02-17T12:17:10.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.020746+0000', 'last_change': '2024-02-17T12:17:05.020746+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.020746+0000', 'last_undegraded': '2024-02-17T12:17:05.020746+0000', 'last_fullsized': '2024-02-17T12:17:05.020746+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:17:10.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-02-17T12:17:10.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-02-17T12:17:10.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-02-17T12:17:10.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-02-17T12:17:10.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.024948+0000', 'last_change': '2024-02-17T12:17:05.024948+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.024948+0000', 'last_undegraded': '2024-02-17T12:17:05.024948+0000', 'last_fullsized': '2024-02-17T12:17:05.024948+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T12:17:10.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-02-17T12:17:10.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.015857+0000', 'last_change': '2024-02-17T12:17:05.015857+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.015857+0000', 'last_undegraded': '2024-02-17T12:17:05.015857+0000', 'last_fullsized': '2024-02-17T12:17:05.015857+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:17:10.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-02-17T12:17:10.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.018823+0000', 'last_change': '2024-02-17T12:17:05.018823+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.018823+0000', 'last_undegraded': '2024-02-17T12:17:05.018823+0000', 'last_fullsized': '2024-02-17T12:17:05.018823+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:17:10.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-02-17T12:17:10.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.020119+0000', 'last_change': '2024-02-17T12:17:05.020119+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.020119+0000', 'last_undegraded': '2024-02-17T12:17:05.020119+0000', 'last_fullsized': '2024-02-17T12:17:05.020119+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:17:10.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-02-17T12:17:10.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.019781+0000', 'last_change': '2024-02-17T12:17:05.019781+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.019781+0000', 'last_undegraded': '2024-02-17T12:17:05.019781+0000', 'last_fullsized': '2024-02-17T12:17:05.019781+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:17:10.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-02-17T12:17:10.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.015108+0000', 'last_change': '2024-02-17T12:17:05.015108+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.015108+0000', 'last_undegraded': '2024-02-17T12:17:05.015108+0000', 'last_fullsized': '2024-02-17T12:17:05.015108+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:17:10.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-02-17T12:17:10.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-02-17T12:17:10.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-02-17T12:17:10.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.021688+0000', 'last_change': '2024-02-17T12:17:05.021688+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.021688+0000', 'last_undegraded': '2024-02-17T12:17:05.021688+0000', 'last_fullsized': '2024-02-17T12:17:05.021688+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:17:10.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-02-17T12:17:10.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-02-17T12:17:10.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.027129+0000', 'last_change': '2024-02-17T12:17:05.027129+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.027129+0000', 'last_undegraded': '2024-02-17T12:17:05.027129+0000', 'last_fullsized': '2024-02-17T12:17:05.027129+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T12:17:10.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-02-17T12:17:10.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.021555+0000', 'last_change': '2024-02-17T12:17:05.021555+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.021555+0000', 'last_undegraded': '2024-02-17T12:17:05.021555+0000', 'last_fullsized': '2024-02-17T12:17:05.021555+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:17:10.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-02-17T12:17:10.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-02-17T12:17:10.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.019217+0000', 'last_change': '2024-02-17T12:17:05.019217+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.019217+0000', 'last_undegraded': '2024-02-17T12:17:05.019217+0000', 'last_fullsized': '2024-02-17T12:17:05.019217+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:17:10.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:04.011402+0000', 'last_change': '2024-02-17T12:17:04.011402+0000', 'last_active': '2024-02-17T12:17:03.997307+0000', 'last_peered': '2024-02-17T12:17:03.997307+0000', 'last_clean': '2024-02-17T12:17:03.997307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:04.011402+0000', 'last_undegraded': '2024-02-17T12:17:04.011402+0000', 'last_fullsized': '2024-02-17T12:17:04.011402+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:04.011438+0000', 'last_change': '2024-02-17T12:17:04.011438+0000', 'last_active': '2024-02-17T12:17:03.997307+0000', 'last_peered': '2024-02-17T12:17:03.997307+0000', 'last_clean': '2024-02-17T12:17:03.997307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:04.011438+0000', 'last_undegraded': '2024-02-17T12:17:04.011438+0000', 'last_fullsized': '2024-02-17T12:17:04.011438+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.015155+0000', 'last_change': '2024-02-17T12:17:05.015155+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.015155+0000', 'last_undegraded': '2024-02-17T12:17:05.015155+0000', 'last_fullsized': '2024-02-17T12:17:05.015155+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:04.009681+0000', 'last_change': '2024-02-17T12:17:04.009681+0000', 'last_active': '2024-02-17T12:17:03.997307+0000', 'last_peered': '2024-02-17T12:17:03.997307+0000', 'last_clean': '2024-02-17T12:17:03.997307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:04.009681+0000', 'last_undegraded': '2024-02-17T12:17:04.009681+0000', 'last_fullsized': '2024-02-17T12:17:04.009681+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-02-17T12:17:10.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-02-17T12:17:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.019933+0000', 'last_change': '2024-02-17T12:17:05.019933+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.019933+0000', 'last_undegraded': '2024-02-17T12:17:05.019933+0000', 'last_fullsized': '2024-02-17T12:17:05.019933+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:17:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-02-17T12:17:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:04.010789+0000', 'last_change': '2024-02-17T12:17:04.010789+0000', 'last_active': '2024-02-17T12:17:03.997307+0000', 'last_peered': '2024-02-17T12:17:03.997307+0000', 'last_clean': '2024-02-17T12:17:03.997307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:04.010789+0000', 'last_undegraded': '2024-02-17T12:17:04.010789+0000', 'last_fullsized': '2024-02-17T12:17:04.010789+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:17:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-02-17T12:17:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.015802+0000', 'last_change': '2024-02-17T12:17:05.015802+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.015802+0000', 'last_undegraded': '2024-02-17T12:17:05.015802+0000', 'last_fullsized': '2024-02-17T12:17:05.015802+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:17:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-02-17T12:17:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.018515+0000', 'last_change': '2024-02-17T12:17:05.018515+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.018515+0000', 'last_undegraded': '2024-02-17T12:17:05.018515+0000', 'last_fullsized': '2024-02-17T12:17:05.018515+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:17:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-02-17T12:17:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.019403+0000', 'last_change': '2024-02-17T12:17:05.019403+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.019403+0000', 'last_undegraded': '2024-02-17T12:17:05.019403+0000', 'last_fullsized': '2024-02-17T12:17:05.019403+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:17:10.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-02-17T12:17:10.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.016475+0000', 'last_change': '2024-02-17T12:17:05.016475+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.016475+0000', 'last_undegraded': '2024-02-17T12:17:05.016475+0000', 'last_fullsized': '2024-02-17T12:17:05.016475+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:17:10.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-02-17T12:17:10.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.018784+0000', 'last_change': '2024-02-17T12:17:05.018784+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.018784+0000', 'last_undegraded': '2024-02-17T12:17:05.018784+0000', 'last_fullsized': '2024-02-17T12:17:05.018784+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:17:10.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-02-17T12:17:10.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:04.009350+0000', 'last_change': '2024-02-17T12:17:04.009350+0000', 'last_active': '2024-02-17T12:17:03.997307+0000', 'last_peered': '2024-02-17T12:17:03.997307+0000', 'last_clean': '2024-02-17T12:17:03.997307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:04.009350+0000', 'last_undegraded': '2024-02-17T12:17:04.009350+0000', 'last_fullsized': '2024-02-17T12:17:04.009350+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:17:10.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-02-17T12:17:10.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.017776+0000', 'last_change': '2024-02-17T12:17:05.017776+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.017776+0000', 'last_undegraded': '2024-02-17T12:17:05.017776+0000', 'last_fullsized': '2024-02-17T12:17:05.017776+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:17:10.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-02-17T12:17:10.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.020422+0000', 'last_change': '2024-02-17T12:17:05.020422+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.020422+0000', 'last_undegraded': '2024-02-17T12:17:05.020422+0000', 'last_fullsized': '2024-02-17T12:17:05.020422+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.016834+0000', 'last_change': '2024-02-17T12:17:05.016834+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.016834+0000', 'last_undegraded': '2024-02-17T12:17:05.016834+0000', 'last_fullsized': '2024-02-17T12:17:05.016834+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:04.010365+0000', 'last_change': '2024-02-17T12:17:04.010365+0000', 'last_active': '2024-02-17T12:17:03.997307+0000', 'last_peered': '2024-02-17T12:17:03.997307+0000', 'last_clean': '2024-02-17T12:17:03.997307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:04.010365+0000', 'last_undegraded': '2024-02-17T12:17:04.010365+0000', 'last_fullsized': '2024-02-17T12:17:04.010365+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.018360+0000', 'last_change': '2024-02-17T12:17:05.018360+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.018360+0000', 'last_undegraded': '2024-02-17T12:17:05.018360+0000', 'last_fullsized': '2024-02-17T12:17:05.018360+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-02-17T12:17:10.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:04.009312+0000', 'last_change': '2024-02-17T12:17:04.009312+0000', 'last_active': '2024-02-17T12:17:03.997307+0000', 'last_peered': '2024-02-17T12:17:03.997307+0000', 'last_clean': '2024-02-17T12:17:03.997307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:04.009312+0000', 'last_undegraded': '2024-02-17T12:17:04.009312+0000', 'last_fullsized': '2024-02-17T12:17:04.009312+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:17:10.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-02-17T12:17:10.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-02-17T12:17:10.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:04.009289+0000', 'last_change': '2024-02-17T12:17:04.009289+0000', 'last_active': '2024-02-17T12:17:03.997307+0000', 'last_peered': '2024-02-17T12:17:03.997307+0000', 'last_clean': '2024-02-17T12:17:03.997307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:04.009289+0000', 'last_undegraded': '2024-02-17T12:17:04.009289+0000', 'last_fullsized': '2024-02-17T12:17:04.009289+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:17:10.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-02-17T12:17:10.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-02-17T12:17:10.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:04.010291+0000', 'last_change': '2024-02-17T12:17:04.010291+0000', 'last_active': '2024-02-17T12:17:03.997307+0000', 'last_peered': '2024-02-17T12:17:03.997307+0000', 'last_clean': '2024-02-17T12:17:03.997307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:04.010291+0000', 'last_undegraded': '2024-02-17T12:17:04.010291+0000', 'last_fullsized': '2024-02-17T12:17:04.010291+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.015310+0000', 'last_change': '2024-02-17T12:17:05.015310+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.015310+0000', 'last_undegraded': '2024-02-17T12:17:05.015310+0000', 'last_fullsized': '2024-02-17T12:17:05.015310+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:17:10.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-02-17T12:17:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.026078+0000', 'last_change': '2024-02-17T12:17:05.026078+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.026078+0000', 'last_undegraded': '2024-02-17T12:17:05.026078+0000', 'last_fullsized': '2024-02-17T12:17:05.026078+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T12:17:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-02-17T12:17:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.020596+0000', 'last_change': '2024-02-17T12:17:05.020596+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.020596+0000', 'last_undegraded': '2024-02-17T12:17:05.020596+0000', 'last_fullsized': '2024-02-17T12:17:05.020596+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:17:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-02-17T12:17:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.028102+0000', 'last_change': '2024-02-17T12:17:05.028102+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.028102+0000', 'last_undegraded': '2024-02-17T12:17:05.028102+0000', 'last_fullsized': '2024-02-17T12:17:05.028102+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T12:17:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-02-17T12:17:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:05.021248+0000', 'last_change': '2024-02-17T12:17:05.021248+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.021248+0000', 'last_undegraded': '2024-02-17T12:17:05.021248+0000', 'last_fullsized': '2024-02-17T12:17:05.021248+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:17:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-02-17T12:17:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:17:04.009717+0000', 'last_change': '2024-02-17T12:17:04.009717+0000', 'last_active': '2024-02-17T12:17:03.997307+0000', 'last_peered': '2024-02-17T12:17:03.997307+0000', 'last_clean': '2024-02-17T12:17:03.997307+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:04.009717+0000', 'last_undegraded': '2024-02-17T12:17:04.009717+0000', 'last_fullsized': '2024-02-17T12:17:04.009717+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:03.997307+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:17:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-02-17T12:17:10.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-02-17T12:17:10.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:17:05.004567+0000', 'last_change': '2024-02-17T12:17:05.004567+0000', 'last_active': '2024-02-17T12:17:05.004567+0000', 'last_peered': '2024-02-17T12:17:05.004567+0000', 'last_clean': '2024-02-17T12:17:05.004567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:17:05.004567+0000', 'last_undegraded': '2024-02-17T12:17:05.004567+0000', 'last_fullsized': '2024-02-17T12:17:05.004567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'last_clean_scrub_stamp': '2024-02-17T12:17:05.004567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:17:10.881 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-17T12:17:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bd1c00640 1 Processor -- start 2024-02-17T12:17:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bd1c00640 1 -- start start 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bd1c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1bcc14ba10 0x7f1bcc0c6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bd1c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc155870 0x7f1bcc0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bd1c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc1583e0 con 0x7f1bcc0c6420 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bd1c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc155cc0 con 0x7f1bcc14ba10 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bd1c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0c30a0 con 0x7f1bcc155870 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bcaa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1bcc14ba10 0x7f1bcc0c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bcaa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1bcc14ba10 0x7f1bcc0c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42658/0 (socket says 172.21.15.114:42658) 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bcaa00640 1 -- 172.21.15.114:0/1477612520 learned_addr learned my addr 172.21.15.114:0/1477612520 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bcb400640 1 --2- 172.21.15.114:0/1477612520 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc155870 0x7f1bcc0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bcaa00640 1 -- 172.21.15.114:0/1477612520 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc155870 msgr2=0x7f1bcc0c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bcaa00640 1 --2- 172.21.15.114:0/1477612520 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc155870 0x7f1bcc0c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bcaa00640 1 -- 172.21.15.114:0/1477612520 >> v1:172.21.15.116:6789/0 conn(0x7f1bcc0c6420 legacy=0x7f1bcc158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bcaa00640 1 -- 172.21.15.114:0/1477612520 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc0c3360 con 0x7f1bcc14ba10 2024-02-17T12:17:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.026+0000 7f1bcb400640 1 --2- 172.21.15.114:0/1477612520 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc155870 0x7f1bcc0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:11.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bcaa00640 1 --2- 172.21.15.114:0/1477612520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc14ba10 0x7f1bcc0c6930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009870 tx=0x7f1bbc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f5daf6f42109e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:11.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bc9600640 1 -- 172.21.15.114:0/1477612520 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0ab610 con 0x7f1bcc14ba10 2024-02-17T12:17:11.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bc9600640 1 -- 172.21.15.114:0/1477612520 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0ab770 con 0x7f1bcc14ba10 2024-02-17T12:17:11.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bc9600640 1 -- 172.21.15.114:0/1477612520 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0abb00 con 0x7f1bcc14ba10 2024-02-17T12:17:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bd1c00640 1 -- 172.21.15.114:0/1477612520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc14ba10 msgr2=0x7f1bcc0c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bd1c00640 1 --2- 172.21.15.114:0/1477612520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc14ba10 0x7f1bcc0c6930 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009870 tx=0x7f1bbc01c410 comp rx=0 tx=0).stop 2024-02-17T12:17:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bd1c00640 1 -- 172.21.15.114:0/1477612520 shutdown_connections 2024-02-17T12:17:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bd1c00640 1 --2- 172.21.15.114:0/1477612520 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc155870 0x7f1bcc0c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bd1c00640 1 --2- 172.21.15.114:0/1477612520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc14ba10 0x7f1bcc0c6930 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bd1c00640 1 -- 172.21.15.114:0/1477612520 >> 172.21.15.114:0/1477612520 conn(0x7f1bcc066d60 msgr2=0x7f1bcc067170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bd1c00640 1 -- 172.21.15.114:0/1477612520 shutdown_connections 2024-02-17T12:17:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.030+0000 7f1bd1c00640 1 -- 172.21.15.114:0/1477612520 wait complete. 2024-02-17T12:17:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bd1c00640 1 Processor -- start 2024-02-17T12:17:11.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bd1c00640 1 -- start start 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bd1c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc0c6420 0x7f1bcc145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bd1c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1bcc14ba10 0x7f1bcc0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bd1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc155870 0x7f1bcc0abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bd1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0a87c0 con 0x7f1bcc155870 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bd1c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc06d980 con 0x7f1bcc14ba10 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bd1c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0a81e0 con 0x7f1bcc0c6420 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bcb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc155870 0x7f1bcc0abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bcb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc155870 0x7f1bcc0abb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42668/0 (socket says 172.21.15.114:42668) 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bcb400640 1 -- 172.21.15.114:0/959224130 learned_addr learned my addr 172.21.15.114:0/959224130 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bcaa00640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc0c6420 0x7f1bcc145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bca000640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1bcc14ba10 0x7f1bcc0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bcb400640 1 -- 172.21.15.114:0/959224130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc0c6420 msgr2=0x7f1bcc145970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bcb400640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc0c6420 0x7f1bcc145970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bcb400640 1 -- 172.21.15.114:0/959224130 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1bcc14ba10 msgr2=0x7f1bcc0ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bcb400640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1bcc14ba10 0x7f1bcc0ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bcb400640 1 -- 172.21.15.114:0/959224130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc0094d0 con 0x7f1bcc155870 2024-02-17T12:17:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bcb400640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc155870 0x7f1bcc0abb20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4007e50 tx=0x7f1bc400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bc2a00640 1 -- 172.21.15.114:0/959224130 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40039a0 con 0x7f1bcc155870 2024-02-17T12:17:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bc2a00640 1 -- 172.21.15.114:0/959224130 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc400f040 con 0x7f1bcc155870 2024-02-17T12:17:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bc2a00640 1 -- 172.21.15.114:0/959224130 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4003d20 con 0x7f1bcc155870 2024-02-17T12:17:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bd1c00640 1 -- 172.21.15.114:0/959224130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc154c00 con 0x7f1bcc155870 2024-02-17T12:17:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.034+0000 7f1bd1c00640 1 -- 172.21.15.114:0/959224130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc06c730 con 0x7f1bcc155870 2024-02-17T12:17:11.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.038+0000 7f1bd1c00640 1 -- 172.21.15.114:0/959224130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc074840 con 0x7f1bcc155870 2024-02-17T12:17:11.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.038+0000 7f1bc2a00640 1 -- 172.21.15.114:0/959224130 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1bc4004030 con 0x7f1bcc155870 2024-02-17T12:17:11.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.038+0000 7f1bc2a00640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1bac066e40 0x7f1bac069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.038+0000 7f1bc2a00640 1 -- 172.21.15.114:0/959224130 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bc4084c90 con 0x7f1bcc155870 2024-02-17T12:17:11.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.038+0000 7f1bcaa00640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1bac066e40 0x7f1bac069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.038+0000 7f1bcaa00640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1bac066e40 0x7f1bac069300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0af000 tx=0x7f1bbc0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.042+0000 7f1bc2a00640 1 -- 172.21.15.114:0/959224130 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1bc4051b20 con 0x7f1bcc155870 2024-02-17T12:17:11.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.250+0000 7f1bd1c00640 1 -- 172.21.15.114:0/959224130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1bcc0c2850 con 0x7f1bcc155870 2024-02-17T12:17:11.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.250+0000 7f1bc2a00640 1 -- 172.21.15.114:0/959224130 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2722 (secure 0 0 0) 0x7f1bc401aac0 con 0x7f1bcc155870 2024-02-17T12:17:11.258 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:11.258 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":73,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1708172169,"num_in_osds":8,"osd_in_since":1708172160,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":47},{"state_name":"unknown","count":27},{"state_name":"active+clean","count":23}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":229355520,"bytes_avail":772864757760,"bytes_total":773094113280,"unknown_pgs_ratio":0.27835050225257874,"inactive_pgs_ratio":0.48453608155250549},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4947}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-02-17T12:17:05.225394+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-17T12:17:11.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 -- 172.21.15.114:0/959224130 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1bac066e40 msgr2=0x7f1bac069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1bac066e40 0x7f1bac069300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0af000 tx=0x7f1bbc0b6040 comp rx=0 tx=0).stop 2024-02-17T12:17:11.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 -- 172.21.15.114:0/959224130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc155870 msgr2=0x7f1bcc0abb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc155870 0x7f1bcc0abb20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4007e50 tx=0x7f1bc400d4a0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 -- 172.21.15.114:0/959224130 shutdown_connections 2024-02-17T12:17:11.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1bac066e40 0x7f1bac069300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bcc155870 0x7f1bcc0abb20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1bcc14ba10 0x7f1bcc0ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 --2- 172.21.15.114:0/959224130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1bcc0c6420 0x7f1bcc145970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 -- 172.21.15.114:0/959224130 >> 172.21.15.114:0/959224130 conn(0x7f1bcc066d60 msgr2=0x7f1bcc0aa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:11.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 -- 172.21.15.114:0/959224130 shutdown_connections 2024-02-17T12:17:11.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.254+0000 7f1bd1c00640 1 -- 172.21.15.114:0/959224130 wait complete. 2024-02-17T12:17:11.279 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-17T12:17:11.279 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:17:11.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.406+0000 7ffb28200640 1 Processor -- start 2024-02-17T12:17:11.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.406+0000 7ffb28200640 1 -- start start 2024-02-17T12:17:11.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.406+0000 7ffb28200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014f110 0x7ffb200c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.406+0000 7ffb28200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ffb200c2580 0x7ffb200aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.406+0000 7ffb28200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb200a9420 con 0x7ffb200c1eb0 2024-02-17T12:17:11.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.406+0000 7ffb28200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2014f4f0 con 0x7ffb200c2580 2024-02-17T12:17:11.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.406+0000 7ffb28200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb200aae80 con 0x7ffb2014f110 2024-02-17T12:17:11.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.406+0000 7ffb26200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffb200c1eb0 0x7ffb20155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50814/0 (socket says 172.21.15.114:50814) 2024-02-17T12:17:11.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.406+0000 7ffb26200640 1 -- 172.21.15.114:0/1643214263 learned_addr learned my addr 172.21.15.114:0/1643214263 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:11.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb25800640 1 --2- 172.21.15.114:0/1643214263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014f110 0x7ffb200c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb24e00640 1 --2- 172.21.15.114:0/1643214263 >> v2:172.21.15.116:3300/0 conn(0x7ffb200c2580 0x7ffb200aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb1fe00640 1 -- 172.21.15.114:0/1643214263 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212768008 0 0) 0x7ffb200a9420 con 0x7ffb200c1eb0 2024-02-17T12:17:11.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb1fe00640 1 -- 172.21.15.114:0/1643214263 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb08003530 con 0x7ffb200c1eb0 2024-02-17T12:17:11.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb24e00640 1 -- 172.21.15.114:0/1643214263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014f110 msgr2=0x7ffb200c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:11.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb24e00640 1 --2- 172.21.15.114:0/1643214263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014f110 0x7ffb200c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb24e00640 1 -- 172.21.15.114:0/1643214263 >> v1:172.21.15.114:6789/0 conn(0x7ffb200c1eb0 legacy=0x7ffb20155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb24e00640 1 -- 172.21.15.114:0/1643214263 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb20152850 con 0x7ffb200c2580 2024-02-17T12:17:11.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb25800640 1 --2- 172.21.15.114:0/1643214263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014f110 0x7ffb200c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb24e00640 1 --2- 172.21.15.114:0/1643214263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb200c2580 0x7ffb200aa150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffb140097c0 tx=0x7ffb1401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=747dcec80d2fdd8c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.410+0000 7ffb1fe00640 1 -- 172.21.15.114:0/1643214263 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140ac640 con 0x7ffb200c2580 2024-02-17T12:17:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb1fe00640 1 -- 172.21.15.114:0/1643214263 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb140ac7a0 con 0x7ffb200c2580 2024-02-17T12:17:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb1fe00640 1 -- 172.21.15.114:0/1643214263 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140acb30 con 0x7ffb200c2580 2024-02-17T12:17:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 -- 172.21.15.114:0/1643214263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb200c2580 msgr2=0x7ffb200aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 --2- 172.21.15.114:0/1643214263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb200c2580 0x7ffb200aa150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffb140097c0 tx=0x7ffb1401c3e0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 -- 172.21.15.114:0/1643214263 shutdown_connections 2024-02-17T12:17:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 --2- 172.21.15.114:0/1643214263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb200c2580 0x7ffb200aa150 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 --2- 172.21.15.114:0/1643214263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014f110 0x7ffb200c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 -- 172.21.15.114:0/1643214263 >> 172.21.15.114:0/1643214263 conn(0x7ffb200a8490 msgr2=0x7ffb200a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 -- 172.21.15.114:0/1643214263 shutdown_connections 2024-02-17T12:17:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 -- 172.21.15.114:0/1643214263 wait complete. 2024-02-17T12:17:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 Processor -- start 2024-02-17T12:17:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 -- start start 2024-02-17T12:17:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb200c1eb0 0x7ffb2013fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb2014f110 0x7ffb201400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014ce70 0x7ffb201505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb20142820 con 0x7ffb2014f110 2024-02-17T12:17:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2014d4c0 con 0x7ffb200c1eb0 2024-02-17T12:17:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb28200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2014f9b0 con 0x7ffb2014ce70 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb24e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb2014f110 0x7ffb201400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb24e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb2014f110 0x7ffb201400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42676/0 (socket says 172.21.15.114:42676) 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb24e00640 1 -- 172.21.15.114:0/382639180 learned_addr learned my addr 172.21.15.114:0/382639180 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb25800640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb200c1eb0 0x7ffb2013fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb26200640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014ce70 0x7ffb201505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb24e00640 1 -- 172.21.15.114:0/382639180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014ce70 msgr2=0x7ffb201505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb24e00640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014ce70 0x7ffb201505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb24e00640 1 -- 172.21.15.114:0/382639180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb200c1eb0 msgr2=0x7ffb2013fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb24e00640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb200c1eb0 0x7ffb2013fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb24e00640 1 -- 172.21.15.114:0/382639180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10009420 con 0x7ffb2014f110 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.414+0000 7ffb26200640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014ce70 0x7ffb201505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb24e00640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb2014f110 0x7ffb201400f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffb140af040 tx=0x7ffb14019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb1d600640 1 -- 172.21.15.114:0/382639180 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140b5610 con 0x7ffb2014f110 2024-02-17T12:17:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb1d600640 1 -- 172.21.15.114:0/382639180 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb140b5790 con 0x7ffb2014f110 2024-02-17T12:17:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb1d600640 1 -- 172.21.15.114:0/382639180 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140b5b40 con 0x7ffb2014f110 2024-02-17T12:17:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb28200640 1 -- 172.21.15.114:0/382639180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb14009420 con 0x7ffb2014f110 2024-02-17T12:17:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb28200640 1 -- 172.21.15.114:0/382639180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2014ff50 con 0x7ffb2014f110 2024-02-17T12:17:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb28200640 1 -- 172.21.15.114:0/382639180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb20142960 con 0x7ffb2014f110 2024-02-17T12:17:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb1d600640 1 -- 172.21.15.114:0/382639180 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ffb140b3040 con 0x7ffb2014f110 2024-02-17T12:17:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb1d600640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffb04066e40 0x7ffb04069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:11.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb1d600640 1 -- 172.21.15.114:0/382639180 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb1411ec90 con 0x7ffb2014f110 2024-02-17T12:17:11.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.418+0000 7ffb25800640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffb04066e40 0x7ffb04069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:11.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.422+0000 7ffb25800640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffb04066e40 0x7ffb04069300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffb20068190 tx=0x7ffb10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:11.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.422+0000 7ffb1d600640 1 -- 172.21.15.114:0/382639180 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffb20142960 con 0x7ffb2014f110 2024-02-17T12:17:11.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.574+0000 7ffb28200640 1 -- 172.21.15.114:0/382639180 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb200aa690 con 0x7ffb04066e40 2024-02-17T12:17:11.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.582+0000 7ffb1d600640 1 -- 172.21.15.114:0/382639180 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+265601 (secure 0 0 0) 0x7ffb10011a70 con 0x7ffb04066e40 2024-02-17T12:17:11.591 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:11.593 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:17:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 -- 172.21.15.114:0/382639180 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffb04066e40 msgr2=0x7ffb04069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffb04066e40 0x7ffb04069300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffb20068190 tx=0x7ffb10008040 comp rx=0 tx=0).stop 2024-02-17T12:17:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 -- 172.21.15.114:0/382639180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb2014f110 msgr2=0x7ffb201400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb2014f110 0x7ffb201400f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffb140af040 tx=0x7ffb14019180 comp rx=0 tx=0).stop 2024-02-17T12:17:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 -- 172.21.15.114:0/382639180 shutdown_connections 2024-02-17T12:17:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb2014ce70 0x7ffb201505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffb04066e40 0x7ffb04069300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb2014f110 0x7ffb201400f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 --2- 172.21.15.114:0/382639180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb200c1eb0 0x7ffb2013fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:11.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 -- 172.21.15.114:0/382639180 >> 172.21.15.114:0/382639180 conn(0x7ffb200a8490 msgr2=0x7ffb200a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:11.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 -- 172.21.15.114:0/382639180 shutdown_connections 2024-02-17T12:17:11.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:11.586+0000 7ffb28200640 1 -- 172.21.15.114:0/382639180 wait complete. 2024-02-17T12:17:11.612 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-02-17T12:17:11.226407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224344,"kb_used_data":3976,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750376,"statfs":{"total":773094113280,"available":772864385024,"internally_reserved":0,"allocated":4071424,"data_stored":2271420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.216934"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068069+0000","last_change":"2024-02-17T12:17:06.053476+0000","last_active":"2024-02-17T12:17:07.068069+0000","last_peered":"2024-02-17T12:17:07.068069+0000","last_clean":"2024-02-17T12:17:07.068069+0000","last_became_active":"2024-02-17T12:17:06.052947+0000","last_became_peered":"2024-02-17T12:17:06.052947+0000","last_unstale":"2024-02-17T12:17:07.068069+0000","last_undegraded":"2024-02-17T12:17:07.068069+0000","last_fullsized":"2024-02-17T12:17:07.068069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:38.086638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066586+0000","last_change":"2024-02-17T12:17:06.052373+0000","last_active":"2024-02-17T12:17:07.066586+0000","last_peered":"2024-02-17T12:17:07.066586+0000","last_clean":"2024-02-17T12:17:07.066586+0000","last_became_active":"2024-02-17T12:17:06.050597+0000","last_became_peered":"2024-02-17T12:17:06.050597+0000","last_unstale":"2024-02-17T12:17:07.066586+0000","last_undegraded":"2024-02-17T12:17:07.066586+0000","last_fullsized":"2024-02-17T12:17:07.066586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:34:21.177151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033584+0000","last_change":"2024-02-17T12:17:06.061029+0000","last_active":"2024-02-17T12:17:07.033584+0000","last_peered":"2024-02-17T12:17:07.033584+0000","last_clean":"2024-02-17T12:17:07.033584+0000","last_became_active":"2024-02-17T12:17:06.060750+0000","last_became_peered":"2024-02-17T12:17:06.060750+0000","last_unstale":"2024-02-17T12:17:07.033584+0000","last_undegraded":"2024-02-17T12:17:07.033584+0000","last_fullsized":"2024-02-17T12:17:07.033584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:49.648481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058415+0000","last_change":"2024-02-17T12:17:06.065748+0000","last_active":"2024-02-17T12:17:07.058415+0000","last_peered":"2024-02-17T12:17:07.058415+0000","last_clean":"2024-02-17T12:17:07.058415+0000","last_became_active":"2024-02-17T12:17:06.065234+0000","last_became_peered":"2024-02-17T12:17:06.065234+0000","last_unstale":"2024-02-17T12:17:07.058415+0000","last_undegraded":"2024-02-17T12:17:07.058415+0000","last_fullsized":"2024-02-17T12:17:07.058415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:25:38.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065635+0000","last_change":"2024-02-17T12:17:06.042206+0000","last_active":"2024-02-17T12:17:07.065635+0000","last_peered":"2024-02-17T12:17:07.065635+0000","last_clean":"2024-02-17T12:17:07.065635+0000","last_became_active":"2024-02-17T12:17:06.041911+0000","last_became_peered":"2024-02-17T12:17:06.041911+0000","last_unstale":"2024-02-17T12:17:07.065635+0000","last_undegraded":"2024-02-17T12:17:07.065635+0000","last_fullsized":"2024-02-17T12:17:07.065635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:09.997084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066209+0000","last_change":"2024-02-17T12:17:06.046884+0000","last_active":"2024-02-17T12:17:07.066209+0000","last_peered":"2024-02-17T12:17:07.066209+0000","last_clean":"2024-02-17T12:17:07.066209+0000","last_became_active":"2024-02-17T12:17:06.046588+0000","last_became_peered":"2024-02-17T12:17:06.046588+0000","last_unstale":"2024-02-17T12:17:07.066209+0000","last_undegraded":"2024-02-17T12:17:07.066209+0000","last_fullsized":"2024-02-17T12:17:07.066209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:50:00.758848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068200+0000","last_change":"2024-02-17T12:17:06.057466+0000","last_active":"2024-02-17T12:17:07.068200+0000","last_peered":"2024-02-17T12:17:07.068200+0000","last_clean":"2024-02-17T12:17:07.068200+0000","last_became_active":"2024-02-17T12:17:06.056922+0000","last_became_peered":"2024-02-17T12:17:06.056922+0000","last_unstale":"2024-02-17T12:17:07.068200+0000","last_undegraded":"2024-02-17T12:17:07.068200+0000","last_fullsized":"2024-02-17T12:17:07.068200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:48.842059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067801+0000","last_change":"2024-02-17T12:17:06.064126+0000","last_active":"2024-02-17T12:17:07.067801+0000","last_peered":"2024-02-17T12:17:07.067801+0000","last_clean":"2024-02-17T12:17:07.067801+0000","last_became_active":"2024-02-17T12:17:06.063876+0000","last_became_peered":"2024-02-17T12:17:06.063876+0000","last_unstale":"2024-02-17T12:17:07.067801+0000","last_undegraded":"2024-02-17T12:17:07.067801+0000","last_fullsized":"2024-02-17T12:17:07.067801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:33:43.849542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033961+0000","last_change":"2024-02-17T12:17:06.070529+0000","last_active":"2024-02-17T12:17:07.033961+0000","last_peered":"2024-02-17T12:17:07.033961+0000","last_clean":"2024-02-17T12:17:07.033961+0000","last_became_active":"2024-02-17T12:17:06.066959+0000","last_became_peered":"2024-02-17T12:17:06.066959+0000","last_unstale":"2024-02-17T12:17:07.033961+0000","last_undegraded":"2024-02-17T12:17:07.033961+0000","last_fullsized":"2024-02-17T12:17:07.033961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:56:36.987010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058520+0000","last_change":"2024-02-17T12:17:06.046775+0000","last_active":"2024-02-17T12:17:07.058520+0000","last_peered":"2024-02-17T12:17:07.058520+0000","last_clean":"2024-02-17T12:17:07.058520+0000","last_became_active":"2024-02-17T12:17:06.046488+0000","last_became_peered":"2024-02-17T12:17:06.046488+0000","last_unstale":"2024-02-17T12:17:07.058520+0000","last_undegraded":"2024-02-17T12:17:07.058520+0000","last_fullsized":"2024-02-17T12:17:07.058520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:09:44.880288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067772+0000","last_change":"2024-02-17T12:17:06.066599+0000","last_active":"2024-02-17T12:17:07.067772+0000","last_peered":"2024-02-17T12:17:07.067772+0000","last_clean":"2024-02-17T12:17:07.067772+0000","last_became_active":"2024-02-17T12:17:06.066328+0000","last_became_peered":"2024-02-17T12:17:06.066328+0000","last_unstale":"2024-02-17T12:17:07.067772+0000","last_undegraded":"2024-02-17T12:17:07.067772+0000","last_fullsized":"2024-02-17T12:17:07.067772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:05.232139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033277+0000","last_change":"2024-02-17T12:17:06.044931+0000","last_active":"2024-02-17T12:17:07.033277+0000","last_peered":"2024-02-17T12:17:07.033277+0000","last_clean":"2024-02-17T12:17:07.033277+0000","last_became_active":"2024-02-17T12:17:06.044646+0000","last_became_peered":"2024-02-17T12:17:06.044646+0000","last_unstale":"2024-02-17T12:17:07.033277+0000","last_undegraded":"2024-02-17T12:17:07.033277+0000","last_fullsized":"2024-02-17T12:17:07.033277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:16.951684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065406+0000","last_change":"2024-02-17T12:17:06.050786+0000","last_active":"2024-02-17T12:17:07.065406+0000","last_peered":"2024-02-17T12:17:07.065406+0000","last_clean":"2024-02-17T12:17:07.065406+0000","last_became_active":"2024-02-17T12:17:06.050510+0000","last_became_peered":"2024-02-17T12:17:06.050510+0000","last_unstale":"2024-02-17T12:17:07.065406+0000","last_undegraded":"2024-02-17T12:17:07.065406+0000","last_fullsized":"2024-02-17T12:17:07.065406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:32:33.567679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066215+0000","last_change":"2024-02-17T12:17:06.048246+0000","last_active":"2024-02-17T12:17:07.066215+0000","last_peered":"2024-02-17T12:17:07.066215+0000","last_clean":"2024-02-17T12:17:07.066215+0000","last_became_active":"2024-02-17T12:17:06.047970+0000","last_became_peered":"2024-02-17T12:17:06.047970+0000","last_unstale":"2024-02-17T12:17:07.066215+0000","last_undegraded":"2024-02-17T12:17:07.066215+0000","last_fullsized":"2024-02-17T12:17:07.066215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:10:08.114724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033150+0000","last_change":"2024-02-17T12:17:06.050512+0000","last_active":"2024-02-17T12:17:07.033150+0000","last_peered":"2024-02-17T12:17:07.033150+0000","last_clean":"2024-02-17T12:17:07.033150+0000","last_became_active":"2024-02-17T12:17:06.050068+0000","last_became_peered":"2024-02-17T12:17:06.050068+0000","last_unstale":"2024-02-17T12:17:07.033150+0000","last_undegraded":"2024-02-17T12:17:07.033150+0000","last_fullsized":"2024-02-17T12:17:07.033150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:52.059473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067855+0000","last_change":"2024-02-17T12:17:06.053372+0000","last_active":"2024-02-17T12:17:07.067855+0000","last_peered":"2024-02-17T12:17:07.067855+0000","last_clean":"2024-02-17T12:17:07.067855+0000","last_became_active":"2024-02-17T12:17:06.053019+0000","last_became_peered":"2024-02-17T12:17:06.053019+0000","last_unstale":"2024-02-17T12:17:07.067855+0000","last_undegraded":"2024-02-17T12:17:07.067855+0000","last_fullsized":"2024-02-17T12:17:07.067855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:01:09.789376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068291+0000","last_change":"2024-02-17T12:17:06.056524+0000","last_active":"2024-02-17T12:17:07.068291+0000","last_peered":"2024-02-17T12:17:07.068291+0000","last_clean":"2024-02-17T12:17:07.068291+0000","last_became_active":"2024-02-17T12:17:06.056171+0000","last_became_peered":"2024-02-17T12:17:06.056171+0000","last_unstale":"2024-02-17T12:17:07.068291+0000","last_undegraded":"2024-02-17T12:17:07.068291+0000","last_fullsized":"2024-02-17T12:17:07.068291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.599213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066746+0000","last_change":"2024-02-17T12:17:06.061999+0000","last_active":"2024-02-17T12:17:07.066746+0000","last_peered":"2024-02-17T12:17:07.066746+0000","last_clean":"2024-02-17T12:17:07.066746+0000","last_became_active":"2024-02-17T12:17:06.060293+0000","last_became_peered":"2024-02-17T12:17:06.060293+0000","last_unstale":"2024-02-17T12:17:07.066746+0000","last_undegraded":"2024-02-17T12:17:07.066746+0000","last_fullsized":"2024-02-17T12:17:07.066746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:52:45.908320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066389+0000","last_change":"2024-02-17T12:17:06.047799+0000","last_active":"2024-02-17T12:17:07.066389+0000","last_peered":"2024-02-17T12:17:07.066389+0000","last_clean":"2024-02-17T12:17:07.066389+0000","last_became_active":"2024-02-17T12:17:06.047532+0000","last_became_peered":"2024-02-17T12:17:06.047532+0000","last_unstale":"2024-02-17T12:17:07.066389+0000","last_undegraded":"2024-02-17T12:17:07.066389+0000","last_fullsized":"2024-02-17T12:17:07.066389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:49:48.671656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065566+0000","last_change":"2024-02-17T12:17:06.042349+0000","last_active":"2024-02-17T12:17:07.065566+0000","last_peered":"2024-02-17T12:17:07.065566+0000","last_clean":"2024-02-17T12:17:07.065566+0000","last_became_active":"2024-02-17T12:17:06.041014+0000","last_became_peered":"2024-02-17T12:17:06.041014+0000","last_unstale":"2024-02-17T12:17:07.065566+0000","last_undegraded":"2024-02-17T12:17:07.065566+0000","last_fullsized":"2024-02-17T12:17:07.065566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:17.216650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033123+0000","last_change":"2024-02-17T12:17:06.056498+0000","last_active":"2024-02-17T12:17:07.033123+0000","last_peered":"2024-02-17T12:17:07.033123+0000","last_clean":"2024-02-17T12:17:07.033123+0000","last_became_active":"2024-02-17T12:17:06.056186+0000","last_became_peered":"2024-02-17T12:17:06.056186+0000","last_unstale":"2024-02-17T12:17:07.033123+0000","last_undegraded":"2024-02-17T12:17:07.033123+0000","last_fullsized":"2024-02-17T12:17:07.033123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:54.119743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033745+0000","last_change":"2024-02-17T12:17:06.061943+0000","last_active":"2024-02-17T12:17:07.033745+0000","last_peered":"2024-02-17T12:17:07.033745+0000","last_clean":"2024-02-17T12:17:07.033745+0000","last_became_active":"2024-02-17T12:17:06.057880+0000","last_became_peered":"2024-02-17T12:17:06.057880+0000","last_unstale":"2024-02-17T12:17:07.033745+0000","last_undegraded":"2024-02-17T12:17:07.033745+0000","last_fullsized":"2024-02-17T12:17:07.033745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:41.759635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030038+0000","last_change":"2024-02-17T12:17:06.043576+0000","last_active":"2024-02-17T12:17:07.030038+0000","last_peered":"2024-02-17T12:17:07.030038+0000","last_clean":"2024-02-17T12:17:07.030038+0000","last_became_active":"2024-02-17T12:17:06.043313+0000","last_became_peered":"2024-02-17T12:17:06.043313+0000","last_unstale":"2024-02-17T12:17:07.030038+0000","last_undegraded":"2024-02-17T12:17:07.030038+0000","last_fullsized":"2024-02-17T12:17:07.030038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:18.832967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033946+0000","last_change":"2024-02-17T12:17:06.046677+0000","last_active":"2024-02-17T12:17:07.033946+0000","last_peered":"2024-02-17T12:17:07.033946+0000","last_clean":"2024-02-17T12:17:07.033946+0000","last_became_active":"2024-02-17T12:17:06.046330+0000","last_became_peered":"2024-02-17T12:17:06.046330+0000","last_unstale":"2024-02-17T12:17:07.033946+0000","last_undegraded":"2024-02-17T12:17:07.033946+0000","last_fullsized":"2024-02-17T12:17:07.033946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:10:08.114724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058606+0000","last_change":"2024-02-17T12:17:06.054887+0000","last_active":"2024-02-17T12:17:07.058606+0000","last_peered":"2024-02-17T12:17:07.058606+0000","last_clean":"2024-02-17T12:17:07.058606+0000","last_became_active":"2024-02-17T12:17:06.054012+0000","last_became_peered":"2024-02-17T12:17:06.054012+0000","last_unstale":"2024-02-17T12:17:07.058606+0000","last_undegraded":"2024-02-17T12:17:07.058606+0000","last_fullsized":"2024-02-17T12:17:07.058606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:41.419455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066743+0000","last_change":"2024-02-17T12:17:06.045278+0000","last_active":"2024-02-17T12:17:07.066743+0000","last_peered":"2024-02-17T12:17:07.066743+0000","last_clean":"2024-02-17T12:17:07.066743+0000","last_became_active":"2024-02-17T12:17:06.045015+0000","last_became_peered":"2024-02-17T12:17:06.045015+0000","last_unstale":"2024-02-17T12:17:07.066743+0000","last_undegraded":"2024-02-17T12:17:07.066743+0000","last_fullsized":"2024-02-17T12:17:07.066743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:23:10.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058741+0000","last_change":"2024-02-17T12:17:06.065534+0000","last_active":"2024-02-17T12:17:07.058741+0000","last_peered":"2024-02-17T12:17:07.058741+0000","last_clean":"2024-02-17T12:17:07.058741+0000","last_became_active":"2024-02-17T12:17:06.065279+0000","last_became_peered":"2024-02-17T12:17:06.065279+0000","last_unstale":"2024-02-17T12:17:07.058741+0000","last_undegraded":"2024-02-17T12:17:07.058741+0000","last_fullsized":"2024-02-17T12:17:07.058741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:52.059473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033827+0000","last_change":"2024-02-17T12:17:06.044234+0000","last_active":"2024-02-17T12:17:07.033827+0000","last_peered":"2024-02-17T12:17:07.033827+0000","last_clean":"2024-02-17T12:17:07.033827+0000","last_became_active":"2024-02-17T12:17:06.043918+0000","last_became_peered":"2024-02-17T12:17:06.043918+0000","last_unstale":"2024-02-17T12:17:07.033827+0000","last_undegraded":"2024-02-17T12:17:07.033827+0000","last_fullsized":"2024-02-17T12:17:07.033827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:15.140333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.034492+0000","last_change":"2024-02-17T12:17:06.059053+0000","last_active":"2024-02-17T12:17:07.034492+0000","last_peered":"2024-02-17T12:17:07.034492+0000","last_clean":"2024-02-17T12:17:07.034492+0000","last_became_active":"2024-02-17T12:17:06.058762+0000","last_became_peered":"2024-02-17T12:17:06.058762+0000","last_unstale":"2024-02-17T12:17:07.034492+0000","last_undegraded":"2024-02-17T12:17:07.034492+0000","last_fullsized":"2024-02-17T12:17:07.034492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:54:58.399092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067566+0000","last_change":"2024-02-17T12:17:06.056092+0000","last_active":"2024-02-17T12:17:07.067566+0000","last_peered":"2024-02-17T12:17:07.067566+0000","last_clean":"2024-02-17T12:17:07.067566+0000","last_became_active":"2024-02-17T12:17:06.055782+0000","last_became_peered":"2024-02-17T12:17:06.055782+0000","last_unstale":"2024-02-17T12:17:07.067566+0000","last_undegraded":"2024-02-17T12:17:07.067566+0000","last_fullsized":"2024-02-17T12:17:07.067566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:04:27.477154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067932+0000","last_change":"2024-02-17T12:17:06.058310+0000","last_active":"2024-02-17T12:17:07.067932+0000","last_peered":"2024-02-17T12:17:07.067932+0000","last_clean":"2024-02-17T12:17:07.067932+0000","last_became_active":"2024-02-17T12:17:06.058007+0000","last_became_peered":"2024-02-17T12:17:06.058007+0000","last_unstale":"2024-02-17T12:17:07.067932+0000","last_undegraded":"2024-02-17T12:17:07.067932+0000","last_fullsized":"2024-02-17T12:17:07.067932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:10.427795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067407+0000","last_change":"2024-02-17T12:17:06.067536+0000","last_active":"2024-02-17T12:17:07.067407+0000","last_peered":"2024-02-17T12:17:07.067407+0000","last_clean":"2024-02-17T12:17:07.067407+0000","last_became_active":"2024-02-17T12:17:06.066861+0000","last_became_peered":"2024-02-17T12:17:06.066861+0000","last_unstale":"2024-02-17T12:17:07.067407+0000","last_undegraded":"2024-02-17T12:17:07.067407+0000","last_fullsized":"2024-02-17T12:17:07.067407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:52.966313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030459+0000","last_change":"2024-02-17T12:17:06.046159+0000","last_active":"2024-02-17T12:17:07.030459+0000","last_peered":"2024-02-17T12:17:07.030459+0000","last_clean":"2024-02-17T12:17:07.030459+0000","last_became_active":"2024-02-17T12:17:06.045821+0000","last_became_peered":"2024-02-17T12:17:06.045821+0000","last_unstale":"2024-02-17T12:17:07.030459+0000","last_undegraded":"2024-02-17T12:17:07.030459+0000","last_fullsized":"2024-02-17T12:17:07.030459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:40.043966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068327+0000","last_change":"2024-02-17T12:17:05.029800+0000","last_active":"2024-02-17T12:17:07.068327+0000","last_peered":"2024-02-17T12:17:07.068327+0000","last_clean":"2024-02-17T12:17:07.068327+0000","last_became_active":"2024-02-17T12:17:05.029482+0000","last_became_peered":"2024-02-17T12:17:05.029482+0000","last_unstale":"2024-02-17T12:17:07.068327+0000","last_undegraded":"2024-02-17T12:17:07.068327+0000","last_fullsized":"2024-02-17T12:17:07.068327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068229+0000","last_change":"2024-02-17T12:17:06.070621+0000","last_active":"2024-02-17T12:17:07.068229+0000","last_peered":"2024-02-17T12:17:07.068229+0000","last_clean":"2024-02-17T12:17:07.068229+0000","last_became_active":"2024-02-17T12:17:06.069921+0000","last_became_peered":"2024-02-17T12:17:06.069921+0000","last_unstale":"2024-02-17T12:17:07.068229+0000","last_undegraded":"2024-02-17T12:17:07.068229+0000","last_fullsized":"2024-02-17T12:17:07.068229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:02.449515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030408+0000","last_change":"2024-02-17T12:17:05.039687+0000","last_active":"2024-02-17T12:17:07.030408+0000","last_peered":"2024-02-17T12:17:07.030408+0000","last_clean":"2024-02-17T12:17:07.030408+0000","last_became_active":"2024-02-17T12:17:05.039381+0000","last_became_peered":"2024-02-17T12:17:05.039381+0000","last_unstale":"2024-02-17T12:17:07.030408+0000","last_undegraded":"2024-02-17T12:17:07.030408+0000","last_fullsized":"2024-02-17T12:17:07.030408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033679+0000","last_change":"2024-02-17T12:17:06.059046+0000","last_active":"2024-02-17T12:17:07.033679+0000","last_peered":"2024-02-17T12:17:07.033679+0000","last_clean":"2024-02-17T12:17:07.033679+0000","last_became_active":"2024-02-17T12:17:06.058674+0000","last_became_peered":"2024-02-17T12:17:06.058674+0000","last_unstale":"2024-02-17T12:17:07.033679+0000","last_undegraded":"2024-02-17T12:17:07.033679+0000","last_fullsized":"2024-02-17T12:17:07.033679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:39:57.779942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066473+0000","last_change":"2024-02-17T12:17:05.033787+0000","last_active":"2024-02-17T12:17:07.066473+0000","last_peered":"2024-02-17T12:17:07.066473+0000","last_clean":"2024-02-17T12:17:07.066473+0000","last_became_active":"2024-02-17T12:17:05.033470+0000","last_became_peered":"2024-02-17T12:17:05.033470+0000","last_unstale":"2024-02-17T12:17:07.066473+0000","last_undegraded":"2024-02-17T12:17:07.066473+0000","last_fullsized":"2024-02-17T12:17:07.066473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:14:47.318267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058907+0000","last_change":"2024-02-17T12:17:06.065678+0000","last_active":"2024-02-17T12:17:07.058907+0000","last_peered":"2024-02-17T12:17:07.058907+0000","last_clean":"2024-02-17T12:17:07.058907+0000","last_became_active":"2024-02-17T12:17:06.065401+0000","last_became_peered":"2024-02-17T12:17:06.065401+0000","last_unstale":"2024-02-17T12:17:07.058907+0000","last_undegraded":"2024-02-17T12:17:07.058907+0000","last_fullsized":"2024-02-17T12:17:07.058907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:14.063262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065525+0000","last_change":"2024-02-17T12:17:05.031611+0000","last_active":"2024-02-17T12:17:07.065525+0000","last_peered":"2024-02-17T12:17:07.065525+0000","last_clean":"2024-02-17T12:17:07.065525+0000","last_became_active":"2024-02-17T12:17:05.031301+0000","last_became_peered":"2024-02-17T12:17:05.031301+0000","last_unstale":"2024-02-17T12:17:07.065525+0000","last_undegraded":"2024-02-17T12:17:07.065525+0000","last_fullsized":"2024-02-17T12:17:07.065525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:16:26.921410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067724+0000","last_change":"2024-02-17T12:17:06.067276+0000","last_active":"2024-02-17T12:17:07.067724+0000","last_peered":"2024-02-17T12:17:07.067724+0000","last_clean":"2024-02-17T12:17:07.067724+0000","last_became_active":"2024-02-17T12:17:06.066957+0000","last_became_peered":"2024-02-17T12:17:06.066957+0000","last_unstale":"2024-02-17T12:17:07.067724+0000","last_undegraded":"2024-02-17T12:17:07.067724+0000","last_fullsized":"2024-02-17T12:17:07.067724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:11:41.273983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033300+0000","last_change":"2024-02-17T12:17:05.033265+0000","last_active":"2024-02-17T12:17:07.033300+0000","last_peered":"2024-02-17T12:17:07.033300+0000","last_clean":"2024-02-17T12:17:07.033300+0000","last_became_active":"2024-02-17T12:17:05.032692+0000","last_became_peered":"2024-02-17T12:17:05.032692+0000","last_unstale":"2024-02-17T12:17:07.033300+0000","last_undegraded":"2024-02-17T12:17:07.033300+0000","last_fullsized":"2024-02-17T12:17:07.033300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:26.317463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033005+0000","last_change":"2024-02-17T12:17:06.044302+0000","last_active":"2024-02-17T12:17:07.033005+0000","last_peered":"2024-02-17T12:17:07.033005+0000","last_clean":"2024-02-17T12:17:07.033005+0000","last_became_active":"2024-02-17T12:17:06.043786+0000","last_became_peered":"2024-02-17T12:17:06.043786+0000","last_unstale":"2024-02-17T12:17:07.033005+0000","last_undegraded":"2024-02-17T12:17:07.033005+0000","last_fullsized":"2024-02-17T12:17:07.033005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:41.419455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033779+0000","last_change":"2024-02-17T12:17:05.026630+0000","last_active":"2024-02-17T12:17:07.033779+0000","last_peered":"2024-02-17T12:17:07.033779+0000","last_clean":"2024-02-17T12:17:07.033779+0000","last_became_active":"2024-02-17T12:17:05.026382+0000","last_became_peered":"2024-02-17T12:17:05.026382+0000","last_unstale":"2024-02-17T12:17:07.033779+0000","last_undegraded":"2024-02-17T12:17:07.033779+0000","last_fullsized":"2024-02-17T12:17:07.033779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:01.105877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.034059+0000","last_change":"2024-02-17T12:17:06.057017+0000","last_active":"2024-02-17T12:17:07.034059+0000","last_peered":"2024-02-17T12:17:07.034059+0000","last_clean":"2024-02-17T12:17:07.034059+0000","last_became_active":"2024-02-17T12:17:06.056811+0000","last_became_peered":"2024-02-17T12:17:06.056811+0000","last_unstale":"2024-02-17T12:17:07.034059+0000","last_undegraded":"2024-02-17T12:17:07.034059+0000","last_fullsized":"2024-02-17T12:17:07.034059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:20.704065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066062+0000","last_change":"2024-02-17T12:17:05.030240+0000","last_active":"2024-02-17T12:17:07.066062+0000","last_peered":"2024-02-17T12:17:07.066062+0000","last_clean":"2024-02-17T12:17:07.066062+0000","last_became_active":"2024-02-17T12:17:05.029142+0000","last_became_peered":"2024-02-17T12:17:05.029142+0000","last_unstale":"2024-02-17T12:17:07.066062+0000","last_undegraded":"2024-02-17T12:17:07.066062+0000","last_fullsized":"2024-02-17T12:17:07.066062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:06.543631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058307+0000","last_change":"2024-02-17T12:17:06.048418+0000","last_active":"2024-02-17T12:17:07.058307+0000","last_peered":"2024-02-17T12:17:07.058307+0000","last_clean":"2024-02-17T12:17:07.058307+0000","last_became_active":"2024-02-17T12:17:06.048123+0000","last_became_peered":"2024-02-17T12:17:06.048123+0000","last_unstale":"2024-02-17T12:17:07.058307+0000","last_undegraded":"2024-02-17T12:17:07.058307+0000","last_fullsized":"2024-02-17T12:17:07.058307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:00:35.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.034006+0000","last_change":"2024-02-17T12:17:05.029530+0000","last_active":"2024-02-17T12:17:07.034006+0000","last_peered":"2024-02-17T12:17:07.034006+0000","last_clean":"2024-02-17T12:17:07.034006+0000","last_became_active":"2024-02-17T12:17:05.029267+0000","last_became_peered":"2024-02-17T12:17:05.029267+0000","last_unstale":"2024-02-17T12:17:07.034006+0000","last_undegraded":"2024-02-17T12:17:07.034006+0000","last_fullsized":"2024-02-17T12:17:07.034006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:18:31.092114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033612+0000","last_change":"2024-02-17T12:17:06.045622+0000","last_active":"2024-02-17T12:17:07.033612+0000","last_peered":"2024-02-17T12:17:07.033612+0000","last_clean":"2024-02-17T12:17:07.033612+0000","last_became_active":"2024-02-17T12:17:06.044323+0000","last_became_peered":"2024-02-17T12:17:06.044323+0000","last_unstale":"2024-02-17T12:17:07.033612+0000","last_undegraded":"2024-02-17T12:17:07.033612+0000","last_fullsized":"2024-02-17T12:17:07.033612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:03.897754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066675+0000","last_change":"2024-02-17T12:17:05.040696+0000","last_active":"2024-02-17T12:17:07.066675+0000","last_peered":"2024-02-17T12:17:07.066675+0000","last_clean":"2024-02-17T12:17:07.066675+0000","last_became_active":"2024-02-17T12:17:05.040185+0000","last_became_peered":"2024-02-17T12:17:05.040185+0000","last_unstale":"2024-02-17T12:17:07.066675+0000","last_undegraded":"2024-02-17T12:17:07.066675+0000","last_fullsized":"2024-02-17T12:17:07.066675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:09.420535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066697+0000","last_change":"2024-02-17T12:17:06.060266+0000","last_active":"2024-02-17T12:17:07.066697+0000","last_peered":"2024-02-17T12:17:07.066697+0000","last_clean":"2024-02-17T12:17:07.066697+0000","last_became_active":"2024-02-17T12:17:06.059994+0000","last_became_peered":"2024-02-17T12:17:06.059994+0000","last_unstale":"2024-02-17T12:17:07.066697+0000","last_undegraded":"2024-02-17T12:17:07.066697+0000","last_fullsized":"2024-02-17T12:17:07.066697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:16.827288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030487+0000","last_change":"2024-02-17T12:17:05.042848+0000","last_active":"2024-02-17T12:17:07.030487+0000","last_peered":"2024-02-17T12:17:07.030487+0000","last_clean":"2024-02-17T12:17:07.030487+0000","last_became_active":"2024-02-17T12:17:05.042537+0000","last_became_peered":"2024-02-17T12:17:05.042537+0000","last_unstale":"2024-02-17T12:17:07.030487+0000","last_undegraded":"2024-02-17T12:17:07.030487+0000","last_fullsized":"2024-02-17T12:17:07.030487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066414+0000","last_change":"2024-02-17T12:17:06.050890+0000","last_active":"2024-02-17T12:17:07.066414+0000","last_peered":"2024-02-17T12:17:07.066414+0000","last_clean":"2024-02-17T12:17:07.066414+0000","last_became_active":"2024-02-17T12:17:06.050253+0000","last_became_peered":"2024-02-17T12:17:06.050253+0000","last_unstale":"2024-02-17T12:17:07.066414+0000","last_undegraded":"2024-02-17T12:17:07.066414+0000","last_fullsized":"2024-02-17T12:17:07.066414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:09:31.745218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033684+0000","last_change":"2024-02-17T12:17:05.038559+0000","last_active":"2024-02-17T12:17:07.033684+0000","last_peered":"2024-02-17T12:17:07.033684+0000","last_clean":"2024-02-17T12:17:07.033684+0000","last_became_active":"2024-02-17T12:17:05.038388+0000","last_became_peered":"2024-02-17T12:17:05.038388+0000","last_unstale":"2024-02-17T12:17:07.033684+0000","last_undegraded":"2024-02-17T12:17:07.033684+0000","last_fullsized":"2024-02-17T12:17:07.033684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:14:47.318267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033418+0000","last_change":"2024-02-17T12:17:06.066601+0000","last_active":"2024-02-17T12:17:07.033418+0000","last_peered":"2024-02-17T12:17:07.033418+0000","last_clean":"2024-02-17T12:17:07.033418+0000","last_became_active":"2024-02-17T12:17:06.066262+0000","last_became_peered":"2024-02-17T12:17:06.066262+0000","last_unstale":"2024-02-17T12:17:07.033418+0000","last_undegraded":"2024-02-17T12:17:07.033418+0000","last_fullsized":"2024-02-17T12:17:07.033418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:14.063262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066500+0000","last_change":"2024-02-17T12:17:05.034049+0000","last_active":"2024-02-17T12:17:07.066500+0000","last_peered":"2024-02-17T12:17:07.066500+0000","last_clean":"2024-02-17T12:17:07.066500+0000","last_became_active":"2024-02-17T12:17:05.033414+0000","last_became_peered":"2024-02-17T12:17:05.033414+0000","last_unstale":"2024-02-17T12:17:07.066500+0000","last_undegraded":"2024-02-17T12:17:07.066500+0000","last_fullsized":"2024-02-17T12:17:07.066500+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:17.825707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058801+0000","last_change":"2024-02-17T12:17:06.049102+0000","last_active":"2024-02-17T12:17:07.058801+0000","last_peered":"2024-02-17T12:17:07.058801+0000","last_clean":"2024-02-17T12:17:07.058801+0000","last_became_active":"2024-02-17T12:17:06.048820+0000","last_became_peered":"2024-02-17T12:17:06.048820+0000","last_unstale":"2024-02-17T12:17:07.058801+0000","last_undegraded":"2024-02-17T12:17:07.058801+0000","last_fullsized":"2024-02-17T12:17:07.058801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:16.951684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033421+0000","last_change":"2024-02-17T12:17:05.032981+0000","last_active":"2024-02-17T12:17:07.033421+0000","last_peered":"2024-02-17T12:17:07.033421+0000","last_clean":"2024-02-17T12:17:07.033421+0000","last_became_active":"2024-02-17T12:17:05.032653+0000","last_became_peered":"2024-02-17T12:17:05.032653+0000","last_unstale":"2024-02-17T12:17:07.033421+0000","last_undegraded":"2024-02-17T12:17:07.033421+0000","last_fullsized":"2024-02-17T12:17:07.033421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:32.512700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066560+0000","last_change":"2024-02-17T12:17:06.043565+0000","last_active":"2024-02-17T12:17:07.066560+0000","last_peered":"2024-02-17T12:17:07.066560+0000","last_clean":"2024-02-17T12:17:07.066560+0000","last_became_active":"2024-02-17T12:17:06.043189+0000","last_became_peered":"2024-02-17T12:17:06.043189+0000","last_unstale":"2024-02-17T12:17:07.066560+0000","last_undegraded":"2024-02-17T12:17:07.066560+0000","last_fullsized":"2024-02-17T12:17:07.066560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:02:23.127482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058256+0000","last_change":"2024-02-17T12:17:05.032388+0000","last_active":"2024-02-17T12:17:07.058256+0000","last_peered":"2024-02-17T12:17:07.058256+0000","last_clean":"2024-02-17T12:17:07.058256+0000","last_became_active":"2024-02-17T12:17:05.032055+0000","last_became_peered":"2024-02-17T12:17:05.032055+0000","last_unstale":"2024-02-17T12:17:07.058256+0000","last_undegraded":"2024-02-17T12:17:07.058256+0000","last_fullsized":"2024-02-17T12:17:07.058256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067565+0000","last_change":"2024-02-17T12:17:06.067761+0000","last_active":"2024-02-17T12:17:07.067565+0000","last_peered":"2024-02-17T12:17:07.067565+0000","last_clean":"2024-02-17T12:17:07.067565+0000","last_became_active":"2024-02-17T12:17:06.067249+0000","last_became_peered":"2024-02-17T12:17:06.067249+0000","last_unstale":"2024-02-17T12:17:07.067565+0000","last_undegraded":"2024-02-17T12:17:07.067565+0000","last_fullsized":"2024-02-17T12:17:07.067565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:40:09.999149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066047+0000","last_change":"2024-02-17T12:17:05.037345+0000","last_active":"2024-02-17T12:17:07.066047+0000","last_peered":"2024-02-17T12:17:07.066047+0000","last_clean":"2024-02-17T12:17:07.066047+0000","last_became_active":"2024-02-17T12:17:05.037076+0000","last_became_peered":"2024-02-17T12:17:05.037076+0000","last_unstale":"2024-02-17T12:17:07.066047+0000","last_undegraded":"2024-02-17T12:17:07.066047+0000","last_fullsized":"2024-02-17T12:17:07.066047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:34.554467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068070+0000","last_change":"2024-02-17T12:17:06.066823+0000","last_active":"2024-02-17T12:17:07.068070+0000","last_peered":"2024-02-17T12:17:07.068070+0000","last_clean":"2024-02-17T12:17:07.068070+0000","last_became_active":"2024-02-17T12:17:06.066564+0000","last_became_peered":"2024-02-17T12:17:06.066564+0000","last_unstale":"2024-02-17T12:17:07.068070+0000","last_undegraded":"2024-02-17T12:17:07.068070+0000","last_fullsized":"2024-02-17T12:17:07.068070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:00:35.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065941+0000","last_change":"2024-02-17T12:17:05.033809+0000","last_active":"2024-02-17T12:17:07.065941+0000","last_peered":"2024-02-17T12:17:07.065941+0000","last_clean":"2024-02-17T12:17:07.065941+0000","last_became_active":"2024-02-17T12:17:05.033434+0000","last_became_peered":"2024-02-17T12:17:05.033434+0000","last_unstale":"2024-02-17T12:17:07.065941+0000","last_undegraded":"2024-02-17T12:17:07.065941+0000","last_fullsized":"2024-02-17T12:17:07.065941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:20.156577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033507+0000","last_change":"2024-02-17T12:17:06.056551+0000","last_active":"2024-02-17T12:17:07.033507+0000","last_peered":"2024-02-17T12:17:07.033507+0000","last_clean":"2024-02-17T12:17:07.033507+0000","last_became_active":"2024-02-17T12:17:06.056226+0000","last_became_peered":"2024-02-17T12:17:06.056226+0000","last_unstale":"2024-02-17T12:17:07.033507+0000","last_undegraded":"2024-02-17T12:17:07.033507+0000","last_fullsized":"2024-02-17T12:17:07.033507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:26:02.974500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058637+0000","last_change":"2024-02-17T12:17:05.039589+0000","last_active":"2024-02-17T12:17:07.058637+0000","last_peered":"2024-02-17T12:17:07.058637+0000","last_clean":"2024-02-17T12:17:07.058637+0000","last_became_active":"2024-02-17T12:17:05.039353+0000","last_became_peered":"2024-02-17T12:17:05.039353+0000","last_unstale":"2024-02-17T12:17:07.058637+0000","last_undegraded":"2024-02-17T12:17:07.058637+0000","last_fullsized":"2024-02-17T12:17:07.058637+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033868+0000","last_change":"2024-02-17T12:17:06.070352+0000","last_active":"2024-02-17T12:17:07.033868+0000","last_peered":"2024-02-17T12:17:07.033868+0000","last_clean":"2024-02-17T12:17:07.033868+0000","last_became_active":"2024-02-17T12:17:06.070053+0000","last_became_peered":"2024-02-17T12:17:06.070053+0000","last_unstale":"2024-02-17T12:17:07.033868+0000","last_undegraded":"2024-02-17T12:17:07.033868+0000","last_fullsized":"2024-02-17T12:17:07.033868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:50:00.758848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033556+0000","last_change":"2024-02-17T12:17:05.030468+0000","last_active":"2024-02-17T12:17:07.033556+0000","last_peered":"2024-02-17T12:17:07.033556+0000","last_clean":"2024-02-17T12:17:07.033556+0000","last_became_active":"2024-02-17T12:17:05.030205+0000","last_became_peered":"2024-02-17T12:17:05.030205+0000","last_unstale":"2024-02-17T12:17:07.033556+0000","last_undegraded":"2024-02-17T12:17:07.033556+0000","last_fullsized":"2024-02-17T12:17:07.033556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:08.989824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058329+0000","last_change":"2024-02-17T12:17:06.060894+0000","last_active":"2024-02-17T12:17:07.058329+0000","last_peered":"2024-02-17T12:17:07.058329+0000","last_clean":"2024-02-17T12:17:07.058329+0000","last_became_active":"2024-02-17T12:17:06.060631+0000","last_became_peered":"2024-02-17T12:17:06.060631+0000","last_unstale":"2024-02-17T12:17:07.058329+0000","last_undegraded":"2024-02-17T12:17:07.058329+0000","last_fullsized":"2024-02-17T12:17:07.058329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:02.449515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033577+0000","last_change":"2024-02-17T12:17:05.037680+0000","last_active":"2024-02-17T12:17:07.033577+0000","last_peered":"2024-02-17T12:17:07.033577+0000","last_clean":"2024-02-17T12:17:07.033577+0000","last_became_active":"2024-02-17T12:17:05.037370+0000","last_became_peered":"2024-02-17T12:17:05.037370+0000","last_unstale":"2024-02-17T12:17:07.033577+0000","last_undegraded":"2024-02-17T12:17:07.033577+0000","last_fullsized":"2024-02-17T12:17:07.033577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:16.209390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065490+0000","last_change":"2024-02-17T12:17:06.047087+0000","last_active":"2024-02-17T12:17:07.065490+0000","last_peered":"2024-02-17T12:17:07.065490+0000","last_clean":"2024-02-17T12:17:07.065490+0000","last_became_active":"2024-02-17T12:17:06.046719+0000","last_became_peered":"2024-02-17T12:17:06.046719+0000","last_unstale":"2024-02-17T12:17:07.065490+0000","last_undegraded":"2024-02-17T12:17:07.065490+0000","last_fullsized":"2024-02-17T12:17:07.065490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:42.759571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033749+0000","last_change":"2024-02-17T12:17:05.026370+0000","last_active":"2024-02-17T12:17:07.033749+0000","last_peered":"2024-02-17T12:17:07.033749+0000","last_clean":"2024-02-17T12:17:07.033749+0000","last_became_active":"2024-02-17T12:17:05.026124+0000","last_became_peered":"2024-02-17T12:17:05.026124+0000","last_unstale":"2024-02-17T12:17:07.033749+0000","last_undegraded":"2024-02-17T12:17:07.033749+0000","last_fullsized":"2024-02-17T12:17:07.033749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:35.272161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065486+0000","last_change":"2024-02-17T12:17:06.058275+0000","last_active":"2024-02-17T12:17:07.065486+0000","last_peered":"2024-02-17T12:17:07.065486+0000","last_clean":"2024-02-17T12:17:07.065486+0000","last_became_active":"2024-02-17T12:17:06.057949+0000","last_became_peered":"2024-02-17T12:17:06.057949+0000","last_unstale":"2024-02-17T12:17:07.065486+0000","last_undegraded":"2024-02-17T12:17:07.065486+0000","last_fullsized":"2024-02-17T12:17:07.065486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:36.279421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030192+0000","last_change":"2024-02-17T12:17:05.038848+0000","last_active":"2024-02-17T12:17:07.030192+0000","last_peered":"2024-02-17T12:17:07.030192+0000","last_clean":"2024-02-17T12:17:07.030192+0000","last_became_active":"2024-02-17T12:17:05.038528+0000","last_became_peered":"2024-02-17T12:17:05.038528+0000","last_unstale":"2024-02-17T12:17:07.030192+0000","last_undegraded":"2024-02-17T12:17:07.030192+0000","last_fullsized":"2024-02-17T12:17:07.030192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:01:36.502802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065549+0000","last_change":"2024-02-17T12:17:06.044343+0000","last_active":"2024-02-17T12:17:07.065549+0000","last_peered":"2024-02-17T12:17:07.065549+0000","last_clean":"2024-02-17T12:17:07.065549+0000","last_became_active":"2024-02-17T12:17:06.044057+0000","last_became_peered":"2024-02-17T12:17:06.044057+0000","last_unstale":"2024-02-17T12:17:07.065549+0000","last_undegraded":"2024-02-17T12:17:07.065549+0000","last_fullsized":"2024-02-17T12:17:07.065549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:33.519960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067666+0000","last_change":"2024-02-17T12:17:05.035457+0000","last_active":"2024-02-17T12:17:07.067666+0000","last_peered":"2024-02-17T12:17:07.067666+0000","last_clean":"2024-02-17T12:17:07.067666+0000","last_became_active":"2024-02-17T12:17:05.035024+0000","last_became_peered":"2024-02-17T12:17:05.035024+0000","last_unstale":"2024-02-17T12:17:07.067666+0000","last_undegraded":"2024-02-17T12:17:07.067666+0000","last_fullsized":"2024-02-17T12:17:07.067666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065502+0000","last_change":"2024-02-17T12:17:06.051800+0000","last_active":"2024-02-17T12:17:07.065502+0000","last_peered":"2024-02-17T12:17:07.065502+0000","last_clean":"2024-02-17T12:17:07.065502+0000","last_became_active":"2024-02-17T12:17:06.047017+0000","last_became_peered":"2024-02-17T12:17:06.047017+0000","last_unstale":"2024-02-17T12:17:07.065502+0000","last_undegraded":"2024-02-17T12:17:07.065502+0000","last_fullsized":"2024-02-17T12:17:07.065502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:27.324723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033144+0000","last_change":"2024-02-17T12:17:05.024282+0000","last_active":"2024-02-17T12:17:07.033144+0000","last_peered":"2024-02-17T12:17:07.033144+0000","last_clean":"2024-02-17T12:17:07.033144+0000","last_became_active":"2024-02-17T12:17:05.023939+0000","last_became_peered":"2024-02-17T12:17:05.023939+0000","last_unstale":"2024-02-17T12:17:07.033144+0000","last_undegraded":"2024-02-17T12:17:07.033144+0000","last_fullsized":"2024-02-17T12:17:07.033144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:41.752311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068063+0000","last_change":"2024-02-17T12:17:06.057175+0000","last_active":"2024-02-17T12:17:07.068063+0000","last_peered":"2024-02-17T12:17:07.068063+0000","last_clean":"2024-02-17T12:17:07.068063+0000","last_became_active":"2024-02-17T12:17:06.055674+0000","last_became_peered":"2024-02-17T12:17:06.055674+0000","last_unstale":"2024-02-17T12:17:07.068063+0000","last_undegraded":"2024-02-17T12:17:07.068063+0000","last_fullsized":"2024-02-17T12:17:07.068063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:26:17.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.032813+0000","last_change":"2024-02-17T12:17:05.037887+0000","last_active":"2024-02-17T12:17:07.032813+0000","last_peered":"2024-02-17T12:17:07.032813+0000","last_clean":"2024-02-17T12:17:07.032813+0000","last_became_active":"2024-02-17T12:17:05.037587+0000","last_became_peered":"2024-02-17T12:17:05.037587+0000","last_unstale":"2024-02-17T12:17:07.032813+0000","last_undegraded":"2024-02-17T12:17:07.032813+0000","last_fullsized":"2024-02-17T12:17:07.032813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:20.156577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065729+0000","last_change":"2024-02-17T12:17:06.037347+0000","last_active":"2024-02-17T12:17:07.065729+0000","last_peered":"2024-02-17T12:17:07.065729+0000","last_clean":"2024-02-17T12:17:07.065729+0000","last_became_active":"2024-02-17T12:17:06.037068+0000","last_became_peered":"2024-02-17T12:17:06.037068+0000","last_unstale":"2024-02-17T12:17:07.065729+0000","last_undegraded":"2024-02-17T12:17:07.065729+0000","last_fullsized":"2024-02-17T12:17:07.065729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:54:10.814424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058697+0000","last_change":"2024-02-17T12:17:05.025815+0000","last_active":"2024-02-17T12:17:07.058697+0000","last_peered":"2024-02-17T12:17:07.058697+0000","last_clean":"2024-02-17T12:17:07.058697+0000","last_became_active":"2024-02-17T12:17:05.025568+0000","last_became_peered":"2024-02-17T12:17:05.025568+0000","last_unstale":"2024-02-17T12:17:07.058697+0000","last_undegraded":"2024-02-17T12:17:07.058697+0000","last_fullsized":"2024-02-17T12:17:07.058697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033946+0000","last_change":"2024-02-17T12:17:06.060996+0000","last_active":"2024-02-17T12:17:07.033946+0000","last_peered":"2024-02-17T12:17:07.033946+0000","last_clean":"2024-02-17T12:17:07.033946+0000","last_became_active":"2024-02-17T12:17:06.060713+0000","last_became_peered":"2024-02-17T12:17:06.060713+0000","last_unstale":"2024-02-17T12:17:07.033946+0000","last_undegraded":"2024-02-17T12:17:07.033946+0000","last_fullsized":"2024-02-17T12:17:07.033946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:49:48.671656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030575+0000","last_change":"2024-02-17T12:17:05.039517+0000","last_active":"2024-02-17T12:17:07.030575+0000","last_peered":"2024-02-17T12:17:07.030575+0000","last_clean":"2024-02-17T12:17:07.030575+0000","last_became_active":"2024-02-17T12:17:05.039209+0000","last_became_peered":"2024-02-17T12:17:05.039209+0000","last_unstale":"2024-02-17T12:17:07.030575+0000","last_undegraded":"2024-02-17T12:17:07.030575+0000","last_fullsized":"2024-02-17T12:17:07.030575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030081+0000","last_change":"2024-02-17T12:17:06.039368+0000","last_active":"2024-02-17T12:17:07.030081+0000","last_peered":"2024-02-17T12:17:07.030081+0000","last_clean":"2024-02-17T12:17:07.030081+0000","last_became_active":"2024-02-17T12:17:06.039047+0000","last_became_peered":"2024-02-17T12:17:06.039047+0000","last_unstale":"2024-02-17T12:17:07.030081+0000","last_undegraded":"2024-02-17T12:17:07.030081+0000","last_fullsized":"2024-02-17T12:17:07.030081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:07.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058470+0000","last_change":"2024-02-17T12:17:05.037708+0000","last_active":"2024-02-17T12:17:07.058470+0000","last_peered":"2024-02-17T12:17:07.058470+0000","last_clean":"2024-02-17T12:17:07.058470+0000","last_became_active":"2024-02-17T12:17:05.037213+0000","last_became_peered":"2024-02-17T12:17:05.037213+0000","last_unstale":"2024-02-17T12:17:07.058470+0000","last_undegraded":"2024-02-17T12:17:07.058470+0000","last_fullsized":"2024-02-17T12:17:07.058470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067594+0000","last_change":"2024-02-17T12:17:06.051204+0000","last_active":"2024-02-17T12:17:07.067594+0000","last_peered":"2024-02-17T12:17:07.067594+0000","last_clean":"2024-02-17T12:17:07.067594+0000","last_became_active":"2024-02-17T12:17:06.050919+0000","last_became_peered":"2024-02-17T12:17:06.050919+0000","last_unstale":"2024-02-17T12:17:07.067594+0000","last_undegraded":"2024-02-17T12:17:07.067594+0000","last_fullsized":"2024-02-17T12:17:07.067594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:40.043966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030335+0000","last_change":"2024-02-17T12:17:05.034917+0000","last_active":"2024-02-17T12:17:07.030335+0000","last_peered":"2024-02-17T12:17:07.030335+0000","last_clean":"2024-02-17T12:17:07.030335+0000","last_became_active":"2024-02-17T12:17:05.034653+0000","last_became_peered":"2024-02-17T12:17:05.034653+0000","last_unstale":"2024-02-17T12:17:07.030335+0000","last_undegraded":"2024-02-17T12:17:07.030335+0000","last_fullsized":"2024-02-17T12:17:07.030335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030244+0000","last_change":"2024-02-17T12:17:06.047590+0000","last_active":"2024-02-17T12:17:07.030244+0000","last_peered":"2024-02-17T12:17:07.030244+0000","last_clean":"2024-02-17T12:17:07.030244+0000","last_became_active":"2024-02-17T12:17:06.046851+0000","last_became_peered":"2024-02-17T12:17:06.046851+0000","last_unstale":"2024-02-17T12:17:07.030244+0000","last_undegraded":"2024-02-17T12:17:07.030244+0000","last_fullsized":"2024-02-17T12:17:07.030244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:35.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058367+0000","last_change":"2024-02-17T12:17:05.026508+0000","last_active":"2024-02-17T12:17:07.058367+0000","last_peered":"2024-02-17T12:17:07.058367+0000","last_clean":"2024-02-17T12:17:07.058367+0000","last_became_active":"2024-02-17T12:17:05.026238+0000","last_became_peered":"2024-02-17T12:17:05.026238+0000","last_unstale":"2024-02-17T12:17:07.058367+0000","last_undegraded":"2024-02-17T12:17:07.058367+0000","last_fullsized":"2024-02-17T12:17:07.058367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065948+0000","last_change":"2024-02-17T12:17:06.048841+0000","last_active":"2024-02-17T12:17:07.065948+0000","last_peered":"2024-02-17T12:17:07.065948+0000","last_clean":"2024-02-17T12:17:07.065948+0000","last_became_active":"2024-02-17T12:17:06.048593+0000","last_became_peered":"2024-02-17T12:17:06.048593+0000","last_unstale":"2024-02-17T12:17:07.065948+0000","last_undegraded":"2024-02-17T12:17:07.065948+0000","last_fullsized":"2024-02-17T12:17:07.065948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:15.140333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033263+0000","last_change":"2024-02-17T12:17:05.024299+0000","last_active":"2024-02-17T12:17:07.033263+0000","last_peered":"2024-02-17T12:17:07.033263+0000","last_clean":"2024-02-17T12:17:07.033263+0000","last_became_active":"2024-02-17T12:17:05.023219+0000","last_became_peered":"2024-02-17T12:17:05.023219+0000","last_unstale":"2024-02-17T12:17:07.033263+0000","last_undegraded":"2024-02-17T12:17:07.033263+0000","last_fullsized":"2024-02-17T12:17:07.033263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:32:32.560419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033085+0000","last_change":"2024-02-17T12:17:06.060773+0000","last_active":"2024-02-17T12:17:07.033085+0000","last_peered":"2024-02-17T12:17:07.033085+0000","last_clean":"2024-02-17T12:17:07.033085+0000","last_became_active":"2024-02-17T12:17:06.060435+0000","last_became_peered":"2024-02-17T12:17:06.060435+0000","last_unstale":"2024-02-17T12:17:07.033085+0000","last_undegraded":"2024-02-17T12:17:07.033085+0000","last_fullsized":"2024-02-17T12:17:07.033085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:24.540105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066041+0000","last_change":"2024-02-17T12:17:05.036670+0000","last_active":"2024-02-17T12:17:07.066041+0000","last_peered":"2024-02-17T12:17:07.066041+0000","last_clean":"2024-02-17T12:17:07.066041+0000","last_became_active":"2024-02-17T12:17:05.036395+0000","last_became_peered":"2024-02-17T12:17:05.036395+0000","last_unstale":"2024-02-17T12:17:07.066041+0000","last_undegraded":"2024-02-17T12:17:07.066041+0000","last_fullsized":"2024-02-17T12:17:07.066041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:39.036706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067588+0000","last_change":"2024-02-17T12:17:06.057194+0000","last_active":"2024-02-17T12:17:07.067588+0000","last_peered":"2024-02-17T12:17:07.067588+0000","last_clean":"2024-02-17T12:17:07.067588+0000","last_became_active":"2024-02-17T12:17:06.056898+0000","last_became_peered":"2024-02-17T12:17:06.056898+0000","last_unstale":"2024-02-17T12:17:07.067588+0000","last_undegraded":"2024-02-17T12:17:07.067588+0000","last_fullsized":"2024-02-17T12:17:07.067588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:06:21.529406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067840+0000","last_change":"2024-02-17T12:17:05.036734+0000","last_active":"2024-02-17T12:17:07.067840+0000","last_peered":"2024-02-17T12:17:07.067840+0000","last_clean":"2024-02-17T12:17:07.067840+0000","last_became_active":"2024-02-17T12:17:05.036453+0000","last_became_peered":"2024-02-17T12:17:05.036453+0000","last_unstale":"2024-02-17T12:17:07.067840+0000","last_undegraded":"2024-02-17T12:17:07.067840+0000","last_fullsized":"2024-02-17T12:17:07.067840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067866+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:17:07.067866+0000","last_peered":"2024-02-17T12:17:07.067866+0000","last_clean":"2024-02-17T12:17:07.067866+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:17:07.067866+0000","last_undegraded":"2024-02-17T12:17:07.067866+0000","last_fullsized":"2024-02-17T12:17:07.067866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":136349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":136405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":137367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":137367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":726101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":726191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":360448,"data_stored":135837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.82899999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":356352,"data_stored":135803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:17:12.127 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:17:12.131 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:17:14.617 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:17:14.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.754+0000 7f677ca00640 1 Processor -- start 2024-02-17T12:17:14.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.754+0000 7f677ca00640 1 -- start start 2024-02-17T12:17:14.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.754+0000 7f677ca00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f677814f110 0x7f67780c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:14.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f677ca00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67780a9420 con 0x7f67780c2580 2024-02-17T12:17:14.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f677ca00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6778152850 con 0x7f67780c1eb0 2024-02-17T12:17:14.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f677ca00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677814f4f0 con 0x7f677814f110 2024-02-17T12:17:14.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6775e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f677814f110 0x7f67780c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:14.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6775400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f67780c2580 0x7f67780aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50826/0 (socket says 172.21.15.114:50826) 2024-02-17T12:17:14.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6775400640 1 -- 172.21.15.114:0/2447315569 learned_addr learned my addr 172.21.15.114:0/2447315569 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:14.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6775e00640 1 -- 172.21.15.114:0/2447315569 >> v1:172.21.15.116:6789/0 conn(0x7f67780c1eb0 legacy=0x7f677815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:14.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6775e00640 1 -- 172.21.15.114:0/2447315569 >> v1:172.21.15.114:6789/0 conn(0x7f67780c2580 legacy=0x7f67780aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:14.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6775e00640 1 -- 172.21.15.114:0/2447315569 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780a9670 con 0x7f677814f110 2024-02-17T12:17:14.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6774a00640 1 -- 172.21.15.114:0/2447315569 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195284767 0 0) 0x7f67780a9420 con 0x7f67780c2580 2024-02-17T12:17:14.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6775e00640 1 --2- 172.21.15.114:0/2447315569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677814f110 0x7f67780c65a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6768009d90 tx=0x7f676801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0ec648e1bd0982 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:14.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6774a00640 1 -- 172.21.15.114:0/2447315569 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680a5850 con 0x7f677814f110 2024-02-17T12:17:14.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6774a00640 1 -- 172.21.15.114:0/2447315569 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67680a59b0 con 0x7f677814f110 2024-02-17T12:17:14.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.758+0000 7f6774a00640 1 -- 172.21.15.114:0/2447315569 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680a5d40 con 0x7f677814f110 2024-02-17T12:17:14.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 -- 172.21.15.114:0/2447315569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677814f110 msgr2=0x7f67780c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:14.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 --2- 172.21.15.114:0/2447315569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677814f110 0x7f67780c65a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6768009d90 tx=0x7f676801c8a0 comp rx=0 tx=0).stop 2024-02-17T12:17:14.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 -- 172.21.15.114:0/2447315569 shutdown_connections 2024-02-17T12:17:14.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 --2- 172.21.15.114:0/2447315569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f677814f110 0x7f67780c65a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:14.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 -- 172.21.15.114:0/2447315569 >> 172.21.15.114:0/2447315569 conn(0x7f67780a8490 msgr2=0x7f67780a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:14.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 -- 172.21.15.114:0/2447315569 shutdown_connections 2024-02-17T12:17:14.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 -- 172.21.15.114:0/2447315569 wait complete. 2024-02-17T12:17:14.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 Processor -- start 2024-02-17T12:17:14.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 -- start start 2024-02-17T12:17:14.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f67780c1eb0 0x7f677814deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:14.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67780c2580 0x7f677814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:14.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f677814f110 0x7f67781f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:14.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677814d0a0 con 0x7f67780c2580 2024-02-17T12:17:14.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67781f1290 con 0x7f677814f110 2024-02-17T12:17:14.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f677ca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677814b130 con 0x7f67780c1eb0 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f6775400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67780c2580 0x7f677814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f6775400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67780c2580 0x7f677814e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42690/0 (socket says 172.21.15.114:42690) 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f6775400640 1 -- 172.21.15.114:0/1675922964 learned_addr learned my addr 172.21.15.114:0/1675922964 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f6775e00640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f67780c1eb0 0x7f677814deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f6776800640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f677814f110 0x7f67781f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f6775400640 1 -- 172.21.15.114:0/1675922964 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f67780c1eb0 msgr2=0x7f677814deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f6775400640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f67780c1eb0 0x7f677814deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f6775400640 1 -- 172.21.15.114:0/1675922964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f677814f110 msgr2=0x7f67781f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f6775400640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f677814f110 0x7f67781f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.762+0000 7f6775400640 1 -- 172.21.15.114:0/1675922964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768009a70 con 0x7f67780c2580 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.766+0000 7f6776800640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f677814f110 0x7f67781f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.766+0000 7f6775400640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67780c2580 0x7f677814e3f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f676400c450 tx=0x7f676400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.766+0000 7f676e000640 1 -- 172.21.15.114:0/1675922964 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67640074e0 con 0x7f67780c2580 2024-02-17T12:17:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.766+0000 7f676e000640 1 -- 172.21.15.114:0/1675922964 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6764007640 con 0x7f67780c2580 2024-02-17T12:17:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.766+0000 7f676e000640 1 -- 172.21.15.114:0/1675922964 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67640049f0 con 0x7f67780c2580 2024-02-17T12:17:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.766+0000 7f677ca00640 1 -- 172.21.15.114:0/1675922964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677814c8f0 con 0x7f67780c2580 2024-02-17T12:17:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.766+0000 7f677ca00640 1 -- 172.21.15.114:0/1675922964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677814c610 con 0x7f67780c2580 2024-02-17T12:17:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.766+0000 7f677ca00640 1 -- 172.21.15.114:0/1675922964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677814c470 con 0x7f67780c2580 2024-02-17T12:17:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.766+0000 7f676e000640 1 -- 172.21.15.114:0/1675922964 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6764004b50 con 0x7f67780c2580 2024-02-17T12:17:14.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.766+0000 7f676e000640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6758066e40 0x7f6758069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:14.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.770+0000 7f676e000640 1 -- 172.21.15.114:0/1675922964 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6764083c50 con 0x7f67780c2580 2024-02-17T12:17:14.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.770+0000 7f6775e00640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6758066e40 0x7f6758069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:14.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.770+0000 7f6775e00640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6758066e40 0x7f6758069300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f67680af000 tx=0x7f67680a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:14.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.774+0000 7f676e000640 1 -- 172.21.15.114:0/1675922964 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f677814c470 con 0x7f67780c2580 2024-02-17T12:17:14.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.922+0000 7f677ca00640 1 -- 172.21.15.114:0/1675922964 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67781f1400 con 0x7f6758066e40 2024-02-17T12:17:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.930+0000 7f676e000640 1 -- 172.21.15.114:0/1675922964 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+265601 (secure 0 0 0) 0x7f67781f1400 con 0x7f6758066e40 2024-02-17T12:17:14.939 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:17:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 -- 172.21.15.114:0/1675922964 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6758066e40 msgr2=0x7f6758069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6758066e40 0x7f6758069300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f67680af000 tx=0x7f67680a7070 comp rx=0 tx=0).stop 2024-02-17T12:17:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 -- 172.21.15.114:0/1675922964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67780c2580 msgr2=0x7f677814e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67780c2580 0x7f677814e3f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f676400c450 tx=0x7f676400c910 comp rx=0 tx=0).stop 2024-02-17T12:17:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 -- 172.21.15.114:0/1675922964 shutdown_connections 2024-02-17T12:17:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f677814f110 0x7f67781f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6758066e40 0x7f6758069300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67780c2580 0x7f677814e3f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 --2- 172.21.15.114:0/1675922964 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f67780c1eb0 0x7f677814deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 -- 172.21.15.114:0/1675922964 >> 172.21.15.114:0/1675922964 conn(0x7f67780a8490 msgr2=0x7f67780c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 -- 172.21.15.114:0/1675922964 shutdown_connections 2024-02-17T12:17:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:14.934+0000 7f677ca00640 1 -- 172.21.15.114:0/1675922964 wait complete. 2024-02-17T12:17:14.959 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-02-17T12:17:13.226934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224344,"kb_used_data":3976,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750376,"statfs":{"total":773094113280,"available":772864385024,"internally_reserved":0,"allocated":4071424,"data_stored":2271420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001585"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068069+0000","last_change":"2024-02-17T12:17:06.053476+0000","last_active":"2024-02-17T12:17:07.068069+0000","last_peered":"2024-02-17T12:17:07.068069+0000","last_clean":"2024-02-17T12:17:07.068069+0000","last_became_active":"2024-02-17T12:17:06.052947+0000","last_became_peered":"2024-02-17T12:17:06.052947+0000","last_unstale":"2024-02-17T12:17:07.068069+0000","last_undegraded":"2024-02-17T12:17:07.068069+0000","last_fullsized":"2024-02-17T12:17:07.068069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:38.086638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066586+0000","last_change":"2024-02-17T12:17:06.052373+0000","last_active":"2024-02-17T12:17:07.066586+0000","last_peered":"2024-02-17T12:17:07.066586+0000","last_clean":"2024-02-17T12:17:07.066586+0000","last_became_active":"2024-02-17T12:17:06.050597+0000","last_became_peered":"2024-02-17T12:17:06.050597+0000","last_unstale":"2024-02-17T12:17:07.066586+0000","last_undegraded":"2024-02-17T12:17:07.066586+0000","last_fullsized":"2024-02-17T12:17:07.066586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:34:21.177151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033584+0000","last_change":"2024-02-17T12:17:06.061029+0000","last_active":"2024-02-17T12:17:07.033584+0000","last_peered":"2024-02-17T12:17:07.033584+0000","last_clean":"2024-02-17T12:17:07.033584+0000","last_became_active":"2024-02-17T12:17:06.060750+0000","last_became_peered":"2024-02-17T12:17:06.060750+0000","last_unstale":"2024-02-17T12:17:07.033584+0000","last_undegraded":"2024-02-17T12:17:07.033584+0000","last_fullsized":"2024-02-17T12:17:07.033584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:49.648481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058415+0000","last_change":"2024-02-17T12:17:06.065748+0000","last_active":"2024-02-17T12:17:07.058415+0000","last_peered":"2024-02-17T12:17:07.058415+0000","last_clean":"2024-02-17T12:17:07.058415+0000","last_became_active":"2024-02-17T12:17:06.065234+0000","last_became_peered":"2024-02-17T12:17:06.065234+0000","last_unstale":"2024-02-17T12:17:07.058415+0000","last_undegraded":"2024-02-17T12:17:07.058415+0000","last_fullsized":"2024-02-17T12:17:07.058415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:25:38.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065635+0000","last_change":"2024-02-17T12:17:06.042206+0000","last_active":"2024-02-17T12:17:07.065635+0000","last_peered":"2024-02-17T12:17:07.065635+0000","last_clean":"2024-02-17T12:17:07.065635+0000","last_became_active":"2024-02-17T12:17:06.041911+0000","last_became_peered":"2024-02-17T12:17:06.041911+0000","last_unstale":"2024-02-17T12:17:07.065635+0000","last_undegraded":"2024-02-17T12:17:07.065635+0000","last_fullsized":"2024-02-17T12:17:07.065635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:09.997084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066209+0000","last_change":"2024-02-17T12:17:06.046884+0000","last_active":"2024-02-17T12:17:07.066209+0000","last_peered":"2024-02-17T12:17:07.066209+0000","last_clean":"2024-02-17T12:17:07.066209+0000","last_became_active":"2024-02-17T12:17:06.046588+0000","last_became_peered":"2024-02-17T12:17:06.046588+0000","last_unstale":"2024-02-17T12:17:07.066209+0000","last_undegraded":"2024-02-17T12:17:07.066209+0000","last_fullsized":"2024-02-17T12:17:07.066209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:50:00.758848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068200+0000","last_change":"2024-02-17T12:17:06.057466+0000","last_active":"2024-02-17T12:17:07.068200+0000","last_peered":"2024-02-17T12:17:07.068200+0000","last_clean":"2024-02-17T12:17:07.068200+0000","last_became_active":"2024-02-17T12:17:06.056922+0000","last_became_peered":"2024-02-17T12:17:06.056922+0000","last_unstale":"2024-02-17T12:17:07.068200+0000","last_undegraded":"2024-02-17T12:17:07.068200+0000","last_fullsized":"2024-02-17T12:17:07.068200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:48.842059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067801+0000","last_change":"2024-02-17T12:17:06.064126+0000","last_active":"2024-02-17T12:17:07.067801+0000","last_peered":"2024-02-17T12:17:07.067801+0000","last_clean":"2024-02-17T12:17:07.067801+0000","last_became_active":"2024-02-17T12:17:06.063876+0000","last_became_peered":"2024-02-17T12:17:06.063876+0000","last_unstale":"2024-02-17T12:17:07.067801+0000","last_undegraded":"2024-02-17T12:17:07.067801+0000","last_fullsized":"2024-02-17T12:17:07.067801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:33:43.849542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033961+0000","last_change":"2024-02-17T12:17:06.070529+0000","last_active":"2024-02-17T12:17:07.033961+0000","last_peered":"2024-02-17T12:17:07.033961+0000","last_clean":"2024-02-17T12:17:07.033961+0000","last_became_active":"2024-02-17T12:17:06.066959+0000","last_became_peered":"2024-02-17T12:17:06.066959+0000","last_unstale":"2024-02-17T12:17:07.033961+0000","last_undegraded":"2024-02-17T12:17:07.033961+0000","last_fullsized":"2024-02-17T12:17:07.033961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:56:36.987010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058520+0000","last_change":"2024-02-17T12:17:06.046775+0000","last_active":"2024-02-17T12:17:07.058520+0000","last_peered":"2024-02-17T12:17:07.058520+0000","last_clean":"2024-02-17T12:17:07.058520+0000","last_became_active":"2024-02-17T12:17:06.046488+0000","last_became_peered":"2024-02-17T12:17:06.046488+0000","last_unstale":"2024-02-17T12:17:07.058520+0000","last_undegraded":"2024-02-17T12:17:07.058520+0000","last_fullsized":"2024-02-17T12:17:07.058520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:09:44.880288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067772+0000","last_change":"2024-02-17T12:17:06.066599+0000","last_active":"2024-02-17T12:17:07.067772+0000","last_peered":"2024-02-17T12:17:07.067772+0000","last_clean":"2024-02-17T12:17:07.067772+0000","last_became_active":"2024-02-17T12:17:06.066328+0000","last_became_peered":"2024-02-17T12:17:06.066328+0000","last_unstale":"2024-02-17T12:17:07.067772+0000","last_undegraded":"2024-02-17T12:17:07.067772+0000","last_fullsized":"2024-02-17T12:17:07.067772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:05.232139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033277+0000","last_change":"2024-02-17T12:17:06.044931+0000","last_active":"2024-02-17T12:17:07.033277+0000","last_peered":"2024-02-17T12:17:07.033277+0000","last_clean":"2024-02-17T12:17:07.033277+0000","last_became_active":"2024-02-17T12:17:06.044646+0000","last_became_peered":"2024-02-17T12:17:06.044646+0000","last_unstale":"2024-02-17T12:17:07.033277+0000","last_undegraded":"2024-02-17T12:17:07.033277+0000","last_fullsized":"2024-02-17T12:17:07.033277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:16.951684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065406+0000","last_change":"2024-02-17T12:17:06.050786+0000","last_active":"2024-02-17T12:17:07.065406+0000","last_peered":"2024-02-17T12:17:07.065406+0000","last_clean":"2024-02-17T12:17:07.065406+0000","last_became_active":"2024-02-17T12:17:06.050510+0000","last_became_peered":"2024-02-17T12:17:06.050510+0000","last_unstale":"2024-02-17T12:17:07.065406+0000","last_undegraded":"2024-02-17T12:17:07.065406+0000","last_fullsized":"2024-02-17T12:17:07.065406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:32:33.567679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066215+0000","last_change":"2024-02-17T12:17:06.048246+0000","last_active":"2024-02-17T12:17:07.066215+0000","last_peered":"2024-02-17T12:17:07.066215+0000","last_clean":"2024-02-17T12:17:07.066215+0000","last_became_active":"2024-02-17T12:17:06.047970+0000","last_became_peered":"2024-02-17T12:17:06.047970+0000","last_unstale":"2024-02-17T12:17:07.066215+0000","last_undegraded":"2024-02-17T12:17:07.066215+0000","last_fullsized":"2024-02-17T12:17:07.066215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:10:08.114724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033150+0000","last_change":"2024-02-17T12:17:06.050512+0000","last_active":"2024-02-17T12:17:07.033150+0000","last_peered":"2024-02-17T12:17:07.033150+0000","last_clean":"2024-02-17T12:17:07.033150+0000","last_became_active":"2024-02-17T12:17:06.050068+0000","last_became_peered":"2024-02-17T12:17:06.050068+0000","last_unstale":"2024-02-17T12:17:07.033150+0000","last_undegraded":"2024-02-17T12:17:07.033150+0000","last_fullsized":"2024-02-17T12:17:07.033150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:52.059473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067855+0000","last_change":"2024-02-17T12:17:06.053372+0000","last_active":"2024-02-17T12:17:07.067855+0000","last_peered":"2024-02-17T12:17:07.067855+0000","last_clean":"2024-02-17T12:17:07.067855+0000","last_became_active":"2024-02-17T12:17:06.053019+0000","last_became_peered":"2024-02-17T12:17:06.053019+0000","last_unstale":"2024-02-17T12:17:07.067855+0000","last_undegraded":"2024-02-17T12:17:07.067855+0000","last_fullsized":"2024-02-17T12:17:07.067855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:01:09.789376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068291+0000","last_change":"2024-02-17T12:17:06.056524+0000","last_active":"2024-02-17T12:17:07.068291+0000","last_peered":"2024-02-17T12:17:07.068291+0000","last_clean":"2024-02-17T12:17:07.068291+0000","last_became_active":"2024-02-17T12:17:06.056171+0000","last_became_peered":"2024-02-17T12:17:06.056171+0000","last_unstale":"2024-02-17T12:17:07.068291+0000","last_undegraded":"2024-02-17T12:17:07.068291+0000","last_fullsized":"2024-02-17T12:17:07.068291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.599213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066746+0000","last_change":"2024-02-17T12:17:06.061999+0000","last_active":"2024-02-17T12:17:07.066746+0000","last_peered":"2024-02-17T12:17:07.066746+0000","last_clean":"2024-02-17T12:17:07.066746+0000","last_became_active":"2024-02-17T12:17:06.060293+0000","last_became_peered":"2024-02-17T12:17:06.060293+0000","last_unstale":"2024-02-17T12:17:07.066746+0000","last_undegraded":"2024-02-17T12:17:07.066746+0000","last_fullsized":"2024-02-17T12:17:07.066746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:52:45.908320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066389+0000","last_change":"2024-02-17T12:17:06.047799+0000","last_active":"2024-02-17T12:17:07.066389+0000","last_peered":"2024-02-17T12:17:07.066389+0000","last_clean":"2024-02-17T12:17:07.066389+0000","last_became_active":"2024-02-17T12:17:06.047532+0000","last_became_peered":"2024-02-17T12:17:06.047532+0000","last_unstale":"2024-02-17T12:17:07.066389+0000","last_undegraded":"2024-02-17T12:17:07.066389+0000","last_fullsized":"2024-02-17T12:17:07.066389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:49:48.671656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065566+0000","last_change":"2024-02-17T12:17:06.042349+0000","last_active":"2024-02-17T12:17:07.065566+0000","last_peered":"2024-02-17T12:17:07.065566+0000","last_clean":"2024-02-17T12:17:07.065566+0000","last_became_active":"2024-02-17T12:17:06.041014+0000","last_became_peered":"2024-02-17T12:17:06.041014+0000","last_unstale":"2024-02-17T12:17:07.065566+0000","last_undegraded":"2024-02-17T12:17:07.065566+0000","last_fullsized":"2024-02-17T12:17:07.065566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:17.216650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033123+0000","last_change":"2024-02-17T12:17:06.056498+0000","last_active":"2024-02-17T12:17:07.033123+0000","last_peered":"2024-02-17T12:17:07.033123+0000","last_clean":"2024-02-17T12:17:07.033123+0000","last_became_active":"2024-02-17T12:17:06.056186+0000","last_became_peered":"2024-02-17T12:17:06.056186+0000","last_unstale":"2024-02-17T12:17:07.033123+0000","last_undegraded":"2024-02-17T12:17:07.033123+0000","last_fullsized":"2024-02-17T12:17:07.033123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:54.119743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033745+0000","last_change":"2024-02-17T12:17:06.061943+0000","last_active":"2024-02-17T12:17:07.033745+0000","last_peered":"2024-02-17T12:17:07.033745+0000","last_clean":"2024-02-17T12:17:07.033745+0000","last_became_active":"2024-02-17T12:17:06.057880+0000","last_became_peered":"2024-02-17T12:17:06.057880+0000","last_unstale":"2024-02-17T12:17:07.033745+0000","last_undegraded":"2024-02-17T12:17:07.033745+0000","last_fullsized":"2024-02-17T12:17:07.033745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:41.759635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030038+0000","last_change":"2024-02-17T12:17:06.043576+0000","last_active":"2024-02-17T12:17:07.030038+0000","last_peered":"2024-02-17T12:17:07.030038+0000","last_clean":"2024-02-17T12:17:07.030038+0000","last_became_active":"2024-02-17T12:17:06.043313+0000","last_became_peered":"2024-02-17T12:17:06.043313+0000","last_unstale":"2024-02-17T12:17:07.030038+0000","last_undegraded":"2024-02-17T12:17:07.030038+0000","last_fullsized":"2024-02-17T12:17:07.030038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:18.832967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033946+0000","last_change":"2024-02-17T12:17:06.046677+0000","last_active":"2024-02-17T12:17:07.033946+0000","last_peered":"2024-02-17T12:17:07.033946+0000","last_clean":"2024-02-17T12:17:07.033946+0000","last_became_active":"2024-02-17T12:17:06.046330+0000","last_became_peered":"2024-02-17T12:17:06.046330+0000","last_unstale":"2024-02-17T12:17:07.033946+0000","last_undegraded":"2024-02-17T12:17:07.033946+0000","last_fullsized":"2024-02-17T12:17:07.033946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:10:08.114724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058606+0000","last_change":"2024-02-17T12:17:06.054887+0000","last_active":"2024-02-17T12:17:07.058606+0000","last_peered":"2024-02-17T12:17:07.058606+0000","last_clean":"2024-02-17T12:17:07.058606+0000","last_became_active":"2024-02-17T12:17:06.054012+0000","last_became_peered":"2024-02-17T12:17:06.054012+0000","last_unstale":"2024-02-17T12:17:07.058606+0000","last_undegraded":"2024-02-17T12:17:07.058606+0000","last_fullsized":"2024-02-17T12:17:07.058606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:41.419455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066743+0000","last_change":"2024-02-17T12:17:06.045278+0000","last_active":"2024-02-17T12:17:07.066743+0000","last_peered":"2024-02-17T12:17:07.066743+0000","last_clean":"2024-02-17T12:17:07.066743+0000","last_became_active":"2024-02-17T12:17:06.045015+0000","last_became_peered":"2024-02-17T12:17:06.045015+0000","last_unstale":"2024-02-17T12:17:07.066743+0000","last_undegraded":"2024-02-17T12:17:07.066743+0000","last_fullsized":"2024-02-17T12:17:07.066743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:23:10.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058741+0000","last_change":"2024-02-17T12:17:06.065534+0000","last_active":"2024-02-17T12:17:07.058741+0000","last_peered":"2024-02-17T12:17:07.058741+0000","last_clean":"2024-02-17T12:17:07.058741+0000","last_became_active":"2024-02-17T12:17:06.065279+0000","last_became_peered":"2024-02-17T12:17:06.065279+0000","last_unstale":"2024-02-17T12:17:07.058741+0000","last_undegraded":"2024-02-17T12:17:07.058741+0000","last_fullsized":"2024-02-17T12:17:07.058741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:52.059473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033827+0000","last_change":"2024-02-17T12:17:06.044234+0000","last_active":"2024-02-17T12:17:07.033827+0000","last_peered":"2024-02-17T12:17:07.033827+0000","last_clean":"2024-02-17T12:17:07.033827+0000","last_became_active":"2024-02-17T12:17:06.043918+0000","last_became_peered":"2024-02-17T12:17:06.043918+0000","last_unstale":"2024-02-17T12:17:07.033827+0000","last_undegraded":"2024-02-17T12:17:07.033827+0000","last_fullsized":"2024-02-17T12:17:07.033827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:15.140333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.034492+0000","last_change":"2024-02-17T12:17:06.059053+0000","last_active":"2024-02-17T12:17:07.034492+0000","last_peered":"2024-02-17T12:17:07.034492+0000","last_clean":"2024-02-17T12:17:07.034492+0000","last_became_active":"2024-02-17T12:17:06.058762+0000","last_became_peered":"2024-02-17T12:17:06.058762+0000","last_unstale":"2024-02-17T12:17:07.034492+0000","last_undegraded":"2024-02-17T12:17:07.034492+0000","last_fullsized":"2024-02-17T12:17:07.034492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:54:58.399092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067566+0000","last_change":"2024-02-17T12:17:06.056092+0000","last_active":"2024-02-17T12:17:07.067566+0000","last_peered":"2024-02-17T12:17:07.067566+0000","last_clean":"2024-02-17T12:17:07.067566+0000","last_became_active":"2024-02-17T12:17:06.055782+0000","last_became_peered":"2024-02-17T12:17:06.055782+0000","last_unstale":"2024-02-17T12:17:07.067566+0000","last_undegraded":"2024-02-17T12:17:07.067566+0000","last_fullsized":"2024-02-17T12:17:07.067566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:04:27.477154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067932+0000","last_change":"2024-02-17T12:17:06.058310+0000","last_active":"2024-02-17T12:17:07.067932+0000","last_peered":"2024-02-17T12:17:07.067932+0000","last_clean":"2024-02-17T12:17:07.067932+0000","last_became_active":"2024-02-17T12:17:06.058007+0000","last_became_peered":"2024-02-17T12:17:06.058007+0000","last_unstale":"2024-02-17T12:17:07.067932+0000","last_undegraded":"2024-02-17T12:17:07.067932+0000","last_fullsized":"2024-02-17T12:17:07.067932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:10.427795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067407+0000","last_change":"2024-02-17T12:17:06.067536+0000","last_active":"2024-02-17T12:17:07.067407+0000","last_peered":"2024-02-17T12:17:07.067407+0000","last_clean":"2024-02-17T12:17:07.067407+0000","last_became_active":"2024-02-17T12:17:06.066861+0000","last_became_peered":"2024-02-17T12:17:06.066861+0000","last_unstale":"2024-02-17T12:17:07.067407+0000","last_undegraded":"2024-02-17T12:17:07.067407+0000","last_fullsized":"2024-02-17T12:17:07.067407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:52.966313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030459+0000","last_change":"2024-02-17T12:17:06.046159+0000","last_active":"2024-02-17T12:17:07.030459+0000","last_peered":"2024-02-17T12:17:07.030459+0000","last_clean":"2024-02-17T12:17:07.030459+0000","last_became_active":"2024-02-17T12:17:06.045821+0000","last_became_peered":"2024-02-17T12:17:06.045821+0000","last_unstale":"2024-02-17T12:17:07.030459+0000","last_undegraded":"2024-02-17T12:17:07.030459+0000","last_fullsized":"2024-02-17T12:17:07.030459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:40.043966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068327+0000","last_change":"2024-02-17T12:17:05.029800+0000","last_active":"2024-02-17T12:17:07.068327+0000","last_peered":"2024-02-17T12:17:07.068327+0000","last_clean":"2024-02-17T12:17:07.068327+0000","last_became_active":"2024-02-17T12:17:05.029482+0000","last_became_peered":"2024-02-17T12:17:05.029482+0000","last_unstale":"2024-02-17T12:17:07.068327+0000","last_undegraded":"2024-02-17T12:17:07.068327+0000","last_fullsized":"2024-02-17T12:17:07.068327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068229+0000","last_change":"2024-02-17T12:17:06.070621+0000","last_active":"2024-02-17T12:17:07.068229+0000","last_peered":"2024-02-17T12:17:07.068229+0000","last_clean":"2024-02-17T12:17:07.068229+0000","last_became_active":"2024-02-17T12:17:06.069921+0000","last_became_peered":"2024-02-17T12:17:06.069921+0000","last_unstale":"2024-02-17T12:17:07.068229+0000","last_undegraded":"2024-02-17T12:17:07.068229+0000","last_fullsized":"2024-02-17T12:17:07.068229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:02.449515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030408+0000","last_change":"2024-02-17T12:17:05.039687+0000","last_active":"2024-02-17T12:17:07.030408+0000","last_peered":"2024-02-17T12:17:07.030408+0000","last_clean":"2024-02-17T12:17:07.030408+0000","last_became_active":"2024-02-17T12:17:05.039381+0000","last_became_peered":"2024-02-17T12:17:05.039381+0000","last_unstale":"2024-02-17T12:17:07.030408+0000","last_undegraded":"2024-02-17T12:17:07.030408+0000","last_fullsized":"2024-02-17T12:17:07.030408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033679+0000","last_change":"2024-02-17T12:17:06.059046+0000","last_active":"2024-02-17T12:17:07.033679+0000","last_peered":"2024-02-17T12:17:07.033679+0000","last_clean":"2024-02-17T12:17:07.033679+0000","last_became_active":"2024-02-17T12:17:06.058674+0000","last_became_peered":"2024-02-17T12:17:06.058674+0000","last_unstale":"2024-02-17T12:17:07.033679+0000","last_undegraded":"2024-02-17T12:17:07.033679+0000","last_fullsized":"2024-02-17T12:17:07.033679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:39:57.779942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066473+0000","last_change":"2024-02-17T12:17:05.033787+0000","last_active":"2024-02-17T12:17:07.066473+0000","last_peered":"2024-02-17T12:17:07.066473+0000","last_clean":"2024-02-17T12:17:07.066473+0000","last_became_active":"2024-02-17T12:17:05.033470+0000","last_became_peered":"2024-02-17T12:17:05.033470+0000","last_unstale":"2024-02-17T12:17:07.066473+0000","last_undegraded":"2024-02-17T12:17:07.066473+0000","last_fullsized":"2024-02-17T12:17:07.066473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:14:47.318267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058907+0000","last_change":"2024-02-17T12:17:06.065678+0000","last_active":"2024-02-17T12:17:07.058907+0000","last_peered":"2024-02-17T12:17:07.058907+0000","last_clean":"2024-02-17T12:17:07.058907+0000","last_became_active":"2024-02-17T12:17:06.065401+0000","last_became_peered":"2024-02-17T12:17:06.065401+0000","last_unstale":"2024-02-17T12:17:07.058907+0000","last_undegraded":"2024-02-17T12:17:07.058907+0000","last_fullsized":"2024-02-17T12:17:07.058907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:14.063262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065525+0000","last_change":"2024-02-17T12:17:05.031611+0000","last_active":"2024-02-17T12:17:07.065525+0000","last_peered":"2024-02-17T12:17:07.065525+0000","last_clean":"2024-02-17T12:17:07.065525+0000","last_became_active":"2024-02-17T12:17:05.031301+0000","last_became_peered":"2024-02-17T12:17:05.031301+0000","last_unstale":"2024-02-17T12:17:07.065525+0000","last_undegraded":"2024-02-17T12:17:07.065525+0000","last_fullsized":"2024-02-17T12:17:07.065525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:16:26.921410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067724+0000","last_change":"2024-02-17T12:17:06.067276+0000","last_active":"2024-02-17T12:17:07.067724+0000","last_peered":"2024-02-17T12:17:07.067724+0000","last_clean":"2024-02-17T12:17:07.067724+0000","last_became_active":"2024-02-17T12:17:06.066957+0000","last_became_peered":"2024-02-17T12:17:06.066957+0000","last_unstale":"2024-02-17T12:17:07.067724+0000","last_undegraded":"2024-02-17T12:17:07.067724+0000","last_fullsized":"2024-02-17T12:17:07.067724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:11:41.273983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033300+0000","last_change":"2024-02-17T12:17:05.033265+0000","last_active":"2024-02-17T12:17:07.033300+0000","last_peered":"2024-02-17T12:17:07.033300+0000","last_clean":"2024-02-17T12:17:07.033300+0000","last_became_active":"2024-02-17T12:17:05.032692+0000","last_became_peered":"2024-02-17T12:17:05.032692+0000","last_unstale":"2024-02-17T12:17:07.033300+0000","last_undegraded":"2024-02-17T12:17:07.033300+0000","last_fullsized":"2024-02-17T12:17:07.033300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:26.317463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033005+0000","last_change":"2024-02-17T12:17:06.044302+0000","last_active":"2024-02-17T12:17:07.033005+0000","last_peered":"2024-02-17T12:17:07.033005+0000","last_clean":"2024-02-17T12:17:07.033005+0000","last_became_active":"2024-02-17T12:17:06.043786+0000","last_became_peered":"2024-02-17T12:17:06.043786+0000","last_unstale":"2024-02-17T12:17:07.033005+0000","last_undegraded":"2024-02-17T12:17:07.033005+0000","last_fullsized":"2024-02-17T12:17:07.033005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:41.419455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033779+0000","last_change":"2024-02-17T12:17:05.026630+0000","last_active":"2024-02-17T12:17:07.033779+0000","last_peered":"2024-02-17T12:17:07.033779+0000","last_clean":"2024-02-17T12:17:07.033779+0000","last_became_active":"2024-02-17T12:17:05.026382+0000","last_became_peered":"2024-02-17T12:17:05.026382+0000","last_unstale":"2024-02-17T12:17:07.033779+0000","last_undegraded":"2024-02-17T12:17:07.033779+0000","last_fullsized":"2024-02-17T12:17:07.033779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:01.105877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.034059+0000","last_change":"2024-02-17T12:17:06.057017+0000","last_active":"2024-02-17T12:17:07.034059+0000","last_peered":"2024-02-17T12:17:07.034059+0000","last_clean":"2024-02-17T12:17:07.034059+0000","last_became_active":"2024-02-17T12:17:06.056811+0000","last_became_peered":"2024-02-17T12:17:06.056811+0000","last_unstale":"2024-02-17T12:17:07.034059+0000","last_undegraded":"2024-02-17T12:17:07.034059+0000","last_fullsized":"2024-02-17T12:17:07.034059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:20.704065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066062+0000","last_change":"2024-02-17T12:17:05.030240+0000","last_active":"2024-02-17T12:17:07.066062+0000","last_peered":"2024-02-17T12:17:07.066062+0000","last_clean":"2024-02-17T12:17:07.066062+0000","last_became_active":"2024-02-17T12:17:05.029142+0000","last_became_peered":"2024-02-17T12:17:05.029142+0000","last_unstale":"2024-02-17T12:17:07.066062+0000","last_undegraded":"2024-02-17T12:17:07.066062+0000","last_fullsized":"2024-02-17T12:17:07.066062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:06.543631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058307+0000","last_change":"2024-02-17T12:17:06.048418+0000","last_active":"2024-02-17T12:17:07.058307+0000","last_peered":"2024-02-17T12:17:07.058307+0000","last_clean":"2024-02-17T12:17:07.058307+0000","last_became_active":"2024-02-17T12:17:06.048123+0000","last_became_peered":"2024-02-17T12:17:06.048123+0000","last_unstale":"2024-02-17T12:17:07.058307+0000","last_undegraded":"2024-02-17T12:17:07.058307+0000","last_fullsized":"2024-02-17T12:17:07.058307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:00:35.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.034006+0000","last_change":"2024-02-17T12:17:05.029530+0000","last_active":"2024-02-17T12:17:07.034006+0000","last_peered":"2024-02-17T12:17:07.034006+0000","last_clean":"2024-02-17T12:17:07.034006+0000","last_became_active":"2024-02-17T12:17:05.029267+0000","last_became_peered":"2024-02-17T12:17:05.029267+0000","last_unstale":"2024-02-17T12:17:07.034006+0000","last_undegraded":"2024-02-17T12:17:07.034006+0000","last_fullsized":"2024-02-17T12:17:07.034006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:18:31.092114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033612+0000","last_change":"2024-02-17T12:17:06.045622+0000","last_active":"2024-02-17T12:17:07.033612+0000","last_peered":"2024-02-17T12:17:07.033612+0000","last_clean":"2024-02-17T12:17:07.033612+0000","last_became_active":"2024-02-17T12:17:06.044323+0000","last_became_peered":"2024-02-17T12:17:06.044323+0000","last_unstale":"2024-02-17T12:17:07.033612+0000","last_undegraded":"2024-02-17T12:17:07.033612+0000","last_fullsized":"2024-02-17T12:17:07.033612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:03.897754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066675+0000","last_change":"2024-02-17T12:17:05.040696+0000","last_active":"2024-02-17T12:17:07.066675+0000","last_peered":"2024-02-17T12:17:07.066675+0000","last_clean":"2024-02-17T12:17:07.066675+0000","last_became_active":"2024-02-17T12:17:05.040185+0000","last_became_peered":"2024-02-17T12:17:05.040185+0000","last_unstale":"2024-02-17T12:17:07.066675+0000","last_undegraded":"2024-02-17T12:17:07.066675+0000","last_fullsized":"2024-02-17T12:17:07.066675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:09.420535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066697+0000","last_change":"2024-02-17T12:17:06.060266+0000","last_active":"2024-02-17T12:17:07.066697+0000","last_peered":"2024-02-17T12:17:07.066697+0000","last_clean":"2024-02-17T12:17:07.066697+0000","last_became_active":"2024-02-17T12:17:06.059994+0000","last_became_peered":"2024-02-17T12:17:06.059994+0000","last_unstale":"2024-02-17T12:17:07.066697+0000","last_undegraded":"2024-02-17T12:17:07.066697+0000","last_fullsized":"2024-02-17T12:17:07.066697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:16.827288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030487+0000","last_change":"2024-02-17T12:17:05.042848+0000","last_active":"2024-02-17T12:17:07.030487+0000","last_peered":"2024-02-17T12:17:07.030487+0000","last_clean":"2024-02-17T12:17:07.030487+0000","last_became_active":"2024-02-17T12:17:05.042537+0000","last_became_peered":"2024-02-17T12:17:05.042537+0000","last_unstale":"2024-02-17T12:17:07.030487+0000","last_undegraded":"2024-02-17T12:17:07.030487+0000","last_fullsized":"2024-02-17T12:17:07.030487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066414+0000","last_change":"2024-02-17T12:17:06.050890+0000","last_active":"2024-02-17T12:17:07.066414+0000","last_peered":"2024-02-17T12:17:07.066414+0000","last_clean":"2024-02-17T12:17:07.066414+0000","last_became_active":"2024-02-17T12:17:06.050253+0000","last_became_peered":"2024-02-17T12:17:06.050253+0000","last_unstale":"2024-02-17T12:17:07.066414+0000","last_undegraded":"2024-02-17T12:17:07.066414+0000","last_fullsized":"2024-02-17T12:17:07.066414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:09:31.745218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033684+0000","last_change":"2024-02-17T12:17:05.038559+0000","last_active":"2024-02-17T12:17:07.033684+0000","last_peered":"2024-02-17T12:17:07.033684+0000","last_clean":"2024-02-17T12:17:07.033684+0000","last_became_active":"2024-02-17T12:17:05.038388+0000","last_became_peered":"2024-02-17T12:17:05.038388+0000","last_unstale":"2024-02-17T12:17:07.033684+0000","last_undegraded":"2024-02-17T12:17:07.033684+0000","last_fullsized":"2024-02-17T12:17:07.033684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:14:47.318267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033418+0000","last_change":"2024-02-17T12:17:06.066601+0000","last_active":"2024-02-17T12:17:07.033418+0000","last_peered":"2024-02-17T12:17:07.033418+0000","last_clean":"2024-02-17T12:17:07.033418+0000","last_became_active":"2024-02-17T12:17:06.066262+0000","last_became_peered":"2024-02-17T12:17:06.066262+0000","last_unstale":"2024-02-17T12:17:07.033418+0000","last_undegraded":"2024-02-17T12:17:07.033418+0000","last_fullsized":"2024-02-17T12:17:07.033418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:14.063262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066500+0000","last_change":"2024-02-17T12:17:05.034049+0000","last_active":"2024-02-17T12:17:07.066500+0000","last_peered":"2024-02-17T12:17:07.066500+0000","last_clean":"2024-02-17T12:17:07.066500+0000","last_became_active":"2024-02-17T12:17:05.033414+0000","last_became_peered":"2024-02-17T12:17:05.033414+0000","last_unstale":"2024-02-17T12:17:07.066500+0000","last_undegraded":"2024-02-17T12:17:07.066500+0000","last_fullsized":"2024-02-17T12:17:07.066500+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:17.825707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058801+0000","last_change":"2024-02-17T12:17:06.049102+0000","last_active":"2024-02-17T12:17:07.058801+0000","last_peered":"2024-02-17T12:17:07.058801+0000","last_clean":"2024-02-17T12:17:07.058801+0000","last_became_active":"2024-02-17T12:17:06.048820+0000","last_became_peered":"2024-02-17T12:17:06.048820+0000","last_unstale":"2024-02-17T12:17:07.058801+0000","last_undegraded":"2024-02-17T12:17:07.058801+0000","last_fullsized":"2024-02-17T12:17:07.058801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:16.951684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033421+0000","last_change":"2024-02-17T12:17:05.032981+0000","last_active":"2024-02-17T12:17:07.033421+0000","last_peered":"2024-02-17T12:17:07.033421+0000","last_clean":"2024-02-17T12:17:07.033421+0000","last_became_active":"2024-02-17T12:17:05.032653+0000","last_became_peered":"2024-02-17T12:17:05.032653+0000","last_unstale":"2024-02-17T12:17:07.033421+0000","last_undegraded":"2024-02-17T12:17:07.033421+0000","last_fullsized":"2024-02-17T12:17:07.033421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:32.512700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066560+0000","last_change":"2024-02-17T12:17:06.043565+0000","last_active":"2024-02-17T12:17:07.066560+0000","last_peered":"2024-02-17T12:17:07.066560+0000","last_clean":"2024-02-17T12:17:07.066560+0000","last_became_active":"2024-02-17T12:17:06.043189+0000","last_became_peered":"2024-02-17T12:17:06.043189+0000","last_unstale":"2024-02-17T12:17:07.066560+0000","last_undegraded":"2024-02-17T12:17:07.066560+0000","last_fullsized":"2024-02-17T12:17:07.066560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:02:23.127482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058256+0000","last_change":"2024-02-17T12:17:05.032388+0000","last_active":"2024-02-17T12:17:07.058256+0000","last_peered":"2024-02-17T12:17:07.058256+0000","last_clean":"2024-02-17T12:17:07.058256+0000","last_became_active":"2024-02-17T12:17:05.032055+0000","last_became_peered":"2024-02-17T12:17:05.032055+0000","last_unstale":"2024-02-17T12:17:07.058256+0000","last_undegraded":"2024-02-17T12:17:07.058256+0000","last_fullsized":"2024-02-17T12:17:07.058256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067565+0000","last_change":"2024-02-17T12:17:06.067761+0000","last_active":"2024-02-17T12:17:07.067565+0000","last_peered":"2024-02-17T12:17:07.067565+0000","last_clean":"2024-02-17T12:17:07.067565+0000","last_became_active":"2024-02-17T12:17:06.067249+0000","last_became_peered":"2024-02-17T12:17:06.067249+0000","last_unstale":"2024-02-17T12:17:07.067565+0000","last_undegraded":"2024-02-17T12:17:07.067565+0000","last_fullsized":"2024-02-17T12:17:07.067565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:40:09.999149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066047+0000","last_change":"2024-02-17T12:17:05.037345+0000","last_active":"2024-02-17T12:17:07.066047+0000","last_peered":"2024-02-17T12:17:07.066047+0000","last_clean":"2024-02-17T12:17:07.066047+0000","last_became_active":"2024-02-17T12:17:05.037076+0000","last_became_peered":"2024-02-17T12:17:05.037076+0000","last_unstale":"2024-02-17T12:17:07.066047+0000","last_undegraded":"2024-02-17T12:17:07.066047+0000","last_fullsized":"2024-02-17T12:17:07.066047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:34.554467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068070+0000","last_change":"2024-02-17T12:17:06.066823+0000","last_active":"2024-02-17T12:17:07.068070+0000","last_peered":"2024-02-17T12:17:07.068070+0000","last_clean":"2024-02-17T12:17:07.068070+0000","last_became_active":"2024-02-17T12:17:06.066564+0000","last_became_peered":"2024-02-17T12:17:06.066564+0000","last_unstale":"2024-02-17T12:17:07.068070+0000","last_undegraded":"2024-02-17T12:17:07.068070+0000","last_fullsized":"2024-02-17T12:17:07.068070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:00:35.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065941+0000","last_change":"2024-02-17T12:17:05.033809+0000","last_active":"2024-02-17T12:17:07.065941+0000","last_peered":"2024-02-17T12:17:07.065941+0000","last_clean":"2024-02-17T12:17:07.065941+0000","last_became_active":"2024-02-17T12:17:05.033434+0000","last_became_peered":"2024-02-17T12:17:05.033434+0000","last_unstale":"2024-02-17T12:17:07.065941+0000","last_undegraded":"2024-02-17T12:17:07.065941+0000","last_fullsized":"2024-02-17T12:17:07.065941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:20.156577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033507+0000","last_change":"2024-02-17T12:17:06.056551+0000","last_active":"2024-02-17T12:17:07.033507+0000","last_peered":"2024-02-17T12:17:07.033507+0000","last_clean":"2024-02-17T12:17:07.033507+0000","last_became_active":"2024-02-17T12:17:06.056226+0000","last_became_peered":"2024-02-17T12:17:06.056226+0000","last_unstale":"2024-02-17T12:17:07.033507+0000","last_undegraded":"2024-02-17T12:17:07.033507+0000","last_fullsized":"2024-02-17T12:17:07.033507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:26:02.974500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058637+0000","last_change":"2024-02-17T12:17:05.039589+0000","last_active":"2024-02-17T12:17:07.058637+0000","last_peered":"2024-02-17T12:17:07.058637+0000","last_clean":"2024-02-17T12:17:07.058637+0000","last_became_active":"2024-02-17T12:17:05.039353+0000","last_became_peered":"2024-02-17T12:17:05.039353+0000","last_unstale":"2024-02-17T12:17:07.058637+0000","last_undegraded":"2024-02-17T12:17:07.058637+0000","last_fullsized":"2024-02-17T12:17:07.058637+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033868+0000","last_change":"2024-02-17T12:17:06.070352+0000","last_active":"2024-02-17T12:17:07.033868+0000","last_peered":"2024-02-17T12:17:07.033868+0000","last_clean":"2024-02-17T12:17:07.033868+0000","last_became_active":"2024-02-17T12:17:06.070053+0000","last_became_peered":"2024-02-17T12:17:06.070053+0000","last_unstale":"2024-02-17T12:17:07.033868+0000","last_undegraded":"2024-02-17T12:17:07.033868+0000","last_fullsized":"2024-02-17T12:17:07.033868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:50:00.758848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033556+0000","last_change":"2024-02-17T12:17:05.030468+0000","last_active":"2024-02-17T12:17:07.033556+0000","last_peered":"2024-02-17T12:17:07.033556+0000","last_clean":"2024-02-17T12:17:07.033556+0000","last_became_active":"2024-02-17T12:17:05.030205+0000","last_became_peered":"2024-02-17T12:17:05.030205+0000","last_unstale":"2024-02-17T12:17:07.033556+0000","last_undegraded":"2024-02-17T12:17:07.033556+0000","last_fullsized":"2024-02-17T12:17:07.033556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:08.989824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058329+0000","last_change":"2024-02-17T12:17:06.060894+0000","last_active":"2024-02-17T12:17:07.058329+0000","last_peered":"2024-02-17T12:17:07.058329+0000","last_clean":"2024-02-17T12:17:07.058329+0000","last_became_active":"2024-02-17T12:17:06.060631+0000","last_became_peered":"2024-02-17T12:17:06.060631+0000","last_unstale":"2024-02-17T12:17:07.058329+0000","last_undegraded":"2024-02-17T12:17:07.058329+0000","last_fullsized":"2024-02-17T12:17:07.058329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:02.449515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033577+0000","last_change":"2024-02-17T12:17:05.037680+0000","last_active":"2024-02-17T12:17:07.033577+0000","last_peered":"2024-02-17T12:17:07.033577+0000","last_clean":"2024-02-17T12:17:07.033577+0000","last_became_active":"2024-02-17T12:17:05.037370+0000","last_became_peered":"2024-02-17T12:17:05.037370+0000","last_unstale":"2024-02-17T12:17:07.033577+0000","last_undegraded":"2024-02-17T12:17:07.033577+0000","last_fullsized":"2024-02-17T12:17:07.033577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:16.209390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065490+0000","last_change":"2024-02-17T12:17:06.047087+0000","last_active":"2024-02-17T12:17:07.065490+0000","last_peered":"2024-02-17T12:17:07.065490+0000","last_clean":"2024-02-17T12:17:07.065490+0000","last_became_active":"2024-02-17T12:17:06.046719+0000","last_became_peered":"2024-02-17T12:17:06.046719+0000","last_unstale":"2024-02-17T12:17:07.065490+0000","last_undegraded":"2024-02-17T12:17:07.065490+0000","last_fullsized":"2024-02-17T12:17:07.065490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:42.759571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033749+0000","last_change":"2024-02-17T12:17:05.026370+0000","last_active":"2024-02-17T12:17:07.033749+0000","last_peered":"2024-02-17T12:17:07.033749+0000","last_clean":"2024-02-17T12:17:07.033749+0000","last_became_active":"2024-02-17T12:17:05.026124+0000","last_became_peered":"2024-02-17T12:17:05.026124+0000","last_unstale":"2024-02-17T12:17:07.033749+0000","last_undegraded":"2024-02-17T12:17:07.033749+0000","last_fullsized":"2024-02-17T12:17:07.033749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:35.272161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065486+0000","last_change":"2024-02-17T12:17:06.058275+0000","last_active":"2024-02-17T12:17:07.065486+0000","last_peered":"2024-02-17T12:17:07.065486+0000","last_clean":"2024-02-17T12:17:07.065486+0000","last_became_active":"2024-02-17T12:17:06.057949+0000","last_became_peered":"2024-02-17T12:17:06.057949+0000","last_unstale":"2024-02-17T12:17:07.065486+0000","last_undegraded":"2024-02-17T12:17:07.065486+0000","last_fullsized":"2024-02-17T12:17:07.065486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:36.279421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030192+0000","last_change":"2024-02-17T12:17:05.038848+0000","last_active":"2024-02-17T12:17:07.030192+0000","last_peered":"2024-02-17T12:17:07.030192+0000","last_clean":"2024-02-17T12:17:07.030192+0000","last_became_active":"2024-02-17T12:17:05.038528+0000","last_became_peered":"2024-02-17T12:17:05.038528+0000","last_unstale":"2024-02-17T12:17:07.030192+0000","last_undegraded":"2024-02-17T12:17:07.030192+0000","last_fullsized":"2024-02-17T12:17:07.030192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:01:36.502802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065549+0000","last_change":"2024-02-17T12:17:06.044343+0000","last_active":"2024-02-17T12:17:07.065549+0000","last_peered":"2024-02-17T12:17:07.065549+0000","last_clean":"2024-02-17T12:17:07.065549+0000","last_became_active":"2024-02-17T12:17:06.044057+0000","last_became_peered":"2024-02-17T12:17:06.044057+0000","last_unstale":"2024-02-17T12:17:07.065549+0000","last_undegraded":"2024-02-17T12:17:07.065549+0000","last_fullsized":"2024-02-17T12:17:07.065549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:33.519960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067666+0000","last_change":"2024-02-17T12:17:05.035457+0000","last_active":"2024-02-17T12:17:07.067666+0000","last_peered":"2024-02-17T12:17:07.067666+0000","last_clean":"2024-02-17T12:17:07.067666+0000","last_became_active":"2024-02-17T12:17:05.035024+0000","last_became_peered":"2024-02-17T12:17:05.035024+0000","last_unstale":"2024-02-17T12:17:07.067666+0000","last_undegraded":"2024-02-17T12:17:07.067666+0000","last_fullsized":"2024-02-17T12:17:07.067666+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065502+0000","last_change":"2024-02-17T12:17:06.051800+0000","last_active":"2024-02-17T12:17:07.065502+0000","last_peered":"2024-02-17T12:17:07.065502+0000","last_clean":"2024-02-17T12:17:07.065502+0000","last_became_active":"2024-02-17T12:17:06.047017+0000","last_became_peered":"2024-02-17T12:17:06.047017+0000","last_unstale":"2024-02-17T12:17:07.065502+0000","last_undegraded":"2024-02-17T12:17:07.065502+0000","last_fullsized":"2024-02-17T12:17:07.065502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:27.324723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033144+0000","last_change":"2024-02-17T12:17:05.024282+0000","last_active":"2024-02-17T12:17:07.033144+0000","last_peered":"2024-02-17T12:17:07.033144+0000","last_clean":"2024-02-17T12:17:07.033144+0000","last_became_active":"2024-02-17T12:17:05.023939+0000","last_became_peered":"2024-02-17T12:17:05.023939+0000","last_unstale":"2024-02-17T12:17:07.033144+0000","last_undegraded":"2024-02-17T12:17:07.033144+0000","last_fullsized":"2024-02-17T12:17:07.033144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:41.752311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.068063+0000","last_change":"2024-02-17T12:17:06.057175+0000","last_active":"2024-02-17T12:17:07.068063+0000","last_peered":"2024-02-17T12:17:07.068063+0000","last_clean":"2024-02-17T12:17:07.068063+0000","last_became_active":"2024-02-17T12:17:06.055674+0000","last_became_peered":"2024-02-17T12:17:06.055674+0000","last_unstale":"2024-02-17T12:17:07.068063+0000","last_undegraded":"2024-02-17T12:17:07.068063+0000","last_fullsized":"2024-02-17T12:17:07.068063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:26:17.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.032813+0000","last_change":"2024-02-17T12:17:05.037887+0000","last_active":"2024-02-17T12:17:07.032813+0000","last_peered":"2024-02-17T12:17:07.032813+0000","last_clean":"2024-02-17T12:17:07.032813+0000","last_became_active":"2024-02-17T12:17:05.037587+0000","last_became_peered":"2024-02-17T12:17:05.037587+0000","last_unstale":"2024-02-17T12:17:07.032813+0000","last_undegraded":"2024-02-17T12:17:07.032813+0000","last_fullsized":"2024-02-17T12:17:07.032813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:20.156577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065729+0000","last_change":"2024-02-17T12:17:06.037347+0000","last_active":"2024-02-17T12:17:07.065729+0000","last_peered":"2024-02-17T12:17:07.065729+0000","last_clean":"2024-02-17T12:17:07.065729+0000","last_became_active":"2024-02-17T12:17:06.037068+0000","last_became_peered":"2024-02-17T12:17:06.037068+0000","last_unstale":"2024-02-17T12:17:07.065729+0000","last_undegraded":"2024-02-17T12:17:07.065729+0000","last_fullsized":"2024-02-17T12:17:07.065729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:54:10.814424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058697+0000","last_change":"2024-02-17T12:17:05.025815+0000","last_active":"2024-02-17T12:17:07.058697+0000","last_peered":"2024-02-17T12:17:07.058697+0000","last_clean":"2024-02-17T12:17:07.058697+0000","last_became_active":"2024-02-17T12:17:05.025568+0000","last_became_peered":"2024-02-17T12:17:05.025568+0000","last_unstale":"2024-02-17T12:17:07.058697+0000","last_undegraded":"2024-02-17T12:17:07.058697+0000","last_fullsized":"2024-02-17T12:17:07.058697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033946+0000","last_change":"2024-02-17T12:17:06.060996+0000","last_active":"2024-02-17T12:17:07.033946+0000","last_peered":"2024-02-17T12:17:07.033946+0000","last_clean":"2024-02-17T12:17:07.033946+0000","last_became_active":"2024-02-17T12:17:06.060713+0000","last_became_peered":"2024-02-17T12:17:06.060713+0000","last_unstale":"2024-02-17T12:17:07.033946+0000","last_undegraded":"2024-02-17T12:17:07.033946+0000","last_fullsized":"2024-02-17T12:17:07.033946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:49:48.671656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030575+0000","last_change":"2024-02-17T12:17:05.039517+0000","last_active":"2024-02-17T12:17:07.030575+0000","last_peered":"2024-02-17T12:17:07.030575+0000","last_clean":"2024-02-17T12:17:07.030575+0000","last_became_active":"2024-02-17T12:17:05.039209+0000","last_became_peered":"2024-02-17T12:17:05.039209+0000","last_unstale":"2024-02-17T12:17:07.030575+0000","last_undegraded":"2024-02-17T12:17:07.030575+0000","last_fullsized":"2024-02-17T12:17:07.030575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030081+0000","last_change":"2024-02-17T12:17:06.039368+0000","last_active":"2024-02-17T12:17:07.030081+0000","last_peered":"2024-02-17T12:17:07.030081+0000","last_clean":"2024-02-17T12:17:07.030081+0000","last_became_active":"2024-02-17T12:17:06.039047+0000","last_became_peered":"2024-02-17T12:17:06.039047+0000","last_unstale":"2024-02-17T12:17:07.030081+0000","last_undegraded":"2024-02-17T12:17:07.030081+0000","last_fullsized":"2024-02-17T12:17:07.030081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:07.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058470+0000","last_change":"2024-02-17T12:17:05.037708+0000","last_active":"2024-02-17T12:17:07.058470+0000","last_peered":"2024-02-17T12:17:07.058470+0000","last_clean":"2024-02-17T12:17:07.058470+0000","last_became_active":"2024-02-17T12:17:05.037213+0000","last_became_peered":"2024-02-17T12:17:05.037213+0000","last_unstale":"2024-02-17T12:17:07.058470+0000","last_undegraded":"2024-02-17T12:17:07.058470+0000","last_fullsized":"2024-02-17T12:17:07.058470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067594+0000","last_change":"2024-02-17T12:17:06.051204+0000","last_active":"2024-02-17T12:17:07.067594+0000","last_peered":"2024-02-17T12:17:07.067594+0000","last_clean":"2024-02-17T12:17:07.067594+0000","last_became_active":"2024-02-17T12:17:06.050919+0000","last_became_peered":"2024-02-17T12:17:06.050919+0000","last_unstale":"2024-02-17T12:17:07.067594+0000","last_undegraded":"2024-02-17T12:17:07.067594+0000","last_fullsized":"2024-02-17T12:17:07.067594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:40.043966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030335+0000","last_change":"2024-02-17T12:17:05.034917+0000","last_active":"2024-02-17T12:17:07.030335+0000","last_peered":"2024-02-17T12:17:07.030335+0000","last_clean":"2024-02-17T12:17:07.030335+0000","last_became_active":"2024-02-17T12:17:05.034653+0000","last_became_peered":"2024-02-17T12:17:05.034653+0000","last_unstale":"2024-02-17T12:17:07.030335+0000","last_undegraded":"2024-02-17T12:17:07.030335+0000","last_fullsized":"2024-02-17T12:17:07.030335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.030244+0000","last_change":"2024-02-17T12:17:06.047590+0000","last_active":"2024-02-17T12:17:07.030244+0000","last_peered":"2024-02-17T12:17:07.030244+0000","last_clean":"2024-02-17T12:17:07.030244+0000","last_became_active":"2024-02-17T12:17:06.046851+0000","last_became_peered":"2024-02-17T12:17:06.046851+0000","last_unstale":"2024-02-17T12:17:07.030244+0000","last_undegraded":"2024-02-17T12:17:07.030244+0000","last_fullsized":"2024-02-17T12:17:07.030244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:35.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.058367+0000","last_change":"2024-02-17T12:17:05.026508+0000","last_active":"2024-02-17T12:17:07.058367+0000","last_peered":"2024-02-17T12:17:07.058367+0000","last_clean":"2024-02-17T12:17:07.058367+0000","last_became_active":"2024-02-17T12:17:05.026238+0000","last_became_peered":"2024-02-17T12:17:05.026238+0000","last_unstale":"2024-02-17T12:17:07.058367+0000","last_undegraded":"2024-02-17T12:17:07.058367+0000","last_fullsized":"2024-02-17T12:17:07.058367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.065948+0000","last_change":"2024-02-17T12:17:06.048841+0000","last_active":"2024-02-17T12:17:07.065948+0000","last_peered":"2024-02-17T12:17:07.065948+0000","last_clean":"2024-02-17T12:17:07.065948+0000","last_became_active":"2024-02-17T12:17:06.048593+0000","last_became_peered":"2024-02-17T12:17:06.048593+0000","last_unstale":"2024-02-17T12:17:07.065948+0000","last_undegraded":"2024-02-17T12:17:07.065948+0000","last_fullsized":"2024-02-17T12:17:07.065948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:15.140333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033263+0000","last_change":"2024-02-17T12:17:05.024299+0000","last_active":"2024-02-17T12:17:07.033263+0000","last_peered":"2024-02-17T12:17:07.033263+0000","last_clean":"2024-02-17T12:17:07.033263+0000","last_became_active":"2024-02-17T12:17:05.023219+0000","last_became_peered":"2024-02-17T12:17:05.023219+0000","last_unstale":"2024-02-17T12:17:07.033263+0000","last_undegraded":"2024-02-17T12:17:07.033263+0000","last_fullsized":"2024-02-17T12:17:07.033263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:32:32.560419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.033085+0000","last_change":"2024-02-17T12:17:06.060773+0000","last_active":"2024-02-17T12:17:07.033085+0000","last_peered":"2024-02-17T12:17:07.033085+0000","last_clean":"2024-02-17T12:17:07.033085+0000","last_became_active":"2024-02-17T12:17:06.060435+0000","last_became_peered":"2024-02-17T12:17:06.060435+0000","last_unstale":"2024-02-17T12:17:07.033085+0000","last_undegraded":"2024-02-17T12:17:07.033085+0000","last_fullsized":"2024-02-17T12:17:07.033085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:24.540105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.066041+0000","last_change":"2024-02-17T12:17:05.036670+0000","last_active":"2024-02-17T12:17:07.066041+0000","last_peered":"2024-02-17T12:17:07.066041+0000","last_clean":"2024-02-17T12:17:07.066041+0000","last_became_active":"2024-02-17T12:17:05.036395+0000","last_became_peered":"2024-02-17T12:17:05.036395+0000","last_unstale":"2024-02-17T12:17:07.066041+0000","last_undegraded":"2024-02-17T12:17:07.066041+0000","last_fullsized":"2024-02-17T12:17:07.066041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:39.036706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067588+0000","last_change":"2024-02-17T12:17:06.057194+0000","last_active":"2024-02-17T12:17:07.067588+0000","last_peered":"2024-02-17T12:17:07.067588+0000","last_clean":"2024-02-17T12:17:07.067588+0000","last_became_active":"2024-02-17T12:17:06.056898+0000","last_became_peered":"2024-02-17T12:17:06.056898+0000","last_unstale":"2024-02-17T12:17:07.067588+0000","last_undegraded":"2024-02-17T12:17:07.067588+0000","last_fullsized":"2024-02-17T12:17:07.067588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:06:21.529406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067840+0000","last_change":"2024-02-17T12:17:05.036734+0000","last_active":"2024-02-17T12:17:07.067840+0000","last_peered":"2024-02-17T12:17:07.067840+0000","last_clean":"2024-02-17T12:17:07.067840+0000","last_became_active":"2024-02-17T12:17:05.036453+0000","last_became_peered":"2024-02-17T12:17:05.036453+0000","last_unstale":"2024-02-17T12:17:07.067840+0000","last_undegraded":"2024-02-17T12:17:07.067840+0000","last_fullsized":"2024-02-17T12:17:07.067840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-02-17T12:17:07.067866+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:17:07.067866+0000","last_peered":"2024-02-17T12:17:07.067866+0000","last_clean":"2024-02-17T12:17:07.067866+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:17:07.067866+0000","last_undegraded":"2024-02-17T12:17:07.067866+0000","last_fullsized":"2024-02-17T12:17:07.067866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":136349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":136405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":137367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":137367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":726101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":726191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":360448,"data_stored":135837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.82899999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":356352,"data_stored":135803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:17:14.963 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T12:17:14.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-02-17T12:17:15.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a9d800640 1 Processor -- start 2024-02-17T12:17:15.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a9d800640 1 -- start start 2024-02-17T12:17:15.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a9d800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 0x7f0a980aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a9d800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0a980c1eb0 0x7f0a9815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a9d800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a980a9420 con 0x7f0a9814f110 2024-02-17T12:17:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a9d800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9814f4f0 con 0x7f0a980c1eb0 2024-02-17T12:17:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a9d800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980aae80 con 0x7f0a980c2580 2024-02-17T12:17:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a96a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0a9814f110 0x7f0a980c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55422/0 (socket says 172.21.15.114:55422) 2024-02-17T12:17:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a96a00640 1 -- 172.21.15.114:0/2656816545 learned_addr learned my addr 172.21.15.114:0/2656816545 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a96000640 1 --2- 172.21.15.114:0/2656816545 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 0x7f0a980aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a97400640 1 --2- 172.21.15.114:0/2656816545 >> v2:172.21.15.116:3300/0 conn(0x7f0a980c1eb0 0x7f0a9815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a95600640 1 -- 172.21.15.114:0/2656816545 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700419385 0 0) 0x7f0a980a9420 con 0x7f0a9814f110 2024-02-17T12:17:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a95600640 1 -- 172.21.15.114:0/2656816545 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a7c003530 con 0x7f0a9814f110 2024-02-17T12:17:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a96000640 1 -- 172.21.15.114:0/2656816545 >> v2:172.21.15.116:3300/0 conn(0x7f0a980c1eb0 msgr2=0x7f0a9815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a96000640 1 --2- 172.21.15.114:0/2656816545 >> v2:172.21.15.116:3300/0 conn(0x7f0a980c1eb0 0x7f0a9815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a96000640 1 -- 172.21.15.114:0/2656816545 >> v1:172.21.15.114:6789/0 conn(0x7f0a9814f110 legacy=0x7f0a980c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a95600640 1 -- 172.21.15.114:0/2656816545 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1607215374 0 0) 0x7f0a7c003530 con 0x7f0a9814f110 2024-02-17T12:17:15.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.142+0000 7f0a96000640 1 -- 172.21.15.114:0/2656816545 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a98152850 con 0x7f0a980c2580 2024-02-17T12:17:15.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a96000640 1 --2- 172.21.15.114:0/2656816545 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 0x7f0a980aa150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a800097c0 tx=0x7f0a8001c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=787098caeebdcf77 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a95600640 1 -- 172.21.15.114:0/2656816545 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88001680 con 0x7f0a980c2580 2024-02-17T12:17:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a95600640 1 -- 172.21.15.114:0/2656816545 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a800a7050 con 0x7f0a980c2580 2024-02-17T12:17:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a95600640 1 -- 172.21.15.114:0/2656816545 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a800ab620 con 0x7f0a980c2580 2024-02-17T12:17:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a9d800640 1 -- 172.21.15.114:0/2656816545 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 msgr2=0x7f0a980aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a9d800640 1 --2- 172.21.15.114:0/2656816545 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 0x7f0a980aa150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a800097c0 tx=0x7f0a8001c300 comp rx=0 tx=0).stop 2024-02-17T12:17:15.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a9d800640 1 -- 172.21.15.114:0/2656816545 shutdown_connections 2024-02-17T12:17:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a9d800640 1 --2- 172.21.15.114:0/2656816545 >> v2:172.21.15.116:3300/0 conn(0x7f0a980c1eb0 0x7f0a9815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a9d800640 1 --2- 172.21.15.114:0/2656816545 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 0x7f0a980aa150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a9d800640 1 -- 172.21.15.114:0/2656816545 >> 172.21.15.114:0/2656816545 conn(0x7f0a980a8490 msgr2=0x7f0a980a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a9d800640 1 -- 172.21.15.114:0/2656816545 shutdown_connections 2024-02-17T12:17:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.146+0000 7f0a9d800640 1 -- 172.21.15.114:0/2656816545 wait complete. 2024-02-17T12:17:15.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 Processor -- start 2024-02-17T12:17:15.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 -- start start 2024-02-17T12:17:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a980c1eb0 0x7f0a9814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 0x7f0a9813fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a9814f110 0x7f0a9813ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a98153210 con 0x7f0a980c1eb0 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980c4090 con 0x7f0a9814f110 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980c4370 con 0x7f0a980c2580 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a96a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a980c1eb0 0x7f0a9814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a96a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a980c1eb0 0x7f0a9814e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59914/0 (socket says 172.21.15.114:59914) 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a96a00640 1 -- 172.21.15.114:0/1326571049 learned_addr learned my addr 172.21.15.114:0/1326571049 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a97400640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a9814f110 0x7f0a9813ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a96000640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 0x7f0a9813fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a96a00640 1 -- 172.21.15.114:0/1326571049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 msgr2=0x7f0a9813fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a96a00640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 0x7f0a9813fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a96a00640 1 -- 172.21.15.114:0/1326571049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a9814f110 msgr2=0x7f0a9813ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a96a00640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a9814f110 0x7f0a9813ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a96a00640 1 -- 172.21.15.114:0/1326571049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a80009420 con 0x7f0a980c1eb0 2024-02-17T12:17:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a96a00640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a980c1eb0 0x7f0a9814e100 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800c750 tx=0x7f0a8800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a8ea00640 1 -- 172.21.15.114:0/1326571049 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88005ae0 con 0x7f0a980c1eb0 2024-02-17T12:17:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a8ea00640 1 -- 172.21.15.114:0/1326571049 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a88005c40 con 0x7f0a980c1eb0 2024-02-17T12:17:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 -- 172.21.15.114:0/1326571049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a980c4650 con 0x7f0a980c1eb0 2024-02-17T12:17:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a8ea00640 1 -- 172.21.15.114:0/1326571049 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88007070 con 0x7f0a980c1eb0 2024-02-17T12:17:15.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 -- 172.21.15.114:0/1326571049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a980c4c10 con 0x7f0a980c1eb0 2024-02-17T12:17:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.150+0000 7f0a9d800640 1 -- 172.21.15.114:0/1326571049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a980c4e00 con 0x7f0a980c1eb0 2024-02-17T12:17:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.154+0000 7f0a8ea00640 1 -- 172.21.15.114:0/1326571049 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0a880071d0 con 0x7f0a980c1eb0 2024-02-17T12:17:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.154+0000 7f0a8ea00640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a74066e40 0x7f0a74069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.154+0000 7f0a8ea00640 1 -- 172.21.15.114:0/1326571049 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a88084760 con 0x7f0a980c1eb0 2024-02-17T12:17:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.154+0000 7f0a96000640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a74066e40 0x7f0a74069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.154+0000 7f0a96000640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a74066e40 0x7f0a74069300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0a800ad000 tx=0x7f0a800a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:15.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.158+0000 7f0a8ea00640 1 -- 172.21.15.114:0/1326571049 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0a880515f0 con 0x7f0a980c1eb0 2024-02-17T12:17:15.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.370+0000 7f0a9d800640 1 -- 172.21.15.114:0/1326571049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0a98074840 con 0x7f0a980c1eb0 2024-02-17T12:17:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a8ea00640 1 -- 172.21.15.114:0/1326571049 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0a88054cb0 con 0x7f0a980c1eb0 2024-02-17T12:17:15.380 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-02-17T12:17:15.380 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlaXt+FxAAn4YhbPPnUC6y0giRDPuYyQ== 2024-02-17T12:17:15.381 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-02-17T12:17:15.381 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-02-17T12:17:15.381 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-02-17T12:17:15.381 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 -- 172.21.15.114:0/1326571049 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a74066e40 msgr2=0x7f0a74069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a74066e40 0x7f0a74069300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0a800ad000 tx=0x7f0a800a6000 comp rx=0 tx=0).stop 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 -- 172.21.15.114:0/1326571049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a980c1eb0 msgr2=0x7f0a9814e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a980c1eb0 0x7f0a9814e100 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800c750 tx=0x7f0a8800cc10 comp rx=0 tx=0).stop 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 -- 172.21.15.114:0/1326571049 shutdown_connections 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a9814f110 0x7f0a9813ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a980c2580 0x7f0a9813fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a74066e40 0x7f0a74069300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 --2- 172.21.15.114:0/1326571049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a980c1eb0 0x7f0a9814e100 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 -- 172.21.15.114:0/1326571049 >> 172.21.15.114:0/1326571049 conn(0x7f0a980a8490 msgr2=0x7f0a98151b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 -- 172.21.15.114:0/1326571049 shutdown_connections 2024-02-17T12:17:15.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.374+0000 7f0a9d800640 1 -- 172.21.15.114:0/1326571049 wait complete. 2024-02-17T12:17:15.402 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:15.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f36a0a00640 1 Processor -- start 2024-02-17T12:17:15.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f36a0a00640 1 -- start start 2024-02-17T12:17:15.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f36a0a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f369c06db50 0x7f369c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f36a0a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c156270 con 0x7f369c0c25a0 2024-02-17T12:17:15.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f36a0a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c156550 con 0x7f369c150490 2024-02-17T12:17:15.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f36a0a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369c06f090 con 0x7f369c06db50 2024-02-17T12:17:15.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f369c0c25a0 0x7f369c06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55434/0 (socket says 172.21.15.114:55434) 2024-02-17T12:17:15.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699e00640 1 -- 172.21.15.114:0/517208485 learned_addr learned my addr 172.21.15.114:0/517208485 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:15.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381395371 0 0) 0x7f369c156270 con 0x7f369c0c25a0 2024-02-17T12:17:15.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3680003530 con 0x7f369c0c25a0 2024-02-17T12:17:15.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3691400640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f369c06db50 0x7f369c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1247867000 0 0) 0x7f3680003530 con 0x7f369c0c25a0 2024-02-17T12:17:15.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f369c06db50 msgr2=0x7f369c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:15.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f369c06db50 0x7f369c14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 >> v1:172.21.15.116:6789/0 conn(0x7f369c150490 legacy=0x7f369c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c156830 con 0x7f369c0c25a0 2024-02-17T12:17:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f368c001a00 con 0x7f369c0c25a0 2024-02-17T12:17:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 >> v1:172.21.15.114:6789/0 conn(0x7f369c0c25a0 legacy=0x7f369c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f369c06db50 0x7f36800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3680003f80 0x7f36800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3680004d10 0x7f3680005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c06f090 con 0x7f3680004d10 2024-02-17T12:17:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368000bc20 con 0x7f3680003f80 2024-02-17T12:17:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368000bde0 con 0x7f369c06db50 2024-02-17T12:17:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f369a800640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3680004d10 0x7f3680005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3691400640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3680003f80 0x7f36800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.530+0000 7f3699e00640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f369c06db50 0x7f36800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f369a800640 1 -- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f369c06db50 msgr2=0x7f36800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f369a800640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f369c06db50 0x7f36800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f369a800640 1 -- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3680003f80 msgr2=0x7f36800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f369a800640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3680003f80 0x7f36800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f369a800640 1 -- 172.21.15.114:0/517208485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680003530 con 0x7f3680004d10 2024-02-17T12:17:15.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f369a800640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3680004d10 0x7f3680005170 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3694001780 tx=0x7f369401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c13401557736c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:15.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940052d0 con 0x7f3680004d10 2024-02-17T12:17:15.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36940a7050 con 0x7f3680004d10 2024-02-17T12:17:15.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f3699400640 1 -- 172.21.15.114:0/517208485 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694003600 con 0x7f3680004d10 2024-02-17T12:17:15.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f36a0a00640 1 -- 172.21.15.114:0/517208485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3680004d10 msgr2=0x7f3680005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f36a0a00640 1 --2- 172.21.15.114:0/517208485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3680004d10 0x7f3680005170 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3694001780 tx=0x7f369401c420 comp rx=0 tx=0).stop 2024-02-17T12:17:15.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.534+0000 7f369a800640 1 -- 172.21.15.114:0/517208485 reap_dead start 2024-02-17T12:17:15.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 -- 172.21.15.114:0/517208485 shutdown_connections 2024-02-17T12:17:15.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 -- 172.21.15.114:0/517208485 >> 172.21.15.114:0/517208485 conn(0x7f369c0a8490 msgr2=0x7f369c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:15.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 -- 172.21.15.114:0/517208485 shutdown_connections 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 -- 172.21.15.114:0/517208485 wait complete. 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 Processor -- start 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 -- start start 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3680004d10 0x7f369c1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f369c15d4b0 0x7f369c157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c151da0 0x7f369c1eec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c15d910 con 0x7f369c151da0 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c158120 con 0x7f369c15d4b0 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369c158d90 con 0x7f3680004d10 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f369a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c151da0 0x7f369c1eec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f369a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c151da0 0x7f369c1eec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59940/0 (socket says 172.21.15.114:59940) 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f369a800640 1 -- 172.21.15.114:0/943216419 learned_addr learned my addr 172.21.15.114:0/943216419 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f3691400640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f369c15d4b0 0x7f369c157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f3699e00640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3680004d10 0x7f369c1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f369a800640 1 -- 172.21.15.114:0/943216419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3680004d10 msgr2=0x7f369c1587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f369a800640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3680004d10 0x7f369c1587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f369a800640 1 -- 172.21.15.114:0/943216419 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f369c15d4b0 msgr2=0x7f369c157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f369a800640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f369c15d4b0 0x7f369c157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f369a800640 1 -- 172.21.15.114:0/943216419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c15c9d0 con 0x7f369c151da0 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f369a800640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c151da0 0x7f369c1eec90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3694001780 tx=0x7f3680005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f3692a00640 1 -- 172.21.15.114:0/943216419 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694007a40 con 0x7f369c151da0 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f3692a00640 1 -- 172.21.15.114:0/943216419 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694007040 con 0x7f369c151da0 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f3692a00640 1 -- 172.21.15.114:0/943216419 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940073b0 con 0x7f369c151da0 2024-02-17T12:17:15.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.538+0000 7f36a0a00640 1 -- 172.21.15.114:0/943216419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c15ccb0 con 0x7f369c151da0 2024-02-17T12:17:15.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.542+0000 7f36a0a00640 1 -- 172.21.15.114:0/943216419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c159070 con 0x7f369c151da0 2024-02-17T12:17:15.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.542+0000 7f36a0a00640 1 -- 172.21.15.114:0/943216419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369c074840 con 0x7f369c151da0 2024-02-17T12:17:15.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.542+0000 7f3692a00640 1 -- 172.21.15.114:0/943216419 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3694007510 con 0x7f369c151da0 2024-02-17T12:17:15.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.542+0000 7f3692a00640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3678066e40 0x7f3678069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:15.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.542+0000 7f3692a00640 1 -- 172.21.15.114:0/943216419 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f369411dbc0 con 0x7f369c151da0 2024-02-17T12:17:15.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.542+0000 7f3699e00640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3678066e40 0x7f3678069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:15.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.542+0000 7f3699e00640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3678066e40 0x7f3678069300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f368c000f90 tx=0x7f368c006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:15.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.546+0000 7f3692a00640 1 -- 172.21.15.114:0/943216419 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f36940ea9a0 con 0x7f369c151da0 2024-02-17T12:17:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.730+0000 7f36a0a00640 1 -- 172.21.15.114:0/943216419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f369c15d160 con 0x7f369c151da0 2024-02-17T12:17:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.730+0000 7f3692a00640 1 -- 172.21.15.114:0/943216419 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f36940bb020 con 0x7f369c151da0 2024-02-17T12:17:15.738 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:15.739 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4941,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2833741536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2833741536},{"type":"v1","addr":"172.21.15.114:6836","nonce":2833741536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:05.397716+0000","modified":"2024-02-17T12:17:08.427075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1473468479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1473468479},{"type":"v1","addr":"172.21.15.114:6837","nonce":1473468479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-17T12:17:15.739 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 17 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 -- 172.21.15.114:0/943216419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3678066e40 msgr2=0x7f3678069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3678066e40 0x7f3678069300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f368c000f90 tx=0x7f368c006040 comp rx=0 tx=0).stop 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 -- 172.21.15.114:0/943216419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c151da0 msgr2=0x7f369c1eec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c151da0 0x7f369c1eec90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3694001780 tx=0x7f3680005800 comp rx=0 tx=0).stop 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 -- 172.21.15.114:0/943216419 shutdown_connections 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3678066e40 0x7f3678069300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369c151da0 0x7f369c1eec90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f369c15d4b0 0x7f369c157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 --2- 172.21.15.114:0/943216419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3680004d10 0x7f369c1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 -- 172.21.15.114:0/943216419 >> 172.21.15.114:0/943216419 conn(0x7f369c0a8490 msgr2=0x7f369c0c1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 -- 172.21.15.114:0/943216419 shutdown_connections 2024-02-17T12:17:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:15.734+0000 7f36a0a00640 1 -- 172.21.15.114:0/943216419 wait complete. 2024-02-17T12:17:16.162 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T12:17:05.397716+0000', 'modified': '2024-02-17T12:17:08.427075+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4947}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4947': {'gid': 4947, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6837/1473468479', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 1473468479}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 1473468479}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-17T12:17:16.162 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-17T12:17:16.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-02-17T12:17:16.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.294+0000 7f6481c00640 1 Processor -- start 2024-02-17T12:17:16.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.294+0000 7f6481c00640 1 -- start start 2024-02-17T12:17:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6481c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14f110 0x7f647c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6481c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c0a9420 con 0x7f647c0c1eb0 2024-02-17T12:17:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6481c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c152850 con 0x7f647c0c2580 2024-02-17T12:17:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6481c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c14f4f0 con 0x7f647c14f110 2024-02-17T12:17:16.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f647c0c1eb0 0x7f647c15c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55436/0 (socket says 172.21.15.114:55436) 2024-02-17T12:17:16.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647b400640 1 -- 172.21.15.114:0/1937649232 learned_addr learned my addr 172.21.15.114:0/1937649232 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647aa00640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14f110 0x7f647c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868292164 0 0) 0x7f647c0a9420 con 0x7f647c0c1eb0 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6460003530 con 0x7f647c0c1eb0 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551429201 0 0) 0x7f647c152850 con 0x7f647c0c2580 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f647c0a9420 con 0x7f647c0c2580 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641688925 0 0) 0x7f6460003530 con 0x7f647c0c1eb0 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14f110 msgr2=0x7f647c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14f110 0x7f647c0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 >> v1:172.21.15.116:6789/0 conn(0x7f647c0c2580 legacy=0x7f647c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c0a9670 con 0x7f647c0c1eb0 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f6474001a00 con 0x7f647c0c1eb0 2024-02-17T12:17:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647aa00640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14f110 0x7f647c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 >> v1:172.21.15.114:6789/0 conn(0x7f647c0c1eb0 legacy=0x7f647c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14f110 0x7f6460003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64600040d0 0x7f64600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6460004d10 0x7f6460005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c14f4f0 con 0x7f6460004d10 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646000bb50 con 0x7f64600040d0 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646000bd10 con 0x7f647c14f110 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647b400640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6460004d10 0x7f6460005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647aa00640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14f110 0x7f6460003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647a000640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64600040d0 0x7f64600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647b400640 1 -- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14f110 msgr2=0x7f6460003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647b400640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14f110 0x7f6460003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647b400640 1 -- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64600040d0 msgr2=0x7f64600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647b400640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64600040d0 0x7f64600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.298+0000 7f647b400640 1 -- 172.21.15.114:0/1937649232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c009420 con 0x7f6460004d10 2024-02-17T12:17:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f647b400640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6460004d10 0x7f6460005190 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f647400a6e0 tx=0x7f647401d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ff48853dea0ef7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740ad630 con 0x7f6460004d10 2024-02-17T12:17:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64740a8070 con 0x7f6460004d10 2024-02-17T12:17:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f6479600640 1 -- 172.21.15.114:0/1937649232 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740ada50 con 0x7f6460004d10 2024-02-17T12:17:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f6481c00640 1 -- 172.21.15.114:0/1937649232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6460004d10 msgr2=0x7f6460005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f6481c00640 1 --2- 172.21.15.114:0/1937649232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6460004d10 0x7f6460005190 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f647400a6e0 tx=0x7f647401d1e0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f647b400640 1 -- 172.21.15.114:0/1937649232 reap_dead start 2024-02-17T12:17:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f6481c00640 1 -- 172.21.15.114:0/1937649232 shutdown_connections 2024-02-17T12:17:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f6481c00640 1 -- 172.21.15.114:0/1937649232 >> 172.21.15.114:0/1937649232 conn(0x7f647c0a8490 msgr2=0x7f647c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f6481c00640 1 -- 172.21.15.114:0/1937649232 shutdown_connections 2024-02-17T12:17:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f6481c00640 1 -- 172.21.15.114:0/1937649232 wait complete. 2024-02-17T12:17:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.302+0000 7f6481c00640 1 Processor -- start 2024-02-17T12:17:16.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6481c00640 1 -- start start 2024-02-17T12:17:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6481c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14b600 0x7f647c14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6481c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647c1413a0 0x7f647c14a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6481c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f647c14aa50 0x7f647c1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6481c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c1539b0 con 0x7f647c1413a0 2024-02-17T12:17:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6481c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c1411e0 con 0x7f647c14aa50 2024-02-17T12:17:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6481c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c152db0 con 0x7f647c14b600 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647c1413a0 0x7f647c14a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647c1413a0 0x7f647c14a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59948/0 (socket says 172.21.15.114:59948) 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647a000640 1 -- 172.21.15.114:0/2598128662 learned_addr learned my addr 172.21.15.114:0/2598128662 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647aa00640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14b600 0x7f647c14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647b400640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f647c14aa50 0x7f647c1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647a000640 1 -- 172.21.15.114:0/2598128662 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14b600 msgr2=0x7f647c14b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647a000640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14b600 0x7f647c14b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647a000640 1 -- 172.21.15.114:0/2598128662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f647c14aa50 msgr2=0x7f647c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647a000640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f647c14aa50 0x7f647c1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647a000640 1 -- 172.21.15.114:0/2598128662 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c155d50 con 0x7f647c1413a0 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647b400640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f647c14aa50 0x7f647c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f647a000640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647c1413a0 0x7f647c14a510 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f64680079b0 tx=0x7f6468012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6472a00640 1 -- 172.21.15.114:0/2598128662 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468010bd0 con 0x7f647c1413a0 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6472a00640 1 -- 172.21.15.114:0/2598128662 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468010d50 con 0x7f647c1413a0 2024-02-17T12:17:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6472a00640 1 -- 172.21.15.114:0/2598128662 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64680166c0 con 0x7f647c1413a0 2024-02-17T12:17:16.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6481c00640 1 -- 172.21.15.114:0/2598128662 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c153000 con 0x7f647c1413a0 2024-02-17T12:17:16.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.306+0000 7f6481c00640 1 -- 172.21.15.114:0/2598128662 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c1eb5c0 con 0x7f647c1413a0 2024-02-17T12:17:16.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6472a00640 1 -- 172.21.15.114:0/2598128662 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6468016820 con 0x7f647c1413a0 2024-02-17T12:17:16.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6472a00640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f645c066e70 0x7f645c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6472a00640 1 -- 172.21.15.114:0/2598128662 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6468088350 con 0x7f647c1413a0 2024-02-17T12:17:16.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647aa00640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f645c066e70 0x7f645c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6485098000 1 Processor -- start 2024-02-17T12:17:16.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6485098000 1 -- start start 2024-02-17T12:17:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647aa00640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f645c066e70 0x7f645c069330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f647c14f930 tx=0x7f646c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6485098000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850cf36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6485098000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf3bf0 0x557850cf3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6485098000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d3d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6485098000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557850bbdd00 con 0x557850cf4510 2024-02-17T12:17:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6485098000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557850b4f430 con 0x557850cf3bf0 2024-02-17T12:17:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6485098000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x557850b4c960 con 0x557850cf32d0 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d3d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d3d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59960/0 (socket says 172.21.15.114:59960) 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647b400640 1 -- 172.21.15.114:0/1621138326 learned_addr learned my addr 172.21.15.114:0/1621138326 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647aa00640 1 --2- 172.21.15.114:0/1621138326 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850cf36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647a000640 1 --2- 172.21.15.114:0/1621138326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf3bf0 0x557850cf3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647b400640 1 -- 172.21.15.114:0/1621138326 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 msgr2=0x557850cf36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647b400640 1 --2- 172.21.15.114:0/1621138326 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850cf36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647b400640 1 -- 172.21.15.114:0/1621138326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf3bf0 msgr2=0x557850cf3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647b400640 1 --2- 172.21.15.114:0/1621138326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf3bf0 0x557850cf3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647b400640 1 -- 172.21.15.114:0/1621138326 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55785083e890 con 0x557850cf4510 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f647b400640 1 --2- 172.21.15.114:0/1621138326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d3d4b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f647400a6e0 tx=0x7f6474001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c637b941d001bcb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6467400640 1 -- 172.21.15.114:0/1621138326 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740011d0 con 0x557850cf4510 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6467400640 1 -- 172.21.15.114:0/1621138326 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64740013b0 con 0x557850cf4510 2024-02-17T12:17:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.310+0000 7f6467400640 1 -- 172.21.15.114:0/1621138326 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474001a00 con 0x557850cf4510 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- 172.21.15.114:0/1621138326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 msgr2=0x557850d3d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 --2- 172.21.15.114:0/1621138326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d3d4b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f647400a6e0 tx=0x7f6474001cc0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- 172.21.15.114:0/1621138326 shutdown_connections 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 --2- 172.21.15.114:0/1621138326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d3d4b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 --2- 172.21.15.114:0/1621138326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf3bf0 0x557850cf3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 --2- 172.21.15.114:0/1621138326 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850cf36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- 172.21.15.114:0/1621138326 >> 172.21.15.114:0/1621138326 conn(0x557850d31210 msgr2=0x557850d33600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- 172.21.15.114:0/1621138326 shutdown_connections 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- 172.21.15.114:0/1621138326 wait complete. 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- start start 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 Processor -- start 2024-02-17T12:17:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf32d0 0x557850cf92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf3bf0 0x557850cf97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850cf9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557850b48140 con 0x557850cf4510 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557850ae2630 con 0x557850cf32d0 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x557850ae22d0 con 0x557850cf3bf0 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 10 client.0 _ll_register_callbacks cb 0x557850bf81c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647a000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf3bf0 0x557850cf97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850cf9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647aa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf32d0 0x557850cf92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850cf9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59970/0 (socket says 172.21.15.114:59970) 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647a000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf3bf0 0x557850cf97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:47104/0 (socket says 172.21.15.114:47104) 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647b400640 1 -- 172.21.15.114:0/1205752597 learned_addr learned my addr 172.21.15.114:0/1205752597 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647b400640 1 -- 172.21.15.114:0/1205752597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf3bf0 msgr2=0x557850cf97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647b400640 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf3bf0 0x557850cf97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647b400640 1 -- 172.21.15.114:0/1205752597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf32d0 msgr2=0x557850cf92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647b400640 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf32d0 0x557850cf92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647b400640 1 -- 172.21.15.114:0/1205752597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64740b1040 con 0x557850cf4510 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f647b400640 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850cf9d20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f64740af040 tx=0x7f6474019f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b86c2bdcac2cd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f645be00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f645be00640 1 -- 172.21.15.114:0/1205752597 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740013b0 con 0x557850cf4510 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f645be00640 1 -- 172.21.15.114:0/1205752597 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6468001d30 con 0x557850cf4510 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- 172.21.15.114:0/1205752597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557850afb850 con 0x557850cf4510 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f645be00640 1 -- 172.21.15.114:0/1205752597 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6474001800 con 0x557850cf4510 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 10 client.5133 fetch_fsmap learned FSMap version 17 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- 172.21.15.114:0/1205752597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557850b07e70 con 0x557850cf4510 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f645be00640 1 -- 172.21.15.114:0/1205752597 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557850afb850 con 0x557850cf4510 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f645be00640 1 -- 172.21.15.114:0/1205752597 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6474001960 con 0x557850cf4510 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 10 client.5133 fetch_fsmap finished waiting for FSMap version 17 2024-02-17T12:17:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 10 client.5133 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-17T12:17:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 20 client.5133 populate_metadata read hostname 'smithi114' 2024-02-17T12:17:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.114:6835/1473468479,v1:172.21.15.114:6837/1473468479] conn(0x557850d45ce0 0x557850d480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 4 client.5133 mds_command: new command op to 4947 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T12:17:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.314+0000 7f6485098000 1 -- 172.21.15.114:0/1205752597 --> [v2:172.21.15.114:6835/1473468479,v1:172.21.15.114:6837/1473468479] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557850b44f20 con 0x557850d45ce0 2024-02-17T12:17:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f647aa00640 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.114:6835/1473468479,v1:172.21.15.114:6837/1473468479] conn(0x557850d45ce0 0x557850d480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f647aa00640 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.114:6835/1473468479,v1:172.21.15.114:6837/1473468479] conn(0x557850d45ce0 0x557850d480d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=626aab84089bcd5a server_cookie=53f6069aaa8054e1 in_seq=0 out_seq=0 2024-02-17T12:17:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f645be00640 10 client.5133 ms_handle_connect on v2:172.21.15.114:6835/1473468479 2024-02-17T12:17:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f645be00640 1 -- 172.21.15.114:0/1205752597 <== mds.0 v2:172.21.15.114:6835/1473468479 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557850b44f20 con 0x557850d45ce0 2024-02-17T12:17:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f645be00640 10 client.5133 handle_command_reply: tid=0 2024-02-17T12:17:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 client.5133 shutdown 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 -- 172.21.15.114:0/1205752597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 msgr2=0x557850cf9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850cf9d20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f64740af040 tx=0x7f6474019f80 comp rx=0 tx=0).stop 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 -- 172.21.15.114:0/1205752597 shutdown_connections 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.114:6835/1473468479,v1:172.21.15.114:6837/1473468479] conn(0x557850d45ce0 0x557850d480d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850cf9d20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf3bf0 0x557850cf97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 --2- 172.21.15.114:0/1205752597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf32d0 0x557850cf92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f645be00640 0 client.5133 ms_handle_reset on v2:172.21.15.114:6835/1473468479 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 -- 172.21.15.114:0/1205752597 >> 172.21.15.114:0/1205752597 conn(0x557850d31210 msgr2=0x557850cf29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 -- 172.21.15.114:0/1205752597 shutdown_connections 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 1 -- 172.21.15.114:0/1205752597 wait complete. 2024-02-17T12:17:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.318+0000 7f6485098000 20 client.5133 trim_cache size 0 max 16384 2024-02-17T12:17:16.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 Processor -- start 2024-02-17T12:17:16.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 -- start start 2024-02-17T12:17:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850d480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf3bf0 0x557850d48610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf4510 0x557850d48b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578507ff940 con 0x557850cf3bf0 2024-02-17T12:17:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557850b45540 con 0x557850cf4510 2024-02-17T12:17:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x557850b4aca0 con 0x557850cf32d0 2024-02-17T12:17:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf3bf0 0x557850d48610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf3bf0 0x557850d48610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59976/0 (socket says 172.21.15.114:59976) 2024-02-17T12:17:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647a000640 1 -- 172.21.15.114:0/1547935991 learned_addr learned my addr 172.21.15.114:0/1547935991 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647b400640 1 --2- 172.21.15.114:0/1547935991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf4510 0x557850d48b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647aa00640 1 --2- 172.21.15.114:0/1547935991 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850d480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647a000640 1 -- 172.21.15.114:0/1547935991 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 msgr2=0x557850d480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647a000640 1 --2- 172.21.15.114:0/1547935991 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850d480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647a000640 1 -- 172.21.15.114:0/1547935991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf4510 msgr2=0x557850d48b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647a000640 1 --2- 172.21.15.114:0/1547935991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf4510 0x557850d48b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647a000640 1 -- 172.21.15.114:0/1547935991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557850d33e90 con 0x557850cf3bf0 2024-02-17T12:17:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f647a000640 1 --2- 172.21.15.114:0/1547935991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf3bf0 0x557850d48610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f64680105b0 tx=0x7f6468007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae94d680a0cc82e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6466a00640 1 -- 172.21.15.114:0/1547935991 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468058e90 con 0x557850cf3bf0 2024-02-17T12:17:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6466a00640 1 -- 172.21.15.114:0/1547935991 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646805cfe0 con 0x557850cf3bf0 2024-02-17T12:17:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6466a00640 1 -- 172.21.15.114:0/1547935991 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64680615a0 con 0x557850cf3bf0 2024-02-17T12:17:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 -- 172.21.15.114:0/1547935991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf3bf0 msgr2=0x557850d48610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 --2- 172.21.15.114:0/1547935991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf3bf0 0x557850d48610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f64680105b0 tx=0x7f6468007cd0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 -- 172.21.15.114:0/1547935991 shutdown_connections 2024-02-17T12:17:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 --2- 172.21.15.114:0/1547935991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf4510 0x557850d48b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 --2- 172.21.15.114:0/1547935991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf3bf0 0x557850d48610 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 --2- 172.21.15.114:0/1547935991 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850d480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 -- 172.21.15.114:0/1547935991 >> 172.21.15.114:0/1547935991 conn(0x557850d31210 msgr2=0x557850cf82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 -- 172.21.15.114:0/1547935991 shutdown_connections 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.334+0000 7f6485098000 1 -- 172.21.15.114:0/1547935991 wait complete. 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 -- start start 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 Processor -- start 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850d97570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf3bf0 0x557850d5b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d5b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x557850b4c140 con 0x557850cf4510 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557850ced750 con 0x557850cf3bf0 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x557850b3bec0 con 0x557850cf32d0 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 10 client.0 _ll_register_callbacks cb 0x557850af1010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d5b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d5b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:59988/0 (socket says 172.21.15.114:59988) 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647b400640 1 -- 172.21.15.114:0/1515334067 learned_addr learned my addr 172.21.15.114:0/1515334067 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647a000640 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf3bf0 0x557850d5b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647aa00640 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850d97570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647b400640 1 -- 172.21.15.114:0/1515334067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 msgr2=0x557850d97570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647b400640 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850d97570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647b400640 1 -- 172.21.15.114:0/1515334067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf3bf0 msgr2=0x557850d5b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647b400640 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf3bf0 0x557850d5b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647b400640 1 -- 172.21.15.114:0/1515334067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c1eb5c0 con 0x557850cf4510 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647b400640 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d5b580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6474002240 tx=0x7f64740a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3c88ddf989d9d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f645be00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f645be00640 1 -- 172.21.15.114:0/1515334067 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740011d0 con 0x557850cf4510 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f645be00640 1 -- 172.21.15.114:0/1515334067 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6474001800 con 0x557850cf4510 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 -- 172.21.15.114:0/1515334067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557850acde80 con 0x557850cf4510 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f645be00640 1 -- 172.21.15.114:0/1515334067 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64740019c0 con 0x557850cf4510 2024-02-17T12:17:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 10 client.5139 fetch_fsmap learned FSMap version 17 2024-02-17T12:17:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 -- 172.21.15.114:0/1515334067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557850aede10 con 0x557850cf4510 2024-02-17T12:17:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f645be00640 1 -- 172.21.15.114:0/1515334067 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557850acde80 con 0x557850cf4510 2024-02-17T12:17:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f645be00640 1 -- 172.21.15.114:0/1515334067 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f64740b7a50 con 0x557850cf4510 2024-02-17T12:17:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 10 client.5139 fetch_fsmap finished waiting for FSMap version 17 2024-02-17T12:17:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 10 client.5139 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-17T12:17:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 20 client.5139 populate_metadata read hostname 'smithi114' 2024-02-17T12:17:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.114:6835/1473468479,v1:172.21.15.114:6837/1473468479] conn(0x557850d5bac0 0x557850d5bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 4 client.5139 mds_command: new command op to 4947 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T12:17:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f6485098000 1 -- 172.21.15.114:0/1515334067 --> [v2:172.21.15.114:6835/1473468479,v1:172.21.15.114:6837/1473468479] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557850b10fa0 con 0x557850d5bac0 2024-02-17T12:17:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647aa00640 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.114:6835/1473468479,v1:172.21.15.114:6837/1473468479] conn(0x557850d5bac0 0x557850d5bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f647aa00640 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.114:6835/1473468479,v1:172.21.15.114:6837/1473468479] conn(0x557850d5bac0 0x557850d5bea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef2c7d07e6db03c8 server_cookie=a14d40b7a8754e30 in_seq=0 out_seq=0 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.338+0000 7f645be00640 10 client.5139 ms_handle_connect on v2:172.21.15.114:6835/1473468479 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f645be00640 1 -- 172.21.15.114:0/1515334067 <== mds.0 v2:172.21.15.114:6835/1473468479 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557850b10fa0 con 0x557850d5bac0 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f645be00640 10 client.5139 handle_command_reply: tid=0 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 client.5139 shutdown 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 -- 172.21.15.114:0/1515334067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 msgr2=0x557850d5b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d5b580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6474002240 tx=0x7f64740a7000 comp rx=0 tx=0).stop 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 -- 172.21.15.114:0/1515334067 shutdown_connections 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.114:6835/1473468479,v1:172.21.15.114:6837/1473468479] conn(0x557850d5bac0 0x557850d5bea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x557850cf4510 0x557850d5b580 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557850cf3bf0 0x557850d5b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f645be00640 0 client.5139 ms_handle_reset on v2:172.21.15.114:6835/1473468479 2024-02-17T12:17:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 --2- 172.21.15.114:0/1515334067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x557850cf32d0 0x557850d97570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 -- 172.21.15.114:0/1515334067 >> 172.21.15.114:0/1515334067 conn(0x557850d31210 msgr2=0x557850cf7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 -- 172.21.15.114:0/1515334067 shutdown_connections 2024-02-17T12:17:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 1 -- 172.21.15.114:0/1515334067 wait complete. 2024-02-17T12:17:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6485098000 20 client.5139 trim_cache size 0 max 16384 2024-02-17T12:17:16.352 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:17:16.352 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "718e3165-e11b-4138-adc9-584dcfeb6e24", 2024-02-17T12:17:16.352 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-02-17T12:17:16.352 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4947, 2024-02-17T12:17:16.352 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-02-17T12:17:16.352 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-02-17T12:17:16.353 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-02-17T12:17:16.353 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.302090228000001, 2024-02-17T12:17:16.353 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 17, 2024-02-17T12:17:16.353 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 32, 2024-02-17T12:17:16.353 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 32, 2024-02-17T12:17:16.353 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 17.351903174 2024-02-17T12:17:16.353 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:17:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 -- 172.21.15.114:0/2598128662 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f645c066e70 msgr2=0x7f645c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f645c066e70 0x7f645c069330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f647c14f930 tx=0x7f646c009190 comp rx=0 tx=0).stop 2024-02-17T12:17:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 -- 172.21.15.114:0/2598128662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647c1413a0 msgr2=0x7f647c14a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647c1413a0 0x7f647c14a510 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f64680079b0 tx=0x7f6468012d20 comp rx=0 tx=0).stop 2024-02-17T12:17:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 -- 172.21.15.114:0/2598128662 shutdown_connections 2024-02-17T12:17:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f647c14aa50 0x7f647c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f645c066e70 0x7f645c069330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647c1413a0 0x7f647c14a510 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 --2- 172.21.15.114:0/2598128662 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f647c14b600 0x7f647c14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 -- 172.21.15.114:0/2598128662 >> 172.21.15.114:0/2598128662 conn(0x7f647c0a8490 msgr2=0x7f647c06dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 -- 172.21.15.114:0/2598128662 shutdown_connections 2024-02-17T12:17:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.342+0000 7f6481c00640 1 -- 172.21.15.114:0/2598128662 wait complete. 2024-02-17T12:17:16.367 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:17:16.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.494+0000 7fb8a2400640 1 Processor -- start 2024-02-17T12:17:16.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.494+0000 7fb8a2400640 1 -- start start 2024-02-17T12:17:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb8a2400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb89c0c2580 0x7fb89c0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb8a2400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb89c0c1eb0 0x7fb89c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb8a2400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89c0a9420 con 0x7fb89c14f110 2024-02-17T12:17:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb8a2400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c14f4f0 con 0x7fb89c0c2580 2024-02-17T12:17:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb8a2400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c0aae80 con 0x7fb89c0c1eb0 2024-02-17T12:17:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb89aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb89c0c2580 0x7fb89c0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb89aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb89c0c2580 0x7fb89c0aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60000/0 (socket says 172.21.15.114:60000) 2024-02-17T12:17:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb89aa00640 1 -- 172.21.15.114:0/2302176800 learned_addr learned my addr 172.21.15.114:0/2302176800 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb89be00640 1 --2- 172.21.15.114:0/2302176800 >> v2:172.21.15.116:3300/0 conn(0x7fb89c0c1eb0 0x7fb89c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb89aa00640 1 -- 172.21.15.114:0/2302176800 >> v2:172.21.15.116:3300/0 conn(0x7fb89c0c1eb0 msgr2=0x7fb89c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb89aa00640 1 --2- 172.21.15.114:0/2302176800 >> v2:172.21.15.116:3300/0 conn(0x7fb89c0c1eb0 0x7fb89c15c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb89aa00640 1 -- 172.21.15.114:0/2302176800 >> v1:172.21.15.116:6789/0 conn(0x7fb89c14f110 legacy=0x7fb89c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb89aa00640 1 -- 172.21.15.114:0/2302176800 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c152850 con 0x7fb89c0c2580 2024-02-17T12:17:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.498+0000 7fb89be00640 1 --2- 172.21.15.114:0/2302176800 >> v2:172.21.15.116:3300/0 conn(0x7fb89c0c1eb0 0x7fb89c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:16.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb89aa00640 1 --2- 172.21.15.114:0/2302176800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c0c2580 0x7fb89c0aa150 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb89c06ceb0 tx=0x7fb88801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e103d064fec1a524 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:16.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb89a000640 1 -- 172.21.15.114:0/2302176800 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8880ab660 con 0x7fb89c0c2580 2024-02-17T12:17:16.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb89a000640 1 -- 172.21.15.114:0/2302176800 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8880ab7c0 con 0x7fb89c0c2580 2024-02-17T12:17:16.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb89a000640 1 -- 172.21.15.114:0/2302176800 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8880abb50 con 0x7fb89c0c2580 2024-02-17T12:17:16.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 -- 172.21.15.114:0/2302176800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c0c2580 msgr2=0x7fb89c0aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 --2- 172.21.15.114:0/2302176800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c0c2580 0x7fb89c0aa150 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb89c06ceb0 tx=0x7fb88801c460 comp rx=0 tx=0).stop 2024-02-17T12:17:16.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 -- 172.21.15.114:0/2302176800 shutdown_connections 2024-02-17T12:17:16.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 --2- 172.21.15.114:0/2302176800 >> v2:172.21.15.116:3300/0 conn(0x7fb89c0c1eb0 0x7fb89c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 --2- 172.21.15.114:0/2302176800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c0c2580 0x7fb89c0aa150 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 -- 172.21.15.114:0/2302176800 >> 172.21.15.114:0/2302176800 conn(0x7fb89c0a8490 msgr2=0x7fb89c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:16.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 -- 172.21.15.114:0/2302176800 shutdown_connections 2024-02-17T12:17:16.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 -- 172.21.15.114:0/2302176800 wait complete. 2024-02-17T12:17:16.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 Processor -- start 2024-02-17T12:17:16.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 -- start start 2024-02-17T12:17:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb89c0c1eb0 0x7fb89c0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb89c0c2580 0x7fb89c145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c14f110 0x7fb89c13ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c140b50 con 0x7fb89c14f110 2024-02-17T12:17:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c1416d0 con 0x7fb89c0c1eb0 2024-02-17T12:17:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb8a2400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c14de00 con 0x7fb89c0c2580 2024-02-17T12:17:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb89be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c14f110 0x7fb89c13ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb89be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c14f110 0x7fb89c13ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60016/0 (socket says 172.21.15.114:60016) 2024-02-17T12:17:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb89be00640 1 -- 172.21.15.114:0/88084110 learned_addr learned my addr 172.21.15.114:0/88084110 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb89aa00640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb89c0c2580 0x7fb89c145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.502+0000 7fb89b400640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb89c0c1eb0 0x7fb89c0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb89be00640 1 -- 172.21.15.114:0/88084110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb89c0c2580 msgr2=0x7fb89c145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb89be00640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb89c0c2580 0x7fb89c145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb89be00640 1 -- 172.21.15.114:0/88084110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb89c0c1eb0 msgr2=0x7fb89c0c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb89be00640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb89c0c1eb0 0x7fb89c0c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb89be00640 1 -- 172.21.15.114:0/88084110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8880094d0 con 0x7fb89c14f110 2024-02-17T12:17:16.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb89be00640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c14f110 0x7fb89c13ebc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb894007f20 tx=0x7fb89400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:16.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb893400640 1 -- 172.21.15.114:0/88084110 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400dee0 con 0x7fb89c14f110 2024-02-17T12:17:16.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb893400640 1 -- 172.21.15.114:0/88084110 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89400f040 con 0x7fb89c14f110 2024-02-17T12:17:16.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb8a2400640 1 -- 172.21.15.114:0/88084110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89c140da0 con 0x7fb89c14f110 2024-02-17T12:17:16.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb893400640 1 -- 172.21.15.114:0/88084110 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894003de0 con 0x7fb89c14f110 2024-02-17T12:17:16.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb8a2400640 1 -- 172.21.15.114:0/88084110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c141360 con 0x7fb89c14f110 2024-02-17T12:17:16.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb8a2400640 1 -- 172.21.15.114:0/88084110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89c141810 con 0x7fb89c14f110 2024-02-17T12:17:16.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb893400640 1 -- 172.21.15.114:0/88084110 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb894004030 con 0x7fb89c14f110 2024-02-17T12:17:16.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb893400640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb87c066e40 0x7fb87c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:16.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb893400640 1 -- 172.21.15.114:0/88084110 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb894084d40 con 0x7fb89c14f110 2024-02-17T12:17:16.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.506+0000 7fb89b400640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb87c066e40 0x7fb87c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:16.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.510+0000 7fb89b400640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb87c066e40 0x7fb87c069300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0015b0 tx=0x7fb88c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:16.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.510+0000 7fb893400640 1 -- 172.21.15.114:0/88084110 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb894051bd0 con 0x7fb89c14f110 2024-02-17T12:17:16.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.698+0000 7fb8a2400640 1 -- 172.21.15.114:0/88084110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb89c074840 con 0x7fb89c14f110 2024-02-17T12:17:16.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.698+0000 7fb893400640 1 -- 172.21.15.114:0/88084110 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb89401a070 con 0x7fb89c14f110 2024-02-17T12:17:16.705 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:17:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.698+0000 7fb8a2400640 1 -- 172.21.15.114:0/88084110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb87c066e40 msgr2=0x7fb87c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb87c066e40 0x7fb87c069300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0015b0 tx=0x7fb88c009040 comp rx=0 tx=0).stop 2024-02-17T12:17:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 -- 172.21.15.114:0/88084110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c14f110 msgr2=0x7fb89c13ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c14f110 0x7fb89c13ebc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb894007f20 tx=0x7fb89400d560 comp rx=0 tx=0).stop 2024-02-17T12:17:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 -- 172.21.15.114:0/88084110 shutdown_connections 2024-02-17T12:17:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb87c066e40 0x7fb87c069300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb89c14f110 0x7fb89c13ebc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb89c0c2580 0x7fb89c145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 --2- 172.21.15.114:0/88084110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb89c0c1eb0 0x7fb89c0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 -- 172.21.15.114:0/88084110 >> 172.21.15.114:0/88084110 conn(0x7fb89c0a8490 msgr2=0x7fb89c0bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 -- 172.21.15.114:0/88084110 shutdown_connections 2024-02-17T12:17:16.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:16.702+0000 7fb8a2400640 1 -- 172.21.15.114:0/88084110 wait complete. 2024-02-17T12:17:16.726 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T12:17:16.726 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:17:16.726 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-02-17T12:17:16.726 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-17T12:17:16.726 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:17:16.726 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T12:17:16.727 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:17:16.727 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:17:16.727 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:17:16.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:16.727 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-02-17T12:17:16.736 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:17:16.736 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:17:16.736 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:17:16.737 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42449sec preferred_lft 42449sec 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:a0:c1:dc:19 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:17:16.738 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:16.739 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:17:16.739 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:17:16.739 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:17:16.739 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:16.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:16.739 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:17:16.795 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-02-17T12:17:16.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:16.798 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-02-17T12:17:16.849 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-02-17T12:17:16.849 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:17:16.849 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:17:16.849 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:17:16.849 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:17:16.849 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:17:16.849 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:16.849 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:16.849 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:16.849 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:17:16.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:16.850 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:17:16.850 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:17:16.850 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:17:16.850 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:17:16.850 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:17:16.850 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:17:16.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:16.941 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-02-17T12:17:16.990 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T12:17:16.991 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:17:16.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:16.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-02-17T12:17:17.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:17:17.054 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T12:17:17.102 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:17:17.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:17:17.102 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:17:17.149 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:17:17.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:17.150 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:17:17.239 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:17:17.239 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:17:17.239 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:17:17.253 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:17:17.253 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:17:17.253 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:17:17.253 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:17:17.254 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:17:17.263 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:17:17.263 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:17:17.263 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:17:17.263 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:17:17.263 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:17:17.263 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:17:17.263 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:17:17.263 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:17:17.267 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:17:17.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:17.268 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:17:17.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:17.288 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:17:17.350 INFO:teuthology.orchestra.run.smithi114.stdout:client4844 2024-02-17T12:17:17.350 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:17:17.350 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:17.398 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:17:17.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ecca00640 1 Processor -- start 2024-02-17T12:17:17.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ecca00640 1 -- start start 2024-02-17T12:17:17.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ecca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ec80c2580 0x7f6ec80aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:17.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ecca00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6ec80c1eb0 0x7f6ec815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:17.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ecca00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec80a9420 con 0x7f6ec814f110 2024-02-17T12:17:17.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ecca00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec814f4f0 con 0x7f6ec80c1eb0 2024-02-17T12:17:17.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ecca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80aae80 con 0x7f6ec80c2580 2024-02-17T12:17:17.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6ec814f110 0x7f6ec80c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55442/0 (socket says 172.21.15.114:55442) 2024-02-17T12:17:17.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5e00640 1 -- 172.21.15.114:0/2396926980 learned_addr learned my addr 172.21.15.114:0/2396926980 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:17.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec6800640 1 --2- 172.21.15.114:0/2396926980 >> v2:172.21.15.116:3300/0 conn(0x7f6ec80c1eb0 0x7f6ec815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:17.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ebfe00640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ec80c2580 0x7f6ec80aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334511915 0 0) 0x7f6ec80a9420 con 0x7f6ec814f110 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eac003530 con 0x7f6ec814f110 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3488778735 0 0) 0x7f6eac003530 con 0x7f6ec814f110 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ec80c2580 msgr2=0x7f6ec80aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ec80c2580 0x7f6ec80aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 >> v2:172.21.15.116:3300/0 conn(0x7f6ec80c1eb0 msgr2=0x7f6ec815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 --2- 172.21.15.114:0/2396926980 >> v2:172.21.15.116:3300/0 conn(0x7f6ec80c1eb0 0x7f6ec815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8152850 con 0x7f6ec814f110 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f6eb8001680 con 0x7f6ec814f110 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 >> v1:172.21.15.114:6789/0 conn(0x7f6ec814f110 legacy=0x7f6ec80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6eac003980 0x7f6eac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6eac0047d0 0x7f6eac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ec80c2580 0x7f6eac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:17.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec814f4f0 con 0x7f6eac003980 2024-02-17T12:17:17.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80aae80 con 0x7f6eac0047d0 2024-02-17T12:17:17.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac00b990 con 0x7f6ec80c2580 2024-02-17T12:17:17.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5e00640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6eac003980 0x7f6eac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:17.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ebfe00640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6eac0047d0 0x7f6eac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:17.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec6800640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ec80c2580 0x7f6eac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:17.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5e00640 1 -- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ec80c2580 msgr2=0x7f6eac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:17.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5e00640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6ec80c2580 0x7f6eac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:17.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5e00640 1 -- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6eac0047d0 msgr2=0x7f6eac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:17.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5e00640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6eac0047d0 0x7f6eac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:17.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.566+0000 7f6ec5e00640 1 -- 172.21.15.114:0/2396926980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac003530 con 0x7f6eac003980 2024-02-17T12:17:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ec5e00640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6eac003980 0x7f6eac003da0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c270 tx=0x7f6eb801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ff79e8ab3ddfcf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80058e0 con 0x7f6eac003980 2024-02-17T12:17:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8005a40 con 0x7f6eac003980 2024-02-17T12:17:17.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ec5400640 1 -- 172.21.15.114:0/2396926980 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8005e10 con 0x7f6eac003980 2024-02-17T12:17:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ecca00640 1 -- 172.21.15.114:0/2396926980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6eac003980 msgr2=0x7f6eac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ecca00640 1 --2- 172.21.15.114:0/2396926980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6eac003980 0x7f6eac003da0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c270 tx=0x7f6eb801cc50 comp rx=0 tx=0).stop 2024-02-17T12:17:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ec6800640 1 -- 172.21.15.114:0/2396926980 reap_dead start 2024-02-17T12:17:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ecca00640 1 -- 172.21.15.114:0/2396926980 shutdown_connections 2024-02-17T12:17:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ecca00640 1 -- 172.21.15.114:0/2396926980 >> 172.21.15.114:0/2396926980 conn(0x7f6ec80a8490 msgr2=0x7f6ec80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ecca00640 1 -- 172.21.15.114:0/2396926980 shutdown_connections 2024-02-17T12:17:17.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.570+0000 7f6ecca00640 1 -- 172.21.15.114:0/2396926980 wait complete. 2024-02-17T12:17:17.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ecca00640 1 Processor -- start 2024-02-17T12:17:17.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ecca00640 1 -- start start 2024-02-17T12:17:17.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ecca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6eac003980 0x7f6ec8143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ecca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ec814cb50 0x7f6ec8143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ecca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec81458d0 0x7f6ec8145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ecca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec814e010 con 0x7f6ec81458d0 2024-02-17T12:17:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ecca00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8142350 con 0x7f6ec814cb50 2024-02-17T12:17:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ecca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81462a0 con 0x7f6eac003980 2024-02-17T12:17:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ec6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec81458d0 0x7f6ec8145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ec6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec81458d0 0x7f6ec8145d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60026/0 (socket says 172.21.15.114:60026) 2024-02-17T12:17:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ec6800640 1 -- 172.21.15.114:0/3897665804 learned_addr learned my addr 172.21.15.114:0/3897665804 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ebfe00640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ec814cb50 0x7f6ec8143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:17.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ec5e00640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6eac003980 0x7f6ec8143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ec6800640 1 -- 172.21.15.114:0/3897665804 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6eac003980 msgr2=0x7f6ec8143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ec6800640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6eac003980 0x7f6ec8143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:17.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ec6800640 1 -- 172.21.15.114:0/3897665804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ec814cb50 msgr2=0x7f6ec8143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ec6800640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ec814cb50 0x7f6ec8143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ec6800640 1 -- 172.21.15.114:0/3897665804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec81425a0 con 0x7f6ec81458d0 2024-02-17T12:17:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ec6800640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec81458d0 0x7f6ec8145d60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80c2320 tx=0x7f6ec000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ebe000640 1 -- 172.21.15.114:0/3897665804 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000e040 con 0x7f6ec81458d0 2024-02-17T12:17:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ebe000640 1 -- 172.21.15.114:0/3897665804 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000f040 con 0x7f6ec81458d0 2024-02-17T12:17:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ebe000640 1 -- 172.21.15.114:0/3897665804 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0015670 con 0x7f6ec81458d0 2024-02-17T12:17:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ecca00640 1 -- 172.21.15.114:0/3897665804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec8142880 con 0x7f6ec81458d0 2024-02-17T12:17:17.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.574+0000 7f6ecca00640 1 -- 172.21.15.114:0/3897665804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec8142e40 con 0x7f6ec81458d0 2024-02-17T12:17:17.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.578+0000 7f6ecca00640 1 -- 172.21.15.114:0/3897665804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec8143060 con 0x7f6ec81458d0 2024-02-17T12:17:17.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.578+0000 7f6ebe000640 1 -- 172.21.15.114:0/3897665804 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6ec00157d0 con 0x7f6ec81458d0 2024-02-17T12:17:17.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.578+0000 7f6ebe000640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ea4066e70 0x7f6ea4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:17.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.578+0000 7f6ebe000640 1 -- 172.21.15.114:0/3897665804 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ec0084fe0 con 0x7f6ec81458d0 2024-02-17T12:17:17.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.578+0000 7f6ec5e00640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ea4066e70 0x7f6ea4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:17.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.578+0000 7f6ec5e00640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ea4066e70 0x7f6ea4069330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80aa000 tx=0x7f6eb8001a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:17.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.582+0000 7f6ebe000640 1 -- 172.21.15.114:0/3897665804 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6ec0051de0 con 0x7f6ec81458d0 2024-02-17T12:17:17.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.766+0000 7f6ecca00640 1 -- 172.21.15.114:0/3897665804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6ec806bb70 con 0x7f6ec81458d0 2024-02-17T12:17:17.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.766+0000 7f6ebe000640 1 -- 172.21.15.114:0/3897665804 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6ec00554a0 con 0x7f6ec81458d0 2024-02-17T12:17:17.775 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 -- 172.21.15.114:0/3897665804 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ea4066e70 msgr2=0x7f6ea4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ea4066e70 0x7f6ea4069330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80aa000 tx=0x7f6eb8001a80 comp rx=0 tx=0).stop 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 -- 172.21.15.114:0/3897665804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec81458d0 msgr2=0x7f6ec8145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec81458d0 0x7f6ec8145d60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80c2320 tx=0x7f6ec000f580 comp rx=0 tx=0).stop 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 -- 172.21.15.114:0/3897665804 shutdown_connections 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ea4066e70 0x7f6ea4069330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec81458d0 0x7f6ec8145d60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ec814cb50 0x7f6ec8143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 --2- 172.21.15.114:0/3897665804 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6eac003980 0x7f6ec8143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 -- 172.21.15.114:0/3897665804 >> 172.21.15.114:0/3897665804 conn(0x7f6ec80a8490 msgr2=0x7f6ec806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:17.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 -- 172.21.15.114:0/3897665804 shutdown_connections 2024-02-17T12:17:17.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:17.770+0000 7f6ecca00640 1 -- 172.21.15.114:0/3897665804 wait complete. 2024-02-17T12:17:17.796 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T12:17:17.796 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:17:17.796 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-17T12:17:17.796 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-17T12:17:17.796 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T12:17:17.796 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T12:17:17.796 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:17:17.796 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:17:17.796 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:17:17.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:17.797 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-17T12:17:17.806 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:17:17.806 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:17:17.806 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:17:17.806 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:17.806 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42278sec preferred_lft 42278sec 2024-02-17T12:17:17.807 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 02:42:58:59:74:79 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:17:17.808 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T12:17:17.809 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:17:17.809 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:17.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:17.810 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:17:17.874 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-17T12:17:17.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:17.877 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-17T12:17:17.928 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-17T12:17:17.928 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:17:17.928 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:17:17.928 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:17:17.928 INFO:teuthology.orchestra.run.smithi116.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:17:17.928 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:17:17.928 INFO:teuthology.orchestra.run.smithi116.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:17.928 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:17.929 INFO:teuthology.orchestra.run.smithi116.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:17.929 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:17:17.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:17.929 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:17:17.929 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:17:17.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:17:17.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:17:17.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:17:17.929 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:17:18.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:18.021 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-17T12:17:18.030 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-17T12:17:18.030 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:17:18.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:18.030 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-02-17T12:17:18.093 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:17:18.093 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-17T12:17:18.141 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:17:18.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:17:18.141 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:17:18.192 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:17:18.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:18.193 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:17:18.281 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:17:18.281 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:17:18.281 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:17:18.297 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:17:18.297 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:17:18.297 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:17:18.297 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:17:18.297 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:17:18.306 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:17:18.306 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:17:18.306 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:17:18.306 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:17:18.306 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:17:18.306 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:17:18.306 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:17:18.306 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:17:18.310 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:17:18.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:18.310 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:17:18.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:18.376 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:17:18.428 INFO:teuthology.orchestra.run.smithi116.stdout:client4853 2024-02-17T12:17:18.428 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:17:18.428 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:18.477 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-02-17T12:17:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.606+0000 7f05dae00640 1 Processor -- start 2024-02-17T12:17:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05dae00640 1 -- start start 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05dae00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05d406db50 0x7f05d414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05dae00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f05d4150490 0x7f05d4152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05dae00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d4156270 con 0x7f05d40c25a0 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05dae00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d406f090 con 0x7f05d4150490 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05dae00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d4071630 con 0x7f05d406db50 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05d8e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f05d4150490 0x7f05d4152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05d8e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f05d4150490 0x7f05d4152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60032/0 (socket says 172.21.15.114:60032) 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05d8e00640 1 -- 172.21.15.114:0/1443474828 learned_addr learned my addr 172.21.15.114:0/1443474828 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05d3400640 1 --2- 172.21.15.114:0/1443474828 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05d406db50 0x7f05d414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05d8e00640 1 -- 172.21.15.114:0/1443474828 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05d406db50 msgr2=0x7f05d414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05d8e00640 1 --2- 172.21.15.114:0/1443474828 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05d406db50 0x7f05d414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05d8e00640 1 -- 172.21.15.114:0/1443474828 >> v1:172.21.15.116:6789/0 conn(0x7f05d40c25a0 legacy=0x7f05d406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.610+0000 7f05d8e00640 1 -- 172.21.15.114:0/1443474828 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d4156550 con 0x7f05d4150490 2024-02-17T12:17:18.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05d8e00640 1 --2- 172.21.15.114:0/1443474828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 0x7f05d4152c50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009870 tx=0x7f05cc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8849a597153d8f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:18.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05d2a00640 1 -- 172.21.15.114:0/1443474828 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d41539a0 con 0x7f05d4150490 2024-02-17T12:17:18.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05d2a00640 1 -- 172.21.15.114:0/1443474828 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc0ab610 con 0x7f05d4150490 2024-02-17T12:17:18.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05d2a00640 1 -- 172.21.15.114:0/1443474828 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0ab9a0 con 0x7f05d4150490 2024-02-17T12:17:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05dae00640 1 -- 172.21.15.114:0/1443474828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 msgr2=0x7f05d4152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05dae00640 1 --2- 172.21.15.114:0/1443474828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 0x7f05d4152c50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009870 tx=0x7f05cc01c410 comp rx=0 tx=0).stop 2024-02-17T12:17:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05dae00640 1 -- 172.21.15.114:0/1443474828 shutdown_connections 2024-02-17T12:17:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05dae00640 1 --2- 172.21.15.114:0/1443474828 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 0x7f05d4152c50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05dae00640 1 --2- 172.21.15.114:0/1443474828 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05d406db50 0x7f05d414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05dae00640 1 -- 172.21.15.114:0/1443474828 >> 172.21.15.114:0/1443474828 conn(0x7f05d40a8490 msgr2=0x7f05d40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05dae00640 1 -- 172.21.15.114:0/1443474828 shutdown_connections 2024-02-17T12:17:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05dae00640 1 -- 172.21.15.114:0/1443474828 wait complete. 2024-02-17T12:17:18.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05dae00640 1 Processor -- start 2024-02-17T12:17:18.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.614+0000 7f05dae00640 1 -- start start 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05dae00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05d406db50 0x7f05d4143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05dae00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05d40c25a0 0x7f05d40aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05dae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 0x7f05d40ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05dae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d4142890 con 0x7f05d4150490 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05dae00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40c5490 con 0x7f05d406db50 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05dae00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40c5770 con 0x7f05d40c25a0 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 0x7f05d40ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 0x7f05d40ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60040/0 (socket says 172.21.15.114:60040) 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d8e00640 1 -- 172.21.15.114:0/1580021505 learned_addr learned my addr 172.21.15.114:0/1580021505 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d3400640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05d40c25a0 0x7f05d40aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d3e00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05d406db50 0x7f05d4143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d8e00640 1 -- 172.21.15.114:0/1580021505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05d40c25a0 msgr2=0x7f05d40aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:18.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d8e00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05d40c25a0 0x7f05d40aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d8e00640 1 -- 172.21.15.114:0/1580021505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05d406db50 msgr2=0x7f05d4143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d8e00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05d406db50 0x7f05d4143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d8e00640 1 -- 172.21.15.114:0/1580021505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc0094d0 con 0x7f05d4150490 2024-02-17T12:17:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05d8e00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 0x7f05d40ab0d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0ad040 tx=0x7f05cc01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05cbe00640 1 -- 172.21.15.114:0/1580021505 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0b4600 con 0x7f05d4150490 2024-02-17T12:17:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05cbe00640 1 -- 172.21.15.114:0/1580021505 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc0b4760 con 0x7f05d4150490 2024-02-17T12:17:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05dae00640 1 -- 172.21.15.114:0/1580021505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d40c5a50 con 0x7f05d4150490 2024-02-17T12:17:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05cbe00640 1 -- 172.21.15.114:0/1580021505 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0b4b10 con 0x7f05d4150490 2024-02-17T12:17:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05dae00640 1 -- 172.21.15.114:0/1580021505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d40c6010 con 0x7f05d4150490 2024-02-17T12:17:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05dae00640 1 -- 172.21.15.114:0/1580021505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d4074840 con 0x7f05d4150490 2024-02-17T12:17:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.618+0000 7f05cbe00640 1 -- 172.21.15.114:0/1580021505 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f05cc0b4c70 con 0x7f05d4150490 2024-02-17T12:17:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.622+0000 7f05cbe00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05b0066e70 0x7f05b0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.622+0000 7f05cbe00640 1 -- 172.21.15.114:0/1580021505 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05cc11f370 con 0x7f05d4150490 2024-02-17T12:17:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.622+0000 7f05d3e00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05b0066e70 0x7f05b0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:18.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.622+0000 7f05d3e00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05b0066e70 0x7f05b0069330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f05c4001ea0 tx=0x7f05c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:18.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.626+0000 7f05cbe00640 1 -- 172.21.15.114:0/1580021505 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f05cc0ec2a0 con 0x7f05d4150490 2024-02-17T12:17:18.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 -- 172.21.15.114:0/1580021505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f05d40c12e0 con 0x7f05d4150490 2024-02-17T12:17:18.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05cbe00640 1 -- 172.21.15.114:0/1580021505 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v9) v1 ==== 84+0+0 (secure 0 0 0) 0x7f05cc0ef960 con 0x7f05d4150490 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 -- 172.21.15.114:0/1580021505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05b0066e70 msgr2=0x7f05b0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05b0066e70 0x7f05b0069330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f05c4001ea0 tx=0x7f05c4009040 comp rx=0 tx=0).stop 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 -- 172.21.15.114:0/1580021505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 msgr2=0x7f05d40ab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 0x7f05d40ab0d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0ad040 tx=0x7f05cc01ac50 comp rx=0 tx=0).stop 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 -- 172.21.15.114:0/1580021505 shutdown_connections 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05b0066e70 0x7f05b0069330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d4150490 0x7f05d40ab0d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05d40c25a0 0x7f05d40aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 --2- 172.21.15.114:0/1580021505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05d406db50 0x7f05d4143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 -- 172.21.15.114:0/1580021505 >> 172.21.15.114:0/1580021505 conn(0x7f05d40a8490 msgr2=0x7f05d4072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 -- 172.21.15.114:0/1580021505 shutdown_connections 2024-02-17T12:17:18.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.834+0000 7f05dae00640 1 -- 172.21.15.114:0/1580021505 wait complete. 2024-02-17T12:17:18.861 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:18.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.986+0000 7f0c0e600640 1 Processor -- start 2024-02-17T12:17:18.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c0e600640 1 -- start start 2024-02-17T12:17:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c0e600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0c0806f4d0 0x7f0c08072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c0e600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c0806bec0 0x7f0c080a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c0e600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080ac8a0 con 0x7f0c080a6260 2024-02-17T12:17:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c0e600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c08071f80 con 0x7f0c0806bec0 2024-02-17T12:17:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c0e600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c08153430 con 0x7f0c0806f4d0 2024-02-17T12:17:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c0d200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0c0806f4d0 0x7f0c08072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c07e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c0806bec0 0x7f0c080a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c0d200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0c0806f4d0 0x7f0c08072d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:45800/0 (socket says 172.21.15.114:45800) 2024-02-17T12:17:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c0d200640 1 -- 172.21.15.114:0/553472947 learned_addr learned my addr 172.21.15.114:0/553472947 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c07e00640 1 -- 172.21.15.114:0/553472947 >> v2:172.21.15.116:3300/0 conn(0x7f0c0806f4d0 msgr2=0x7f0c08072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c07e00640 1 --2- 172.21.15.114:0/553472947 >> v2:172.21.15.116:3300/0 conn(0x7f0c0806f4d0 0x7f0c08072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c07400640 1 -- 172.21.15.114:0/553472947 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387555061 0 0) 0x7f0c080ac8a0 con 0x7f0c080a6260 2024-02-17T12:17:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c07e00640 1 -- 172.21.15.114:0/553472947 >> v1:172.21.15.116:6789/0 conn(0x7f0c080a6260 legacy=0x7f0c0814f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.990+0000 7f0c07e00640 1 -- 172.21.15.114:0/553472947 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c080716e0 con 0x7f0c0806bec0 2024-02-17T12:17:19.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c07e00640 1 --2- 172.21.15.114:0/553472947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 0x7f0c080a5d20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0c08066af0 tx=0x7f0bf801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff577925927fe10 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c07400640 1 -- 172.21.15.114:0/553472947 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80ac410 con 0x7f0c0806bec0 2024-02-17T12:17:19.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c07400640 1 -- 172.21.15.114:0/553472947 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf80ac570 con 0x7f0c0806bec0 2024-02-17T12:17:19.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c07400640 1 -- 172.21.15.114:0/553472947 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80ac900 con 0x7f0c0806bec0 2024-02-17T12:17:19.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c0e600640 1 -- 172.21.15.114:0/553472947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 msgr2=0x7f0c080a5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c0e600640 1 --2- 172.21.15.114:0/553472947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 0x7f0c080a5d20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0c08066af0 tx=0x7f0bf801c450 comp rx=0 tx=0).stop 2024-02-17T12:17:19.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c0e600640 1 -- 172.21.15.114:0/553472947 shutdown_connections 2024-02-17T12:17:19.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c0e600640 1 --2- 172.21.15.114:0/553472947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 0x7f0c080a5d20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c0e600640 1 --2- 172.21.15.114:0/553472947 >> v2:172.21.15.116:3300/0 conn(0x7f0c0806f4d0 0x7f0c08072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c0e600640 1 -- 172.21.15.114:0/553472947 >> 172.21.15.114:0/553472947 conn(0x7f0c0806ac10 msgr2=0x7f0c0806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:19.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c0e600640 1 -- 172.21.15.114:0/553472947 shutdown_connections 2024-02-17T12:17:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c0e600640 1 -- 172.21.15.114:0/553472947 wait complete. 2024-02-17T12:17:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c0e600640 1 Processor -- start 2024-02-17T12:17:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.994+0000 7f0c0e600640 1 -- start start 2024-02-17T12:17:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 0x7f0c0814b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0e600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c0806f4d0 0x7f0c0806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0e600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c080a6260 0x7f0c080aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0e600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0814a950 con 0x7f0c0806bec0 2024-02-17T12:17:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0e600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0814b5f0 con 0x7f0c080a6260 2024-02-17T12:17:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0e600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c081edc10 con 0x7f0c0806f4d0 2024-02-17T12:17:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 0x7f0c0814b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 0x7f0c0814b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60044/0 (socket says 172.21.15.114:60044) 2024-02-17T12:17:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0d200640 1 -- 172.21.15.114:0/380863932 learned_addr learned my addr 172.21.15.114:0/380863932 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c07e00640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c0806f4d0 0x7f0c0806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0dc00640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c080a6260 0x7f0c080aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0d200640 1 -- 172.21.15.114:0/380863932 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c0806f4d0 msgr2=0x7f0c0806eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0d200640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c0806f4d0 0x7f0c0806eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0d200640 1 -- 172.21.15.114:0/380863932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c080a6260 msgr2=0x7f0c080aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0d200640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c080a6260 0x7f0c080aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0d200640 1 -- 172.21.15.114:0/380863932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf8009420 con 0x7f0c0806bec0 2024-02-17T12:17:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0dc00640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c080a6260 0x7f0c080aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:19.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0d200640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 0x7f0c0814b010 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000e8c0 tx=0x7f0bf000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c04c00640 1 -- 172.21.15.114:0/380863932 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0009620 con 0x7f0c0806bec0 2024-02-17T12:17:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c04c00640 1 -- 172.21.15.114:0/380863932 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000c940 con 0x7f0c0806bec0 2024-02-17T12:17:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c04c00640 1 -- 172.21.15.114:0/380863932 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000ccf0 con 0x7f0c0806bec0 2024-02-17T12:17:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0e600640 1 -- 172.21.15.114:0/380863932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c081ee140 con 0x7f0c0806bec0 2024-02-17T12:17:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0e600640 1 -- 172.21.15.114:0/380863932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c08154f20 con 0x7f0c0806bec0 2024-02-17T12:17:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c0e600640 1 -- 172.21.15.114:0/380863932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c080675f0 con 0x7f0c0806bec0 2024-02-17T12:17:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:18.998+0000 7f0c04c00640 1 -- 172.21.15.114:0/380863932 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0bf0013470 con 0x7f0c0806bec0 2024-02-17T12:17:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.002+0000 7f0c04c00640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0be4066e40 0x7f0be4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.002+0000 7f0c04c00640 1 -- 172.21.15.114:0/380863932 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bf0084ef0 con 0x7f0c0806bec0 2024-02-17T12:17:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.002+0000 7f0c07e00640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0be4066e40 0x7f0be4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.002+0000 7f0c07e00640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0be4066e40 0x7f0be4069300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80ae000 tx=0x7f0bf8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.006+0000 7f0c04c00640 1 -- 172.21.15.114:0/380863932 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0bf0051d70 con 0x7f0c0806bec0 2024-02-17T12:17:19.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 -- 172.21.15.114:0/380863932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c0804eef0 con 0x7f0c0806bec0 2024-02-17T12:17:19.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c04c00640 1 -- 172.21.15.114:0/380863932 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16681 (secure 0 0 0) 0x7f0bf0055430 con 0x7f0c0806bec0 2024-02-17T12:17:19.168 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:19.168 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:07.026009+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:19.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 -- 172.21.15.114:0/380863932 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0be4066e40 msgr2=0x7f0be4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0be4066e40 0x7f0be4069300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80ae000 tx=0x7f0bf8008040 comp rx=0 tx=0).stop 2024-02-17T12:17:19.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 -- 172.21.15.114:0/380863932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 msgr2=0x7f0c0814b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 0x7f0c0814b010 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000e8c0 tx=0x7f0bf000ed80 comp rx=0 tx=0).stop 2024-02-17T12:17:19.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 -- 172.21.15.114:0/380863932 shutdown_connections 2024-02-17T12:17:19.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c080a6260 0x7f0c080aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c0806f4d0 0x7f0c0806eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0be4066e40 0x7f0be4069300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 --2- 172.21.15.114:0/380863932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c0806bec0 0x7f0c0814b010 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 -- 172.21.15.114:0/380863932 >> 172.21.15.114:0/380863932 conn(0x7f0c0806ac10 msgr2=0x7f0c08073fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:19.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 -- 172.21.15.114:0/380863932 shutdown_connections 2024-02-17T12:17:19.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.162+0000 7f0c0e600640 1 -- 172.21.15.114:0/380863932 wait complete. 2024-02-17T12:17:19.189 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:17:03.897758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:17:04.389290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:17:19.190 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:17:19.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.322+0000 7ff7a7800640 1 Processor -- start 2024-02-17T12:17:19.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.322+0000 7ff7a7800640 1 -- start start 2024-02-17T12:17:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff7a7800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff7a006db50 0x7ff7a014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff7a7800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a0156270 con 0x7ff7a00c25a0 2024-02-17T12:17:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff7a7800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a0156550 con 0x7ff7a0150490 2024-02-17T12:17:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff7a7800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a006f090 con 0x7ff7a006db50 2024-02-17T12:17:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff79fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff7a006db50 0x7ff7a014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff7a4e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff7a00c25a0 0x7ff7a006e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55450/0 (socket says 172.21.15.114:55450) 2024-02-17T12:17:19.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff7a4e00640 1 -- 172.21.15.114:0/2000492881 learned_addr learned my addr 172.21.15.114:0/2000492881 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:19.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff79fe00640 1 -- 172.21.15.114:0/2000492881 >> v1:172.21.15.116:6789/0 conn(0x7ff7a0150490 legacy=0x7ff7a0152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:19.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff79fe00640 1 -- 172.21.15.114:0/2000492881 >> v1:172.21.15.114:6789/0 conn(0x7ff7a00c25a0 legacy=0x7ff7a006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff79fe00640 1 -- 172.21.15.114:0/2000492881 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0156830 con 0x7ff7a006db50 2024-02-17T12:17:19.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff79f400640 1 -- 172.21.15.114:0/2000492881 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160748564 0 0) 0x7ff7a0156270 con 0x7ff7a00c25a0 2024-02-17T12:17:19.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.326+0000 7ff79fe00640 1 --2- 172.21.15.114:0/2000492881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a006db50 0x7ff7a014ff50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff7880097c0 tx=0x7ff78801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f798a61daf252ec8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff79f400640 1 -- 172.21.15.114:0/2000492881 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880ab600 con 0x7ff7a006db50 2024-02-17T12:17:19.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff79f400640 1 -- 172.21.15.114:0/2000492881 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7880a7050 con 0x7ff7a006db50 2024-02-17T12:17:19.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff79f400640 1 -- 172.21.15.114:0/2000492881 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880ab980 con 0x7ff7a006db50 2024-02-17T12:17:19.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 -- 172.21.15.114:0/2000492881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a006db50 msgr2=0x7ff7a014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 --2- 172.21.15.114:0/2000492881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a006db50 0x7ff7a014ff50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff7880097c0 tx=0x7ff78801c380 comp rx=0 tx=0).stop 2024-02-17T12:17:19.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 -- 172.21.15.114:0/2000492881 shutdown_connections 2024-02-17T12:17:19.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 --2- 172.21.15.114:0/2000492881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a006db50 0x7ff7a014ff50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 -- 172.21.15.114:0/2000492881 >> 172.21.15.114:0/2000492881 conn(0x7ff7a00a8490 msgr2=0x7ff7a00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:19.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 -- 172.21.15.114:0/2000492881 shutdown_connections 2024-02-17T12:17:19.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 -- 172.21.15.114:0/2000492881 wait complete. 2024-02-17T12:17:19.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 Processor -- start 2024-02-17T12:17:19.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 -- start start 2024-02-17T12:17:19.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7a006db50 0x7ff7a013f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a00c25a0 0x7ff7a00bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff7a0150490 0x7ff7a0154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a013a8e0 con 0x7ff7a00c25a0 2024-02-17T12:17:19.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a013ad00 con 0x7ff7a006db50 2024-02-17T12:17:19.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a7800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0139c60 con 0x7ff7a0150490 2024-02-17T12:17:19.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff79fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a00c25a0 0x7ff7a00bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff79fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a00c25a0 0x7ff7a00bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60054/0 (socket says 172.21.15.114:60054) 2024-02-17T12:17:19.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff79fe00640 1 -- 172.21.15.114:0/1256743344 learned_addr learned my addr 172.21.15.114:0/1256743344 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:19.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a4e00640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7a006db50 0x7ff7a013f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.330+0000 7ff7a5800640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff7a0150490 0x7ff7a0154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79fe00640 1 -- 172.21.15.114:0/1256743344 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff7a0150490 msgr2=0x7ff7a0154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79fe00640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff7a0150490 0x7ff7a0154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79fe00640 1 -- 172.21.15.114:0/1256743344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7a006db50 msgr2=0x7ff7a013f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79fe00640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7a006db50 0x7ff7a013f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79fe00640 1 -- 172.21.15.114:0/1256743344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff788009420 con 0x7ff7a00c25a0 2024-02-17T12:17:19.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff7a4e00640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7a006db50 0x7ff7a013f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:19.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff7a5800640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff7a0150490 0x7ff7a0154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:19.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79fe00640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a00c25a0 0x7ff7a00bfa00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff788018f90 tx=0x7ff78801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79cc00640 1 -- 172.21.15.114:0/1256743344 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880b7650 con 0x7ff7a00c25a0 2024-02-17T12:17:19.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79cc00640 1 -- 172.21.15.114:0/1256743344 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7880abe90 con 0x7ff7a00c25a0 2024-02-17T12:17:19.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff7a7800640 1 -- 172.21.15.114:0/1256743344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a0139f40 con 0x7ff7a00c25a0 2024-02-17T12:17:19.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79cc00640 1 -- 172.21.15.114:0/1256743344 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880b7a10 con 0x7ff7a00c25a0 2024-02-17T12:17:19.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff7a7800640 1 -- 172.21.15.114:0/1256743344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a013a500 con 0x7ff7a00c25a0 2024-02-17T12:17:19.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff7a7800640 1 -- 172.21.15.114:0/1256743344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a0074840 con 0x7ff7a00c25a0 2024-02-17T12:17:19.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79cc00640 1 -- 172.21.15.114:0/1256743344 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff7880b7b70 con 0x7ff7a00c25a0 2024-02-17T12:17:19.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.334+0000 7ff79cc00640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff77c066e40 0x7ff77c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.338+0000 7ff79cc00640 1 -- 172.21.15.114:0/1256743344 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff78811f470 con 0x7ff7a00c25a0 2024-02-17T12:17:19.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.338+0000 7ff7a4e00640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff77c066e40 0x7ff77c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.338+0000 7ff7a4e00640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff77c066e40 0x7ff77c069300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff790007fd0 tx=0x7ff790009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.342+0000 7ff79cc00640 1 -- 172.21.15.114:0/1256743344 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7880ec1c0 con 0x7ff7a00c25a0 2024-02-17T12:17:19.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.494+0000 7ff7a7800640 1 -- 172.21.15.114:0/1256743344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7a014d7c0 con 0x7ff7a00c25a0 2024-02-17T12:17:19.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.494+0000 7ff79cc00640 1 -- 172.21.15.114:0/1256743344 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7880ef880 con 0x7ff7a00c25a0 2024-02-17T12:17:19.502 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:17:19.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 -- 172.21.15.114:0/1256743344 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff77c066e40 msgr2=0x7ff77c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff77c066e40 0x7ff77c069300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff790007fd0 tx=0x7ff790009040 comp rx=0 tx=0).stop 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 -- 172.21.15.114:0/1256743344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a00c25a0 msgr2=0x7ff7a00bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a00c25a0 0x7ff7a00bfa00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff788018f90 tx=0x7ff78801abc0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 -- 172.21.15.114:0/1256743344 shutdown_connections 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff7a0150490 0x7ff7a0154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff77c066e40 0x7ff77c069300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7a00c25a0 0x7ff7a00bfa00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 --2- 172.21.15.114:0/1256743344 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7a006db50 0x7ff7a013f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 -- 172.21.15.114:0/1256743344 >> 172.21.15.114:0/1256743344 conn(0x7ff7a00a8490 msgr2=0x7ff7a00c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 -- 172.21.15.114:0/1256743344 shutdown_connections 2024-02-17T12:17:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.498+0000 7ff7a7800640 1 -- 172.21.15.114:0/1256743344 wait complete. 2024-02-17T12:17:19.522 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:17:19.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.650+0000 7f4fd5c00640 1 Processor -- start 2024-02-17T12:17:19.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.650+0000 7f4fd5c00640 1 -- start start 2024-02-17T12:17:19.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fd5c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4fd00c25a0 0x7f4fd006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fd5c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4fd006db50 0x7f4fd014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fd5c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd0156270 con 0x7f4fd0150490 2024-02-17T12:17:19.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fd5c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd0071630 con 0x7f4fd006db50 2024-02-17T12:17:19.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fd5c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd0156550 con 0x7f4fd00c25a0 2024-02-17T12:17:19.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fce000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4fd006db50 0x7f4fd014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fce000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4fd006db50 0x7f4fd014ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60070/0 (socket says 172.21.15.114:60070) 2024-02-17T12:17:19.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fce000640 1 -- 172.21.15.114:0/2374125610 learned_addr learned my addr 172.21.15.114:0/2374125610 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:19.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fcf400640 1 --1- 172.21.15.114:0/2374125610 >> v1:172.21.15.114:6789/0 conn(0x7f4fd0150490 0x7f4fd0152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55454/0 (socket says 172.21.15.114:55454) 2024-02-17T12:17:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fcea00640 1 --2- 172.21.15.114:0/2374125610 >> v2:172.21.15.116:3300/0 conn(0x7f4fd00c25a0 0x7f4fd006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fce000640 1 -- 172.21.15.114:0/2374125610 >> v2:172.21.15.116:3300/0 conn(0x7f4fd00c25a0 msgr2=0x7f4fd006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fce000640 1 --2- 172.21.15.114:0/2374125610 >> v2:172.21.15.116:3300/0 conn(0x7f4fd00c25a0 0x7f4fd006e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fce000640 1 -- 172.21.15.114:0/2374125610 >> v1:172.21.15.114:6789/0 conn(0x7f4fd0150490 legacy=0x7f4fd0152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fce000640 1 -- 172.21.15.114:0/2374125610 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd0156830 con 0x7f4fd006db50 2024-02-17T12:17:19.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.654+0000 7f4fcd600640 1 -- 172.21.15.114:0/2374125610 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571285595 0 0) 0x7f4fd0156270 con 0x7f4fd0150490 2024-02-17T12:17:19.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fce000640 1 --2- 172.21.15.114:0/2374125610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd006db50 0x7f4fd014ff50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00ab930 tx=0x7f4fbc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a394519c2eb589a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fcd600640 1 -- 172.21.15.114:0/2374125610 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0a4ea0 con 0x7f4fd006db50 2024-02-17T12:17:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fcd600640 1 -- 172.21.15.114:0/2374125610 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc0a7050 con 0x7f4fd006db50 2024-02-17T12:17:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fcd600640 1 -- 172.21.15.114:0/2374125610 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0ab820 con 0x7f4fd006db50 2024-02-17T12:17:19.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 -- 172.21.15.114:0/2374125610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd006db50 msgr2=0x7f4fd014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 --2- 172.21.15.114:0/2374125610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd006db50 0x7f4fd014ff50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00ab930 tx=0x7f4fbc01c400 comp rx=0 tx=0).stop 2024-02-17T12:17:19.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 -- 172.21.15.114:0/2374125610 shutdown_connections 2024-02-17T12:17:19.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 --2- 172.21.15.114:0/2374125610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd006db50 0x7f4fd014ff50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 --2- 172.21.15.114:0/2374125610 >> v2:172.21.15.116:3300/0 conn(0x7f4fd00c25a0 0x7f4fd006e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 -- 172.21.15.114:0/2374125610 >> 172.21.15.114:0/2374125610 conn(0x7f4fd00a8490 msgr2=0x7f4fd00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:19.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 -- 172.21.15.114:0/2374125610 shutdown_connections 2024-02-17T12:17:19.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 -- 172.21.15.114:0/2374125610 wait complete. 2024-02-17T12:17:19.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 Processor -- start 2024-02-17T12:17:19.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 -- start start 2024-02-17T12:17:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fd006db50 0x7f4fd0149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd00c25a0 0x7f4fd01ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd0150490 0x7f4fd01ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd0144870 con 0x7f4fd0150490 2024-02-17T12:17:19.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd0144b50 con 0x7f4fd006db50 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.658+0000 7f4fd5c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd014dbf0 con 0x7f4fd00c25a0 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fcf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd0150490 0x7f4fd01ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fcf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd0150490 0x7f4fd01ed810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60078/0 (socket says 172.21.15.114:60078) 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fcf400640 1 -- 172.21.15.114:0/1974560916 learned_addr learned my addr 172.21.15.114:0/1974560916 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fcea00640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fd006db50 0x7f4fd0149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fce000640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd00c25a0 0x7f4fd01ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fcf400640 1 -- 172.21.15.114:0/1974560916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd00c25a0 msgr2=0x7f4fd01ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fcf400640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd00c25a0 0x7f4fd01ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fcf400640 1 -- 172.21.15.114:0/1974560916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fd006db50 msgr2=0x7f4fd0149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fcf400640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fd006db50 0x7f4fd0149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fcf400640 1 -- 172.21.15.114:0/1974560916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0094d0 con 0x7f4fd0150490 2024-02-17T12:17:19.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fcf400640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd0150490 0x7f4fd01ed810 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800c700 tx=0x7f4fc800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fc6a00640 1 -- 172.21.15.114:0/1974560916 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800ce10 con 0x7f4fd0150490 2024-02-17T12:17:19.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fc6a00640 1 -- 172.21.15.114:0/1974560916 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc800a640 con 0x7f4fd0150490 2024-02-17T12:17:19.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fc6a00640 1 -- 172.21.15.114:0/1974560916 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800aa70 con 0x7f4fd0150490 2024-02-17T12:17:19.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fd5c00640 1 -- 172.21.15.114:0/1974560916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd014ded0 con 0x7f4fd0150490 2024-02-17T12:17:19.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fd5c00640 1 -- 172.21.15.114:0/1974560916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd00ab2b0 con 0x7f4fd0150490 2024-02-17T12:17:19.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fd5c00640 1 -- 172.21.15.114:0/1974560916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd014e110 con 0x7f4fd0150490 2024-02-17T12:17:19.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fc6a00640 1 -- 172.21.15.114:0/1974560916 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4fc800abd0 con 0x7f4fd0150490 2024-02-17T12:17:19.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fc6a00640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4fb0066e40 0x7f4fb0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.662+0000 7f4fc6a00640 1 -- 172.21.15.114:0/1974560916 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fc8083e10 con 0x7f4fd0150490 2024-02-17T12:17:19.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.666+0000 7f4fcea00640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4fb0066e40 0x7f4fb0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.666+0000 7f4fcea00640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4fb0066e40 0x7f4fb0069300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0007a60 tx=0x7f4fc0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.670+0000 7f4fc6a00640 1 -- 172.21.15.114:0/1974560916 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4fd014e110 con 0x7f4fd0150490 2024-02-17T12:17:19.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.818+0000 7f4fd5c00640 1 -- 172.21.15.114:0/1974560916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fd014e0c0 con 0x7f4fd0150490 2024-02-17T12:17:19.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fc6a00640 1 -- 172.21.15.114:0/1974560916 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fc8018020 con 0x7f4fd0150490 2024-02-17T12:17:19.827 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:17:19.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 -- 172.21.15.114:0/1974560916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4fb0066e40 msgr2=0x7f4fb0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4fb0066e40 0x7f4fb0069300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0007a60 tx=0x7f4fc0008040 comp rx=0 tx=0).stop 2024-02-17T12:17:19.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 -- 172.21.15.114:0/1974560916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd0150490 msgr2=0x7f4fd01ed810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd0150490 0x7f4fd01ed810 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800c700 tx=0x7f4fc800cbc0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 -- 172.21.15.114:0/1974560916 shutdown_connections 2024-02-17T12:17:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4fb0066e40 0x7f4fb0069300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4fd0150490 0x7f4fd01ed810 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd00c25a0 0x7f4fd01ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 --2- 172.21.15.114:0/1974560916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4fd006db50 0x7f4fd0149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 -- 172.21.15.114:0/1974560916 >> 172.21.15.114:0/1974560916 conn(0x7f4fd00a8490 msgr2=0x7f4fd00a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 -- 172.21.15.114:0/1974560916 shutdown_connections 2024-02-17T12:17:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.822+0000 7f4fd5c00640 1 -- 172.21.15.114:0/1974560916 wait complete. 2024-02-17T12:17:19.849 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:17:19.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.978+0000 7f3536800640 1 Processor -- start 2024-02-17T12:17:19.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.978+0000 7f3536800640 1 -- start start 2024-02-17T12:17:19.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.978+0000 7f3536800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35300c3760 0x7f3530155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.978+0000 7f3536800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35300c66c0 0x7f3530155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.978+0000 7f3536800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300c5380 con 0x7f3530070b50 2024-02-17T12:17:19.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.978+0000 7f3536800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300c4b10 con 0x7f35300c66c0 2024-02-17T12:17:19.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.978+0000 7f3536800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35300c2ca0 con 0x7f35300c3760 2024-02-17T12:17:19.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f3534a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35300c66c0 0x7f3530155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f3535e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3530070b50 0x7f3530158350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55468/0 (socket says 172.21.15.114:55468) 2024-02-17T12:17:19.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f3535e00640 1 -- 172.21.15.114:0/3173878698 learned_addr learned my addr 172.21.15.114:0/3173878698 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:19.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f3535400640 1 --2- 172.21.15.114:0/3173878698 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35300c3760 0x7f3530155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f3534a00640 1 -- 172.21.15.114:0/3173878698 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35300c3760 msgr2=0x7f3530155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:19.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f3534a00640 1 --2- 172.21.15.114:0/3173878698 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35300c3760 0x7f3530155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f3534a00640 1 -- 172.21.15.114:0/3173878698 >> v1:172.21.15.114:6789/0 conn(0x7f3530070b50 legacy=0x7f3530158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f3534a00640 1 -- 172.21.15.114:0/3173878698 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300c2f80 con 0x7f35300c66c0 2024-02-17T12:17:19.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f352fe00640 1 -- 172.21.15.114:0/3173878698 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711227096 0 0) 0x7f35300c5380 con 0x7f3530070b50 2024-02-17T12:17:19.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f3535400640 1 --2- 172.21.15.114:0/3173878698 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35300c3760 0x7f3530155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:19.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f3534a00640 1 --2- 172.21.15.114:0/3173878698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c66c0 0x7f3530155bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f351c0097c0 tx=0x7f351c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df9850e59394f47 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f352fe00640 1 -- 172.21.15.114:0/3173878698 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0ad680 con 0x7f35300c66c0 2024-02-17T12:17:19.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f352fe00640 1 -- 172.21.15.114:0/3173878698 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c0ad7e0 con 0x7f35300c66c0 2024-02-17T12:17:19.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.982+0000 7f352fe00640 1 -- 172.21.15.114:0/3173878698 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0adb70 con 0x7f35300c66c0 2024-02-17T12:17:19.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 -- 172.21.15.114:0/3173878698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c66c0 msgr2=0x7f3530155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 --2- 172.21.15.114:0/3173878698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c66c0 0x7f3530155bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f351c0097c0 tx=0x7f351c01c380 comp rx=0 tx=0).stop 2024-02-17T12:17:19.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 -- 172.21.15.114:0/3173878698 shutdown_connections 2024-02-17T12:17:19.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 --2- 172.21.15.114:0/3173878698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c66c0 0x7f3530155bb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 --2- 172.21.15.114:0/3173878698 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35300c3760 0x7f3530155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 -- 172.21.15.114:0/3173878698 >> 172.21.15.114:0/3173878698 conn(0x7f35300a9f70 msgr2=0x7f35300aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:19.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 -- 172.21.15.114:0/3173878698 shutdown_connections 2024-02-17T12:17:19.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 -- 172.21.15.114:0/3173878698 wait complete. 2024-02-17T12:17:19.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 Processor -- start 2024-02-17T12:17:19.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 -- start start 2024-02-17T12:17:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3530070b50 0x7f3530156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c3760 0x7f353006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35300c66c0 0x7f353006f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530156a60 con 0x7f35300c3760 2024-02-17T12:17:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530158420 con 0x7f35300c66c0 2024-02-17T12:17:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3536800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35300ad690 con 0x7f3530070b50 2024-02-17T12:17:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3534a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c3760 0x7f353006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3534a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c3760 0x7f353006efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60084/0 (socket says 172.21.15.114:60084) 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3534a00640 1 -- 172.21.15.114:0/3915472522 learned_addr learned my addr 172.21.15.114:0/3915472522 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3535e00640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35300c66c0 0x7f353006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3535400640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3530070b50 0x7f3530156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3534a00640 1 -- 172.21.15.114:0/3915472522 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3530070b50 msgr2=0x7f3530156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3534a00640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3530070b50 0x7f3530156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3534a00640 1 -- 172.21.15.114:0/3915472522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35300c66c0 msgr2=0x7f353006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3534a00640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35300c66c0 0x7f353006f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3534a00640 1 -- 172.21.15.114:0/3915472522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c009420 con 0x7f35300c3760 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.986+0000 7f3534a00640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c3760 0x7f353006efd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f351c0097c0 tx=0x7f351c01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f352d600640 1 -- 172.21.15.114:0/3915472522 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0adde0 con 0x7f35300c3760 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f352d600640 1 -- 172.21.15.114:0/3915472522 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c0b8450 con 0x7f35300c3760 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f352d600640 1 -- 172.21.15.114:0/3915472522 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0b8800 con 0x7f35300c3760 2024-02-17T12:17:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f3536800640 1 -- 172.21.15.114:0/3915472522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3530158620 con 0x7f35300c3760 2024-02-17T12:17:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f3536800640 1 -- 172.21.15.114:0/3915472522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35301564a0 con 0x7f35300c3760 2024-02-17T12:17:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f3536800640 1 -- 172.21.15.114:0/3915472522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35301581a0 con 0x7f35300c3760 2024-02-17T12:17:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f352d600640 1 -- 172.21.15.114:0/3915472522 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f351c0b4070 con 0x7f35300c3760 2024-02-17T12:17:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f352d600640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3510066e70 0x7f3510069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f352d600640 1 -- 172.21.15.114:0/3915472522 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f351c11f160 con 0x7f35300c3760 2024-02-17T12:17:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f3535400640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3510066e70 0x7f3510069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.990+0000 7f3535400640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3510066e70 0x7f3510069330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f352400ba10 tx=0x7f3524008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:20.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:19.994+0000 7f352d600640 1 -- 172.21.15.114:0/3915472522 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f35301581a0 con 0x7f35300c3760 2024-02-17T12:17:20.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.150+0000 7f3536800640 1 -- 172.21.15.114:0/3915472522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35301581a0 con 0x7f35300c3760 2024-02-17T12:17:20.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.150+0000 7f352d600640 1 -- 172.21.15.114:0/3915472522 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35301581a0 con 0x7f35300c3760 2024-02-17T12:17:20.157 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:17:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.150+0000 7f3536800640 1 -- 172.21.15.114:0/3915472522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3510066e70 msgr2=0x7f3510069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.150+0000 7f3536800640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3510066e70 0x7f3510069330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f352400ba10 tx=0x7f3524008040 comp rx=0 tx=0).stop 2024-02-17T12:17:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.150+0000 7f3536800640 1 -- 172.21.15.114:0/3915472522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c3760 msgr2=0x7f353006efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.150+0000 7f3536800640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c3760 0x7f353006efd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f351c0097c0 tx=0x7f351c01abc0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.154+0000 7f3536800640 1 -- 172.21.15.114:0/3915472522 shutdown_connections 2024-02-17T12:17:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.154+0000 7f3536800640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35300c66c0 0x7f353006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.154+0000 7f3536800640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3510066e70 0x7f3510069330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.154+0000 7f3536800640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35300c3760 0x7f353006efd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.154+0000 7f3536800640 1 --2- 172.21.15.114:0/3915472522 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3530070b50 0x7f3530156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.154+0000 7f3536800640 1 -- 172.21.15.114:0/3915472522 >> 172.21.15.114:0/3915472522 conn(0x7f35300a9f70 msgr2=0x7f3530154790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.154+0000 7f3536800640 1 -- 172.21.15.114:0/3915472522 shutdown_connections 2024-02-17T12:17:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.154+0000 7f3536800640 1 -- 172.21.15.114:0/3915472522 wait complete. 2024-02-17T12:17:20.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T12:17:20.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6fa6000640 1 Processor -- start 2024-02-17T12:17:20.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6fa6000640 1 -- start start 2024-02-17T12:17:20.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6fa6000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6fa006db50 0x7f6fa014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6fa6000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fa0150490 0x7f6fa0152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6fa6000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa0156270 con 0x7f6fa00c25a0 2024-02-17T12:17:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6fa6000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa006f090 con 0x7f6fa006db50 2024-02-17T12:17:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6fa6000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0071630 con 0x7f6fa0150490 2024-02-17T12:17:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6f9f400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6fa00c25a0 0x7f6fa006e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55472/0 (socket says 172.21.15.114:55472) 2024-02-17T12:17:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6f9f400640 1 -- 172.21.15.114:0/3248568203 learned_addr learned my addr 172.21.15.114:0/3248568203 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6f9ea00640 1 --2- 172.21.15.114:0/3248568203 >> v2:172.21.15.116:3300/0 conn(0x7f6fa006db50 0x7f6fa014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6f9fe00640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fa0150490 0x7f6fa0152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889726163 0 0) 0x7f6fa0156270 con 0x7f6fa00c25a0 2024-02-17T12:17:20.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.306+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f84003530 con 0x7f6fa00c25a0 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1892888198 0 0) 0x7f6f84003530 con 0x7f6fa00c25a0 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fa0150490 msgr2=0x7f6fa0152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fa0150490 0x7f6fa0152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 >> v2:172.21.15.116:3300/0 conn(0x7f6fa006db50 msgr2=0x7f6fa014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 --2- 172.21.15.114:0/3248568203 >> v2:172.21.15.116:3300/0 conn(0x7f6fa006db50 0x7f6fa014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0156550 con 0x7f6fa00c25a0 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f6f90001a20 con 0x7f6fa00c25a0 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 >> v1:172.21.15.114:6789/0 conn(0x7f6fa00c25a0 legacy=0x7f6fa006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fa0150490 0x7f6f84003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f84003f00 0x7f6f840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f84004d10 0x7f6f84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa006f090 con 0x7f6f84003f00 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8400fe00 con 0x7f6f84004d10 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8400ffc0 con 0x7f6fa0150490 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9ea00640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f84003f00 0x7f6f840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9f400640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fa0150490 0x7f6f84003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9fe00640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f84004d10 0x7f6f84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9ea00640 1 -- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fa0150490 msgr2=0x7f6f84003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9ea00640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fa0150490 0x7f6f84003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9ea00640 1 -- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f84004d10 msgr2=0x7f6f84005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9ea00640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f84004d10 0x7f6f84005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9ea00640 1 -- 172.21.15.114:0/3248568203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84003530 con 0x7f6f84003f00 2024-02-17T12:17:20.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.310+0000 7f6f9ea00640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f84003f00 0x7f6f840047d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009ae0 tx=0x7f6f8801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c141a2b1733cf0e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:20.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f880a5560 con 0x7f6f84003f00 2024-02-17T12:17:20.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f880a56c0 con 0x7f6f84003f00 2024-02-17T12:17:20.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9e000640 1 -- 172.21.15.114:0/3248568203 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f880a5870 con 0x7f6f84003f00 2024-02-17T12:17:20.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 -- 172.21.15.114:0/3248568203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f84003f00 msgr2=0x7f6f840047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 --2- 172.21.15.114:0/3248568203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f84003f00 0x7f6f840047d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009ae0 tx=0x7f6f8801ca80 comp rx=0 tx=0).stop 2024-02-17T12:17:20.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9fe00640 1 -- 172.21.15.114:0/3248568203 reap_dead start 2024-02-17T12:17:20.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 -- 172.21.15.114:0/3248568203 shutdown_connections 2024-02-17T12:17:20.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 -- 172.21.15.114:0/3248568203 >> 172.21.15.114:0/3248568203 conn(0x7f6fa00a8490 msgr2=0x7f6fa00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:20.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 -- 172.21.15.114:0/3248568203 shutdown_connections 2024-02-17T12:17:20.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 -- 172.21.15.114:0/3248568203 wait complete. 2024-02-17T12:17:20.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 Processor -- start 2024-02-17T12:17:20.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 -- start start 2024-02-17T12:17:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f84003f00 0x7f6fa01487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa0147ec0 0x7f6fa0142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fa0142fb0 0x7f6fa01e93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa01e8ee0 con 0x7f6fa0142fb0 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0143430 con 0x7f6fa0147ec0 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6fa6000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa014ef60 con 0x7f6f84003f00 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fa0142fb0 0x7f6fa01e93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fa0142fb0 0x7f6fa01e93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60096/0 (socket says 172.21.15.114:60096) 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9fe00640 1 -- 172.21.15.114:0/1701198885 learned_addr learned my addr 172.21.15.114:0/1701198885 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9ea00640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa0147ec0 0x7f6fa0142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9f400640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f84003f00 0x7f6fa01487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9fe00640 1 -- 172.21.15.114:0/1701198885 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f84003f00 msgr2=0x7f6fa01487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9fe00640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f84003f00 0x7f6fa01487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9fe00640 1 -- 172.21.15.114:0/1701198885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa0147ec0 msgr2=0x7f6fa0142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9fe00640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa0147ec0 0x7f6fa0142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9fe00640 1 -- 172.21.15.114:0/1701198885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa014f240 con 0x7f6fa0142fb0 2024-02-17T12:17:20.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.314+0000 7f6f9f400640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f84003f00 0x7f6fa01487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:20.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6f9fe00640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fa0142fb0 0x7f6fa01e93e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00a91e0 tx=0x7f6f98011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:20.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6f97400640 1 -- 172.21.15.114:0/1701198885 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98004030 con 0x7f6fa0142fb0 2024-02-17T12:17:20.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6f97400640 1 -- 172.21.15.114:0/1701198885 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f98004190 con 0x7f6fa0142fb0 2024-02-17T12:17:20.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6fa6000640 1 -- 172.21.15.114:0/1701198885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa014f520 con 0x7f6fa0142fb0 2024-02-17T12:17:20.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6f97400640 1 -- 172.21.15.114:0/1701198885 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800f770 con 0x7f6fa0142fb0 2024-02-17T12:17:20.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6fa6000640 1 -- 172.21.15.114:0/1701198885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa01472a0 con 0x7f6fa0142fb0 2024-02-17T12:17:20.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6fa6000640 1 -- 172.21.15.114:0/1701198885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa0074840 con 0x7f6fa0142fb0 2024-02-17T12:17:20.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6f97400640 1 -- 172.21.15.114:0/1701198885 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6f9800fae0 con 0x7f6fa0142fb0 2024-02-17T12:17:20.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6f97400640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f7c066e40 0x7f6f7c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6f97400640 1 -- 172.21.15.114:0/1701198885 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f98085030 con 0x7f6fa0142fb0 2024-02-17T12:17:20.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.318+0000 7f6f9f400640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f7c066e40 0x7f6f7c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.322+0000 7f6f9f400640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f7c066e40 0x7f6f7c069300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000f90 tx=0x7f6f90006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:20.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.322+0000 7f6f97400640 1 -- 172.21.15.114:0/1701198885 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f98051eb0 con 0x7f6fa0142fb0 2024-02-17T12:17:20.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.478+0000 7f6fa6000640 1 -- 172.21.15.114:0/1701198885 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6fa01de110 con 0x7f6fa0142fb0 2024-02-17T12:17:20.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.478+0000 7f6f97400640 1 -- 172.21.15.114:0/1701198885 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+207 (secure 0 0 0) 0x7f6f98055570 con 0x7f6fa0142fb0 2024-02-17T12:17:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:20.486 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-02-17T12:17:20.486 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 4, 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "cephfs_metadata" 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 5, 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "cephfs_data" 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:20.487 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-02-17T12:17:20.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 -- 172.21.15.114:0/1701198885 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f7c066e40 msgr2=0x7f6f7c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f7c066e40 0x7f6f7c069300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000f90 tx=0x7f6f90006040 comp rx=0 tx=0).stop 2024-02-17T12:17:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 -- 172.21.15.114:0/1701198885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fa0142fb0 msgr2=0x7f6fa01e93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fa0142fb0 0x7f6fa01e93e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00a91e0 tx=0x7f6f98011cf0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 -- 172.21.15.114:0/1701198885 shutdown_connections 2024-02-17T12:17:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f7c066e40 0x7f6f7c069300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fa0142fb0 0x7f6fa01e93e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fa0147ec0 0x7f6fa0142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 --2- 172.21.15.114:0/1701198885 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f84003f00 0x7f6fa01487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 -- 172.21.15.114:0/1701198885 >> 172.21.15.114:0/1701198885 conn(0x7f6fa00a8490 msgr2=0x7f6fa01de910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 -- 172.21.15.114:0/1701198885 shutdown_connections 2024-02-17T12:17:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.482+0000 7f6fa6000640 1 -- 172.21.15.114:0/1701198885 wait complete. 2024-02-17T12:17:20.507 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-02-17T12:17:20.507 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-02-17T12:17:20.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.638+0000 7f49e9000640 1 Processor -- start 2024-02-17T12:17:20.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.638+0000 7f49e9000640 1 -- start start 2024-02-17T12:17:20.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e9000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40c38e0 0x7f49e406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e9000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f49e41543a0 0x7f49e4154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e9000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e4153640 con 0x7f49e40a6590 2024-02-17T12:17:20.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e9000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e40c3cc0 con 0x7f49e41543a0 2024-02-17T12:17:20.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e9000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e41506a0 con 0x7f49e40c38e0 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e1e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40c38e0 0x7f49e406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e2800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f49e41543a0 0x7f49e4154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e2800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f49e41543a0 0x7f49e4154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:45890/0 (socket says 172.21.15.114:45890) 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e2800640 1 -- 172.21.15.114:0/892366317 learned_addr learned my addr 172.21.15.114:0/892366317 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e1400640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f49e40a6590 0x7f49e40a6ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:60202/0 (socket says 172.21.15.114:60202) 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e2800640 1 -- 172.21.15.114:0/892366317 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40c38e0 msgr2=0x7f49e406e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e2800640 1 --2- 172.21.15.114:0/892366317 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40c38e0 0x7f49e406e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e2800640 1 -- 172.21.15.114:0/892366317 >> v1:172.21.15.116:6789/0 conn(0x7f49e40a6590 legacy=0x7f49e40a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e2800640 1 -- 172.21.15.114:0/892366317 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4153b70 con 0x7f49e41543a0 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e1e00640 1 --2- 172.21.15.114:0/892366317 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40c38e0 0x7f49e406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:20.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.642+0000 7f49e0a00640 1 -- 172.21.15.114:0/892366317 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278937861 0 0) 0x7f49e4153640 con 0x7f49e40a6590 2024-02-17T12:17:20.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e2800640 1 --2- 172.21.15.114:0/892366317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49e41543a0 0x7f49e4154830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0098a0 tx=0x7f49dc01c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21b1cb45b869f873 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:20.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e0a00640 1 -- 172.21.15.114:0/892366317 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0ac640 con 0x7f49e41543a0 2024-02-17T12:17:20.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e0a00640 1 -- 172.21.15.114:0/892366317 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0ac7a0 con 0x7f49e41543a0 2024-02-17T12:17:20.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e0a00640 1 -- 172.21.15.114:0/892366317 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0acb30 con 0x7f49e41543a0 2024-02-17T12:17:20.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 -- 172.21.15.114:0/892366317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49e41543a0 msgr2=0x7f49e4154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 --2- 172.21.15.114:0/892366317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49e41543a0 0x7f49e4154830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0098a0 tx=0x7f49dc01c420 comp rx=0 tx=0).stop 2024-02-17T12:17:20.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 -- 172.21.15.114:0/892366317 shutdown_connections 2024-02-17T12:17:20.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 --2- 172.21.15.114:0/892366317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49e41543a0 0x7f49e4154830 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 --2- 172.21.15.114:0/892366317 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40c38e0 0x7f49e406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 -- 172.21.15.114:0/892366317 >> 172.21.15.114:0/892366317 conn(0x7f49e406b210 msgr2=0x7f49e406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:20.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 -- 172.21.15.114:0/892366317 shutdown_connections 2024-02-17T12:17:20.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 -- 172.21.15.114:0/892366317 wait complete. 2024-02-17T12:17:20.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 Processor -- start 2024-02-17T12:17:20.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 -- start start 2024-02-17T12:17:20.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40a6590 0x7f49e4149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49e40c38e0 0x7f49e4151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e41543a0 0x7f49e40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e4151ee0 con 0x7f49e41543a0 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e4150cd0 con 0x7f49e40c38e0 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.646+0000 7f49e9000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e414ec70 con 0x7f49e40a6590 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e41543a0 0x7f49e40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e41543a0 0x7f49e40abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60106/0 (socket says 172.21.15.114:60106) 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e1e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40a6590 0x7f49e4149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e2800640 1 -- 172.21.15.114:0/2064954818 learned_addr learned my addr 172.21.15.114:0/2064954818 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e1400640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49e40c38e0 0x7f49e4151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e2800640 1 -- 172.21.15.114:0/2064954818 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40a6590 msgr2=0x7f49e4149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e2800640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40a6590 0x7f49e4149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e2800640 1 -- 172.21.15.114:0/2064954818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49e40c38e0 msgr2=0x7f49e4151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e2800640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49e40c38e0 0x7f49e4151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:20.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e2800640 1 -- 172.21.15.114:0/2064954818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d4009a70 con 0x7f49e41543a0 2024-02-17T12:17:20.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e2800640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e41543a0 0x7f49e40abdd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0098a0 tx=0x7f49dc01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:20.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49da000640 1 -- 172.21.15.114:0/2064954818 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0b7620 con 0x7f49e41543a0 2024-02-17T12:17:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49da000640 1 -- 172.21.15.114:0/2064954818 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0b7780 con 0x7f49e41543a0 2024-02-17T12:17:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e9000640 1 -- 172.21.15.114:0/2064954818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49dc0094d0 con 0x7f49e41543a0 2024-02-17T12:17:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49da000640 1 -- 172.21.15.114:0/2064954818 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0b7b30 con 0x7f49e41543a0 2024-02-17T12:17:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e9000640 1 -- 172.21.15.114:0/2064954818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e414f360 con 0x7f49e41543a0 2024-02-17T12:17:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49e9000640 1 -- 172.21.15.114:0/2064954818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e4152150 con 0x7f49e41543a0 2024-02-17T12:17:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.650+0000 7f49da000640 1 -- 172.21.15.114:0/2064954818 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f49dc0b3040 con 0x7f49e41543a0 2024-02-17T12:17:20.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.654+0000 7f49da000640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f49c0066e40 0x7f49c0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:20.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.654+0000 7f49da000640 1 -- 172.21.15.114:0/2064954818 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49dc11f0f0 con 0x7f49e41543a0 2024-02-17T12:17:20.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.654+0000 7f49e1e00640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f49c0066e40 0x7f49c0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:20.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.654+0000 7f49e1e00640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f49c0066e40 0x7f49c0069300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009fd0 tx=0x7f49d400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:20.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.654+0000 7f49da000640 1 -- 172.21.15.114:0/2064954818 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f49dc0ec100 con 0x7f49e41543a0 2024-02-17T12:17:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:20.810+0000 7f49e9000640 1 -- 172.21.15.114:0/2064954818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f49e4074840 con 0x7f49e41543a0 2024-02-17T12:17:21.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49da000640 1 -- 172.21.15.114:0/2064954818 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v33) v1 ==== 140+0+0 (secure 0 0 0) 0x7f49dc0ef7c0 con 0x7f49e41543a0 2024-02-17T12:17:21.308 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_metadata' created 2024-02-17T12:17:21.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 -- 172.21.15.114:0/2064954818 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f49c0066e40 msgr2=0x7f49c0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:21.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f49c0066e40 0x7f49c0069300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009fd0 tx=0x7f49d400b040 comp rx=0 tx=0).stop 2024-02-17T12:17:21.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 -- 172.21.15.114:0/2064954818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e41543a0 msgr2=0x7f49e40abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:21.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e41543a0 0x7f49e40abdd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0098a0 tx=0x7f49dc01ac60 comp rx=0 tx=0).stop 2024-02-17T12:17:21.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 -- 172.21.15.114:0/2064954818 shutdown_connections 2024-02-17T12:17:21.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f49c0066e40 0x7f49c0069300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:21.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49e41543a0 0x7f49e40abdd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:21.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49e40c38e0 0x7f49e4151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:21.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 --2- 172.21.15.114:0/2064954818 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49e40a6590 0x7f49e4149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:21.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 -- 172.21.15.114:0/2064954818 >> 172.21.15.114:0/2064954818 conn(0x7f49e406b210 msgr2=0x7f49e414f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:21.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 -- 172.21.15.114:0/2064954818 shutdown_connections 2024-02-17T12:17:21.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.302+0000 7f49e9000640 1 -- 172.21.15.114:0/2064954818 wait complete. 2024-02-17T12:17:21.335 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T12:17:21.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.470+0000 7fec49000640 1 Processor -- start 2024-02-17T12:17:21.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.470+0000 7fec49000640 1 -- start start 2024-02-17T12:17:21.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.470+0000 7fec49000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec440c25a0 0x7fec4406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:21.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.470+0000 7fec49000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec44156270 con 0x7fec4406db50 2024-02-17T12:17:21.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.470+0000 7fec49000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec44156550 con 0x7fec44152c50 2024-02-17T12:17:21.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.470+0000 7fec49000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec44071630 con 0x7fec440c25a0 2024-02-17T12:17:21.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.470+0000 7fec41400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fec4406db50 0x7fec4414ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55482/0 (socket says 172.21.15.114:55482) 2024-02-17T12:17:21.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.470+0000 7fec41400640 1 -- 172.21.15.114:0/1364337148 learned_addr learned my addr 172.21.15.114:0/1364337148 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:21.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.470+0000 7fec41e00640 1 --2- 172.21.15.114:0/1364337148 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec440c25a0 0x7fec4406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:21.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec40a00640 1 -- 172.21.15.114:0/1364337148 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739525961 0 0) 0x7fec44156270 con 0x7fec4406db50 2024-02-17T12:17:21.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec40a00640 1 -- 172.21.15.114:0/1364337148 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec28003530 con 0x7fec4406db50 2024-02-17T12:17:21.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec40a00640 1 -- 172.21.15.114:0/1364337148 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634877444 0 0) 0x7fec44156550 con 0x7fec44152c50 2024-02-17T12:17:21.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec40a00640 1 -- 172.21.15.114:0/1364337148 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec44156270 con 0x7fec44152c50 2024-02-17T12:17:21.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec41e00640 1 -- 172.21.15.114:0/1364337148 >> v1:172.21.15.116:6789/0 conn(0x7fec44152c50 legacy=0x7fec441530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:21.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec41e00640 1 -- 172.21.15.114:0/1364337148 >> v1:172.21.15.114:6789/0 conn(0x7fec4406db50 legacy=0x7fec4414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:21.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec41e00640 1 -- 172.21.15.114:0/1364337148 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec44156830 con 0x7fec440c25a0 2024-02-17T12:17:21.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec41e00640 1 --2- 172.21.15.114:0/1364337148 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec440c25a0 0x7fec4406e980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec340097f0 tx=0x7fec3401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70fc5c51cc342d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:21.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec40a00640 1 -- 172.21.15.114:0/1364337148 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340ab600 con 0x7fec440c25a0 2024-02-17T12:17:21.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec40a00640 1 -- 172.21.15.114:0/1364337148 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec340a7050 con 0x7fec440c25a0 2024-02-17T12:17:21.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.474+0000 7fec40a00640 1 -- 172.21.15.114:0/1364337148 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340ab980 con 0x7fec440c25a0 2024-02-17T12:17:21.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 -- 172.21.15.114:0/1364337148 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec440c25a0 msgr2=0x7fec4406e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:21.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 --2- 172.21.15.114:0/1364337148 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec440c25a0 0x7fec4406e980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec340097f0 tx=0x7fec3401c390 comp rx=0 tx=0).stop 2024-02-17T12:17:21.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 -- 172.21.15.114:0/1364337148 shutdown_connections 2024-02-17T12:17:21.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 --2- 172.21.15.114:0/1364337148 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec440c25a0 0x7fec4406e980 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:21.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 -- 172.21.15.114:0/1364337148 >> 172.21.15.114:0/1364337148 conn(0x7fec440a8490 msgr2=0x7fec440a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:21.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 -- 172.21.15.114:0/1364337148 shutdown_connections 2024-02-17T12:17:21.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 -- 172.21.15.114:0/1364337148 wait complete. 2024-02-17T12:17:21.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 Processor -- start 2024-02-17T12:17:21.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 -- start start 2024-02-17T12:17:21.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4406db50 0x7fec440c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:21.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec440c25a0 0x7fec44155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec44152c50 0x7fec441445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44154750 con 0x7fec4406db50 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec441558f0 con 0x7fec440c25a0 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec49000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec44153ef0 con 0x7fec44152c50 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec41e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4406db50 0x7fec440c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec41e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4406db50 0x7fec440c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60108/0 (socket says 172.21.15.114:60108) 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec41e00640 1 -- 172.21.15.114:0/1543435643 learned_addr learned my addr 172.21.15.114:0/1543435643 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec41400640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec440c25a0 0x7fec44155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec42800640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec44152c50 0x7fec441445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec41e00640 1 -- 172.21.15.114:0/1543435643 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec44152c50 msgr2=0x7fec441445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec41e00640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec44152c50 0x7fec441445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec41e00640 1 -- 172.21.15.114:0/1543435643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec440c25a0 msgr2=0x7fec44155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec41e00640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec440c25a0 0x7fec44155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:21.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec41e00640 1 -- 172.21.15.114:0/1543435643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34009420 con 0x7fec4406db50 2024-02-17T12:17:21.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.478+0000 7fec42800640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec44152c50 0x7fec441445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:21.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec41e00640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4406db50 0x7fec440c4ac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fec340097f0 tx=0x7fec3401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:21.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec3a000640 1 -- 172.21.15.114:0/1543435643 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340b7450 con 0x7fec4406db50 2024-02-17T12:17:21.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec3a000640 1 -- 172.21.15.114:0/1543435643 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec340b75b0 con 0x7fec4406db50 2024-02-17T12:17:21.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec49000640 1 -- 172.21.15.114:0/1543435643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec440c5000 con 0x7fec4406db50 2024-02-17T12:17:21.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec3a000640 1 -- 172.21.15.114:0/1543435643 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340b7960 con 0x7fec4406db50 2024-02-17T12:17:21.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec49000640 1 -- 172.21.15.114:0/1543435643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4414f570 con 0x7fec4406db50 2024-02-17T12:17:21.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec49000640 1 -- 172.21.15.114:0/1543435643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec44074840 con 0x7fec4406db50 2024-02-17T12:17:21.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec3a000640 1 -- 172.21.15.114:0/1543435643 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fec340b7ac0 con 0x7fec4406db50 2024-02-17T12:17:21.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec3a000640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec24066e70 0x7fec24069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:21.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec3a000640 1 -- 172.21.15.114:0/1543435643 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6080+0+0 (secure 0 0 0) 0x7fec3411f700 con 0x7fec4406db50 2024-02-17T12:17:21.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.482+0000 7fec41400640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec24066e70 0x7fec24069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:21.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.486+0000 7fec41400640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec24066e70 0x7fec24069330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fec441454a0 tx=0x7fec30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:21.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.486+0000 7fec3a000640 1 -- 172.21.15.114:0/1543435643 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fec340ec530 con 0x7fec4406db50 2024-02-17T12:17:21.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:21.642+0000 7fec49000640 1 -- 172.21.15.114:0/1543435643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fec441451f0 con 0x7fec4406db50 2024-02-17T12:17:22.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.306+0000 7fec3a000640 1 -- 172.21.15.114:0/1543435643 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v34) v1 ==== 172+0+0 (secure 0 0 0) 0x7fec340efbf0 con 0x7fec4406db50 2024-02-17T12:17:22.315 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_data' created 2024-02-17T12:17:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 -- 172.21.15.114:0/1543435643 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec24066e70 msgr2=0x7fec24069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec24066e70 0x7fec24069330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fec441454a0 tx=0x7fec30009040 comp rx=0 tx=0).stop 2024-02-17T12:17:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 -- 172.21.15.114:0/1543435643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4406db50 msgr2=0x7fec440c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4406db50 0x7fec440c4ac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fec340097f0 tx=0x7fec3401abd0 comp rx=0 tx=0).stop 2024-02-17T12:17:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 -- 172.21.15.114:0/1543435643 shutdown_connections 2024-02-17T12:17:22.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec44152c50 0x7fec441445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec440c25a0 0x7fec44155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec24066e70 0x7fec24069330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 --2- 172.21.15.114:0/1543435643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec4406db50 0x7fec440c4ac0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 -- 172.21.15.114:0/1543435643 >> 172.21.15.114:0/1543435643 conn(0x7fec440a8490 msgr2=0x7fec440c03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 -- 172.21.15.114:0/1543435643 shutdown_connections 2024-02-17T12:17:22.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.310+0000 7fec49000640 1 -- 172.21.15.114:0/1543435643 wait complete. 2024-02-17T12:17:22.358 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-02-17T12:17:22.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.490+0000 7fb5a7200640 1 Processor -- start 2024-02-17T12:17:22.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.490+0000 7fb5a7200640 1 -- start start 2024-02-17T12:17:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.490+0000 7fb5a7200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a006db50 0x7fb5a014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.490+0000 7fb5a7200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a0156270 con 0x7fb5a0150490 2024-02-17T12:17:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.490+0000 7fb5a7200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a0156550 con 0x7fb5a00c25a0 2024-02-17T12:17:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.490+0000 7fb5a7200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a006f090 con 0x7fb5a006db50 2024-02-17T12:17:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb5a5200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb5a0150490 0x7fb5a0152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55484/0 (socket says 172.21.15.114:55484) 2024-02-17T12:17:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb5a5200640 1 -- 172.21.15.114:0/2851220040 learned_addr learned my addr 172.21.15.114:0/2851220040 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb59f400640 1 --2- 172.21.15.114:0/2851220040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a006db50 0x7fb5a014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb59ea00640 1 -- 172.21.15.114:0/2851220040 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777174615 0 0) 0x7fb5a0156270 con 0x7fb5a0150490 2024-02-17T12:17:22.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb59ea00640 1 -- 172.21.15.114:0/2851220040 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb584003530 con 0x7fb5a0150490 2024-02-17T12:17:22.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb59ea00640 1 -- 172.21.15.114:0/2851220040 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933427396 0 0) 0x7fb5a0156550 con 0x7fb5a00c25a0 2024-02-17T12:17:22.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb59ea00640 1 -- 172.21.15.114:0/2851220040 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a0156270 con 0x7fb5a00c25a0 2024-02-17T12:17:22.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb59f400640 1 -- 172.21.15.114:0/2851220040 >> v1:172.21.15.116:6789/0 conn(0x7fb5a00c25a0 legacy=0x7fb5a006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:22.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb59f400640 1 -- 172.21.15.114:0/2851220040 >> v1:172.21.15.114:6789/0 conn(0x7fb5a0150490 legacy=0x7fb5a0152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:22.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb59f400640 1 -- 172.21.15.114:0/2851220040 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a0156830 con 0x7fb5a006db50 2024-02-17T12:17:22.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.494+0000 7fb59f400640 1 --2- 172.21.15.114:0/2851220040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a006db50 0x7fb5a014ff50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0097f0 tx=0x7fb58c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d07f0309460894 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:22.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb59ea00640 1 -- 172.21.15.114:0/2851220040 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0ab600 con 0x7fb5a006db50 2024-02-17T12:17:22.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb59ea00640 1 -- 172.21.15.114:0/2851220040 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c0a7050 con 0x7fb5a006db50 2024-02-17T12:17:22.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb59ea00640 1 -- 172.21.15.114:0/2851220040 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0ab980 con 0x7fb5a006db50 2024-02-17T12:17:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 -- 172.21.15.114:0/2851220040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a006db50 msgr2=0x7fb5a014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 --2- 172.21.15.114:0/2851220040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a006db50 0x7fb5a014ff50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0097f0 tx=0x7fb58c01c3c0 comp rx=0 tx=0).stop 2024-02-17T12:17:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 -- 172.21.15.114:0/2851220040 shutdown_connections 2024-02-17T12:17:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 --2- 172.21.15.114:0/2851220040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a006db50 0x7fb5a014ff50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 -- 172.21.15.114:0/2851220040 >> 172.21.15.114:0/2851220040 conn(0x7fb5a00a8490 msgr2=0x7fb5a00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 -- 172.21.15.114:0/2851220040 shutdown_connections 2024-02-17T12:17:22.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 -- 172.21.15.114:0/2851220040 wait complete. 2024-02-17T12:17:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 Processor -- start 2024-02-17T12:17:22.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 -- start start 2024-02-17T12:17:22.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5a006db50 0x7fb5a0139e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:22.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a00c25a0 0x7fb5a01f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:22.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a0150490 0x7fb5a013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:22.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00a99d0 con 0x7fb5a0150490 2024-02-17T12:17:22.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00aaa00 con 0x7fb5a006db50 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a7200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0139c50 con 0x7fb5a00c25a0 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a0150490 0x7fb5a013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a0150490 0x7fb5a013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60120/0 (socket says 172.21.15.114:60120) 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a5200640 1 -- 172.21.15.114:0/1516809705 learned_addr learned my addr 172.21.15.114:0/1516809705 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb59fe00640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5a006db50 0x7fb5a0139e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb59f400640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a00c25a0 0x7fb5a01f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a5200640 1 -- 172.21.15.114:0/1516809705 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a00c25a0 msgr2=0x7fb5a01f11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.498+0000 7fb5a5200640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a00c25a0 0x7fb5a01f11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb5a5200640 1 -- 172.21.15.114:0/1516809705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5a006db50 msgr2=0x7fb5a0139e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb5a5200640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5a006db50 0x7fb5a0139e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb5a5200640 1 -- 172.21.15.114:0/1516809705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c009420 con 0x7fb5a0150490 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb5a5200640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a0150490 0x7fb5a013e520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb59800cb20 tx=0x7fb59800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:22.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb597e00640 1 -- 172.21.15.114:0/1516809705 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59800aca0 con 0x7fb5a0150490 2024-02-17T12:17:22.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb597e00640 1 -- 172.21.15.114:0/1516809705 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59800ae00 con 0x7fb5a0150490 2024-02-17T12:17:22.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb597e00640 1 -- 172.21.15.114:0/1516809705 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598012600 con 0x7fb5a0150490 2024-02-17T12:17:22.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb5a7200640 1 -- 172.21.15.114:0/1516809705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a013cb40 con 0x7fb5a0150490 2024-02-17T12:17:22.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb5a7200640 1 -- 172.21.15.114:0/1516809705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a013ea60 con 0x7fb5a0150490 2024-02-17T12:17:22.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb5a7200640 1 -- 172.21.15.114:0/1516809705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a00c0a30 con 0x7fb5a0150490 2024-02-17T12:17:22.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.502+0000 7fb597e00640 1 -- 172.21.15.114:0/1516809705 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb598007070 con 0x7fb5a0150490 2024-02-17T12:17:22.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.506+0000 7fb597e00640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb580066e40 0x7fb580069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:22.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.506+0000 7fb597e00640 1 -- 172.21.15.114:0/1516809705 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fb598084ec0 con 0x7fb5a0150490 2024-02-17T12:17:22.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.506+0000 7fb59fe00640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb580066e40 0x7fb580069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:22.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.506+0000 7fb59fe00640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb580066e40 0x7fb580069300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00aa550 tx=0x7fb590009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:22.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.506+0000 7fb597e00640 1 -- 172.21.15.114:0/1516809705 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb598051be0 con 0x7fb5a0150490 2024-02-17T12:17:22.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:22.694+0000 7fb5a7200640 1 -- 172.21.15.114:0/1516809705 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fb5a0072a80 con 0x7fb5a0150490 2024-02-17T12:17:23.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.318+0000 7fb597e00640 1 -- 172.21.15.114:0/1516809705 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7fb5980552a0 con 0x7fb5a0150490 2024-02-17T12:17:23.332 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 6 and data pool 7 2024-02-17T12:17:23.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.330+0000 7fb5a7200640 1 -- 172.21.15.114:0/1516809705 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb580066e40 msgr2=0x7fb580069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.330+0000 7fb5a7200640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb580066e40 0x7fb580069300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00aa550 tx=0x7fb590009040 comp rx=0 tx=0).stop 2024-02-17T12:17:23.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.330+0000 7fb5a7200640 1 -- 172.21.15.114:0/1516809705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a0150490 msgr2=0x7fb5a013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.330+0000 7fb5a7200640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a0150490 0x7fb5a013e520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb59800cb20 tx=0x7fb59800a060 comp rx=0 tx=0).stop 2024-02-17T12:17:23.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.330+0000 7fb5a7200640 1 -- 172.21.15.114:0/1516809705 shutdown_connections 2024-02-17T12:17:23.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.330+0000 7fb5a7200640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb580066e40 0x7fb580069300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.330+0000 7fb5a7200640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5a0150490 0x7fb5a013e520 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.330+0000 7fb5a7200640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5a00c25a0 0x7fb5a01f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.330+0000 7fb5a7200640 1 --2- 172.21.15.114:0/1516809705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5a006db50 0x7fb5a0139e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.330+0000 7fb5a7200640 1 -- 172.21.15.114:0/1516809705 >> 172.21.15.114:0/1516809705 conn(0x7fb5a00a8490 msgr2=0x7fb5a013f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:23.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.334+0000 7fb5a7200640 1 -- 172.21.15.114:0/1516809705 shutdown_connections 2024-02-17T12:17:23.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.334+0000 7fb5a7200640 1 -- 172.21.15.114:0/1516809705 wait complete. 2024-02-17T12:17:23.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:23.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.506+0000 7ff52c800640 1 Processor -- start 2024-02-17T12:17:23.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.506+0000 7ff52c800640 1 -- start start 2024-02-17T12:17:23.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff52c800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 0x7ff5241530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff52c800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff524156270 con 0x7ff52406db50 2024-02-17T12:17:23.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff52c800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff524156550 con 0x7ff5240c25a0 2024-02-17T12:17:23.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff52c800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52406f090 con 0x7ff524152c50 2024-02-17T12:17:23.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff529400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff52406db50 0x7ff52414ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55486/0 (socket says 172.21.15.114:55486) 2024-02-17T12:17:23.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff529400640 1 -- 172.21.15.114:0/1173280694 learned_addr learned my addr 172.21.15.114:0/1173280694 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:23.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff52a800640 1 --2- 172.21.15.114:0/1173280694 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 0x7ff5241530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff528a00640 1 -- 172.21.15.114:0/1173280694 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570581853 0 0) 0x7ff524156270 con 0x7ff52406db50 2024-02-17T12:17:23.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff528a00640 1 -- 172.21.15.114:0/1173280694 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff50c003530 con 0x7ff52406db50 2024-02-17T12:17:23.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff528a00640 1 -- 172.21.15.114:0/1173280694 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885104713 0 0) 0x7ff524156550 con 0x7ff5240c25a0 2024-02-17T12:17:23.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff528a00640 1 -- 172.21.15.114:0/1173280694 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff524156270 con 0x7ff5240c25a0 2024-02-17T12:17:23.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff52a800640 1 -- 172.21.15.114:0/1173280694 >> v1:172.21.15.116:6789/0 conn(0x7ff5240c25a0 legacy=0x7ff52406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff52a800640 1 -- 172.21.15.114:0/1173280694 >> v1:172.21.15.114:6789/0 conn(0x7ff52406db50 legacy=0x7ff52414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.510+0000 7ff52a800640 1 -- 172.21.15.114:0/1173280694 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524156830 con 0x7ff524152c50 2024-02-17T12:17:23.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff52a800640 1 --2- 172.21.15.114:0/1173280694 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 0x7ff5241530c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff520009dc0 tx=0x7ff52001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=909253352ae28c28 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:23.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff528a00640 1 -- 172.21.15.114:0/1173280694 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200a5840 con 0x7ff524152c50 2024-02-17T12:17:23.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff528a00640 1 -- 172.21.15.114:0/1173280694 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5200a59a0 con 0x7ff524152c50 2024-02-17T12:17:23.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff528a00640 1 -- 172.21.15.114:0/1173280694 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200a5d30 con 0x7ff524152c50 2024-02-17T12:17:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff52c800640 1 -- 172.21.15.114:0/1173280694 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 msgr2=0x7ff5241530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff52c800640 1 --2- 172.21.15.114:0/1173280694 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 0x7ff5241530c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff520009dc0 tx=0x7ff52001c870 comp rx=0 tx=0).stop 2024-02-17T12:17:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff52c800640 1 -- 172.21.15.114:0/1173280694 shutdown_connections 2024-02-17T12:17:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff52c800640 1 --2- 172.21.15.114:0/1173280694 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 0x7ff5241530c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff52c800640 1 -- 172.21.15.114:0/1173280694 >> 172.21.15.114:0/1173280694 conn(0x7ff5240a8490 msgr2=0x7ff5240a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff52c800640 1 -- 172.21.15.114:0/1173280694 shutdown_connections 2024-02-17T12:17:23.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff52c800640 1 -- 172.21.15.114:0/1173280694 wait complete. 2024-02-17T12:17:23.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff52c800640 1 Processor -- start 2024-02-17T12:17:23.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.514+0000 7ff52c800640 1 -- start start 2024-02-17T12:17:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff52c800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff52406db50 0x7ff524154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff52c800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5240c25a0 0x7ff524139a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff52c800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 0x7ff524139f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff52c800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52414f390 con 0x7ff5240c25a0 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff52c800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52413f0e0 con 0x7ff52406db50 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff52c800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52414f0b0 con 0x7ff524152c50 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff529400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5240c25a0 0x7ff524139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff529400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5240c25a0 0x7ff524139a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60124/0 (socket says 172.21.15.114:60124) 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff529400640 1 -- 172.21.15.114:0/1129243401 learned_addr learned my addr 172.21.15.114:0/1129243401 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff529e00640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff52406db50 0x7ff524154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff52a800640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 0x7ff524139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff529400640 1 -- 172.21.15.114:0/1129243401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 msgr2=0x7ff524139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff529400640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 0x7ff524139f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff529400640 1 -- 172.21.15.114:0/1129243401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff52406db50 msgr2=0x7ff524154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff529400640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff52406db50 0x7ff524154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff529400640 1 -- 172.21.15.114:0/1129243401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520009a70 con 0x7ff5240c25a0 2024-02-17T12:17:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff529400640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5240c25a0 0x7ff524139a50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff51400c500 tx=0x7ff51400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:23.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff51e000640 1 -- 172.21.15.114:0/1129243401 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514005cf0 con 0x7ff5240c25a0 2024-02-17T12:17:23.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff51e000640 1 -- 172.21.15.114:0/1129243401 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff514005e50 con 0x7ff5240c25a0 2024-02-17T12:17:23.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff52c800640 1 -- 172.21.15.114:0/1129243401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff524143c70 con 0x7ff5240c25a0 2024-02-17T12:17:23.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff51e000640 1 -- 172.21.15.114:0/1129243401 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514007310 con 0x7ff5240c25a0 2024-02-17T12:17:23.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff52c800640 1 -- 172.21.15.114:0/1129243401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52413b500 con 0x7ff5240c25a0 2024-02-17T12:17:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff52c800640 1 -- 172.21.15.114:0/1129243401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52413f290 con 0x7ff5240c25a0 2024-02-17T12:17:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.518+0000 7ff51e000640 1 -- 172.21.15.114:0/1129243401 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff514007470 con 0x7ff5240c25a0 2024-02-17T12:17:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.522+0000 7ff51e000640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff508066e40 0x7ff508069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.522+0000 7ff51e000640 1 -- 172.21.15.114:0/1129243401 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff514084420 con 0x7ff5240c25a0 2024-02-17T12:17:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.522+0000 7ff529e00640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff508066e40 0x7ff508069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.522+0000 7ff529e00640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff508066e40 0x7ff508069300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff5180011f0 tx=0x7ff518009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:23.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.526+0000 7ff51e000640 1 -- 172.21.15.114:0/1129243401 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff52413f290 con 0x7ff5240c25a0 2024-02-17T12:17:23.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.678+0000 7ff52c800640 1 -- 172.21.15.114:0/1129243401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff52413f290 con 0x7ff5240c25a0 2024-02-17T12:17:23.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.678+0000 7ff51e000640 1 -- 172.21.15.114:0/1129243401 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20420 (secure 0 0 0) 0x7ff52413f290 con 0x7ff5240c25a0 2024-02-17T12:17:23.687 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:23.687 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":35,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:22.698183+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:23.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 -- 172.21.15.114:0/1129243401 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff508066e40 msgr2=0x7ff508069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff508066e40 0x7ff508069300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff5180011f0 tx=0x7ff518009040 comp rx=0 tx=0).stop 2024-02-17T12:17:23.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 -- 172.21.15.114:0/1129243401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5240c25a0 msgr2=0x7ff524139a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5240c25a0 0x7ff524139a50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff51400c500 tx=0x7ff51400c9c0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 -- 172.21.15.114:0/1129243401 shutdown_connections 2024-02-17T12:17:23.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff524152c50 0x7ff524139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff508066e40 0x7ff508069300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5240c25a0 0x7ff524139a50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 --2- 172.21.15.114:0/1129243401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff52406db50 0x7ff524154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 -- 172.21.15.114:0/1129243401 >> 172.21.15.114:0/1129243401 conn(0x7ff5240a8490 msgr2=0x7ff52406e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:23.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 -- 172.21.15.114:0/1129243401 shutdown_connections 2024-02-17T12:17:23.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.682+0000 7ff52c800640 1 -- 172.21.15.114:0/1129243401 wait complete. 2024-02-17T12:17:23.707 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:23.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.834+0000 7fa73b800640 1 Processor -- start 2024-02-17T12:17:23.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.834+0000 7fa73b800640 1 -- start start 2024-02-17T12:17:23.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa73b800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7340c2580 0x7fa7340aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa73b800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa7340c1eb0 0x7fa73415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa73b800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7340a9420 con 0x7fa73414f110 2024-02-17T12:17:23.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa73b800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73414f4f0 con 0x7fa7340c1eb0 2024-02-17T12:17:23.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa73b800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7340aae80 con 0x7fa7340c2580 2024-02-17T12:17:23.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa738e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa73414f110 0x7fa7340c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55498/0 (socket says 172.21.15.114:55498) 2024-02-17T12:17:23.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa738e00640 1 -- 172.21.15.114:0/3718919300 learned_addr learned my addr 172.21.15.114:0/3718919300 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:23.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa739800640 1 --2- 172.21.15.114:0/3718919300 >> v2:172.21.15.116:3300/0 conn(0x7fa7340c1eb0 0x7fa73415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa733e00640 1 --2- 172.21.15.114:0/3718919300 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7340c2580 0x7fa7340aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa733400640 1 -- 172.21.15.114:0/3718919300 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523179605 0 0) 0x7fa7340a9420 con 0x7fa73414f110 2024-02-17T12:17:23.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa733400640 1 -- 172.21.15.114:0/3718919300 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa718003530 con 0x7fa73414f110 2024-02-17T12:17:23.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa739800640 1 -- 172.21.15.114:0/3718919300 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7340c2580 msgr2=0x7fa7340aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:23.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa733400640 1 -- 172.21.15.114:0/3718919300 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4153319711 0 0) 0x7fa718003530 con 0x7fa73414f110 2024-02-17T12:17:23.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa739800640 1 --2- 172.21.15.114:0/3718919300 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7340c2580 0x7fa7340aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa739800640 1 -- 172.21.15.114:0/3718919300 >> v1:172.21.15.114:6789/0 conn(0x7fa73414f110 legacy=0x7fa7340c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.838+0000 7fa739800640 1 -- 172.21.15.114:0/3718919300 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734152850 con 0x7fa7340c1eb0 2024-02-17T12:17:23.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa739800640 1 --2- 172.21.15.114:0/3718919300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7340c1eb0 0x7fa73415c390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009d90 tx=0x7fa72c01c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aabf6085c9b8f36c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:23.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa733400640 1 -- 172.21.15.114:0/3718919300 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724001680 con 0x7fa7340c1eb0 2024-02-17T12:17:23.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa733400640 1 -- 172.21.15.114:0/3718919300 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c0a55d0 con 0x7fa7340c1eb0 2024-02-17T12:17:23.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa733400640 1 -- 172.21.15.114:0/3718919300 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0a5960 con 0x7fa7340c1eb0 2024-02-17T12:17:23.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa73b800640 1 -- 172.21.15.114:0/3718919300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7340c1eb0 msgr2=0x7fa73415c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa73b800640 1 --2- 172.21.15.114:0/3718919300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7340c1eb0 0x7fa73415c390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009d90 tx=0x7fa72c01c7d0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa73b800640 1 -- 172.21.15.114:0/3718919300 shutdown_connections 2024-02-17T12:17:23.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa73b800640 1 --2- 172.21.15.114:0/3718919300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7340c1eb0 0x7fa73415c390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa73b800640 1 --2- 172.21.15.114:0/3718919300 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7340c2580 0x7fa7340aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa73b800640 1 -- 172.21.15.114:0/3718919300 >> 172.21.15.114:0/3718919300 conn(0x7fa7340a8490 msgr2=0x7fa7340a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:23.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa73b800640 1 -- 172.21.15.114:0/3718919300 shutdown_connections 2024-02-17T12:17:23.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.842+0000 7fa73b800640 1 -- 172.21.15.114:0/3718919300 wait complete. 2024-02-17T12:17:23.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 Processor -- start 2024-02-17T12:17:23.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 -- start start 2024-02-17T12:17:23.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7340c1eb0 0x7fa73414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7340c2580 0x7fa7340c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa73414f110 0x7fa73413dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7340c4260 con 0x7fa73414f110 2024-02-17T12:17:23.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73414e710 con 0x7fa7340c1eb0 2024-02-17T12:17:23.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7340c44d0 con 0x7fa7340c2580 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa739800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa73414f110 0x7fa73413dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa739800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa73414f110 0x7fa73413dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60132/0 (socket says 172.21.15.114:60132) 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa739800640 1 -- 172.21.15.114:0/3874366045 learned_addr learned my addr 172.21.15.114:0/3874366045 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa738e00640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7340c1eb0 0x7fa73414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa733e00640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7340c2580 0x7fa7340c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa739800640 1 -- 172.21.15.114:0/3874366045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7340c2580 msgr2=0x7fa7340c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa739800640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7340c2580 0x7fa7340c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa739800640 1 -- 172.21.15.114:0/3874366045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7340c1eb0 msgr2=0x7fa73414d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa739800640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7340c1eb0 0x7fa73414d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa739800640 1 -- 172.21.15.114:0/3874366045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c009a70 con 0x7fa73414f110 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa738e00640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7340c1eb0 0x7fa73414d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:23.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa739800640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa73414f110 0x7fa73413dde0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa72c01d070 tx=0x7fa72c019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:23.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa730c00640 1 -- 172.21.15.114:0/3874366045 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0ad640 con 0x7fa73414f110 2024-02-17T12:17:23.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa730c00640 1 -- 172.21.15.114:0/3874366045 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c0ad7a0 con 0x7fa73414f110 2024-02-17T12:17:23.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 -- 172.21.15.114:0/3874366045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73414ce70 con 0x7fa73414f110 2024-02-17T12:17:23.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa730c00640 1 -- 172.21.15.114:0/3874366045 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0adb30 con 0x7fa73414f110 2024-02-17T12:17:23.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 -- 172.21.15.114:0/3874366045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7340c52a0 con 0x7fa73414f110 2024-02-17T12:17:23.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.846+0000 7fa73b800640 1 -- 172.21.15.114:0/3874366045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa734074840 con 0x7fa73414f110 2024-02-17T12:17:23.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.850+0000 7fa730c00640 1 -- 172.21.15.114:0/3874366045 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa72c0b4070 con 0x7fa73414f110 2024-02-17T12:17:23.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.850+0000 7fa730c00640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa710066e40 0x7fa710069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:23.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.850+0000 7fa730c00640 1 -- 172.21.15.114:0/3874366045 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa72c11fcb0 con 0x7fa73414f110 2024-02-17T12:17:23.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.850+0000 7fa738e00640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa710066e40 0x7fa710069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:23.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.850+0000 7fa738e00640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa710066e40 0x7fa710069300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa7240011f0 tx=0x7fa724009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:23.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:23.854+0000 7fa730c00640 1 -- 172.21.15.114:0/3874366045 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa72c0ec7f0 con 0x7fa73414f110 2024-02-17T12:17:24.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 -- 172.21.15.114:0/3874366045 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7340c1380 con 0x7fa73414f110 2024-02-17T12:17:24.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa730c00640 1 -- 172.21.15.114:0/3874366045 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20420 (secure 0 0 0) 0x7fa72c0b2090 con 0x7fa73414f110 2024-02-17T12:17:24.017 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:24.017 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":35,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:22.698183+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 -- 172.21.15.114:0/3874366045 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa710066e40 msgr2=0x7fa710069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa710066e40 0x7fa710069300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa7240011f0 tx=0x7fa724009040 comp rx=0 tx=0).stop 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 -- 172.21.15.114:0/3874366045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa73414f110 msgr2=0x7fa73413dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa73414f110 0x7fa73413dde0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa72c01d070 tx=0x7fa72c019570 comp rx=0 tx=0).stop 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 -- 172.21.15.114:0/3874366045 shutdown_connections 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa710066e40 0x7fa710069300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa73414f110 0x7fa73413dde0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7340c2580 0x7fa7340c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 --2- 172.21.15.114:0/3874366045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7340c1eb0 0x7fa73414d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 -- 172.21.15.114:0/3874366045 >> 172.21.15.114:0/3874366045 conn(0x7fa7340a8490 msgr2=0x7fa73406ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 -- 172.21.15.114:0/3874366045 shutdown_connections 2024-02-17T12:17:24.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.010+0000 7fa73b800640 1 -- 172.21.15.114:0/3874366045 wait complete. 2024-02-17T12:17:24.037 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-02-17T12:17:24.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff653800640 1 Processor -- start 2024-02-17T12:17:24.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff653800640 1 -- start start 2024-02-17T12:17:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff653800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff64c14f110 0x7ff64c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff653800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff64c0c2580 0x7ff64c0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff653800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c0a9420 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff653800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c14f4f0 con 0x7ff64c14f110 2024-02-17T12:17:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff653800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c0aae80 con 0x7ff64c0c2580 2024-02-17T12:17:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff650e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff64c14f110 0x7ff64c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff651800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff64c0c1eb0 0x7ff64c155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55508/0 (socket says 172.21.15.114:55508) 2024-02-17T12:17:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff651800640 1 -- 172.21.15.114:0/3448008873 learned_addr learned my addr 172.21.15.114:0/3448008873 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff64be00640 1 --2- 172.21.15.114:0/3448008873 >> v2:172.21.15.116:3300/0 conn(0x7ff64c0c2580 0x7ff64c0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:24.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff650e00640 1 -- 172.21.15.114:0/3448008873 >> v2:172.21.15.116:3300/0 conn(0x7ff64c0c2580 msgr2=0x7ff64c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:24.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff650e00640 1 --2- 172.21.15.114:0/3448008873 >> v2:172.21.15.116:3300/0 conn(0x7ff64c0c2580 0x7ff64c0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:24.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff650e00640 1 -- 172.21.15.114:0/3448008873 >> v1:172.21.15.114:6789/0 conn(0x7ff64c0c1eb0 legacy=0x7ff64c155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:24.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff650e00640 1 -- 172.21.15.114:0/3448008873 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c152850 con 0x7ff64c14f110 2024-02-17T12:17:24.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff64be00640 1 --2- 172.21.15.114:0/3448008873 >> v2:172.21.15.116:3300/0 conn(0x7ff64c0c2580 0x7ff64c0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:24.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.170+0000 7ff64b400640 1 -- 172.21.15.114:0/3448008873 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494758207 0 0) 0x7ff64c0a9420 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff650e00640 1 --2- 172.21.15.114:0/3448008873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c14f110 0x7ff64c0c65a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff64c06f0d0 tx=0x7ff64001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd60447d00e3992b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff64b400640 1 -- 172.21.15.114:0/3448008873 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400ac620 con 0x7ff64c14f110 2024-02-17T12:17:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff64b400640 1 -- 172.21.15.114:0/3448008873 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6400ac780 con 0x7ff64c14f110 2024-02-17T12:17:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff64b400640 1 -- 172.21.15.114:0/3448008873 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400acb10 con 0x7ff64c14f110 2024-02-17T12:17:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff653800640 1 -- 172.21.15.114:0/3448008873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c14f110 msgr2=0x7ff64c0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff653800640 1 --2- 172.21.15.114:0/3448008873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c14f110 0x7ff64c0c65a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff64c06f0d0 tx=0x7ff64001c3c0 comp rx=0 tx=0).stop 2024-02-17T12:17:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff653800640 1 -- 172.21.15.114:0/3448008873 shutdown_connections 2024-02-17T12:17:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff653800640 1 --2- 172.21.15.114:0/3448008873 >> v2:172.21.15.116:3300/0 conn(0x7ff64c0c2580 0x7ff64c0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff653800640 1 --2- 172.21.15.114:0/3448008873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c14f110 0x7ff64c0c65a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:24.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff653800640 1 -- 172.21.15.114:0/3448008873 >> 172.21.15.114:0/3448008873 conn(0x7ff64c0a8490 msgr2=0x7ff64c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:24.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff653800640 1 -- 172.21.15.114:0/3448008873 shutdown_connections 2024-02-17T12:17:24.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff653800640 1 -- 172.21.15.114:0/3448008873 wait complete. 2024-02-17T12:17:24.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff653800640 1 Processor -- start 2024-02-17T12:17:24.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.174+0000 7ff653800640 1 -- start start 2024-02-17T12:17:24.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff653800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c0c1eb0 0x7ff64c1ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff653800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64c0c2580 0x7ff64c14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff653800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff64c14f110 0x7ff64c139d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff653800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c14cf30 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff653800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c1495c0 con 0x7ff64c0c2580 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff653800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c1ec5e0 con 0x7ff64c14f110 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff650e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c0c1eb0 0x7ff64c1ec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff650e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c0c1eb0 0x7ff64c1ec0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60146/0 (socket says 172.21.15.114:60146) 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff650e00640 1 -- 172.21.15.114:0/317145621 learned_addr learned my addr 172.21.15.114:0/317145621 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff651800640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff64c14f110 0x7ff64c139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff650e00640 1 -- 172.21.15.114:0/317145621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff64c14f110 msgr2=0x7ff64c139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff64be00640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64c0c2580 0x7ff64c14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:24.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff650e00640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff64c14f110 0x7ff64c139d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff650e00640 1 -- 172.21.15.114:0/317145621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64c0c2580 msgr2=0x7ff64c14ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff650e00640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64c0c2580 0x7ff64c14ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff650e00640 1 -- 172.21.15.114:0/317145621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff640009420 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff64be00640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64c0c2580 0x7ff64c14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff651800640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff64c14f110 0x7ff64c139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff650e00640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c0c1eb0 0x7ff64c1ec0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff6400af040 tx=0x7ff64001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff648c00640 1 -- 172.21.15.114:0/317145621 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400b8450 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff648c00640 1 -- 172.21.15.114:0/317145621 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6400b85d0 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff653800640 1 -- 172.21.15.114:0/317145621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c14de70 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff648c00640 1 -- 172.21.15.114:0/317145621 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400b8980 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff653800640 1 -- 172.21.15.114:0/317145621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c14e430 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff653800640 1 -- 172.21.15.114:0/317145621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c074840 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.178+0000 7ff648c00640 1 -- 172.21.15.114:0/317145621 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff6400aa070 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.182+0000 7ff648c00640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff62c066e40 0x7ff62c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:24.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.182+0000 7ff648c00640 1 -- 172.21.15.114:0/317145621 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff64011f3a0 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.182+0000 7ff64be00640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff62c066e40 0x7ff62c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:24.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.182+0000 7ff64be00640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff62c066e40 0x7ff62c069300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff64c141010 tx=0x7ff638008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:24.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.186+0000 7ff648c00640 1 -- 172.21.15.114:0/317145621 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff6400ebfe0 con 0x7ff64c0c1eb0 2024-02-17T12:17:24.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:24.390+0000 7ff653800640 1 -- 172.21.15.114:0/317145621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff64c13e510 con 0x7ff64c0c1eb0 2024-02-17T12:17:25.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.334+0000 7ff648c00640 1 -- 172.21.15.114:0/317145621 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7ff6400ef6a0 con 0x7ff64c0c1eb0 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 -- 172.21.15.114:0/317145621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff62c066e40 msgr2=0x7ff62c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff62c066e40 0x7ff62c069300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff64c141010 tx=0x7ff638008040 comp rx=0 tx=0).stop 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 -- 172.21.15.114:0/317145621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c0c1eb0 msgr2=0x7ff64c1ec0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c0c1eb0 0x7ff64c1ec0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff6400af040 tx=0x7ff64001ac00 comp rx=0 tx=0).stop 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 -- 172.21.15.114:0/317145621 shutdown_connections 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff64c14f110 0x7ff64c139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64c0c2580 0x7ff64c14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff62c066e40 0x7ff62c069300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 --2- 172.21.15.114:0/317145621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c0c1eb0 0x7ff64c1ec0a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 -- 172.21.15.114:0/317145621 >> 172.21.15.114:0/317145621 conn(0x7ff64c0a8490 msgr2=0x7ff64c0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:25.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 -- 172.21.15.114:0/317145621 shutdown_connections 2024-02-17T12:17:25.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.338+0000 7ff653800640 1 -- 172.21.15.114:0/317145621 wait complete. 2024-02-17T12:17:25.366 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-17T12:17:25.366 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-02-17T12:17:25.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c93400640 1 Processor -- start 2024-02-17T12:17:25.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c93400640 1 -- start start 2024-02-17T12:17:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c93400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c14f110 0x7f5c8c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c93400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5c8c0c1eb0 0x7f5c8c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c93400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8c0a9420 con 0x7f5c8c0c2580 2024-02-17T12:17:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c93400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8c14f4f0 con 0x7f5c8c0c1eb0 2024-02-17T12:17:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c93400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c0aae80 con 0x7f5c8c14f110 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c8be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5c8c0c2580 0x7f5c8c0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52662/0 (socket says 172.21.15.114:52662) 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c8be00640 1 -- 172.21.15.114:0/3135874722 learned_addr learned my addr 172.21.15.114:0/3135874722 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c91400640 1 --2- 172.21.15.114:0/3135874722 >> v2:172.21.15.116:3300/0 conn(0x7f5c8c0c1eb0 0x7f5c8c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c90a00640 1 --2- 172.21.15.114:0/3135874722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c14f110 0x7f5c8c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c8b400640 1 -- 172.21.15.114:0/3135874722 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911538942 0 0) 0x7f5c8c0a9420 con 0x7f5c8c0c2580 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c8b400640 1 -- 172.21.15.114:0/3135874722 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c70003530 con 0x7f5c8c0c2580 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c90a00640 1 -- 172.21.15.114:0/3135874722 >> v2:172.21.15.116:3300/0 conn(0x7f5c8c0c1eb0 msgr2=0x7f5c8c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c90a00640 1 --2- 172.21.15.114:0/3135874722 >> v2:172.21.15.116:3300/0 conn(0x7f5c8c0c1eb0 0x7f5c8c15c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c90a00640 1 -- 172.21.15.114:0/3135874722 >> v1:172.21.15.114:6789/0 conn(0x7f5c8c0c2580 legacy=0x7f5c8c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c90a00640 1 -- 172.21.15.114:0/3135874722 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c152850 con 0x7f5c8c14f110 2024-02-17T12:17:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.502+0000 7f5c91400640 1 --2- 172.21.15.114:0/3135874722 >> v2:172.21.15.116:3300/0 conn(0x7f5c8c0c1eb0 0x7f5c8c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:25.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c90a00640 1 --2- 172.21.15.114:0/3135874722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c14f110 0x7f5c8c0c65a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009d90 tx=0x7f5c7c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41cfbed554b572ac server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:25.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c8b400640 1 -- 172.21.15.114:0/3135874722 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c0a5970 con 0x7f5c8c14f110 2024-02-17T12:17:25.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c8b400640 1 -- 172.21.15.114:0/3135874722 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c0a5ad0 con 0x7f5c8c14f110 2024-02-17T12:17:25.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c8b400640 1 -- 172.21.15.114:0/3135874722 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c0a5e60 con 0x7f5c8c14f110 2024-02-17T12:17:25.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c93400640 1 -- 172.21.15.114:0/3135874722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c14f110 msgr2=0x7f5c8c0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:25.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c93400640 1 --2- 172.21.15.114:0/3135874722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c14f110 0x7f5c8c0c65a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009d90 tx=0x7f5c7c01c8b0 comp rx=0 tx=0).stop 2024-02-17T12:17:25.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c93400640 1 -- 172.21.15.114:0/3135874722 shutdown_connections 2024-02-17T12:17:25.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c93400640 1 --2- 172.21.15.114:0/3135874722 >> v2:172.21.15.116:3300/0 conn(0x7f5c8c0c1eb0 0x7f5c8c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:25.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c93400640 1 --2- 172.21.15.114:0/3135874722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c14f110 0x7f5c8c0c65a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:25.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c93400640 1 -- 172.21.15.114:0/3135874722 >> 172.21.15.114:0/3135874722 conn(0x7f5c8c0a8490 msgr2=0x7f5c8c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:25.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c93400640 1 -- 172.21.15.114:0/3135874722 shutdown_connections 2024-02-17T12:17:25.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c93400640 1 -- 172.21.15.114:0/3135874722 wait complete. 2024-02-17T12:17:25.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c93400640 1 Processor -- start 2024-02-17T12:17:25.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.506+0000 7f5c93400640 1 -- start start 2024-02-17T12:17:25.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c93400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c0c1eb0 0x7f5c8c141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:25.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c93400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c8c0c2580 0x7f5c8c154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c93400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c8c14f110 0x7f5c8c14d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c93400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c155380 con 0x7f5c8c0c2580 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c93400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c142270 con 0x7f5c8c14f110 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c93400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c1f15b0 con 0x7f5c8c0c1eb0 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c8be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c8c0c2580 0x7f5c8c154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c8be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c8c0c2580 0x7f5c8c154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56008/0 (socket says 172.21.15.114:56008) 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c8be00640 1 -- 172.21.15.114:0/791158118 learned_addr learned my addr 172.21.15.114:0/791158118 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c91400640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c8c14f110 0x7f5c8c14d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c90a00640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c0c1eb0 0x7f5c8c141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c8be00640 1 -- 172.21.15.114:0/791158118 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c0c1eb0 msgr2=0x7f5c8c141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c8be00640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c0c1eb0 0x7f5c8c141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:25.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c8be00640 1 -- 172.21.15.114:0/791158118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c8c14f110 msgr2=0x7f5c8c14d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:25.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c8be00640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c8c14f110 0x7f5c8c14d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:25.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c8be00640 1 -- 172.21.15.114:0/791158118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c84009420 con 0x7f5c8c0c2580 2024-02-17T12:17:25.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c90a00640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c0c1eb0 0x7f5c8c141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:25.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c8be00640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c8c0c2580 0x7f5c8c154870 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800c420 tx=0x7f5c7800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:25.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c88c00640 1 -- 172.21.15.114:0/791158118 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78005cf0 con 0x7f5c8c0c2580 2024-02-17T12:17:25.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c88c00640 1 -- 172.21.15.114:0/791158118 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c78005e70 con 0x7f5c8c0c2580 2024-02-17T12:17:25.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c88c00640 1 -- 172.21.15.114:0/791158118 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780072f0 con 0x7f5c8c0c2580 2024-02-17T12:17:25.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c93400640 1 -- 172.21.15.114:0/791158118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c009a70 con 0x7f5c8c0c2580 2024-02-17T12:17:25.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c93400640 1 -- 172.21.15.114:0/791158118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8c1f1b70 con 0x7f5c8c0c2580 2024-02-17T12:17:25.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.510+0000 7f5c93400640 1 -- 172.21.15.114:0/791158118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8c074840 con 0x7f5c8c0c2580 2024-02-17T12:17:25.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.514+0000 7f5c88c00640 1 -- 172.21.15.114:0/791158118 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f5c78007450 con 0x7f5c8c0c2580 2024-02-17T12:17:25.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.514+0000 7f5c88c00640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5c6c066e40 0x7f5c6c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:25.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.514+0000 7f5c88c00640 1 -- 172.21.15.114:0/791158118 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5c780843f0 con 0x7f5c8c0c2580 2024-02-17T12:17:25.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.514+0000 7f5c90a00640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5c6c066e40 0x7f5c6c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:25.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.514+0000 7f5c90a00640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5c6c066e40 0x7f5c6c069300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0af000 tx=0x7f5c7c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:25.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.518+0000 7f5c88c00640 1 -- 172.21.15.114:0/791158118 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5c78050f30 con 0x7f5c8c0c2580 2024-02-17T12:17:25.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:25.702+0000 7f5c93400640 1 -- 172.21.15.114:0/791158118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5c8c155ea0 con 0x7f5c8c0c2580 2024-02-17T12:17:25.832 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-02-17T12:17:25.826+0000 7f0b5fc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:17:26.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c88c00640 1 -- 172.21.15.114:0/791158118 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5c780545f0 con 0x7f5c8c0c2580 2024-02-17T12:17:26.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 -- 172.21.15.114:0/791158118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5c6c066e40 msgr2=0x7f5c6c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5c6c066e40 0x7f5c6c069300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0af000 tx=0x7f5c7c0a7070 comp rx=0 tx=0).stop 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 -- 172.21.15.114:0/791158118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c8c0c2580 msgr2=0x7f5c8c154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c8c0c2580 0x7f5c8c154870 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800c420 tx=0x7f5c7800c820 comp rx=0 tx=0).stop 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 -- 172.21.15.114:0/791158118 shutdown_connections 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5c8c14f110 0x7f5c8c14d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5c6c066e40 0x7f5c6c069300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c8c0c2580 0x7f5c8c154870 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 --2- 172.21.15.114:0/791158118 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5c8c0c1eb0 0x7f5c8c141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 -- 172.21.15.114:0/791158118 >> 172.21.15.114:0/791158118 conn(0x7f5c8c0a8490 msgr2=0x7f5c8c14c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 -- 172.21.15.114:0/791158118 shutdown_connections 2024-02-17T12:17:26.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.338+0000 7f5c93400640 1 -- 172.21.15.114:0/791158118 wait complete. 2024-02-17T12:17:26.370 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-02-17T12:17:26.370 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:26.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52cae00640 1 Processor -- start 2024-02-17T12:17:26.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52cae00640 1 -- start start 2024-02-17T12:17:26.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52cae00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f52c4158660 0x7f52c40c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52cae00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c406bd20 0x7f52c406c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52cae00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c4159150 con 0x7f52c40c59a0 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52cae00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c40c3440 con 0x7f52c4158660 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52cae00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40c6800 con 0x7f52c406bd20 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c9000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f52c40c59a0 0x7f52c4158a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52672/0 (socket says 172.21.15.114:52672) 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c9000640 1 -- 172.21.15.114:0/2817019432 learned_addr learned my addr 172.21.15.114:0/2817019432 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52ca400640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c406bd20 0x7f52c406c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c9a00640 1 --2- 172.21.15.114:0/2817019432 >> v2:172.21.15.116:3300/0 conn(0x7f52c4158660 0x7f52c40c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032357668 0 0) 0x7f52b4001120 con 0x7f52c40c59a0 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ac003530 con 0x7f52c40c59a0 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1329010698 0 0) 0x7f52ac003530 con 0x7f52c40c59a0 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c406bd20 msgr2=0x7f52c406c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c406bd20 0x7f52c406c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 >> v2:172.21.15.116:3300/0 conn(0x7f52c4158660 msgr2=0x7f52c40c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 --2- 172.21.15.114:0/2817019432 >> v2:172.21.15.116:3300/0 conn(0x7f52c4158660 0x7f52c40c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40c5510 con 0x7f52c40c59a0 2024-02-17T12:17:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f52b4001810 con 0x7f52c40c59a0 2024-02-17T12:17:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 >> v1:172.21.15.114:6789/0 conn(0x7f52c40c59a0 legacy=0x7f52c4158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c406bd20 0x7f52ac003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 0x7f52ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52ac004d10 0x7f52ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40c3440 con 0x7f52ac003f00 2024-02-17T12:17:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40c6800 con 0x7f52ac004d10 2024-02-17T12:17:26.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac00b9e0 con 0x7f52c406bd20 2024-02-17T12:17:26.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c9000640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 0x7f52ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c9a00640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c406bd20 0x7f52ac003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52ca400640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52ac004d10 0x7f52ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c9000640 1 -- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c406bd20 msgr2=0x7f52ac003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:26.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c9000640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c406bd20 0x7f52ac003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c9000640 1 -- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52ac004d10 msgr2=0x7f52ac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:26.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c9000640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52ac004d10 0x7f52ac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.502+0000 7f52c9000640 1 -- 172.21.15.114:0/2817019432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac003530 con 0x7f52ac003f00 2024-02-17T12:17:26.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52c9000640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 0x7f52ac0047d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f52b400c270 tx=0x7f52b401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b575d561c0439ba7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:26.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b40058e0 con 0x7f52ac003f00 2024-02-17T12:17:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b4005a60 con 0x7f52ac003f00 2024-02-17T12:17:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52c3e00640 1 -- 172.21.15.114:0/2817019432 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4005e50 con 0x7f52ac003f00 2024-02-17T12:17:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52cae00640 1 -- 172.21.15.114:0/2817019432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 msgr2=0x7f52ac0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52cae00640 1 --2- 172.21.15.114:0/2817019432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 0x7f52ac0047d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f52b400c270 tx=0x7f52b401cc60 comp rx=0 tx=0).stop 2024-02-17T12:17:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52ca400640 1 -- 172.21.15.114:0/2817019432 reap_dead start 2024-02-17T12:17:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52cae00640 1 -- 172.21.15.114:0/2817019432 shutdown_connections 2024-02-17T12:17:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52cae00640 1 -- 172.21.15.114:0/2817019432 >> 172.21.15.114:0/2817019432 conn(0x7f52c4066960 msgr2=0x7f52c4066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52cae00640 1 -- 172.21.15.114:0/2817019432 shutdown_connections 2024-02-17T12:17:26.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.506+0000 7f52cae00640 1 -- 172.21.15.114:0/2817019432 wait complete. 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 Processor -- start 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 -- start start 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 0x7f52c40ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c40c8660 0x7f52c40703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52c41f0d80 0x7f52c41f1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c41ee8c0 con 0x7f52ac003f00 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40c7430 con 0x7f52c41f0d80 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40ac870 con 0x7f52c40c8660 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 0x7f52c40ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 0x7f52c40ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56036/0 (socket says 172.21.15.114:56036) 2024-02-17T12:17:26.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9a00640 1 -- 172.21.15.114:0/2698940785 learned_addr learned my addr 172.21.15.114:0/2698940785 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52ca400640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52c41f0d80 0x7f52c41f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9000640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c40c8660 0x7f52c40703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9a00640 1 -- 172.21.15.114:0/2698940785 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c40c8660 msgr2=0x7f52c40703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9a00640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c40c8660 0x7f52c40703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9a00640 1 -- 172.21.15.114:0/2698940785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52c41f0d80 msgr2=0x7f52c41f1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9a00640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52c41f0d80 0x7f52c41f1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9a00640 1 -- 172.21.15.114:0/2698940785 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40c7680 con 0x7f52ac003f00 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9000640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c40c8660 0x7f52c40703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c9a00640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 0x7f52c40ac210 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f52b80115e0 tx=0x7f52b8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c1600640 1 -- 172.21.15.114:0/2698940785 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b800f8f0 con 0x7f52ac003f00 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c1600640 1 -- 172.21.15.114:0/2698940785 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b800fa50 con 0x7f52ac003f00 2024-02-17T12:17:26.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 -- 172.21.15.114:0/2698940785 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c40acb10 con 0x7f52ac003f00 2024-02-17T12:17:26.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52c1600640 1 -- 172.21.15.114:0/2698940785 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b800fdc0 con 0x7f52ac003f00 2024-02-17T12:17:26.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 -- 172.21.15.114:0/2698940785 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c414aec0 con 0x7f52ac003f00 2024-02-17T12:17:26.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.510+0000 7f52cae00640 1 -- 172.21.15.114:0/2698940785 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c4068180 con 0x7f52ac003f00 2024-02-17T12:17:26.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.514+0000 7f52c1600640 1 -- 172.21.15.114:0/2698940785 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f52b8015460 con 0x7f52ac003f00 2024-02-17T12:17:26.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.514+0000 7f52c1600640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52a8066e70 0x7f52a8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.514+0000 7f52c1600640 1 -- 172.21.15.114:0/2698940785 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f52b8085610 con 0x7f52ac003f00 2024-02-17T12:17:26.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.514+0000 7f52c9000640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52a8066e70 0x7f52a8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.514+0000 7f52c9000640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52a8066e70 0x7f52a8069330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f52b40aa000 tx=0x7f52c40c5e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:26.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.518+0000 7f52c1600640 1 -- 172.21.15.114:0/2698940785 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f52b8052090 con 0x7f52ac003f00 2024-02-17T12:17:26.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.702+0000 7f52cae00640 1 -- 172.21.15.114:0/2698940785 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52c41f09c0 con 0x7f52ac003f00 2024-02-17T12:17:26.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.702+0000 7f52c1600640 1 -- 172.21.15.114:0/2698940785 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6192 (secure 0 0 0) 0x7f52b805ae60 con 0x7f52ac003f00 2024-02-17T12:17:26.710 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:26.711 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:05.397716+0000","modified":"2024-02-17T12:17:08.427075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1473468479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1473468479},{"type":"v1","addr":"172.21.15.114:6837","nonce":1473468479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:22.698504+0000","modified":"2024-02-17T12:17:25.708127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4941},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4941":{"gid":4941,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/2833741536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2833741536},{"type":"v1","addr":"172.21.15.114:6836","nonce":2833741536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-02-17T12:17:26.711 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 22 2024-02-17T12:17:26.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 -- 172.21.15.114:0/2698940785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52a8066e70 msgr2=0x7f52a8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52a8066e70 0x7f52a8069330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f52b40aa000 tx=0x7f52c40c5e00 comp rx=0 tx=0).stop 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 -- 172.21.15.114:0/2698940785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 msgr2=0x7f52c40ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 0x7f52c40ac210 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f52b80115e0 tx=0x7f52b8011aa0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 -- 172.21.15.114:0/2698940785 shutdown_connections 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52c41f0d80 0x7f52c41f1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c40c8660 0x7f52c40703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52a8066e70 0x7f52a8069330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 --2- 172.21.15.114:0/2698940785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ac003f00 0x7f52c40ac210 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 -- 172.21.15.114:0/2698940785 >> 172.21.15.114:0/2698940785 conn(0x7f52c4066960 msgr2=0x7f52c406f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 -- 172.21.15.114:0/2698940785 shutdown_connections 2024-02-17T12:17:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.706+0000 7f52cae00640 1 -- 172.21.15.114:0/2698940785 wait complete. 2024-02-17T12:17:26.732 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:26.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.858+0000 7fbc4da00640 1 Processor -- start 2024-02-17T12:17:26.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.858+0000 7fbc4da00640 1 -- start start 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.858+0000 7fbc4da00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc480c25a0 0x7fbc4806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.858+0000 7fbc4da00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbc48152c50 0x7fbc481530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.858+0000 7fbc4da00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc48156270 con 0x7fbc4806db50 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.858+0000 7fbc4da00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc48071630 con 0x7fbc48152c50 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc4da00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48156550 con 0x7fbc480c25a0 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc3fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbc4806db50 0x7fbc4814ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52674/0 (socket says 172.21.15.114:52674) 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc3fe00640 1 -- 172.21.15.114:0/1807474180 learned_addr learned my addr 172.21.15.114:0/1807474180 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc47400640 1 --2- 172.21.15.114:0/1807474180 >> v2:172.21.15.116:3300/0 conn(0x7fbc48152c50 0x7fbc481530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46a00640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc480c25a0 0x7fbc4806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351399306 0 0) 0x7fbc48156270 con 0x7fbc4806db50 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc2c003530 con 0x7fbc4806db50 2024-02-17T12:17:26.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3425874176 0 0) 0x7fbc2c003530 con 0x7fbc4806db50 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc480c25a0 msgr2=0x7fbc4806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc480c25a0 0x7fbc4806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 >> v2:172.21.15.116:3300/0 conn(0x7fbc48152c50 msgr2=0x7fbc481530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 --2- 172.21.15.114:0/1807474180 >> v2:172.21.15.116:3300/0 conn(0x7fbc48152c50 0x7fbc481530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc48156830 con 0x7fbc4806db50 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fbc30001680 con 0x7fbc4806db50 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc47400640 1 --2- 172.21.15.114:0/1807474180 >> v2:172.21.15.116:3300/0 conn(0x7fbc48152c50 0x7fbc481530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 >> v1:172.21.15.114:6789/0 conn(0x7fbc4806db50 legacy=0x7fbc4814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc2c003980 0x7fbc2c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc2c0047d0 0x7fbc2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc480c25a0 0x7fbc2c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48156550 con 0x7fbc2c0047d0 2024-02-17T12:17:26.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c00b990 con 0x7fbc2c003980 2024-02-17T12:17:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c00bb50 con 0x7fbc480c25a0 2024-02-17T12:17:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc2c0047d0 0x7fbc2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc46a00640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc2c003980 0x7fbc2c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc47400640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc480c25a0 0x7fbc2c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc3fe00640 1 -- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc480c25a0 msgr2=0x7fbc2c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc480c25a0 0x7fbc2c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc3fe00640 1 -- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc2c003980 msgr2=0x7fbc2c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc2c003980 0x7fbc2c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.862+0000 7fbc3fe00640 1 -- 172.21.15.114:0/1807474180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c003530 con 0x7fbc2c0047d0 2024-02-17T12:17:26.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc2c0047d0 0x7fbc2c004c50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000c210 tx=0x7fbc3001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f92f9df965ba5db server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:26.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300a58f0 con 0x7fbc2c0047d0 2024-02-17T12:17:26.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc300a5a50 con 0x7fbc2c0047d0 2024-02-17T12:17:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc46000640 1 -- 172.21.15.114:0/1807474180 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300a5e00 con 0x7fbc2c0047d0 2024-02-17T12:17:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc4da00640 1 -- 172.21.15.114:0/1807474180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc2c0047d0 msgr2=0x7fbc2c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc4da00640 1 --2- 172.21.15.114:0/1807474180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc2c0047d0 0x7fbc2c004c50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000c210 tx=0x7fbc3001cc30 comp rx=0 tx=0).stop 2024-02-17T12:17:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc47400640 1 -- 172.21.15.114:0/1807474180 reap_dead start 2024-02-17T12:17:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc4da00640 1 -- 172.21.15.114:0/1807474180 shutdown_connections 2024-02-17T12:17:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc4da00640 1 -- 172.21.15.114:0/1807474180 >> 172.21.15.114:0/1807474180 conn(0x7fbc480a8490 msgr2=0x7fbc480a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc4da00640 1 -- 172.21.15.114:0/1807474180 shutdown_connections 2024-02-17T12:17:26.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc4da00640 1 -- 172.21.15.114:0/1807474180 wait complete. 2024-02-17T12:17:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc4da00640 1 Processor -- start 2024-02-17T12:17:26.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc4da00640 1 -- start start 2024-02-17T12:17:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc4da00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc2c0047d0 0x7fbc481512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.866+0000 7fbc4da00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc481475c0 0x7fbc4814f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc4da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc480ab290 0x7fbc48144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc4da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48151da0 con 0x7fbc480ab290 2024-02-17T12:17:26.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc4da00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc481f0fa0 con 0x7fbc2c0047d0 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc4da00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc481f14d0 con 0x7fbc481475c0 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc47400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc480ab290 0x7fbc48144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc47400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc480ab290 0x7fbc48144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56050/0 (socket says 172.21.15.114:56050) 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc47400640 1 -- 172.21.15.114:0/3445576421 learned_addr learned my addr 172.21.15.114:0/3445576421 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc46a00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc2c0047d0 0x7fbc481512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc481475c0 0x7fbc4814f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc47400640 1 -- 172.21.15.114:0/3445576421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc481475c0 msgr2=0x7fbc4814f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc47400640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc481475c0 0x7fbc4814f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc47400640 1 -- 172.21.15.114:0/3445576421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc2c0047d0 msgr2=0x7fbc481512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc47400640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc2c0047d0 0x7fbc481512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:26.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc47400640 1 -- 172.21.15.114:0/3445576421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc481f11f0 con 0x7fbc480ab290 2024-02-17T12:17:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc481475c0 0x7fbc4814f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc47400640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc480ab290 0x7fbc48144ec0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbc48153cb0 tx=0x7fbc4000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc3ea00640 1 -- 172.21.15.114:0/3445576421 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000e040 con 0x7fbc480ab290 2024-02-17T12:17:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc3ea00640 1 -- 172.21.15.114:0/3445576421 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4000f040 con 0x7fbc480ab290 2024-02-17T12:17:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc4da00640 1 -- 172.21.15.114:0/3445576421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc48150af0 con 0x7fbc480ab290 2024-02-17T12:17:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc3ea00640 1 -- 172.21.15.114:0/3445576421 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40003be0 con 0x7fbc480ab290 2024-02-17T12:17:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc4da00640 1 -- 172.21.15.114:0/3445576421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4814f550 con 0x7fbc480ab290 2024-02-17T12:17:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc4da00640 1 -- 172.21.15.114:0/3445576421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc48151010 con 0x7fbc480ab290 2024-02-17T12:17:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.870+0000 7fbc3ea00640 1 -- 172.21.15.114:0/3445576421 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbc40015430 con 0x7fbc480ab290 2024-02-17T12:17:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.874+0000 7fbc3ea00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc24066e40 0x7fbc24069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.874+0000 7fbc3ea00640 1 -- 172.21.15.114:0/3445576421 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbc400855f0 con 0x7fbc480ab290 2024-02-17T12:17:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.874+0000 7fbc46a00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc24066e40 0x7fbc24069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:26.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.874+0000 7fbc46a00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc24066e40 0x7fbc24069300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc480aade0 tx=0x7fbc38009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:26.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:26.874+0000 7fbc3ea00640 1 -- 172.21.15.114:0/3445576421 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbc48151010 con 0x7fbc480ab290 2024-02-17T12:17:27.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.030+0000 7fbc4da00640 1 -- 172.21.15.114:0/3445576421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc48151010 con 0x7fbc480ab290 2024-02-17T12:17:27.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc3ea00640 1 -- 172.21.15.114:0/3445576421 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20407 (secure 0 0 0) 0x7fbc48151010 con 0x7fbc480ab290 2024-02-17T12:17:27.040 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:27.040 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:24.325322+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:27.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 -- 172.21.15.114:0/3445576421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc24066e40 msgr2=0x7fbc24069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc24066e40 0x7fbc24069300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc480aade0 tx=0x7fbc38009190 comp rx=0 tx=0).stop 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 -- 172.21.15.114:0/3445576421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc480ab290 msgr2=0x7fbc48144ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc480ab290 0x7fbc48144ec0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbc48153cb0 tx=0x7fbc4000f580 comp rx=0 tx=0).stop 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 -- 172.21.15.114:0/3445576421 shutdown_connections 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc24066e40 0x7fbc24069300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc480ab290 0x7fbc48144ec0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc481475c0 0x7fbc4814f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 --2- 172.21.15.114:0/3445576421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc2c0047d0 0x7fbc481512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 -- 172.21.15.114:0/3445576421 >> 172.21.15.114:0/3445576421 conn(0x7fbc480a8490 msgr2=0x7fbc4814fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 -- 172.21.15.114:0/3445576421 shutdown_connections 2024-02-17T12:17:27.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.034+0000 7fbc4da00640 1 -- 172.21.15.114:0/3445576421 wait complete. 2024-02-17T12:17:27.061 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T12:17:27.061 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:17:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe81d200640 1 Processor -- start 2024-02-17T12:17:27.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe81d200640 1 -- start start 2024-02-17T12:17:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe81d200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8180714c0 0x7fe818156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe81d200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe818157270 con 0x7fe818152d30 2024-02-17T12:17:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe81d200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8180c3580 con 0x7fe818150300 2024-02-17T12:17:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe81d200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8180c6900 con 0x7fe8180714c0 2024-02-17T12:17:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe815400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8180714c0 0x7fe818156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe816800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe818152d30 0x7fe818153180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52690/0 (socket says 172.21.15.114:52690) 2024-02-17T12:17:27.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe816800640 1 -- 172.21.15.114:0/462809161 learned_addr learned my addr 172.21.15.114:0/462809161 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:27.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe815400640 1 -- 172.21.15.114:0/462809161 >> v1:172.21.15.116:6789/0 conn(0x7fe818150300 legacy=0x7fe8180aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:27.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe815400640 1 -- 172.21.15.114:0/462809161 >> v1:172.21.15.114:6789/0 conn(0x7fe818152d30 legacy=0x7fe818153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.190+0000 7fe815400640 1 -- 172.21.15.114:0/462809161 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180c2fc0 con 0x7fe8180714c0 2024-02-17T12:17:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe815400640 1 --2- 172.21.15.114:0/462809161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8180714c0 0x7fe818156d30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe8040097c0 tx=0x7fe80401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6fad3afbee086c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe814a00640 1 -- 172.21.15.114:0/462809161 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040ab600 con 0x7fe8180714c0 2024-02-17T12:17:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe814a00640 1 -- 172.21.15.114:0/462809161 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8040a7050 con 0x7fe8180714c0 2024-02-17T12:17:27.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe814a00640 1 -- 172.21.15.114:0/462809161 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040ab980 con 0x7fe8180714c0 2024-02-17T12:17:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe81d200640 1 -- 172.21.15.114:0/462809161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8180714c0 msgr2=0x7fe818156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe81d200640 1 --2- 172.21.15.114:0/462809161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8180714c0 0x7fe818156d30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe8040097c0 tx=0x7fe80401c3d0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe81d200640 1 -- 172.21.15.114:0/462809161 shutdown_connections 2024-02-17T12:17:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe81d200640 1 --2- 172.21.15.114:0/462809161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8180714c0 0x7fe818156d30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe81d200640 1 -- 172.21.15.114:0/462809161 >> 172.21.15.114:0/462809161 conn(0x7fe8180c4f20 msgr2=0x7fe8180c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:27.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe81d200640 1 -- 172.21.15.114:0/462809161 shutdown_connections 2024-02-17T12:17:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe81d200640 1 -- 172.21.15.114:0/462809161 wait complete. 2024-02-17T12:17:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe81d200640 1 Processor -- start 2024-02-17T12:17:27.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.194+0000 7fe81d200640 1 -- start start 2024-02-17T12:17:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe81d200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8180714c0 0x7fe81814e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe81d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818150300 0x7fe818153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe81d200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe818152d30 0x7fe818154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe81d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe818155e10 con 0x7fe818150300 2024-02-17T12:17:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe81d200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe818156e00 con 0x7fe818152d30 2024-02-17T12:17:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe81d200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81814cde0 con 0x7fe8180714c0 2024-02-17T12:17:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818150300 0x7fe818153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818150300 0x7fe818153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56056/0 (socket says 172.21.15.114:56056) 2024-02-17T12:17:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815400640 1 -- 172.21.15.114:0/2030235427 learned_addr learned my addr 172.21.15.114:0/2030235427 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe816800640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe818152d30 0x7fe818154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815e00640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8180714c0 0x7fe81814e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815400640 1 -- 172.21.15.114:0/2030235427 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8180714c0 msgr2=0x7fe81814e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815400640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8180714c0 0x7fe81814e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815400640 1 -- 172.21.15.114:0/2030235427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe818152d30 msgr2=0x7fe818154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815400640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe818152d30 0x7fe818154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815400640 1 -- 172.21.15.114:0/2030235427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804009420 con 0x7fe818150300 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe816800640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe818152d30 0x7fe818154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815e00640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8180714c0 0x7fe81814e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe815400640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818150300 0x7fe818153f50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe804018fe0 tx=0x7fe804019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe80e000640 1 -- 172.21.15.114:0/2030235427 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040b4430 con 0x7fe818150300 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe80e000640 1 -- 172.21.15.114:0/2030235427 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8040b4590 con 0x7fe818150300 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe80e000640 1 -- 172.21.15.114:0/2030235427 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040b4940 con 0x7fe818150300 2024-02-17T12:17:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe81d200640 1 -- 172.21.15.114:0/2030235427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81814c4b0 con 0x7fe818150300 2024-02-17T12:17:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe81d200640 1 -- 172.21.15.114:0/2030235427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81814ca70 con 0x7fe818150300 2024-02-17T12:17:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe81d200640 1 -- 172.21.15.114:0/2030235427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe818074840 con 0x7fe818150300 2024-02-17T12:17:27.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.198+0000 7fe80e000640 1 -- 172.21.15.114:0/2030235427 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe8040b2040 con 0x7fe818150300 2024-02-17T12:17:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.202+0000 7fe80e000640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 0x7fe7f8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.202+0000 7fe80e000640 1 -- 172.21.15.114:0/2030235427 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe80411ecb0 con 0x7fe818150300 2024-02-17T12:17:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.202+0000 7fe815e00640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 0x7fe7f8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.202+0000 7fe815e00640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 0x7fe7f8069300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe80800a850 tx=0x7fe808008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:27.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.206+0000 7fe80e000640 1 -- 172.21.15.114:0/2030235427 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe8040eb7d0 con 0x7fe818150300 2024-02-17T12:17:27.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.358+0000 7fe81d200640 1 -- 172.21.15.114:0/2030235427 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe818153890 con 0x7fe7f8066e40 2024-02-17T12:17:27.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.374+0000 7fe80e000640 1 -- 172.21.15.114:0/2030235427 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527492 (secure 0 0 0) 0x7fe80800ae80 con 0x7fe7f8066e40 2024-02-17T12:17:27.387 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:27.391 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:17:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.378+0000 7fe81d200640 1 -- 172.21.15.114:0/2030235427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 msgr2=0x7fe7f8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.378+0000 7fe81d200640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 0x7fe7f8069300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe80800a850 tx=0x7fe808008040 comp rx=0 tx=0).stop 2024-02-17T12:17:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.378+0000 7fe81d200640 1 -- 172.21.15.114:0/2030235427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818150300 msgr2=0x7fe818153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.378+0000 7fe81d200640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818150300 0x7fe818153f50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe804018fe0 tx=0x7fe804019170 comp rx=0 tx=0).stop 2024-02-17T12:17:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.378+0000 7fe81d200640 1 -- 172.21.15.114:0/2030235427 shutdown_connections 2024-02-17T12:17:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.378+0000 7fe81d200640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe818152d30 0x7fe818154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.378+0000 7fe81d200640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe7f8066e40 0x7fe7f8069300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.378+0000 7fe81d200640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe818150300 0x7fe818153f50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.378+0000 7fe81d200640 1 --2- 172.21.15.114:0/2030235427 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8180714c0 0x7fe81814e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.378+0000 7fe81d200640 1 -- 172.21.15.114:0/2030235427 >> 172.21.15.114:0/2030235427 conn(0x7fe8180c4f20 msgr2=0x7fe81815df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:27.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.382+0000 7fe81d200640 1 -- 172.21.15.114:0/2030235427 shutdown_connections 2024-02-17T12:17:27.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.382+0000 7fe81d200640 1 -- 172.21.15.114:0/2030235427 wait complete. 2024-02-17T12:17:27.405 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-02-17T12:17:27.229666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596691,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224712,"kb_used_data":4388,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750008,"statfs":{"total":773094113280,"available":772864008192,"internally_reserved":0,"allocated":4493312,"data_stored":2486439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.918718"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405815+0000","last_change":"2024-02-17T12:17:23.350089+0000","last_active":"2024-02-17T12:17:24.405815+0000","last_peered":"2024-02-17T12:17:24.405815+0000","last_clean":"2024-02-17T12:17:24.405815+0000","last_became_active":"2024-02-17T12:17:23.349766+0000","last_became_peered":"2024-02-17T12:17:23.349766+0000","last_unstale":"2024-02-17T12:17:24.405815+0000","last_undegraded":"2024-02-17T12:17:24.405815+0000","last_fullsized":"2024-02-17T12:17:24.405815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:18:31.192739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322378+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:17:23.322378+0000","last_peered":"2024-02-17T12:17:23.322378+0000","last_clean":"2024-02-17T12:17:23.322378+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:17:23.322378+0000","last_undegraded":"2024-02-17T12:17:23.322378+0000","last_fullsized":"2024-02-17T12:17:23.322378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340374+0000","last_change":"2024-02-17T12:17:05.036734+0000","last_active":"2024-02-17T12:17:24.340374+0000","last_peered":"2024-02-17T12:17:24.340374+0000","last_clean":"2024-02-17T12:17:24.340374+0000","last_became_active":"2024-02-17T12:17:05.036453+0000","last_became_peered":"2024-02-17T12:17:05.036453+0000","last_unstale":"2024-02-17T12:17:24.340374+0000","last_undegraded":"2024-02-17T12:17:24.340374+0000","last_fullsized":"2024-02-17T12:17:24.340374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322802+0000","last_change":"2024-02-17T12:17:06.057194+0000","last_active":"2024-02-17T12:17:23.322802+0000","last_peered":"2024-02-17T12:17:23.322802+0000","last_clean":"2024-02-17T12:17:23.322802+0000","last_became_active":"2024-02-17T12:17:06.056898+0000","last_became_peered":"2024-02-17T12:17:06.056898+0000","last_unstale":"2024-02-17T12:17:23.322802+0000","last_undegraded":"2024-02-17T12:17:23.322802+0000","last_fullsized":"2024-02-17T12:17:23.322802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:06:21.529406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342277+0000","last_change":"2024-02-17T12:17:22.337896+0000","last_active":"2024-02-17T12:17:24.342277+0000","last_peered":"2024-02-17T12:17:24.342277+0000","last_clean":"2024-02-17T12:17:24.342277+0000","last_became_active":"2024-02-17T12:17:22.337632+0000","last_became_peered":"2024-02-17T12:17:22.337632+0000","last_unstale":"2024-02-17T12:17:24.342277+0000","last_undegraded":"2024-02-17T12:17:24.342277+0000","last_fullsized":"2024-02-17T12:17:24.342277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:42:51.719748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350963+0000","last_change":"2024-02-17T12:17:23.345743+0000","last_active":"2024-02-17T12:17:24.350963+0000","last_peered":"2024-02-17T12:17:24.350963+0000","last_clean":"2024-02-17T12:17:24.350963+0000","last_became_active":"2024-02-17T12:17:23.345454+0000","last_became_peered":"2024-02-17T12:17:23.345454+0000","last_unstale":"2024-02-17T12:17:24.350963+0000","last_undegraded":"2024-02-17T12:17:24.350963+0000","last_fullsized":"2024-02-17T12:17:24.350963+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:11.167970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350805+0000","last_change":"2024-02-17T12:17:05.036670+0000","last_active":"2024-02-17T12:17:24.350805+0000","last_peered":"2024-02-17T12:17:24.350805+0000","last_clean":"2024-02-17T12:17:24.350805+0000","last_became_active":"2024-02-17T12:17:05.036395+0000","last_became_peered":"2024-02-17T12:17:05.036395+0000","last_unstale":"2024-02-17T12:17:24.350805+0000","last_undegraded":"2024-02-17T12:17:24.350805+0000","last_fullsized":"2024-02-17T12:17:24.350805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:39.036706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330272+0000","last_change":"2024-02-17T12:17:06.060773+0000","last_active":"2024-02-17T12:17:23.330272+0000","last_peered":"2024-02-17T12:17:23.330272+0000","last_clean":"2024-02-17T12:17:23.330272+0000","last_became_active":"2024-02-17T12:17:06.060435+0000","last_became_peered":"2024-02-17T12:17:06.060435+0000","last_unstale":"2024-02-17T12:17:23.330272+0000","last_undegraded":"2024-02-17T12:17:23.330272+0000","last_fullsized":"2024-02-17T12:17:23.330272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:24.540105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330533+0000","last_change":"2024-02-17T12:17:22.327566+0000","last_active":"2024-02-17T12:17:23.330533+0000","last_peered":"2024-02-17T12:17:23.330533+0000","last_clean":"2024-02-17T12:17:23.330533+0000","last_became_active":"2024-02-17T12:17:22.327132+0000","last_became_peered":"2024-02-17T12:17:22.327132+0000","last_unstale":"2024-02-17T12:17:23.330533+0000","last_undegraded":"2024-02-17T12:17:23.330533+0000","last_fullsized":"2024-02-17T12:17:23.330533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:31.894104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351164+0000","last_change":"2024-02-17T12:17:23.344974+0000","last_active":"2024-02-17T12:17:24.351164+0000","last_peered":"2024-02-17T12:17:24.351164+0000","last_clean":"2024-02-17T12:17:24.351164+0000","last_became_active":"2024-02-17T12:17:23.344704+0000","last_became_peered":"2024-02-17T12:17:23.344704+0000","last_unstale":"2024-02-17T12:17:24.351164+0000","last_undegraded":"2024-02-17T12:17:24.351164+0000","last_fullsized":"2024-02-17T12:17:24.351164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:30:21.314740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330516+0000","last_change":"2024-02-17T12:17:05.024299+0000","last_active":"2024-02-17T12:17:23.330516+0000","last_peered":"2024-02-17T12:17:23.330516+0000","last_clean":"2024-02-17T12:17:23.330516+0000","last_became_active":"2024-02-17T12:17:05.023219+0000","last_became_peered":"2024-02-17T12:17:05.023219+0000","last_unstale":"2024-02-17T12:17:23.330516+0000","last_undegraded":"2024-02-17T12:17:23.330516+0000","last_fullsized":"2024-02-17T12:17:23.330516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:32:32.560419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350697+0000","last_change":"2024-02-17T12:17:06.048841+0000","last_active":"2024-02-17T12:17:24.350697+0000","last_peered":"2024-02-17T12:17:24.350697+0000","last_clean":"2024-02-17T12:17:24.350697+0000","last_became_active":"2024-02-17T12:17:06.048593+0000","last_became_peered":"2024-02-17T12:17:06.048593+0000","last_unstale":"2024-02-17T12:17:24.350697+0000","last_undegraded":"2024-02-17T12:17:24.350697+0000","last_fullsized":"2024-02-17T12:17:24.350697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:15.140333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322268+0000","last_change":"2024-02-17T12:17:22.341384+0000","last_active":"2024-02-17T12:17:23.322268+0000","last_peered":"2024-02-17T12:17:23.322268+0000","last_clean":"2024-02-17T12:17:23.322268+0000","last_became_active":"2024-02-17T12:17:22.341126+0000","last_became_peered":"2024-02-17T12:17:22.341126+0000","last_unstale":"2024-02-17T12:17:23.322268+0000","last_undegraded":"2024-02-17T12:17:23.322268+0000","last_fullsized":"2024-02-17T12:17:23.322268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:41.942390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.349447+0000","last_change":"2024-02-17T12:17:23.348296+0000","last_active":"2024-02-17T12:17:23.349447+0000","last_peered":"2024-02-17T12:17:23.349447+0000","last_clean":"2024-02-17T12:17:23.349447+0000","last_became_active":"2024-02-17T12:17:23.347880+0000","last_became_peered":"2024-02-17T12:17:23.347880+0000","last_unstale":"2024-02-17T12:17:23.349447+0000","last_undegraded":"2024-02-17T12:17:23.349447+0000","last_fullsized":"2024-02-17T12:17:23.349447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:09:42.753986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335699+0000","last_change":"2024-02-17T12:17:05.026508+0000","last_active":"2024-02-17T12:17:24.335699+0000","last_peered":"2024-02-17T12:17:24.335699+0000","last_clean":"2024-02-17T12:17:24.335699+0000","last_became_active":"2024-02-17T12:17:05.026238+0000","last_became_peered":"2024-02-17T12:17:05.026238+0000","last_unstale":"2024-02-17T12:17:24.335699+0000","last_undegraded":"2024-02-17T12:17:24.335699+0000","last_fullsized":"2024-02-17T12:17:24.335699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405430+0000","last_change":"2024-02-17T12:17:06.047590+0000","last_active":"2024-02-17T12:17:24.405430+0000","last_peered":"2024-02-17T12:17:24.405430+0000","last_clean":"2024-02-17T12:17:24.405430+0000","last_became_active":"2024-02-17T12:17:06.046851+0000","last_became_peered":"2024-02-17T12:17:06.046851+0000","last_unstale":"2024-02-17T12:17:24.405430+0000","last_undegraded":"2024-02-17T12:17:24.405430+0000","last_fullsized":"2024-02-17T12:17:24.405430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:35.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405224+0000","last_change":"2024-02-17T12:17:22.327178+0000","last_active":"2024-02-17T12:17:24.405224+0000","last_peered":"2024-02-17T12:17:24.405224+0000","last_clean":"2024-02-17T12:17:24.405224+0000","last_became_active":"2024-02-17T12:17:22.326706+0000","last_became_peered":"2024-02-17T12:17:22.326706+0000","last_unstale":"2024-02-17T12:17:24.405224+0000","last_undegraded":"2024-02-17T12:17:24.405224+0000","last_fullsized":"2024-02-17T12:17:24.405224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:31.435224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340742+0000","last_change":"2024-02-17T12:17:23.340021+0000","last_active":"2024-02-17T12:17:24.340742+0000","last_peered":"2024-02-17T12:17:24.340742+0000","last_clean":"2024-02-17T12:17:24.340742+0000","last_became_active":"2024-02-17T12:17:23.339716+0000","last_became_peered":"2024-02-17T12:17:23.339716+0000","last_unstale":"2024-02-17T12:17:24.340742+0000","last_undegraded":"2024-02-17T12:17:24.340742+0000","last_fullsized":"2024-02-17T12:17:24.340742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:16:27.358514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405698+0000","last_change":"2024-02-17T12:17:05.034917+0000","last_active":"2024-02-17T12:17:24.405698+0000","last_peered":"2024-02-17T12:17:24.405698+0000","last_clean":"2024-02-17T12:17:24.405698+0000","last_became_active":"2024-02-17T12:17:05.034653+0000","last_became_peered":"2024-02-17T12:17:05.034653+0000","last_unstale":"2024-02-17T12:17:24.405698+0000","last_undegraded":"2024-02-17T12:17:24.405698+0000","last_fullsized":"2024-02-17T12:17:24.405698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339751+0000","last_change":"2024-02-17T12:17:06.051204+0000","last_active":"2024-02-17T12:17:24.339751+0000","last_peered":"2024-02-17T12:17:24.339751+0000","last_clean":"2024-02-17T12:17:24.339751+0000","last_became_active":"2024-02-17T12:17:06.050919+0000","last_became_peered":"2024-02-17T12:17:06.050919+0000","last_unstale":"2024-02-17T12:17:24.339751+0000","last_undegraded":"2024-02-17T12:17:24.339751+0000","last_fullsized":"2024-02-17T12:17:24.339751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:40.043966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335462+0000","last_change":"2024-02-17T12:17:22.342158+0000","last_active":"2024-02-17T12:17:24.335462+0000","last_peered":"2024-02-17T12:17:24.335462+0000","last_clean":"2024-02-17T12:17:24.335462+0000","last_became_active":"2024-02-17T12:17:22.341688+0000","last_became_peered":"2024-02-17T12:17:22.341688+0000","last_unstale":"2024-02-17T12:17:24.335462+0000","last_undegraded":"2024-02-17T12:17:24.335462+0000","last_fullsized":"2024-02-17T12:17:24.335462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:34:37.472041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340920+0000","last_change":"2024-02-17T12:17:23.353713+0000","last_active":"2024-02-17T12:17:24.340920+0000","last_peered":"2024-02-17T12:17:24.340920+0000","last_clean":"2024-02-17T12:17:24.340920+0000","last_became_active":"2024-02-17T12:17:23.351428+0000","last_became_peered":"2024-02-17T12:17:23.351428+0000","last_unstale":"2024-02-17T12:17:24.340920+0000","last_undegraded":"2024-02-17T12:17:24.340920+0000","last_fullsized":"2024-02-17T12:17:24.340920+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:23:47.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336208+0000","last_change":"2024-02-17T12:17:05.037708+0000","last_active":"2024-02-17T12:17:24.336208+0000","last_peered":"2024-02-17T12:17:24.336208+0000","last_clean":"2024-02-17T12:17:24.336208+0000","last_became_active":"2024-02-17T12:17:05.037213+0000","last_became_peered":"2024-02-17T12:17:05.037213+0000","last_unstale":"2024-02-17T12:17:24.336208+0000","last_undegraded":"2024-02-17T12:17:24.336208+0000","last_fullsized":"2024-02-17T12:17:24.336208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405481+0000","last_change":"2024-02-17T12:17:06.039368+0000","last_active":"2024-02-17T12:17:24.405481+0000","last_peered":"2024-02-17T12:17:24.405481+0000","last_clean":"2024-02-17T12:17:24.405481+0000","last_became_active":"2024-02-17T12:17:06.039047+0000","last_became_peered":"2024-02-17T12:17:06.039047+0000","last_unstale":"2024-02-17T12:17:24.405481+0000","last_undegraded":"2024-02-17T12:17:24.405481+0000","last_fullsized":"2024-02-17T12:17:24.405481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:07.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.353531+0000","last_change":"2024-02-17T12:17:22.332971+0000","last_active":"2024-02-17T12:17:24.353531+0000","last_peered":"2024-02-17T12:17:24.353531+0000","last_clean":"2024-02-17T12:17:24.353531+0000","last_became_active":"2024-02-17T12:17:22.332679+0000","last_became_peered":"2024-02-17T12:17:22.332679+0000","last_unstale":"2024-02-17T12:17:24.353531+0000","last_undegraded":"2024-02-17T12:17:24.353531+0000","last_fullsized":"2024-02-17T12:17:24.353531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:44:45.541886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.347165+0000","last_change":"2024-02-17T12:17:23.340465+0000","last_active":"2024-02-17T12:17:23.347165+0000","last_peered":"2024-02-17T12:17:23.347165+0000","last_clean":"2024-02-17T12:17:23.347165+0000","last_became_active":"2024-02-17T12:17:23.340144+0000","last_became_peered":"2024-02-17T12:17:23.340144+0000","last_unstale":"2024-02-17T12:17:23.347165+0000","last_undegraded":"2024-02-17T12:17:23.347165+0000","last_fullsized":"2024-02-17T12:17:23.347165+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:53:22.233526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405994+0000","last_change":"2024-02-17T12:17:05.039517+0000","last_active":"2024-02-17T12:17:24.405994+0000","last_peered":"2024-02-17T12:17:24.405994+0000","last_clean":"2024-02-17T12:17:24.405994+0000","last_became_active":"2024-02-17T12:17:05.039209+0000","last_became_peered":"2024-02-17T12:17:05.039209+0000","last_unstale":"2024-02-17T12:17:24.405994+0000","last_undegraded":"2024-02-17T12:17:24.405994+0000","last_fullsized":"2024-02-17T12:17:24.405994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342436+0000","last_change":"2024-02-17T12:17:06.060996+0000","last_active":"2024-02-17T12:17:24.342436+0000","last_peered":"2024-02-17T12:17:24.342436+0000","last_clean":"2024-02-17T12:17:24.342436+0000","last_became_active":"2024-02-17T12:17:06.060713+0000","last_became_peered":"2024-02-17T12:17:06.060713+0000","last_unstale":"2024-02-17T12:17:24.342436+0000","last_undegraded":"2024-02-17T12:17:24.342436+0000","last_fullsized":"2024-02-17T12:17:24.342436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:49:48.671656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335675+0000","last_change":"2024-02-17T12:17:22.334681+0000","last_active":"2024-02-17T12:17:24.335675+0000","last_peered":"2024-02-17T12:17:24.335675+0000","last_clean":"2024-02-17T12:17:24.335675+0000","last_became_active":"2024-02-17T12:17:22.334179+0000","last_became_peered":"2024-02-17T12:17:22.334179+0000","last_unstale":"2024-02-17T12:17:24.335675+0000","last_undegraded":"2024-02-17T12:17:24.335675+0000","last_fullsized":"2024-02-17T12:17:24.335675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:09:48.040109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405296+0000","last_change":"2024-02-17T12:17:23.346334+0000","last_active":"2024-02-17T12:17:24.405296+0000","last_peered":"2024-02-17T12:17:24.405296+0000","last_clean":"2024-02-17T12:17:24.405296+0000","last_became_active":"2024-02-17T12:17:23.345942+0000","last_became_peered":"2024-02-17T12:17:23.345942+0000","last_unstale":"2024-02-17T12:17:24.405296+0000","last_undegraded":"2024-02-17T12:17:24.405296+0000","last_fullsized":"2024-02-17T12:17:24.405296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:23:47.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336573+0000","last_change":"2024-02-17T12:17:05.025815+0000","last_active":"2024-02-17T12:17:24.336573+0000","last_peered":"2024-02-17T12:17:24.336573+0000","last_clean":"2024-02-17T12:17:24.336573+0000","last_became_active":"2024-02-17T12:17:05.025568+0000","last_became_peered":"2024-02-17T12:17:05.025568+0000","last_unstale":"2024-02-17T12:17:24.336573+0000","last_undegraded":"2024-02-17T12:17:24.336573+0000","last_fullsized":"2024-02-17T12:17:24.336573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330248+0000","last_change":"2024-02-17T12:17:06.037347+0000","last_active":"2024-02-17T12:17:23.330248+0000","last_peered":"2024-02-17T12:17:23.330248+0000","last_clean":"2024-02-17T12:17:23.330248+0000","last_became_active":"2024-02-17T12:17:06.037068+0000","last_became_peered":"2024-02-17T12:17:06.037068+0000","last_unstale":"2024-02-17T12:17:23.330248+0000","last_undegraded":"2024-02-17T12:17:23.330248+0000","last_fullsized":"2024-02-17T12:17:23.330248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:54:10.814424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.323564+0000","last_change":"2024-02-17T12:17:22.343469+0000","last_active":"2024-02-17T12:17:23.323564+0000","last_peered":"2024-02-17T12:17:23.323564+0000","last_clean":"2024-02-17T12:17:23.323564+0000","last_became_active":"2024-02-17T12:17:22.343117+0000","last_became_peered":"2024-02-17T12:17:22.343117+0000","last_unstale":"2024-02-17T12:17:23.323564+0000","last_undegraded":"2024-02-17T12:17:23.323564+0000","last_fullsized":"2024-02-17T12:17:23.323564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:50:41.501694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335714+0000","last_change":"2024-02-17T12:17:23.333807+0000","last_active":"2024-02-17T12:17:24.335714+0000","last_peered":"2024-02-17T12:17:24.335714+0000","last_clean":"2024-02-17T12:17:24.335714+0000","last_became_active":"2024-02-17T12:17:23.333498+0000","last_became_peered":"2024-02-17T12:17:23.333498+0000","last_unstale":"2024-02-17T12:17:24.335714+0000","last_undegraded":"2024-02-17T12:17:24.335714+0000","last_fullsized":"2024-02-17T12:17:24.335714+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:38.848587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340896+0000","last_change":"2024-02-17T12:17:05.037887+0000","last_active":"2024-02-17T12:17:24.340896+0000","last_peered":"2024-02-17T12:17:24.340896+0000","last_clean":"2024-02-17T12:17:24.340896+0000","last_became_active":"2024-02-17T12:17:05.037587+0000","last_became_peered":"2024-02-17T12:17:05.037587+0000","last_unstale":"2024-02-17T12:17:24.340896+0000","last_undegraded":"2024-02-17T12:17:24.340896+0000","last_fullsized":"2024-02-17T12:17:24.340896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:20.156577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322996+0000","last_change":"2024-02-17T12:17:06.057175+0000","last_active":"2024-02-17T12:17:23.322996+0000","last_peered":"2024-02-17T12:17:23.322996+0000","last_clean":"2024-02-17T12:17:23.322996+0000","last_became_active":"2024-02-17T12:17:06.055674+0000","last_became_peered":"2024-02-17T12:17:06.055674+0000","last_unstale":"2024-02-17T12:17:23.322996+0000","last_undegraded":"2024-02-17T12:17:23.322996+0000","last_fullsized":"2024-02-17T12:17:23.322996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:26:17.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341663+0000","last_change":"2024-02-17T12:17:22.333156+0000","last_active":"2024-02-17T12:17:24.341663+0000","last_peered":"2024-02-17T12:17:24.341663+0000","last_clean":"2024-02-17T12:17:24.341663+0000","last_became_active":"2024-02-17T12:17:22.332889+0000","last_became_peered":"2024-02-17T12:17:22.332889+0000","last_unstale":"2024-02-17T12:17:24.341663+0000","last_undegraded":"2024-02-17T12:17:24.341663+0000","last_fullsized":"2024-02-17T12:17:24.341663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:43:21.162608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351019+0000","last_change":"2024-02-17T12:17:23.337321+0000","last_active":"2024-02-17T12:17:24.351019+0000","last_peered":"2024-02-17T12:17:24.351019+0000","last_clean":"2024-02-17T12:17:24.351019+0000","last_became_active":"2024-02-17T12:17:23.337063+0000","last_became_peered":"2024-02-17T12:17:23.337063+0000","last_unstale":"2024-02-17T12:17:24.351019+0000","last_undegraded":"2024-02-17T12:17:24.351019+0000","last_fullsized":"2024-02-17T12:17:24.351019+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:51.431244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330396+0000","last_change":"2024-02-17T12:17:05.024282+0000","last_active":"2024-02-17T12:17:23.330396+0000","last_peered":"2024-02-17T12:17:23.330396+0000","last_clean":"2024-02-17T12:17:23.330396+0000","last_became_active":"2024-02-17T12:17:05.023939+0000","last_became_peered":"2024-02-17T12:17:05.023939+0000","last_unstale":"2024-02-17T12:17:23.330396+0000","last_undegraded":"2024-02-17T12:17:23.330396+0000","last_fullsized":"2024-02-17T12:17:23.330396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:41.752311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329665+0000","last_change":"2024-02-17T12:17:06.051800+0000","last_active":"2024-02-17T12:17:23.329665+0000","last_peered":"2024-02-17T12:17:23.329665+0000","last_clean":"2024-02-17T12:17:23.329665+0000","last_became_active":"2024-02-17T12:17:06.047017+0000","last_became_peered":"2024-02-17T12:17:06.047017+0000","last_unstale":"2024-02-17T12:17:23.329665+0000","last_undegraded":"2024-02-17T12:17:23.329665+0000","last_fullsized":"2024-02-17T12:17:23.329665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:27.324723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351163+0000","last_change":"2024-02-17T12:17:22.330496+0000","last_active":"2024-02-17T12:17:24.351163+0000","last_peered":"2024-02-17T12:17:24.351163+0000","last_clean":"2024-02-17T12:17:24.351163+0000","last_became_active":"2024-02-17T12:17:22.330199+0000","last_became_peered":"2024-02-17T12:17:22.330199+0000","last_unstale":"2024-02-17T12:17:24.351163+0000","last_undegraded":"2024-02-17T12:17:24.351163+0000","last_fullsized":"2024-02-17T12:17:24.351163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:14:38.298712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405036+0000","last_change":"2024-02-17T12:17:23.345010+0000","last_active":"2024-02-17T12:17:24.405036+0000","last_peered":"2024-02-17T12:17:24.405036+0000","last_clean":"2024-02-17T12:17:24.405036+0000","last_became_active":"2024-02-17T12:17:23.344713+0000","last_became_peered":"2024-02-17T12:17:23.344713+0000","last_unstale":"2024-02-17T12:17:24.405036+0000","last_undegraded":"2024-02-17T12:17:24.405036+0000","last_fullsized":"2024-02-17T12:17:24.405036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:40:17.228464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340148+0000","last_change":"2024-02-17T12:17:05.035457+0000","last_active":"2024-02-17T12:17:24.340148+0000","last_peered":"2024-02-17T12:17:24.340148+0000","last_clean":"2024-02-17T12:17:24.340148+0000","last_became_active":"2024-02-17T12:17:05.035024+0000","last_became_peered":"2024-02-17T12:17:05.035024+0000","last_unstale":"2024-02-17T12:17:24.340148+0000","last_undegraded":"2024-02-17T12:17:24.340148+0000","last_fullsized":"2024-02-17T12:17:24.340148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329533+0000","last_change":"2024-02-17T12:17:06.044343+0000","last_active":"2024-02-17T12:17:23.329533+0000","last_peered":"2024-02-17T12:17:23.329533+0000","last_clean":"2024-02-17T12:17:23.329533+0000","last_became_active":"2024-02-17T12:17:06.044057+0000","last_became_peered":"2024-02-17T12:17:06.044057+0000","last_unstale":"2024-02-17T12:17:23.329533+0000","last_undegraded":"2024-02-17T12:17:23.329533+0000","last_fullsized":"2024-02-17T12:17:23.329533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:33.519960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322286+0000","last_change":"2024-02-17T12:17:22.345056+0000","last_active":"2024-02-17T12:17:23.322286+0000","last_peered":"2024-02-17T12:17:23.322286+0000","last_clean":"2024-02-17T12:17:23.322286+0000","last_became_active":"2024-02-17T12:17:22.344704+0000","last_became_peered":"2024-02-17T12:17:22.344704+0000","last_unstale":"2024-02-17T12:17:23.322286+0000","last_undegraded":"2024-02-17T12:17:23.322286+0000","last_fullsized":"2024-02-17T12:17:23.322286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:17.347242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.347782+0000","last_change":"2024-02-17T12:17:23.337391+0000","last_active":"2024-02-17T12:17:23.347782+0000","last_peered":"2024-02-17T12:17:23.347782+0000","last_clean":"2024-02-17T12:17:23.347782+0000","last_became_active":"2024-02-17T12:17:23.333405+0000","last_became_peered":"2024-02-17T12:17:23.333405+0000","last_unstale":"2024-02-17T12:17:23.347782+0000","last_undegraded":"2024-02-17T12:17:23.347782+0000","last_fullsized":"2024-02-17T12:17:23.347782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:40:15.081772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405513+0000","last_change":"2024-02-17T12:17:05.038848+0000","last_active":"2024-02-17T12:17:24.405513+0000","last_peered":"2024-02-17T12:17:24.405513+0000","last_clean":"2024-02-17T12:17:24.405513+0000","last_became_active":"2024-02-17T12:17:05.038528+0000","last_became_peered":"2024-02-17T12:17:05.038528+0000","last_unstale":"2024-02-17T12:17:24.405513+0000","last_undegraded":"2024-02-17T12:17:24.405513+0000","last_fullsized":"2024-02-17T12:17:24.405513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:01:36.502802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330382+0000","last_change":"2024-02-17T12:17:06.058275+0000","last_active":"2024-02-17T12:17:23.330382+0000","last_peered":"2024-02-17T12:17:23.330382+0000","last_clean":"2024-02-17T12:17:23.330382+0000","last_became_active":"2024-02-17T12:17:06.057949+0000","last_became_peered":"2024-02-17T12:17:06.057949+0000","last_unstale":"2024-02-17T12:17:23.330382+0000","last_undegraded":"2024-02-17T12:17:23.330382+0000","last_fullsized":"2024-02-17T12:17:23.330382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:36.279421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405058+0000","last_change":"2024-02-17T12:17:22.336283+0000","last_active":"2024-02-17T12:17:24.405058+0000","last_peered":"2024-02-17T12:17:24.405058+0000","last_clean":"2024-02-17T12:17:24.405058+0000","last_became_active":"2024-02-17T12:17:22.335986+0000","last_became_peered":"2024-02-17T12:17:22.335986+0000","last_unstale":"2024-02-17T12:17:24.405058+0000","last_undegraded":"2024-02-17T12:17:24.405058+0000","last_fullsized":"2024-02-17T12:17:24.405058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:51:05.943372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405775+0000","last_change":"2024-02-17T12:17:23.345984+0000","last_active":"2024-02-17T12:17:24.405775+0000","last_peered":"2024-02-17T12:17:24.405775+0000","last_clean":"2024-02-17T12:17:24.405775+0000","last_became_active":"2024-02-17T12:17:23.345680+0000","last_became_peered":"2024-02-17T12:17:23.345680+0000","last_unstale":"2024-02-17T12:17:24.405775+0000","last_undegraded":"2024-02-17T12:17:24.405775+0000","last_fullsized":"2024-02-17T12:17:24.405775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:25:14.234550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.338234+0000","last_change":"2024-02-17T12:17:05.026370+0000","last_active":"2024-02-17T12:17:23.338234+0000","last_peered":"2024-02-17T12:17:23.338234+0000","last_clean":"2024-02-17T12:17:23.338234+0000","last_became_active":"2024-02-17T12:17:05.026124+0000","last_became_peered":"2024-02-17T12:17:05.026124+0000","last_unstale":"2024-02-17T12:17:23.338234+0000","last_undegraded":"2024-02-17T12:17:23.338234+0000","last_fullsized":"2024-02-17T12:17:23.338234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:35.272161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.328857+0000","last_change":"2024-02-17T12:17:06.047087+0000","last_active":"2024-02-17T12:17:23.328857+0000","last_peered":"2024-02-17T12:17:23.328857+0000","last_clean":"2024-02-17T12:17:23.328857+0000","last_became_active":"2024-02-17T12:17:06.046719+0000","last_became_peered":"2024-02-17T12:17:06.046719+0000","last_unstale":"2024-02-17T12:17:23.328857+0000","last_undegraded":"2024-02-17T12:17:23.328857+0000","last_fullsized":"2024-02-17T12:17:23.328857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:42.759571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.361329+0000","last_change":"2024-02-17T12:17:22.337390+0000","last_active":"2024-02-17T12:17:23.361329+0000","last_peered":"2024-02-17T12:17:23.361329+0000","last_clean":"2024-02-17T12:17:23.361329+0000","last_became_active":"2024-02-17T12:17:22.337058+0000","last_became_peered":"2024-02-17T12:17:22.337058+0000","last_unstale":"2024-02-17T12:17:23.361329+0000","last_undegraded":"2024-02-17T12:17:23.361329+0000","last_fullsized":"2024-02-17T12:17:23.361329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:24:23.397983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.351092+0000","last_change":"2024-02-17T12:17:23.338481+0000","last_active":"2024-02-17T12:17:23.351092+0000","last_peered":"2024-02-17T12:17:23.351092+0000","last_clean":"2024-02-17T12:17:23.351092+0000","last_became_active":"2024-02-17T12:17:23.338200+0000","last_became_peered":"2024-02-17T12:17:23.338200+0000","last_unstale":"2024-02-17T12:17:23.351092+0000","last_undegraded":"2024-02-17T12:17:23.351092+0000","last_fullsized":"2024-02-17T12:17:23.351092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:59.061465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.338565+0000","last_change":"2024-02-17T12:17:05.037680+0000","last_active":"2024-02-17T12:17:23.338565+0000","last_peered":"2024-02-17T12:17:23.338565+0000","last_clean":"2024-02-17T12:17:23.338565+0000","last_became_active":"2024-02-17T12:17:05.037370+0000","last_became_peered":"2024-02-17T12:17:05.037370+0000","last_unstale":"2024-02-17T12:17:23.338565+0000","last_undegraded":"2024-02-17T12:17:23.338565+0000","last_fullsized":"2024-02-17T12:17:23.338565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:16.209390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335936+0000","last_change":"2024-02-17T12:17:06.060894+0000","last_active":"2024-02-17T12:17:24.335936+0000","last_peered":"2024-02-17T12:17:24.335936+0000","last_clean":"2024-02-17T12:17:24.335936+0000","last_became_active":"2024-02-17T12:17:06.060631+0000","last_became_peered":"2024-02-17T12:17:06.060631+0000","last_unstale":"2024-02-17T12:17:24.335936+0000","last_undegraded":"2024-02-17T12:17:24.335936+0000","last_fullsized":"2024-02-17T12:17:24.335936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:02.449515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.358707+0000","last_change":"2024-02-17T12:17:22.342026+0000","last_active":"2024-02-17T12:17:23.358707+0000","last_peered":"2024-02-17T12:17:23.358707+0000","last_clean":"2024-02-17T12:17:23.358707+0000","last_became_active":"2024-02-17T12:17:22.341754+0000","last_became_peered":"2024-02-17T12:17:22.341754+0000","last_unstale":"2024-02-17T12:17:23.358707+0000","last_undegraded":"2024-02-17T12:17:23.358707+0000","last_fullsized":"2024-02-17T12:17:23.358707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:26:19.269391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340182+0000","last_change":"2024-02-17T12:17:23.346991+0000","last_active":"2024-02-17T12:17:24.340182+0000","last_peered":"2024-02-17T12:17:24.340182+0000","last_clean":"2024-02-17T12:17:24.340182+0000","last_became_active":"2024-02-17T12:17:23.346701+0000","last_became_peered":"2024-02-17T12:17:23.346701+0000","last_unstale":"2024-02-17T12:17:24.340182+0000","last_undegraded":"2024-02-17T12:17:24.340182+0000","last_fullsized":"2024-02-17T12:17:24.340182+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:25.892811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.338022+0000","last_change":"2024-02-17T12:17:05.030468+0000","last_active":"2024-02-17T12:17:23.338022+0000","last_peered":"2024-02-17T12:17:23.338022+0000","last_clean":"2024-02-17T12:17:23.338022+0000","last_became_active":"2024-02-17T12:17:05.030205+0000","last_became_peered":"2024-02-17T12:17:05.030205+0000","last_unstale":"2024-02-17T12:17:23.338022+0000","last_undegraded":"2024-02-17T12:17:23.338022+0000","last_fullsized":"2024-02-17T12:17:23.338022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:08.989824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342406+0000","last_change":"2024-02-17T12:17:06.070352+0000","last_active":"2024-02-17T12:17:24.342406+0000","last_peered":"2024-02-17T12:17:24.342406+0000","last_clean":"2024-02-17T12:17:24.342406+0000","last_became_active":"2024-02-17T12:17:06.070053+0000","last_became_peered":"2024-02-17T12:17:06.070053+0000","last_unstale":"2024-02-17T12:17:24.342406+0000","last_undegraded":"2024-02-17T12:17:24.342406+0000","last_fullsized":"2024-02-17T12:17:24.342406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:50:00.758848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351471+0000","last_change":"2024-02-17T12:17:22.336524+0000","last_active":"2024-02-17T12:17:24.351471+0000","last_peered":"2024-02-17T12:17:24.351471+0000","last_clean":"2024-02-17T12:17:24.351471+0000","last_became_active":"2024-02-17T12:17:22.336312+0000","last_became_peered":"2024-02-17T12:17:22.336312+0000","last_unstale":"2024-02-17T12:17:24.351471+0000","last_undegraded":"2024-02-17T12:17:24.351471+0000","last_fullsized":"2024-02-17T12:17:24.351471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:18:30.185800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340376+0000","last_change":"2024-02-17T12:17:23.347740+0000","last_active":"2024-02-17T12:17:24.340376+0000","last_peered":"2024-02-17T12:17:24.340376+0000","last_clean":"2024-02-17T12:17:24.340376+0000","last_became_active":"2024-02-17T12:17:23.347416+0000","last_became_peered":"2024-02-17T12:17:23.347416+0000","last_unstale":"2024-02-17T12:17:24.340376+0000","last_undegraded":"2024-02-17T12:17:24.340376+0000","last_fullsized":"2024-02-17T12:17:24.340376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:42:52.726687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336525+0000","last_change":"2024-02-17T12:17:05.039589+0000","last_active":"2024-02-17T12:17:24.336525+0000","last_peered":"2024-02-17T12:17:24.336525+0000","last_clean":"2024-02-17T12:17:24.336525+0000","last_became_active":"2024-02-17T12:17:05.039353+0000","last_became_peered":"2024-02-17T12:17:05.039353+0000","last_unstale":"2024-02-17T12:17:24.336525+0000","last_undegraded":"2024-02-17T12:17:24.336525+0000","last_fullsized":"2024-02-17T12:17:24.336525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.337924+0000","last_change":"2024-02-17T12:17:06.056551+0000","last_active":"2024-02-17T12:17:23.337924+0000","last_peered":"2024-02-17T12:17:23.337924+0000","last_clean":"2024-02-17T12:17:23.337924+0000","last_became_active":"2024-02-17T12:17:06.056226+0000","last_became_peered":"2024-02-17T12:17:06.056226+0000","last_unstale":"2024-02-17T12:17:23.337924+0000","last_undegraded":"2024-02-17T12:17:23.337924+0000","last_fullsized":"2024-02-17T12:17:23.337924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:26:02.974500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342116+0000","last_change":"2024-02-17T12:17:22.336212+0000","last_active":"2024-02-17T12:17:24.342116+0000","last_peered":"2024-02-17T12:17:24.342116+0000","last_clean":"2024-02-17T12:17:24.342116+0000","last_became_active":"2024-02-17T12:17:22.335850+0000","last_became_peered":"2024-02-17T12:17:22.335850+0000","last_unstale":"2024-02-17T12:17:24.342116+0000","last_undegraded":"2024-02-17T12:17:24.342116+0000","last_fullsized":"2024-02-17T12:17:24.342116+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:24.885872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405704+0000","last_change":"2024-02-17T12:17:23.342620+0000","last_active":"2024-02-17T12:17:24.405704+0000","last_peered":"2024-02-17T12:17:24.405704+0000","last_clean":"2024-02-17T12:17:24.405704+0000","last_became_active":"2024-02-17T12:17:23.342301+0000","last_became_peered":"2024-02-17T12:17:23.342301+0000","last_unstale":"2024-02-17T12:17:24.405704+0000","last_undegraded":"2024-02-17T12:17:24.405704+0000","last_fullsized":"2024-02-17T12:17:24.405704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:14:39.305651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350730+0000","last_change":"2024-02-17T12:17:05.033809+0000","last_active":"2024-02-17T12:17:24.350730+0000","last_peered":"2024-02-17T12:17:24.350730+0000","last_clean":"2024-02-17T12:17:24.350730+0000","last_became_active":"2024-02-17T12:17:05.033434+0000","last_became_peered":"2024-02-17T12:17:05.033434+0000","last_unstale":"2024-02-17T12:17:24.350730+0000","last_undegraded":"2024-02-17T12:17:24.350730+0000","last_fullsized":"2024-02-17T12:17:24.350730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:20.156577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339718+0000","last_change":"2024-02-17T12:17:06.066823+0000","last_active":"2024-02-17T12:17:24.339718+0000","last_peered":"2024-02-17T12:17:24.339718+0000","last_clean":"2024-02-17T12:17:24.339718+0000","last_became_active":"2024-02-17T12:17:06.066564+0000","last_became_peered":"2024-02-17T12:17:06.066564+0000","last_unstale":"2024-02-17T12:17:24.339718+0000","last_undegraded":"2024-02-17T12:17:24.339718+0000","last_fullsized":"2024-02-17T12:17:24.339718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:00:35.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322243+0000","last_change":"2024-02-17T12:17:22.344548+0000","last_active":"2024-02-17T12:17:23.322243+0000","last_peered":"2024-02-17T12:17:23.322243+0000","last_clean":"2024-02-17T12:17:23.322243+0000","last_became_active":"2024-02-17T12:17:22.344242+0000","last_became_peered":"2024-02-17T12:17:22.344242+0000","last_unstale":"2024-02-17T12:17:23.322243+0000","last_undegraded":"2024-02-17T12:17:23.322243+0000","last_fullsized":"2024-02-17T12:17:23.322243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:49:13.729470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339509+0000","last_change":"2024-02-17T12:17:23.353560+0000","last_active":"2024-02-17T12:17:24.339509+0000","last_peered":"2024-02-17T12:17:24.339509+0000","last_clean":"2024-02-17T12:17:24.339509+0000","last_became_active":"2024-02-17T12:17:23.350039+0000","last_became_peered":"2024-02-17T12:17:23.350039+0000","last_unstale":"2024-02-17T12:17:24.339509+0000","last_undegraded":"2024-02-17T12:17:24.339509+0000","last_fullsized":"2024-02-17T12:17:24.339509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:56:23.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350969+0000","last_change":"2024-02-17T12:17:05.037345+0000","last_active":"2024-02-17T12:17:24.350969+0000","last_peered":"2024-02-17T12:17:24.350969+0000","last_clean":"2024-02-17T12:17:24.350969+0000","last_became_active":"2024-02-17T12:17:05.037076+0000","last_became_peered":"2024-02-17T12:17:05.037076+0000","last_unstale":"2024-02-17T12:17:24.350969+0000","last_undegraded":"2024-02-17T12:17:24.350969+0000","last_fullsized":"2024-02-17T12:17:24.350969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:34.554467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.321994+0000","last_change":"2024-02-17T12:17:06.067761+0000","last_active":"2024-02-17T12:17:23.321994+0000","last_peered":"2024-02-17T12:17:23.321994+0000","last_clean":"2024-02-17T12:17:23.321994+0000","last_became_active":"2024-02-17T12:17:06.067249+0000","last_became_peered":"2024-02-17T12:17:06.067249+0000","last_unstale":"2024-02-17T12:17:23.321994+0000","last_undegraded":"2024-02-17T12:17:23.321994+0000","last_fullsized":"2024-02-17T12:17:23.321994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:40:09.999149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351053+0000","last_change":"2024-02-17T12:17:22.339368+0000","last_active":"2024-02-17T12:17:24.351053+0000","last_peered":"2024-02-17T12:17:24.351053+0000","last_clean":"2024-02-17T12:17:24.351053+0000","last_became_active":"2024-02-17T12:17:22.339129+0000","last_became_peered":"2024-02-17T12:17:22.339129+0000","last_unstale":"2024-02-17T12:17:24.351053+0000","last_undegraded":"2024-02-17T12:17:24.351053+0000","last_fullsized":"2024-02-17T12:17:24.351053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:04.168896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.347304+0000","last_change":"2024-02-17T12:17:23.341129+0000","last_active":"2024-02-17T12:17:23.347304+0000","last_peered":"2024-02-17T12:17:23.347304+0000","last_clean":"2024-02-17T12:17:23.347304+0000","last_became_active":"2024-02-17T12:17:23.340596+0000","last_became_peered":"2024-02-17T12:17:23.340596+0000","last_unstale":"2024-02-17T12:17:23.347304+0000","last_undegraded":"2024-02-17T12:17:23.347304+0000","last_fullsized":"2024-02-17T12:17:23.347304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:08.165541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335582+0000","last_change":"2024-02-17T12:17:05.032388+0000","last_active":"2024-02-17T12:17:24.335582+0000","last_peered":"2024-02-17T12:17:24.335582+0000","last_clean":"2024-02-17T12:17:24.335582+0000","last_became_active":"2024-02-17T12:17:05.032055+0000","last_became_peered":"2024-02-17T12:17:05.032055+0000","last_unstale":"2024-02-17T12:17:24.335582+0000","last_undegraded":"2024-02-17T12:17:24.335582+0000","last_fullsized":"2024-02-17T12:17:24.335582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351262+0000","last_change":"2024-02-17T12:17:06.043565+0000","last_active":"2024-02-17T12:17:24.351262+0000","last_peered":"2024-02-17T12:17:24.351262+0000","last_clean":"2024-02-17T12:17:24.351262+0000","last_became_active":"2024-02-17T12:17:06.043189+0000","last_became_peered":"2024-02-17T12:17:06.043189+0000","last_unstale":"2024-02-17T12:17:24.351262+0000","last_undegraded":"2024-02-17T12:17:24.351262+0000","last_fullsized":"2024-02-17T12:17:24.351262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:02:23.127482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405198+0000","last_change":"2024-02-17T12:17:22.326967+0000","last_active":"2024-02-17T12:17:24.405198+0000","last_peered":"2024-02-17T12:17:24.405198+0000","last_clean":"2024-02-17T12:17:24.405198+0000","last_became_active":"2024-02-17T12:17:22.326377+0000","last_became_peered":"2024-02-17T12:17:22.326377+0000","last_unstale":"2024-02-17T12:17:24.405198+0000","last_undegraded":"2024-02-17T12:17:24.405198+0000","last_fullsized":"2024-02-17T12:17:24.405198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:20.192645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350673+0000","last_change":"2024-02-17T12:17:23.339306+0000","last_active":"2024-02-17T12:17:24.350673+0000","last_peered":"2024-02-17T12:17:24.350673+0000","last_clean":"2024-02-17T12:17:24.350673+0000","last_became_active":"2024-02-17T12:17:23.339053+0000","last_became_peered":"2024-02-17T12:17:23.339053+0000","last_unstale":"2024-02-17T12:17:24.350673+0000","last_undegraded":"2024-02-17T12:17:24.350673+0000","last_fullsized":"2024-02-17T12:17:24.350673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:36:04.909419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.331244+0000","last_change":"2024-02-17T12:17:05.032981+0000","last_active":"2024-02-17T12:17:23.331244+0000","last_peered":"2024-02-17T12:17:23.331244+0000","last_clean":"2024-02-17T12:17:23.331244+0000","last_became_active":"2024-02-17T12:17:05.032653+0000","last_became_peered":"2024-02-17T12:17:05.032653+0000","last_unstale":"2024-02-17T12:17:23.331244+0000","last_undegraded":"2024-02-17T12:17:23.331244+0000","last_fullsized":"2024-02-17T12:17:23.331244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:32.512700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335581+0000","last_change":"2024-02-17T12:17:06.049102+0000","last_active":"2024-02-17T12:17:24.335581+0000","last_peered":"2024-02-17T12:17:24.335581+0000","last_clean":"2024-02-17T12:17:24.335581+0000","last_became_active":"2024-02-17T12:17:06.048820+0000","last_became_peered":"2024-02-17T12:17:06.048820+0000","last_unstale":"2024-02-17T12:17:24.335581+0000","last_undegraded":"2024-02-17T12:17:24.335581+0000","last_fullsized":"2024-02-17T12:17:24.335581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:16.951684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350864+0000","last_change":"2024-02-17T12:17:22.326094+0000","last_active":"2024-02-17T12:17:24.350864+0000","last_peered":"2024-02-17T12:17:24.350864+0000","last_clean":"2024-02-17T12:17:24.350864+0000","last_became_active":"2024-02-17T12:17:22.325795+0000","last_became_peered":"2024-02-17T12:17:22.325795+0000","last_unstale":"2024-02-17T12:17:24.350864+0000","last_undegraded":"2024-02-17T12:17:24.350864+0000","last_fullsized":"2024-02-17T12:17:24.350864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:00:58.487000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.342718+0000","last_change":"2024-02-17T12:17:23.335741+0000","last_active":"2024-02-17T12:17:23.342718+0000","last_peered":"2024-02-17T12:17:23.342718+0000","last_clean":"2024-02-17T12:17:23.342718+0000","last_became_active":"2024-02-17T12:17:23.335458+0000","last_became_peered":"2024-02-17T12:17:23.335458+0000","last_unstale":"2024-02-17T12:17:23.342718+0000","last_undegraded":"2024-02-17T12:17:23.342718+0000","last_fullsized":"2024-02-17T12:17:23.342718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:20.203815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351530+0000","last_change":"2024-02-17T12:17:05.034049+0000","last_active":"2024-02-17T12:17:24.351530+0000","last_peered":"2024-02-17T12:17:24.351530+0000","last_clean":"2024-02-17T12:17:24.351530+0000","last_became_active":"2024-02-17T12:17:05.033414+0000","last_became_peered":"2024-02-17T12:17:05.033414+0000","last_unstale":"2024-02-17T12:17:24.351530+0000","last_undegraded":"2024-02-17T12:17:24.351530+0000","last_fullsized":"2024-02-17T12:17:24.351530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:17.825707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342083+0000","last_change":"2024-02-17T12:17:06.066601+0000","last_active":"2024-02-17T12:17:24.342083+0000","last_peered":"2024-02-17T12:17:24.342083+0000","last_clean":"2024-02-17T12:17:24.342083+0000","last_became_active":"2024-02-17T12:17:06.066262+0000","last_became_peered":"2024-02-17T12:17:06.066262+0000","last_unstale":"2024-02-17T12:17:24.342083+0000","last_undegraded":"2024-02-17T12:17:24.342083+0000","last_fullsized":"2024-02-17T12:17:24.342083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:14.063262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405661+0000","last_change":"2024-02-17T12:17:22.332075+0000","last_active":"2024-02-17T12:17:24.405661+0000","last_peered":"2024-02-17T12:17:24.405661+0000","last_clean":"2024-02-17T12:17:24.405661+0000","last_became_active":"2024-02-17T12:17:22.331806+0000","last_became_peered":"2024-02-17T12:17:22.331806+0000","last_unstale":"2024-02-17T12:17:24.405661+0000","last_undegraded":"2024-02-17T12:17:24.405661+0000","last_fullsized":"2024-02-17T12:17:24.405661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:02:39.422372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.361387+0000","last_change":"2024-02-17T12:17:23.357929+0000","last_active":"2024-02-17T12:17:23.361387+0000","last_peered":"2024-02-17T12:17:23.361387+0000","last_clean":"2024-02-17T12:17:23.361387+0000","last_became_active":"2024-02-17T12:17:23.357616+0000","last_became_peered":"2024-02-17T12:17:23.357616+0000","last_unstale":"2024-02-17T12:17:23.361387+0000","last_undegraded":"2024-02-17T12:17:23.361387+0000","last_fullsized":"2024-02-17T12:17:23.361387+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:23:27.249851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342224+0000","last_change":"2024-02-17T12:17:05.038559+0000","last_active":"2024-02-17T12:17:24.342224+0000","last_peered":"2024-02-17T12:17:24.342224+0000","last_clean":"2024-02-17T12:17:24.342224+0000","last_became_active":"2024-02-17T12:17:05.038388+0000","last_became_peered":"2024-02-17T12:17:05.038388+0000","last_unstale":"2024-02-17T12:17:24.342224+0000","last_undegraded":"2024-02-17T12:17:24.342224+0000","last_fullsized":"2024-02-17T12:17:24.342224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:14:47.318267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351399+0000","last_change":"2024-02-17T12:17:06.050890+0000","last_active":"2024-02-17T12:17:24.351399+0000","last_peered":"2024-02-17T12:17:24.351399+0000","last_clean":"2024-02-17T12:17:24.351399+0000","last_became_active":"2024-02-17T12:17:06.050253+0000","last_became_peered":"2024-02-17T12:17:06.050253+0000","last_unstale":"2024-02-17T12:17:24.351399+0000","last_undegraded":"2024-02-17T12:17:24.351399+0000","last_fullsized":"2024-02-17T12:17:24.351399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:09:31.745218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.339191+0000","last_change":"2024-02-17T12:17:22.340883+0000","last_active":"2024-02-17T12:17:23.339191+0000","last_peered":"2024-02-17T12:17:23.339191+0000","last_clean":"2024-02-17T12:17:23.339191+0000","last_became_active":"2024-02-17T12:17:22.340620+0000","last_became_peered":"2024-02-17T12:17:22.340620+0000","last_unstale":"2024-02-17T12:17:23.339191+0000","last_undegraded":"2024-02-17T12:17:23.339191+0000","last_fullsized":"2024-02-17T12:17:23.339191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:39.182118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.348825+0000","last_change":"2024-02-17T12:17:23.345047+0000","last_active":"2024-02-17T12:17:23.348825+0000","last_peered":"2024-02-17T12:17:23.348825+0000","last_clean":"2024-02-17T12:17:23.348825+0000","last_became_active":"2024-02-17T12:17:23.342316+0000","last_became_peered":"2024-02-17T12:17:23.342316+0000","last_unstale":"2024-02-17T12:17:23.348825+0000","last_undegraded":"2024-02-17T12:17:23.348825+0000","last_fullsized":"2024-02-17T12:17:23.348825+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:16:27.228088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405926+0000","last_change":"2024-02-17T12:17:05.042848+0000","last_active":"2024-02-17T12:17:24.405926+0000","last_peered":"2024-02-17T12:17:24.405926+0000","last_clean":"2024-02-17T12:17:24.405926+0000","last_became_active":"2024-02-17T12:17:05.042537+0000","last_became_peered":"2024-02-17T12:17:05.042537+0000","last_unstale":"2024-02-17T12:17:24.405926+0000","last_undegraded":"2024-02-17T12:17:24.405926+0000","last_fullsized":"2024-02-17T12:17:24.405926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351857+0000","last_change":"2024-02-17T12:17:06.060266+0000","last_active":"2024-02-17T12:17:24.351857+0000","last_peered":"2024-02-17T12:17:24.351857+0000","last_clean":"2024-02-17T12:17:24.351857+0000","last_became_active":"2024-02-17T12:17:06.059994+0000","last_became_peered":"2024-02-17T12:17:06.059994+0000","last_unstale":"2024-02-17T12:17:24.351857+0000","last_undegraded":"2024-02-17T12:17:24.351857+0000","last_fullsized":"2024-02-17T12:17:24.351857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:16.827288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.369675+0000","last_change":"2024-02-17T12:17:22.337927+0000","last_active":"2024-02-17T12:17:23.369675+0000","last_peered":"2024-02-17T12:17:23.369675+0000","last_clean":"2024-02-17T12:17:23.369675+0000","last_became_active":"2024-02-17T12:17:22.337621+0000","last_became_peered":"2024-02-17T12:17:22.337621+0000","last_unstale":"2024-02-17T12:17:23.369675+0000","last_undegraded":"2024-02-17T12:17:23.369675+0000","last_fullsized":"2024-02-17T12:17:23.369675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:27:10.414634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351376+0000","last_change":"2024-02-17T12:17:23.337515+0000","last_active":"2024-02-17T12:17:24.351376+0000","last_peered":"2024-02-17T12:17:24.351376+0000","last_clean":"2024-02-17T12:17:24.351376+0000","last_became_active":"2024-02-17T12:17:23.337210+0000","last_became_peered":"2024-02-17T12:17:23.337210+0000","last_unstale":"2024-02-17T12:17:24.351376+0000","last_undegraded":"2024-02-17T12:17:24.351376+0000","last_fullsized":"2024-02-17T12:17:24.351376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:27:31.050659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351909+0000","last_change":"2024-02-17T12:17:05.040696+0000","last_active":"2024-02-17T12:17:24.351909+0000","last_peered":"2024-02-17T12:17:24.351909+0000","last_clean":"2024-02-17T12:17:24.351909+0000","last_became_active":"2024-02-17T12:17:05.040185+0000","last_became_peered":"2024-02-17T12:17:05.040185+0000","last_unstale":"2024-02-17T12:17:24.351909+0000","last_undegraded":"2024-02-17T12:17:24.351909+0000","last_fullsized":"2024-02-17T12:17:24.351909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:09.420535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342348+0000","last_change":"2024-02-17T12:17:06.045622+0000","last_active":"2024-02-17T12:17:24.342348+0000","last_peered":"2024-02-17T12:17:24.342348+0000","last_clean":"2024-02-17T12:17:24.342348+0000","last_became_active":"2024-02-17T12:17:06.044323+0000","last_became_peered":"2024-02-17T12:17:06.044323+0000","last_unstale":"2024-02-17T12:17:24.342348+0000","last_undegraded":"2024-02-17T12:17:24.342348+0000","last_fullsized":"2024-02-17T12:17:24.342348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:03.897754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'3","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.360248+0000","last_change":"2024-02-17T12:17:22.342926+0000","last_active":"2024-02-17T12:17:23.360248+0000","last_peered":"2024-02-17T12:17:23.360248+0000","last_clean":"2024-02-17T12:17:23.360248+0000","last_became_active":"2024-02-17T12:17:22.342539+0000","last_became_peered":"2024-02-17T12:17:22.342539+0000","last_unstale":"2024-02-17T12:17:23.360248+0000","last_undegraded":"2024-02-17T12:17:23.360248+0000","last_fullsized":"2024-02-17T12:17:23.360248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:43.326791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405579+0000","last_change":"2024-02-17T12:17:23.355592+0000","last_active":"2024-02-17T12:17:24.405579+0000","last_peered":"2024-02-17T12:17:24.405579+0000","last_clean":"2024-02-17T12:17:24.405579+0000","last_became_active":"2024-02-17T12:17:23.355419+0000","last_became_peered":"2024-02-17T12:17:23.355419+0000","last_unstale":"2024-02-17T12:17:24.405579+0000","last_undegraded":"2024-02-17T12:17:24.405579+0000","last_fullsized":"2024-02-17T12:17:24.405579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:16:27.358514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329688+0000","last_change":"2024-02-17T12:17:05.029530+0000","last_active":"2024-02-17T12:17:23.329688+0000","last_peered":"2024-02-17T12:17:23.329688+0000","last_clean":"2024-02-17T12:17:23.329688+0000","last_became_active":"2024-02-17T12:17:05.029267+0000","last_became_peered":"2024-02-17T12:17:05.029267+0000","last_unstale":"2024-02-17T12:17:23.329688+0000","last_undegraded":"2024-02-17T12:17:23.329688+0000","last_fullsized":"2024-02-17T12:17:23.329688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:18:31.092114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335462+0000","last_change":"2024-02-17T12:17:06.048418+0000","last_active":"2024-02-17T12:17:24.335462+0000","last_peered":"2024-02-17T12:17:24.335462+0000","last_clean":"2024-02-17T12:17:24.335462+0000","last_became_active":"2024-02-17T12:17:06.048123+0000","last_became_peered":"2024-02-17T12:17:06.048123+0000","last_unstale":"2024-02-17T12:17:24.335462+0000","last_undegraded":"2024-02-17T12:17:24.335462+0000","last_fullsized":"2024-02-17T12:17:24.335462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:00:35.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.361783+0000","last_change":"2024-02-17T12:17:22.326544+0000","last_active":"2024-02-17T12:17:23.361783+0000","last_peered":"2024-02-17T12:17:23.361783+0000","last_clean":"2024-02-17T12:17:23.361783+0000","last_became_active":"2024-02-17T12:17:22.326263+0000","last_became_peered":"2024-02-17T12:17:22.326263+0000","last_unstale":"2024-02-17T12:17:23.361783+0000","last_undegraded":"2024-02-17T12:17:23.361783+0000","last_fullsized":"2024-02-17T12:17:23.361783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:14:05.136950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.345706+0000","last_change":"2024-02-17T12:17:23.344214+0000","last_active":"2024-02-17T12:17:23.345706+0000","last_peered":"2024-02-17T12:17:23.345706+0000","last_clean":"2024-02-17T12:17:23.345706+0000","last_became_active":"2024-02-17T12:17:23.343926+0000","last_became_peered":"2024-02-17T12:17:23.343926+0000","last_unstale":"2024-02-17T12:17:23.345706+0000","last_undegraded":"2024-02-17T12:17:23.345706+0000","last_fullsized":"2024-02-17T12:17:23.345706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:00:44.784053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350925+0000","last_change":"2024-02-17T12:17:05.030240+0000","last_active":"2024-02-17T12:17:24.350925+0000","last_peered":"2024-02-17T12:17:24.350925+0000","last_clean":"2024-02-17T12:17:24.350925+0000","last_became_active":"2024-02-17T12:17:05.029142+0000","last_became_peered":"2024-02-17T12:17:05.029142+0000","last_unstale":"2024-02-17T12:17:24.350925+0000","last_undegraded":"2024-02-17T12:17:24.350925+0000","last_fullsized":"2024-02-17T12:17:24.350925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:06.543631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329599+0000","last_change":"2024-02-17T12:17:06.057017+0000","last_active":"2024-02-17T12:17:23.329599+0000","last_peered":"2024-02-17T12:17:23.329599+0000","last_clean":"2024-02-17T12:17:23.329599+0000","last_became_active":"2024-02-17T12:17:06.056811+0000","last_became_peered":"2024-02-17T12:17:06.056811+0000","last_unstale":"2024-02-17T12:17:23.329599+0000","last_undegraded":"2024-02-17T12:17:23.329599+0000","last_fullsized":"2024-02-17T12:17:23.329599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:20.704065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351040+0000","last_change":"2024-02-17T12:17:22.330509+0000","last_active":"2024-02-17T12:17:24.351040+0000","last_peered":"2024-02-17T12:17:24.351040+0000","last_clean":"2024-02-17T12:17:24.351040+0000","last_became_active":"2024-02-17T12:17:22.330187+0000","last_became_peered":"2024-02-17T12:17:22.330187+0000","last_unstale":"2024-02-17T12:17:24.351040+0000","last_undegraded":"2024-02-17T12:17:24.351040+0000","last_fullsized":"2024-02-17T12:17:24.351040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:16:26.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339296+0000","last_change":"2024-02-17T12:17:23.350582+0000","last_active":"2024-02-17T12:17:24.339296+0000","last_peered":"2024-02-17T12:17:24.339296+0000","last_clean":"2024-02-17T12:17:24.339296+0000","last_became_active":"2024-02-17T12:17:23.350327+0000","last_became_peered":"2024-02-17T12:17:23.350327+0000","last_unstale":"2024-02-17T12:17:24.339296+0000","last_undegraded":"2024-02-17T12:17:24.339296+0000","last_fullsized":"2024-02-17T12:17:24.339296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:28.360685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330606+0000","last_change":"2024-02-17T12:17:05.026630+0000","last_active":"2024-02-17T12:17:23.330606+0000","last_peered":"2024-02-17T12:17:23.330606+0000","last_clean":"2024-02-17T12:17:23.330606+0000","last_became_active":"2024-02-17T12:17:05.026382+0000","last_became_peered":"2024-02-17T12:17:05.026382+0000","last_unstale":"2024-02-17T12:17:23.330606+0000","last_undegraded":"2024-02-17T12:17:23.330606+0000","last_fullsized":"2024-02-17T12:17:23.330606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:01.105877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341952+0000","last_change":"2024-02-17T12:17:06.044302+0000","last_active":"2024-02-17T12:17:24.341952+0000","last_peered":"2024-02-17T12:17:24.341952+0000","last_clean":"2024-02-17T12:17:24.341952+0000","last_became_active":"2024-02-17T12:17:06.043786+0000","last_became_peered":"2024-02-17T12:17:06.043786+0000","last_unstale":"2024-02-17T12:17:24.341952+0000","last_undegraded":"2024-02-17T12:17:24.341952+0000","last_fullsized":"2024-02-17T12:17:24.341952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:41.419455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405118+0000","last_change":"2024-02-17T12:17:22.335847+0000","last_active":"2024-02-17T12:17:24.405118+0000","last_peered":"2024-02-17T12:17:24.405118+0000","last_clean":"2024-02-17T12:17:24.405118+0000","last_became_active":"2024-02-17T12:17:22.333935+0000","last_became_peered":"2024-02-17T12:17:22.333935+0000","last_unstale":"2024-02-17T12:17:24.405118+0000","last_undegraded":"2024-02-17T12:17:24.405118+0000","last_fullsized":"2024-02-17T12:17:24.405118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:30.358153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405018+0000","last_change":"2024-02-17T12:17:23.349851+0000","last_active":"2024-02-17T12:17:24.405018+0000","last_peered":"2024-02-17T12:17:24.405018+0000","last_clean":"2024-02-17T12:17:24.405018+0000","last_became_active":"2024-02-17T12:17:23.349605+0000","last_became_peered":"2024-02-17T12:17:23.349605+0000","last_unstale":"2024-02-17T12:17:24.405018+0000","last_undegraded":"2024-02-17T12:17:24.405018+0000","last_fullsized":"2024-02-17T12:17:24.405018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:42:52.726687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.331138+0000","last_change":"2024-02-17T12:17:05.033265+0000","last_active":"2024-02-17T12:17:23.331138+0000","last_peered":"2024-02-17T12:17:23.331138+0000","last_clean":"2024-02-17T12:17:23.331138+0000","last_became_active":"2024-02-17T12:17:05.032692+0000","last_became_peered":"2024-02-17T12:17:05.032692+0000","last_unstale":"2024-02-17T12:17:23.331138+0000","last_undegraded":"2024-02-17T12:17:23.331138+0000","last_fullsized":"2024-02-17T12:17:23.331138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:26.317463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322300+0000","last_change":"2024-02-17T12:17:06.067276+0000","last_active":"2024-02-17T12:17:23.322300+0000","last_peered":"2024-02-17T12:17:23.322300+0000","last_clean":"2024-02-17T12:17:23.322300+0000","last_became_active":"2024-02-17T12:17:06.066957+0000","last_became_peered":"2024-02-17T12:17:06.066957+0000","last_unstale":"2024-02-17T12:17:23.322300+0000","last_undegraded":"2024-02-17T12:17:23.322300+0000","last_fullsized":"2024-02-17T12:17:23.322300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:11:41.273983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341594+0000","last_change":"2024-02-17T12:17:22.340152+0000","last_active":"2024-02-17T12:17:24.341594+0000","last_peered":"2024-02-17T12:17:24.341594+0000","last_clean":"2024-02-17T12:17:24.341594+0000","last_became_active":"2024-02-17T12:17:22.335915+0000","last_became_peered":"2024-02-17T12:17:22.335915+0000","last_unstale":"2024-02-17T12:17:24.341594+0000","last_undegraded":"2024-02-17T12:17:24.341594+0000","last_fullsized":"2024-02-17T12:17:24.341594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:26:41.182127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340729+0000","last_change":"2024-02-17T12:17:23.353451+0000","last_active":"2024-02-17T12:17:24.340729+0000","last_peered":"2024-02-17T12:17:24.340729+0000","last_clean":"2024-02-17T12:17:24.340729+0000","last_became_active":"2024-02-17T12:17:23.348284+0000","last_became_peered":"2024-02-17T12:17:23.348284+0000","last_unstale":"2024-02-17T12:17:24.340729+0000","last_undegraded":"2024-02-17T12:17:24.340729+0000","last_fullsized":"2024-02-17T12:17:24.340729+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:31.316019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.361661+0000","last_change":"2024-02-17T12:17:22.333453+0000","last_active":"2024-02-17T12:17:23.361661+0000","last_peered":"2024-02-17T12:17:23.361661+0000","last_clean":"2024-02-17T12:17:23.361661+0000","last_became_active":"2024-02-17T12:17:22.333120+0000","last_became_peered":"2024-02-17T12:17:22.333120+0000","last_unstale":"2024-02-17T12:17:23.361661+0000","last_undegraded":"2024-02-17T12:17:23.361661+0000","last_fullsized":"2024-02-17T12:17:23.361661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:08:36.441039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329247+0000","last_change":"2024-02-17T12:17:05.031611+0000","last_active":"2024-02-17T12:17:23.329247+0000","last_peered":"2024-02-17T12:17:23.329247+0000","last_clean":"2024-02-17T12:17:23.329247+0000","last_became_active":"2024-02-17T12:17:05.031301+0000","last_became_peered":"2024-02-17T12:17:05.031301+0000","last_unstale":"2024-02-17T12:17:23.329247+0000","last_undegraded":"2024-02-17T12:17:23.329247+0000","last_fullsized":"2024-02-17T12:17:23.329247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:16:26.921410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335858+0000","last_change":"2024-02-17T12:17:06.065678+0000","last_active":"2024-02-17T12:17:24.335858+0000","last_peered":"2024-02-17T12:17:24.335858+0000","last_clean":"2024-02-17T12:17:24.335858+0000","last_became_active":"2024-02-17T12:17:06.065401+0000","last_became_peered":"2024-02-17T12:17:06.065401+0000","last_unstale":"2024-02-17T12:17:24.335858+0000","last_undegraded":"2024-02-17T12:17:24.335858+0000","last_fullsized":"2024-02-17T12:17:24.335858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:14.063262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336195+0000","last_change":"2024-02-17T12:17:23.336875+0000","last_active":"2024-02-17T12:17:24.336195+0000","last_peered":"2024-02-17T12:17:24.336195+0000","last_clean":"2024-02-17T12:17:24.336195+0000","last_became_active":"2024-02-17T12:17:23.336600+0000","last_became_peered":"2024-02-17T12:17:23.336600+0000","last_unstale":"2024-02-17T12:17:24.336195+0000","last_undegraded":"2024-02-17T12:17:24.336195+0000","last_fullsized":"2024-02-17T12:17:24.336195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:56:23.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"35'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351776+0000","last_change":"2024-02-17T12:17:22.337729+0000","last_active":"2024-02-17T12:17:24.351776+0000","last_peered":"2024-02-17T12:17:24.351776+0000","last_clean":"2024-02-17T12:17:24.351776+0000","last_became_active":"2024-02-17T12:17:22.337328+0000","last_became_peered":"2024-02-17T12:17:22.337328+0000","last_unstale":"2024-02-17T12:17:24.351776+0000","last_undegraded":"2024-02-17T12:17:24.351776+0000","last_fullsized":"2024-02-17T12:17:24.351776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:25:13.227611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351276+0000","last_change":"2024-02-17T12:17:05.033787+0000","last_active":"2024-02-17T12:17:24.351276+0000","last_peered":"2024-02-17T12:17:24.351276+0000","last_clean":"2024-02-17T12:17:24.351276+0000","last_became_active":"2024-02-17T12:17:05.033470+0000","last_became_peered":"2024-02-17T12:17:05.033470+0000","last_unstale":"2024-02-17T12:17:24.351276+0000","last_undegraded":"2024-02-17T12:17:24.351276+0000","last_fullsized":"2024-02-17T12:17:24.351276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:14:47.318267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.338140+0000","last_change":"2024-02-17T12:17:06.059046+0000","last_active":"2024-02-17T12:17:23.338140+0000","last_peered":"2024-02-17T12:17:23.338140+0000","last_clean":"2024-02-17T12:17:23.338140+0000","last_became_active":"2024-02-17T12:17:06.058674+0000","last_became_peered":"2024-02-17T12:17:06.058674+0000","last_unstale":"2024-02-17T12:17:23.338140+0000","last_undegraded":"2024-02-17T12:17:23.338140+0000","last_fullsized":"2024-02-17T12:17:23.338140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:39:57.779942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336171+0000","last_change":"2024-02-17T12:17:23.350808+0000","last_active":"2024-02-17T12:17:24.336171+0000","last_peered":"2024-02-17T12:17:24.336171+0000","last_clean":"2024-02-17T12:17:24.336171+0000","last_became_active":"2024-02-17T12:17:23.350256+0000","last_became_peered":"2024-02-17T12:17:23.350256+0000","last_unstale":"2024-02-17T12:17:24.336171+0000","last_undegraded":"2024-02-17T12:17:24.336171+0000","last_fullsized":"2024-02-17T12:17:24.336171+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:28.360685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405827+0000","last_change":"2024-02-17T12:17:05.039687+0000","last_active":"2024-02-17T12:17:24.405827+0000","last_peered":"2024-02-17T12:17:24.405827+0000","last_clean":"2024-02-17T12:17:24.405827+0000","last_became_active":"2024-02-17T12:17:05.039381+0000","last_became_peered":"2024-02-17T12:17:05.039381+0000","last_unstale":"2024-02-17T12:17:24.405827+0000","last_undegraded":"2024-02-17T12:17:24.405827+0000","last_fullsized":"2024-02-17T12:17:24.405827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340899+0000","last_change":"2024-02-17T12:17:06.070621+0000","last_active":"2024-02-17T12:17:24.340899+0000","last_peered":"2024-02-17T12:17:24.340899+0000","last_clean":"2024-02-17T12:17:24.340899+0000","last_became_active":"2024-02-17T12:17:06.069921+0000","last_became_peered":"2024-02-17T12:17:06.069921+0000","last_unstale":"2024-02-17T12:17:24.340899+0000","last_undegraded":"2024-02-17T12:17:24.340899+0000","last_fullsized":"2024-02-17T12:17:24.340899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:02.449515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.360163+0000","last_change":"2024-02-17T12:17:22.336191+0000","last_active":"2024-02-17T12:17:23.360163+0000","last_peered":"2024-02-17T12:17:23.360163+0000","last_clean":"2024-02-17T12:17:23.360163+0000","last_became_active":"2024-02-17T12:17:22.335893+0000","last_became_peered":"2024-02-17T12:17:22.335893+0000","last_unstale":"2024-02-17T12:17:23.360163+0000","last_undegraded":"2024-02-17T12:17:23.360163+0000","last_fullsized":"2024-02-17T12:17:23.360163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:10:23.952737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342240+0000","last_change":"2024-02-17T12:17:23.336740+0000","last_active":"2024-02-17T12:17:24.342240+0000","last_peered":"2024-02-17T12:17:24.342240+0000","last_clean":"2024-02-17T12:17:24.342240+0000","last_became_active":"2024-02-17T12:17:23.336431+0000","last_became_peered":"2024-02-17T12:17:23.336431+0000","last_unstale":"2024-02-17T12:17:24.342240+0000","last_undegraded":"2024-02-17T12:17:24.342240+0000","last_fullsized":"2024-02-17T12:17:24.342240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:18:31.192739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340963+0000","last_change":"2024-02-17T12:17:05.029800+0000","last_active":"2024-02-17T12:17:24.340963+0000","last_peered":"2024-02-17T12:17:24.340963+0000","last_clean":"2024-02-17T12:17:24.340963+0000","last_became_active":"2024-02-17T12:17:05.029482+0000","last_became_peered":"2024-02-17T12:17:05.029482+0000","last_unstale":"2024-02-17T12:17:24.340963+0000","last_undegraded":"2024-02-17T12:17:24.340963+0000","last_fullsized":"2024-02-17T12:17:24.340963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405737+0000","last_change":"2024-02-17T12:17:06.046159+0000","last_active":"2024-02-17T12:17:24.405737+0000","last_peered":"2024-02-17T12:17:24.405737+0000","last_clean":"2024-02-17T12:17:24.405737+0000","last_became_active":"2024-02-17T12:17:06.045821+0000","last_became_peered":"2024-02-17T12:17:06.045821+0000","last_unstale":"2024-02-17T12:17:24.405737+0000","last_undegraded":"2024-02-17T12:17:24.405737+0000","last_fullsized":"2024-02-17T12:17:24.405737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:40.043966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336334+0000","last_change":"2024-02-17T12:17:22.341496+0000","last_active":"2024-02-17T12:17:24.336334+0000","last_peered":"2024-02-17T12:17:24.336334+0000","last_clean":"2024-02-17T12:17:24.336334+0000","last_became_active":"2024-02-17T12:17:22.338288+0000","last_became_peered":"2024-02-17T12:17:22.338288+0000","last_unstale":"2024-02-17T12:17:24.336334+0000","last_undegraded":"2024-02-17T12:17:24.336334+0000","last_fullsized":"2024-02-17T12:17:24.336334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:02:39.422372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.345686+0000","last_change":"2024-02-17T12:17:23.341176+0000","last_active":"2024-02-17T12:17:23.345686+0000","last_peered":"2024-02-17T12:17:23.345686+0000","last_clean":"2024-02-17T12:17:23.345686+0000","last_became_active":"2024-02-17T12:17:23.340896+0000","last_became_peered":"2024-02-17T12:17:23.340896+0000","last_unstale":"2024-02-17T12:17:23.345686+0000","last_undegraded":"2024-02-17T12:17:23.345686+0000","last_fullsized":"2024-02-17T12:17:23.345686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:11:14.938938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.321833+0000","last_change":"2024-02-17T12:17:06.067536+0000","last_active":"2024-02-17T12:17:23.321833+0000","last_peered":"2024-02-17T12:17:23.321833+0000","last_clean":"2024-02-17T12:17:23.321833+0000","last_became_active":"2024-02-17T12:17:06.066861+0000","last_became_peered":"2024-02-17T12:17:06.066861+0000","last_unstale":"2024-02-17T12:17:23.321833+0000","last_undegraded":"2024-02-17T12:17:23.321833+0000","last_fullsized":"2024-02-17T12:17:23.321833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:52.966313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339986+0000","last_change":"2024-02-17T12:17:23.347358+0000","last_active":"2024-02-17T12:17:24.339986+0000","last_peered":"2024-02-17T12:17:24.339986+0000","last_clean":"2024-02-17T12:17:24.339986+0000","last_became_active":"2024-02-17T12:17:23.346889+0000","last_became_peered":"2024-02-17T12:17:23.346889+0000","last_unstale":"2024-02-17T12:17:24.339986+0000","last_undegraded":"2024-02-17T12:17:24.339986+0000","last_fullsized":"2024-02-17T12:17:24.339986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:26:42.189066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339382+0000","last_change":"2024-02-17T12:17:06.058310+0000","last_active":"2024-02-17T12:17:24.339382+0000","last_peered":"2024-02-17T12:17:24.339382+0000","last_clean":"2024-02-17T12:17:24.339382+0000","last_became_active":"2024-02-17T12:17:06.058007+0000","last_became_peered":"2024-02-17T12:17:06.058007+0000","last_unstale":"2024-02-17T12:17:24.339382+0000","last_undegraded":"2024-02-17T12:17:24.339382+0000","last_fullsized":"2024-02-17T12:17:24.339382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:10.427795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.351496+0000","last_change":"2024-02-17T12:17:23.340221+0000","last_active":"2024-02-17T12:17:23.351496+0000","last_peered":"2024-02-17T12:17:23.351496+0000","last_clean":"2024-02-17T12:17:23.351496+0000","last_became_active":"2024-02-17T12:17:23.339968+0000","last_became_peered":"2024-02-17T12:17:23.339968+0000","last_unstale":"2024-02-17T12:17:23.351496+0000","last_undegraded":"2024-02-17T12:17:23.351496+0000","last_fullsized":"2024-02-17T12:17:23.351496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:56:54.288840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322216+0000","last_change":"2024-02-17T12:17:06.056092+0000","last_active":"2024-02-17T12:17:23.322216+0000","last_peered":"2024-02-17T12:17:23.322216+0000","last_clean":"2024-02-17T12:17:23.322216+0000","last_became_active":"2024-02-17T12:17:06.055782+0000","last_became_peered":"2024-02-17T12:17:06.055782+0000","last_unstale":"2024-02-17T12:17:23.322216+0000","last_undegraded":"2024-02-17T12:17:23.322216+0000","last_fullsized":"2024-02-17T12:17:23.322216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:04:27.477154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350857+0000","last_change":"2024-02-17T12:17:23.332649+0000","last_active":"2024-02-17T12:17:24.350857+0000","last_peered":"2024-02-17T12:17:24.350857+0000","last_clean":"2024-02-17T12:17:24.350857+0000","last_became_active":"2024-02-17T12:17:23.332294+0000","last_became_peered":"2024-02-17T12:17:23.332294+0000","last_unstale":"2024-02-17T12:17:24.350857+0000","last_undegraded":"2024-02-17T12:17:24.350857+0000","last_fullsized":"2024-02-17T12:17:24.350857+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:52:50.391174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.331041+0000","last_change":"2024-02-17T12:17:06.059053+0000","last_active":"2024-02-17T12:17:23.331041+0000","last_peered":"2024-02-17T12:17:23.331041+0000","last_clean":"2024-02-17T12:17:23.331041+0000","last_became_active":"2024-02-17T12:17:06.058762+0000","last_became_peered":"2024-02-17T12:17:06.058762+0000","last_unstale":"2024-02-17T12:17:23.331041+0000","last_undegraded":"2024-02-17T12:17:23.331041+0000","last_fullsized":"2024-02-17T12:17:23.331041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:54:58.399092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.351528+0000","last_change":"2024-02-17T12:17:23.348700+0000","last_active":"2024-02-17T12:17:23.351528+0000","last_peered":"2024-02-17T12:17:23.351528+0000","last_clean":"2024-02-17T12:17:23.351528+0000","last_became_active":"2024-02-17T12:17:23.348472+0000","last_became_peered":"2024-02-17T12:17:23.348472+0000","last_unstale":"2024-02-17T12:17:23.351528+0000","last_undegraded":"2024-02-17T12:17:23.351528+0000","last_fullsized":"2024-02-17T12:17:23.351528+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:59:51.903718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342457+0000","last_change":"2024-02-17T12:17:06.044234+0000","last_active":"2024-02-17T12:17:24.342457+0000","last_peered":"2024-02-17T12:17:24.342457+0000","last_clean":"2024-02-17T12:17:24.342457+0000","last_became_active":"2024-02-17T12:17:06.043918+0000","last_became_peered":"2024-02-17T12:17:06.043918+0000","last_unstale":"2024-02-17T12:17:24.342457+0000","last_undegraded":"2024-02-17T12:17:24.342457+0000","last_fullsized":"2024-02-17T12:17:24.342457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:15.140333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340862+0000","last_change":"2024-02-17T12:17:23.351279+0000","last_active":"2024-02-17T12:17:24.340862+0000","last_peered":"2024-02-17T12:17:24.340862+0000","last_clean":"2024-02-17T12:17:24.340862+0000","last_became_active":"2024-02-17T12:17:23.348237+0000","last_became_peered":"2024-02-17T12:17:23.348237+0000","last_unstale":"2024-02-17T12:17:24.340862+0000","last_undegraded":"2024-02-17T12:17:24.340862+0000","last_fullsized":"2024-02-17T12:17:24.340862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:25.808758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335874+0000","last_change":"2024-02-17T12:17:06.065534+0000","last_active":"2024-02-17T12:17:24.335874+0000","last_peered":"2024-02-17T12:17:24.335874+0000","last_clean":"2024-02-17T12:17:24.335874+0000","last_became_active":"2024-02-17T12:17:06.065279+0000","last_became_peered":"2024-02-17T12:17:06.065279+0000","last_unstale":"2024-02-17T12:17:24.335874+0000","last_undegraded":"2024-02-17T12:17:24.335874+0000","last_fullsized":"2024-02-17T12:17:24.335874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:52.059473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342000+0000","last_change":"2024-02-17T12:17:23.337509+0000","last_active":"2024-02-17T12:17:24.342000+0000","last_peered":"2024-02-17T12:17:24.342000+0000","last_clean":"2024-02-17T12:17:24.342000+0000","last_became_active":"2024-02-17T12:17:23.337202+0000","last_became_peered":"2024-02-17T12:17:23.337202+0000","last_unstale":"2024-02-17T12:17:24.342000+0000","last_undegraded":"2024-02-17T12:17:24.342000+0000","last_fullsized":"2024-02-17T12:17:24.342000+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:14:39.305651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351759+0000","last_change":"2024-02-17T12:17:06.045278+0000","last_active":"2024-02-17T12:17:24.351759+0000","last_peered":"2024-02-17T12:17:24.351759+0000","last_clean":"2024-02-17T12:17:24.351759+0000","last_became_active":"2024-02-17T12:17:06.045015+0000","last_became_peered":"2024-02-17T12:17:06.045015+0000","last_unstale":"2024-02-17T12:17:24.351759+0000","last_undegraded":"2024-02-17T12:17:24.351759+0000","last_fullsized":"2024-02-17T12:17:24.351759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:23:10.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.345613+0000","last_change":"2024-02-17T12:17:23.341600+0000","last_active":"2024-02-17T12:17:23.345613+0000","last_peered":"2024-02-17T12:17:23.345613+0000","last_clean":"2024-02-17T12:17:23.345613+0000","last_became_active":"2024-02-17T12:17:23.341333+0000","last_became_peered":"2024-02-17T12:17:23.341333+0000","last_unstale":"2024-02-17T12:17:23.345613+0000","last_undegraded":"2024-02-17T12:17:23.345613+0000","last_fullsized":"2024-02-17T12:17:23.345613+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:59.089431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336446+0000","last_change":"2024-02-17T12:17:06.054887+0000","last_active":"2024-02-17T12:17:24.336446+0000","last_peered":"2024-02-17T12:17:24.336446+0000","last_clean":"2024-02-17T12:17:24.336446+0000","last_became_active":"2024-02-17T12:17:06.054012+0000","last_became_peered":"2024-02-17T12:17:06.054012+0000","last_unstale":"2024-02-17T12:17:24.336446+0000","last_undegraded":"2024-02-17T12:17:24.336446+0000","last_fullsized":"2024-02-17T12:17:24.336446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:41.419455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405194+0000","last_change":"2024-02-17T12:17:23.349574+0000","last_active":"2024-02-17T12:17:24.405194+0000","last_peered":"2024-02-17T12:17:24.405194+0000","last_clean":"2024-02-17T12:17:24.405194+0000","last_became_active":"2024-02-17T12:17:23.348486+0000","last_became_peered":"2024-02-17T12:17:23.348486+0000","last_unstale":"2024-02-17T12:17:24.405194+0000","last_undegraded":"2024-02-17T12:17:24.405194+0000","last_fullsized":"2024-02-17T12:17:24.405194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:25.808758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340801+0000","last_change":"2024-02-17T12:17:06.046677+0000","last_active":"2024-02-17T12:17:24.340801+0000","last_peered":"2024-02-17T12:17:24.340801+0000","last_clean":"2024-02-17T12:17:24.340801+0000","last_became_active":"2024-02-17T12:17:06.046330+0000","last_became_peered":"2024-02-17T12:17:06.046330+0000","last_unstale":"2024-02-17T12:17:24.340801+0000","last_undegraded":"2024-02-17T12:17:24.340801+0000","last_fullsized":"2024-02-17T12:17:24.340801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:10:08.114724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351380+0000","last_change":"2024-02-17T12:17:23.346479+0000","last_active":"2024-02-17T12:17:24.351380+0000","last_peered":"2024-02-17T12:17:24.351380+0000","last_clean":"2024-02-17T12:17:24.351380+0000","last_became_active":"2024-02-17T12:17:23.346107+0000","last_became_peered":"2024-02-17T12:17:23.346107+0000","last_unstale":"2024-02-17T12:17:24.351380+0000","last_undegraded":"2024-02-17T12:17:24.351380+0000","last_fullsized":"2024-02-17T12:17:24.351380+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:08:55.017639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405104+0000","last_change":"2024-02-17T12:17:06.043576+0000","last_active":"2024-02-17T12:17:24.405104+0000","last_peered":"2024-02-17T12:17:24.405104+0000","last_clean":"2024-02-17T12:17:24.405104+0000","last_became_active":"2024-02-17T12:17:06.043313+0000","last_became_peered":"2024-02-17T12:17:06.043313+0000","last_unstale":"2024-02-17T12:17:24.405104+0000","last_undegraded":"2024-02-17T12:17:24.405104+0000","last_fullsized":"2024-02-17T12:17:24.405104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:18.832967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339201+0000","last_change":"2024-02-17T12:17:23.350086+0000","last_active":"2024-02-17T12:17:24.339201+0000","last_peered":"2024-02-17T12:17:24.339201+0000","last_clean":"2024-02-17T12:17:24.339201+0000","last_became_active":"2024-02-17T12:17:23.348268+0000","last_became_peered":"2024-02-17T12:17:23.348268+0000","last_unstale":"2024-02-17T12:17:24.339201+0000","last_undegraded":"2024-02-17T12:17:24.339201+0000","last_fullsized":"2024-02-17T12:17:24.339201+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:42:07.187217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330247+0000","last_change":"2024-02-17T12:17:06.061943+0000","last_active":"2024-02-17T12:17:23.330247+0000","last_peered":"2024-02-17T12:17:23.330247+0000","last_clean":"2024-02-17T12:17:23.330247+0000","last_became_active":"2024-02-17T12:17:06.057880+0000","last_became_peered":"2024-02-17T12:17:06.057880+0000","last_unstale":"2024-02-17T12:17:23.330247+0000","last_undegraded":"2024-02-17T12:17:23.330247+0000","last_fullsized":"2024-02-17T12:17:23.330247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:41.759635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339657+0000","last_change":"2024-02-17T12:17:23.340929+0000","last_active":"2024-02-17T12:17:24.339657+0000","last_peered":"2024-02-17T12:17:24.339657+0000","last_clean":"2024-02-17T12:17:24.339657+0000","last_became_active":"2024-02-17T12:17:23.340480+0000","last_became_peered":"2024-02-17T12:17:23.340480+0000","last_unstale":"2024-02-17T12:17:24.339657+0000","last_undegraded":"2024-02-17T12:17:24.339657+0000","last_fullsized":"2024-02-17T12:17:24.339657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:43:22.169547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330938+0000","last_change":"2024-02-17T12:17:06.056498+0000","last_active":"2024-02-17T12:17:23.330938+0000","last_peered":"2024-02-17T12:17:23.330938+0000","last_clean":"2024-02-17T12:17:23.330938+0000","last_became_active":"2024-02-17T12:17:06.056186+0000","last_became_peered":"2024-02-17T12:17:06.056186+0000","last_unstale":"2024-02-17T12:17:23.330938+0000","last_undegraded":"2024-02-17T12:17:23.330938+0000","last_fullsized":"2024-02-17T12:17:23.330938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:54.119743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.348691+0000","last_change":"2024-02-17T12:17:23.344887+0000","last_active":"2024-02-17T12:17:23.348691+0000","last_peered":"2024-02-17T12:17:23.348691+0000","last_clean":"2024-02-17T12:17:23.348691+0000","last_became_active":"2024-02-17T12:17:23.344580+0000","last_became_peered":"2024-02-17T12:17:23.344580+0000","last_unstale":"2024-02-17T12:17:23.348691+0000","last_undegraded":"2024-02-17T12:17:23.348691+0000","last_fullsized":"2024-02-17T12:17:23.348691+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:00:34.474456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329148+0000","last_change":"2024-02-17T12:17:06.042349+0000","last_active":"2024-02-17T12:17:23.329148+0000","last_peered":"2024-02-17T12:17:23.329148+0000","last_clean":"2024-02-17T12:17:23.329148+0000","last_became_active":"2024-02-17T12:17:06.041014+0000","last_became_peered":"2024-02-17T12:17:06.041014+0000","last_unstale":"2024-02-17T12:17:23.329148+0000","last_undegraded":"2024-02-17T12:17:23.329148+0000","last_fullsized":"2024-02-17T12:17:23.329148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:17.216650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.348598+0000","last_change":"2024-02-17T12:17:23.344990+0000","last_active":"2024-02-17T12:17:23.348598+0000","last_peered":"2024-02-17T12:17:23.348598+0000","last_clean":"2024-02-17T12:17:23.348598+0000","last_became_active":"2024-02-17T12:17:23.344662+0000","last_became_peered":"2024-02-17T12:17:23.344662+0000","last_unstale":"2024-02-17T12:17:23.348598+0000","last_undegraded":"2024-02-17T12:17:23.348598+0000","last_fullsized":"2024-02-17T12:17:23.348598+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:20:48.204608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351229+0000","last_change":"2024-02-17T12:17:06.047799+0000","last_active":"2024-02-17T12:17:24.351229+0000","last_peered":"2024-02-17T12:17:24.351229+0000","last_clean":"2024-02-17T12:17:24.351229+0000","last_became_active":"2024-02-17T12:17:06.047532+0000","last_became_peered":"2024-02-17T12:17:06.047532+0000","last_unstale":"2024-02-17T12:17:24.351229+0000","last_undegraded":"2024-02-17T12:17:24.351229+0000","last_fullsized":"2024-02-17T12:17:24.351229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:49:48.671656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.351445+0000","last_change":"2024-02-17T12:17:23.341593+0000","last_active":"2024-02-17T12:17:23.351445+0000","last_peered":"2024-02-17T12:17:23.351445+0000","last_clean":"2024-02-17T12:17:23.351445+0000","last_became_active":"2024-02-17T12:17:23.341274+0000","last_became_peered":"2024-02-17T12:17:23.341274+0000","last_unstale":"2024-02-17T12:17:23.351445+0000","last_undegraded":"2024-02-17T12:17:23.351445+0000","last_fullsized":"2024-02-17T12:17:23.351445+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:38.005895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351685+0000","last_change":"2024-02-17T12:17:06.061999+0000","last_active":"2024-02-17T12:17:24.351685+0000","last_peered":"2024-02-17T12:17:24.351685+0000","last_clean":"2024-02-17T12:17:24.351685+0000","last_became_active":"2024-02-17T12:17:06.060293+0000","last_became_peered":"2024-02-17T12:17:06.060293+0000","last_unstale":"2024-02-17T12:17:24.351685+0000","last_undegraded":"2024-02-17T12:17:24.351685+0000","last_fullsized":"2024-02-17T12:17:24.351685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:52:45.908320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340415+0000","last_change":"2024-02-17T12:17:23.351123+0000","last_active":"2024-02-17T12:17:24.340415+0000","last_peered":"2024-02-17T12:17:24.340415+0000","last_clean":"2024-02-17T12:17:24.340415+0000","last_became_active":"2024-02-17T12:17:23.350739+0000","last_became_peered":"2024-02-17T12:17:23.350739+0000","last_unstale":"2024-02-17T12:17:24.340415+0000","last_undegraded":"2024-02-17T12:17:24.340415+0000","last_fullsized":"2024-02-17T12:17:24.340415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:40:17.228464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.324132+0000","last_change":"2024-02-17T12:17:06.056524+0000","last_active":"2024-02-17T12:17:23.324132+0000","last_peered":"2024-02-17T12:17:23.324132+0000","last_clean":"2024-02-17T12:17:23.324132+0000","last_became_active":"2024-02-17T12:17:06.056171+0000","last_became_peered":"2024-02-17T12:17:06.056171+0000","last_unstale":"2024-02-17T12:17:23.324132+0000","last_undegraded":"2024-02-17T12:17:23.324132+0000","last_fullsized":"2024-02-17T12:17:23.324132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.599213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405110+0000","last_change":"2024-02-17T12:17:23.354324+0000","last_active":"2024-02-17T12:17:24.405110+0000","last_peered":"2024-02-17T12:17:24.405110+0000","last_clean":"2024-02-17T12:17:24.405110+0000","last_became_active":"2024-02-17T12:17:23.352975+0000","last_became_peered":"2024-02-17T12:17:23.352975+0000","last_unstale":"2024-02-17T12:17:24.405110+0000","last_undegraded":"2024-02-17T12:17:24.405110+0000","last_fullsized":"2024-02-17T12:17:24.405110+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:31.316019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322239+0000","last_change":"2024-02-17T12:17:06.053372+0000","last_active":"2024-02-17T12:17:23.322239+0000","last_peered":"2024-02-17T12:17:23.322239+0000","last_clean":"2024-02-17T12:17:23.322239+0000","last_became_active":"2024-02-17T12:17:06.053019+0000","last_became_peered":"2024-02-17T12:17:06.053019+0000","last_unstale":"2024-02-17T12:17:23.322239+0000","last_undegraded":"2024-02-17T12:17:23.322239+0000","last_fullsized":"2024-02-17T12:17:23.322239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:01:09.789376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.353675+0000","last_change":"2024-02-17T12:17:23.345991+0000","last_active":"2024-02-17T12:17:23.353675+0000","last_peered":"2024-02-17T12:17:23.353675+0000","last_clean":"2024-02-17T12:17:23.353675+0000","last_became_active":"2024-02-17T12:17:23.345690+0000","last_became_peered":"2024-02-17T12:17:23.345690+0000","last_unstale":"2024-02-17T12:17:23.353675+0000","last_undegraded":"2024-02-17T12:17:23.353675+0000","last_fullsized":"2024-02-17T12:17:23.353675+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:15.700922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341618+0000","last_change":"2024-02-17T12:17:06.050512+0000","last_active":"2024-02-17T12:17:24.341618+0000","last_peered":"2024-02-17T12:17:24.341618+0000","last_clean":"2024-02-17T12:17:24.341618+0000","last_became_active":"2024-02-17T12:17:06.050068+0000","last_became_peered":"2024-02-17T12:17:06.050068+0000","last_unstale":"2024-02-17T12:17:24.341618+0000","last_undegraded":"2024-02-17T12:17:24.341618+0000","last_fullsized":"2024-02-17T12:17:24.341618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:52.059473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339188+0000","last_change":"2024-02-17T12:17:23.343419+0000","last_active":"2024-02-17T12:17:24.339188+0000","last_peered":"2024-02-17T12:17:24.339188+0000","last_clean":"2024-02-17T12:17:24.339188+0000","last_became_active":"2024-02-17T12:17:23.342512+0000","last_became_peered":"2024-02-17T12:17:23.342512+0000","last_unstale":"2024-02-17T12:17:24.339188+0000","last_undegraded":"2024-02-17T12:17:24.339188+0000","last_fullsized":"2024-02-17T12:17:24.339188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:38.848587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351430+0000","last_change":"2024-02-17T12:17:06.048246+0000","last_active":"2024-02-17T12:17:24.351430+0000","last_peered":"2024-02-17T12:17:24.351430+0000","last_clean":"2024-02-17T12:17:24.351430+0000","last_became_active":"2024-02-17T12:17:06.047970+0000","last_became_peered":"2024-02-17T12:17:06.047970+0000","last_unstale":"2024-02-17T12:17:24.351430+0000","last_undegraded":"2024-02-17T12:17:24.351430+0000","last_fullsized":"2024-02-17T12:17:24.351430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:10:08.114724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350771+0000","last_change":"2024-02-17T12:17:23.346426+0000","last_active":"2024-02-17T12:17:24.350771+0000","last_peered":"2024-02-17T12:17:24.350771+0000","last_clean":"2024-02-17T12:17:24.350771+0000","last_became_active":"2024-02-17T12:17:23.345948+0000","last_became_peered":"2024-02-17T12:17:23.345948+0000","last_unstale":"2024-02-17T12:17:24.350771+0000","last_undegraded":"2024-02-17T12:17:24.350771+0000","last_fullsized":"2024-02-17T12:17:24.350771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:05.113702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329415+0000","last_change":"2024-02-17T12:17:06.050786+0000","last_active":"2024-02-17T12:17:23.329415+0000","last_peered":"2024-02-17T12:17:23.329415+0000","last_clean":"2024-02-17T12:17:23.329415+0000","last_became_active":"2024-02-17T12:17:06.050510+0000","last_became_peered":"2024-02-17T12:17:06.050510+0000","last_unstale":"2024-02-17T12:17:23.329415+0000","last_undegraded":"2024-02-17T12:17:23.329415+0000","last_fullsized":"2024-02-17T12:17:23.329415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:32:33.567679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405607+0000","last_change":"2024-02-17T12:17:23.358972+0000","last_active":"2024-02-17T12:17:24.405607+0000","last_peered":"2024-02-17T12:17:24.405607+0000","last_clean":"2024-02-17T12:17:24.405607+0000","last_became_active":"2024-02-17T12:17:23.358748+0000","last_became_peered":"2024-02-17T12:17:23.358748+0000","last_unstale":"2024-02-17T12:17:24.405607+0000","last_undegraded":"2024-02-17T12:17:24.405607+0000","last_fullsized":"2024-02-17T12:17:24.405607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:05.175835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342365+0000","last_change":"2024-02-17T12:17:06.044931+0000","last_active":"2024-02-17T12:17:24.342365+0000","last_peered":"2024-02-17T12:17:24.342365+0000","last_clean":"2024-02-17T12:17:24.342365+0000","last_became_active":"2024-02-17T12:17:06.044646+0000","last_became_peered":"2024-02-17T12:17:06.044646+0000","last_unstale":"2024-02-17T12:17:24.342365+0000","last_undegraded":"2024-02-17T12:17:24.342365+0000","last_fullsized":"2024-02-17T12:17:24.342365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:16.951684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405698+0000","last_change":"2024-02-17T12:17:23.357131+0000","last_active":"2024-02-17T12:17:24.405698+0000","last_peered":"2024-02-17T12:17:24.405698+0000","last_clean":"2024-02-17T12:17:24.405698+0000","last_became_active":"2024-02-17T12:17:23.356796+0000","last_became_peered":"2024-02-17T12:17:23.356796+0000","last_unstale":"2024-02-17T12:17:24.405698+0000","last_undegraded":"2024-02-17T12:17:24.405698+0000","last_fullsized":"2024-02-17T12:17:24.405698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:44:46.548825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.323628+0000","last_change":"2024-02-17T12:17:06.066599+0000","last_active":"2024-02-17T12:17:23.323628+0000","last_peered":"2024-02-17T12:17:23.323628+0000","last_clean":"2024-02-17T12:17:23.323628+0000","last_became_active":"2024-02-17T12:17:06.066328+0000","last_became_peered":"2024-02-17T12:17:06.066328+0000","last_unstale":"2024-02-17T12:17:23.323628+0000","last_undegraded":"2024-02-17T12:17:23.323628+0000","last_fullsized":"2024-02-17T12:17:23.323628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:05.232139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341940+0000","last_change":"2024-02-17T12:17:23.337740+0000","last_active":"2024-02-17T12:17:24.341940+0000","last_peered":"2024-02-17T12:17:24.341940+0000","last_clean":"2024-02-17T12:17:24.341940+0000","last_became_active":"2024-02-17T12:17:23.337210+0000","last_became_peered":"2024-02-17T12:17:23.337210+0000","last_unstale":"2024-02-17T12:17:24.341940+0000","last_undegraded":"2024-02-17T12:17:24.341940+0000","last_fullsized":"2024-02-17T12:17:24.341940+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:44:46.548825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336241+0000","last_change":"2024-02-17T12:17:06.046775+0000","last_active":"2024-02-17T12:17:24.336241+0000","last_peered":"2024-02-17T12:17:24.336241+0000","last_clean":"2024-02-17T12:17:24.336241+0000","last_became_active":"2024-02-17T12:17:06.046488+0000","last_became_peered":"2024-02-17T12:17:06.046488+0000","last_unstale":"2024-02-17T12:17:24.336241+0000","last_undegraded":"2024-02-17T12:17:24.336241+0000","last_fullsized":"2024-02-17T12:17:24.336241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:09:44.880288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405401+0000","last_change":"2024-02-17T12:17:23.356702+0000","last_active":"2024-02-17T12:17:24.405401+0000","last_peered":"2024-02-17T12:17:24.405401+0000","last_clean":"2024-02-17T12:17:24.405401+0000","last_became_active":"2024-02-17T12:17:23.355031+0000","last_became_peered":"2024-02-17T12:17:23.355031+0000","last_unstale":"2024-02-17T12:17:24.405401+0000","last_undegraded":"2024-02-17T12:17:24.405401+0000","last_fullsized":"2024-02-17T12:17:24.405401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:28.760947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.339279+0000","last_change":"2024-02-17T12:17:06.070529+0000","last_active":"2024-02-17T12:17:23.339279+0000","last_peered":"2024-02-17T12:17:23.339279+0000","last_clean":"2024-02-17T12:17:23.339279+0000","last_became_active":"2024-02-17T12:17:06.066959+0000","last_became_peered":"2024-02-17T12:17:06.066959+0000","last_unstale":"2024-02-17T12:17:23.339279+0000","last_undegraded":"2024-02-17T12:17:23.339279+0000","last_fullsized":"2024-02-17T12:17:23.339279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:56:36.987010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350861+0000","last_change":"2024-02-17T12:17:23.327940+0000","last_active":"2024-02-17T12:17:24.350861+0000","last_peered":"2024-02-17T12:17:24.350861+0000","last_clean":"2024-02-17T12:17:24.350861+0000","last_became_active":"2024-02-17T12:17:23.327675+0000","last_became_peered":"2024-02-17T12:17:23.327675+0000","last_unstale":"2024-02-17T12:17:24.350861+0000","last_undegraded":"2024-02-17T12:17:24.350861+0000","last_fullsized":"2024-02-17T12:17:24.350861+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:04:21.451609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.321898+0000","last_change":"2024-02-17T12:17:06.064126+0000","last_active":"2024-02-17T12:17:23.321898+0000","last_peered":"2024-02-17T12:17:23.321898+0000","last_clean":"2024-02-17T12:17:23.321898+0000","last_became_active":"2024-02-17T12:17:06.063876+0000","last_became_peered":"2024-02-17T12:17:06.063876+0000","last_unstale":"2024-02-17T12:17:23.321898+0000","last_undegraded":"2024-02-17T12:17:23.321898+0000","last_fullsized":"2024-02-17T12:17:23.321898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:33:43.849542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341858+0000","last_change":"2024-02-17T12:17:23.344138+0000","last_active":"2024-02-17T12:17:24.341858+0000","last_peered":"2024-02-17T12:17:24.341858+0000","last_clean":"2024-02-17T12:17:24.341858+0000","last_became_active":"2024-02-17T12:17:23.343907+0000","last_became_peered":"2024-02-17T12:17:23.343907+0000","last_unstale":"2024-02-17T12:17:24.341858+0000","last_undegraded":"2024-02-17T12:17:24.341858+0000","last_fullsized":"2024-02-17T12:17:24.341858+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:05.175835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.323114+0000","last_change":"2024-02-17T12:17:06.057466+0000","last_active":"2024-02-17T12:17:23.323114+0000","last_peered":"2024-02-17T12:17:23.323114+0000","last_clean":"2024-02-17T12:17:23.323114+0000","last_became_active":"2024-02-17T12:17:06.056922+0000","last_became_peered":"2024-02-17T12:17:06.056922+0000","last_unstale":"2024-02-17T12:17:23.323114+0000","last_undegraded":"2024-02-17T12:17:23.323114+0000","last_fullsized":"2024-02-17T12:17:23.323114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:48.842059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405003+0000","last_change":"2024-02-17T12:17:23.357082+0000","last_active":"2024-02-17T12:17:24.405003+0000","last_peered":"2024-02-17T12:17:24.405003+0000","last_clean":"2024-02-17T12:17:24.405003+0000","last_became_active":"2024-02-17T12:17:23.355207+0000","last_became_peered":"2024-02-17T12:17:23.355207+0000","last_unstale":"2024-02-17T12:17:24.405003+0000","last_undegraded":"2024-02-17T12:17:24.405003+0000","last_fullsized":"2024-02-17T12:17:24.405003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:25.892811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351319+0000","last_change":"2024-02-17T12:17:06.046884+0000","last_active":"2024-02-17T12:17:24.351319+0000","last_peered":"2024-02-17T12:17:24.351319+0000","last_clean":"2024-02-17T12:17:24.351319+0000","last_became_active":"2024-02-17T12:17:06.046588+0000","last_became_peered":"2024-02-17T12:17:06.046588+0000","last_unstale":"2024-02-17T12:17:24.351319+0000","last_undegraded":"2024-02-17T12:17:24.351319+0000","last_fullsized":"2024-02-17T12:17:24.351319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:50:00.758848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.347280+0000","last_change":"2024-02-17T12:17:23.340850+0000","last_active":"2024-02-17T12:17:23.347280+0000","last_peered":"2024-02-17T12:17:23.347280+0000","last_clean":"2024-02-17T12:17:23.347280+0000","last_became_active":"2024-02-17T12:17:23.340238+0000","last_became_peered":"2024-02-17T12:17:23.340238+0000","last_unstale":"2024-02-17T12:17:23.347280+0000","last_undegraded":"2024-02-17T12:17:23.347280+0000","last_fullsized":"2024-02-17T12:17:23.347280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:07.872630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.328871+0000","last_change":"2024-02-17T12:17:06.042206+0000","last_active":"2024-02-17T12:17:23.328871+0000","last_peered":"2024-02-17T12:17:23.328871+0000","last_clean":"2024-02-17T12:17:23.328871+0000","last_became_active":"2024-02-17T12:17:06.041911+0000","last_became_peered":"2024-02-17T12:17:06.041911+0000","last_unstale":"2024-02-17T12:17:23.328871+0000","last_undegraded":"2024-02-17T12:17:23.328871+0000","last_fullsized":"2024-02-17T12:17:23.328871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:09.997084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342186+0000","last_change":"2024-02-17T12:17:23.352578+0000","last_active":"2024-02-17T12:17:24.342186+0000","last_peered":"2024-02-17T12:17:24.342186+0000","last_clean":"2024-02-17T12:17:24.342186+0000","last_became_active":"2024-02-17T12:17:23.352080+0000","last_became_peered":"2024-02-17T12:17:23.352080+0000","last_unstale":"2024-02-17T12:17:24.342186+0000","last_undegraded":"2024-02-17T12:17:24.342186+0000","last_fullsized":"2024-02-17T12:17:24.342186+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:25:14.234550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335842+0000","last_change":"2024-02-17T12:17:06.065748+0000","last_active":"2024-02-17T12:17:24.335842+0000","last_peered":"2024-02-17T12:17:24.335842+0000","last_clean":"2024-02-17T12:17:24.335842+0000","last_became_active":"2024-02-17T12:17:06.065234+0000","last_became_peered":"2024-02-17T12:17:06.065234+0000","last_unstale":"2024-02-17T12:17:24.335842+0000","last_undegraded":"2024-02-17T12:17:24.335842+0000","last_fullsized":"2024-02-17T12:17:24.335842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:25:38.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.349026+0000","last_change":"2024-02-17T12:17:23.346045+0000","last_active":"2024-02-17T12:17:23.349026+0000","last_peered":"2024-02-17T12:17:23.349026+0000","last_clean":"2024-02-17T12:17:23.349026+0000","last_became_active":"2024-02-17T12:17:23.345638+0000","last_became_peered":"2024-02-17T12:17:23.345638+0000","last_unstale":"2024-02-17T12:17:23.349026+0000","last_undegraded":"2024-02-17T12:17:23.349026+0000","last_fullsized":"2024-02-17T12:17:23.349026+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:17:30.345217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342221+0000","last_change":"2024-02-17T12:17:06.061029+0000","last_active":"2024-02-17T12:17:24.342221+0000","last_peered":"2024-02-17T12:17:24.342221+0000","last_clean":"2024-02-17T12:17:24.342221+0000","last_became_active":"2024-02-17T12:17:06.060750+0000","last_became_peered":"2024-02-17T12:17:06.060750+0000","last_unstale":"2024-02-17T12:17:24.342221+0000","last_undegraded":"2024-02-17T12:17:24.342221+0000","last_fullsized":"2024-02-17T12:17:24.342221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:49.648481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405429+0000","last_change":"2024-02-17T12:17:23.351523+0000","last_active":"2024-02-17T12:17:24.405429+0000","last_peered":"2024-02-17T12:17:24.405429+0000","last_clean":"2024-02-17T12:17:24.405429+0000","last_became_active":"2024-02-17T12:17:23.351278+0000","last_became_peered":"2024-02-17T12:17:23.351278+0000","last_unstale":"2024-02-17T12:17:24.405429+0000","last_undegraded":"2024-02-17T12:17:24.405429+0000","last_fullsized":"2024-02-17T12:17:24.405429+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:00:59.493939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351684+0000","last_change":"2024-02-17T12:17:06.052373+0000","last_active":"2024-02-17T12:17:24.351684+0000","last_peered":"2024-02-17T12:17:24.351684+0000","last_clean":"2024-02-17T12:17:24.351684+0000","last_became_active":"2024-02-17T12:17:06.050597+0000","last_became_peered":"2024-02-17T12:17:06.050597+0000","last_unstale":"2024-02-17T12:17:24.351684+0000","last_undegraded":"2024-02-17T12:17:24.351684+0000","last_fullsized":"2024-02-17T12:17:24.351684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:34:21.177151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.345588+0000","last_change":"2024-02-17T12:17:23.341028+0000","last_active":"2024-02-17T12:17:23.345588+0000","last_peered":"2024-02-17T12:17:23.345588+0000","last_clean":"2024-02-17T12:17:23.345588+0000","last_became_active":"2024-02-17T12:17:23.340496+0000","last_became_peered":"2024-02-17T12:17:23.340496+0000","last_unstale":"2024-02-17T12:17:23.345588+0000","last_undegraded":"2024-02-17T12:17:23.345588+0000","last_fullsized":"2024-02-17T12:17:23.345588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:20:30.059824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340784+0000","last_change":"2024-02-17T12:17:06.053476+0000","last_active":"2024-02-17T12:17:24.340784+0000","last_peered":"2024-02-17T12:17:24.340784+0000","last_clean":"2024-02-17T12:17:24.340784+0000","last_became_active":"2024-02-17T12:17:06.052947+0000","last_became_peered":"2024-02-17T12:17:06.052947+0000","last_unstale":"2024-02-17T12:17:24.340784+0000","last_undegraded":"2024-02-17T12:17:24.340784+0000","last_fullsized":"2024-02-17T12:17:24.340784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:38.086638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":165604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.88700000000000001}]},{"osd":1,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.78600000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.82099999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.93300000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76500000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.71399999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":165058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.753}]},{"osd":2,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.77900000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72299999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.81000000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":168091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.621},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76400000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.81299999999999994}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.93200000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.89800000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.89000000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.871}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":167523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.1779999999999999,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.6399999999999997,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.51300000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.54400000000000004}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.2779999999999996,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.58799999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":999424,"data_stored":754718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.37}]},{"osd":2,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.312},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.443}]},{"osd":4,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.65900000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.623},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70099999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":747707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.379},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.40999999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.496},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.56699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":158875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.69399999999999995}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.82099999999999995}]},{"osd":2,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.745},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.76000000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.79400000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":158863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.505}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.91100000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.80500000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.75},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.871}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:17:27.415 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:17:27.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.574+0000 7f9e13400640 1 Processor -- start 2024-02-17T12:17:27.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.574+0000 7f9e13400640 1 -- start start 2024-02-17T12:17:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.574+0000 7f9e13400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 0x7f9e0c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.574+0000 7f9e13400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c156270 con 0x7f9e0c152c50 2024-02-17T12:17:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.574+0000 7f9e13400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c156550 con 0x7f9e0c06db50 2024-02-17T12:17:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.574+0000 7f9e13400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c071630 con 0x7f9e0c0c25a0 2024-02-17T12:17:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.574+0000 7f9e11400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9e0c152c50 0x7f9e0c1530e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52706/0 (socket says 172.21.15.114:52706) 2024-02-17T12:17:27.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.574+0000 7f9e11400640 1 -- 172.21.15.114:0/808827256 learned_addr learned my addr 172.21.15.114:0/808827256 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.574+0000 7f9e10a00640 1 --2- 172.21.15.114:0/808827256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 0x7f9e0c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.574+0000 7f9e0b400640 1 -- 172.21.15.114:0/808827256 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456013759 0 0) 0x7f9e0c156270 con 0x7f9e0c152c50 2024-02-17T12:17:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e0b400640 1 -- 172.21.15.114:0/808827256 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df0003530 con 0x7f9e0c152c50 2024-02-17T12:17:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e0b400640 1 -- 172.21.15.114:0/808827256 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262777409 0 0) 0x7f9e0c156550 con 0x7f9e0c06db50 2024-02-17T12:17:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e0b400640 1 -- 172.21.15.114:0/808827256 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e0c156270 con 0x7f9e0c06db50 2024-02-17T12:17:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e10a00640 1 -- 172.21.15.114:0/808827256 >> v1:172.21.15.116:6789/0 conn(0x7f9e0c06db50 legacy=0x7f9e0c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e0b400640 1 -- 172.21.15.114:0/808827256 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3513608655 0 0) 0x7f9df0003530 con 0x7f9e0c152c50 2024-02-17T12:17:27.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e10a00640 1 -- 172.21.15.114:0/808827256 >> v1:172.21.15.114:6789/0 conn(0x7f9e0c152c50 legacy=0x7f9e0c1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e10a00640 1 -- 172.21.15.114:0/808827256 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c156830 con 0x7f9e0c0c25a0 2024-02-17T12:17:27.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e10a00640 1 --2- 172.21.15.114:0/808827256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 0x7f9e0c06e980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009dc0 tx=0x7f9dfc01c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f63768e106b342bb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:27.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e0b400640 1 -- 172.21.15.114:0/808827256 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04001680 con 0x7f9e0c0c25a0 2024-02-17T12:17:27.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e0b400640 1 -- 172.21.15.114:0/808827256 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc0a64d0 con 0x7f9e0c0c25a0 2024-02-17T12:17:27.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.578+0000 7f9e0b400640 1 -- 172.21.15.114:0/808827256 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0a6840 con 0x7f9e0c0c25a0 2024-02-17T12:17:27.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 -- 172.21.15.114:0/808827256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 msgr2=0x7f9e0c06e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 --2- 172.21.15.114:0/808827256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 0x7f9e0c06e980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009dc0 tx=0x7f9dfc01c760 comp rx=0 tx=0).stop 2024-02-17T12:17:27.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 -- 172.21.15.114:0/808827256 shutdown_connections 2024-02-17T12:17:27.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 --2- 172.21.15.114:0/808827256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 0x7f9e0c06e980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 -- 172.21.15.114:0/808827256 >> 172.21.15.114:0/808827256 conn(0x7f9e0c0a8490 msgr2=0x7f9e0c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:27.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 -- 172.21.15.114:0/808827256 shutdown_connections 2024-02-17T12:17:27.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 -- 172.21.15.114:0/808827256 wait complete. 2024-02-17T12:17:27.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 Processor -- start 2024-02-17T12:17:27.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 -- start start 2024-02-17T12:17:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e0c06db50 0x7f9e0c153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 0x7f9e0c155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0c152c50 0x7f9e0c13b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0ab4c0 con 0x7f9e0c152c50 2024-02-17T12:17:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c1ed160 con 0x7f9e0c06db50 2024-02-17T12:17:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e13400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c1ed400 con 0x7f9e0c0c25a0 2024-02-17T12:17:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e11400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0c152c50 0x7f9e0c13b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e11400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0c152c50 0x7f9e0c13b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56068/0 (socket says 172.21.15.114:56068) 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e11400640 1 -- 172.21.15.114:0/3277450784 learned_addr learned my addr 172.21.15.114:0/3277450784 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e0be00640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 0x7f9e0c155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e10a00640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e0c06db50 0x7f9e0c153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e11400640 1 -- 172.21.15.114:0/3277450784 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 msgr2=0x7f9e0c155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e11400640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 0x7f9e0c155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e11400640 1 -- 172.21.15.114:0/3277450784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e0c06db50 msgr2=0x7f9e0c153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e11400640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e0c06db50 0x7f9e0c153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e11400640 1 -- 172.21.15.114:0/3277450784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc009a70 con 0x7f9e0c152c50 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e11400640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0c152c50 0x7f9e0c13b6b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400c520 tx=0x7f9e0400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.582+0000 7f9e08c00640 1 -- 172.21.15.114:0/3277450784 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04005cf0 con 0x7f9e0c152c50 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.586+0000 7f9e08c00640 1 -- 172.21.15.114:0/3277450784 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e04005e50 con 0x7f9e0c152c50 2024-02-17T12:17:27.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.586+0000 7f9e08c00640 1 -- 172.21.15.114:0/3277450784 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e04007290 con 0x7f9e0c152c50 2024-02-17T12:17:27.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.586+0000 7f9e13400640 1 -- 172.21.15.114:0/3277450784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c1ed6e0 con 0x7f9e0c152c50 2024-02-17T12:17:27.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.586+0000 7f9e13400640 1 -- 172.21.15.114:0/3277450784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c155d50 con 0x7f9e0c152c50 2024-02-17T12:17:27.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.586+0000 7f9e13400640 1 -- 172.21.15.114:0/3277450784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c1edee0 con 0x7f9e0c152c50 2024-02-17T12:17:27.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.586+0000 7f9e08c00640 1 -- 172.21.15.114:0/3277450784 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9e040073f0 con 0x7f9e0c152c50 2024-02-17T12:17:27.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.586+0000 7f9e08c00640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9de8066e40 0x7f9de8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.586+0000 7f9e08c00640 1 -- 172.21.15.114:0/3277450784 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9e040843a0 con 0x7f9e0c152c50 2024-02-17T12:17:27.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.586+0000 7f9e10a00640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9de8066e40 0x7f9de8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.586+0000 7f9e10a00640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9de8066e40 0x7f9de8069300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0af000 tx=0x7f9dfc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:27.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.590+0000 7f9e08c00640 1 -- 172.21.15.114:0/3277450784 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9e0c1edee0 con 0x7f9e0c152c50 2024-02-17T12:17:27.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.742+0000 7f9e13400640 1 -- 172.21.15.114:0/3277450784 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9e0c0c2980 con 0x7f9de8066e40 2024-02-17T12:17:27.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.754+0000 7f9e08c00640 1 -- 172.21.15.114:0/3277450784 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527492 (secure 0 0 0) 0x7f9dfc003b80 con 0x7f9de8066e40 2024-02-17T12:17:27.766 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:27.772 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:17:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 -- 172.21.15.114:0/3277450784 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9de8066e40 msgr2=0x7f9de8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9de8066e40 0x7f9de8069300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0af000 tx=0x7f9dfc0a7000 comp rx=0 tx=0).stop 2024-02-17T12:17:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 -- 172.21.15.114:0/3277450784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0c152c50 msgr2=0x7f9e0c13b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0c152c50 0x7f9e0c13b6b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400c520 tx=0x7f9e0400c9e0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 -- 172.21.15.114:0/3277450784 shutdown_connections 2024-02-17T12:17:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9de8066e40 0x7f9de8069300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e0c152c50 0x7f9e0c13b6b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e0c0c25a0 0x7f9e0c155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 --2- 172.21.15.114:0/3277450784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e0c06db50 0x7f9e0c153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 -- 172.21.15.114:0/3277450784 >> 172.21.15.114:0/3277450784 conn(0x7f9e0c0a8490 msgr2=0x7f9e0c072c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 -- 172.21.15.114:0/3277450784 shutdown_connections 2024-02-17T12:17:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.758+0000 7f9e13400640 1 -- 172.21.15.114:0/3277450784 wait complete. 2024-02-17T12:17:27.784 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-02-17T12:17:27.229666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596691,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":363,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224712,"kb_used_data":4388,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750008,"statfs":{"total":773094113280,"available":772864008192,"internally_reserved":0,"allocated":4493312,"data_stored":2486439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.918718"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405815+0000","last_change":"2024-02-17T12:17:23.350089+0000","last_active":"2024-02-17T12:17:24.405815+0000","last_peered":"2024-02-17T12:17:24.405815+0000","last_clean":"2024-02-17T12:17:24.405815+0000","last_became_active":"2024-02-17T12:17:23.349766+0000","last_became_peered":"2024-02-17T12:17:23.349766+0000","last_unstale":"2024-02-17T12:17:24.405815+0000","last_undegraded":"2024-02-17T12:17:24.405815+0000","last_fullsized":"2024-02-17T12:17:24.405815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:18:31.192739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322378+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:17:23.322378+0000","last_peered":"2024-02-17T12:17:23.322378+0000","last_clean":"2024-02-17T12:17:23.322378+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:17:23.322378+0000","last_undegraded":"2024-02-17T12:17:23.322378+0000","last_fullsized":"2024-02-17T12:17:23.322378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340374+0000","last_change":"2024-02-17T12:17:05.036734+0000","last_active":"2024-02-17T12:17:24.340374+0000","last_peered":"2024-02-17T12:17:24.340374+0000","last_clean":"2024-02-17T12:17:24.340374+0000","last_became_active":"2024-02-17T12:17:05.036453+0000","last_became_peered":"2024-02-17T12:17:05.036453+0000","last_unstale":"2024-02-17T12:17:24.340374+0000","last_undegraded":"2024-02-17T12:17:24.340374+0000","last_fullsized":"2024-02-17T12:17:24.340374+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322802+0000","last_change":"2024-02-17T12:17:06.057194+0000","last_active":"2024-02-17T12:17:23.322802+0000","last_peered":"2024-02-17T12:17:23.322802+0000","last_clean":"2024-02-17T12:17:23.322802+0000","last_became_active":"2024-02-17T12:17:06.056898+0000","last_became_peered":"2024-02-17T12:17:06.056898+0000","last_unstale":"2024-02-17T12:17:23.322802+0000","last_undegraded":"2024-02-17T12:17:23.322802+0000","last_fullsized":"2024-02-17T12:17:23.322802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:06:21.529406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342277+0000","last_change":"2024-02-17T12:17:22.337896+0000","last_active":"2024-02-17T12:17:24.342277+0000","last_peered":"2024-02-17T12:17:24.342277+0000","last_clean":"2024-02-17T12:17:24.342277+0000","last_became_active":"2024-02-17T12:17:22.337632+0000","last_became_peered":"2024-02-17T12:17:22.337632+0000","last_unstale":"2024-02-17T12:17:24.342277+0000","last_undegraded":"2024-02-17T12:17:24.342277+0000","last_fullsized":"2024-02-17T12:17:24.342277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:42:51.719748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350963+0000","last_change":"2024-02-17T12:17:23.345743+0000","last_active":"2024-02-17T12:17:24.350963+0000","last_peered":"2024-02-17T12:17:24.350963+0000","last_clean":"2024-02-17T12:17:24.350963+0000","last_became_active":"2024-02-17T12:17:23.345454+0000","last_became_peered":"2024-02-17T12:17:23.345454+0000","last_unstale":"2024-02-17T12:17:24.350963+0000","last_undegraded":"2024-02-17T12:17:24.350963+0000","last_fullsized":"2024-02-17T12:17:24.350963+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:11.167970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350805+0000","last_change":"2024-02-17T12:17:05.036670+0000","last_active":"2024-02-17T12:17:24.350805+0000","last_peered":"2024-02-17T12:17:24.350805+0000","last_clean":"2024-02-17T12:17:24.350805+0000","last_became_active":"2024-02-17T12:17:05.036395+0000","last_became_peered":"2024-02-17T12:17:05.036395+0000","last_unstale":"2024-02-17T12:17:24.350805+0000","last_undegraded":"2024-02-17T12:17:24.350805+0000","last_fullsized":"2024-02-17T12:17:24.350805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:39.036706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330272+0000","last_change":"2024-02-17T12:17:06.060773+0000","last_active":"2024-02-17T12:17:23.330272+0000","last_peered":"2024-02-17T12:17:23.330272+0000","last_clean":"2024-02-17T12:17:23.330272+0000","last_became_active":"2024-02-17T12:17:06.060435+0000","last_became_peered":"2024-02-17T12:17:06.060435+0000","last_unstale":"2024-02-17T12:17:23.330272+0000","last_undegraded":"2024-02-17T12:17:23.330272+0000","last_fullsized":"2024-02-17T12:17:23.330272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:24.540105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330533+0000","last_change":"2024-02-17T12:17:22.327566+0000","last_active":"2024-02-17T12:17:23.330533+0000","last_peered":"2024-02-17T12:17:23.330533+0000","last_clean":"2024-02-17T12:17:23.330533+0000","last_became_active":"2024-02-17T12:17:22.327132+0000","last_became_peered":"2024-02-17T12:17:22.327132+0000","last_unstale":"2024-02-17T12:17:23.330533+0000","last_undegraded":"2024-02-17T12:17:23.330533+0000","last_fullsized":"2024-02-17T12:17:23.330533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:31.894104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351164+0000","last_change":"2024-02-17T12:17:23.344974+0000","last_active":"2024-02-17T12:17:24.351164+0000","last_peered":"2024-02-17T12:17:24.351164+0000","last_clean":"2024-02-17T12:17:24.351164+0000","last_became_active":"2024-02-17T12:17:23.344704+0000","last_became_peered":"2024-02-17T12:17:23.344704+0000","last_unstale":"2024-02-17T12:17:24.351164+0000","last_undegraded":"2024-02-17T12:17:24.351164+0000","last_fullsized":"2024-02-17T12:17:24.351164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:30:21.314740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330516+0000","last_change":"2024-02-17T12:17:05.024299+0000","last_active":"2024-02-17T12:17:23.330516+0000","last_peered":"2024-02-17T12:17:23.330516+0000","last_clean":"2024-02-17T12:17:23.330516+0000","last_became_active":"2024-02-17T12:17:05.023219+0000","last_became_peered":"2024-02-17T12:17:05.023219+0000","last_unstale":"2024-02-17T12:17:23.330516+0000","last_undegraded":"2024-02-17T12:17:23.330516+0000","last_fullsized":"2024-02-17T12:17:23.330516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:32:32.560419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350697+0000","last_change":"2024-02-17T12:17:06.048841+0000","last_active":"2024-02-17T12:17:24.350697+0000","last_peered":"2024-02-17T12:17:24.350697+0000","last_clean":"2024-02-17T12:17:24.350697+0000","last_became_active":"2024-02-17T12:17:06.048593+0000","last_became_peered":"2024-02-17T12:17:06.048593+0000","last_unstale":"2024-02-17T12:17:24.350697+0000","last_undegraded":"2024-02-17T12:17:24.350697+0000","last_fullsized":"2024-02-17T12:17:24.350697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:15.140333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322268+0000","last_change":"2024-02-17T12:17:22.341384+0000","last_active":"2024-02-17T12:17:23.322268+0000","last_peered":"2024-02-17T12:17:23.322268+0000","last_clean":"2024-02-17T12:17:23.322268+0000","last_became_active":"2024-02-17T12:17:22.341126+0000","last_became_peered":"2024-02-17T12:17:22.341126+0000","last_unstale":"2024-02-17T12:17:23.322268+0000","last_undegraded":"2024-02-17T12:17:23.322268+0000","last_fullsized":"2024-02-17T12:17:23.322268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:41.942390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.349447+0000","last_change":"2024-02-17T12:17:23.348296+0000","last_active":"2024-02-17T12:17:23.349447+0000","last_peered":"2024-02-17T12:17:23.349447+0000","last_clean":"2024-02-17T12:17:23.349447+0000","last_became_active":"2024-02-17T12:17:23.347880+0000","last_became_peered":"2024-02-17T12:17:23.347880+0000","last_unstale":"2024-02-17T12:17:23.349447+0000","last_undegraded":"2024-02-17T12:17:23.349447+0000","last_fullsized":"2024-02-17T12:17:23.349447+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:09:42.753986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335699+0000","last_change":"2024-02-17T12:17:05.026508+0000","last_active":"2024-02-17T12:17:24.335699+0000","last_peered":"2024-02-17T12:17:24.335699+0000","last_clean":"2024-02-17T12:17:24.335699+0000","last_became_active":"2024-02-17T12:17:05.026238+0000","last_became_peered":"2024-02-17T12:17:05.026238+0000","last_unstale":"2024-02-17T12:17:24.335699+0000","last_undegraded":"2024-02-17T12:17:24.335699+0000","last_fullsized":"2024-02-17T12:17:24.335699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405430+0000","last_change":"2024-02-17T12:17:06.047590+0000","last_active":"2024-02-17T12:17:24.405430+0000","last_peered":"2024-02-17T12:17:24.405430+0000","last_clean":"2024-02-17T12:17:24.405430+0000","last_became_active":"2024-02-17T12:17:06.046851+0000","last_became_peered":"2024-02-17T12:17:06.046851+0000","last_unstale":"2024-02-17T12:17:24.405430+0000","last_undegraded":"2024-02-17T12:17:24.405430+0000","last_fullsized":"2024-02-17T12:17:24.405430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:35.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405224+0000","last_change":"2024-02-17T12:17:22.327178+0000","last_active":"2024-02-17T12:17:24.405224+0000","last_peered":"2024-02-17T12:17:24.405224+0000","last_clean":"2024-02-17T12:17:24.405224+0000","last_became_active":"2024-02-17T12:17:22.326706+0000","last_became_peered":"2024-02-17T12:17:22.326706+0000","last_unstale":"2024-02-17T12:17:24.405224+0000","last_undegraded":"2024-02-17T12:17:24.405224+0000","last_fullsized":"2024-02-17T12:17:24.405224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:31.435224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340742+0000","last_change":"2024-02-17T12:17:23.340021+0000","last_active":"2024-02-17T12:17:24.340742+0000","last_peered":"2024-02-17T12:17:24.340742+0000","last_clean":"2024-02-17T12:17:24.340742+0000","last_became_active":"2024-02-17T12:17:23.339716+0000","last_became_peered":"2024-02-17T12:17:23.339716+0000","last_unstale":"2024-02-17T12:17:24.340742+0000","last_undegraded":"2024-02-17T12:17:24.340742+0000","last_fullsized":"2024-02-17T12:17:24.340742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:16:27.358514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405698+0000","last_change":"2024-02-17T12:17:05.034917+0000","last_active":"2024-02-17T12:17:24.405698+0000","last_peered":"2024-02-17T12:17:24.405698+0000","last_clean":"2024-02-17T12:17:24.405698+0000","last_became_active":"2024-02-17T12:17:05.034653+0000","last_became_peered":"2024-02-17T12:17:05.034653+0000","last_unstale":"2024-02-17T12:17:24.405698+0000","last_undegraded":"2024-02-17T12:17:24.405698+0000","last_fullsized":"2024-02-17T12:17:24.405698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:51.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339751+0000","last_change":"2024-02-17T12:17:06.051204+0000","last_active":"2024-02-17T12:17:24.339751+0000","last_peered":"2024-02-17T12:17:24.339751+0000","last_clean":"2024-02-17T12:17:24.339751+0000","last_became_active":"2024-02-17T12:17:06.050919+0000","last_became_peered":"2024-02-17T12:17:06.050919+0000","last_unstale":"2024-02-17T12:17:24.339751+0000","last_undegraded":"2024-02-17T12:17:24.339751+0000","last_fullsized":"2024-02-17T12:17:24.339751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:40.043966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335462+0000","last_change":"2024-02-17T12:17:22.342158+0000","last_active":"2024-02-17T12:17:24.335462+0000","last_peered":"2024-02-17T12:17:24.335462+0000","last_clean":"2024-02-17T12:17:24.335462+0000","last_became_active":"2024-02-17T12:17:22.341688+0000","last_became_peered":"2024-02-17T12:17:22.341688+0000","last_unstale":"2024-02-17T12:17:24.335462+0000","last_undegraded":"2024-02-17T12:17:24.335462+0000","last_fullsized":"2024-02-17T12:17:24.335462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:34:37.472041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340920+0000","last_change":"2024-02-17T12:17:23.353713+0000","last_active":"2024-02-17T12:17:24.340920+0000","last_peered":"2024-02-17T12:17:24.340920+0000","last_clean":"2024-02-17T12:17:24.340920+0000","last_became_active":"2024-02-17T12:17:23.351428+0000","last_became_peered":"2024-02-17T12:17:23.351428+0000","last_unstale":"2024-02-17T12:17:24.340920+0000","last_undegraded":"2024-02-17T12:17:24.340920+0000","last_fullsized":"2024-02-17T12:17:24.340920+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:23:47.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336208+0000","last_change":"2024-02-17T12:17:05.037708+0000","last_active":"2024-02-17T12:17:24.336208+0000","last_peered":"2024-02-17T12:17:24.336208+0000","last_clean":"2024-02-17T12:17:24.336208+0000","last_became_active":"2024-02-17T12:17:05.037213+0000","last_became_peered":"2024-02-17T12:17:05.037213+0000","last_unstale":"2024-02-17T12:17:24.336208+0000","last_undegraded":"2024-02-17T12:17:24.336208+0000","last_fullsized":"2024-02-17T12:17:24.336208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405481+0000","last_change":"2024-02-17T12:17:06.039368+0000","last_active":"2024-02-17T12:17:24.405481+0000","last_peered":"2024-02-17T12:17:24.405481+0000","last_clean":"2024-02-17T12:17:24.405481+0000","last_became_active":"2024-02-17T12:17:06.039047+0000","last_became_peered":"2024-02-17T12:17:06.039047+0000","last_unstale":"2024-02-17T12:17:24.405481+0000","last_undegraded":"2024-02-17T12:17:24.405481+0000","last_fullsized":"2024-02-17T12:17:24.405481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:07.550891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.353531+0000","last_change":"2024-02-17T12:17:22.332971+0000","last_active":"2024-02-17T12:17:24.353531+0000","last_peered":"2024-02-17T12:17:24.353531+0000","last_clean":"2024-02-17T12:17:24.353531+0000","last_became_active":"2024-02-17T12:17:22.332679+0000","last_became_peered":"2024-02-17T12:17:22.332679+0000","last_unstale":"2024-02-17T12:17:24.353531+0000","last_undegraded":"2024-02-17T12:17:24.353531+0000","last_fullsized":"2024-02-17T12:17:24.353531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:44:45.541886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.347165+0000","last_change":"2024-02-17T12:17:23.340465+0000","last_active":"2024-02-17T12:17:23.347165+0000","last_peered":"2024-02-17T12:17:23.347165+0000","last_clean":"2024-02-17T12:17:23.347165+0000","last_became_active":"2024-02-17T12:17:23.340144+0000","last_became_peered":"2024-02-17T12:17:23.340144+0000","last_unstale":"2024-02-17T12:17:23.347165+0000","last_undegraded":"2024-02-17T12:17:23.347165+0000","last_fullsized":"2024-02-17T12:17:23.347165+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:53:22.233526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405994+0000","last_change":"2024-02-17T12:17:05.039517+0000","last_active":"2024-02-17T12:17:24.405994+0000","last_peered":"2024-02-17T12:17:24.405994+0000","last_clean":"2024-02-17T12:17:24.405994+0000","last_became_active":"2024-02-17T12:17:05.039209+0000","last_became_peered":"2024-02-17T12:17:05.039209+0000","last_unstale":"2024-02-17T12:17:24.405994+0000","last_undegraded":"2024-02-17T12:17:24.405994+0000","last_fullsized":"2024-02-17T12:17:24.405994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342436+0000","last_change":"2024-02-17T12:17:06.060996+0000","last_active":"2024-02-17T12:17:24.342436+0000","last_peered":"2024-02-17T12:17:24.342436+0000","last_clean":"2024-02-17T12:17:24.342436+0000","last_became_active":"2024-02-17T12:17:06.060713+0000","last_became_peered":"2024-02-17T12:17:06.060713+0000","last_unstale":"2024-02-17T12:17:24.342436+0000","last_undegraded":"2024-02-17T12:17:24.342436+0000","last_fullsized":"2024-02-17T12:17:24.342436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:49:48.671656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335675+0000","last_change":"2024-02-17T12:17:22.334681+0000","last_active":"2024-02-17T12:17:24.335675+0000","last_peered":"2024-02-17T12:17:24.335675+0000","last_clean":"2024-02-17T12:17:24.335675+0000","last_became_active":"2024-02-17T12:17:22.334179+0000","last_became_peered":"2024-02-17T12:17:22.334179+0000","last_unstale":"2024-02-17T12:17:24.335675+0000","last_undegraded":"2024-02-17T12:17:24.335675+0000","last_fullsized":"2024-02-17T12:17:24.335675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:09:48.040109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405296+0000","last_change":"2024-02-17T12:17:23.346334+0000","last_active":"2024-02-17T12:17:24.405296+0000","last_peered":"2024-02-17T12:17:24.405296+0000","last_clean":"2024-02-17T12:17:24.405296+0000","last_became_active":"2024-02-17T12:17:23.345942+0000","last_became_peered":"2024-02-17T12:17:23.345942+0000","last_unstale":"2024-02-17T12:17:24.405296+0000","last_undegraded":"2024-02-17T12:17:24.405296+0000","last_fullsized":"2024-02-17T12:17:24.405296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:23:47.482793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336573+0000","last_change":"2024-02-17T12:17:05.025815+0000","last_active":"2024-02-17T12:17:24.336573+0000","last_peered":"2024-02-17T12:17:24.336573+0000","last_clean":"2024-02-17T12:17:24.336573+0000","last_became_active":"2024-02-17T12:17:05.025568+0000","last_became_peered":"2024-02-17T12:17:05.025568+0000","last_unstale":"2024-02-17T12:17:24.336573+0000","last_undegraded":"2024-02-17T12:17:24.336573+0000","last_fullsized":"2024-02-17T12:17:24.336573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330248+0000","last_change":"2024-02-17T12:17:06.037347+0000","last_active":"2024-02-17T12:17:23.330248+0000","last_peered":"2024-02-17T12:17:23.330248+0000","last_clean":"2024-02-17T12:17:23.330248+0000","last_became_active":"2024-02-17T12:17:06.037068+0000","last_became_peered":"2024-02-17T12:17:06.037068+0000","last_unstale":"2024-02-17T12:17:23.330248+0000","last_undegraded":"2024-02-17T12:17:23.330248+0000","last_fullsized":"2024-02-17T12:17:23.330248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:54:10.814424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.323564+0000","last_change":"2024-02-17T12:17:22.343469+0000","last_active":"2024-02-17T12:17:23.323564+0000","last_peered":"2024-02-17T12:17:23.323564+0000","last_clean":"2024-02-17T12:17:23.323564+0000","last_became_active":"2024-02-17T12:17:22.343117+0000","last_became_peered":"2024-02-17T12:17:22.343117+0000","last_unstale":"2024-02-17T12:17:23.323564+0000","last_undegraded":"2024-02-17T12:17:23.323564+0000","last_fullsized":"2024-02-17T12:17:23.323564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:50:41.501694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335714+0000","last_change":"2024-02-17T12:17:23.333807+0000","last_active":"2024-02-17T12:17:24.335714+0000","last_peered":"2024-02-17T12:17:24.335714+0000","last_clean":"2024-02-17T12:17:24.335714+0000","last_became_active":"2024-02-17T12:17:23.333498+0000","last_became_peered":"2024-02-17T12:17:23.333498+0000","last_unstale":"2024-02-17T12:17:24.335714+0000","last_undegraded":"2024-02-17T12:17:24.335714+0000","last_fullsized":"2024-02-17T12:17:24.335714+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:38.848587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340896+0000","last_change":"2024-02-17T12:17:05.037887+0000","last_active":"2024-02-17T12:17:24.340896+0000","last_peered":"2024-02-17T12:17:24.340896+0000","last_clean":"2024-02-17T12:17:24.340896+0000","last_became_active":"2024-02-17T12:17:05.037587+0000","last_became_peered":"2024-02-17T12:17:05.037587+0000","last_unstale":"2024-02-17T12:17:24.340896+0000","last_undegraded":"2024-02-17T12:17:24.340896+0000","last_fullsized":"2024-02-17T12:17:24.340896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:20.156577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322996+0000","last_change":"2024-02-17T12:17:06.057175+0000","last_active":"2024-02-17T12:17:23.322996+0000","last_peered":"2024-02-17T12:17:23.322996+0000","last_clean":"2024-02-17T12:17:23.322996+0000","last_became_active":"2024-02-17T12:17:06.055674+0000","last_became_peered":"2024-02-17T12:17:06.055674+0000","last_unstale":"2024-02-17T12:17:23.322996+0000","last_undegraded":"2024-02-17T12:17:23.322996+0000","last_fullsized":"2024-02-17T12:17:23.322996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:26:17.444221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341663+0000","last_change":"2024-02-17T12:17:22.333156+0000","last_active":"2024-02-17T12:17:24.341663+0000","last_peered":"2024-02-17T12:17:24.341663+0000","last_clean":"2024-02-17T12:17:24.341663+0000","last_became_active":"2024-02-17T12:17:22.332889+0000","last_became_peered":"2024-02-17T12:17:22.332889+0000","last_unstale":"2024-02-17T12:17:24.341663+0000","last_undegraded":"2024-02-17T12:17:24.341663+0000","last_fullsized":"2024-02-17T12:17:24.341663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:43:21.162608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351019+0000","last_change":"2024-02-17T12:17:23.337321+0000","last_active":"2024-02-17T12:17:24.351019+0000","last_peered":"2024-02-17T12:17:24.351019+0000","last_clean":"2024-02-17T12:17:24.351019+0000","last_became_active":"2024-02-17T12:17:23.337063+0000","last_became_peered":"2024-02-17T12:17:23.337063+0000","last_unstale":"2024-02-17T12:17:24.351019+0000","last_undegraded":"2024-02-17T12:17:24.351019+0000","last_fullsized":"2024-02-17T12:17:24.351019+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:51.431244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330396+0000","last_change":"2024-02-17T12:17:05.024282+0000","last_active":"2024-02-17T12:17:23.330396+0000","last_peered":"2024-02-17T12:17:23.330396+0000","last_clean":"2024-02-17T12:17:23.330396+0000","last_became_active":"2024-02-17T12:17:05.023939+0000","last_became_peered":"2024-02-17T12:17:05.023939+0000","last_unstale":"2024-02-17T12:17:23.330396+0000","last_undegraded":"2024-02-17T12:17:23.330396+0000","last_fullsized":"2024-02-17T12:17:23.330396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:41.752311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329665+0000","last_change":"2024-02-17T12:17:06.051800+0000","last_active":"2024-02-17T12:17:23.329665+0000","last_peered":"2024-02-17T12:17:23.329665+0000","last_clean":"2024-02-17T12:17:23.329665+0000","last_became_active":"2024-02-17T12:17:06.047017+0000","last_became_peered":"2024-02-17T12:17:06.047017+0000","last_unstale":"2024-02-17T12:17:23.329665+0000","last_undegraded":"2024-02-17T12:17:23.329665+0000","last_fullsized":"2024-02-17T12:17:23.329665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:27.324723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351163+0000","last_change":"2024-02-17T12:17:22.330496+0000","last_active":"2024-02-17T12:17:24.351163+0000","last_peered":"2024-02-17T12:17:24.351163+0000","last_clean":"2024-02-17T12:17:24.351163+0000","last_became_active":"2024-02-17T12:17:22.330199+0000","last_became_peered":"2024-02-17T12:17:22.330199+0000","last_unstale":"2024-02-17T12:17:24.351163+0000","last_undegraded":"2024-02-17T12:17:24.351163+0000","last_fullsized":"2024-02-17T12:17:24.351163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:14:38.298712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405036+0000","last_change":"2024-02-17T12:17:23.345010+0000","last_active":"2024-02-17T12:17:24.405036+0000","last_peered":"2024-02-17T12:17:24.405036+0000","last_clean":"2024-02-17T12:17:24.405036+0000","last_became_active":"2024-02-17T12:17:23.344713+0000","last_became_peered":"2024-02-17T12:17:23.344713+0000","last_unstale":"2024-02-17T12:17:24.405036+0000","last_undegraded":"2024-02-17T12:17:24.405036+0000","last_fullsized":"2024-02-17T12:17:24.405036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:40:17.228464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340148+0000","last_change":"2024-02-17T12:17:05.035457+0000","last_active":"2024-02-17T12:17:24.340148+0000","last_peered":"2024-02-17T12:17:24.340148+0000","last_clean":"2024-02-17T12:17:24.340148+0000","last_became_active":"2024-02-17T12:17:05.035024+0000","last_became_peered":"2024-02-17T12:17:05.035024+0000","last_unstale":"2024-02-17T12:17:24.340148+0000","last_undegraded":"2024-02-17T12:17:24.340148+0000","last_fullsized":"2024-02-17T12:17:24.340148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329533+0000","last_change":"2024-02-17T12:17:06.044343+0000","last_active":"2024-02-17T12:17:23.329533+0000","last_peered":"2024-02-17T12:17:23.329533+0000","last_clean":"2024-02-17T12:17:23.329533+0000","last_became_active":"2024-02-17T12:17:06.044057+0000","last_became_peered":"2024-02-17T12:17:06.044057+0000","last_unstale":"2024-02-17T12:17:23.329533+0000","last_undegraded":"2024-02-17T12:17:23.329533+0000","last_fullsized":"2024-02-17T12:17:23.329533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:33.519960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322286+0000","last_change":"2024-02-17T12:17:22.345056+0000","last_active":"2024-02-17T12:17:23.322286+0000","last_peered":"2024-02-17T12:17:23.322286+0000","last_clean":"2024-02-17T12:17:23.322286+0000","last_became_active":"2024-02-17T12:17:22.344704+0000","last_became_peered":"2024-02-17T12:17:22.344704+0000","last_unstale":"2024-02-17T12:17:23.322286+0000","last_undegraded":"2024-02-17T12:17:23.322286+0000","last_fullsized":"2024-02-17T12:17:23.322286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:17.347242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.347782+0000","last_change":"2024-02-17T12:17:23.337391+0000","last_active":"2024-02-17T12:17:23.347782+0000","last_peered":"2024-02-17T12:17:23.347782+0000","last_clean":"2024-02-17T12:17:23.347782+0000","last_became_active":"2024-02-17T12:17:23.333405+0000","last_became_peered":"2024-02-17T12:17:23.333405+0000","last_unstale":"2024-02-17T12:17:23.347782+0000","last_undegraded":"2024-02-17T12:17:23.347782+0000","last_fullsized":"2024-02-17T12:17:23.347782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:40:15.081772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405513+0000","last_change":"2024-02-17T12:17:05.038848+0000","last_active":"2024-02-17T12:17:24.405513+0000","last_peered":"2024-02-17T12:17:24.405513+0000","last_clean":"2024-02-17T12:17:24.405513+0000","last_became_active":"2024-02-17T12:17:05.038528+0000","last_became_peered":"2024-02-17T12:17:05.038528+0000","last_unstale":"2024-02-17T12:17:24.405513+0000","last_undegraded":"2024-02-17T12:17:24.405513+0000","last_fullsized":"2024-02-17T12:17:24.405513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:01:36.502802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330382+0000","last_change":"2024-02-17T12:17:06.058275+0000","last_active":"2024-02-17T12:17:23.330382+0000","last_peered":"2024-02-17T12:17:23.330382+0000","last_clean":"2024-02-17T12:17:23.330382+0000","last_became_active":"2024-02-17T12:17:06.057949+0000","last_became_peered":"2024-02-17T12:17:06.057949+0000","last_unstale":"2024-02-17T12:17:23.330382+0000","last_undegraded":"2024-02-17T12:17:23.330382+0000","last_fullsized":"2024-02-17T12:17:23.330382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:36.279421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405058+0000","last_change":"2024-02-17T12:17:22.336283+0000","last_active":"2024-02-17T12:17:24.405058+0000","last_peered":"2024-02-17T12:17:24.405058+0000","last_clean":"2024-02-17T12:17:24.405058+0000","last_became_active":"2024-02-17T12:17:22.335986+0000","last_became_peered":"2024-02-17T12:17:22.335986+0000","last_unstale":"2024-02-17T12:17:24.405058+0000","last_undegraded":"2024-02-17T12:17:24.405058+0000","last_fullsized":"2024-02-17T12:17:24.405058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:51:05.943372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405775+0000","last_change":"2024-02-17T12:17:23.345984+0000","last_active":"2024-02-17T12:17:24.405775+0000","last_peered":"2024-02-17T12:17:24.405775+0000","last_clean":"2024-02-17T12:17:24.405775+0000","last_became_active":"2024-02-17T12:17:23.345680+0000","last_became_peered":"2024-02-17T12:17:23.345680+0000","last_unstale":"2024-02-17T12:17:24.405775+0000","last_undegraded":"2024-02-17T12:17:24.405775+0000","last_fullsized":"2024-02-17T12:17:24.405775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:25:14.234550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.338234+0000","last_change":"2024-02-17T12:17:05.026370+0000","last_active":"2024-02-17T12:17:23.338234+0000","last_peered":"2024-02-17T12:17:23.338234+0000","last_clean":"2024-02-17T12:17:23.338234+0000","last_became_active":"2024-02-17T12:17:05.026124+0000","last_became_peered":"2024-02-17T12:17:05.026124+0000","last_unstale":"2024-02-17T12:17:23.338234+0000","last_undegraded":"2024-02-17T12:17:23.338234+0000","last_fullsized":"2024-02-17T12:17:23.338234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:35.272161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.328857+0000","last_change":"2024-02-17T12:17:06.047087+0000","last_active":"2024-02-17T12:17:23.328857+0000","last_peered":"2024-02-17T12:17:23.328857+0000","last_clean":"2024-02-17T12:17:23.328857+0000","last_became_active":"2024-02-17T12:17:06.046719+0000","last_became_peered":"2024-02-17T12:17:06.046719+0000","last_unstale":"2024-02-17T12:17:23.328857+0000","last_undegraded":"2024-02-17T12:17:23.328857+0000","last_fullsized":"2024-02-17T12:17:23.328857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:13:42.759571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.361329+0000","last_change":"2024-02-17T12:17:22.337390+0000","last_active":"2024-02-17T12:17:23.361329+0000","last_peered":"2024-02-17T12:17:23.361329+0000","last_clean":"2024-02-17T12:17:23.361329+0000","last_became_active":"2024-02-17T12:17:22.337058+0000","last_became_peered":"2024-02-17T12:17:22.337058+0000","last_unstale":"2024-02-17T12:17:23.361329+0000","last_undegraded":"2024-02-17T12:17:23.361329+0000","last_fullsized":"2024-02-17T12:17:23.361329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:24:23.397983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.351092+0000","last_change":"2024-02-17T12:17:23.338481+0000","last_active":"2024-02-17T12:17:23.351092+0000","last_peered":"2024-02-17T12:17:23.351092+0000","last_clean":"2024-02-17T12:17:23.351092+0000","last_became_active":"2024-02-17T12:17:23.338200+0000","last_became_peered":"2024-02-17T12:17:23.338200+0000","last_unstale":"2024-02-17T12:17:23.351092+0000","last_undegraded":"2024-02-17T12:17:23.351092+0000","last_fullsized":"2024-02-17T12:17:23.351092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:59.061465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.338565+0000","last_change":"2024-02-17T12:17:05.037680+0000","last_active":"2024-02-17T12:17:23.338565+0000","last_peered":"2024-02-17T12:17:23.338565+0000","last_clean":"2024-02-17T12:17:23.338565+0000","last_became_active":"2024-02-17T12:17:05.037370+0000","last_became_peered":"2024-02-17T12:17:05.037370+0000","last_unstale":"2024-02-17T12:17:23.338565+0000","last_undegraded":"2024-02-17T12:17:23.338565+0000","last_fullsized":"2024-02-17T12:17:23.338565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:16.209390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335936+0000","last_change":"2024-02-17T12:17:06.060894+0000","last_active":"2024-02-17T12:17:24.335936+0000","last_peered":"2024-02-17T12:17:24.335936+0000","last_clean":"2024-02-17T12:17:24.335936+0000","last_became_active":"2024-02-17T12:17:06.060631+0000","last_became_peered":"2024-02-17T12:17:06.060631+0000","last_unstale":"2024-02-17T12:17:24.335936+0000","last_undegraded":"2024-02-17T12:17:24.335936+0000","last_fullsized":"2024-02-17T12:17:24.335936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:02.449515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.358707+0000","last_change":"2024-02-17T12:17:22.342026+0000","last_active":"2024-02-17T12:17:23.358707+0000","last_peered":"2024-02-17T12:17:23.358707+0000","last_clean":"2024-02-17T12:17:23.358707+0000","last_became_active":"2024-02-17T12:17:22.341754+0000","last_became_peered":"2024-02-17T12:17:22.341754+0000","last_unstale":"2024-02-17T12:17:23.358707+0000","last_undegraded":"2024-02-17T12:17:23.358707+0000","last_fullsized":"2024-02-17T12:17:23.358707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:26:19.269391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340182+0000","last_change":"2024-02-17T12:17:23.346991+0000","last_active":"2024-02-17T12:17:24.340182+0000","last_peered":"2024-02-17T12:17:24.340182+0000","last_clean":"2024-02-17T12:17:24.340182+0000","last_became_active":"2024-02-17T12:17:23.346701+0000","last_became_peered":"2024-02-17T12:17:23.346701+0000","last_unstale":"2024-02-17T12:17:24.340182+0000","last_undegraded":"2024-02-17T12:17:24.340182+0000","last_fullsized":"2024-02-17T12:17:24.340182+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:25.892811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.338022+0000","last_change":"2024-02-17T12:17:05.030468+0000","last_active":"2024-02-17T12:17:23.338022+0000","last_peered":"2024-02-17T12:17:23.338022+0000","last_clean":"2024-02-17T12:17:23.338022+0000","last_became_active":"2024-02-17T12:17:05.030205+0000","last_became_peered":"2024-02-17T12:17:05.030205+0000","last_unstale":"2024-02-17T12:17:23.338022+0000","last_undegraded":"2024-02-17T12:17:23.338022+0000","last_fullsized":"2024-02-17T12:17:23.338022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:08.989824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342406+0000","last_change":"2024-02-17T12:17:06.070352+0000","last_active":"2024-02-17T12:17:24.342406+0000","last_peered":"2024-02-17T12:17:24.342406+0000","last_clean":"2024-02-17T12:17:24.342406+0000","last_became_active":"2024-02-17T12:17:06.070053+0000","last_became_peered":"2024-02-17T12:17:06.070053+0000","last_unstale":"2024-02-17T12:17:24.342406+0000","last_undegraded":"2024-02-17T12:17:24.342406+0000","last_fullsized":"2024-02-17T12:17:24.342406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:50:00.758848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351471+0000","last_change":"2024-02-17T12:17:22.336524+0000","last_active":"2024-02-17T12:17:24.351471+0000","last_peered":"2024-02-17T12:17:24.351471+0000","last_clean":"2024-02-17T12:17:24.351471+0000","last_became_active":"2024-02-17T12:17:22.336312+0000","last_became_peered":"2024-02-17T12:17:22.336312+0000","last_unstale":"2024-02-17T12:17:24.351471+0000","last_undegraded":"2024-02-17T12:17:24.351471+0000","last_fullsized":"2024-02-17T12:17:24.351471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:18:30.185800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340376+0000","last_change":"2024-02-17T12:17:23.347740+0000","last_active":"2024-02-17T12:17:24.340376+0000","last_peered":"2024-02-17T12:17:24.340376+0000","last_clean":"2024-02-17T12:17:24.340376+0000","last_became_active":"2024-02-17T12:17:23.347416+0000","last_became_peered":"2024-02-17T12:17:23.347416+0000","last_unstale":"2024-02-17T12:17:24.340376+0000","last_undegraded":"2024-02-17T12:17:24.340376+0000","last_fullsized":"2024-02-17T12:17:24.340376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:42:52.726687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336525+0000","last_change":"2024-02-17T12:17:05.039589+0000","last_active":"2024-02-17T12:17:24.336525+0000","last_peered":"2024-02-17T12:17:24.336525+0000","last_clean":"2024-02-17T12:17:24.336525+0000","last_became_active":"2024-02-17T12:17:05.039353+0000","last_became_peered":"2024-02-17T12:17:05.039353+0000","last_unstale":"2024-02-17T12:17:24.336525+0000","last_undegraded":"2024-02-17T12:17:24.336525+0000","last_fullsized":"2024-02-17T12:17:24.336525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:37.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.337924+0000","last_change":"2024-02-17T12:17:06.056551+0000","last_active":"2024-02-17T12:17:23.337924+0000","last_peered":"2024-02-17T12:17:23.337924+0000","last_clean":"2024-02-17T12:17:23.337924+0000","last_became_active":"2024-02-17T12:17:06.056226+0000","last_became_peered":"2024-02-17T12:17:06.056226+0000","last_unstale":"2024-02-17T12:17:23.337924+0000","last_undegraded":"2024-02-17T12:17:23.337924+0000","last_fullsized":"2024-02-17T12:17:23.337924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:26:02.974500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342116+0000","last_change":"2024-02-17T12:17:22.336212+0000","last_active":"2024-02-17T12:17:24.342116+0000","last_peered":"2024-02-17T12:17:24.342116+0000","last_clean":"2024-02-17T12:17:24.342116+0000","last_became_active":"2024-02-17T12:17:22.335850+0000","last_became_peered":"2024-02-17T12:17:22.335850+0000","last_unstale":"2024-02-17T12:17:24.342116+0000","last_undegraded":"2024-02-17T12:17:24.342116+0000","last_fullsized":"2024-02-17T12:17:24.342116+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:24.885872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405704+0000","last_change":"2024-02-17T12:17:23.342620+0000","last_active":"2024-02-17T12:17:24.405704+0000","last_peered":"2024-02-17T12:17:24.405704+0000","last_clean":"2024-02-17T12:17:24.405704+0000","last_became_active":"2024-02-17T12:17:23.342301+0000","last_became_peered":"2024-02-17T12:17:23.342301+0000","last_unstale":"2024-02-17T12:17:24.405704+0000","last_undegraded":"2024-02-17T12:17:24.405704+0000","last_fullsized":"2024-02-17T12:17:24.405704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:14:39.305651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350730+0000","last_change":"2024-02-17T12:17:05.033809+0000","last_active":"2024-02-17T12:17:24.350730+0000","last_peered":"2024-02-17T12:17:24.350730+0000","last_clean":"2024-02-17T12:17:24.350730+0000","last_became_active":"2024-02-17T12:17:05.033434+0000","last_became_peered":"2024-02-17T12:17:05.033434+0000","last_unstale":"2024-02-17T12:17:24.350730+0000","last_undegraded":"2024-02-17T12:17:24.350730+0000","last_fullsized":"2024-02-17T12:17:24.350730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:20.156577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339718+0000","last_change":"2024-02-17T12:17:06.066823+0000","last_active":"2024-02-17T12:17:24.339718+0000","last_peered":"2024-02-17T12:17:24.339718+0000","last_clean":"2024-02-17T12:17:24.339718+0000","last_became_active":"2024-02-17T12:17:06.066564+0000","last_became_peered":"2024-02-17T12:17:06.066564+0000","last_unstale":"2024-02-17T12:17:24.339718+0000","last_undegraded":"2024-02-17T12:17:24.339718+0000","last_fullsized":"2024-02-17T12:17:24.339718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:00:35.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322243+0000","last_change":"2024-02-17T12:17:22.344548+0000","last_active":"2024-02-17T12:17:23.322243+0000","last_peered":"2024-02-17T12:17:23.322243+0000","last_clean":"2024-02-17T12:17:23.322243+0000","last_became_active":"2024-02-17T12:17:22.344242+0000","last_became_peered":"2024-02-17T12:17:22.344242+0000","last_unstale":"2024-02-17T12:17:23.322243+0000","last_undegraded":"2024-02-17T12:17:23.322243+0000","last_fullsized":"2024-02-17T12:17:23.322243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:49:13.729470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339509+0000","last_change":"2024-02-17T12:17:23.353560+0000","last_active":"2024-02-17T12:17:24.339509+0000","last_peered":"2024-02-17T12:17:24.339509+0000","last_clean":"2024-02-17T12:17:24.339509+0000","last_became_active":"2024-02-17T12:17:23.350039+0000","last_became_peered":"2024-02-17T12:17:23.350039+0000","last_unstale":"2024-02-17T12:17:24.339509+0000","last_undegraded":"2024-02-17T12:17:24.339509+0000","last_fullsized":"2024-02-17T12:17:24.339509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:56:23.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350969+0000","last_change":"2024-02-17T12:17:05.037345+0000","last_active":"2024-02-17T12:17:24.350969+0000","last_peered":"2024-02-17T12:17:24.350969+0000","last_clean":"2024-02-17T12:17:24.350969+0000","last_became_active":"2024-02-17T12:17:05.037076+0000","last_became_peered":"2024-02-17T12:17:05.037076+0000","last_unstale":"2024-02-17T12:17:24.350969+0000","last_undegraded":"2024-02-17T12:17:24.350969+0000","last_fullsized":"2024-02-17T12:17:24.350969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:34.554467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.321994+0000","last_change":"2024-02-17T12:17:06.067761+0000","last_active":"2024-02-17T12:17:23.321994+0000","last_peered":"2024-02-17T12:17:23.321994+0000","last_clean":"2024-02-17T12:17:23.321994+0000","last_became_active":"2024-02-17T12:17:06.067249+0000","last_became_peered":"2024-02-17T12:17:06.067249+0000","last_unstale":"2024-02-17T12:17:23.321994+0000","last_undegraded":"2024-02-17T12:17:23.321994+0000","last_fullsized":"2024-02-17T12:17:23.321994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:40:09.999149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351053+0000","last_change":"2024-02-17T12:17:22.339368+0000","last_active":"2024-02-17T12:17:24.351053+0000","last_peered":"2024-02-17T12:17:24.351053+0000","last_clean":"2024-02-17T12:17:24.351053+0000","last_became_active":"2024-02-17T12:17:22.339129+0000","last_became_peered":"2024-02-17T12:17:22.339129+0000","last_unstale":"2024-02-17T12:17:24.351053+0000","last_undegraded":"2024-02-17T12:17:24.351053+0000","last_fullsized":"2024-02-17T12:17:24.351053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:04.168896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.347304+0000","last_change":"2024-02-17T12:17:23.341129+0000","last_active":"2024-02-17T12:17:23.347304+0000","last_peered":"2024-02-17T12:17:23.347304+0000","last_clean":"2024-02-17T12:17:23.347304+0000","last_became_active":"2024-02-17T12:17:23.340596+0000","last_became_peered":"2024-02-17T12:17:23.340596+0000","last_unstale":"2024-02-17T12:17:23.347304+0000","last_undegraded":"2024-02-17T12:17:23.347304+0000","last_fullsized":"2024-02-17T12:17:23.347304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:08.165541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335582+0000","last_change":"2024-02-17T12:17:05.032388+0000","last_active":"2024-02-17T12:17:24.335582+0000","last_peered":"2024-02-17T12:17:24.335582+0000","last_clean":"2024-02-17T12:17:24.335582+0000","last_became_active":"2024-02-17T12:17:05.032055+0000","last_became_peered":"2024-02-17T12:17:05.032055+0000","last_unstale":"2024-02-17T12:17:24.335582+0000","last_undegraded":"2024-02-17T12:17:24.335582+0000","last_fullsized":"2024-02-17T12:17:24.335582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351262+0000","last_change":"2024-02-17T12:17:06.043565+0000","last_active":"2024-02-17T12:17:24.351262+0000","last_peered":"2024-02-17T12:17:24.351262+0000","last_clean":"2024-02-17T12:17:24.351262+0000","last_became_active":"2024-02-17T12:17:06.043189+0000","last_became_peered":"2024-02-17T12:17:06.043189+0000","last_unstale":"2024-02-17T12:17:24.351262+0000","last_undegraded":"2024-02-17T12:17:24.351262+0000","last_fullsized":"2024-02-17T12:17:24.351262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:02:23.127482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405198+0000","last_change":"2024-02-17T12:17:22.326967+0000","last_active":"2024-02-17T12:17:24.405198+0000","last_peered":"2024-02-17T12:17:24.405198+0000","last_clean":"2024-02-17T12:17:24.405198+0000","last_became_active":"2024-02-17T12:17:22.326377+0000","last_became_peered":"2024-02-17T12:17:22.326377+0000","last_unstale":"2024-02-17T12:17:24.405198+0000","last_undegraded":"2024-02-17T12:17:24.405198+0000","last_fullsized":"2024-02-17T12:17:24.405198+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:20.192645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350673+0000","last_change":"2024-02-17T12:17:23.339306+0000","last_active":"2024-02-17T12:17:24.350673+0000","last_peered":"2024-02-17T12:17:24.350673+0000","last_clean":"2024-02-17T12:17:24.350673+0000","last_became_active":"2024-02-17T12:17:23.339053+0000","last_became_peered":"2024-02-17T12:17:23.339053+0000","last_unstale":"2024-02-17T12:17:24.350673+0000","last_undegraded":"2024-02-17T12:17:24.350673+0000","last_fullsized":"2024-02-17T12:17:24.350673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:36:04.909419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.331244+0000","last_change":"2024-02-17T12:17:05.032981+0000","last_active":"2024-02-17T12:17:23.331244+0000","last_peered":"2024-02-17T12:17:23.331244+0000","last_clean":"2024-02-17T12:17:23.331244+0000","last_became_active":"2024-02-17T12:17:05.032653+0000","last_became_peered":"2024-02-17T12:17:05.032653+0000","last_unstale":"2024-02-17T12:17:23.331244+0000","last_undegraded":"2024-02-17T12:17:23.331244+0000","last_fullsized":"2024-02-17T12:17:23.331244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:06:32.512700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335581+0000","last_change":"2024-02-17T12:17:06.049102+0000","last_active":"2024-02-17T12:17:24.335581+0000","last_peered":"2024-02-17T12:17:24.335581+0000","last_clean":"2024-02-17T12:17:24.335581+0000","last_became_active":"2024-02-17T12:17:06.048820+0000","last_became_peered":"2024-02-17T12:17:06.048820+0000","last_unstale":"2024-02-17T12:17:24.335581+0000","last_undegraded":"2024-02-17T12:17:24.335581+0000","last_fullsized":"2024-02-17T12:17:24.335581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:16.951684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350864+0000","last_change":"2024-02-17T12:17:22.326094+0000","last_active":"2024-02-17T12:17:24.350864+0000","last_peered":"2024-02-17T12:17:24.350864+0000","last_clean":"2024-02-17T12:17:24.350864+0000","last_became_active":"2024-02-17T12:17:22.325795+0000","last_became_peered":"2024-02-17T12:17:22.325795+0000","last_unstale":"2024-02-17T12:17:24.350864+0000","last_undegraded":"2024-02-17T12:17:24.350864+0000","last_fullsized":"2024-02-17T12:17:24.350864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:00:58.487000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.342718+0000","last_change":"2024-02-17T12:17:23.335741+0000","last_active":"2024-02-17T12:17:23.342718+0000","last_peered":"2024-02-17T12:17:23.342718+0000","last_clean":"2024-02-17T12:17:23.342718+0000","last_became_active":"2024-02-17T12:17:23.335458+0000","last_became_peered":"2024-02-17T12:17:23.335458+0000","last_unstale":"2024-02-17T12:17:23.342718+0000","last_undegraded":"2024-02-17T12:17:23.342718+0000","last_fullsized":"2024-02-17T12:17:23.342718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:20.203815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351530+0000","last_change":"2024-02-17T12:17:05.034049+0000","last_active":"2024-02-17T12:17:24.351530+0000","last_peered":"2024-02-17T12:17:24.351530+0000","last_clean":"2024-02-17T12:17:24.351530+0000","last_became_active":"2024-02-17T12:17:05.033414+0000","last_became_peered":"2024-02-17T12:17:05.033414+0000","last_unstale":"2024-02-17T12:17:24.351530+0000","last_undegraded":"2024-02-17T12:17:24.351530+0000","last_fullsized":"2024-02-17T12:17:24.351530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:17.825707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342083+0000","last_change":"2024-02-17T12:17:06.066601+0000","last_active":"2024-02-17T12:17:24.342083+0000","last_peered":"2024-02-17T12:17:24.342083+0000","last_clean":"2024-02-17T12:17:24.342083+0000","last_became_active":"2024-02-17T12:17:06.066262+0000","last_became_peered":"2024-02-17T12:17:06.066262+0000","last_unstale":"2024-02-17T12:17:24.342083+0000","last_undegraded":"2024-02-17T12:17:24.342083+0000","last_fullsized":"2024-02-17T12:17:24.342083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:14.063262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405661+0000","last_change":"2024-02-17T12:17:22.332075+0000","last_active":"2024-02-17T12:17:24.405661+0000","last_peered":"2024-02-17T12:17:24.405661+0000","last_clean":"2024-02-17T12:17:24.405661+0000","last_became_active":"2024-02-17T12:17:22.331806+0000","last_became_peered":"2024-02-17T12:17:22.331806+0000","last_unstale":"2024-02-17T12:17:24.405661+0000","last_undegraded":"2024-02-17T12:17:24.405661+0000","last_fullsized":"2024-02-17T12:17:24.405661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:02:39.422372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.361387+0000","last_change":"2024-02-17T12:17:23.357929+0000","last_active":"2024-02-17T12:17:23.361387+0000","last_peered":"2024-02-17T12:17:23.361387+0000","last_clean":"2024-02-17T12:17:23.361387+0000","last_became_active":"2024-02-17T12:17:23.357616+0000","last_became_peered":"2024-02-17T12:17:23.357616+0000","last_unstale":"2024-02-17T12:17:23.361387+0000","last_undegraded":"2024-02-17T12:17:23.361387+0000","last_fullsized":"2024-02-17T12:17:23.361387+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:23:27.249851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342224+0000","last_change":"2024-02-17T12:17:05.038559+0000","last_active":"2024-02-17T12:17:24.342224+0000","last_peered":"2024-02-17T12:17:24.342224+0000","last_clean":"2024-02-17T12:17:24.342224+0000","last_became_active":"2024-02-17T12:17:05.038388+0000","last_became_peered":"2024-02-17T12:17:05.038388+0000","last_unstale":"2024-02-17T12:17:24.342224+0000","last_undegraded":"2024-02-17T12:17:24.342224+0000","last_fullsized":"2024-02-17T12:17:24.342224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:14:47.318267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351399+0000","last_change":"2024-02-17T12:17:06.050890+0000","last_active":"2024-02-17T12:17:24.351399+0000","last_peered":"2024-02-17T12:17:24.351399+0000","last_clean":"2024-02-17T12:17:24.351399+0000","last_became_active":"2024-02-17T12:17:06.050253+0000","last_became_peered":"2024-02-17T12:17:06.050253+0000","last_unstale":"2024-02-17T12:17:24.351399+0000","last_undegraded":"2024-02-17T12:17:24.351399+0000","last_fullsized":"2024-02-17T12:17:24.351399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:09:31.745218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.339191+0000","last_change":"2024-02-17T12:17:22.340883+0000","last_active":"2024-02-17T12:17:23.339191+0000","last_peered":"2024-02-17T12:17:23.339191+0000","last_clean":"2024-02-17T12:17:23.339191+0000","last_became_active":"2024-02-17T12:17:22.340620+0000","last_became_peered":"2024-02-17T12:17:22.340620+0000","last_unstale":"2024-02-17T12:17:23.339191+0000","last_undegraded":"2024-02-17T12:17:23.339191+0000","last_fullsized":"2024-02-17T12:17:23.339191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:39.182118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.348825+0000","last_change":"2024-02-17T12:17:23.345047+0000","last_active":"2024-02-17T12:17:23.348825+0000","last_peered":"2024-02-17T12:17:23.348825+0000","last_clean":"2024-02-17T12:17:23.348825+0000","last_became_active":"2024-02-17T12:17:23.342316+0000","last_became_peered":"2024-02-17T12:17:23.342316+0000","last_unstale":"2024-02-17T12:17:23.348825+0000","last_undegraded":"2024-02-17T12:17:23.348825+0000","last_fullsized":"2024-02-17T12:17:23.348825+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:16:27.228088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405926+0000","last_change":"2024-02-17T12:17:05.042848+0000","last_active":"2024-02-17T12:17:24.405926+0000","last_peered":"2024-02-17T12:17:24.405926+0000","last_clean":"2024-02-17T12:17:24.405926+0000","last_became_active":"2024-02-17T12:17:05.042537+0000","last_became_peered":"2024-02-17T12:17:05.042537+0000","last_unstale":"2024-02-17T12:17:24.405926+0000","last_undegraded":"2024-02-17T12:17:24.405926+0000","last_fullsized":"2024-02-17T12:17:24.405926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:28.728456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351857+0000","last_change":"2024-02-17T12:17:06.060266+0000","last_active":"2024-02-17T12:17:24.351857+0000","last_peered":"2024-02-17T12:17:24.351857+0000","last_clean":"2024-02-17T12:17:24.351857+0000","last_became_active":"2024-02-17T12:17:06.059994+0000","last_became_peered":"2024-02-17T12:17:06.059994+0000","last_unstale":"2024-02-17T12:17:24.351857+0000","last_undegraded":"2024-02-17T12:17:24.351857+0000","last_fullsized":"2024-02-17T12:17:24.351857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:16.827288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.369675+0000","last_change":"2024-02-17T12:17:22.337927+0000","last_active":"2024-02-17T12:17:23.369675+0000","last_peered":"2024-02-17T12:17:23.369675+0000","last_clean":"2024-02-17T12:17:23.369675+0000","last_became_active":"2024-02-17T12:17:22.337621+0000","last_became_peered":"2024-02-17T12:17:22.337621+0000","last_unstale":"2024-02-17T12:17:23.369675+0000","last_undegraded":"2024-02-17T12:17:23.369675+0000","last_fullsized":"2024-02-17T12:17:23.369675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:27:10.414634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351376+0000","last_change":"2024-02-17T12:17:23.337515+0000","last_active":"2024-02-17T12:17:24.351376+0000","last_peered":"2024-02-17T12:17:24.351376+0000","last_clean":"2024-02-17T12:17:24.351376+0000","last_became_active":"2024-02-17T12:17:23.337210+0000","last_became_peered":"2024-02-17T12:17:23.337210+0000","last_unstale":"2024-02-17T12:17:24.351376+0000","last_undegraded":"2024-02-17T12:17:24.351376+0000","last_fullsized":"2024-02-17T12:17:24.351376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:27:31.050659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351909+0000","last_change":"2024-02-17T12:17:05.040696+0000","last_active":"2024-02-17T12:17:24.351909+0000","last_peered":"2024-02-17T12:17:24.351909+0000","last_clean":"2024-02-17T12:17:24.351909+0000","last_became_active":"2024-02-17T12:17:05.040185+0000","last_became_peered":"2024-02-17T12:17:05.040185+0000","last_unstale":"2024-02-17T12:17:24.351909+0000","last_undegraded":"2024-02-17T12:17:24.351909+0000","last_fullsized":"2024-02-17T12:17:24.351909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:09.420535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342348+0000","last_change":"2024-02-17T12:17:06.045622+0000","last_active":"2024-02-17T12:17:24.342348+0000","last_peered":"2024-02-17T12:17:24.342348+0000","last_clean":"2024-02-17T12:17:24.342348+0000","last_became_active":"2024-02-17T12:17:06.044323+0000","last_became_peered":"2024-02-17T12:17:06.044323+0000","last_unstale":"2024-02-17T12:17:24.342348+0000","last_undegraded":"2024-02-17T12:17:24.342348+0000","last_fullsized":"2024-02-17T12:17:24.342348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:03.897754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'3","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.360248+0000","last_change":"2024-02-17T12:17:22.342926+0000","last_active":"2024-02-17T12:17:23.360248+0000","last_peered":"2024-02-17T12:17:23.360248+0000","last_clean":"2024-02-17T12:17:23.360248+0000","last_became_active":"2024-02-17T12:17:22.342539+0000","last_became_peered":"2024-02-17T12:17:22.342539+0000","last_unstale":"2024-02-17T12:17:23.360248+0000","last_undegraded":"2024-02-17T12:17:23.360248+0000","last_fullsized":"2024-02-17T12:17:23.360248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:31:43.326791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405579+0000","last_change":"2024-02-17T12:17:23.355592+0000","last_active":"2024-02-17T12:17:24.405579+0000","last_peered":"2024-02-17T12:17:24.405579+0000","last_clean":"2024-02-17T12:17:24.405579+0000","last_became_active":"2024-02-17T12:17:23.355419+0000","last_became_peered":"2024-02-17T12:17:23.355419+0000","last_unstale":"2024-02-17T12:17:24.405579+0000","last_undegraded":"2024-02-17T12:17:24.405579+0000","last_fullsized":"2024-02-17T12:17:24.405579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:16:27.358514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329688+0000","last_change":"2024-02-17T12:17:05.029530+0000","last_active":"2024-02-17T12:17:23.329688+0000","last_peered":"2024-02-17T12:17:23.329688+0000","last_clean":"2024-02-17T12:17:23.329688+0000","last_became_active":"2024-02-17T12:17:05.029267+0000","last_became_peered":"2024-02-17T12:17:05.029267+0000","last_unstale":"2024-02-17T12:17:23.329688+0000","last_undegraded":"2024-02-17T12:17:23.329688+0000","last_fullsized":"2024-02-17T12:17:23.329688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:18:31.092114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335462+0000","last_change":"2024-02-17T12:17:06.048418+0000","last_active":"2024-02-17T12:17:24.335462+0000","last_peered":"2024-02-17T12:17:24.335462+0000","last_clean":"2024-02-17T12:17:24.335462+0000","last_became_active":"2024-02-17T12:17:06.048123+0000","last_became_peered":"2024-02-17T12:17:06.048123+0000","last_unstale":"2024-02-17T12:17:24.335462+0000","last_undegraded":"2024-02-17T12:17:24.335462+0000","last_fullsized":"2024-02-17T12:17:24.335462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:00:35.258895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.361783+0000","last_change":"2024-02-17T12:17:22.326544+0000","last_active":"2024-02-17T12:17:23.361783+0000","last_peered":"2024-02-17T12:17:23.361783+0000","last_clean":"2024-02-17T12:17:23.361783+0000","last_became_active":"2024-02-17T12:17:22.326263+0000","last_became_peered":"2024-02-17T12:17:22.326263+0000","last_unstale":"2024-02-17T12:17:23.361783+0000","last_undegraded":"2024-02-17T12:17:23.361783+0000","last_fullsized":"2024-02-17T12:17:23.361783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:14:05.136950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.345706+0000","last_change":"2024-02-17T12:17:23.344214+0000","last_active":"2024-02-17T12:17:23.345706+0000","last_peered":"2024-02-17T12:17:23.345706+0000","last_clean":"2024-02-17T12:17:23.345706+0000","last_became_active":"2024-02-17T12:17:23.343926+0000","last_became_peered":"2024-02-17T12:17:23.343926+0000","last_unstale":"2024-02-17T12:17:23.345706+0000","last_undegraded":"2024-02-17T12:17:23.345706+0000","last_fullsized":"2024-02-17T12:17:23.345706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:00:44.784053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350925+0000","last_change":"2024-02-17T12:17:05.030240+0000","last_active":"2024-02-17T12:17:24.350925+0000","last_peered":"2024-02-17T12:17:24.350925+0000","last_clean":"2024-02-17T12:17:24.350925+0000","last_became_active":"2024-02-17T12:17:05.029142+0000","last_became_peered":"2024-02-17T12:17:05.029142+0000","last_unstale":"2024-02-17T12:17:24.350925+0000","last_undegraded":"2024-02-17T12:17:24.350925+0000","last_fullsized":"2024-02-17T12:17:24.350925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:06.543631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329599+0000","last_change":"2024-02-17T12:17:06.057017+0000","last_active":"2024-02-17T12:17:23.329599+0000","last_peered":"2024-02-17T12:17:23.329599+0000","last_clean":"2024-02-17T12:17:23.329599+0000","last_became_active":"2024-02-17T12:17:06.056811+0000","last_became_peered":"2024-02-17T12:17:06.056811+0000","last_unstale":"2024-02-17T12:17:23.329599+0000","last_undegraded":"2024-02-17T12:17:23.329599+0000","last_fullsized":"2024-02-17T12:17:23.329599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:20.704065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351040+0000","last_change":"2024-02-17T12:17:22.330509+0000","last_active":"2024-02-17T12:17:24.351040+0000","last_peered":"2024-02-17T12:17:24.351040+0000","last_clean":"2024-02-17T12:17:24.351040+0000","last_became_active":"2024-02-17T12:17:22.330187+0000","last_became_peered":"2024-02-17T12:17:22.330187+0000","last_unstale":"2024-02-17T12:17:24.351040+0000","last_undegraded":"2024-02-17T12:17:24.351040+0000","last_fullsized":"2024-02-17T12:17:24.351040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:16:26.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339296+0000","last_change":"2024-02-17T12:17:23.350582+0000","last_active":"2024-02-17T12:17:24.339296+0000","last_peered":"2024-02-17T12:17:24.339296+0000","last_clean":"2024-02-17T12:17:24.339296+0000","last_became_active":"2024-02-17T12:17:23.350327+0000","last_became_peered":"2024-02-17T12:17:23.350327+0000","last_unstale":"2024-02-17T12:17:24.339296+0000","last_undegraded":"2024-02-17T12:17:24.339296+0000","last_fullsized":"2024-02-17T12:17:24.339296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:28.360685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330606+0000","last_change":"2024-02-17T12:17:05.026630+0000","last_active":"2024-02-17T12:17:23.330606+0000","last_peered":"2024-02-17T12:17:23.330606+0000","last_clean":"2024-02-17T12:17:23.330606+0000","last_became_active":"2024-02-17T12:17:05.026382+0000","last_became_peered":"2024-02-17T12:17:05.026382+0000","last_unstale":"2024-02-17T12:17:23.330606+0000","last_undegraded":"2024-02-17T12:17:23.330606+0000","last_fullsized":"2024-02-17T12:17:23.330606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:01.105877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341952+0000","last_change":"2024-02-17T12:17:06.044302+0000","last_active":"2024-02-17T12:17:24.341952+0000","last_peered":"2024-02-17T12:17:24.341952+0000","last_clean":"2024-02-17T12:17:24.341952+0000","last_became_active":"2024-02-17T12:17:06.043786+0000","last_became_peered":"2024-02-17T12:17:06.043786+0000","last_unstale":"2024-02-17T12:17:24.341952+0000","last_undegraded":"2024-02-17T12:17:24.341952+0000","last_fullsized":"2024-02-17T12:17:24.341952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:41.419455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405118+0000","last_change":"2024-02-17T12:17:22.335847+0000","last_active":"2024-02-17T12:17:24.405118+0000","last_peered":"2024-02-17T12:17:24.405118+0000","last_clean":"2024-02-17T12:17:24.405118+0000","last_became_active":"2024-02-17T12:17:22.333935+0000","last_became_peered":"2024-02-17T12:17:22.333935+0000","last_unstale":"2024-02-17T12:17:24.405118+0000","last_undegraded":"2024-02-17T12:17:24.405118+0000","last_fullsized":"2024-02-17T12:17:24.405118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:30.358153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405018+0000","last_change":"2024-02-17T12:17:23.349851+0000","last_active":"2024-02-17T12:17:24.405018+0000","last_peered":"2024-02-17T12:17:24.405018+0000","last_clean":"2024-02-17T12:17:24.405018+0000","last_became_active":"2024-02-17T12:17:23.349605+0000","last_became_peered":"2024-02-17T12:17:23.349605+0000","last_unstale":"2024-02-17T12:17:24.405018+0000","last_undegraded":"2024-02-17T12:17:24.405018+0000","last_fullsized":"2024-02-17T12:17:24.405018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:42:52.726687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.331138+0000","last_change":"2024-02-17T12:17:05.033265+0000","last_active":"2024-02-17T12:17:23.331138+0000","last_peered":"2024-02-17T12:17:23.331138+0000","last_clean":"2024-02-17T12:17:23.331138+0000","last_became_active":"2024-02-17T12:17:05.032692+0000","last_became_peered":"2024-02-17T12:17:05.032692+0000","last_unstale":"2024-02-17T12:17:23.331138+0000","last_undegraded":"2024-02-17T12:17:23.331138+0000","last_fullsized":"2024-02-17T12:17:23.331138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:26.317463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322300+0000","last_change":"2024-02-17T12:17:06.067276+0000","last_active":"2024-02-17T12:17:23.322300+0000","last_peered":"2024-02-17T12:17:23.322300+0000","last_clean":"2024-02-17T12:17:23.322300+0000","last_became_active":"2024-02-17T12:17:06.066957+0000","last_became_peered":"2024-02-17T12:17:06.066957+0000","last_unstale":"2024-02-17T12:17:23.322300+0000","last_undegraded":"2024-02-17T12:17:23.322300+0000","last_fullsized":"2024-02-17T12:17:23.322300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:11:41.273983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341594+0000","last_change":"2024-02-17T12:17:22.340152+0000","last_active":"2024-02-17T12:17:24.341594+0000","last_peered":"2024-02-17T12:17:24.341594+0000","last_clean":"2024-02-17T12:17:24.341594+0000","last_became_active":"2024-02-17T12:17:22.335915+0000","last_became_peered":"2024-02-17T12:17:22.335915+0000","last_unstale":"2024-02-17T12:17:24.341594+0000","last_undegraded":"2024-02-17T12:17:24.341594+0000","last_fullsized":"2024-02-17T12:17:24.341594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:26:41.182127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340729+0000","last_change":"2024-02-17T12:17:23.353451+0000","last_active":"2024-02-17T12:17:24.340729+0000","last_peered":"2024-02-17T12:17:24.340729+0000","last_clean":"2024-02-17T12:17:24.340729+0000","last_became_active":"2024-02-17T12:17:23.348284+0000","last_became_peered":"2024-02-17T12:17:23.348284+0000","last_unstale":"2024-02-17T12:17:24.340729+0000","last_undegraded":"2024-02-17T12:17:24.340729+0000","last_fullsized":"2024-02-17T12:17:24.340729+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:31.316019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.361661+0000","last_change":"2024-02-17T12:17:22.333453+0000","last_active":"2024-02-17T12:17:23.361661+0000","last_peered":"2024-02-17T12:17:23.361661+0000","last_clean":"2024-02-17T12:17:23.361661+0000","last_became_active":"2024-02-17T12:17:22.333120+0000","last_became_peered":"2024-02-17T12:17:22.333120+0000","last_unstale":"2024-02-17T12:17:23.361661+0000","last_undegraded":"2024-02-17T12:17:23.361661+0000","last_fullsized":"2024-02-17T12:17:23.361661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:08:36.441039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329247+0000","last_change":"2024-02-17T12:17:05.031611+0000","last_active":"2024-02-17T12:17:23.329247+0000","last_peered":"2024-02-17T12:17:23.329247+0000","last_clean":"2024-02-17T12:17:23.329247+0000","last_became_active":"2024-02-17T12:17:05.031301+0000","last_became_peered":"2024-02-17T12:17:05.031301+0000","last_unstale":"2024-02-17T12:17:23.329247+0000","last_undegraded":"2024-02-17T12:17:23.329247+0000","last_fullsized":"2024-02-17T12:17:23.329247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:16:26.921410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335858+0000","last_change":"2024-02-17T12:17:06.065678+0000","last_active":"2024-02-17T12:17:24.335858+0000","last_peered":"2024-02-17T12:17:24.335858+0000","last_clean":"2024-02-17T12:17:24.335858+0000","last_became_active":"2024-02-17T12:17:06.065401+0000","last_became_peered":"2024-02-17T12:17:06.065401+0000","last_unstale":"2024-02-17T12:17:24.335858+0000","last_undegraded":"2024-02-17T12:17:24.335858+0000","last_fullsized":"2024-02-17T12:17:24.335858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:14:14.063262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336195+0000","last_change":"2024-02-17T12:17:23.336875+0000","last_active":"2024-02-17T12:17:24.336195+0000","last_peered":"2024-02-17T12:17:24.336195+0000","last_clean":"2024-02-17T12:17:24.336195+0000","last_became_active":"2024-02-17T12:17:23.336600+0000","last_became_peered":"2024-02-17T12:17:23.336600+0000","last_unstale":"2024-02-17T12:17:24.336195+0000","last_undegraded":"2024-02-17T12:17:24.336195+0000","last_fullsized":"2024-02-17T12:17:24.336195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:56:23.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"35'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351776+0000","last_change":"2024-02-17T12:17:22.337729+0000","last_active":"2024-02-17T12:17:24.351776+0000","last_peered":"2024-02-17T12:17:24.351776+0000","last_clean":"2024-02-17T12:17:24.351776+0000","last_became_active":"2024-02-17T12:17:22.337328+0000","last_became_peered":"2024-02-17T12:17:22.337328+0000","last_unstale":"2024-02-17T12:17:24.351776+0000","last_undegraded":"2024-02-17T12:17:24.351776+0000","last_fullsized":"2024-02-17T12:17:24.351776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:25:13.227611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351276+0000","last_change":"2024-02-17T12:17:05.033787+0000","last_active":"2024-02-17T12:17:24.351276+0000","last_peered":"2024-02-17T12:17:24.351276+0000","last_clean":"2024-02-17T12:17:24.351276+0000","last_became_active":"2024-02-17T12:17:05.033470+0000","last_became_peered":"2024-02-17T12:17:05.033470+0000","last_unstale":"2024-02-17T12:17:24.351276+0000","last_undegraded":"2024-02-17T12:17:24.351276+0000","last_fullsized":"2024-02-17T12:17:24.351276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:14:47.318267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.338140+0000","last_change":"2024-02-17T12:17:06.059046+0000","last_active":"2024-02-17T12:17:23.338140+0000","last_peered":"2024-02-17T12:17:23.338140+0000","last_clean":"2024-02-17T12:17:23.338140+0000","last_became_active":"2024-02-17T12:17:06.058674+0000","last_became_peered":"2024-02-17T12:17:06.058674+0000","last_unstale":"2024-02-17T12:17:23.338140+0000","last_undegraded":"2024-02-17T12:17:23.338140+0000","last_fullsized":"2024-02-17T12:17:23.338140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:39:57.779942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336171+0000","last_change":"2024-02-17T12:17:23.350808+0000","last_active":"2024-02-17T12:17:24.336171+0000","last_peered":"2024-02-17T12:17:24.336171+0000","last_clean":"2024-02-17T12:17:24.336171+0000","last_became_active":"2024-02-17T12:17:23.350256+0000","last_became_peered":"2024-02-17T12:17:23.350256+0000","last_unstale":"2024-02-17T12:17:24.336171+0000","last_undegraded":"2024-02-17T12:17:24.336171+0000","last_fullsized":"2024-02-17T12:17:24.336171+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:45:28.360685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405827+0000","last_change":"2024-02-17T12:17:05.039687+0000","last_active":"2024-02-17T12:17:24.405827+0000","last_peered":"2024-02-17T12:17:24.405827+0000","last_clean":"2024-02-17T12:17:24.405827+0000","last_became_active":"2024-02-17T12:17:05.039381+0000","last_became_peered":"2024-02-17T12:17:05.039381+0000","last_unstale":"2024-02-17T12:17:24.405827+0000","last_undegraded":"2024-02-17T12:17:24.405827+0000","last_fullsized":"2024-02-17T12:17:24.405827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:08:49.079397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340899+0000","last_change":"2024-02-17T12:17:06.070621+0000","last_active":"2024-02-17T12:17:24.340899+0000","last_peered":"2024-02-17T12:17:24.340899+0000","last_clean":"2024-02-17T12:17:24.340899+0000","last_became_active":"2024-02-17T12:17:06.069921+0000","last_became_peered":"2024-02-17T12:17:06.069921+0000","last_unstale":"2024-02-17T12:17:24.340899+0000","last_undegraded":"2024-02-17T12:17:24.340899+0000","last_fullsized":"2024-02-17T12:17:24.340899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:02.449515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.360163+0000","last_change":"2024-02-17T12:17:22.336191+0000","last_active":"2024-02-17T12:17:23.360163+0000","last_peered":"2024-02-17T12:17:23.360163+0000","last_clean":"2024-02-17T12:17:23.360163+0000","last_became_active":"2024-02-17T12:17:22.335893+0000","last_became_peered":"2024-02-17T12:17:22.335893+0000","last_unstale":"2024-02-17T12:17:23.360163+0000","last_undegraded":"2024-02-17T12:17:23.360163+0000","last_fullsized":"2024-02-17T12:17:23.360163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:10:23.952737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342240+0000","last_change":"2024-02-17T12:17:23.336740+0000","last_active":"2024-02-17T12:17:24.342240+0000","last_peered":"2024-02-17T12:17:24.342240+0000","last_clean":"2024-02-17T12:17:24.342240+0000","last_became_active":"2024-02-17T12:17:23.336431+0000","last_became_peered":"2024-02-17T12:17:23.336431+0000","last_unstale":"2024-02-17T12:17:24.342240+0000","last_undegraded":"2024-02-17T12:17:24.342240+0000","last_fullsized":"2024-02-17T12:17:24.342240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:18:31.192739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340963+0000","last_change":"2024-02-17T12:17:05.029800+0000","last_active":"2024-02-17T12:17:24.340963+0000","last_peered":"2024-02-17T12:17:24.340963+0000","last_clean":"2024-02-17T12:17:24.340963+0000","last_became_active":"2024-02-17T12:17:05.029482+0000","last_became_peered":"2024-02-17T12:17:05.029482+0000","last_unstale":"2024-02-17T12:17:24.340963+0000","last_undegraded":"2024-02-17T12:17:24.340963+0000","last_fullsized":"2024-02-17T12:17:24.340963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:03.997307+0000","last_clean_scrub_stamp":"2024-02-17T12:17:03.997307+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:15.061948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405737+0000","last_change":"2024-02-17T12:17:06.046159+0000","last_active":"2024-02-17T12:17:24.405737+0000","last_peered":"2024-02-17T12:17:24.405737+0000","last_clean":"2024-02-17T12:17:24.405737+0000","last_became_active":"2024-02-17T12:17:06.045821+0000","last_became_peered":"2024-02-17T12:17:06.045821+0000","last_unstale":"2024-02-17T12:17:24.405737+0000","last_undegraded":"2024-02-17T12:17:24.405737+0000","last_fullsized":"2024-02-17T12:17:24.405737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:30:40.043966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336334+0000","last_change":"2024-02-17T12:17:22.341496+0000","last_active":"2024-02-17T12:17:24.336334+0000","last_peered":"2024-02-17T12:17:24.336334+0000","last_clean":"2024-02-17T12:17:24.336334+0000","last_became_active":"2024-02-17T12:17:22.338288+0000","last_became_peered":"2024-02-17T12:17:22.338288+0000","last_unstale":"2024-02-17T12:17:24.336334+0000","last_undegraded":"2024-02-17T12:17:24.336334+0000","last_fullsized":"2024-02-17T12:17:24.336334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:21.299458+0000","last_clean_scrub_stamp":"2024-02-17T12:17:21.299458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:02:39.422372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.345686+0000","last_change":"2024-02-17T12:17:23.341176+0000","last_active":"2024-02-17T12:17:23.345686+0000","last_peered":"2024-02-17T12:17:23.345686+0000","last_clean":"2024-02-17T12:17:23.345686+0000","last_became_active":"2024-02-17T12:17:23.340896+0000","last_became_peered":"2024-02-17T12:17:23.340896+0000","last_unstale":"2024-02-17T12:17:23.345686+0000","last_undegraded":"2024-02-17T12:17:23.345686+0000","last_fullsized":"2024-02-17T12:17:23.345686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:11:14.938938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.321833+0000","last_change":"2024-02-17T12:17:06.067536+0000","last_active":"2024-02-17T12:17:23.321833+0000","last_peered":"2024-02-17T12:17:23.321833+0000","last_clean":"2024-02-17T12:17:23.321833+0000","last_became_active":"2024-02-17T12:17:06.066861+0000","last_became_peered":"2024-02-17T12:17:06.066861+0000","last_unstale":"2024-02-17T12:17:23.321833+0000","last_undegraded":"2024-02-17T12:17:23.321833+0000","last_fullsized":"2024-02-17T12:17:23.321833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:52.966313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339986+0000","last_change":"2024-02-17T12:17:23.347358+0000","last_active":"2024-02-17T12:17:24.339986+0000","last_peered":"2024-02-17T12:17:24.339986+0000","last_clean":"2024-02-17T12:17:24.339986+0000","last_became_active":"2024-02-17T12:17:23.346889+0000","last_became_peered":"2024-02-17T12:17:23.346889+0000","last_unstale":"2024-02-17T12:17:24.339986+0000","last_undegraded":"2024-02-17T12:17:24.339986+0000","last_fullsized":"2024-02-17T12:17:24.339986+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:26:42.189066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339382+0000","last_change":"2024-02-17T12:17:06.058310+0000","last_active":"2024-02-17T12:17:24.339382+0000","last_peered":"2024-02-17T12:17:24.339382+0000","last_clean":"2024-02-17T12:17:24.339382+0000","last_became_active":"2024-02-17T12:17:06.058007+0000","last_became_peered":"2024-02-17T12:17:06.058007+0000","last_unstale":"2024-02-17T12:17:24.339382+0000","last_undegraded":"2024-02-17T12:17:24.339382+0000","last_fullsized":"2024-02-17T12:17:24.339382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:10.427795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.351496+0000","last_change":"2024-02-17T12:17:23.340221+0000","last_active":"2024-02-17T12:17:23.351496+0000","last_peered":"2024-02-17T12:17:23.351496+0000","last_clean":"2024-02-17T12:17:23.351496+0000","last_became_active":"2024-02-17T12:17:23.339968+0000","last_became_peered":"2024-02-17T12:17:23.339968+0000","last_unstale":"2024-02-17T12:17:23.351496+0000","last_undegraded":"2024-02-17T12:17:23.351496+0000","last_fullsized":"2024-02-17T12:17:23.351496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:56:54.288840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322216+0000","last_change":"2024-02-17T12:17:06.056092+0000","last_active":"2024-02-17T12:17:23.322216+0000","last_peered":"2024-02-17T12:17:23.322216+0000","last_clean":"2024-02-17T12:17:23.322216+0000","last_became_active":"2024-02-17T12:17:06.055782+0000","last_became_peered":"2024-02-17T12:17:06.055782+0000","last_unstale":"2024-02-17T12:17:23.322216+0000","last_undegraded":"2024-02-17T12:17:23.322216+0000","last_fullsized":"2024-02-17T12:17:23.322216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:04:27.477154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350857+0000","last_change":"2024-02-17T12:17:23.332649+0000","last_active":"2024-02-17T12:17:24.350857+0000","last_peered":"2024-02-17T12:17:24.350857+0000","last_clean":"2024-02-17T12:17:24.350857+0000","last_became_active":"2024-02-17T12:17:23.332294+0000","last_became_peered":"2024-02-17T12:17:23.332294+0000","last_unstale":"2024-02-17T12:17:24.350857+0000","last_undegraded":"2024-02-17T12:17:24.350857+0000","last_fullsized":"2024-02-17T12:17:24.350857+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:52:50.391174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.331041+0000","last_change":"2024-02-17T12:17:06.059053+0000","last_active":"2024-02-17T12:17:23.331041+0000","last_peered":"2024-02-17T12:17:23.331041+0000","last_clean":"2024-02-17T12:17:23.331041+0000","last_became_active":"2024-02-17T12:17:06.058762+0000","last_became_peered":"2024-02-17T12:17:06.058762+0000","last_unstale":"2024-02-17T12:17:23.331041+0000","last_undegraded":"2024-02-17T12:17:23.331041+0000","last_fullsized":"2024-02-17T12:17:23.331041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:54:58.399092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.351528+0000","last_change":"2024-02-17T12:17:23.348700+0000","last_active":"2024-02-17T12:17:23.351528+0000","last_peered":"2024-02-17T12:17:23.351528+0000","last_clean":"2024-02-17T12:17:23.351528+0000","last_became_active":"2024-02-17T12:17:23.348472+0000","last_became_peered":"2024-02-17T12:17:23.348472+0000","last_unstale":"2024-02-17T12:17:23.351528+0000","last_undegraded":"2024-02-17T12:17:23.351528+0000","last_fullsized":"2024-02-17T12:17:23.351528+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:59:51.903718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342457+0000","last_change":"2024-02-17T12:17:06.044234+0000","last_active":"2024-02-17T12:17:24.342457+0000","last_peered":"2024-02-17T12:17:24.342457+0000","last_clean":"2024-02-17T12:17:24.342457+0000","last_became_active":"2024-02-17T12:17:06.043918+0000","last_became_peered":"2024-02-17T12:17:06.043918+0000","last_unstale":"2024-02-17T12:17:24.342457+0000","last_undegraded":"2024-02-17T12:17:24.342457+0000","last_fullsized":"2024-02-17T12:17:24.342457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:15.140333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340862+0000","last_change":"2024-02-17T12:17:23.351279+0000","last_active":"2024-02-17T12:17:24.340862+0000","last_peered":"2024-02-17T12:17:24.340862+0000","last_clean":"2024-02-17T12:17:24.340862+0000","last_became_active":"2024-02-17T12:17:23.348237+0000","last_became_peered":"2024-02-17T12:17:23.348237+0000","last_unstale":"2024-02-17T12:17:24.340862+0000","last_undegraded":"2024-02-17T12:17:24.340862+0000","last_fullsized":"2024-02-17T12:17:24.340862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:25.808758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335874+0000","last_change":"2024-02-17T12:17:06.065534+0000","last_active":"2024-02-17T12:17:24.335874+0000","last_peered":"2024-02-17T12:17:24.335874+0000","last_clean":"2024-02-17T12:17:24.335874+0000","last_became_active":"2024-02-17T12:17:06.065279+0000","last_became_peered":"2024-02-17T12:17:06.065279+0000","last_unstale":"2024-02-17T12:17:24.335874+0000","last_undegraded":"2024-02-17T12:17:24.335874+0000","last_fullsized":"2024-02-17T12:17:24.335874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:52.059473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342000+0000","last_change":"2024-02-17T12:17:23.337509+0000","last_active":"2024-02-17T12:17:24.342000+0000","last_peered":"2024-02-17T12:17:24.342000+0000","last_clean":"2024-02-17T12:17:24.342000+0000","last_became_active":"2024-02-17T12:17:23.337202+0000","last_became_peered":"2024-02-17T12:17:23.337202+0000","last_unstale":"2024-02-17T12:17:24.342000+0000","last_undegraded":"2024-02-17T12:17:24.342000+0000","last_fullsized":"2024-02-17T12:17:24.342000+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:14:39.305651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351759+0000","last_change":"2024-02-17T12:17:06.045278+0000","last_active":"2024-02-17T12:17:24.351759+0000","last_peered":"2024-02-17T12:17:24.351759+0000","last_clean":"2024-02-17T12:17:24.351759+0000","last_became_active":"2024-02-17T12:17:06.045015+0000","last_became_peered":"2024-02-17T12:17:06.045015+0000","last_unstale":"2024-02-17T12:17:24.351759+0000","last_undegraded":"2024-02-17T12:17:24.351759+0000","last_fullsized":"2024-02-17T12:17:24.351759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:23:10.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.345613+0000","last_change":"2024-02-17T12:17:23.341600+0000","last_active":"2024-02-17T12:17:23.345613+0000","last_peered":"2024-02-17T12:17:23.345613+0000","last_clean":"2024-02-17T12:17:23.345613+0000","last_became_active":"2024-02-17T12:17:23.341333+0000","last_became_peered":"2024-02-17T12:17:23.341333+0000","last_unstale":"2024-02-17T12:17:23.345613+0000","last_undegraded":"2024-02-17T12:17:23.345613+0000","last_fullsized":"2024-02-17T12:17:23.345613+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:59.089431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336446+0000","last_change":"2024-02-17T12:17:06.054887+0000","last_active":"2024-02-17T12:17:24.336446+0000","last_peered":"2024-02-17T12:17:24.336446+0000","last_clean":"2024-02-17T12:17:24.336446+0000","last_became_active":"2024-02-17T12:17:06.054012+0000","last_became_peered":"2024-02-17T12:17:06.054012+0000","last_unstale":"2024-02-17T12:17:24.336446+0000","last_undegraded":"2024-02-17T12:17:24.336446+0000","last_fullsized":"2024-02-17T12:17:24.336446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:02:41.419455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405194+0000","last_change":"2024-02-17T12:17:23.349574+0000","last_active":"2024-02-17T12:17:24.405194+0000","last_peered":"2024-02-17T12:17:24.405194+0000","last_clean":"2024-02-17T12:17:24.405194+0000","last_became_active":"2024-02-17T12:17:23.348486+0000","last_became_peered":"2024-02-17T12:17:23.348486+0000","last_unstale":"2024-02-17T12:17:24.405194+0000","last_undegraded":"2024-02-17T12:17:24.405194+0000","last_fullsized":"2024-02-17T12:17:24.405194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:25.808758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340801+0000","last_change":"2024-02-17T12:17:06.046677+0000","last_active":"2024-02-17T12:17:24.340801+0000","last_peered":"2024-02-17T12:17:24.340801+0000","last_clean":"2024-02-17T12:17:24.340801+0000","last_became_active":"2024-02-17T12:17:06.046330+0000","last_became_peered":"2024-02-17T12:17:06.046330+0000","last_unstale":"2024-02-17T12:17:24.340801+0000","last_undegraded":"2024-02-17T12:17:24.340801+0000","last_fullsized":"2024-02-17T12:17:24.340801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:10:08.114724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351380+0000","last_change":"2024-02-17T12:17:23.346479+0000","last_active":"2024-02-17T12:17:24.351380+0000","last_peered":"2024-02-17T12:17:24.351380+0000","last_clean":"2024-02-17T12:17:24.351380+0000","last_became_active":"2024-02-17T12:17:23.346107+0000","last_became_peered":"2024-02-17T12:17:23.346107+0000","last_unstale":"2024-02-17T12:17:24.351380+0000","last_undegraded":"2024-02-17T12:17:24.351380+0000","last_fullsized":"2024-02-17T12:17:24.351380+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:08:55.017639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405104+0000","last_change":"2024-02-17T12:17:06.043576+0000","last_active":"2024-02-17T12:17:24.405104+0000","last_peered":"2024-02-17T12:17:24.405104+0000","last_clean":"2024-02-17T12:17:24.405104+0000","last_became_active":"2024-02-17T12:17:06.043313+0000","last_became_peered":"2024-02-17T12:17:06.043313+0000","last_unstale":"2024-02-17T12:17:24.405104+0000","last_undegraded":"2024-02-17T12:17:24.405104+0000","last_fullsized":"2024-02-17T12:17:24.405104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:18.832967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339201+0000","last_change":"2024-02-17T12:17:23.350086+0000","last_active":"2024-02-17T12:17:24.339201+0000","last_peered":"2024-02-17T12:17:24.339201+0000","last_clean":"2024-02-17T12:17:24.339201+0000","last_became_active":"2024-02-17T12:17:23.348268+0000","last_became_peered":"2024-02-17T12:17:23.348268+0000","last_unstale":"2024-02-17T12:17:24.339201+0000","last_undegraded":"2024-02-17T12:17:24.339201+0000","last_fullsized":"2024-02-17T12:17:24.339201+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:42:07.187217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330247+0000","last_change":"2024-02-17T12:17:06.061943+0000","last_active":"2024-02-17T12:17:23.330247+0000","last_peered":"2024-02-17T12:17:23.330247+0000","last_clean":"2024-02-17T12:17:23.330247+0000","last_became_active":"2024-02-17T12:17:06.057880+0000","last_became_peered":"2024-02-17T12:17:06.057880+0000","last_unstale":"2024-02-17T12:17:23.330247+0000","last_undegraded":"2024-02-17T12:17:23.330247+0000","last_fullsized":"2024-02-17T12:17:23.330247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:06:41.759635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339657+0000","last_change":"2024-02-17T12:17:23.340929+0000","last_active":"2024-02-17T12:17:24.339657+0000","last_peered":"2024-02-17T12:17:24.339657+0000","last_clean":"2024-02-17T12:17:24.339657+0000","last_became_active":"2024-02-17T12:17:23.340480+0000","last_became_peered":"2024-02-17T12:17:23.340480+0000","last_unstale":"2024-02-17T12:17:24.339657+0000","last_undegraded":"2024-02-17T12:17:24.339657+0000","last_fullsized":"2024-02-17T12:17:24.339657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:43:22.169547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.330938+0000","last_change":"2024-02-17T12:17:06.056498+0000","last_active":"2024-02-17T12:17:23.330938+0000","last_peered":"2024-02-17T12:17:23.330938+0000","last_clean":"2024-02-17T12:17:23.330938+0000","last_became_active":"2024-02-17T12:17:06.056186+0000","last_became_peered":"2024-02-17T12:17:06.056186+0000","last_unstale":"2024-02-17T12:17:23.330938+0000","last_undegraded":"2024-02-17T12:17:23.330938+0000","last_fullsized":"2024-02-17T12:17:23.330938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:54.119743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.348691+0000","last_change":"2024-02-17T12:17:23.344887+0000","last_active":"2024-02-17T12:17:23.348691+0000","last_peered":"2024-02-17T12:17:23.348691+0000","last_clean":"2024-02-17T12:17:23.348691+0000","last_became_active":"2024-02-17T12:17:23.344580+0000","last_became_peered":"2024-02-17T12:17:23.344580+0000","last_unstale":"2024-02-17T12:17:23.348691+0000","last_undegraded":"2024-02-17T12:17:23.348691+0000","last_fullsized":"2024-02-17T12:17:23.348691+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:00:34.474456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329148+0000","last_change":"2024-02-17T12:17:06.042349+0000","last_active":"2024-02-17T12:17:23.329148+0000","last_peered":"2024-02-17T12:17:23.329148+0000","last_clean":"2024-02-17T12:17:23.329148+0000","last_became_active":"2024-02-17T12:17:06.041014+0000","last_became_peered":"2024-02-17T12:17:06.041014+0000","last_unstale":"2024-02-17T12:17:23.329148+0000","last_undegraded":"2024-02-17T12:17:23.329148+0000","last_fullsized":"2024-02-17T12:17:23.329148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:17.216650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.348598+0000","last_change":"2024-02-17T12:17:23.344990+0000","last_active":"2024-02-17T12:17:23.348598+0000","last_peered":"2024-02-17T12:17:23.348598+0000","last_clean":"2024-02-17T12:17:23.348598+0000","last_became_active":"2024-02-17T12:17:23.344662+0000","last_became_peered":"2024-02-17T12:17:23.344662+0000","last_unstale":"2024-02-17T12:17:23.348598+0000","last_undegraded":"2024-02-17T12:17:23.348598+0000","last_fullsized":"2024-02-17T12:17:23.348598+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:20:48.204608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351229+0000","last_change":"2024-02-17T12:17:06.047799+0000","last_active":"2024-02-17T12:17:24.351229+0000","last_peered":"2024-02-17T12:17:24.351229+0000","last_clean":"2024-02-17T12:17:24.351229+0000","last_became_active":"2024-02-17T12:17:06.047532+0000","last_became_peered":"2024-02-17T12:17:06.047532+0000","last_unstale":"2024-02-17T12:17:24.351229+0000","last_undegraded":"2024-02-17T12:17:24.351229+0000","last_fullsized":"2024-02-17T12:17:24.351229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:49:48.671656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.351445+0000","last_change":"2024-02-17T12:17:23.341593+0000","last_active":"2024-02-17T12:17:23.351445+0000","last_peered":"2024-02-17T12:17:23.351445+0000","last_clean":"2024-02-17T12:17:23.351445+0000","last_became_active":"2024-02-17T12:17:23.341274+0000","last_became_peered":"2024-02-17T12:17:23.341274+0000","last_unstale":"2024-02-17T12:17:23.351445+0000","last_undegraded":"2024-02-17T12:17:23.351445+0000","last_fullsized":"2024-02-17T12:17:23.351445+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:39:38.005895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351685+0000","last_change":"2024-02-17T12:17:06.061999+0000","last_active":"2024-02-17T12:17:24.351685+0000","last_peered":"2024-02-17T12:17:24.351685+0000","last_clean":"2024-02-17T12:17:24.351685+0000","last_became_active":"2024-02-17T12:17:06.060293+0000","last_became_peered":"2024-02-17T12:17:06.060293+0000","last_unstale":"2024-02-17T12:17:24.351685+0000","last_undegraded":"2024-02-17T12:17:24.351685+0000","last_fullsized":"2024-02-17T12:17:24.351685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:52:45.908320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340415+0000","last_change":"2024-02-17T12:17:23.351123+0000","last_active":"2024-02-17T12:17:24.340415+0000","last_peered":"2024-02-17T12:17:24.340415+0000","last_clean":"2024-02-17T12:17:24.340415+0000","last_became_active":"2024-02-17T12:17:23.350739+0000","last_became_peered":"2024-02-17T12:17:23.350739+0000","last_unstale":"2024-02-17T12:17:24.340415+0000","last_undegraded":"2024-02-17T12:17:24.340415+0000","last_fullsized":"2024-02-17T12:17:24.340415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:40:17.228464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.324132+0000","last_change":"2024-02-17T12:17:06.056524+0000","last_active":"2024-02-17T12:17:23.324132+0000","last_peered":"2024-02-17T12:17:23.324132+0000","last_clean":"2024-02-17T12:17:23.324132+0000","last_became_active":"2024-02-17T12:17:06.056171+0000","last_became_peered":"2024-02-17T12:17:06.056171+0000","last_unstale":"2024-02-17T12:17:23.324132+0000","last_undegraded":"2024-02-17T12:17:23.324132+0000","last_fullsized":"2024-02-17T12:17:23.324132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:38:15.599213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405110+0000","last_change":"2024-02-17T12:17:23.354324+0000","last_active":"2024-02-17T12:17:24.405110+0000","last_peered":"2024-02-17T12:17:24.405110+0000","last_clean":"2024-02-17T12:17:24.405110+0000","last_became_active":"2024-02-17T12:17:23.352975+0000","last_became_peered":"2024-02-17T12:17:23.352975+0000","last_unstale":"2024-02-17T12:17:24.405110+0000","last_undegraded":"2024-02-17T12:17:24.405110+0000","last_fullsized":"2024-02-17T12:17:24.405110+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:17:31.316019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.322239+0000","last_change":"2024-02-17T12:17:06.053372+0000","last_active":"2024-02-17T12:17:23.322239+0000","last_peered":"2024-02-17T12:17:23.322239+0000","last_clean":"2024-02-17T12:17:23.322239+0000","last_became_active":"2024-02-17T12:17:06.053019+0000","last_became_peered":"2024-02-17T12:17:06.053019+0000","last_unstale":"2024-02-17T12:17:23.322239+0000","last_undegraded":"2024-02-17T12:17:23.322239+0000","last_fullsized":"2024-02-17T12:17:23.322239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:01:09.789376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.353675+0000","last_change":"2024-02-17T12:17:23.345991+0000","last_active":"2024-02-17T12:17:23.353675+0000","last_peered":"2024-02-17T12:17:23.353675+0000","last_clean":"2024-02-17T12:17:23.353675+0000","last_became_active":"2024-02-17T12:17:23.345690+0000","last_became_peered":"2024-02-17T12:17:23.345690+0000","last_unstale":"2024-02-17T12:17:23.353675+0000","last_undegraded":"2024-02-17T12:17:23.353675+0000","last_fullsized":"2024-02-17T12:17:23.353675+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:15.700922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341618+0000","last_change":"2024-02-17T12:17:06.050512+0000","last_active":"2024-02-17T12:17:24.341618+0000","last_peered":"2024-02-17T12:17:24.341618+0000","last_clean":"2024-02-17T12:17:24.341618+0000","last_became_active":"2024-02-17T12:17:06.050068+0000","last_became_peered":"2024-02-17T12:17:06.050068+0000","last_unstale":"2024-02-17T12:17:24.341618+0000","last_undegraded":"2024-02-17T12:17:24.341618+0000","last_fullsized":"2024-02-17T12:17:24.341618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:52.059473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.339188+0000","last_change":"2024-02-17T12:17:23.343419+0000","last_active":"2024-02-17T12:17:24.339188+0000","last_peered":"2024-02-17T12:17:24.339188+0000","last_clean":"2024-02-17T12:17:24.339188+0000","last_became_active":"2024-02-17T12:17:23.342512+0000","last_became_peered":"2024-02-17T12:17:23.342512+0000","last_unstale":"2024-02-17T12:17:24.339188+0000","last_undegraded":"2024-02-17T12:17:24.339188+0000","last_fullsized":"2024-02-17T12:17:24.339188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:38.848587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351430+0000","last_change":"2024-02-17T12:17:06.048246+0000","last_active":"2024-02-17T12:17:24.351430+0000","last_peered":"2024-02-17T12:17:24.351430+0000","last_clean":"2024-02-17T12:17:24.351430+0000","last_became_active":"2024-02-17T12:17:06.047970+0000","last_became_peered":"2024-02-17T12:17:06.047970+0000","last_unstale":"2024-02-17T12:17:24.351430+0000","last_undegraded":"2024-02-17T12:17:24.351430+0000","last_fullsized":"2024-02-17T12:17:24.351430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:10:08.114724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350771+0000","last_change":"2024-02-17T12:17:23.346426+0000","last_active":"2024-02-17T12:17:24.350771+0000","last_peered":"2024-02-17T12:17:24.350771+0000","last_clean":"2024-02-17T12:17:24.350771+0000","last_became_active":"2024-02-17T12:17:23.345948+0000","last_became_peered":"2024-02-17T12:17:23.345948+0000","last_unstale":"2024-02-17T12:17:24.350771+0000","last_undegraded":"2024-02-17T12:17:24.350771+0000","last_fullsized":"2024-02-17T12:17:24.350771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:05.113702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.329415+0000","last_change":"2024-02-17T12:17:06.050786+0000","last_active":"2024-02-17T12:17:23.329415+0000","last_peered":"2024-02-17T12:17:23.329415+0000","last_clean":"2024-02-17T12:17:23.329415+0000","last_became_active":"2024-02-17T12:17:06.050510+0000","last_became_peered":"2024-02-17T12:17:06.050510+0000","last_unstale":"2024-02-17T12:17:23.329415+0000","last_undegraded":"2024-02-17T12:17:23.329415+0000","last_fullsized":"2024-02-17T12:17:23.329415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:32:33.567679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405607+0000","last_change":"2024-02-17T12:17:23.358972+0000","last_active":"2024-02-17T12:17:24.405607+0000","last_peered":"2024-02-17T12:17:24.405607+0000","last_clean":"2024-02-17T12:17:24.405607+0000","last_became_active":"2024-02-17T12:17:23.358748+0000","last_became_peered":"2024-02-17T12:17:23.358748+0000","last_unstale":"2024-02-17T12:17:24.405607+0000","last_undegraded":"2024-02-17T12:17:24.405607+0000","last_fullsized":"2024-02-17T12:17:24.405607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:05.175835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342365+0000","last_change":"2024-02-17T12:17:06.044931+0000","last_active":"2024-02-17T12:17:24.342365+0000","last_peered":"2024-02-17T12:17:24.342365+0000","last_clean":"2024-02-17T12:17:24.342365+0000","last_became_active":"2024-02-17T12:17:06.044646+0000","last_became_peered":"2024-02-17T12:17:06.044646+0000","last_unstale":"2024-02-17T12:17:24.342365+0000","last_undegraded":"2024-02-17T12:17:24.342365+0000","last_fullsized":"2024-02-17T12:17:24.342365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:15:16.951684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405698+0000","last_change":"2024-02-17T12:17:23.357131+0000","last_active":"2024-02-17T12:17:24.405698+0000","last_peered":"2024-02-17T12:17:24.405698+0000","last_clean":"2024-02-17T12:17:24.405698+0000","last_became_active":"2024-02-17T12:17:23.356796+0000","last_became_peered":"2024-02-17T12:17:23.356796+0000","last_unstale":"2024-02-17T12:17:24.405698+0000","last_undegraded":"2024-02-17T12:17:24.405698+0000","last_fullsized":"2024-02-17T12:17:24.405698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:44:46.548825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.323628+0000","last_change":"2024-02-17T12:17:06.066599+0000","last_active":"2024-02-17T12:17:23.323628+0000","last_peered":"2024-02-17T12:17:23.323628+0000","last_clean":"2024-02-17T12:17:23.323628+0000","last_became_active":"2024-02-17T12:17:06.066328+0000","last_became_peered":"2024-02-17T12:17:06.066328+0000","last_unstale":"2024-02-17T12:17:23.323628+0000","last_undegraded":"2024-02-17T12:17:23.323628+0000","last_fullsized":"2024-02-17T12:17:23.323628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:05.232139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341940+0000","last_change":"2024-02-17T12:17:23.337740+0000","last_active":"2024-02-17T12:17:24.341940+0000","last_peered":"2024-02-17T12:17:24.341940+0000","last_clean":"2024-02-17T12:17:24.341940+0000","last_became_active":"2024-02-17T12:17:23.337210+0000","last_became_peered":"2024-02-17T12:17:23.337210+0000","last_unstale":"2024-02-17T12:17:24.341940+0000","last_undegraded":"2024-02-17T12:17:24.341940+0000","last_fullsized":"2024-02-17T12:17:24.341940+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:44:46.548825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.336241+0000","last_change":"2024-02-17T12:17:06.046775+0000","last_active":"2024-02-17T12:17:24.336241+0000","last_peered":"2024-02-17T12:17:24.336241+0000","last_clean":"2024-02-17T12:17:24.336241+0000","last_became_active":"2024-02-17T12:17:06.046488+0000","last_became_peered":"2024-02-17T12:17:06.046488+0000","last_unstale":"2024-02-17T12:17:24.336241+0000","last_undegraded":"2024-02-17T12:17:24.336241+0000","last_fullsized":"2024-02-17T12:17:24.336241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:09:44.880288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405401+0000","last_change":"2024-02-17T12:17:23.356702+0000","last_active":"2024-02-17T12:17:24.405401+0000","last_peered":"2024-02-17T12:17:24.405401+0000","last_clean":"2024-02-17T12:17:24.405401+0000","last_became_active":"2024-02-17T12:17:23.355031+0000","last_became_peered":"2024-02-17T12:17:23.355031+0000","last_unstale":"2024-02-17T12:17:24.405401+0000","last_undegraded":"2024-02-17T12:17:24.405401+0000","last_fullsized":"2024-02-17T12:17:24.405401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:42:28.760947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.339279+0000","last_change":"2024-02-17T12:17:06.070529+0000","last_active":"2024-02-17T12:17:23.339279+0000","last_peered":"2024-02-17T12:17:23.339279+0000","last_clean":"2024-02-17T12:17:23.339279+0000","last_became_active":"2024-02-17T12:17:06.066959+0000","last_became_peered":"2024-02-17T12:17:06.066959+0000","last_unstale":"2024-02-17T12:17:23.339279+0000","last_undegraded":"2024-02-17T12:17:23.339279+0000","last_fullsized":"2024-02-17T12:17:23.339279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:56:36.987010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.350861+0000","last_change":"2024-02-17T12:17:23.327940+0000","last_active":"2024-02-17T12:17:24.350861+0000","last_peered":"2024-02-17T12:17:24.350861+0000","last_clean":"2024-02-17T12:17:24.350861+0000","last_became_active":"2024-02-17T12:17:23.327675+0000","last_became_peered":"2024-02-17T12:17:23.327675+0000","last_unstale":"2024-02-17T12:17:24.350861+0000","last_undegraded":"2024-02-17T12:17:24.350861+0000","last_fullsized":"2024-02-17T12:17:24.350861+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:04:21.451609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.321898+0000","last_change":"2024-02-17T12:17:06.064126+0000","last_active":"2024-02-17T12:17:23.321898+0000","last_peered":"2024-02-17T12:17:23.321898+0000","last_clean":"2024-02-17T12:17:23.321898+0000","last_became_active":"2024-02-17T12:17:06.063876+0000","last_became_peered":"2024-02-17T12:17:06.063876+0000","last_unstale":"2024-02-17T12:17:23.321898+0000","last_undegraded":"2024-02-17T12:17:23.321898+0000","last_fullsized":"2024-02-17T12:17:23.321898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:33:43.849542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.341858+0000","last_change":"2024-02-17T12:17:23.344138+0000","last_active":"2024-02-17T12:17:24.341858+0000","last_peered":"2024-02-17T12:17:24.341858+0000","last_clean":"2024-02-17T12:17:24.341858+0000","last_became_active":"2024-02-17T12:17:23.343907+0000","last_became_peered":"2024-02-17T12:17:23.343907+0000","last_unstale":"2024-02-17T12:17:24.341858+0000","last_undegraded":"2024-02-17T12:17:24.341858+0000","last_fullsized":"2024-02-17T12:17:24.341858+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:28:05.175835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.323114+0000","last_change":"2024-02-17T12:17:06.057466+0000","last_active":"2024-02-17T12:17:23.323114+0000","last_peered":"2024-02-17T12:17:23.323114+0000","last_clean":"2024-02-17T12:17:23.323114+0000","last_became_active":"2024-02-17T12:17:06.056922+0000","last_became_peered":"2024-02-17T12:17:06.056922+0000","last_unstale":"2024-02-17T12:17:23.323114+0000","last_undegraded":"2024-02-17T12:17:23.323114+0000","last_fullsized":"2024-02-17T12:17:23.323114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:48.842059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405003+0000","last_change":"2024-02-17T12:17:23.357082+0000","last_active":"2024-02-17T12:17:24.405003+0000","last_peered":"2024-02-17T12:17:24.405003+0000","last_clean":"2024-02-17T12:17:24.405003+0000","last_became_active":"2024-02-17T12:17:23.355207+0000","last_became_peered":"2024-02-17T12:17:23.355207+0000","last_unstale":"2024-02-17T12:17:24.405003+0000","last_undegraded":"2024-02-17T12:17:24.405003+0000","last_fullsized":"2024-02-17T12:17:24.405003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:25.892811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351319+0000","last_change":"2024-02-17T12:17:06.046884+0000","last_active":"2024-02-17T12:17:24.351319+0000","last_peered":"2024-02-17T12:17:24.351319+0000","last_clean":"2024-02-17T12:17:24.351319+0000","last_became_active":"2024-02-17T12:17:06.046588+0000","last_became_peered":"2024-02-17T12:17:06.046588+0000","last_unstale":"2024-02-17T12:17:24.351319+0000","last_undegraded":"2024-02-17T12:17:24.351319+0000","last_fullsized":"2024-02-17T12:17:24.351319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:50:00.758848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.347280+0000","last_change":"2024-02-17T12:17:23.340850+0000","last_active":"2024-02-17T12:17:23.347280+0000","last_peered":"2024-02-17T12:17:23.347280+0000","last_clean":"2024-02-17T12:17:23.347280+0000","last_became_active":"2024-02-17T12:17:23.340238+0000","last_became_peered":"2024-02-17T12:17:23.340238+0000","last_unstale":"2024-02-17T12:17:23.347280+0000","last_undegraded":"2024-02-17T12:17:23.347280+0000","last_fullsized":"2024-02-17T12:17:23.347280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:07.872630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.328871+0000","last_change":"2024-02-17T12:17:06.042206+0000","last_active":"2024-02-17T12:17:23.328871+0000","last_peered":"2024-02-17T12:17:23.328871+0000","last_clean":"2024-02-17T12:17:23.328871+0000","last_became_active":"2024-02-17T12:17:06.041911+0000","last_became_peered":"2024-02-17T12:17:06.041911+0000","last_unstale":"2024-02-17T12:17:23.328871+0000","last_undegraded":"2024-02-17T12:17:23.328871+0000","last_fullsized":"2024-02-17T12:17:23.328871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:57:09.997084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342186+0000","last_change":"2024-02-17T12:17:23.352578+0000","last_active":"2024-02-17T12:17:24.342186+0000","last_peered":"2024-02-17T12:17:24.342186+0000","last_clean":"2024-02-17T12:17:24.342186+0000","last_became_active":"2024-02-17T12:17:23.352080+0000","last_became_peered":"2024-02-17T12:17:23.352080+0000","last_unstale":"2024-02-17T12:17:24.342186+0000","last_undegraded":"2024-02-17T12:17:24.342186+0000","last_fullsized":"2024-02-17T12:17:24.342186+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:25:14.234550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.335842+0000","last_change":"2024-02-17T12:17:06.065748+0000","last_active":"2024-02-17T12:17:24.335842+0000","last_peered":"2024-02-17T12:17:24.335842+0000","last_clean":"2024-02-17T12:17:24.335842+0000","last_became_active":"2024-02-17T12:17:06.065234+0000","last_became_peered":"2024-02-17T12:17:06.065234+0000","last_unstale":"2024-02-17T12:17:24.335842+0000","last_undegraded":"2024-02-17T12:17:24.335842+0000","last_fullsized":"2024-02-17T12:17:24.335842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:25:38.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.349026+0000","last_change":"2024-02-17T12:17:23.346045+0000","last_active":"2024-02-17T12:17:23.349026+0000","last_peered":"2024-02-17T12:17:23.349026+0000","last_clean":"2024-02-17T12:17:23.349026+0000","last_became_active":"2024-02-17T12:17:23.345638+0000","last_became_peered":"2024-02-17T12:17:23.345638+0000","last_unstale":"2024-02-17T12:17:23.349026+0000","last_undegraded":"2024-02-17T12:17:23.349026+0000","last_fullsized":"2024-02-17T12:17:23.349026+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:17:30.345217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.342221+0000","last_change":"2024-02-17T12:17:06.061029+0000","last_active":"2024-02-17T12:17:24.342221+0000","last_peered":"2024-02-17T12:17:24.342221+0000","last_clean":"2024-02-17T12:17:24.342221+0000","last_became_active":"2024-02-17T12:17:06.060750+0000","last_became_peered":"2024-02-17T12:17:06.060750+0000","last_unstale":"2024-02-17T12:17:24.342221+0000","last_undegraded":"2024-02-17T12:17:24.342221+0000","last_fullsized":"2024-02-17T12:17:24.342221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:50:49.648481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.405429+0000","last_change":"2024-02-17T12:17:23.351523+0000","last_active":"2024-02-17T12:17:24.405429+0000","last_peered":"2024-02-17T12:17:24.405429+0000","last_clean":"2024-02-17T12:17:24.405429+0000","last_became_active":"2024-02-17T12:17:23.351278+0000","last_became_peered":"2024-02-17T12:17:23.351278+0000","last_unstale":"2024-02-17T12:17:24.405429+0000","last_undegraded":"2024-02-17T12:17:24.405429+0000","last_fullsized":"2024-02-17T12:17:24.405429+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:00:59.493939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.351684+0000","last_change":"2024-02-17T12:17:06.052373+0000","last_active":"2024-02-17T12:17:24.351684+0000","last_peered":"2024-02-17T12:17:24.351684+0000","last_clean":"2024-02-17T12:17:24.351684+0000","last_became_active":"2024-02-17T12:17:06.050597+0000","last_became_peered":"2024-02-17T12:17:06.050597+0000","last_unstale":"2024-02-17T12:17:24.351684+0000","last_undegraded":"2024-02-17T12:17:24.351684+0000","last_fullsized":"2024-02-17T12:17:24.351684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:34:21.177151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-17T12:17:23.345588+0000","last_change":"2024-02-17T12:17:23.341028+0000","last_active":"2024-02-17T12:17:23.345588+0000","last_peered":"2024-02-17T12:17:23.345588+0000","last_clean":"2024-02-17T12:17:23.345588+0000","last_became_active":"2024-02-17T12:17:23.340496+0000","last_became_peered":"2024-02-17T12:17:23.340496+0000","last_unstale":"2024-02-17T12:17:23.345588+0000","last_undegraded":"2024-02-17T12:17:23.345588+0000","last_fullsized":"2024-02-17T12:17:23.345588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:22.306397+0000","last_clean_scrub_stamp":"2024-02-17T12:17:22.306397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:20:30.059824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-02-17T12:17:24.340784+0000","last_change":"2024-02-17T12:17:06.053476+0000","last_active":"2024-02-17T12:17:24.340784+0000","last_peered":"2024-02-17T12:17:24.340784+0000","last_clean":"2024-02-17T12:17:24.340784+0000","last_became_active":"2024-02-17T12:17:06.052947+0000","last_became_peered":"2024-02-17T12:17:06.052947+0000","last_unstale":"2024-02-17T12:17:24.340784+0000","last_undegraded":"2024-02-17T12:17:24.340784+0000","last_fullsized":"2024-02-17T12:17:24.340784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:17:05.004567+0000","last_clean_scrub_stamp":"2024-02-17T12:17:05.004567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:38.086638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":165604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.88700000000000001}]},{"osd":1,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.78600000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.82099999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.93300000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76500000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.71399999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":165058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.79700000000000004}]},{"osd":1,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.753}]},{"osd":2,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.77900000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72299999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.81000000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":168091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.621},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76400000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.81299999999999994}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.93200000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.89800000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.89000000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.871}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":167523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.1779999999999999,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.6399999999999997,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.51300000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.54400000000000004}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.2779999999999996,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.58799999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":999424,"data_stored":754718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.37}]},{"osd":2,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.312},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.443}]},{"osd":4,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.65900000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.67200000000000004}]},{"osd":6,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.623},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70099999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":991232,"data_stored":747707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.379},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.40999999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55200000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.496},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.56699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":158875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.69399999999999995}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.82099999999999995}]},{"osd":2,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.745},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.76000000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.79400000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":158863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.505}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.91100000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.80500000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.75},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.871}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:17:27.792 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T12:17:27.793 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-02-17T12:17:27.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f8854e00640 1 Processor -- start 2024-02-17T12:17:27.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f8854e00640 1 -- start start 2024-02-17T12:17:27.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f8854e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f88500c25a0 0x7f885006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f8854e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f885006db50 0x7f885014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f8854e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8850156270 con 0x7f8850150490 2024-02-17T12:17:27.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f8854e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8850071630 con 0x7f88500c25a0 2024-02-17T12:17:27.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f8854e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8850156550 con 0x7f885006db50 2024-02-17T12:17:27.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f884de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f88500c25a0 0x7f885006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f884de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f88500c25a0 0x7f885006e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56074/0 (socket says 172.21.15.114:56074) 2024-02-17T12:17:27.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f884de00640 1 -- 172.21.15.114:0/3945299883 learned_addr learned my addr 172.21.15.114:0/3945299883 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:27.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f884d400640 1 --2- 172.21.15.114:0/3945299883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f885006db50 0x7f885014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f884de00640 1 -- 172.21.15.114:0/3945299883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f885006db50 msgr2=0x7f885014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:27.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f884de00640 1 --2- 172.21.15.114:0/3945299883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f885006db50 0x7f885014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f884de00640 1 -- 172.21.15.114:0/3945299883 >> v1:172.21.15.116:6789/0 conn(0x7f8850150490 legacy=0x7f8850152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.962+0000 7f884de00640 1 -- 172.21.15.114:0/3945299883 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850156830 con 0x7f88500c25a0 2024-02-17T12:17:27.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f884de00640 1 --2- 172.21.15.114:0/3945299883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500c25a0 0x7f885006e980 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8840009e50 tx=0x7f884001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9500129a1bbf17b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:27.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f884ca00640 1 -- 172.21.15.114:0/3945299883 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400a57c0 con 0x7f88500c25a0 2024-02-17T12:17:27.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f884ca00640 1 -- 172.21.15.114:0/3945299883 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88400a5920 con 0x7f88500c25a0 2024-02-17T12:17:27.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f884ca00640 1 -- 172.21.15.114:0/3945299883 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400a5cb0 con 0x7f88500c25a0 2024-02-17T12:17:27.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f8854e00640 1 -- 172.21.15.114:0/3945299883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500c25a0 msgr2=0x7f885006e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f8854e00640 1 --2- 172.21.15.114:0/3945299883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500c25a0 0x7f885006e980 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8840009e50 tx=0x7f884001c8e0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f8854e00640 1 -- 172.21.15.114:0/3945299883 shutdown_connections 2024-02-17T12:17:27.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f8854e00640 1 --2- 172.21.15.114:0/3945299883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f885006db50 0x7f885014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f8854e00640 1 --2- 172.21.15.114:0/3945299883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500c25a0 0x7f885006e980 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f8854e00640 1 -- 172.21.15.114:0/3945299883 >> 172.21.15.114:0/3945299883 conn(0x7f88500a8490 msgr2=0x7f88500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:27.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f8854e00640 1 -- 172.21.15.114:0/3945299883 shutdown_connections 2024-02-17T12:17:27.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f8854e00640 1 -- 172.21.15.114:0/3945299883 wait complete. 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f8854e00640 1 Processor -- start 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.966+0000 7f8854e00640 1 -- start start 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8854e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f885006db50 0x7f88500c0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8854e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88500c25a0 0x7f88501f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8854e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8850150490 0x7f88501ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8854e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88500c0540 con 0x7f885006db50 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8854e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88501f17c0 con 0x7f8850150490 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8854e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88501f0ac0 con 0x7f88500c25a0 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f885006db50 0x7f88500c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f885006db50 0x7f88500c0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56084/0 (socket says 172.21.15.114:56084) 2024-02-17T12:17:27.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884de00640 1 -- 172.21.15.114:0/1782760916 learned_addr learned my addr 172.21.15.114:0/1782760916 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884d400640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88500c25a0 0x7f88501f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884e800640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8850150490 0x7f88501ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884de00640 1 -- 172.21.15.114:0/1782760916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88500c25a0 msgr2=0x7f88501f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884de00640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88500c25a0 0x7f88501f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884de00640 1 -- 172.21.15.114:0/1782760916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8850150490 msgr2=0x7f88501ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884de00640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8850150490 0x7f88501ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884de00640 1 -- 172.21.15.114:0/1782760916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840009b30 con 0x7f885006db50 2024-02-17T12:17:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f884de00640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f885006db50 0x7f88500c0000 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f884001a510 tx=0x7f8840019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8846000640 1 -- 172.21.15.114:0/1782760916 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400b8670 con 0x7f885006db50 2024-02-17T12:17:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8846000640 1 -- 172.21.15.114:0/1782760916 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88400b87d0 con 0x7f885006db50 2024-02-17T12:17:27.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8846000640 1 -- 172.21.15.114:0/1782760916 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400b8b60 con 0x7f885006db50 2024-02-17T12:17:27.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8854e00640 1 -- 172.21.15.114:0/1782760916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88501411b0 con 0x7f885006db50 2024-02-17T12:17:27.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8854e00640 1 -- 172.21.15.114:0/1782760916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8850140ed0 con 0x7f885006db50 2024-02-17T12:17:27.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8854e00640 1 -- 172.21.15.114:0/1782760916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88501f0920 con 0x7f885006db50 2024-02-17T12:17:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.970+0000 7f8846000640 1 -- 172.21.15.114:0/1782760916 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f88400b8cc0 con 0x7f885006db50 2024-02-17T12:17:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.974+0000 7f8846000640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f882c066e40 0x7f882c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.974+0000 7f8846000640 1 -- 172.21.15.114:0/1782760916 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8840120340 con 0x7f885006db50 2024-02-17T12:17:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.974+0000 7f884d400640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f882c066e40 0x7f882c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.974+0000 7f884d400640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f882c066e40 0x7f882c069300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f885014f760 tx=0x7f8838008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:27.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:27.978+0000 7f8846000640 1 -- 172.21.15.114:0/1782760916 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88501f0920 con 0x7f885006db50 2024-02-17T12:17:28.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.194+0000 7f8854e00640 1 -- 172.21.15.114:0/1782760916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f88501f0920 con 0x7f885006db50 2024-02-17T12:17:28.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.194+0000 7f8846000640 1 -- 172.21.15.114:0/1782760916 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v10) v1 ==== 185+0+142 (secure 0 0 0) 0x7f88501f0920 con 0x7f885006db50 2024-02-17T12:17:28.202 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-02-17T12:17:28.202 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlffPTGhAA6uMply4Nxw6KXsGwVHriZg== 2024-02-17T12:17:28.202 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-02-17T12:17:28.202 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-02-17T12:17:28.203 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-02-17T12:17:28.203 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.1 2024-02-17T12:17:28.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 -- 172.21.15.114:0/1782760916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f882c066e40 msgr2=0x7f882c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f882c066e40 0x7f882c069300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f885014f760 tx=0x7f8838008040 comp rx=0 tx=0).stop 2024-02-17T12:17:28.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 -- 172.21.15.114:0/1782760916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f885006db50 msgr2=0x7f88500c0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f885006db50 0x7f88500c0000 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f884001a510 tx=0x7f8840019680 comp rx=0 tx=0).stop 2024-02-17T12:17:28.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 -- 172.21.15.114:0/1782760916 shutdown_connections 2024-02-17T12:17:28.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8850150490 0x7f88501ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f88500c25a0 0x7f88501f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f882c066e40 0x7f882c069300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 --2- 172.21.15.114:0/1782760916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f885006db50 0x7f88500c0000 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 -- 172.21.15.114:0/1782760916 >> 172.21.15.114:0/1782760916 conn(0x7f88500a8490 msgr2=0x7f8850151920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:28.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 -- 172.21.15.114:0/1782760916 shutdown_connections 2024-02-17T12:17:28.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.198+0000 7f8854e00640 1 -- 172.21.15.114:0/1782760916 wait complete. 2024-02-17T12:17:28.223 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:17:28.223 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:28.233 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:17:28.233 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:28.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:28.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.410+0000 7f339d800640 1 Processor -- start 2024-02-17T12:17:28.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.410+0000 7f339d800640 1 -- start start 2024-02-17T12:17:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f339d800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33980c25a0 0x7f339806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f339d800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3398156270 con 0x7f339806db50 2024-02-17T12:17:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f339d800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3398156550 con 0x7f3398152c50 2024-02-17T12:17:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f339d800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3398071630 con 0x7f33980c25a0 2024-02-17T12:17:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3396000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f339806db50 0x7f339814ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52708/0 (socket says 172.21.15.114:52708) 2024-02-17T12:17:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3396000640 1 -- 172.21.15.114:0/2635028941 learned_addr learned my addr 172.21.15.114:0/2635028941 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:28.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3396a00640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33980c25a0 0x7f339806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243076448 0 0) 0x7f3398156270 con 0x7f339806db50 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337c003530 con 0x7f339806db50 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807307441 0 0) 0x7f3398156550 con 0x7f3398152c50 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3398156270 con 0x7f3398152c50 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1924126896 0 0) 0x7f337c003530 con 0x7f339806db50 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33980c25a0 msgr2=0x7f339806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33980c25a0 0x7f339806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 >> v1:172.21.15.116:6789/0 conn(0x7f3398152c50 legacy=0x7f33981530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398156830 con 0x7f339806db50 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f3384001680 con 0x7f339806db50 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 >> v1:172.21.15.114:6789/0 conn(0x7f339806db50 legacy=0x7f339814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33980c25a0 0x7f337c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f337c0040f0 0x7f337c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 0x7f337c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bbc0 con 0x7f337c004d10 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bd30 con 0x7f337c0040f0 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bef0 con 0x7f33980c25a0 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3397400640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 0x7f337c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3396a00640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33980c25a0 0x7f337c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3396000640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f337c0040f0 0x7f337c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3397400640 1 -- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33980c25a0 msgr2=0x7f337c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3397400640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f33980c25a0 0x7f337c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3397400640 1 -- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f337c0040f0 msgr2=0x7f337c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3397400640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f337c0040f0 0x7f337c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3397400640 1 -- 172.21.15.114:0/2635028941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c003530 con 0x7f337c004d10 2024-02-17T12:17:28.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.414+0000 7f3396000640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f337c0040f0 0x7f337c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f3397400640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 0x7f337c005190 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f33900018d0 tx=0x7f339001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fdcbcbbaa9b8f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900052d0 con 0x7f337c004d10 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33900a7050 con 0x7f337c004d10 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f3395600640 1 -- 172.21.15.114:0/2635028941 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3390003600 con 0x7f337c004d10 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f339d800640 1 -- 172.21.15.114:0/2635028941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 msgr2=0x7f337c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f339d800640 1 --2- 172.21.15.114:0/2635028941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 0x7f337c005190 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f33900018d0 tx=0x7f339001c510 comp rx=0 tx=0).stop 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f3397400640 1 -- 172.21.15.114:0/2635028941 reap_dead start 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f339d800640 1 -- 172.21.15.114:0/2635028941 shutdown_connections 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f339d800640 1 -- 172.21.15.114:0/2635028941 >> 172.21.15.114:0/2635028941 conn(0x7f33980a8490 msgr2=0x7f33980a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f339d800640 1 -- 172.21.15.114:0/2635028941 shutdown_connections 2024-02-17T12:17:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f339d800640 1 -- 172.21.15.114:0/2635028941 wait complete. 2024-02-17T12:17:28.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.418+0000 7f339d800640 1 Processor -- start 2024-02-17T12:17:28.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f339d800640 1 -- start start 2024-02-17T12:17:28.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f339d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 0x7f33981edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f339d800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3398155d00 0x7f3398142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f339d800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3398153f40 0x7f33981543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f339d800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c00e0 con 0x7f337c004d10 2024-02-17T12:17:28.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f339d800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980aaed0 con 0x7f3398155d00 2024-02-17T12:17:28.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f339d800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33981ee0b0 con 0x7f3398153f40 2024-02-17T12:17:28.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3396a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 0x7f33981edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3396a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 0x7f33981edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56112/0 (socket says 172.21.15.114:56112) 2024-02-17T12:17:28.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3396a00640 1 -- 172.21.15.114:0/910340377 learned_addr learned my addr 172.21.15.114:0/910340377 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:28.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3396000640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3398155d00 0x7f3398142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3397400640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3398153f40 0x7f33981543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3396a00640 1 -- 172.21.15.114:0/910340377 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3398153f40 msgr2=0x7f33981543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3396a00640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3398153f40 0x7f33981543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3396a00640 1 -- 172.21.15.114:0/910340377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3398155d00 msgr2=0x7f3398142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3396a00640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3398155d00 0x7f3398142bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3396a00640 1 -- 172.21.15.114:0/910340377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33981430f0 con 0x7f337c004d10 2024-02-17T12:17:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f3396a00640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 0x7f33981edb70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3388011e30 tx=0x7f338800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f338ea00640 1 -- 172.21.15.114:0/910340377 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800e040 con 0x7f337c004d10 2024-02-17T12:17:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f338ea00640 1 -- 172.21.15.114:0/910340377 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338800f040 con 0x7f337c004d10 2024-02-17T12:17:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f339d800640 1 -- 172.21.15.114:0/910340377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33980c0400 con 0x7f337c004d10 2024-02-17T12:17:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f338ea00640 1 -- 172.21.15.114:0/910340377 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388009c00 con 0x7f337c004d10 2024-02-17T12:17:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f339d800640 1 -- 172.21.15.114:0/910340377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33980bfb20 con 0x7f337c004d10 2024-02-17T12:17:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.422+0000 7f339d800640 1 -- 172.21.15.114:0/910340377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3398074840 con 0x7f337c004d10 2024-02-17T12:17:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.426+0000 7f338ea00640 1 -- 172.21.15.114:0/910340377 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3388015850 con 0x7f337c004d10 2024-02-17T12:17:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.426+0000 7f338ea00640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3378066e70 0x7f3378069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.426+0000 7f338ea00640 1 -- 172.21.15.114:0/910340377 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3388085b90 con 0x7f337c004d10 2024-02-17T12:17:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.426+0000 7f3396000640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3378066e70 0x7f3378069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.426+0000 7f3396000640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3378066e70 0x7f3378069330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3384001210 tx=0x7f3384009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.430+0000 7f338ea00640 1 -- 172.21.15.114:0/910340377 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3388052610 con 0x7f337c004d10 2024-02-17T12:17:28.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.582+0000 7f339d800640 1 -- 172.21.15.114:0/910340377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3398150440 con 0x7f337c004d10 2024-02-17T12:17:28.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f338ea00640 1 -- 172.21.15.114:0/910340377 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20407 (secure 0 0 0) 0x7f3388055cd0 con 0x7f337c004d10 2024-02-17T12:17:28.592 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:28.592 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:24.325322+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:28.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 -- 172.21.15.114:0/910340377 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3378066e70 msgr2=0x7f3378069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3378066e70 0x7f3378069330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3384001210 tx=0x7f3384009040 comp rx=0 tx=0).stop 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 -- 172.21.15.114:0/910340377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 msgr2=0x7f33981edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 0x7f33981edb70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3388011e30 tx=0x7f338800f580 comp rx=0 tx=0).stop 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 -- 172.21.15.114:0/910340377 shutdown_connections 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3398153f40 0x7f33981543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3398155d00 0x7f3398142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3378066e70 0x7f3378069330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 --2- 172.21.15.114:0/910340377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c004d10 0x7f33981edb70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 -- 172.21.15.114:0/910340377 >> 172.21.15.114:0/910340377 conn(0x7f33980a8490 msgr2=0x7f33980c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 -- 172.21.15.114:0/910340377 shutdown_connections 2024-02-17T12:17:28.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.586+0000 7f339d800640 1 -- 172.21.15.114:0/910340377 wait complete. 2024-02-17T12:17:28.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:17:03.897758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:17:04.389290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:17:20.859567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:17:21.688611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:17:28.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:17:28.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f183d200640 1 Processor -- start 2024-02-17T12:17:28.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f183d200640 1 -- start start 2024-02-17T12:17:28.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f183d200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f183806db50 0x7f183814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f183d200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1838150490 0x7f1838152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f183d200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1838156270 con 0x7f18380c25a0 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f183d200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183806f090 con 0x7f1838150490 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f183d200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1838071630 con 0x7f183806db50 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f1835e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f18380c25a0 0x7f183806e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52716/0 (socket says 172.21.15.114:52716) 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f1835e00640 1 -- 172.21.15.114:0/4200556963 learned_addr learned my addr 172.21.15.114:0/4200556963 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f1836800640 1 --2- 172.21.15.114:0/4200556963 >> v2:172.21.15.114:3300/0 conn(0x7f1838150490 0x7f1838152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f1835400640 1 --2- 172.21.15.114:0/4200556963 >> v2:172.21.15.116:3300/0 conn(0x7f183806db50 0x7f183814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f1834a00640 1 -- 172.21.15.114:0/4200556963 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474356839 0 0) 0x7f1838156270 con 0x7f18380c25a0 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f1834a00640 1 -- 172.21.15.114:0/4200556963 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f181c003530 con 0x7f18380c25a0 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f1836800640 1 -- 172.21.15.114:0/4200556963 >> v2:172.21.15.116:3300/0 conn(0x7f183806db50 msgr2=0x7f183814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:28.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f1836800640 1 --2- 172.21.15.114:0/4200556963 >> v2:172.21.15.116:3300/0 conn(0x7f183806db50 0x7f183814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f1836800640 1 -- 172.21.15.114:0/4200556963 >> v1:172.21.15.114:6789/0 conn(0x7f18380c25a0 legacy=0x7f183806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.746+0000 7f1836800640 1 -- 172.21.15.114:0/4200556963 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1838156550 con 0x7f1838150490 2024-02-17T12:17:28.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f1836800640 1 --2- 172.21.15.114:0/4200556963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 0x7f1838152c50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f183806e260 tx=0x7f183001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ed492a2308f277 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:28.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f1834a00640 1 -- 172.21.15.114:0/4200556963 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18381539a0 con 0x7f1838150490 2024-02-17T12:17:28.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f1834a00640 1 -- 172.21.15.114:0/4200556963 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18300a57c0 con 0x7f1838150490 2024-02-17T12:17:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f1834a00640 1 -- 172.21.15.114:0/4200556963 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300a5b50 con 0x7f1838150490 2024-02-17T12:17:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f183d200640 1 -- 172.21.15.114:0/4200556963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 msgr2=0x7f1838152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f183d200640 1 --2- 172.21.15.114:0/4200556963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 0x7f1838152c50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f183806e260 tx=0x7f183001c810 comp rx=0 tx=0).stop 2024-02-17T12:17:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f183d200640 1 -- 172.21.15.114:0/4200556963 shutdown_connections 2024-02-17T12:17:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f183d200640 1 --2- 172.21.15.114:0/4200556963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 0x7f1838152c50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f183d200640 1 --2- 172.21.15.114:0/4200556963 >> v2:172.21.15.116:3300/0 conn(0x7f183806db50 0x7f183814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f183d200640 1 -- 172.21.15.114:0/4200556963 >> 172.21.15.114:0/4200556963 conn(0x7f18380a8490 msgr2=0x7f18380a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:28.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f183d200640 1 -- 172.21.15.114:0/4200556963 shutdown_connections 2024-02-17T12:17:28.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f183d200640 1 -- 172.21.15.114:0/4200556963 wait complete. 2024-02-17T12:17:28.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.750+0000 7f183d200640 1 Processor -- start 2024-02-17T12:17:28.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f183d200640 1 -- start start 2024-02-17T12:17:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f183d200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183806db50 0x7f18381461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f183d200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18380c25a0 0x7f18381eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f183d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 0x7f18381eb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f183d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183814fac0 con 0x7f1838150490 2024-02-17T12:17:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f183d200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18381429e0 con 0x7f183806db50 2024-02-17T12:17:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f183d200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1838137800 con 0x7f18380c25a0 2024-02-17T12:17:28.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1836800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 0x7f18381eb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1836800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 0x7f18381eb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56122/0 (socket says 172.21.15.114:56122) 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1836800640 1 -- 172.21.15.114:0/294136565 learned_addr learned my addr 172.21.15.114:0/294136565 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1835400640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18380c25a0 0x7f18381eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1835e00640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183806db50 0x7f18381461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1836800640 1 -- 172.21.15.114:0/294136565 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18380c25a0 msgr2=0x7f18381eed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1836800640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18380c25a0 0x7f18381eed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1836800640 1 -- 172.21.15.114:0/294136565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183806db50 msgr2=0x7f18381461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1836800640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183806db50 0x7f18381461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1836800640 1 -- 172.21.15.114:0/294136565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830009a70 con 0x7f1838150490 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1835e00640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183806db50 0x7f18381461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f1836800640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 0x7f18381eb540 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1830019420 tx=0x7f18300195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f182e000640 1 -- 172.21.15.114:0/294136565 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300ad650 con 0x7f1838150490 2024-02-17T12:17:28.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f182e000640 1 -- 172.21.15.114:0/294136565 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18300ad7b0 con 0x7f1838150490 2024-02-17T12:17:28.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f182e000640 1 -- 172.21.15.114:0/294136565 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300adb60 con 0x7f1838150490 2024-02-17T12:17:28.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f183d200640 1 -- 172.21.15.114:0/294136565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18381eb0b0 con 0x7f1838150490 2024-02-17T12:17:28.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f183d200640 1 -- 172.21.15.114:0/294136565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1838142140 con 0x7f1838150490 2024-02-17T12:17:28.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.754+0000 7f183d200640 1 -- 172.21.15.114:0/294136565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18381eb240 con 0x7f1838150490 2024-02-17T12:17:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.758+0000 7f182e000640 1 -- 172.21.15.114:0/294136565 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f18300b4070 con 0x7f1838150490 2024-02-17T12:17:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.758+0000 7f182e000640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1818066e40 0x7f1818069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.758+0000 7f182e000640 1 -- 172.21.15.114:0/294136565 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f183011fb90 con 0x7f1838150490 2024-02-17T12:17:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.758+0000 7f1835e00640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1818066e40 0x7f1818069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:28.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.758+0000 7f1835e00640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1818066e40 0x7f1818069300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1828005890 tx=0x7f1828009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:28.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.762+0000 7f182e000640 1 -- 172.21.15.114:0/294136565 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f18300ec6c0 con 0x7f1838150490 2024-02-17T12:17:28.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 -- 172.21.15.114:0/294136565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1838153a60 con 0x7f1838150490 2024-02-17T12:17:28.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f182e000640 1 -- 172.21.15.114:0/294136565 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1838153a60 con 0x7f1838150490 2024-02-17T12:17:28.920 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:17:28.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 -- 172.21.15.114:0/294136565 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1818066e40 msgr2=0x7f1818069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1818066e40 0x7f1818069300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1828005890 tx=0x7f1828009040 comp rx=0 tx=0).stop 2024-02-17T12:17:28.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 -- 172.21.15.114:0/294136565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 msgr2=0x7f18381eb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:28.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 0x7f18381eb540 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1830019420 tx=0x7f18300195b0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 -- 172.21.15.114:0/294136565 shutdown_connections 2024-02-17T12:17:28.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1818066e40 0x7f1818069300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1838150490 0x7f18381eb540 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f18380c25a0 0x7f18381eed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 --2- 172.21.15.114:0/294136565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f183806db50 0x7f18381461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:28.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 -- 172.21.15.114:0/294136565 >> 172.21.15.114:0/294136565 conn(0x7f18380a8490 msgr2=0x7f18380c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:28.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 -- 172.21.15.114:0/294136565 shutdown_connections 2024-02-17T12:17:28.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:28.914+0000 7f183d200640 1 -- 172.21.15.114:0/294136565 wait complete. 2024-02-17T12:17:28.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:17:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b17c00640 1 Processor -- start 2024-02-17T12:17:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b17c00640 1 -- start start 2024-02-17T12:17:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b17c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5b100c6460 0x7f5b1006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b17c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b10155dd0 con 0x7f5b10152540 2024-02-17T12:17:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b17c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b101588c0 con 0x7f5b10154e30 2024-02-17T12:17:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b17c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b10155810 con 0x7f5b100c6460 2024-02-17T12:17:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b15200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5b10152540 0x7f5b10158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52724/0 (socket says 172.21.15.114:52724) 2024-02-17T12:17:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b15200640 1 -- 172.21.15.114:0/433858663 learned_addr learned my addr 172.21.15.114:0/433858663 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:29.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b0fe00640 1 --2- 172.21.15.114:0/433858663 >> v2:172.21.15.116:3300/0 conn(0x7f5b100c6460 0x7f5b1006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b0f400640 1 -- 172.21.15.114:0/433858663 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455220718 0 0) 0x7f5b10155dd0 con 0x7f5b10152540 2024-02-17T12:17:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b0f400640 1 -- 172.21.15.114:0/433858663 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af4003530 con 0x7f5b10152540 2024-02-17T12:17:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b0fe00640 1 -- 172.21.15.114:0/433858663 >> v1:172.21.15.116:6789/0 conn(0x7f5b10154e30 legacy=0x7f5b100aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b0f400640 1 -- 172.21.15.114:0/433858663 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930670500 0 0) 0x7f5b101588c0 con 0x7f5b10154e30 2024-02-17T12:17:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b0fe00640 1 -- 172.21.15.114:0/433858663 >> v1:172.21.15.114:6789/0 conn(0x7f5b10152540 legacy=0x7f5b10158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.073+0000 7f5b0fe00640 1 -- 172.21.15.114:0/433858663 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10155af0 con 0x7f5b100c6460 2024-02-17T12:17:29.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b0fe00640 1 --2- 172.21.15.114:0/433858663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b100c6460 0x7f5b1006ff80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0097c0 tx=0x7f5afc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72ad88f2733f6b79 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:29.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b0f400640 1 -- 172.21.15.114:0/433858663 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0ab600 con 0x7f5b100c6460 2024-02-17T12:17:29.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b0f400640 1 -- 172.21.15.114:0/433858663 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0a7050 con 0x7f5b100c6460 2024-02-17T12:17:29.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b0f400640 1 -- 172.21.15.114:0/433858663 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0ab980 con 0x7f5b100c6460 2024-02-17T12:17:29.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b17c00640 1 -- 172.21.15.114:0/433858663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b100c6460 msgr2=0x7f5b1006ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b17c00640 1 --2- 172.21.15.114:0/433858663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b100c6460 0x7f5b1006ff80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0097c0 tx=0x7f5afc01c380 comp rx=0 tx=0).stop 2024-02-17T12:17:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b17c00640 1 -- 172.21.15.114:0/433858663 shutdown_connections 2024-02-17T12:17:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b17c00640 1 --2- 172.21.15.114:0/433858663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b100c6460 0x7f5b1006ff80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b17c00640 1 -- 172.21.15.114:0/433858663 >> 172.21.15.114:0/433858663 conn(0x7f5b100c4f20 msgr2=0x7f5b100c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b17c00640 1 -- 172.21.15.114:0/433858663 shutdown_connections 2024-02-17T12:17:29.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.077+0000 7f5b17c00640 1 -- 172.21.15.114:0/433858663 wait complete. 2024-02-17T12:17:29.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b17c00640 1 Processor -- start 2024-02-17T12:17:29.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b17c00640 1 -- start start 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b17c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b100c6460 0x7f5b1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b17c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b10152540 0x7f5b10156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b17c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b10154e30 0x7f5b10156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b17c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1006c490 con 0x7f5b10152540 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b17c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1014c0e0 con 0x7f5b100c6460 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b17c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1014b280 con 0x7f5b10154e30 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b10152540 0x7f5b10156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b10152540 0x7f5b10156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56124/0 (socket says 172.21.15.114:56124) 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0fe00640 1 -- 172.21.15.114:0/832951436 learned_addr learned my addr 172.21.15.114:0/832951436 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b15200640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b100c6460 0x7f5b1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0fe00640 1 -- 172.21.15.114:0/832951436 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b10154e30 msgr2=0x7f5b10156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b15c00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b10154e30 0x7f5b10156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0fe00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b10154e30 0x7f5b10156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0fe00640 1 -- 172.21.15.114:0/832951436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b100c6460 msgr2=0x7f5b1006d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0fe00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b100c6460 0x7f5b1006d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0fe00640 1 -- 172.21.15.114:0/832951436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc009420 con 0x7f5b10152540 2024-02-17T12:17:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b15200640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b100c6460 0x7f5b1006d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b15c00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b10154e30 0x7f5b10156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:29.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0fe00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b10152540 0x7f5b10156500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0ae040 tx=0x7f5afc01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:29.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0cc00640 1 -- 172.21.15.114:0/832951436 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0abda0 con 0x7f5b10152540 2024-02-17T12:17:29.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0cc00640 1 -- 172.21.15.114:0/832951436 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc004020 con 0x7f5b10152540 2024-02-17T12:17:29.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b17c00640 1 -- 172.21.15.114:0/832951436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1014b560 con 0x7f5b10152540 2024-02-17T12:17:29.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b0cc00640 1 -- 172.21.15.114:0/832951436 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc004390 con 0x7f5b10152540 2024-02-17T12:17:29.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.081+0000 7f5b17c00640 1 -- 172.21.15.114:0/832951436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1014bb20 con 0x7f5b10152540 2024-02-17T12:17:29.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.085+0000 7f5b17c00640 1 -- 172.21.15.114:0/832951436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b100c4d90 con 0x7f5b10152540 2024-02-17T12:17:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.085+0000 7f5b0cc00640 1 -- 172.21.15.114:0/832951436 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f5afc003620 con 0x7f5b10152540 2024-02-17T12:17:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.085+0000 7f5b0cc00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5af0066e40 0x7f5af0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.085+0000 7f5b0cc00640 1 -- 172.21.15.114:0/832951436 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5afc11f410 con 0x7f5b10152540 2024-02-17T12:17:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.085+0000 7f5b15200640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5af0066e40 0x7f5af0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.085+0000 7f5b15200640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5af0066e40 0x7f5af0069300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5b00005890 tx=0x7f5b00009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:29.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.089+0000 7f5b0cc00640 1 -- 172.21.15.114:0/832951436 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5afc0ebe90 con 0x7f5b10152540 2024-02-17T12:17:29.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 -- 172.21.15.114:0/832951436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b1014d6b0 con 0x7f5b10152540 2024-02-17T12:17:29.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b0cc00640 1 -- 172.21.15.114:0/832951436 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5afc0ef550 con 0x7f5b10152540 2024-02-17T12:17:29.253 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:17:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 -- 172.21.15.114:0/832951436 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5af0066e40 msgr2=0x7f5af0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5af0066e40 0x7f5af0069300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5b00005890 tx=0x7f5b00009040 comp rx=0 tx=0).stop 2024-02-17T12:17:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 -- 172.21.15.114:0/832951436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b10152540 msgr2=0x7f5b10156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b10152540 0x7f5b10156500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0ae040 tx=0x7f5afc01abc0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 -- 172.21.15.114:0/832951436 shutdown_connections 2024-02-17T12:17:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b10154e30 0x7f5b10156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5af0066e40 0x7f5af0069300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b10152540 0x7f5b10156500 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 --2- 172.21.15.114:0/832951436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b100c6460 0x7f5b1006d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 -- 172.21.15.114:0/832951436 >> 172.21.15.114:0/832951436 conn(0x7f5b100c4f20 msgr2=0x7f5b101544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:29.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 -- 172.21.15.114:0/832951436 shutdown_connections 2024-02-17T12:17:29.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.245+0000 7f5b17c00640 1 -- 172.21.15.114:0/832951436 wait complete. 2024-02-17T12:17:29.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:17:29.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f803ac00640 1 Processor -- start 2024-02-17T12:17:29.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f803ac00640 1 -- start start 2024-02-17T12:17:29.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f803ac00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f803414f110 0x7f80340c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f803ac00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f80340c1eb0 0x7f803415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f803ac00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80340a9420 con 0x7f80340c2580 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f803ac00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803414f4f0 con 0x7f803414f110 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f803ac00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80340aae80 con 0x7f80340c1eb0 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f8033e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f803414f110 0x7f80340c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f8033400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f80340c2580 0x7f80340aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52726/0 (socket says 172.21.15.114:52726) 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f8033400640 1 -- 172.21.15.114:0/1494998448 learned_addr learned my addr 172.21.15.114:0/1494998448 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f8038c00640 1 --2- 172.21.15.114:0/1494998448 >> v2:172.21.15.116:3300/0 conn(0x7f80340c1eb0 0x7f803415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f8032a00640 1 -- 172.21.15.114:0/1494998448 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044510299 0 0) 0x7f80340a9420 con 0x7f80340c2580 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f8032a00640 1 -- 172.21.15.114:0/1494998448 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8018003530 con 0x7f80340c2580 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f8033e00640 1 -- 172.21.15.114:0/1494998448 >> v2:172.21.15.116:3300/0 conn(0x7f80340c1eb0 msgr2=0x7f803415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f8033e00640 1 --2- 172.21.15.114:0/1494998448 >> v2:172.21.15.116:3300/0 conn(0x7f80340c1eb0 0x7f803415c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f8033e00640 1 -- 172.21.15.114:0/1494998448 >> v1:172.21.15.114:6789/0 conn(0x7f80340c2580 legacy=0x7f80340aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.405+0000 7f8033e00640 1 -- 172.21.15.114:0/1494998448 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8034152850 con 0x7f803414f110 2024-02-17T12:17:29.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f8033e00640 1 --2- 172.21.15.114:0/1494998448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f803414f110 0x7f80340c65a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f803406ceb0 tx=0x7f802401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44876a2d1a7b04e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:29.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f8032a00640 1 -- 172.21.15.114:0/1494998448 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80240a5930 con 0x7f803414f110 2024-02-17T12:17:29.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f8032a00640 1 -- 172.21.15.114:0/1494998448 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80240a5a90 con 0x7f803414f110 2024-02-17T12:17:29.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f8032a00640 1 -- 172.21.15.114:0/1494998448 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80240a5e20 con 0x7f803414f110 2024-02-17T12:17:29.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f803ac00640 1 -- 172.21.15.114:0/1494998448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f803414f110 msgr2=0x7f80340c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f803ac00640 1 --2- 172.21.15.114:0/1494998448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f803414f110 0x7f80340c65a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f803406ceb0 tx=0x7f802401c870 comp rx=0 tx=0).stop 2024-02-17T12:17:29.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f803ac00640 1 -- 172.21.15.114:0/1494998448 shutdown_connections 2024-02-17T12:17:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f803ac00640 1 --2- 172.21.15.114:0/1494998448 >> v2:172.21.15.116:3300/0 conn(0x7f80340c1eb0 0x7f803415c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f803ac00640 1 --2- 172.21.15.114:0/1494998448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f803414f110 0x7f80340c65a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f803ac00640 1 -- 172.21.15.114:0/1494998448 >> 172.21.15.114:0/1494998448 conn(0x7f80340a8490 msgr2=0x7f80340a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f803ac00640 1 -- 172.21.15.114:0/1494998448 shutdown_connections 2024-02-17T12:17:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.409+0000 7f803ac00640 1 -- 172.21.15.114:0/1494998448 wait complete. 2024-02-17T12:17:29.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f803ac00640 1 Processor -- start 2024-02-17T12:17:29.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f803ac00640 1 -- start start 2024-02-17T12:17:29.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f803ac00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f80340c1eb0 0x7f80340bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f803ac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80340c2580 0x7f80341481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f803ac00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f803414f110 0x7f8034148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f803ac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80340c4cf0 con 0x7f80340c2580 2024-02-17T12:17:29.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f803ac00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80340c4f70 con 0x7f803414f110 2024-02-17T12:17:29.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f803ac00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8034150290 con 0x7f80340c1eb0 2024-02-17T12:17:29.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80340c2580 0x7f80341481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80340c2580 0x7f80341481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56138/0 (socket says 172.21.15.114:56138) 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033400640 1 -- 172.21.15.114:0/1011258618 learned_addr learned my addr 172.21.15.114:0/1011258618 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033400640 1 -- 172.21.15.114:0/1011258618 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f80340c1eb0 msgr2=0x7f80340bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033e00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f80340c1eb0 0x7f80340bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8038c00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f803414f110 0x7f8034148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033400640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f80340c1eb0 0x7f80340bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033400640 1 -- 172.21.15.114:0/1011258618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f803414f110 msgr2=0x7f8034148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033400640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f803414f110 0x7f8034148730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033400640 1 -- 172.21.15.114:0/1011258618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024009a70 con 0x7f80340c2580 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8038c00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f803414f110 0x7f8034148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033e00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f80340c1eb0 0x7f80340bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f8033400640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80340c2580 0x7f80341481f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c3c0 tx=0x7f801c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f802be00640 1 -- 172.21.15.114:0/1011258618 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c005cf0 con 0x7f80340c2580 2024-02-17T12:17:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f802be00640 1 -- 172.21.15.114:0/1011258618 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c005e70 con 0x7f80340c2580 2024-02-17T12:17:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f803ac00640 1 -- 172.21.15.114:0/1011258618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80340c4a10 con 0x7f80340c2580 2024-02-17T12:17:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f802be00640 1 -- 172.21.15.114:0/1011258618 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0072f0 con 0x7f80340c2580 2024-02-17T12:17:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.413+0000 7f803ac00640 1 -- 172.21.15.114:0/1011258618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803414ff20 con 0x7f80340c2580 2024-02-17T12:17:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.417+0000 7f803ac00640 1 -- 172.21.15.114:0/1011258618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803414faa0 con 0x7f80340c2580 2024-02-17T12:17:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.417+0000 7f802be00640 1 -- 172.21.15.114:0/1011258618 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f801c007450 con 0x7f80340c2580 2024-02-17T12:17:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.417+0000 7f802be00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8010066e70 0x7f8010069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.417+0000 7f802be00640 1 -- 172.21.15.114:0/1011258618 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f801c084310 con 0x7f80340c2580 2024-02-17T12:17:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.417+0000 7f8033e00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8010066e70 0x7f8010069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.417+0000 7f8033e00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8010066e70 0x7f8010069330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f80240af000 tx=0x7f80240a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.421+0000 7f802be00640 1 -- 172.21.15.114:0/1011258618 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f803414faa0 con 0x7f80340c2580 2024-02-17T12:17:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.573+0000 7f803ac00640 1 -- 172.21.15.114:0/1011258618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f803414faa0 con 0x7f80340c2580 2024-02-17T12:17:29.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.573+0000 7f802be00640 1 -- 172.21.15.114:0/1011258618 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f803414faa0 con 0x7f80340c2580 2024-02-17T12:17:29.583 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:17:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 -- 172.21.15.114:0/1011258618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8010066e70 msgr2=0x7f8010069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8010066e70 0x7f8010069330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f80240af000 tx=0x7f80240a7070 comp rx=0 tx=0).stop 2024-02-17T12:17:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 -- 172.21.15.114:0/1011258618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80340c2580 msgr2=0x7f80341481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80340c2580 0x7f80341481f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c3c0 tx=0x7f801c00c880 comp rx=0 tx=0).stop 2024-02-17T12:17:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 -- 172.21.15.114:0/1011258618 shutdown_connections 2024-02-17T12:17:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f803414f110 0x7f8034148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8010066e70 0x7f8010069330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80340c2580 0x7f80341481f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 --2- 172.21.15.114:0/1011258618 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f80340c1eb0 0x7f80340bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 -- 172.21.15.114:0/1011258618 >> 172.21.15.114:0/1011258618 conn(0x7f80340a8490 msgr2=0x7f803413fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:29.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 -- 172.21.15.114:0/1011258618 shutdown_connections 2024-02-17T12:17:29.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.577+0000 7f803ac00640 1 -- 172.21.15.114:0/1011258618 wait complete. 2024-02-17T12:17:29.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:17:29.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.733+0000 7f996da00640 1 Processor -- start 2024-02-17T12:17:29.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.733+0000 7f996da00640 1 -- start start 2024-02-17T12:17:29.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.733+0000 7f996da00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99680c3760 0x7f9968155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.733+0000 7f996da00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 0x7f9968155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.733+0000 7f996da00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99680c5380 con 0x7f99680c66c0 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.733+0000 7f996da00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99680c4b10 con 0x7f99680c3760 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.733+0000 7f996da00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680c2ca0 con 0x7f9968070b50 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9967e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99680c3760 0x7f9968155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9967e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99680c3760 0x7f9968155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56144/0 (socket says 172.21.15.114:56144) 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9967e00640 1 -- 172.21.15.114:0/246923380 learned_addr learned my addr 172.21.15.114:0/246923380 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f996d000640 1 --2- 172.21.15.114:0/246923380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 0x7f9968155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9967e00640 1 -- 172.21.15.114:0/246923380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 msgr2=0x7f9968155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9967e00640 1 --2- 172.21.15.114:0/246923380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 0x7f9968155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9967e00640 1 -- 172.21.15.114:0/246923380 >> v1:172.21.15.116:6789/0 conn(0x7f99680c66c0 legacy=0x7f9968158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9967e00640 1 -- 172.21.15.114:0/246923380 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680c2f80 con 0x7f99680c3760 2024-02-17T12:17:29.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f996d000640 1 --2- 172.21.15.114:0/246923380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 0x7f9968155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:29.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9967e00640 1 --2- 172.21.15.114:0/246923380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99680c3760 0x7f9968155670 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9958009870 tx=0x7f995801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1266381b20425d54 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:29.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9966a00640 1 -- 172.21.15.114:0/246923380 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580ab640 con 0x7f99680c3760 2024-02-17T12:17:29.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9966a00640 1 -- 172.21.15.114:0/246923380 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99580a7070 con 0x7f99680c3760 2024-02-17T12:17:29.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.737+0000 7f9966a00640 1 -- 172.21.15.114:0/246923380 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580ab9c0 con 0x7f99680c3760 2024-02-17T12:17:29.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 -- 172.21.15.114:0/246923380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99680c3760 msgr2=0x7f9968155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 --2- 172.21.15.114:0/246923380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99680c3760 0x7f9968155670 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9958009870 tx=0x7f995801c440 comp rx=0 tx=0).stop 2024-02-17T12:17:29.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 -- 172.21.15.114:0/246923380 shutdown_connections 2024-02-17T12:17:29.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 --2- 172.21.15.114:0/246923380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 0x7f9968155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 --2- 172.21.15.114:0/246923380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99680c3760 0x7f9968155670 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 -- 172.21.15.114:0/246923380 >> 172.21.15.114:0/246923380 conn(0x7f99680a9f70 msgr2=0x7f99680aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:29.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 -- 172.21.15.114:0/246923380 shutdown_connections 2024-02-17T12:17:29.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 -- 172.21.15.114:0/246923380 wait complete. 2024-02-17T12:17:29.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 Processor -- start 2024-02-17T12:17:29.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 -- start start 2024-02-17T12:17:29.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 0x7f996806cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99680c3760 0x7f99680ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99680c66c0 0x7f99680ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9968153410 con 0x7f99680c3760 2024-02-17T12:17:29.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680ad2f0 con 0x7f99680c66c0 2024-02-17T12:17:29.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996da00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680ac9d0 con 0x7f9968070b50 2024-02-17T12:17:29.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f9967400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99680c3760 0x7f99680ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f9967e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 0x7f996806cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f9967e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 0x7f996806cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:55574/0 (socket says 172.21.15.114:55574) 2024-02-17T12:17:29.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f9967e00640 1 -- 172.21.15.114:0/2121411249 learned_addr learned my addr 172.21.15.114:0/2121411249 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:29.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f996d000640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99680c66c0 0x7f99680ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f9967400640 1 -- 172.21.15.114:0/2121411249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 msgr2=0x7f996806cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f9967400640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 0x7f996806cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f9967400640 1 -- 172.21.15.114:0/2121411249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99680c66c0 msgr2=0x7f99680ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f9967400640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99680c66c0 0x7f99680ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.741+0000 7f9967400640 1 -- 172.21.15.114:0/2121411249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99580094d0 con 0x7f99680c3760 2024-02-17T12:17:29.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f9967400640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99680c3760 0x7f99680ab000 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f995000c3c0 tx=0x7f995000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:29.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f995fe00640 1 -- 172.21.15.114:0/2121411249 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99500052d0 con 0x7f99680c3760 2024-02-17T12:17:29.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f995fe00640 1 -- 172.21.15.114:0/2121411249 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950005430 con 0x7f99680c3760 2024-02-17T12:17:29.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f995fe00640 1 -- 172.21.15.114:0/2121411249 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950007260 con 0x7f99680c3760 2024-02-17T12:17:29.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f996da00640 1 -- 172.21.15.114:0/2121411249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99680acc70 con 0x7f99680c3760 2024-02-17T12:17:29.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f996da00640 1 -- 172.21.15.114:0/2121411249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9968152ef0 con 0x7f99680c3760 2024-02-17T12:17:29.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f996da00640 1 -- 172.21.15.114:0/2121411249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9968153110 con 0x7f99680c3760 2024-02-17T12:17:29.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f995fe00640 1 -- 172.21.15.114:0/2121411249 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f99500073c0 con 0x7f99680c3760 2024-02-17T12:17:29.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f995fe00640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9944066e40 0x7f9944069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:29.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f995fe00640 1 -- 172.21.15.114:0/2121411249 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9950083f40 con 0x7f99680c3760 2024-02-17T12:17:29.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.745+0000 7f9967e00640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9944066e40 0x7f9944069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:29.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.749+0000 7f9967e00640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9944066e40 0x7f9944069300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9958009870 tx=0x7f99580b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:29.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.749+0000 7f995fe00640 1 -- 172.21.15.114:0/2121411249 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9950050a70 con 0x7f99680c3760 2024-02-17T12:17:29.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.901+0000 7f996da00640 1 -- 172.21.15.114:0/2121411249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f996804eef0 con 0x7f99680c3760 2024-02-17T12:17:29.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.901+0000 7f995fe00640 1 -- 172.21.15.114:0/2121411249 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9950054130 con 0x7f99680c3760 2024-02-17T12:17:29.911 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:17:29.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 -- 172.21.15.114:0/2121411249 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9944066e40 msgr2=0x7f9944069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9944066e40 0x7f9944069300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9958009870 tx=0x7f99580b6040 comp rx=0 tx=0).stop 2024-02-17T12:17:29.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 -- 172.21.15.114:0/2121411249 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99680c3760 msgr2=0x7f99680ab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:29.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99680c3760 0x7f99680ab000 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f995000c3c0 tx=0x7f995000c880 comp rx=0 tx=0).stop 2024-02-17T12:17:29.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 -- 172.21.15.114:0/2121411249 shutdown_connections 2024-02-17T12:17:29.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99680c66c0 0x7f99680ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9944066e40 0x7f9944069300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99680c3760 0x7f99680ab000 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 --2- 172.21.15.114:0/2121411249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9968070b50 0x7f996806cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:29.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 -- 172.21.15.114:0/2121411249 >> 172.21.15.114:0/2121411249 conn(0x7f99680a9f70 msgr2=0x7f9968155440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:29.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 -- 172.21.15.114:0/2121411249 shutdown_connections 2024-02-17T12:17:29.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:29.905+0000 7f996da00640 1 -- 172.21.15.114:0/2121411249 wait complete. 2024-02-17T12:17:29.931 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:17:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c92200640 1 Processor -- start 2024-02-17T12:17:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c92200640 1 -- start start 2024-02-17T12:17:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c92200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c8c0c2c80 0x7f8c8c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c92200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8c1504d0 con 0x7f8c8c1500f0 2024-02-17T12:17:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c92200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8c0c3690 con 0x7f8c8c152a20 2024-02-17T12:17:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c92200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c8c0c30e0 con 0x7f8c8c0c2c80 2024-02-17T12:17:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c90e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8c8c1500f0 0x7f8c8c0c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52738/0 (socket says 172.21.15.114:52738) 2024-02-17T12:17:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c90e00640 1 -- 172.21.15.114:0/714224197 learned_addr learned my addr 172.21.15.114:0/714224197 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c83e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c8c0c2c80 0x7f8c8c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c8be00640 1 -- 172.21.15.114:0/714224197 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760083859 0 0) 0x7f8c8c1504d0 con 0x7f8c8c1500f0 2024-02-17T12:17:30.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c8be00640 1 -- 172.21.15.114:0/714224197 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c70003530 con 0x7f8c8c1500f0 2024-02-17T12:17:30.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c83e00640 1 -- 172.21.15.114:0/714224197 >> v1:172.21.15.116:6789/0 conn(0x7f8c8c152a20 legacy=0x7f8c8c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c83e00640 1 -- 172.21.15.114:0/714224197 >> v1:172.21.15.114:6789/0 conn(0x7f8c8c1500f0 legacy=0x7f8c8c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.065+0000 7f8c83e00640 1 -- 172.21.15.114:0/714224197 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c0c3f30 con 0x7f8c8c0c2c80 2024-02-17T12:17:30.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c83e00640 1 --2- 172.21.15.114:0/714224197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c0c2c80 0x7f8c8c1569a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8c740097c0 tx=0x7f8c7401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1585f04bc31818 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c8be00640 1 -- 172.21.15.114:0/714224197 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740a4ea0 con 0x7f8c8c0c2c80 2024-02-17T12:17:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c8be00640 1 -- 172.21.15.114:0/714224197 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c740a7050 con 0x7f8c8c0c2c80 2024-02-17T12:17:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c8be00640 1 -- 172.21.15.114:0/714224197 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740ab820 con 0x7f8c8c0c2c80 2024-02-17T12:17:30.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c92200640 1 -- 172.21.15.114:0/714224197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c0c2c80 msgr2=0x7f8c8c1569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c92200640 1 --2- 172.21.15.114:0/714224197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c0c2c80 0x7f8c8c1569a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8c740097c0 tx=0x7f8c7401c410 comp rx=0 tx=0).stop 2024-02-17T12:17:30.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c92200640 1 -- 172.21.15.114:0/714224197 shutdown_connections 2024-02-17T12:17:30.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c92200640 1 --2- 172.21.15.114:0/714224197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c0c2c80 0x7f8c8c1569a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c92200640 1 -- 172.21.15.114:0/714224197 >> 172.21.15.114:0/714224197 conn(0x7f8c8c066960 msgr2=0x7f8c8c066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:30.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c92200640 1 -- 172.21.15.114:0/714224197 shutdown_connections 2024-02-17T12:17:30.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.069+0000 7f8c92200640 1 -- 172.21.15.114:0/714224197 wait complete. 2024-02-17T12:17:30.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 Processor -- start 2024-02-17T12:17:30.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 -- start start 2024-02-17T12:17:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c8c0c2c80 0x7f8c8c1f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c8c1500f0 0x7f8c8c152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c152a20 0x7f8c8c0c1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c14a1c0 con 0x7f8c8c152a20 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c1ed7b0 con 0x7f8c8c0c2c80 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c1edce0 con 0x7f8c8c1500f0 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c91800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c152a20 0x7f8c8c0c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c91800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c152a20 0x7f8c8c0c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56162/0 (socket says 172.21.15.114:56162) 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c91800640 1 -- 172.21.15.114:0/2634657319 learned_addr learned my addr 172.21.15.114:0/2634657319 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c90e00640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c8c0c2c80 0x7f8c8c1f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c83e00640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c8c1500f0 0x7f8c8c152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c91800640 1 -- 172.21.15.114:0/2634657319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c8c1500f0 msgr2=0x7f8c8c152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c91800640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c8c1500f0 0x7f8c8c152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c91800640 1 -- 172.21.15.114:0/2634657319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c8c0c2c80 msgr2=0x7f8c8c1f02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c91800640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c8c0c2c80 0x7f8c8c1f02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c91800640 1 -- 172.21.15.114:0/2634657319 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c74009420 con 0x7f8c8c152a20 2024-02-17T12:17:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c91800640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c152a20 0x7f8c8c0c1870 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400c770 tx=0x7f8c8400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c89600640 1 -- 172.21.15.114:0/2634657319 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84003b80 con 0x7f8c8c152a20 2024-02-17T12:17:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c89600640 1 -- 172.21.15.114:0/2634657319 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84003ce0 con 0x7f8c8c152a20 2024-02-17T12:17:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c89600640 1 -- 172.21.15.114:0/2634657319 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400aa30 con 0x7f8c8c152a20 2024-02-17T12:17:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 -- 172.21.15.114:0/2634657319 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8c150770 con 0x7f8c8c152a20 2024-02-17T12:17:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 -- 172.21.15.114:0/2634657319 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8c1eda00 con 0x7f8c8c152a20 2024-02-17T12:17:30.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.073+0000 7f8c92200640 1 -- 172.21.15.114:0/2634657319 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8c04eef0 con 0x7f8c8c152a20 2024-02-17T12:17:30.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.077+0000 7f8c89600640 1 -- 172.21.15.114:0/2634657319 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8c8400ab90 con 0x7f8c8c152a20 2024-02-17T12:17:30.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.077+0000 7f8c89600640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c68066e40 0x7f8c68069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.077+0000 7f8c89600640 1 -- 172.21.15.114:0/2634657319 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8c84084a60 con 0x7f8c8c152a20 2024-02-17T12:17:30.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.077+0000 7f8c90e00640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c68066e40 0x7f8c68069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.077+0000 7f8c90e00640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c68066e40 0x7f8c68069300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0011f0 tx=0x7f8c7c007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:30.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.081+0000 7f8c89600640 1 -- 172.21.15.114:0/2634657319 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8c84051590 con 0x7f8c8c152a20 2024-02-17T12:17:30.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.233+0000 7f8c92200640 1 -- 172.21.15.114:0/2634657319 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f8c8c0c6c50 con 0x7f8c8c152a20 2024-02-17T12:17:30.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c89600640 1 -- 172.21.15.114:0/2634657319 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7f8c84054c50 con 0x7f8c8c152a20 2024-02-17T12:17:30.243 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:17:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 -- 172.21.15.114:0/2634657319 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c68066e40 msgr2=0x7f8c68069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c68066e40 0x7f8c68069300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0011f0 tx=0x7f8c7c007d40 comp rx=0 tx=0).stop 2024-02-17T12:17:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 -- 172.21.15.114:0/2634657319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c152a20 msgr2=0x7f8c8c0c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c152a20 0x7f8c8c0c1870 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400c770 tx=0x7f8c8400cc30 comp rx=0 tx=0).stop 2024-02-17T12:17:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 -- 172.21.15.114:0/2634657319 shutdown_connections 2024-02-17T12:17:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8c68066e40 0x7f8c68069300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8c152a20 0x7f8c8c0c1870 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8c8c1500f0 0x7f8c8c152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 --2- 172.21.15.114:0/2634657319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c8c0c2c80 0x7f8c8c1f02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 -- 172.21.15.114:0/2634657319 >> 172.21.15.114:0/2634657319 conn(0x7f8c8c066960 msgr2=0x7f8c8c0c4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 -- 172.21.15.114:0/2634657319 shutdown_connections 2024-02-17T12:17:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.237+0000 7f8c92200640 1 -- 172.21.15.114:0/2634657319 wait complete. 2024-02-17T12:17:30.264 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:17:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff48d800640 1 Processor -- start 2024-02-17T12:17:30.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff48d800640 1 -- start start 2024-02-17T12:17:30.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff48d800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff48814ff90 0x7ff4880c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff48d800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff4880708c0 0x7ff4880c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff48d800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4881537c0 con 0x7ff4880c5330 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff48d800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880c68e0 con 0x7ff48814ff90 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff48d800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880c2d60 con 0x7ff4880708c0 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff487e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff48814ff90 0x7ff4880c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff48ce00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff4880c5330 0x7ff4880c86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52746/0 (socket says 172.21.15.114:52746) 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff48ce00640 1 -- 172.21.15.114:0/2058543294 learned_addr learned my addr 172.21.15.114:0/2058543294 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff487400640 1 --2- 172.21.15.114:0/2058543294 >> v2:172.21.15.116:3300/0 conn(0x7ff4880708c0 0x7ff4880c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff487e00640 1 -- 172.21.15.114:0/2058543294 >> v2:172.21.15.116:3300/0 conn(0x7ff4880708c0 msgr2=0x7ff4880c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff487e00640 1 --2- 172.21.15.114:0/2058543294 >> v2:172.21.15.116:3300/0 conn(0x7ff4880708c0 0x7ff4880c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff487e00640 1 -- 172.21.15.114:0/2058543294 >> v1:172.21.15.114:6789/0 conn(0x7ff4880c5330 legacy=0x7ff4880c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff487e00640 1 -- 172.21.15.114:0/2058543294 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880c2f70 con 0x7ff48814ff90 2024-02-17T12:17:30.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.397+0000 7ff486a00640 1 -- 172.21.15.114:0/2058543294 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253201987 0 0) 0x7ff4881537c0 con 0x7ff4880c5330 2024-02-17T12:17:30.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff487e00640 1 --2- 172.21.15.114:0/2058543294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 0x7ff4880c47a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff478009d90 tx=0x7ff47801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c009e81694b7ae7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:30.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff486a00640 1 -- 172.21.15.114:0/2058543294 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780a57c0 con 0x7ff48814ff90 2024-02-17T12:17:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff486a00640 1 -- 172.21.15.114:0/2058543294 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4780a5920 con 0x7ff48814ff90 2024-02-17T12:17:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff486a00640 1 -- 172.21.15.114:0/2058543294 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780a5cb0 con 0x7ff48814ff90 2024-02-17T12:17:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff48d800640 1 -- 172.21.15.114:0/2058543294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 msgr2=0x7ff4880c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff48d800640 1 --2- 172.21.15.114:0/2058543294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 0x7ff4880c47a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff478009d90 tx=0x7ff47801c810 comp rx=0 tx=0).stop 2024-02-17T12:17:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff48d800640 1 -- 172.21.15.114:0/2058543294 shutdown_connections 2024-02-17T12:17:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff48d800640 1 --2- 172.21.15.114:0/2058543294 >> v2:172.21.15.116:3300/0 conn(0x7ff4880708c0 0x7ff4880c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff48d800640 1 --2- 172.21.15.114:0/2058543294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 0x7ff4880c47a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff48d800640 1 -- 172.21.15.114:0/2058543294 >> 172.21.15.114:0/2058543294 conn(0x7ff488066960 msgr2=0x7ff488066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff48d800640 1 -- 172.21.15.114:0/2058543294 shutdown_connections 2024-02-17T12:17:30.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff48d800640 1 -- 172.21.15.114:0/2058543294 wait complete. 2024-02-17T12:17:30.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.401+0000 7ff48d800640 1 Processor -- start 2024-02-17T12:17:30.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48d800640 1 -- start start 2024-02-17T12:17:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48d800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4880708c0 0x7ff48815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48d800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4880c5330 0x7ff488145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 0x7ff4881458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48d800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff488145de0 con 0x7ff48814ff90 2024-02-17T12:17:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48d800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff488150620 con 0x7ff4880708c0 2024-02-17T12:17:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48d800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff488150900 con 0x7ff4880c5330 2024-02-17T12:17:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 0x7ff4881458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 0x7ff4881458a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56176/0 (socket says 172.21.15.114:56176) 2024-02-17T12:17:30.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48ce00640 1 -- 172.21.15.114:0/2870800163 learned_addr learned my addr 172.21.15.114:0/2870800163 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:30.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff487e00640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4880708c0 0x7ff48815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff487400640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4880c5330 0x7ff488145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48ce00640 1 -- 172.21.15.114:0/2870800163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4880c5330 msgr2=0x7ff488145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48ce00640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4880c5330 0x7ff488145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48ce00640 1 -- 172.21.15.114:0/2870800163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4880708c0 msgr2=0x7ff48815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48ce00640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4880708c0 0x7ff48815b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48ce00640 1 -- 172.21.15.114:0/2870800163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478009a70 con 0x7ff48814ff90 2024-02-17T12:17:30.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48ce00640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 0x7ff4881458a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff48000c480 tx=0x7ff48000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:30.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff47fe00640 1 -- 172.21.15.114:0/2870800163 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800074e0 con 0x7ff48814ff90 2024-02-17T12:17:30.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff47fe00640 1 -- 172.21.15.114:0/2870800163 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480007640 con 0x7ff48814ff90 2024-02-17T12:17:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48d800640 1 -- 172.21.15.114:0/2870800163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488150be0 con 0x7ff48814ff90 2024-02-17T12:17:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff47fe00640 1 -- 172.21.15.114:0/2870800163 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480004a10 con 0x7ff48814ff90 2024-02-17T12:17:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48d800640 1 -- 172.21.15.114:0/2870800163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4881511a0 con 0x7ff48814ff90 2024-02-17T12:17:30.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.405+0000 7ff48d800640 1 -- 172.21.15.114:0/2870800163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4881513c0 con 0x7ff48814ff90 2024-02-17T12:17:30.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.409+0000 7ff47fe00640 1 -- 172.21.15.114:0/2870800163 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff480004b70 con 0x7ff48814ff90 2024-02-17T12:17:30.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.409+0000 7ff47fe00640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff468066e70 0x7ff468069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.409+0000 7ff47fe00640 1 -- 172.21.15.114:0/2870800163 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff4800841c0 con 0x7ff48814ff90 2024-02-17T12:17:30.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.409+0000 7ff487e00640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff468066e70 0x7ff468069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.409+0000 7ff487e00640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff468066e70 0x7ff468069330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff4780af000 tx=0x7ff4780a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:30.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.413+0000 7ff47fe00640 1 -- 172.21.15.114:0/2870800163 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff480050cf0 con 0x7ff48814ff90 2024-02-17T12:17:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.577+0000 7ff48d800640 1 -- 172.21.15.114:0/2870800163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff4880c75d0 con 0x7ff48814ff90 2024-02-17T12:17:30.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.577+0000 7ff47fe00640 1 -- 172.21.15.114:0/2870800163 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff4800543b0 con 0x7ff48814ff90 2024-02-17T12:17:30.586 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:17:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 -- 172.21.15.114:0/2870800163 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff468066e70 msgr2=0x7ff468069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff468066e70 0x7ff468069330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff4780af000 tx=0x7ff4780a7070 comp rx=0 tx=0).stop 2024-02-17T12:17:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 -- 172.21.15.114:0/2870800163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 msgr2=0x7ff4881458a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 0x7ff4881458a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff48000c480 tx=0x7ff48000c940 comp rx=0 tx=0).stop 2024-02-17T12:17:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 -- 172.21.15.114:0/2870800163 shutdown_connections 2024-02-17T12:17:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff468066e70 0x7ff468069330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48814ff90 0x7ff4881458a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4880c5330 0x7ff488145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 --2- 172.21.15.114:0/2870800163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4880708c0 0x7ff48815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 -- 172.21.15.114:0/2870800163 >> 172.21.15.114:0/2870800163 conn(0x7ff488066960 msgr2=0x7ff4880c86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 -- 172.21.15.114:0/2870800163 shutdown_connections 2024-02-17T12:17:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.581+0000 7ff48d800640 1 -- 172.21.15.114:0/2870800163 wait complete. 2024-02-17T12:17:30.607 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-17T12:17:30.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:30.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-17T12:17:30.635 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:17:30.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:30.635 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-17T12:17:30.690 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:17:30.690 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:30.741 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3897 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-02-17T12:17:30.742 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:17:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d6ce00640 1 Processor -- start 2024-02-17T12:17:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d6ce00640 1 -- start start 2024-02-17T12:17:30.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d6ce00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9d68152560 0x7f9d680c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d6ce00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d68072b20 0x7f9d680c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d6ce00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d680723b0 con 0x7f9d680c4760 2024-02-17T12:17:30.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d6ce00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d68070000 con 0x7f9d68152560 2024-02-17T12:17:30.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d6ce00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d68154dc0 con 0x7f9d68072b20 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d66800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9d680c4760 0x7f9d681586f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52760/0 (socket says 172.21.15.114:52760) 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d66800640 1 -- 172.21.15.114:0/1235208675 learned_addr learned my addr 172.21.15.114:0/1235208675 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d65e00640 1 --2- 172.21.15.114:0/1235208675 >> v2:172.21.15.116:3300/0 conn(0x7f9d68152560 0x7f9d680c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d65400640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d68072b20 0x7f9d680c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365574073 0 0) 0x7f9d680723b0 con 0x7f9d680c4760 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d4c003530 con 0x7f9d680c4760 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3758432295 0 0) 0x7f9d4c003530 con 0x7f9d680c4760 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d68072b20 msgr2=0x7f9d680c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d68072b20 0x7f9d680c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 >> v2:172.21.15.116:3300/0 conn(0x7f9d68152560 msgr2=0x7f9d680c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:30.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 --2- 172.21.15.114:0/1235208675 >> v2:172.21.15.116:3300/0 conn(0x7f9d68152560 0x7f9d680c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d680728e0 con 0x7f9d680c4760 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f9d60001680 con 0x7f9d680c4760 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 >> v1:172.21.15.114:6789/0 conn(0x7f9d680c4760 legacy=0x7f9d681586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d68072b20 0x7f9d4c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d4c003f00 0x7f9d4c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d4c004d10 0x7f9d4c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d68070000 con 0x7f9d4c003f00 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d68154dc0 con 0x7f9d4c004d10 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c00b9e0 con 0x7f9d68072b20 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d65400640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d4c003f00 0x7f9d4c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.869+0000 7f9d65e00640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d68072b20 0x7f9d4c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d66800640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d4c004d10 0x7f9d4c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d65400640 1 -- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d68072b20 msgr2=0x7f9d4c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d65400640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d68072b20 0x7f9d4c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d65400640 1 -- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d4c004d10 msgr2=0x7f9d4c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d65400640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d4c004d10 0x7f9d4c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d65400640 1 -- 172.21.15.114:0/1235208675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c003530 con 0x7f9d4c003f00 2024-02-17T12:17:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d65400640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d4c003f00 0x7f9d4c0047d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009b10 tx=0x7f9d5001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735449cd78233c72 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500a6450 con 0x7f9d4c003f00 2024-02-17T12:17:30.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d500a65b0 con 0x7f9d4c003f00 2024-02-17T12:17:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d64a00640 1 -- 172.21.15.114:0/1235208675 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500a6960 con 0x7f9d4c003f00 2024-02-17T12:17:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d6ce00640 1 -- 172.21.15.114:0/1235208675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d4c003f00 msgr2=0x7f9d4c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d6ce00640 1 --2- 172.21.15.114:0/1235208675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d4c003f00 0x7f9d4c0047d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009b10 tx=0x7f9d5001ca70 comp rx=0 tx=0).stop 2024-02-17T12:17:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.873+0000 7f9d66800640 1 -- 172.21.15.114:0/1235208675 reap_dead start 2024-02-17T12:17:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 -- 172.21.15.114:0/1235208675 shutdown_connections 2024-02-17T12:17:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 -- 172.21.15.114:0/1235208675 >> 172.21.15.114:0/1235208675 conn(0x7f9d6806bef0 msgr2=0x7f9d6806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 -- 172.21.15.114:0/1235208675 shutdown_connections 2024-02-17T12:17:30.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 -- 172.21.15.114:0/1235208675 wait complete. 2024-02-17T12:17:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 Processor -- start 2024-02-17T12:17:30.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 -- start start 2024-02-17T12:17:30.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d4c003f00 0x7f9d681ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d68148360 0x7f9d680aa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d6814eb80 0x7f9d68149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d681502d0 con 0x7f9d68148360 2024-02-17T12:17:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680aa840 con 0x7f9d4c003f00 2024-02-17T12:17:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d68149470 con 0x7f9d6814eb80 2024-02-17T12:17:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d65400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d68148360 0x7f9d680aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d65400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d68148360 0x7f9d680aa300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56196/0 (socket says 172.21.15.114:56196) 2024-02-17T12:17:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d65400640 1 -- 172.21.15.114:0/3354880202 learned_addr learned my addr 172.21.15.114:0/3354880202 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d65e00640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d4c003f00 0x7f9d681ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d66800640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d6814eb80 0x7f9d68149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d65400640 1 -- 172.21.15.114:0/3354880202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d6814eb80 msgr2=0x7f9d68149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d65400640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d6814eb80 0x7f9d68149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d65400640 1 -- 172.21.15.114:0/3354880202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d4c003f00 msgr2=0x7f9d681ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d65400640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d4c003f00 0x7f9d681ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d65400640 1 -- 172.21.15.114:0/3354880202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d68148860 con 0x7f9d68148360 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d65400640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d68148360 0x7f9d680aa300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9d5001c8a0 tx=0x7f9d50019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d5e000640 1 -- 172.21.15.114:0/3354880202 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000f000 con 0x7f9d68148360 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d5e000640 1 -- 172.21.15.114:0/3354880202 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d500a6da0 con 0x7f9d68148360 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.877+0000 7f9d6ce00640 1 -- 172.21.15.114:0/3354880202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d68148b40 con 0x7f9d68148360 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.881+0000 7f9d5e000640 1 -- 172.21.15.114:0/3354880202 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500a7650 con 0x7f9d68148360 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.881+0000 7f9d6ce00640 1 -- 172.21.15.114:0/3354880202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d68149100 con 0x7f9d68148360 2024-02-17T12:17:30.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.881+0000 7f9d6ce00640 1 -- 172.21.15.114:0/3354880202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d68067370 con 0x7f9d68148360 2024-02-17T12:17:30.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.881+0000 7f9d5e000640 1 -- 172.21.15.114:0/3354880202 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9d500a77b0 con 0x7f9d68148360 2024-02-17T12:17:30.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.881+0000 7f9d5e000640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9d44066e40 0x7f9d44069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:30.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.881+0000 7f9d5e000640 1 -- 172.21.15.114:0/3354880202 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9d5011e7f0 con 0x7f9d68148360 2024-02-17T12:17:30.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.881+0000 7f9d65e00640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9d44066e40 0x7f9d44069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:30.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.881+0000 7f9d65e00640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9d44066e40 0x7f9d44069300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d58014510 tx=0x7f9d5800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:30.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:30.885+0000 7f9d5e000640 1 -- 172.21.15.114:0/3354880202 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9d500eb290 con 0x7f9d68148360 2024-02-17T12:17:31.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 -- 172.21.15.114:0/3354880202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9d68074840 con 0x7f9d68148360 2024-02-17T12:17:31.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d5e000640 1 -- 172.21.15.114:0/3354880202 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7f9d500be0b0 con 0x7f9d68148360 2024-02-17T12:17:31.084 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:17:31.084 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-02-17T12:17:31.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 -- 172.21.15.114:0/3354880202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9d44066e40 msgr2=0x7f9d44069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:31.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9d44066e40 0x7f9d44069300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d58014510 tx=0x7f9d5800b040 comp rx=0 tx=0).stop 2024-02-17T12:17:31.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 -- 172.21.15.114:0/3354880202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d68148360 msgr2=0x7f9d680aa300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:31.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d68148360 0x7f9d680aa300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9d5001c8a0 tx=0x7f9d50019810 comp rx=0 tx=0).stop 2024-02-17T12:17:31.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 -- 172.21.15.114:0/3354880202 shutdown_connections 2024-02-17T12:17:31.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d6814eb80 0x7f9d68149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:31.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9d44066e40 0x7f9d44069300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:31.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d68148360 0x7f9d680aa300 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:31.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 --2- 172.21.15.114:0/3354880202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d4c003f00 0x7f9d681ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 -- 172.21.15.114:0/3354880202 >> 172.21.15.114:0/3354880202 conn(0x7f9d6806bef0 msgr2=0x7f9d6815e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 -- 172.21.15.114:0/3354880202 shutdown_connections 2024-02-17T12:17:31.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.077+0000 7f9d6ce00640 1 -- 172.21.15.114:0/3354880202 wait complete. 2024-02-17T12:17:31.104 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-02-17T12:17:31.104 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:17:31.104 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-17T12:17:31.104 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-17T12:17:31.104 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T12:17:31.104 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-02-17T12:17:31.105 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:17:31.105 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:17:31.105 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:17:31.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:31.105 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-17T12:17:31.115 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:17:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:17:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:17:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-17T12:17:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:31.115 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:31.115 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42265sec preferred_lft 42265sec 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:31.116 INFO:teuthology.orchestra.run.smithi116.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 02:42:58:59:74:79 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:17:31.117 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:31.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:31.118 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:17:31.176 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-17T12:17:31.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:31.179 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-17T12:17:31.233 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-17T12:17:31.233 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:17:31.233 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:17:31.233 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:17:31.233 INFO:teuthology.orchestra.run.smithi116.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:17:31.233 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:17:31.233 INFO:teuthology.orchestra.run.smithi116.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:31.233 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:31.233 INFO:teuthology.orchestra.run.smithi116.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:31.233 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:17:31.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:31.234 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:17:31.234 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:17:31.234 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:17:31.234 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:17:31.234 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:17:31.234 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:17:31.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:31.327 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-17T12:17:31.335 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-17T12:17:31.336 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:17:31.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:31.337 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-02-17T12:17:31.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:17:31.402 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-17T12:17:31.453 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:17:31.453 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:17:31.454 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:17:31.505 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:17:31.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:31.505 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:17:31.594 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:17:31.594 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-02-17T12:17:31.594 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:17:31.609 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:17:31.609 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-02-17T12:17:31.610 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:17:31.610 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:17:31.610 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:17:31.618 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:17:31.619 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-02-17T12:17:31.619 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:17:31.619 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:17:31.619 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:17:31.619 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:17:31.619 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:17:31.619 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:17:31.622 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:17:31.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:31.623 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:17:31.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:31.643 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:17:31.708 INFO:teuthology.orchestra.run.smithi116.stdout:client5224 2024-02-17T12:17:31.708 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:17:31.708 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:31.757 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2024-02-17T12:17:31.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab9a00640 1 Processor -- start 2024-02-17T12:17:31.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab9a00640 1 -- start start 2024-02-17T12:17:31.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab9a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab40c1800 0x7fdab4154d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:31.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab9a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdab4070920 0x7fdab40c8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:31.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab9a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab40c7340 con 0x7fdab4152420 2024-02-17T12:17:31.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab9a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab4158810 con 0x7fdab4070920 2024-02-17T12:17:31.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab9a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab4152800 con 0x7fdab40c1800 2024-02-17T12:17:31.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab3e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdab4152420 0x7fdab4158c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52776/0 (socket says 172.21.15.114:52776) 2024-02-17T12:17:31.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab3e00640 1 -- 172.21.15.114:0/2126438079 learned_addr learned my addr 172.21.15.114:0/2126438079 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:31.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab3400640 1 --2- 172.21.15.114:0/2126438079 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab40c1800 0x7fdab4154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:31.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab9000640 1 --2- 172.21.15.114:0/2126438079 >> v2:172.21.15.116:3300/0 conn(0x7fdab4070920 0x7fdab40c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:31.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab2a00640 1 -- 172.21.15.114:0/2126438079 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135049133 0 0) 0x7fdab40c7340 con 0x7fdab4152420 2024-02-17T12:17:31.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab2a00640 1 -- 172.21.15.114:0/2126438079 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda98003530 con 0x7fdab4152420 2024-02-17T12:17:31.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab2a00640 1 -- 172.21.15.114:0/2126438079 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349354346 0 0) 0x7fda98003530 con 0x7fdab4152420 2024-02-17T12:17:31.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab3400640 1 -- 172.21.15.114:0/2126438079 >> v2:172.21.15.116:3300/0 conn(0x7fdab4070920 msgr2=0x7fdab40c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:31.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab3400640 1 --2- 172.21.15.114:0/2126438079 >> v2:172.21.15.116:3300/0 conn(0x7fdab4070920 0x7fdab40c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:31.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab3400640 1 -- 172.21.15.114:0/2126438079 >> v1:172.21.15.114:6789/0 conn(0x7fdab4152420 legacy=0x7fdab4158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:31.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab3400640 1 -- 172.21.15.114:0/2126438079 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40c6d80 con 0x7fdab40c1800 2024-02-17T12:17:31.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.889+0000 7fdab9000640 1 --2- 172.21.15.114:0/2126438079 >> v2:172.21.15.116:3300/0 conn(0x7fdab4070920 0x7fdab40c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:31.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab3400640 1 --2- 172.21.15.114:0/2126438079 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab40c1800 0x7fdab4154d20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0097c0 tx=0x7fda9c01c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf16e2f9f2c65b77 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:31.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab2a00640 1 -- 172.21.15.114:0/2126438079 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4001a00 con 0x7fdab40c1800 2024-02-17T12:17:31.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab2a00640 1 -- 172.21.15.114:0/2126438079 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c0a7050 con 0x7fdab40c1800 2024-02-17T12:17:31.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab2a00640 1 -- 172.21.15.114:0/2126438079 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0ab600 con 0x7fdab40c1800 2024-02-17T12:17:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab9a00640 1 -- 172.21.15.114:0/2126438079 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab40c1800 msgr2=0x7fdab4154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab9a00640 1 --2- 172.21.15.114:0/2126438079 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab40c1800 0x7fdab4154d20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0097c0 tx=0x7fda9c01c2a0 comp rx=0 tx=0).stop 2024-02-17T12:17:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab9a00640 1 -- 172.21.15.114:0/2126438079 shutdown_connections 2024-02-17T12:17:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab9a00640 1 --2- 172.21.15.114:0/2126438079 >> v2:172.21.15.116:3300/0 conn(0x7fdab4070920 0x7fdab40c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:31.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab9a00640 1 --2- 172.21.15.114:0/2126438079 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab40c1800 0x7fdab4154d20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:31.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab9a00640 1 -- 172.21.15.114:0/2126438079 >> 172.21.15.114:0/2126438079 conn(0x7fdab4066960 msgr2=0x7fdab4066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:31.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab9a00640 1 -- 172.21.15.114:0/2126438079 shutdown_connections 2024-02-17T12:17:31.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab9a00640 1 -- 172.21.15.114:0/2126438079 wait complete. 2024-02-17T12:17:31.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab9a00640 1 Processor -- start 2024-02-17T12:17:31.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.893+0000 7fdab9a00640 1 -- start start 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070920 0x7fdab4150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab9a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdab40c1800 0x7fdab4149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab9a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab4152420 0x7fdab4149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab9a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab41ee480 con 0x7fdab4070920 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab9a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab41ee150 con 0x7fdab40c1800 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab9a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab4151ac0 con 0x7fdab4152420 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070920 0x7fdab4150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070920 0x7fdab4150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56208/0 (socket says 172.21.15.114:56208) 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab3e00640 1 -- 172.21.15.114:0/3045408253 learned_addr learned my addr 172.21.15.114:0/3045408253 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab3400640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdab40c1800 0x7fdab4149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab9000640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab4152420 0x7fdab4149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab3e00640 1 -- 172.21.15.114:0/3045408253 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab4152420 msgr2=0x7fdab4149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab3e00640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab4152420 0x7fdab4149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab3e00640 1 -- 172.21.15.114:0/3045408253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdab40c1800 msgr2=0x7fdab4149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab3e00640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdab40c1800 0x7fdab4149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab3e00640 1 -- 172.21.15.114:0/3045408253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac009420 con 0x7fdab4070920 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab3e00640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070920 0x7fdab4150e90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40018e0 tx=0x7fdaa400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdaabe00640 1 -- 172.21.15.114:0/3045408253 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4012400 con 0x7fdab4070920 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdaabe00640 1 -- 172.21.15.114:0/3045408253 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa4012560 con 0x7fdab4070920 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdaabe00640 1 -- 172.21.15.114:0/3045408253 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4012950 con 0x7fdab4070920 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab9a00640 1 -- 172.21.15.114:0/3045408253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c009420 con 0x7fdab4070920 2024-02-17T12:17:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab9a00640 1 -- 172.21.15.114:0/3045408253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab4158030 con 0x7fdab4070920 2024-02-17T12:17:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdab9a00640 1 -- 172.21.15.114:0/3045408253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab404efd0 con 0x7fdab4070920 2024-02-17T12:17:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.897+0000 7fdaabe00640 1 -- 172.21.15.114:0/3045408253 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fdaa4012ab0 con 0x7fdab4070920 2024-02-17T12:17:31.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.901+0000 7fdaabe00640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda90066e40 0x7fda90069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:31.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.901+0000 7fdaabe00640 1 -- 172.21.15.114:0/3045408253 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdaa4085620 con 0x7fdab4070920 2024-02-17T12:17:31.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.901+0000 7fdab3400640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda90066e40 0x7fda90069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:31.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.901+0000 7fdab3400640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda90066e40 0x7fda90069300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdab40c1c80 tx=0x7fda9c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:31.905+0000 7fdaabe00640 1 -- 172.21.15.114:0/3045408253 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdaa40520a0 con 0x7fdab4070920 2024-02-17T12:17:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.089+0000 7fdab9a00640 1 -- 172.21.15.114:0/3045408253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7fdab4155210 con 0x7fdab4070920 2024-02-17T12:17:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdaabe00640 1 -- 172.21.15.114:0/3045408253 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v11) v1 ==== 134+0+185 (secure 0 0 0) 0x7fdaa4055760 con 0x7fdab4070920 2024-02-17T12:17:32.100 INFO:teuthology.orchestra.run.smithi114.stdout:[client.testuser] 2024-02-17T12:17:32.101 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDco9BlQSTJBRAAk9inCLXcElmys8nQK+rN9g== 2024-02-17T12:17:32.101 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow rw fsname=cephfs" 2024-02-17T12:17:32.101 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r fsname=cephfs" 2024-02-17T12:17:32.101 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-02-17T12:17:32.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 -- 172.21.15.114:0/3045408253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda90066e40 msgr2=0x7fda90069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda90066e40 0x7fda90069300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdab40c1c80 tx=0x7fda9c0a6000 comp rx=0 tx=0).stop 2024-02-17T12:17:32.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 -- 172.21.15.114:0/3045408253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070920 msgr2=0x7fdab4150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070920 0x7fdab4150e90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40018e0 tx=0x7fdaa400a430 comp rx=0 tx=0).stop 2024-02-17T12:17:32.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 -- 172.21.15.114:0/3045408253 shutdown_connections 2024-02-17T12:17:32.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdab4152420 0x7fdab4149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdab40c1800 0x7fdab4149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda90066e40 0x7fda90069300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 --2- 172.21.15.114:0/3045408253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070920 0x7fdab4150e90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 -- 172.21.15.114:0/3045408253 >> 172.21.15.114:0/3045408253 conn(0x7fdab4066960 msgr2=0x7fdab4066d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:32.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 -- 172.21.15.114:0/3045408253 shutdown_connections 2024-02-17T12:17:32.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.093+0000 7fdab9a00640 1 -- 172.21.15.114:0/3045408253 wait complete. 2024-02-17T12:17:32.121 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-02-17T12:17:32.129 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.ebqA7Va0CB 2024-02-17T12:17:32.129 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:17:32.129 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/tmp/tmp.ebqA7Va0CB 2024-02-17T12:17:32.178 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:17:32.178 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:32.226 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:17:32.226 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:32.274 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:32.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feabd400640 1 Processor -- start 2024-02-17T12:17:32.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feabd400640 1 -- start start 2024-02-17T12:17:32.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feabd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feab80c2580 0x7feab80aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feabd400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7feab80c1eb0 0x7feab815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feabd400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80a9420 con 0x7feab814f110 2024-02-17T12:17:32.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feabd400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab814f4f0 con 0x7feab80c2580 2024-02-17T12:17:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feabd400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80aae80 con 0x7feab80c1eb0 2024-02-17T12:17:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feab5e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feab80c2580 0x7feab80aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feab5e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feab80c2580 0x7feab80aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56222/0 (socket says 172.21.15.114:56222) 2024-02-17T12:17:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feab5e00640 1 -- 172.21.15.114:0/1687604377 learned_addr learned my addr 172.21.15.114:0/1687604377 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.441+0000 7feab7200640 1 --2- 172.21.15.114:0/1687604377 >> v2:172.21.15.116:3300/0 conn(0x7feab80c1eb0 0x7feab815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feab5e00640 1 -- 172.21.15.114:0/1687604377 >> v2:172.21.15.116:3300/0 conn(0x7feab80c1eb0 msgr2=0x7feab815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feab5e00640 1 --2- 172.21.15.114:0/1687604377 >> v2:172.21.15.116:3300/0 conn(0x7feab80c1eb0 0x7feab815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feab5e00640 1 -- 172.21.15.114:0/1687604377 >> v1:172.21.15.116:6789/0 conn(0x7feab814f110 legacy=0x7feab80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feab5e00640 1 -- 172.21.15.114:0/1687604377 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab8152850 con 0x7feab80c2580 2024-02-17T12:17:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feab7200640 1 --2- 172.21.15.114:0/1687604377 >> v2:172.21.15.116:3300/0 conn(0x7feab80c1eb0 0x7feab815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feab5e00640 1 --2- 172.21.15.114:0/1687604377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c2580 0x7feab80aa150 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7feab806ceb0 tx=0x7feaa401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820d588bec2d4bc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feab5400640 1 -- 172.21.15.114:0/1687604377 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40ab620 con 0x7feab80c2580 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feab5400640 1 -- 172.21.15.114:0/1687604377 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa40ab780 con 0x7feab80c2580 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feab5400640 1 -- 172.21.15.114:0/1687604377 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40abb10 con 0x7feab80c2580 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feabd400640 1 -- 172.21.15.114:0/1687604377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c2580 msgr2=0x7feab80aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feabd400640 1 --2- 172.21.15.114:0/1687604377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c2580 0x7feab80aa150 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7feab806ceb0 tx=0x7feaa401c420 comp rx=0 tx=0).stop 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feabd400640 1 -- 172.21.15.114:0/1687604377 shutdown_connections 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feabd400640 1 --2- 172.21.15.114:0/1687604377 >> v2:172.21.15.116:3300/0 conn(0x7feab80c1eb0 0x7feab815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feabd400640 1 --2- 172.21.15.114:0/1687604377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c2580 0x7feab80aa150 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feabd400640 1 -- 172.21.15.114:0/1687604377 >> 172.21.15.114:0/1687604377 conn(0x7feab80a8490 msgr2=0x7feab80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feabd400640 1 -- 172.21.15.114:0/1687604377 shutdown_connections 2024-02-17T12:17:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.445+0000 7feabd400640 1 -- 172.21.15.114:0/1687604377 wait complete. 2024-02-17T12:17:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feabd400640 1 Processor -- start 2024-02-17T12:17:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feabd400640 1 -- start start 2024-02-17T12:17:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feabd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c1eb0 0x7feab814a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feabd400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feab80c2580 0x7feab81493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feabd400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feab814f110 0x7feab8149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feabd400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab81eb3b0 con 0x7feab80c1eb0 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feabd400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab81ec380 con 0x7feab814f110 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feabd400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab81ebef0 con 0x7feab80c2580 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c1eb0 0x7feab814a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c1eb0 0x7feab814a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56238/0 (socket says 172.21.15.114:56238) 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab6800640 1 -- 172.21.15.114:0/3718574251 learned_addr learned my addr 172.21.15.114:0/3718574251 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab7200640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feab814f110 0x7feab8149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab5e00640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feab80c2580 0x7feab81493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab6800640 1 -- 172.21.15.114:0/3718574251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feab80c2580 msgr2=0x7feab81493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab6800640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feab80c2580 0x7feab81493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab6800640 1 -- 172.21.15.114:0/3718574251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feab814f110 msgr2=0x7feab8149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab6800640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feab814f110 0x7feab8149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab6800640 1 -- 172.21.15.114:0/3718574251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40094d0 con 0x7feab80c1eb0 2024-02-17T12:17:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feab6800640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c1eb0 0x7feab814a930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feaa800b440 tx=0x7feaa800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feaaea00640 1 -- 172.21.15.114:0/3718574251 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8011890 con 0x7feab80c1eb0 2024-02-17T12:17:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feaaea00640 1 -- 172.21.15.114:0/3718574251 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa80119f0 con 0x7feab80c1eb0 2024-02-17T12:17:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feabd400640 1 -- 172.21.15.114:0/3718574251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab81eb5c0 con 0x7feab80c1eb0 2024-02-17T12:17:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feaaea00640 1 -- 172.21.15.114:0/3718574251 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8011da0 con 0x7feab80c1eb0 2024-02-17T12:17:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.449+0000 7feabd400640 1 -- 172.21.15.114:0/3718574251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab81ebb80 con 0x7feab80c1eb0 2024-02-17T12:17:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.453+0000 7feabd400640 1 -- 172.21.15.114:0/3718574251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab8074840 con 0x7feab80c1eb0 2024-02-17T12:17:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.453+0000 7feaaea00640 1 -- 172.21.15.114:0/3718574251 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7feaa801a400 con 0x7feab80c1eb0 2024-02-17T12:17:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.453+0000 7feaaea00640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea98066e40 0x7fea98069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.453+0000 7feaaea00640 1 -- 172.21.15.114:0/3718574251 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7feaa8084d10 con 0x7feab80c1eb0 2024-02-17T12:17:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.453+0000 7feab5e00640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea98066e40 0x7fea98069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.453+0000 7feab5e00640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea98066e40 0x7fea98069300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feaa40af000 tx=0x7feaa40b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:32.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.457+0000 7feaaea00640 1 -- 172.21.15.114:0/3718574251 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feaa80517c0 con 0x7feab80c1eb0 2024-02-17T12:17:32.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.613+0000 7feabd400640 1 -- 172.21.15.114:0/3718574251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feab80c1380 con 0x7feab80c1eb0 2024-02-17T12:17:32.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.613+0000 7feaaea00640 1 -- 172.21.15.114:0/3718574251 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20407 (secure 0 0 0) 0x7feaa8015020 con 0x7feab80c1eb0 2024-02-17T12:17:32.623 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:32.623 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:24.325322+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 -- 172.21.15.114:0/3718574251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea98066e40 msgr2=0x7fea98069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea98066e40 0x7fea98069300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feaa40af000 tx=0x7feaa40b6040 comp rx=0 tx=0).stop 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 -- 172.21.15.114:0/3718574251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c1eb0 msgr2=0x7feab814a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c1eb0 0x7feab814a930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feaa800b440 tx=0x7feaa800b900 comp rx=0 tx=0).stop 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 -- 172.21.15.114:0/3718574251 shutdown_connections 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feab814f110 0x7feab8149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feab80c2580 0x7feab81493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fea98066e40 0x7fea98069300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 --2- 172.21.15.114:0/3718574251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feab80c1eb0 0x7feab814a930 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 -- 172.21.15.114:0/3718574251 >> 172.21.15.114:0/3718574251 conn(0x7feab80a8490 msgr2=0x7feab81400e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 -- 172.21.15.114:0/3718574251 shutdown_connections 2024-02-17T12:17:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.617+0000 7feabd400640 1 -- 172.21.15.114:0/3718574251 wait complete. 2024-02-17T12:17:32.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:17:03.897758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:17:04.389290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:17:20.859567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:17:21.688611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:17:32.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:17:32.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.773+0000 7f9ea3c00640 1 Processor -- start 2024-02-17T12:17:32.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.773+0000 7f9ea3c00640 1 -- start start 2024-02-17T12:17:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.773+0000 7f9ea3c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9e9c14f110 0x7f9e9c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.773+0000 7f9ea3c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e9c0c2580 0x7f9e9c0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.773+0000 7f9ea3c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c0a9420 con 0x7f9e9c0c1eb0 2024-02-17T12:17:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.773+0000 7f9ea3c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9c14f4f0 con 0x7f9e9c14f110 2024-02-17T12:17:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.773+0000 7f9ea3c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0aae80 con 0x7f9e9c0c2580 2024-02-17T12:17:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9ea1200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9e9c14f110 0x7f9e9c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9ea1200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9e9c14f110 0x7f9e9c0c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:42774/0 (socket says 172.21.15.114:42774) 2024-02-17T12:17:32.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9ea1200640 1 -- 172.21.15.114:0/1063007717 learned_addr learned my addr 172.21.15.114:0/1063007717 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:32.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9e9be00640 1 --2- 172.21.15.114:0/1063007717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e9c0c2580 0x7f9e9c0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9ea1200640 1 -- 172.21.15.114:0/1063007717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e9c0c2580 msgr2=0x7f9e9c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:32.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9ea1200640 1 --2- 172.21.15.114:0/1063007717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e9c0c2580 0x7f9e9c0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9ea1200640 1 -- 172.21.15.114:0/1063007717 >> v1:172.21.15.116:6789/0 conn(0x7f9e9c0c1eb0 legacy=0x7f9e9c155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9ea1200640 1 -- 172.21.15.114:0/1063007717 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c152850 con 0x7f9e9c14f110 2024-02-17T12:17:32.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9ea1200640 1 --2- 172.21.15.114:0/1063007717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e9c14f110 0x7f9e9c0c65a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009e50 tx=0x7f9e8c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5cee8c04eed455c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:32.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9e9b400640 1 -- 172.21.15.114:0/1063007717 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0a5830 con 0x7f9e9c14f110 2024-02-17T12:17:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9e9b400640 1 -- 172.21.15.114:0/1063007717 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8c0a5990 con 0x7f9e9c14f110 2024-02-17T12:17:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.777+0000 7f9e9b400640 1 -- 172.21.15.114:0/1063007717 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0a5d20 con 0x7f9e9c14f110 2024-02-17T12:17:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 -- 172.21.15.114:0/1063007717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e9c14f110 msgr2=0x7f9e9c0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 --2- 172.21.15.114:0/1063007717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e9c14f110 0x7f9e9c0c65a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009e50 tx=0x7f9e8c01c970 comp rx=0 tx=0).stop 2024-02-17T12:17:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 -- 172.21.15.114:0/1063007717 shutdown_connections 2024-02-17T12:17:32.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 --2- 172.21.15.114:0/1063007717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e9c0c2580 0x7f9e9c0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 --2- 172.21.15.114:0/1063007717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e9c14f110 0x7f9e9c0c65a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 -- 172.21.15.114:0/1063007717 >> 172.21.15.114:0/1063007717 conn(0x7f9e9c0a8490 msgr2=0x7f9e9c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:32.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 -- 172.21.15.114:0/1063007717 shutdown_connections 2024-02-17T12:17:32.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 -- 172.21.15.114:0/1063007717 wait complete. 2024-02-17T12:17:32.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 Processor -- start 2024-02-17T12:17:32.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 -- start start 2024-02-17T12:17:32.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e9c0c1eb0 0x7f9e9c0c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c0c2580 0x7f9e9c1ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e9c14f110 0x7f9e9c1443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0c61c0 con 0x7f9e9c0c2580 2024-02-17T12:17:32.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c14e500 con 0x7f9e9c14f110 2024-02-17T12:17:32.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea3c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c1efc30 con 0x7f9e9c0c1eb0 2024-02-17T12:17:32.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9e9be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c0c2580 0x7f9e9c1ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9e9be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c0c2580 0x7f9e9c1ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56254/0 (socket says 172.21.15.114:56254) 2024-02-17T12:17:32.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9e9be00640 1 -- 172.21.15.114:0/2074382817 learned_addr learned my addr 172.21.15.114:0/2074382817 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:32.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea1200640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e9c0c1eb0 0x7f9e9c0c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9ea1c00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e9c14f110 0x7f9e9c1443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9e9be00640 1 -- 172.21.15.114:0/2074382817 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e9c0c1eb0 msgr2=0x7f9e9c0c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9e9be00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e9c0c1eb0 0x7f9e9c0c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9e9be00640 1 -- 172.21.15.114:0/2074382817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e9c14f110 msgr2=0x7f9e9c1443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9e9be00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e9c14f110 0x7f9e9c1443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.781+0000 7f9e9be00640 1 -- 172.21.15.114:0/2074382817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c009b30 con 0x7f9e9c0c2580 2024-02-17T12:17:32.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9e9be00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c0c2580 0x7f9e9c1ef6f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e930 tx=0x7f9e8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:32.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9e98c00640 1 -- 172.21.15.114:0/2074382817 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84009690 con 0x7f9e9c0c2580 2024-02-17T12:17:32.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9e98c00640 1 -- 172.21.15.114:0/2074382817 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8400c9a0 con 0x7f9e9c0c2580 2024-02-17T12:17:32.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9e98c00640 1 -- 172.21.15.114:0/2074382817 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400cd50 con 0x7f9e9c0c2580 2024-02-17T12:17:32.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9ea3c00640 1 -- 172.21.15.114:0/2074382817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c1eb770 con 0x7f9e9c0c2580 2024-02-17T12:17:32.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9ea3c00640 1 -- 172.21.15.114:0/2074382817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c0c5680 con 0x7f9e9c0c2580 2024-02-17T12:17:32.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9ea3c00640 1 -- 172.21.15.114:0/2074382817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c074840 con 0x7f9e9c0c2580 2024-02-17T12:17:32.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9e98c00640 1 -- 172.21.15.114:0/2074382817 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9e84013470 con 0x7f9e9c0c2580 2024-02-17T12:17:32.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9e98c00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9e78066e40 0x7f9e78069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:32.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9e98c00640 1 -- 172.21.15.114:0/2074382817 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9e84084e20 con 0x7f9e9c0c2580 2024-02-17T12:17:32.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9ea1200640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9e78066e40 0x7f9e78069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:32.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.785+0000 7f9ea1200640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9e78066e40 0x7f9e78069300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0ae000 tx=0x7f9e8c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:32.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.789+0000 7f9e98c00640 1 -- 172.21.15.114:0/2074382817 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9e84051ab0 con 0x7f9e9c0c2580 2024-02-17T12:17:32.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 -- 172.21.15.114:0/2074382817 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e9c0c1380 con 0x7f9e9c0c2580 2024-02-17T12:17:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9e98c00640 1 -- 172.21.15.114:0/2074382817 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e840170a0 con 0x7f9e9c0c2580 2024-02-17T12:17:32.952 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:17:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 -- 172.21.15.114:0/2074382817 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9e78066e40 msgr2=0x7f9e78069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9e78066e40 0x7f9e78069300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0ae000 tx=0x7f9e8c0a7070 comp rx=0 tx=0).stop 2024-02-17T12:17:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 -- 172.21.15.114:0/2074382817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c0c2580 msgr2=0x7f9e9c1ef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c0c2580 0x7f9e9c1ef6f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e930 tx=0x7f9e8400edf0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 -- 172.21.15.114:0/2074382817 shutdown_connections 2024-02-17T12:17:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e9c14f110 0x7f9e9c1443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9e78066e40 0x7f9e78069300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e9c0c2580 0x7f9e9c1ef6f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 --2- 172.21.15.114:0/2074382817 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e9c0c1eb0 0x7f9e9c0c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:32.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 -- 172.21.15.114:0/2074382817 >> 172.21.15.114:0/2074382817 conn(0x7f9e9c0a8490 msgr2=0x7f9e9c0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:32.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 -- 172.21.15.114:0/2074382817 shutdown_connections 2024-02-17T12:17:32.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:32.945+0000 7f9ea3c00640 1 -- 172.21.15.114:0/2074382817 wait complete. 2024-02-17T12:17:32.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:17:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.101+0000 7ff793e00640 1 Processor -- start 2024-02-17T12:17:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.101+0000 7ff793e00640 1 -- start start 2024-02-17T12:17:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff793e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff78c0c25a0 0x7ff78c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff793e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff78c06db50 0x7ff78c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff793e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c156270 con 0x7ff78c150490 2024-02-17T12:17:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff793e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c071630 con 0x7ff78c0c25a0 2024-02-17T12:17:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff793e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c156550 con 0x7ff78c06db50 2024-02-17T12:17:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff791e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff78c150490 0x7ff78c152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52782/0 (socket says 172.21.15.114:52782) 2024-02-17T12:17:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff791e00640 1 -- 172.21.15.114:0/235213536 learned_addr learned my addr 172.21.15.114:0/235213536 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff790a00640 1 --2- 172.21.15.114:0/235213536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff78c06db50 0x7ff78c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff791400640 1 --2- 172.21.15.114:0/235213536 >> v2:172.21.15.116:3300/0 conn(0x7ff78c0c25a0 0x7ff78c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff78be00640 1 -- 172.21.15.114:0/235213536 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307663836 0 0) 0x7ff78c156270 con 0x7ff78c150490 2024-02-17T12:17:33.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff78be00640 1 -- 172.21.15.114:0/235213536 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff774003530 con 0x7ff78c150490 2024-02-17T12:17:33.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff791400640 1 -- 172.21.15.114:0/235213536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff78c06db50 msgr2=0x7ff78c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:33.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff791400640 1 --2- 172.21.15.114:0/235213536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff78c06db50 0x7ff78c14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff791400640 1 -- 172.21.15.114:0/235213536 >> v1:172.21.15.114:6789/0 conn(0x7ff78c150490 legacy=0x7ff78c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.105+0000 7ff791400640 1 -- 172.21.15.114:0/235213536 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c156830 con 0x7ff78c0c25a0 2024-02-17T12:17:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff791400640 1 --2- 172.21.15.114:0/235213536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff78c0c25a0 0x7ff78c06e980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff780009d90 tx=0x7ff78001c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38028663fb80c1a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff78be00640 1 -- 172.21.15.114:0/235213536 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7800a5900 con 0x7ff78c0c25a0 2024-02-17T12:17:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff78be00640 1 -- 172.21.15.114:0/235213536 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7800a5a60 con 0x7ff78c0c25a0 2024-02-17T12:17:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff78be00640 1 -- 172.21.15.114:0/235213536 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7800a5df0 con 0x7ff78c0c25a0 2024-02-17T12:17:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 -- 172.21.15.114:0/235213536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff78c0c25a0 msgr2=0x7ff78c06e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 --2- 172.21.15.114:0/235213536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff78c0c25a0 0x7ff78c06e980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff780009d90 tx=0x7ff78001c820 comp rx=0 tx=0).stop 2024-02-17T12:17:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 -- 172.21.15.114:0/235213536 shutdown_connections 2024-02-17T12:17:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 --2- 172.21.15.114:0/235213536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff78c06db50 0x7ff78c14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 --2- 172.21.15.114:0/235213536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff78c0c25a0 0x7ff78c06e980 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 -- 172.21.15.114:0/235213536 >> 172.21.15.114:0/235213536 conn(0x7ff78c0a8490 msgr2=0x7ff78c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 -- 172.21.15.114:0/235213536 shutdown_connections 2024-02-17T12:17:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 -- 172.21.15.114:0/235213536 wait complete. 2024-02-17T12:17:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 Processor -- start 2024-02-17T12:17:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 -- start start 2024-02-17T12:17:33.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff78c06db50 0x7ff78c0c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff78c0c25a0 0x7ff78c13f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff78c150490 0x7ff78c1f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0aa700 con 0x7ff78c0c25a0 2024-02-17T12:17:33.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c13edb0 con 0x7ff78c150490 2024-02-17T12:17:33.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff793e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c13e1a0 con 0x7ff78c06db50 2024-02-17T12:17:33.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff790a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff78c0c25a0 0x7ff78c13f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff790a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff78c0c25a0 0x7ff78c13f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56264/0 (socket says 172.21.15.114:56264) 2024-02-17T12:17:33.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff790a00640 1 -- 172.21.15.114:0/306451085 learned_addr learned my addr 172.21.15.114:0/306451085 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:33.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.109+0000 7ff791400640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff78c06db50 0x7ff78c0c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff791e00640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff78c150490 0x7ff78c1f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff790a00640 1 -- 172.21.15.114:0/306451085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff78c06db50 msgr2=0x7ff78c0c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff790a00640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff78c06db50 0x7ff78c0c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff790a00640 1 -- 172.21.15.114:0/306451085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff78c150490 msgr2=0x7ff78c1f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff790a00640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff78c150490 0x7ff78c1f0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff790a00640 1 -- 172.21.15.114:0/306451085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780009a70 con 0x7ff78c0c25a0 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff790a00640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff78c0c25a0 0x7ff78c13f590 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff77800e930 tx=0x7ff77800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff789600640 1 -- 172.21.15.114:0/306451085 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778009690 con 0x7ff78c0c25a0 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff789600640 1 -- 172.21.15.114:0/306451085 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77800ca00 con 0x7ff78c0c25a0 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff793e00640 1 -- 172.21.15.114:0/306451085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c13e480 con 0x7ff78c0c25a0 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff789600640 1 -- 172.21.15.114:0/306451085 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800cd70 con 0x7ff78c0c25a0 2024-02-17T12:17:33.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff793e00640 1 -- 172.21.15.114:0/306451085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c13ea40 con 0x7ff78c0c25a0 2024-02-17T12:17:33.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff793e00640 1 -- 172.21.15.114:0/306451085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c074840 con 0x7ff78c0c25a0 2024-02-17T12:17:33.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff789600640 1 -- 172.21.15.114:0/306451085 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff778013470 con 0x7ff78c0c25a0 2024-02-17T12:17:33.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff789600640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff76c066e40 0x7ff76c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff789600640 1 -- 172.21.15.114:0/306451085 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff778084fb0 con 0x7ff78c0c25a0 2024-02-17T12:17:33.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.113+0000 7ff791400640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff76c066e40 0x7ff76c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.117+0000 7ff791400640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff76c066e40 0x7ff76c069300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff7800af000 tx=0x7ff7800a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:33.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.121+0000 7ff789600640 1 -- 172.21.15.114:0/306451085 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff778051b10 con 0x7ff78c0c25a0 2024-02-17T12:17:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.273+0000 7ff793e00640 1 -- 172.21.15.114:0/306451085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff78c13ef20 con 0x7ff78c0c25a0 2024-02-17T12:17:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.273+0000 7ff789600640 1 -- 172.21.15.114:0/306451085 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff778017020 con 0x7ff78c0c25a0 2024-02-17T12:17:33.282 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:17:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 -- 172.21.15.114:0/306451085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff76c066e40 msgr2=0x7ff76c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff76c066e40 0x7ff76c069300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff7800af000 tx=0x7ff7800a7070 comp rx=0 tx=0).stop 2024-02-17T12:17:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 -- 172.21.15.114:0/306451085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff78c0c25a0 msgr2=0x7ff78c13f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff78c0c25a0 0x7ff78c13f590 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff77800e930 tx=0x7ff77800edf0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 -- 172.21.15.114:0/306451085 shutdown_connections 2024-02-17T12:17:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff78c150490 0x7ff78c1f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff76c066e40 0x7ff76c069300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff78c0c25a0 0x7ff78c13f590 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 --2- 172.21.15.114:0/306451085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff78c06db50 0x7ff78c0c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 -- 172.21.15.114:0/306451085 >> 172.21.15.114:0/306451085 conn(0x7ff78c0a8490 msgr2=0x7ff78c0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 -- 172.21.15.114:0/306451085 shutdown_connections 2024-02-17T12:17:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.277+0000 7ff793e00640 1 -- 172.21.15.114:0/306451085 wait complete. 2024-02-17T12:17:33.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:17:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.433+0000 7f4e13e00640 1 Processor -- start 2024-02-17T12:17:33.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.433+0000 7f4e13e00640 1 -- start start 2024-02-17T12:17:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.433+0000 7f4e13e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c0c25a0 0x7f4e0c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.433+0000 7f4e13e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e0c06db50 0x7f4e0c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.433+0000 7f4e13e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c156270 con 0x7f4e0c150490 2024-02-17T12:17:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.433+0000 7f4e13e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c071630 con 0x7f4e0c06db50 2024-02-17T12:17:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.433+0000 7f4e13e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c156550 con 0x7f4e0c0c25a0 2024-02-17T12:17:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.433+0000 7f4e10a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e0c06db50 0x7f4e0c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.433+0000 7f4e11e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4e0c150490 0x7f4e0c152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52788/0 (socket says 172.21.15.114:52788) 2024-02-17T12:17:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.433+0000 7f4e11e00640 1 -- 172.21.15.114:0/2326633870 learned_addr learned my addr 172.21.15.114:0/2326633870 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e11400640 1 --2- 172.21.15.114:0/2326633870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c0c25a0 0x7f4e0c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e10a00640 1 -- 172.21.15.114:0/2326633870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c0c25a0 msgr2=0x7f4e0c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e10a00640 1 --2- 172.21.15.114:0/2326633870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c0c25a0 0x7f4e0c06e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e10a00640 1 -- 172.21.15.114:0/2326633870 >> v1:172.21.15.114:6789/0 conn(0x7f4e0c150490 legacy=0x7f4e0c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e10a00640 1 -- 172.21.15.114:0/2326633870 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c156830 con 0x7f4e0c06db50 2024-02-17T12:17:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e0be00640 1 -- 172.21.15.114:0/2326633870 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127422657 0 0) 0x7f4e0c156270 con 0x7f4e0c150490 2024-02-17T12:17:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e11400640 1 --2- 172.21.15.114:0/2326633870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c0c25a0 0x7f4e0c06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e10a00640 1 --2- 172.21.15.114:0/2326633870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c06db50 0x7f4e0c14ff50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4df80097c0 tx=0x7f4df801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ce4ef08e0b9bc0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e0be00640 1 -- 172.21.15.114:0/2326633870 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df80ab600 con 0x7f4e0c06db50 2024-02-17T12:17:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e0be00640 1 -- 172.21.15.114:0/2326633870 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df80a7050 con 0x7f4e0c06db50 2024-02-17T12:17:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e0be00640 1 -- 172.21.15.114:0/2326633870 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df80ab980 con 0x7f4e0c06db50 2024-02-17T12:17:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e13e00640 1 -- 172.21.15.114:0/2326633870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c06db50 msgr2=0x7f4e0c14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.437+0000 7f4e13e00640 1 --2- 172.21.15.114:0/2326633870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c06db50 0x7f4e0c14ff50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4df80097c0 tx=0x7f4df801c350 comp rx=0 tx=0).stop 2024-02-17T12:17:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 -- 172.21.15.114:0/2326633870 shutdown_connections 2024-02-17T12:17:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 --2- 172.21.15.114:0/2326633870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c06db50 0x7f4e0c14ff50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 --2- 172.21.15.114:0/2326633870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c0c25a0 0x7f4e0c06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 -- 172.21.15.114:0/2326633870 >> 172.21.15.114:0/2326633870 conn(0x7f4e0c0a8490 msgr2=0x7f4e0c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 -- 172.21.15.114:0/2326633870 shutdown_connections 2024-02-17T12:17:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 -- 172.21.15.114:0/2326633870 wait complete. 2024-02-17T12:17:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 Processor -- start 2024-02-17T12:17:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 -- start start 2024-02-17T12:17:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c06db50 0x7f4e0c13a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e0c0c25a0 0x7f4e0c141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c150490 0x7f4e0c1eb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c147e50 con 0x7f4e0c150490 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0c3740 con 0x7f4e0c0c25a0 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c149ed0 con 0x7f4e0c06db50 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e11e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c150490 0x7f4e0c1eb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e11e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c150490 0x7f4e0c1eb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56278/0 (socket says 172.21.15.114:56278) 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e11e00640 1 -- 172.21.15.114:0/1512711297 learned_addr learned my addr 172.21.15.114:0/1512711297 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e11400640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c06db50 0x7f4e0c13a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e10a00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e0c0c25a0 0x7f4e0c141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e11e00640 1 -- 172.21.15.114:0/1512711297 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c06db50 msgr2=0x7f4e0c13a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e11e00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c06db50 0x7f4e0c13a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e11e00640 1 -- 172.21.15.114:0/1512711297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e0c0c25a0 msgr2=0x7f4e0c141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e11e00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e0c0c25a0 0x7f4e0c141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e11e00640 1 -- 172.21.15.114:0/1512711297 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8009420 con 0x7f4e0c150490 2024-02-17T12:17:33.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e10a00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e0c0c25a0 0x7f4e0c141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:33.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e11e00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c150490 0x7f4e0c1eb800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400c3c0 tx=0x7f4e0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:33.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e09600640 1 -- 172.21.15.114:0/1512711297 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e040074e0 con 0x7f4e0c150490 2024-02-17T12:17:33.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e09600640 1 -- 172.21.15.114:0/1512711297 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e04007640 con 0x7f4e0c150490 2024-02-17T12:17:33.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e09600640 1 -- 172.21.15.114:0/1512711297 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04004a30 con 0x7f4e0c150490 2024-02-17T12:17:33.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 -- 172.21.15.114:0/1512711297 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c147420 con 0x7f4e0c150490 2024-02-17T12:17:33.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.441+0000 7f4e13e00640 1 -- 172.21.15.114:0/1512711297 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c147700 con 0x7f4e0c150490 2024-02-17T12:17:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.445+0000 7f4e13e00640 1 -- 172.21.15.114:0/1512711297 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0c147280 con 0x7f4e0c150490 2024-02-17T12:17:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.445+0000 7f4e09600640 1 -- 172.21.15.114:0/1512711297 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4e04004b90 con 0x7f4e0c150490 2024-02-17T12:17:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.445+0000 7f4e09600640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4dec066e40 0x7f4dec069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.445+0000 7f4e09600640 1 -- 172.21.15.114:0/1512711297 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4e04084bc0 con 0x7f4e0c150490 2024-02-17T12:17:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.445+0000 7f4e11400640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4dec066e40 0x7f4dec069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.445+0000 7f4e11400640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4dec066e40 0x7f4dec069300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4e000075b0 tx=0x7f4e00007540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:33.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.449+0000 7f4e09600640 1 -- 172.21.15.114:0/1512711297 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4e0c147280 con 0x7f4e0c150490 2024-02-17T12:17:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.601+0000 7f4e13e00640 1 -- 172.21.15.114:0/1512711297 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e0c1eb140 con 0x7f4e0c150490 2024-02-17T12:17:33.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e09600640 1 -- 172.21.15.114:0/1512711297 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e0c1eb140 con 0x7f4e0c150490 2024-02-17T12:17:33.611 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:17:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 -- 172.21.15.114:0/1512711297 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4dec066e40 msgr2=0x7f4dec069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4dec066e40 0x7f4dec069300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4e000075b0 tx=0x7f4e00007540 comp rx=0 tx=0).stop 2024-02-17T12:17:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 -- 172.21.15.114:0/1512711297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c150490 msgr2=0x7f4e0c1eb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c150490 0x7f4e0c1eb800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400c3c0 tx=0x7f4e0400c880 comp rx=0 tx=0).stop 2024-02-17T12:17:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 -- 172.21.15.114:0/1512711297 shutdown_connections 2024-02-17T12:17:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4dec066e40 0x7f4dec069300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e0c150490 0x7f4e0c1eb800 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e0c0c25a0 0x7f4e0c141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 --2- 172.21.15.114:0/1512711297 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e0c06db50 0x7f4e0c13a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 -- 172.21.15.114:0/1512711297 >> 172.21.15.114:0/1512711297 conn(0x7f4e0c0a8490 msgr2=0x7f4e0c0c1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 -- 172.21.15.114:0/1512711297 shutdown_connections 2024-02-17T12:17:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.605+0000 7f4e13e00640 1 -- 172.21.15.114:0/1512711297 wait complete. 2024-02-17T12:17:33.632 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:17:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd22800640 1 Processor -- start 2024-02-17T12:17:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd22800640 1 -- start start 2024-02-17T12:17:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd22800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c06ef50 0x7fdd1c0ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd22800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c0aa150 con 0x7fdd1c14e9b0 2024-02-17T12:17:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd22800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c0c1e90 con 0x7fdd1c1519b0 2024-02-17T12:17:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd22800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c14ed90 con 0x7fdd1c06ef50 2024-02-17T12:17:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd1b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdd1c14e9b0 0x7fdd1c1512a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52802/0 (socket says 172.21.15.114:52802) 2024-02-17T12:17:33.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd1b400640 1 -- 172.21.15.114:0/2404212959 learned_addr learned my addr 172.21.15.114:0/2404212959 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd1aa00640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c06ef50 0x7fdd1c0ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760675911 0 0) 0x7fdd1c0aa150 con 0x7fdd1c14e9b0 2024-02-17T12:17:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.761+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd00003530 con 0x7fdd1c14e9b0 2024-02-17T12:17:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1843169316 0 0) 0x7fdd00003530 con 0x7fdd1c14e9b0 2024-02-17T12:17:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c06ef50 msgr2=0x7fdd1c0ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c06ef50 0x7fdd1c0ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 >> v1:172.21.15.116:6789/0 conn(0x7fdd1c1519b0 legacy=0x7fdd1c06dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c152000 con 0x7fdd1c14e9b0 2024-02-17T12:17:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fdd0c001a00 con 0x7fdd1c14e9b0 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 >> v1:172.21.15.114:6789/0 conn(0x7fdd1c14e9b0 legacy=0x7fdd1c1512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c06ef50 0x7fdd000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd00003ef0 0x7fdd000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00004d10 0x7fdd00005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c14ed90 con 0x7fdd00003ef0 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0000dc00 con 0x7fdd00004d10 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0000ddc0 con 0x7fdd1c06ef50 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1aa00640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd00003ef0 0x7fdd000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1b400640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c06ef50 0x7fdd000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1be00640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00004d10 0x7fdd00005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1aa00640 1 -- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c06ef50 msgr2=0x7fdd000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1aa00640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c06ef50 0x7fdd000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1aa00640 1 -- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00004d10 msgr2=0x7fdd00005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:33.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1aa00640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00004d10 0x7fdd00005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1aa00640 1 -- 172.21.15.114:0/2404212959 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00003530 con 0x7fdd00003ef0 2024-02-17T12:17:33.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1be00640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00004d10 0x7fdd00005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:33.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.765+0000 7fdd1aa00640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd00003ef0 0x7fdd000047d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400aa30 tx=0x7fdd0401cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c3898dd1ef340 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:33.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040a5b90 con 0x7fdd00003ef0 2024-02-17T12:17:33.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040a5cf0 con 0x7fdd00003ef0 2024-02-17T12:17:33.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd1a000640 1 -- 172.21.15.114:0/2404212959 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040ad640 con 0x7fdd00003ef0 2024-02-17T12:17:33.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 -- 172.21.15.114:0/2404212959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd00003ef0 msgr2=0x7fdd000047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 --2- 172.21.15.114:0/2404212959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd00003ef0 0x7fdd000047d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400aa30 tx=0x7fdd0401cb50 comp rx=0 tx=0).stop 2024-02-17T12:17:33.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd1be00640 1 -- 172.21.15.114:0/2404212959 reap_dead start 2024-02-17T12:17:33.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 -- 172.21.15.114:0/2404212959 shutdown_connections 2024-02-17T12:17:33.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 -- 172.21.15.114:0/2404212959 >> 172.21.15.114:0/2404212959 conn(0x7fdd1c0a8490 msgr2=0x7fdd1c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:33.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 -- 172.21.15.114:0/2404212959 shutdown_connections 2024-02-17T12:17:33.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 -- 172.21.15.114:0/2404212959 wait complete. 2024-02-17T12:17:33.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 Processor -- start 2024-02-17T12:17:33.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 -- start start 2024-02-17T12:17:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00003ef0 0x7fdd1c148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c1e9730 0x7fdd1c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1c1492b0 0x7fdd1c1dceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c1dc510 con 0x7fdd1c1492b0 2024-02-17T12:17:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c14a460 con 0x7fdd00003ef0 2024-02-17T12:17:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd22800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c14b430 con 0x7fdd1c1e9730 2024-02-17T12:17:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1c1492b0 0x7fdd1c1dceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1c1492b0 0x7fdd1c1dceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56294/0 (socket says 172.21.15.114:56294) 2024-02-17T12:17:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd1be00640 1 -- 172.21.15.114:0/3147838734 learned_addr learned my addr 172.21.15.114:0/3147838734 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd1b400640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00003ef0 0x7fdd1c148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.769+0000 7fdd1aa00640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c1e9730 0x7fdd1c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd1be00640 1 -- 172.21.15.114:0/3147838734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c1e9730 msgr2=0x7fdd1c0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd1be00640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c1e9730 0x7fdd1c0c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd1be00640 1 -- 172.21.15.114:0/3147838734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00003ef0 msgr2=0x7fdd1c148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd1be00640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00003ef0 0x7fdd1c148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd1be00640 1 -- 172.21.15.114:0/3147838734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c14b980 con 0x7fdd1c1492b0 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd1be00640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1c1492b0 0x7fdd1c1dceb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0c3a70 tx=0x7fdd14010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd13400640 1 -- 172.21.15.114:0/3147838734 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14005480 con 0x7fdd1c1492b0 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd13400640 1 -- 172.21.15.114:0/3147838734 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1400d070 con 0x7fdd1c1492b0 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd22800640 1 -- 172.21.15.114:0/3147838734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c14bc60 con 0x7fdd1c1492b0 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd13400640 1 -- 172.21.15.114:0/3147838734 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400ea70 con 0x7fdd1c1492b0 2024-02-17T12:17:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd22800640 1 -- 172.21.15.114:0/3147838734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c1dc130 con 0x7fdd1c1492b0 2024-02-17T12:17:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd22800640 1 -- 172.21.15.114:0/3147838734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c1dcd00 con 0x7fdd1c1492b0 2024-02-17T12:17:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd13400640 1 -- 172.21.15.114:0/3147838734 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fdd1400ebd0 con 0x7fdd1c1492b0 2024-02-17T12:17:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd13400640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 0x7fdcf8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd13400640 1 -- 172.21.15.114:0/3147838734 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdd14087e00 con 0x7fdd1c1492b0 2024-02-17T12:17:33.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.773+0000 7fdd1b400640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 0x7fdcf8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:33.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.777+0000 7fdd1b400640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 0x7fdcf8069300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c001fc0 tx=0x7fdd0c006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.777+0000 7fdd13400640 1 -- 172.21.15.114:0/3147838734 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd14054880 con 0x7fdd1c1492b0 2024-02-17T12:17:33.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 -- 172.21.15.114:0/3147838734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd1c074840 con 0x7fdd1c1492b0 2024-02-17T12:17:33.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd13400640 1 -- 172.21.15.114:0/3147838734 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7fdd14057f40 con 0x7fdd1c1492b0 2024-02-17T12:17:33.941 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:17:33.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 -- 172.21.15.114:0/3147838734 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 msgr2=0x7fdcf8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 0x7fdcf8069300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c001fc0 tx=0x7fdd0c006040 comp rx=0 tx=0).stop 2024-02-17T12:17:33.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 -- 172.21.15.114:0/3147838734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1c1492b0 msgr2=0x7fdd1c1dceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:33.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1c1492b0 0x7fdd1c1dceb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0c3a70 tx=0x7fdd14010e80 comp rx=0 tx=0).stop 2024-02-17T12:17:33.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 -- 172.21.15.114:0/3147838734 shutdown_connections 2024-02-17T12:17:33.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 0x7fdcf8069300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1c1492b0 0x7fdd1c1dceb0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd1c1e9730 0x7fdd1c0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 --2- 172.21.15.114:0/3147838734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd00003ef0 0x7fdd1c148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:33.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 -- 172.21.15.114:0/3147838734 >> 172.21.15.114:0/3147838734 conn(0x7fdd1c0a8490 msgr2=0x7fdd1c147870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:33.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 -- 172.21.15.114:0/3147838734 shutdown_connections 2024-02-17T12:17:33.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:33.933+0000 7fdd22800640 1 -- 172.21.15.114:0/3147838734 wait complete. 2024-02-17T12:17:33.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:17:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545f800640 1 Processor -- start 2024-02-17T12:17:34.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545f800640 1 -- start start 2024-02-17T12:17:34.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545f800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f545806db50 0x7f545814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545f800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5458150490 0x7f5458152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545f800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5458156270 con 0x7f54580c25a0 2024-02-17T12:17:34.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545f800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545806f090 con 0x7f5458150490 2024-02-17T12:17:34.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545f800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5458071630 con 0x7f545806db50 2024-02-17T12:17:34.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545d800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5458150490 0x7f5458152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545ce00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f54580c25a0 0x7f545806e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52818/0 (socket says 172.21.15.114:52818) 2024-02-17T12:17:34.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545ce00640 1 -- 172.21.15.114:0/160422993 learned_addr learned my addr 172.21.15.114:0/160422993 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:34.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f5457e00640 1 --2- 172.21.15.114:0/160422993 >> v2:172.21.15.116:3300/0 conn(0x7f545806db50 0x7f545814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545d800640 1 -- 172.21.15.114:0/160422993 >> v2:172.21.15.116:3300/0 conn(0x7f545806db50 msgr2=0x7f545814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:34.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545d800640 1 --2- 172.21.15.114:0/160422993 >> v2:172.21.15.116:3300/0 conn(0x7f545806db50 0x7f545814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545d800640 1 -- 172.21.15.114:0/160422993 >> v1:172.21.15.114:6789/0 conn(0x7f54580c25a0 legacy=0x7f545806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f545d800640 1 -- 172.21.15.114:0/160422993 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458156550 con 0x7f5458150490 2024-02-17T12:17:34.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f5457400640 1 -- 172.21.15.114:0/160422993 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410524657 0 0) 0x7f5458156270 con 0x7f54580c25a0 2024-02-17T12:17:34.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.093+0000 7f5457e00640 1 --2- 172.21.15.114:0/160422993 >> v2:172.21.15.116:3300/0 conn(0x7f545806db50 0x7f545814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545d800640 1 --2- 172.21.15.114:0/160422993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 0x7f5458152c50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f545806e260 tx=0x7f545001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1627279e7097e7b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f5457400640 1 -- 172.21.15.114:0/160422993 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54581539a0 con 0x7f5458150490 2024-02-17T12:17:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f5457400640 1 -- 172.21.15.114:0/160422993 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54500a57c0 con 0x7f5458150490 2024-02-17T12:17:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f5457400640 1 -- 172.21.15.114:0/160422993 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500a5b50 con 0x7f5458150490 2024-02-17T12:17:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545f800640 1 -- 172.21.15.114:0/160422993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 msgr2=0x7f5458152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545f800640 1 --2- 172.21.15.114:0/160422993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 0x7f5458152c50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f545806e260 tx=0x7f545001c810 comp rx=0 tx=0).stop 2024-02-17T12:17:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545f800640 1 -- 172.21.15.114:0/160422993 shutdown_connections 2024-02-17T12:17:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545f800640 1 --2- 172.21.15.114:0/160422993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 0x7f5458152c50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545f800640 1 --2- 172.21.15.114:0/160422993 >> v2:172.21.15.116:3300/0 conn(0x7f545806db50 0x7f545814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545f800640 1 -- 172.21.15.114:0/160422993 >> 172.21.15.114:0/160422993 conn(0x7f54580a8490 msgr2=0x7f54580a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545f800640 1 -- 172.21.15.114:0/160422993 shutdown_connections 2024-02-17T12:17:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545f800640 1 -- 172.21.15.114:0/160422993 wait complete. 2024-02-17T12:17:34.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545f800640 1 Processor -- start 2024-02-17T12:17:34.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.097+0000 7f545f800640 1 -- start start 2024-02-17T12:17:34.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545f800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f545806db50 0x7f545814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545f800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54580c25a0 0x7f54580ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545f800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 0x7f5458151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545f800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54581f0aa0 con 0x7f5458150490 2024-02-17T12:17:34.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545f800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54581422e0 con 0x7f54580c25a0 2024-02-17T12:17:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545f800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54581425c0 con 0x7f545806db50 2024-02-17T12:17:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 0x7f5458151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 0x7f5458151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56322/0 (socket says 172.21.15.114:56322) 2024-02-17T12:17:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545d800640 1 -- 172.21.15.114:0/2247214072 learned_addr learned my addr 172.21.15.114:0/2247214072 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f5457e00640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54580c25a0 0x7f54580ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545ce00640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f545806db50 0x7f545814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545d800640 1 -- 172.21.15.114:0/2247214072 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f545806db50 msgr2=0x7f545814d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545d800640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f545806db50 0x7f545814d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545d800640 1 -- 172.21.15.114:0/2247214072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54580c25a0 msgr2=0x7f54580ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545d800640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54580c25a0 0x7f54580ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545d800640 1 -- 172.21.15.114:0/2247214072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5450009a70 con 0x7f5458150490 2024-02-17T12:17:34.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545d800640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 0x7f5458151fa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f54500b0040 tx=0x7f54500195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:34.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f5454c00640 1 -- 172.21.15.114:0/2247214072 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500b9860 con 0x7f5458150490 2024-02-17T12:17:34.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f5454c00640 1 -- 172.21.15.114:0/2247214072 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54500b99c0 con 0x7f5458150490 2024-02-17T12:17:34.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f5454c00640 1 -- 172.21.15.114:0/2247214072 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500b9d70 con 0x7f5458150490 2024-02-17T12:17:34.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545f800640 1 -- 172.21.15.114:0/2247214072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54581f0730 con 0x7f5458150490 2024-02-17T12:17:34.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545f800640 1 -- 172.21.15.114:0/2247214072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54581428a0 con 0x7f5458150490 2024-02-17T12:17:34.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f545f800640 1 -- 172.21.15.114:0/2247214072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54581f0c50 con 0x7f5458150490 2024-02-17T12:17:34.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.101+0000 7f5454c00640 1 -- 172.21.15.114:0/2247214072 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f54500ad440 con 0x7f5458150490 2024-02-17T12:17:34.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.105+0000 7f5454c00640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5438066e70 0x7f5438069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.105+0000 7f5454c00640 1 -- 172.21.15.114:0/2247214072 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f545011fef0 con 0x7f5458150490 2024-02-17T12:17:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.105+0000 7f545ce00640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5438066e70 0x7f5438069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.105+0000 7f545ce00640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5438066e70 0x7f5438069330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f544c000f70 tx=0x7f544c007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.109+0000 7f5454c00640 1 -- 172.21.15.114:0/2247214072 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54581f0c50 con 0x7f5458150490 2024-02-17T12:17:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.261+0000 7f545f800640 1 -- 172.21.15.114:0/2247214072 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f5458074840 con 0x7f5458150490 2024-02-17T12:17:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.261+0000 7f5454c00640 1 -- 172.21.15.114:0/2247214072 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7f54500ec970 con 0x7f5458150490 2024-02-17T12:17:34.270 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:17:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 -- 172.21.15.114:0/2247214072 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5438066e70 msgr2=0x7f5438069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5438066e70 0x7f5438069330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f544c000f70 tx=0x7f544c007b60 comp rx=0 tx=0).stop 2024-02-17T12:17:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 -- 172.21.15.114:0/2247214072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 msgr2=0x7f5458151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 0x7f5458151fa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f54500b0040 tx=0x7f54500195b0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 -- 172.21.15.114:0/2247214072 shutdown_connections 2024-02-17T12:17:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5438066e70 0x7f5438069330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5458150490 0x7f5458151fa0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54580c25a0 0x7f54580ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 --2- 172.21.15.114:0/2247214072 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f545806db50 0x7f545814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 -- 172.21.15.114:0/2247214072 >> 172.21.15.114:0/2247214072 conn(0x7f54580a8490 msgr2=0x7f54580c1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 -- 172.21.15.114:0/2247214072 shutdown_connections 2024-02-17T12:17:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.265+0000 7f545f800640 1 -- 172.21.15.114:0/2247214072 wait complete. 2024-02-17T12:17:34.292 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:17:34.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c93000640 1 Processor -- start 2024-02-17T12:17:34.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c93000640 1 -- start start 2024-02-17T12:17:34.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c93000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3c8c06fdc0 0x7f3c8c0aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c93000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c158ad0 0x7f3c8c15f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c93000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c0c5ee0 con 0x7f3c8c0aa060 2024-02-17T12:17:34.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c93000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c0c2390 con 0x7f3c8c06fdc0 2024-02-17T12:17:34.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c93000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0706e0 con 0x7f3c8c158ad0 2024-02-17T12:17:34.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c91200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3c8c06fdc0 0x7f3c8c0aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c91200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3c8c06fdc0 0x7f3c8c0aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56332/0 (socket says 172.21.15.114:56332) 2024-02-17T12:17:34.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c91200640 1 -- 172.21.15.114:0/824821302 learned_addr learned my addr 172.21.15.114:0/824821302 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:34.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c92600640 1 --2- 172.21.15.114:0/824821302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c158ad0 0x7f3c8c15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c91200640 1 -- 172.21.15.114:0/824821302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c158ad0 msgr2=0x7f3c8c15f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:34.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c91200640 1 --2- 172.21.15.114:0/824821302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c158ad0 0x7f3c8c15f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c91200640 1 -- 172.21.15.114:0/824821302 >> v1:172.21.15.116:6789/0 conn(0x7f3c8c0aa060 legacy=0x7f3c8c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.421+0000 7f3c91200640 1 -- 172.21.15.114:0/824821302 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0c2570 con 0x7f3c8c06fdc0 2024-02-17T12:17:34.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c91200640 1 --2- 172.21.15.114:0/824821302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c06fdc0 0x7f3c8c0aa440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009870 tx=0x7f3c8001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde4fea31282577 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:34.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c8be00640 1 -- 172.21.15.114:0/824821302 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800ab610 con 0x7f3c8c06fdc0 2024-02-17T12:17:34.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c8be00640 1 -- 172.21.15.114:0/824821302 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800ab770 con 0x7f3c8c06fdc0 2024-02-17T12:17:34.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c8be00640 1 -- 172.21.15.114:0/824821302 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800abb00 con 0x7f3c8c06fdc0 2024-02-17T12:17:34.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c93000640 1 -- 172.21.15.114:0/824821302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c06fdc0 msgr2=0x7f3c8c0aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c93000640 1 --2- 172.21.15.114:0/824821302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c06fdc0 0x7f3c8c0aa440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009870 tx=0x7f3c8001c410 comp rx=0 tx=0).stop 2024-02-17T12:17:34.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c93000640 1 -- 172.21.15.114:0/824821302 shutdown_connections 2024-02-17T12:17:34.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c93000640 1 --2- 172.21.15.114:0/824821302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c158ad0 0x7f3c8c15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c93000640 1 --2- 172.21.15.114:0/824821302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c06fdc0 0x7f3c8c0aa440 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c93000640 1 -- 172.21.15.114:0/824821302 >> 172.21.15.114:0/824821302 conn(0x7f3c8c06ed70 msgr2=0x7f3c8c06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:34.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c93000640 1 -- 172.21.15.114:0/824821302 shutdown_connections 2024-02-17T12:17:34.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.425+0000 7f3c93000640 1 -- 172.21.15.114:0/824821302 wait complete. 2024-02-17T12:17:34.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 Processor -- start 2024-02-17T12:17:34.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 -- start start 2024-02-17T12:17:34.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c06fdc0 0x7f3c8c0acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0aa060 0x7f3c8c154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c158ad0 0x7f3c8c154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c155510 con 0x7f3c8c0aa060 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c159ef0 con 0x7f3c8c158ad0 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c153cf0 con 0x7f3c8c06fdc0 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0aa060 0x7f3c8c154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0aa060 0x7f3c8c154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56348/0 (socket says 172.21.15.114:56348) 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91200640 1 -- 172.21.15.114:0/3641869995 learned_addr learned my addr 172.21.15.114:0/3641869995 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91c00640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c06fdc0 0x7f3c8c0acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c92600640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c158ad0 0x7f3c8c154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91200640 1 -- 172.21.15.114:0/3641869995 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c06fdc0 msgr2=0x7f3c8c0acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91200640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c06fdc0 0x7f3c8c0acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91200640 1 -- 172.21.15.114:0/3641869995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c158ad0 msgr2=0x7f3c8c154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91200640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c158ad0 0x7f3c8c154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91200640 1 -- 172.21.15.114:0/3641869995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c800094d0 con 0x7f3c8c0aa060 2024-02-17T12:17:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c92600640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c158ad0 0x7f3c8c154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91c00640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c06fdc0 0x7f3c8c0acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c91200640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0aa060 0x7f3c8c154a90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3c800ad040 tx=0x7f3c8001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c89600640 1 -- 172.21.15.114:0/3641869995 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800be5f0 con 0x7f3c8c0aa060 2024-02-17T12:17:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c89600640 1 -- 172.21.15.114:0/3641869995 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800be770 con 0x7f3c8c0aa060 2024-02-17T12:17:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c89600640 1 -- 172.21.15.114:0/3641869995 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800beb20 con 0x7f3c8c0aa060 2024-02-17T12:17:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 -- 172.21.15.114:0/3641869995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c1ee0f0 con 0x7f3c8c0aa060 2024-02-17T12:17:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 -- 172.21.15.114:0/3641869995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c154290 con 0x7f3c8c0aa060 2024-02-17T12:17:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.429+0000 7f3c93000640 1 -- 172.21.15.114:0/3641869995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c068180 con 0x7f3c8c0aa060 2024-02-17T12:17:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.433+0000 7f3c89600640 1 -- 172.21.15.114:0/3641869995 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3c800b4600 con 0x7f3c8c0aa060 2024-02-17T12:17:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.433+0000 7f3c89600640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3c70066e40 0x7f3c70069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.433+0000 7f3c89600640 1 -- 172.21.15.114:0/3641869995 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3c8011feb0 con 0x7f3c8c0aa060 2024-02-17T12:17:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.433+0000 7f3c91c00640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3c70066e40 0x7f3c70069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.433+0000 7f3c91c00640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3c70066e40 0x7f3c70069300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c001670 tx=0x7f3c7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:34.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.437+0000 7f3c89600640 1 -- 172.21.15.114:0/3641869995 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3c800ec8a0 con 0x7f3c8c0aa060 2024-02-17T12:17:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 -- 172.21.15.114:0/3641869995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3c8c04eef0 con 0x7f3c8c0aa060 2024-02-17T12:17:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c89600640 1 -- 172.21.15.114:0/3641869995 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3c800eff60 con 0x7f3c8c0aa060 2024-02-17T12:17:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:17:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 -- 172.21.15.114:0/3641869995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3c70066e40 msgr2=0x7f3c70069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3c70066e40 0x7f3c70069300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c001670 tx=0x7f3c7c009040 comp rx=0 tx=0).stop 2024-02-17T12:17:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 -- 172.21.15.114:0/3641869995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0aa060 msgr2=0x7f3c8c154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0aa060 0x7f3c8c154a90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3c800ad040 tx=0x7f3c8001ac50 comp rx=0 tx=0).stop 2024-02-17T12:17:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 -- 172.21.15.114:0/3641869995 shutdown_connections 2024-02-17T12:17:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3c8c158ad0 0x7f3c8c154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3c70066e40 0x7f3c70069300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c8c0aa060 0x7f3c8c154a90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 --2- 172.21.15.114:0/3641869995 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3c8c06fdc0 0x7f3c8c0acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 -- 172.21.15.114:0/3641869995 >> 172.21.15.114:0/3641869995 conn(0x7f3c8c06ed70 msgr2=0x7f3c8c06f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:34.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 -- 172.21.15.114:0/3641869995 shutdown_connections 2024-02-17T12:17:34.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.605+0000 7f3c93000640 1 -- 172.21.15.114:0/3641869995 wait complete. 2024-02-17T12:17:34.633 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-17T12:17:34.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:34.633 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-17T12:17:34.660 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:17:34.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:34.660 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-17T12:17:34.711 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:17:34.711 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:34.766 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354568k,nr_inodes=4088642,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2004 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-17T12:17:34.767 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:17:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f7981800640 1 Processor -- start 2024-02-17T12:17:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f7981800640 1 -- start start 2024-02-17T12:17:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f7981800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f797c0c25a0 0x7f797c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f7981800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c156270 con 0x7f797c06db50 2024-02-17T12:17:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f7981800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c156550 con 0x7f797c152c50 2024-02-17T12:17:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f7981800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c071630 con 0x7f797c0c25a0 2024-02-17T12:17:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f797aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f797c0c25a0 0x7f797c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f797a000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f797c06db50 0x7f797c14ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52834/0 (socket says 172.21.15.114:52834) 2024-02-17T12:17:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f797a000640 1 -- 172.21.15.114:0/2997644064 learned_addr learned my addr 172.21.15.114:0/2997644064 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f797aa00640 1 -- 172.21.15.114:0/2997644064 >> v1:172.21.15.116:6789/0 conn(0x7f797c152c50 legacy=0x7f797c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f797aa00640 1 -- 172.21.15.114:0/2997644064 >> v1:172.21.15.114:6789/0 conn(0x7f797c06db50 legacy=0x7f797c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f797aa00640 1 -- 172.21.15.114:0/2997644064 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c156830 con 0x7f797c0c25a0 2024-02-17T12:17:34.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.937+0000 7f7979600640 1 -- 172.21.15.114:0/2997644064 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573873000 0 0) 0x7f797c156270 con 0x7f797c06db50 2024-02-17T12:17:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f797aa00640 1 --2- 172.21.15.114:0/2997644064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c0c25a0 0x7f797c06e980 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f796c009d90 tx=0x7f796c01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af773818ba45de6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f7979600640 1 -- 172.21.15.114:0/2997644064 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0a5800 con 0x7f797c0c25a0 2024-02-17T12:17:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f7979600640 1 -- 172.21.15.114:0/2997644064 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0a5960 con 0x7f797c0c25a0 2024-02-17T12:17:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f7979600640 1 -- 172.21.15.114:0/2997644064 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0a5cf0 con 0x7f797c0c25a0 2024-02-17T12:17:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f7981800640 1 -- 172.21.15.114:0/2997644064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c0c25a0 msgr2=0x7f797c06e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f7981800640 1 --2- 172.21.15.114:0/2997644064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c0c25a0 0x7f797c06e980 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f796c009d90 tx=0x7f796c01c820 comp rx=0 tx=0).stop 2024-02-17T12:17:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f7981800640 1 -- 172.21.15.114:0/2997644064 shutdown_connections 2024-02-17T12:17:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f7981800640 1 --2- 172.21.15.114:0/2997644064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c0c25a0 0x7f797c06e980 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f7981800640 1 -- 172.21.15.114:0/2997644064 >> 172.21.15.114:0/2997644064 conn(0x7f797c0a8490 msgr2=0x7f797c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f7981800640 1 -- 172.21.15.114:0/2997644064 shutdown_connections 2024-02-17T12:17:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.941+0000 7f7981800640 1 -- 172.21.15.114:0/2997644064 wait complete. 2024-02-17T12:17:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 Processor -- start 2024-02-17T12:17:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 -- start start 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c06db50 0x7f797c0a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f797c0c25a0 0x7f797c0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f797c152c50 0x7f797c1f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0aacb0 con 0x7f797c06db50 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0aaf00 con 0x7f797c0c25a0 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c151c20 con 0x7f797c152c50 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c06db50 0x7f797c0a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c06db50 0x7f797c0a9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56360/0 (socket says 172.21.15.114:56360) 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797aa00640 1 -- 172.21.15.114:0/1155201976 learned_addr learned my addr 172.21.15.114:0/1155201976 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797b400640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f797c152c50 0x7f797c1f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797a000640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f797c0c25a0 0x7f797c0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797aa00640 1 -- 172.21.15.114:0/1155201976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f797c152c50 msgr2=0x7f797c1f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797aa00640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f797c152c50 0x7f797c1f06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797aa00640 1 -- 172.21.15.114:0/1155201976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f797c0c25a0 msgr2=0x7f797c0bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797aa00640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f797c0c25a0 0x7f797c0bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797aa00640 1 -- 172.21.15.114:0/1155201976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c009a70 con 0x7f797c06db50 2024-02-17T12:17:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f797aa00640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c06db50 0x7f797c0a9830 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f796c0b0040 tx=0x7f796c0195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7972a00640 1 -- 172.21.15.114:0/1155201976 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0b9860 con 0x7f797c06db50 2024-02-17T12:17:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7972a00640 1 -- 172.21.15.114:0/1155201976 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0b99c0 con 0x7f797c06db50 2024-02-17T12:17:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 -- 172.21.15.114:0/1155201976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c151f00 con 0x7f797c06db50 2024-02-17T12:17:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7972a00640 1 -- 172.21.15.114:0/1155201976 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0b9d70 con 0x7f797c06db50 2024-02-17T12:17:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 -- 172.21.15.114:0/1155201976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c1524c0 con 0x7f797c06db50 2024-02-17T12:17:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.945+0000 7f7981800640 1 -- 172.21.15.114:0/1155201976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c1526b0 con 0x7f797c06db50 2024-02-17T12:17:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.949+0000 7f7972a00640 1 -- 172.21.15.114:0/1155201976 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f796c0ad440 con 0x7f797c06db50 2024-02-17T12:17:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.949+0000 7f7972a00640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f795c066e40 0x7f795c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.949+0000 7f7972a00640 1 -- 172.21.15.114:0/1155201976 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f796c120230 con 0x7f797c06db50 2024-02-17T12:17:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.949+0000 7f797a000640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f795c066e40 0x7f795c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:34.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.949+0000 7f797a000640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f795c066e40 0x7f795c069300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7968007fd0 tx=0x7f7968007ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:34.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:34.953+0000 7f7972a00640 1 -- 172.21.15.114:0/1155201976 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f796c0ecdd0 con 0x7f797c06db50 2024-02-17T12:17:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.141+0000 7f7981800640 1 -- 172.21.15.114:0/1155201976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f797c151d60 con 0x7f797c06db50 2024-02-17T12:17:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.141+0000 7f7972a00640 1 -- 172.21.15.114:0/1155201976 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7f797c151d60 con 0x7f797c06db50 2024-02-17T12:17:35.150 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:17:35.150 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-02-17T12:17:35.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 -- 172.21.15.114:0/1155201976 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f795c066e40 msgr2=0x7f795c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:35.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f795c066e40 0x7f795c069300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7968007fd0 tx=0x7f7968007ba0 comp rx=0 tx=0).stop 2024-02-17T12:17:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 -- 172.21.15.114:0/1155201976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c06db50 msgr2=0x7f797c0a9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c06db50 0x7f797c0a9830 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f796c0b0040 tx=0x7f796c0195c0 comp rx=0 tx=0).stop 2024-02-17T12:17:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 -- 172.21.15.114:0/1155201976 shutdown_connections 2024-02-17T12:17:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f797c152c50 0x7f797c1f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f797c0c25a0 0x7f797c0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f795c066e40 0x7f795c069300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 --2- 172.21.15.114:0/1155201976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f797c06db50 0x7f797c0a9830 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 -- 172.21.15.114:0/1155201976 >> 172.21.15.114:0/1155201976 conn(0x7f797c0a8490 msgr2=0x7f797c0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 -- 172.21.15.114:0/1155201976 shutdown_connections 2024-02-17T12:17:35.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:35.145+0000 7f7981800640 1 -- 172.21.15.114:0/1155201976 wait complete. 2024-02-17T12:17:35.171 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-02-17T12:17:35.172 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:17:35.172 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-02-17T12:17:35.172 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-02-17T12:17:35.172 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:17:35.172 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-02-17T12:17:35.172 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:17:35.172 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.ebqA7Va0CB 2024-02-17T12:17:35.172 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-02-17T12:17:35.180 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.Vn0YWDJ5zt 2024-02-17T12:17:35.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /tmp/tmp.ebqA7Va0CB /tmp/tmp.Vn0YWDJ5zt 2024-02-17T12:17:35.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.Vn0YWDJ5zt 2024-02-17T12:17:35.363 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.Vn0YWDJ5zt is 185B 2024-02-17T12:17:35.378 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.Vn0YWDJ5zt 2024-02-17T12:17:35.387 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDco9BlQSTJBRAAk9inCLXcElmys8nQK+rN9g== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2024-02-17T12:17:35.387 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:17:35.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:35.387 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-02-17T12:17:35.439 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:17:35.439 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:17:35.439 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:17:35.439 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:35.439 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-02-17T12:17:35.439 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:35.439 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:35.439 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:35.439 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-02-17T12:17:35.439 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42431sec preferred_lft 42431sec 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:a0:c1:dc:19 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:17:35.440 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:17:35.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:35.442 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:17:35.500 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-02-17T12:17:35.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:35.502 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-02-17T12:17:35.553 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-02-17T12:17:35.553 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:17:35.553 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:17:35.553 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:17:35.553 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:17:35.553 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:17:35.553 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:35.553 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:35.554 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:17:35.554 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:17:35.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:35.554 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:17:35.554 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:17:35.554 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:17:35.554 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:17:35.554 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:17:35.554 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:17:35.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:35.642 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-02-17T12:17:35.650 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T12:17:35.651 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:17:35.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:35.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-02-17T12:17:35.713 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:17:35.713 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T12:17:35.762 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:17:35.762 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:17:35.762 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:17:35.810 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:17:35.810 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/tmp/tmp.ebqA7Va0CB of=/dev/stdout 2024-02-17T12:17:35.859 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:17:35.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:35.859 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDco9BlQSTJBRAAk9inCLXcElmys8nQK+rN9g==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:17:35.950 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQDco9BlQSTJBRAAk9inCLXcElmys8nQK+rN9g==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:17:35.950 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-02-17T12:17:35.950 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:17:35.950 INFO:teuthology.orchestra.run.smithi114.stdout:keyring.get_secret failed 2024-02-17T12:17:35.966 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQDco9BlQSTJBRAAk9inCLXcElmys8nQK+rN9g==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:17:35.966 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-02-17T12:17:35.966 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:17:35.966 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:17:35.966 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:17:35.967 INFO:teuthology.orchestra.run.smithi114.stdout:keyring.get_secret failed 2024-02-17T12:17:35.972 INFO:teuthology.orchestra.run.smithi114.stderr:mount error: no mds (Metadata Server) is up. The cluster might be laggy, or you may not be authorized 2024-02-17T12:17:35.973 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQDco9BlQSTJBRAAk9inCLXcElmys8nQK+rN9g==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:17:35.973 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-02-17T12:17:35.973 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:17:35.973 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:17:35.974 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:17:35.974 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:17:35.974 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:17:35.974 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:17:35.977 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-17T12:17:35.977 INFO:tasks.cephfs.kernel_mount:mount command failed 2024-02-17T12:17:35.977 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-17T12:17:35.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:17:36.105 DEBUG:teuthology.orchestra.run.smithi116:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:17:36.209 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-17T12:17:36.209 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:17:36.209 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:36.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354568k,nr_inodes=4088642,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2004 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-17T12:17:36.218 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:17:36.218 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:36.226 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:17:36.226 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:36.278 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:36.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f3000e00640 1 Processor -- start 2024-02-17T12:17:36.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f3000e00640 1 -- start start 2024-02-17T12:17:36.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f3000e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ffc152540 0x7f2ffc06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f3000e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ffc154e30 0x7f2ffc0aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f3000e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ffc155dd0 con 0x7f2ffc0c6460 2024-02-17T12:17:36.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f3000e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc1588c0 con 0x7f2ffc152540 2024-02-17T12:17:36.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f3000e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc155810 con 0x7f2ffc154e30 2024-02-17T12:17:36.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f2ff9e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ffc152540 0x7f2ffc06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f2ff9e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ffc152540 0x7f2ffc06ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34480/0 (socket says 172.21.15.114:34480) 2024-02-17T12:17:36.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f2ff9e00640 1 -- 172.21.15.114:0/3053399076 learned_addr learned my addr 172.21.15.114:0/3053399076 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:36.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f2ffa800640 1 --2- 172.21.15.114:0/3053399076 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ffc154e30 0x7f2ffc0aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f2ff9e00640 1 -- 172.21.15.114:0/3053399076 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ffc154e30 msgr2=0x7f2ffc0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:36.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f2ff9e00640 1 --2- 172.21.15.114:0/3053399076 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ffc154e30 0x7f2ffc0aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f2ff9e00640 1 -- 172.21.15.114:0/3053399076 >> v1:172.21.15.116:6789/0 conn(0x7f2ffc0c6460 legacy=0x7f2ffc158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:36.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.405+0000 7f2ff9e00640 1 -- 172.21.15.114:0/3053399076 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc155af0 con 0x7f2ffc152540 2024-02-17T12:17:36.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f2ff9e00640 1 --2- 172.21.15.114:0/3053399076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc152540 0x7f2ffc06ff80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2fec009e50 tx=0x7f2fec01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18db3c2f5f5d4bf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f2ff8a00640 1 -- 172.21.15.114:0/3053399076 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0a5660 con 0x7f2ffc152540 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f2ff8a00640 1 -- 172.21.15.114:0/3053399076 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec0a57c0 con 0x7f2ffc152540 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f2ff8a00640 1 -- 172.21.15.114:0/3053399076 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0a5b50 con 0x7f2ffc152540 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f3000e00640 1 -- 172.21.15.114:0/3053399076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc152540 msgr2=0x7f2ffc06ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f3000e00640 1 --2- 172.21.15.114:0/3053399076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc152540 0x7f2ffc06ff80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2fec009e50 tx=0x7f2fec01c8d0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f3000e00640 1 -- 172.21.15.114:0/3053399076 shutdown_connections 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f3000e00640 1 --2- 172.21.15.114:0/3053399076 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ffc154e30 0x7f2ffc0aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f3000e00640 1 --2- 172.21.15.114:0/3053399076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc152540 0x7f2ffc06ff80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f3000e00640 1 -- 172.21.15.114:0/3053399076 >> 172.21.15.114:0/3053399076 conn(0x7f2ffc0c4f20 msgr2=0x7f2ffc0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f3000e00640 1 -- 172.21.15.114:0/3053399076 shutdown_connections 2024-02-17T12:17:36.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.409+0000 7f3000e00640 1 -- 172.21.15.114:0/3053399076 wait complete. 2024-02-17T12:17:36.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 Processor -- start 2024-02-17T12:17:36.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 -- start start 2024-02-17T12:17:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc0c6460 0x7f2ffc1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ffc152540 0x7f2ffc150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc154e30 0x7f2ffc1edd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0abee0 con 0x7f2ffc0c6460 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc1484d0 con 0x7f2ffc154e30 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0ad2d0 con 0x7f2ffc152540 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc0c6460 0x7f2ffc1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc0c6460 0x7f2ffc1575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34492/0 (socket says 172.21.15.114:34492) 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff9e00640 1 -- 172.21.15.114:0/3001793140 learned_addr learned my addr 172.21.15.114:0/3001793140 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff9400640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ffc152540 0x7f2ffc150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ffa800640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc154e30 0x7f2ffc1edd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff9e00640 1 -- 172.21.15.114:0/3001793140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ffc152540 msgr2=0x7f2ffc150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff9e00640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ffc152540 0x7f2ffc150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff9e00640 1 -- 172.21.15.114:0/3001793140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc154e30 msgr2=0x7f2ffc1edd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff9e00640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc154e30 0x7f2ffc1edd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff9e00640 1 -- 172.21.15.114:0/3001793140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec009b30 con 0x7f2ffc0c6460 2024-02-17T12:17:36.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff9e00640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc0c6460 0x7f2ffc1575f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2fec01af80 tx=0x7f2fec019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:36.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff2000640 1 -- 172.21.15.114:0/3001793140 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0b8670 con 0x7f2ffc0c6460 2024-02-17T12:17:36.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff2000640 1 -- 172.21.15.114:0/3001793140 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec0b87d0 con 0x7f2ffc0c6460 2024-02-17T12:17:36.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f2ff2000640 1 -- 172.21.15.114:0/3001793140 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0b8b60 con 0x7f2ffc0c6460 2024-02-17T12:17:36.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 -- 172.21.15.114:0/3001793140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc1f12d0 con 0x7f2ffc0c6460 2024-02-17T12:17:36.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 -- 172.21.15.114:0/3001793140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ffc1f1890 con 0x7f2ffc0c6460 2024-02-17T12:17:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.413+0000 7f3000e00640 1 -- 172.21.15.114:0/3001793140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ffc074840 con 0x7f2ffc0c6460 2024-02-17T12:17:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.417+0000 7f2ff2000640 1 -- 172.21.15.114:0/3001793140 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2fec0b8cc0 con 0x7f2ffc0c6460 2024-02-17T12:17:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.417+0000 7f2ff2000640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fdc066e40 0x7f2fdc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.417+0000 7f2ff2000640 1 -- 172.21.15.114:0/3001793140 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2fec120280 con 0x7f2ffc0c6460 2024-02-17T12:17:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.417+0000 7f2ff9400640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fdc066e40 0x7f2fdc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.417+0000 7f2ff9400640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fdc066e40 0x7f2fdc069300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0a9f50 tx=0x7f2fe8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:36.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.421+0000 7f2ff2000640 1 -- 172.21.15.114:0/3001793140 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2fec0ecd00 con 0x7f2ffc0c6460 2024-02-17T12:17:36.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.577+0000 7f3000e00640 1 -- 172.21.15.114:0/3001793140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ffc1ed9a0 con 0x7f2ffc0c6460 2024-02-17T12:17:36.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f2ff2000640 1 -- 172.21.15.114:0/3001793140 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20407 (secure 0 0 0) 0x7f2fec0f03c0 con 0x7f2ffc0c6460 2024-02-17T12:17:36.587 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:36.588 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:24.325322+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:36.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 -- 172.21.15.114:0/3001793140 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fdc066e40 msgr2=0x7f2fdc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fdc066e40 0x7f2fdc069300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0a9f50 tx=0x7f2fe8009040 comp rx=0 tx=0).stop 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 -- 172.21.15.114:0/3001793140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc0c6460 msgr2=0x7f2ffc1575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc0c6460 0x7f2ffc1575f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2fec01af80 tx=0x7f2fec019670 comp rx=0 tx=0).stop 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 -- 172.21.15.114:0/3001793140 shutdown_connections 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ffc154e30 0x7f2ffc1edd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2ffc152540 0x7f2ffc150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fdc066e40 0x7f2fdc069300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 --2- 172.21.15.114:0/3001793140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ffc0c6460 0x7f2ffc1575f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 -- 172.21.15.114:0/3001793140 >> 172.21.15.114:0/3001793140 conn(0x7f2ffc0c4f20 msgr2=0x7f2ffc0c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 -- 172.21.15.114:0/3001793140 shutdown_connections 2024-02-17T12:17:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.581+0000 7f3000e00640 1 -- 172.21.15.114:0/3001793140 wait complete. 2024-02-17T12:17:36.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:17:03.897758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:17:04.389290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:17:20.859567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:17:21.688611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:17:36.609 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:17:36.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.737+0000 7fadf7800640 1 Processor -- start 2024-02-17T12:17:36.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.737+0000 7fadf7800640 1 -- start start 2024-02-17T12:17:36.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadf7800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fadf0152510 0x7fadf00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadf7800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fadf006ef60 0x7fadf0158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadf7800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf006e890 con 0x7fadf00c0640 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadf7800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf00c2670 con 0x7fadf006ef60 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadf7800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf0158370 con 0x7fadf0152510 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadefe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fadf006ef60 0x7fadf0158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadefe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fadf006ef60 0x7fadf0158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34508/0 (socket says 172.21.15.114:34508) 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadefe00640 1 -- 172.21.15.114:0/2906659342 learned_addr learned my addr 172.21.15.114:0/2906659342 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadf4e00640 1 --2- 172.21.15.114:0/2906659342 >> v2:172.21.15.116:3300/0 conn(0x7fadf0152510 0x7fadf00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadefe00640 1 -- 172.21.15.114:0/2906659342 >> v2:172.21.15.116:3300/0 conn(0x7fadf0152510 msgr2=0x7fadf00c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadefe00640 1 --2- 172.21.15.114:0/2906659342 >> v2:172.21.15.116:3300/0 conn(0x7fadf0152510 0x7fadf00c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadefe00640 1 -- 172.21.15.114:0/2906659342 >> v1:172.21.15.116:6789/0 conn(0x7fadf00c0640 legacy=0x7fadf00c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.741+0000 7fadefe00640 1 -- 172.21.15.114:0/2906659342 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf006e5b0 con 0x7fadf006ef60 2024-02-17T12:17:36.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadefe00640 1 --2- 172.21.15.114:0/2906659342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 0x7fadf0158800 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fadf00bfd30 tx=0x7fadd801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c4df73374428ef server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:36.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadef400640 1 -- 172.21.15.114:0/2906659342 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80ab660 con 0x7fadf006ef60 2024-02-17T12:17:36.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadef400640 1 -- 172.21.15.114:0/2906659342 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd80ab7c0 con 0x7fadf006ef60 2024-02-17T12:17:36.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadef400640 1 -- 172.21.15.114:0/2906659342 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80abb50 con 0x7fadf006ef60 2024-02-17T12:17:36.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadf7800640 1 -- 172.21.15.114:0/2906659342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 msgr2=0x7fadf0158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadf7800640 1 --2- 172.21.15.114:0/2906659342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 0x7fadf0158800 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fadf00bfd30 tx=0x7fadd801c460 comp rx=0 tx=0).stop 2024-02-17T12:17:36.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadf7800640 1 -- 172.21.15.114:0/2906659342 shutdown_connections 2024-02-17T12:17:36.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadf7800640 1 --2- 172.21.15.114:0/2906659342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 0x7fadf0158800 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadf7800640 1 --2- 172.21.15.114:0/2906659342 >> v2:172.21.15.116:3300/0 conn(0x7fadf0152510 0x7fadf00c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadf7800640 1 -- 172.21.15.114:0/2906659342 >> 172.21.15.114:0/2906659342 conn(0x7fadf00a8490 msgr2=0x7fadf00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:36.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadf7800640 1 -- 172.21.15.114:0/2906659342 shutdown_connections 2024-02-17T12:17:36.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadf7800640 1 -- 172.21.15.114:0/2906659342 wait complete. 2024-02-17T12:17:36.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadf7800640 1 Processor -- start 2024-02-17T12:17:36.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.745+0000 7fadf7800640 1 -- start start 2024-02-17T12:17:36.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf7800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 0x7fadf01f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf7800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadf00c0640 0x7fadf0152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf7800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadf0152510 0x7fadf0072710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf7800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c4c10 con 0x7fadf006ef60 2024-02-17T12:17:36.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf7800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf01f1910 con 0x7fadf00c0640 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf7800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c4e60 con 0x7fadf0152510 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 0x7fadf01f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 0x7fadf01f13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34516/0 (socket says 172.21.15.114:34516) 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf4e00640 1 -- 172.21.15.114:0/2291494026 learned_addr learned my addr 172.21.15.114:0/2291494026 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadefe00640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadf00c0640 0x7fadf0152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf5800640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadf0152510 0x7fadf0072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf4e00640 1 -- 172.21.15.114:0/2291494026 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadf0152510 msgr2=0x7fadf0072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf4e00640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadf0152510 0x7fadf0072710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf4e00640 1 -- 172.21.15.114:0/2291494026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadf00c0640 msgr2=0x7fadf0152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf4e00640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadf00c0640 0x7fadf0152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf4e00640 1 -- 172.21.15.114:0/2291494026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80094d0 con 0x7fadf006ef60 2024-02-17T12:17:36.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadefe00640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadf00c0640 0x7fadf0152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:36.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf4e00640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 0x7fadf01f13d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fade0007ef0 tx=0x7fade000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:36.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadecc00640 1 -- 172.21.15.114:0/2291494026 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0014620 con 0x7fadf006ef60 2024-02-17T12:17:36.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadecc00640 1 -- 172.21.15.114:0/2291494026 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade0014780 con 0x7fadf006ef60 2024-02-17T12:17:36.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadecc00640 1 -- 172.21.15.114:0/2291494026 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0014b30 con 0x7fadf006ef60 2024-02-17T12:17:36.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf7800640 1 -- 172.21.15.114:0/2291494026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf00c5140 con 0x7fadf006ef60 2024-02-17T12:17:36.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf7800640 1 -- 172.21.15.114:0/2291494026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf00c5700 con 0x7fadf006ef60 2024-02-17T12:17:36.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadf7800640 1 -- 172.21.15.114:0/2291494026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf0074840 con 0x7fadf006ef60 2024-02-17T12:17:36.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadecc00640 1 -- 172.21.15.114:0/2291494026 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fade0014c90 con 0x7fadf006ef60 2024-02-17T12:17:36.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadecc00640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fadcc066e40 0x7fadcc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:36.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.749+0000 7fadecc00640 1 -- 172.21.15.114:0/2291494026 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fade00857a0 con 0x7fadf006ef60 2024-02-17T12:17:36.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.753+0000 7fadefe00640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fadcc066e40 0x7fadcc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:36.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.753+0000 7fadefe00640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fadcc066e40 0x7fadcc069300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fadd80af000 tx=0x7fadd80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:36.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.757+0000 7fadecc00640 1 -- 172.21.15.114:0/2291494026 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fade0052230 con 0x7fadf006ef60 2024-02-17T12:17:36.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.909+0000 7fadf7800640 1 -- 172.21.15.114:0/2291494026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadf0151d40 con 0x7fadf006ef60 2024-02-17T12:17:36.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadecc00640 1 -- 172.21.15.114:0/2291494026 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fade00558f0 con 0x7fadf006ef60 2024-02-17T12:17:36.919 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:17:36.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 -- 172.21.15.114:0/2291494026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fadcc066e40 msgr2=0x7fadcc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fadcc066e40 0x7fadcc069300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fadd80af000 tx=0x7fadd80a7000 comp rx=0 tx=0).stop 2024-02-17T12:17:36.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 -- 172.21.15.114:0/2291494026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 msgr2=0x7fadf01f13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:36.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 0x7fadf01f13d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fade0007ef0 tx=0x7fade000e4b0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 -- 172.21.15.114:0/2291494026 shutdown_connections 2024-02-17T12:17:36.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fadf0152510 0x7fadf0072710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fadf00c0640 0x7fadf0152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fadcc066e40 0x7fadcc069300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 --2- 172.21.15.114:0/2291494026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadf006ef60 0x7fadf01f13d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:36.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 -- 172.21.15.114:0/2291494026 >> 172.21.15.114:0/2291494026 conn(0x7fadf00a8490 msgr2=0x7fadf0153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:36.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 -- 172.21.15.114:0/2291494026 shutdown_connections 2024-02-17T12:17:36.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:36.913+0000 7fadf7800640 1 -- 172.21.15.114:0/2291494026 wait complete. 2024-02-17T12:17:36.940 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:17:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.073+0000 7f2b47e00640 1 Processor -- start 2024-02-17T12:17:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.073+0000 7f2b47e00640 1 -- start start 2024-02-17T12:17:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.073+0000 7f2b47e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b480c3760 0x7f2b48155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.073+0000 7f2b47e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b48070b50 0x7f2b48155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b480c5380 con 0x7f2b480c66c0 2024-02-17T12:17:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b480c4b10 con 0x7f2b48070b50 2024-02-17T12:17:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480c2ca0 con 0x7f2b480c3760 2024-02-17T12:17:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b48070b50 0x7f2b48155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2b48070b50 0x7f2b48155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34518/0 (socket says 172.21.15.114:34518) 2024-02-17T12:17:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47400640 1 -- 172.21.15.114:0/3054626833 learned_addr learned my addr 172.21.15.114:0/3054626833 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b46a00640 1 --2- 172.21.15.114:0/3054626833 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b480c3760 0x7f2b48155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47400640 1 -- 172.21.15.114:0/3054626833 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b480c3760 msgr2=0x7f2b48155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47400640 1 --2- 172.21.15.114:0/3054626833 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b480c3760 0x7f2b48155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47400640 1 -- 172.21.15.114:0/3054626833 >> v1:172.21.15.116:6789/0 conn(0x7f2b480c66c0 legacy=0x7f2b48158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47400640 1 -- 172.21.15.114:0/3054626833 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480c2f80 con 0x7f2b48070b50 2024-02-17T12:17:37.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b47400640 1 --2- 172.21.15.114:0/3054626833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b48070b50 0x7f2b48155bb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009e50 tx=0x7f2b4001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7593c6ac9b63f79 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b45600640 1 -- 172.21.15.114:0/3054626833 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400a57d0 con 0x7f2b48070b50 2024-02-17T12:17:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b45600640 1 -- 172.21.15.114:0/3054626833 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b400a5930 con 0x7f2b48070b50 2024-02-17T12:17:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.077+0000 7f2b45600640 1 -- 172.21.15.114:0/3054626833 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400a5cc0 con 0x7f2b48070b50 2024-02-17T12:17:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 -- 172.21.15.114:0/3054626833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b48070b50 msgr2=0x7f2b48155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 --2- 172.21.15.114:0/3054626833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b48070b50 0x7f2b48155bb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009e50 tx=0x7f2b4001c910 comp rx=0 tx=0).stop 2024-02-17T12:17:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 -- 172.21.15.114:0/3054626833 shutdown_connections 2024-02-17T12:17:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 --2- 172.21.15.114:0/3054626833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b48070b50 0x7f2b48155bb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 --2- 172.21.15.114:0/3054626833 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b480c3760 0x7f2b48155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 -- 172.21.15.114:0/3054626833 >> 172.21.15.114:0/3054626833 conn(0x7f2b480a9f70 msgr2=0x7f2b480aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 -- 172.21.15.114:0/3054626833 shutdown_connections 2024-02-17T12:17:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 -- 172.21.15.114:0/3054626833 wait complete. 2024-02-17T12:17:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 Processor -- start 2024-02-17T12:17:37.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 -- start start 2024-02-17T12:17:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b48070b50 0x7f2b481f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480c3760 0x7f2b480ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b480c66c0 0x7f2b481561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b481f14e0 con 0x7f2b480c3760 2024-02-17T12:17:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48152ca0 con 0x7f2b480c66c0 2024-02-17T12:17:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b481f0ed0 con 0x7f2b48070b50 2024-02-17T12:17:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b46000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480c3760 0x7f2b480ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b46000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480c3760 0x7f2b480ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34530/0 (socket says 172.21.15.114:34530) 2024-02-17T12:17:37.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b46000640 1 -- 172.21.15.114:0/24534220 learned_addr learned my addr 172.21.15.114:0/24534220 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b46a00640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b48070b50 0x7f2b481f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b47400640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b480c66c0 0x7f2b481561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b46000640 1 -- 172.21.15.114:0/24534220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b48070b50 msgr2=0x7f2b481f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b46000640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b48070b50 0x7f2b481f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b46000640 1 -- 172.21.15.114:0/24534220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b480c66c0 msgr2=0x7f2b481561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b46000640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b480c66c0 0x7f2b481561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b46000640 1 -- 172.21.15.114:0/24534220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b40009b30 con 0x7f2b480c3760 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.081+0000 7f2b46000640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480c3760 0x7f2b480ac2b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800c450 tx=0x7f2b3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.085+0000 7f2b3ea00640 1 -- 172.21.15.114:0/24534220 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380052d0 con 0x7f2b480c3760 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.085+0000 7f2b3ea00640 1 -- 172.21.15.114:0/24534220 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b38005430 con 0x7f2b480c3760 2024-02-17T12:17:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.085+0000 7f2b3ea00640 1 -- 172.21.15.114:0/24534220 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38007260 con 0x7f2b480c3760 2024-02-17T12:17:37.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.085+0000 7f2b47e00640 1 -- 172.21.15.114:0/24534220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b48152f20 con 0x7f2b480c3760 2024-02-17T12:17:37.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.085+0000 7f2b47e00640 1 -- 172.21.15.114:0/24534220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b48153200 con 0x7f2b480c3760 2024-02-17T12:17:37.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.085+0000 7f2b47e00640 1 -- 172.21.15.114:0/24534220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b481f1690 con 0x7f2b480c3760 2024-02-17T12:17:37.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.085+0000 7f2b3ea00640 1 -- 172.21.15.114:0/24534220 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2b380073c0 con 0x7f2b480c3760 2024-02-17T12:17:37.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.085+0000 7f2b3ea00640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b24066e40 0x7f2b24069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.085+0000 7f2b3ea00640 1 -- 172.21.15.114:0/24534220 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2b380844f0 con 0x7f2b480c3760 2024-02-17T12:17:37.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.085+0000 7f2b46a00640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b24066e40 0x7f2b24069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.089+0000 7f2b46a00640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b24066e40 0x7f2b24069300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b48151120 tx=0x7f2b30009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:37.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.089+0000 7f2b3ea00640 1 -- 172.21.15.114:0/24534220 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2b481f1690 con 0x7f2b480c3760 2024-02-17T12:17:37.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.245+0000 7f2b47e00640 1 -- 172.21.15.114:0/24534220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b481f1690 con 0x7f2b480c3760 2024-02-17T12:17:37.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.245+0000 7f2b3ea00640 1 -- 172.21.15.114:0/24534220 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b481f1690 con 0x7f2b480c3760 2024-02-17T12:17:37.255 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:17:37.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 -- 172.21.15.114:0/24534220 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b24066e40 msgr2=0x7f2b24069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b24066e40 0x7f2b24069300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b48151120 tx=0x7f2b30009190 comp rx=0 tx=0).stop 2024-02-17T12:17:37.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 -- 172.21.15.114:0/24534220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480c3760 msgr2=0x7f2b480ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480c3760 0x7f2b480ac2b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800c450 tx=0x7f2b3800c910 comp rx=0 tx=0).stop 2024-02-17T12:17:37.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 -- 172.21.15.114:0/24534220 shutdown_connections 2024-02-17T12:17:37.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b480c66c0 0x7f2b481561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b24066e40 0x7f2b24069300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b480c3760 0x7f2b480ac2b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 --2- 172.21.15.114:0/24534220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b48070b50 0x7f2b481f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 -- 172.21.15.114:0/24534220 >> 172.21.15.114:0/24534220 conn(0x7f2b480a9f70 msgr2=0x7f2b480aa350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 -- 172.21.15.114:0/24534220 shutdown_connections 2024-02-17T12:17:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.249+0000 7f2b47e00640 1 -- 172.21.15.114:0/24534220 wait complete. 2024-02-17T12:17:37.277 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:17:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.405+0000 7f39e0a00640 1 Processor -- start 2024-02-17T12:17:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.405+0000 7f39e0a00640 1 -- start start 2024-02-17T12:17:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.405+0000 7f39e0a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f39dc06ae70 0x7f39dc152390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39e0a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39dc0c0d00 con 0x7f39dc0c20e0 2024-02-17T12:17:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39e0a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39dc0c1880 con 0x7f39dc152ce0 2024-02-17T12:17:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39e0a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39dc0c0f50 con 0x7f39dc06ae70 2024-02-17T12:17:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39d9e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f39dc0c20e0 0x7f39dc14ec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49114/0 (socket says 172.21.15.114:49114) 2024-02-17T12:17:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39d9e00640 1 -- 172.21.15.114:0/2400220139 learned_addr learned my addr 172.21.15.114:0/2400220139 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39da800640 1 --2- 172.21.15.114:0/2400220139 >> v2:172.21.15.116:3300/0 conn(0x7f39dc06ae70 0x7f39dc152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39d9400640 1 -- 172.21.15.114:0/2400220139 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445112456 0 0) 0x7f39dc0c0d00 con 0x7f39dc0c20e0 2024-02-17T12:17:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39d9400640 1 -- 172.21.15.114:0/2400220139 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c0003530 con 0x7f39dc0c20e0 2024-02-17T12:17:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39d9400640 1 -- 172.21.15.114:0/2400220139 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464670238 0 0) 0x7f39dc0c1880 con 0x7f39dc152ce0 2024-02-17T12:17:37.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39d9400640 1 -- 172.21.15.114:0/2400220139 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39dc0c0d00 con 0x7f39dc152ce0 2024-02-17T12:17:37.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39da800640 1 -- 172.21.15.114:0/2400220139 >> v1:172.21.15.116:6789/0 conn(0x7f39dc152ce0 legacy=0x7f39dc15c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39da800640 1 -- 172.21.15.114:0/2400220139 >> v1:172.21.15.114:6789/0 conn(0x7f39dc0c20e0 legacy=0x7f39dc14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39d9400640 1 -- 172.21.15.114:0/2400220139 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1309497059 0 0) 0x7f39c0003530 con 0x7f39dc0c20e0 2024-02-17T12:17:37.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39da800640 1 -- 172.21.15.114:0/2400220139 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc0c1230 con 0x7f39dc06ae70 2024-02-17T12:17:37.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.409+0000 7f39da800640 1 --2- 172.21.15.114:0/2400220139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39dc06ae70 0x7f39dc152390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009d90 tx=0x7f39cc01c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1500bd8c7336074f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:37.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39d9400640 1 -- 172.21.15.114:0/2400220139 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4001680 con 0x7f39dc06ae70 2024-02-17T12:17:37.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39d9400640 1 -- 172.21.15.114:0/2400220139 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc0a64b0 con 0x7f39dc06ae70 2024-02-17T12:17:37.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39d9400640 1 -- 172.21.15.114:0/2400220139 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc0a6840 con 0x7f39dc06ae70 2024-02-17T12:17:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 -- 172.21.15.114:0/2400220139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39dc06ae70 msgr2=0x7f39dc152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 --2- 172.21.15.114:0/2400220139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39dc06ae70 0x7f39dc152390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009d90 tx=0x7f39cc01c740 comp rx=0 tx=0).stop 2024-02-17T12:17:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 -- 172.21.15.114:0/2400220139 shutdown_connections 2024-02-17T12:17:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 --2- 172.21.15.114:0/2400220139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39dc06ae70 0x7f39dc152390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 -- 172.21.15.114:0/2400220139 >> 172.21.15.114:0/2400220139 conn(0x7f39dc0c6300 msgr2=0x7f39dc0c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 -- 172.21.15.114:0/2400220139 shutdown_connections 2024-02-17T12:17:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 -- 172.21.15.114:0/2400220139 wait complete. 2024-02-17T12:17:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 Processor -- start 2024-02-17T12:17:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 -- start start 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39dc06ae70 0x7f39dc0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39dc0c20e0 0x7f39dc1417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39dc152ce0 0x7f39dc141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc14bc20 con 0x7f39dc0c20e0 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc14cbe0 con 0x7f39dc06ae70 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39e0a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc1557b0 con 0x7f39dc152ce0 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39d9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39dc0c20e0 0x7f39dc1417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39d9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39dc0c20e0 0x7f39dc1417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34536/0 (socket says 172.21.15.114:34536) 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39d9e00640 1 -- 172.21.15.114:0/957092981 learned_addr learned my addr 172.21.15.114:0/957092981 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.413+0000 7f39da800640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39dc06ae70 0x7f39dc0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39db200640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39dc152ce0 0x7f39dc141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d9e00640 1 -- 172.21.15.114:0/957092981 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39dc152ce0 msgr2=0x7f39dc141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d9e00640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39dc152ce0 0x7f39dc141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d9e00640 1 -- 172.21.15.114:0/957092981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39dc06ae70 msgr2=0x7f39dc0c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d9e00640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39dc06ae70 0x7f39dc0c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d9e00640 1 -- 172.21.15.114:0/957092981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc009a70 con 0x7f39dc0c20e0 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39db200640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39dc152ce0 0x7f39dc141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d9e00640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39dc0c20e0 0x7f39dc1417a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c730 tx=0x7f39c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d2a00640 1 -- 172.21.15.114:0/957092981 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4005ae0 con 0x7f39dc0c20e0 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d2a00640 1 -- 172.21.15.114:0/957092981 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c4005c40 con 0x7f39dc0c20e0 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d2a00640 1 -- 172.21.15.114:0/957092981 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4007070 con 0x7f39dc0c20e0 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39e0a00640 1 -- 172.21.15.114:0/957092981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39dc13eac0 con 0x7f39dc0c20e0 2024-02-17T12:17:37.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39e0a00640 1 -- 172.21.15.114:0/957092981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc0c5ba0 con 0x7f39dc0c20e0 2024-02-17T12:17:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39e0a00640 1 -- 172.21.15.114:0/957092981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39dc0c1cf0 con 0x7f39dc0c20e0 2024-02-17T12:17:37.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d2a00640 1 -- 172.21.15.114:0/957092981 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f39c40071d0 con 0x7f39dc0c20e0 2024-02-17T12:17:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d2a00640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f39b8066e40 0x7f39b8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.417+0000 7f39d2a00640 1 -- 172.21.15.114:0/957092981 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f39c4084350 con 0x7f39dc0c20e0 2024-02-17T12:17:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.421+0000 7f39da800640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f39b8066e40 0x7f39b8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.421+0000 7f39da800640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f39b8066e40 0x7f39b8069300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0af000 tx=0x7f39cc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.425+0000 7f39d2a00640 1 -- 172.21.15.114:0/957092981 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f39dc0c1cf0 con 0x7f39dc0c20e0 2024-02-17T12:17:37.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.577+0000 7f39e0a00640 1 -- 172.21.15.114:0/957092981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39dc0c1cf0 con 0x7f39dc0c20e0 2024-02-17T12:17:37.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.577+0000 7f39d2a00640 1 -- 172.21.15.114:0/957092981 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39dc0c1cf0 con 0x7f39dc0c20e0 2024-02-17T12:17:37.585 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:17:37.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 -- 172.21.15.114:0/957092981 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f39b8066e40 msgr2=0x7f39b8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f39b8066e40 0x7f39b8069300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0af000 tx=0x7f39cc0a7000 comp rx=0 tx=0).stop 2024-02-17T12:17:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 -- 172.21.15.114:0/957092981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39dc0c20e0 msgr2=0x7f39dc1417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39dc0c20e0 0x7f39dc1417a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c730 tx=0x7f39c400cbf0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 -- 172.21.15.114:0/957092981 shutdown_connections 2024-02-17T12:17:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39dc152ce0 0x7f39dc141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f39b8066e40 0x7f39b8069300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39dc0c20e0 0x7f39dc1417a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 --2- 172.21.15.114:0/957092981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39dc06ae70 0x7f39dc0c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 -- 172.21.15.114:0/957092981 >> 172.21.15.114:0/957092981 conn(0x7f39dc0c6300 msgr2=0x7f39dc14a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 -- 172.21.15.114:0/957092981 shutdown_connections 2024-02-17T12:17:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.581+0000 7f39e0a00640 1 -- 172.21.15.114:0/957092981 wait complete. 2024-02-17T12:17:37.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:17:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f8200640 1 Processor -- start 2024-02-17T12:17:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f8200640 1 -- start start 2024-02-17T12:17:37.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f8200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66f006ff80 0x7f66f00aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f8200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f0155dd0 con 0x7f66f0152540 2024-02-17T12:17:37.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f8200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f01588c0 con 0x7f66f00c6460 2024-02-17T12:17:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f8200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f00703d0 con 0x7f66f006ff80 2024-02-17T12:17:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f5800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f66f0152540 0x7f66f0158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49126/0 (socket says 172.21.15.114:49126) 2024-02-17T12:17:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f5800640 1 -- 172.21.15.114:0/3763278439 learned_addr learned my addr 172.21.15.114:0/3763278439 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f6200640 1 --2- 172.21.15.114:0/3763278439 >> v2:172.21.15.114:3300/0 conn(0x7f66f006ff80 0x7f66f00aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66efe00640 1 -- 172.21.15.114:0/3763278439 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404973019 0 0) 0x7f66f0155dd0 con 0x7f66f0152540 2024-02-17T12:17:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66efe00640 1 -- 172.21.15.114:0/3763278439 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d8003530 con 0x7f66f0152540 2024-02-17T12:17:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f6200640 1 -- 172.21.15.114:0/3763278439 >> v1:172.21.15.116:6789/0 conn(0x7f66f00c6460 legacy=0x7f66f0154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f6200640 1 -- 172.21.15.114:0/3763278439 >> v1:172.21.15.114:6789/0 conn(0x7f66f0152540 legacy=0x7f66f0158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.737+0000 7f66f6200640 1 -- 172.21.15.114:0/3763278439 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f0155540 con 0x7f66f006ff80 2024-02-17T12:17:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66f6200640 1 --2- 172.21.15.114:0/3763278439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 0x7f66f00aa160 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009d90 tx=0x7f66e801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7e21af31b757a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66efe00640 1 -- 172.21.15.114:0/3763278439 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80a5820 con 0x7f66f006ff80 2024-02-17T12:17:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66efe00640 1 -- 172.21.15.114:0/3763278439 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e80a5980 con 0x7f66f006ff80 2024-02-17T12:17:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66efe00640 1 -- 172.21.15.114:0/3763278439 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80a5d10 con 0x7f66f006ff80 2024-02-17T12:17:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66f8200640 1 -- 172.21.15.114:0/3763278439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 msgr2=0x7f66f00aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66f8200640 1 --2- 172.21.15.114:0/3763278439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 0x7f66f00aa160 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009d90 tx=0x7f66e801c850 comp rx=0 tx=0).stop 2024-02-17T12:17:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66f8200640 1 -- 172.21.15.114:0/3763278439 shutdown_connections 2024-02-17T12:17:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66f8200640 1 --2- 172.21.15.114:0/3763278439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 0x7f66f00aa160 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66f8200640 1 -- 172.21.15.114:0/3763278439 >> 172.21.15.114:0/3763278439 conn(0x7f66f00c4f20 msgr2=0x7f66f00c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66f8200640 1 -- 172.21.15.114:0/3763278439 shutdown_connections 2024-02-17T12:17:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.741+0000 7f66f8200640 1 -- 172.21.15.114:0/3763278439 wait complete. 2024-02-17T12:17:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 Processor -- start 2024-02-17T12:17:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 -- start start 2024-02-17T12:17:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 0x7f66f00c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66f00c6460 0x7f66f01431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f66f0152540 0x7f66f0143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f00ad290 con 0x7f66f006ff80 2024-02-17T12:17:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f01f1b50 con 0x7f66f00c6460 2024-02-17T12:17:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f01f0fd0 con 0x7f66f0152540 2024-02-17T12:17:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f5800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 0x7f66f00c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f5800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 0x7f66f00c3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34552/0 (socket says 172.21.15.114:34552) 2024-02-17T12:17:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f5800640 1 -- 172.21.15.114:0/2359135682 learned_addr learned my addr 172.21.15.114:0/2359135682 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f4e00640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66f00c6460 0x7f66f01431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f6200640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f66f0152540 0x7f66f0143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f5800640 1 -- 172.21.15.114:0/2359135682 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f66f0152540 msgr2=0x7f66f0143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f5800640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f66f0152540 0x7f66f0143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f5800640 1 -- 172.21.15.114:0/2359135682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66f00c6460 msgr2=0x7f66f01431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f5800640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66f00c6460 0x7f66f01431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f5800640 1 -- 172.21.15.114:0/2359135682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8009a70 con 0x7f66f006ff80 2024-02-17T12:17:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f4e00640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66f00c6460 0x7f66f01431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f5800640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 0x7f66f00c3b30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c420 tx=0x7f66e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:37.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66ed600640 1 -- 172.21.15.114:0/2359135682 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4005cf0 con 0x7f66f006ff80 2024-02-17T12:17:37.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66ed600640 1 -- 172.21.15.114:0/2359135682 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4005e50 con 0x7f66f006ff80 2024-02-17T12:17:37.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 -- 172.21.15.114:0/2359135682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f01f12b0 con 0x7f66f006ff80 2024-02-17T12:17:37.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66ed600640 1 -- 172.21.15.114:0/2359135682 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40072d0 con 0x7f66f006ff80 2024-02-17T12:17:37.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 -- 172.21.15.114:0/2359135682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f01f1870 con 0x7f66f006ff80 2024-02-17T12:17:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.745+0000 7f66f8200640 1 -- 172.21.15.114:0/2359135682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f0068180 con 0x7f66f006ff80 2024-02-17T12:17:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.749+0000 7f66ed600640 1 -- 172.21.15.114:0/2359135682 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f66e4007430 con 0x7f66f006ff80 2024-02-17T12:17:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.749+0000 7f66ed600640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66d0066e70 0x7f66d0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.749+0000 7f66ed600640 1 -- 172.21.15.114:0/2359135682 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f66e4084300 con 0x7f66f006ff80 2024-02-17T12:17:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.749+0000 7f66f4e00640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66d0066e70 0x7f66d0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.749+0000 7f66f4e00640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66d0066e70 0x7f66d0069330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f66f00c43e0 tx=0x7f66dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.753+0000 7f66ed600640 1 -- 172.21.15.114:0/2359135682 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f66e4050da0 con 0x7f66f006ff80 2024-02-17T12:17:37.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.905+0000 7f66f8200640 1 -- 172.21.15.114:0/2359135682 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66f01ed760 con 0x7f66f006ff80 2024-02-17T12:17:38.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.905+0000 7f66ed600640 1 -- 172.21.15.114:0/2359135682 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7f66e4054460 con 0x7f66f006ff80 2024-02-17T12:17:38.054 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:17:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 -- 172.21.15.114:0/2359135682 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66d0066e70 msgr2=0x7f66d0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66d0066e70 0x7f66d0069330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f66f00c43e0 tx=0x7f66dc009040 comp rx=0 tx=0).stop 2024-02-17T12:17:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 -- 172.21.15.114:0/2359135682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 msgr2=0x7f66f00c3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 0x7f66f00c3b30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c420 tx=0x7f66e400c8e0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 -- 172.21.15.114:0/2359135682 shutdown_connections 2024-02-17T12:17:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f66f0152540 0x7f66f0143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66f00c6460 0x7f66f01431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66d0066e70 0x7f66d0069330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 --2- 172.21.15.114:0/2359135682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f006ff80 0x7f66f00c3b30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 -- 172.21.15.114:0/2359135682 >> 172.21.15.114:0/2359135682 conn(0x7f66f00c4f20 msgr2=0x7f66f014d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:38.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 -- 172.21.15.114:0/2359135682 shutdown_connections 2024-02-17T12:17:38.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:37.909+0000 7f66f8200640 1 -- 172.21.15.114:0/2359135682 wait complete. 2024-02-17T12:17:38.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:17:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.185+0000 7fb687800640 1 Processor -- start 2024-02-17T12:17:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.185+0000 7fb687800640 1 -- start start 2024-02-17T12:17:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb687800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb6800c25a0 0x7fb68006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb687800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb680152c50 0x7fb6801530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb687800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb680156270 con 0x7fb68006db50 2024-02-17T12:17:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb687800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb680071630 con 0x7fb6800c25a0 2024-02-17T12:17:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb687800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb680156550 con 0x7fb680152c50 2024-02-17T12:17:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb67fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb68006db50 0x7fb68014ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49134/0 (socket says 172.21.15.114:49134) 2024-02-17T12:17:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb67fe00640 1 -- 172.21.15.114:0/2113775718 learned_addr learned my addr 172.21.15.114:0/2113775718 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb684e00640 1 --2- 172.21.15.114:0/2113775718 >> v2:172.21.15.114:3300/0 conn(0x7fb6800c25a0 0x7fb68006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb685800640 1 --2- 172.21.15.114:0/2113775718 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb680152c50 0x7fb6801530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb67f400640 1 -- 172.21.15.114:0/2113775718 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160117630 0 0) 0x7fb680156270 con 0x7fb68006db50 2024-02-17T12:17:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb684e00640 1 -- 172.21.15.114:0/2113775718 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb680152c50 msgr2=0x7fb6801530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb684e00640 1 --2- 172.21.15.114:0/2113775718 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb680152c50 0x7fb6801530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb684e00640 1 -- 172.21.15.114:0/2113775718 >> v1:172.21.15.114:6789/0 conn(0x7fb68006db50 legacy=0x7fb68014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.189+0000 7fb684e00640 1 -- 172.21.15.114:0/2113775718 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb680156830 con 0x7fb6800c25a0 2024-02-17T12:17:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb684e00640 1 --2- 172.21.15.114:0/2113775718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 0x7fb68006e980 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb6680097c0 tx=0x7fb66801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556562df10e80fa7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb67f400640 1 -- 172.21.15.114:0/2113775718 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680ab600 con 0x7fb6800c25a0 2024-02-17T12:17:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb67f400640 1 -- 172.21.15.114:0/2113775718 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6680a7050 con 0x7fb6800c25a0 2024-02-17T12:17:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb67f400640 1 -- 172.21.15.114:0/2113775718 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680ab980 con 0x7fb6800c25a0 2024-02-17T12:17:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb687800640 1 -- 172.21.15.114:0/2113775718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 msgr2=0x7fb68006e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb687800640 1 --2- 172.21.15.114:0/2113775718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 0x7fb68006e980 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb6680097c0 tx=0x7fb66801c350 comp rx=0 tx=0).stop 2024-02-17T12:17:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb687800640 1 -- 172.21.15.114:0/2113775718 shutdown_connections 2024-02-17T12:17:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb687800640 1 --2- 172.21.15.114:0/2113775718 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb680152c50 0x7fb6801530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb687800640 1 --2- 172.21.15.114:0/2113775718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 0x7fb68006e980 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb687800640 1 -- 172.21.15.114:0/2113775718 >> 172.21.15.114:0/2113775718 conn(0x7fb6800a8490 msgr2=0x7fb6800a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb687800640 1 -- 172.21.15.114:0/2113775718 shutdown_connections 2024-02-17T12:17:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb687800640 1 -- 172.21.15.114:0/2113775718 wait complete. 2024-02-17T12:17:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb687800640 1 Processor -- start 2024-02-17T12:17:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.193+0000 7fb687800640 1 -- start start 2024-02-17T12:17:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb687800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68006db50 0x7fb680145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb687800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 0x7fb68014f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb687800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb680152c50 0x7fb6800c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb687800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68014ea00 con 0x7fb6800c25a0 2024-02-17T12:17:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb687800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6801458e0 con 0x7fb680152c50 2024-02-17T12:17:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb687800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6800c4fd0 con 0x7fb68006db50 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 0x7fb68014f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 0x7fb68014f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34568/0 (socket says 172.21.15.114:34568) 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67fe00640 1 -- 172.21.15.114:0/2010510810 learned_addr learned my addr 172.21.15.114:0/2010510810 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb684e00640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68006db50 0x7fb680145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb685800640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb680152c50 0x7fb6800c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67fe00640 1 -- 172.21.15.114:0/2010510810 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68006db50 msgr2=0x7fb680145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67fe00640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68006db50 0x7fb680145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67fe00640 1 -- 172.21.15.114:0/2010510810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb680152c50 msgr2=0x7fb6800c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67fe00640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb680152c50 0x7fb6800c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67fe00640 1 -- 172.21.15.114:0/2010510810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb668009420 con 0x7fb6800c25a0 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67fe00640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 0x7fb68014f5c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c550 tx=0x7fb67000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67cc00640 1 -- 172.21.15.114:0/2010510810 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670005cf0 con 0x7fb6800c25a0 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67cc00640 1 -- 172.21.15.114:0/2010510810 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb670005e70 con 0x7fb6800c25a0 2024-02-17T12:17:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67cc00640 1 -- 172.21.15.114:0/2010510810 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670007310 con 0x7fb6800c25a0 2024-02-17T12:17:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb687800640 1 -- 172.21.15.114:0/2010510810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6800c52b0 con 0x7fb6800c25a0 2024-02-17T12:17:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb687800640 1 -- 172.21.15.114:0/2010510810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6800c1e30 con 0x7fb6800c25a0 2024-02-17T12:17:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb687800640 1 -- 172.21.15.114:0/2010510810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6800c57d0 con 0x7fb6800c25a0 2024-02-17T12:17:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.197+0000 7fb67cc00640 1 -- 172.21.15.114:0/2010510810 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb670007470 con 0x7fb6800c25a0 2024-02-17T12:17:38.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.201+0000 7fb67cc00640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb65c066e40 0x7fb65c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.201+0000 7fb67cc00640 1 -- 172.21.15.114:0/2010510810 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb670084320 con 0x7fb6800c25a0 2024-02-17T12:17:38.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.201+0000 7fb684e00640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb65c066e40 0x7fb65c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.201+0000 7fb684e00640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb65c066e40 0x7fb65c069300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb6680ad000 tx=0x7fb668008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:38.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.205+0000 7fb67cc00640 1 -- 172.21.15.114:0/2010510810 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb670050ef0 con 0x7fb6800c25a0 2024-02-17T12:17:38.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.361+0000 7fb687800640 1 -- 172.21.15.114:0/2010510810 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb680074840 con 0x7fb6800c25a0 2024-02-17T12:17:38.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.361+0000 7fb67cc00640 1 -- 172.21.15.114:0/2010510810 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb6700545b0 con 0x7fb6800c25a0 2024-02-17T12:17:38.371 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 -- 172.21.15.114:0/2010510810 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb65c066e40 msgr2=0x7fb65c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb65c066e40 0x7fb65c069300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb6680ad000 tx=0x7fb668008040 comp rx=0 tx=0).stop 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 -- 172.21.15.114:0/2010510810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 msgr2=0x7fb68014f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 0x7fb68014f5c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb67000c550 tx=0x7fb67000ca10 comp rx=0 tx=0).stop 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 -- 172.21.15.114:0/2010510810 shutdown_connections 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb680152c50 0x7fb6800c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb65c066e40 0x7fb65c069300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6800c25a0 0x7fb68014f5c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 --2- 172.21.15.114:0/2010510810 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68006db50 0x7fb680145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 -- 172.21.15.114:0/2010510810 >> 172.21.15.114:0/2010510810 conn(0x7fb6800a8490 msgr2=0x7fb68006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 -- 172.21.15.114:0/2010510810 shutdown_connections 2024-02-17T12:17:38.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.365+0000 7fb687800640 1 -- 172.21.15.114:0/2010510810 wait complete. 2024-02-17T12:17:38.391 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:17:38.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.517+0000 7fcb9f000640 1 Processor -- start 2024-02-17T12:17:38.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.517+0000 7fcb9f000640 1 -- start start 2024-02-17T12:17:38.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.517+0000 7fcb9f000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb980c1eb0 0x7fcb9815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.517+0000 7fcb9f000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb980a9420 con 0x7fcb9814f110 2024-02-17T12:17:38.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.517+0000 7fcb9f000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb98152850 con 0x7fcb980c2580 2024-02-17T12:17:38.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.517+0000 7fcb9f000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9814f4f0 con 0x7fcb980c1eb0 2024-02-17T12:17:38.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb97e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcb9814f110 0x7fcb980c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49146/0 (socket says 172.21.15.114:49146) 2024-02-17T12:17:38.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb9d000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb980c1eb0 0x7fcb9815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb97e00640 1 -- 172.21.15.114:0/4205867621 learned_addr learned my addr 172.21.15.114:0/4205867621 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:38.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb9d000640 1 -- 172.21.15.114:0/4205867621 >> v1:172.21.15.116:6789/0 conn(0x7fcb980c2580 legacy=0x7fcb980aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb9d000640 1 -- 172.21.15.114:0/4205867621 >> v1:172.21.15.114:6789/0 conn(0x7fcb9814f110 legacy=0x7fcb980c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb9d000640 1 -- 172.21.15.114:0/4205867621 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb980a9670 con 0x7fcb980c1eb0 2024-02-17T12:17:38.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb96a00640 1 -- 172.21.15.114:0/4205867621 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256801355 0 0) 0x7fcb980a9420 con 0x7fcb9814f110 2024-02-17T12:17:38.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb9d000640 1 --2- 172.21.15.114:0/4205867621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c1eb0 0x7fcb9815d3a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009d90 tx=0x7fcb9001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a9420ec7bb83c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:38.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb96a00640 1 -- 172.21.15.114:0/4205867621 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900a5890 con 0x7fcb980c1eb0 2024-02-17T12:17:38.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb96a00640 1 -- 172.21.15.114:0/4205867621 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb900a59f0 con 0x7fcb980c1eb0 2024-02-17T12:17:38.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.521+0000 7fcb96a00640 1 -- 172.21.15.114:0/4205867621 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900a5d80 con 0x7fcb980c1eb0 2024-02-17T12:17:38.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 -- 172.21.15.114:0/4205867621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c1eb0 msgr2=0x7fcb9815d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 --2- 172.21.15.114:0/4205867621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c1eb0 0x7fcb9815d3a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009d90 tx=0x7fcb9001c8e0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 -- 172.21.15.114:0/4205867621 shutdown_connections 2024-02-17T12:17:38.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 --2- 172.21.15.114:0/4205867621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c1eb0 0x7fcb9815d3a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 -- 172.21.15.114:0/4205867621 >> 172.21.15.114:0/4205867621 conn(0x7fcb980a8490 msgr2=0x7fcb980a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:38.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 -- 172.21.15.114:0/4205867621 shutdown_connections 2024-02-17T12:17:38.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 -- 172.21.15.114:0/4205867621 wait complete. 2024-02-17T12:17:38.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 Processor -- start 2024-02-17T12:17:38.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 -- start start 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb980c1eb0 0x7fcb98151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c2580 0x7fcb9814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcb9814f110 0x7fcb9814e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb981f1b70 con 0x7fcb980c2580 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98143ea0 con 0x7fcb980c1eb0 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9f000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9814f7f0 con 0x7fcb9814f110 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb97400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c2580 0x7fcb9814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb97400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c2580 0x7fcb9814dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34586/0 (socket says 172.21.15.114:34586) 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb97400640 1 -- 172.21.15.114:0/3406178888 learned_addr learned my addr 172.21.15.114:0/3406178888 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb97e00640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb980c1eb0 0x7fcb98151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb9d000640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcb9814f110 0x7fcb9814e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb97400640 1 -- 172.21.15.114:0/3406178888 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcb9814f110 msgr2=0x7fcb9814e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb97400640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcb9814f110 0x7fcb9814e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb97400640 1 -- 172.21.15.114:0/3406178888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb980c1eb0 msgr2=0x7fcb98151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb97400640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb980c1eb0 0x7fcb98151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb97400640 1 -- 172.21.15.114:0/3406178888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90009a70 con 0x7fcb980c2580 2024-02-17T12:17:38.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb97400640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c2580 0x7fcb9814dac0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000c390 tx=0x7fcb8000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:38.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.525+0000 7fcb8fe00640 1 -- 172.21.15.114:0/3406178888 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800052d0 con 0x7fcb980c2580 2024-02-17T12:17:38.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.529+0000 7fcb8fe00640 1 -- 172.21.15.114:0/3406178888 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb80005430 con 0x7fcb980c2580 2024-02-17T12:17:38.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.529+0000 7fcb8fe00640 1 -- 172.21.15.114:0/3406178888 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80003820 con 0x7fcb980c2580 2024-02-17T12:17:38.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.529+0000 7fcb9f000640 1 -- 172.21.15.114:0/3406178888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb981f1790 con 0x7fcb980c2580 2024-02-17T12:17:38.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.529+0000 7fcb9f000640 1 -- 172.21.15.114:0/3406178888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9814e540 con 0x7fcb980c2580 2024-02-17T12:17:38.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.529+0000 7fcb9f000640 1 -- 172.21.15.114:0/3406178888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb98074840 con 0x7fcb980c2580 2024-02-17T12:17:38.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.529+0000 7fcb8fe00640 1 -- 172.21.15.114:0/3406178888 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fcb80003980 con 0x7fcb980c2580 2024-02-17T12:17:38.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.529+0000 7fcb8fe00640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb74066e40 0x7fcb74069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.529+0000 7fcb8fe00640 1 -- 172.21.15.114:0/3406178888 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcb800841d0 con 0x7fcb980c2580 2024-02-17T12:17:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.529+0000 7fcb97e00640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb74066e40 0x7fcb74069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.529+0000 7fcb97e00640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb74066e40 0x7fcb74069300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb88007a90 tx=0x7fcb880079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:38.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.533+0000 7fcb8fe00640 1 -- 172.21.15.114:0/3406178888 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcb80050da0 con 0x7fcb980c2580 2024-02-17T12:17:38.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 -- 172.21.15.114:0/3406178888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb980c1380 con 0x7fcb980c2580 2024-02-17T12:17:38.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb8fe00640 1 -- 172.21.15.114:0/3406178888 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcb80054460 con 0x7fcb980c2580 2024-02-17T12:17:38.708 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:17:38.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 -- 172.21.15.114:0/3406178888 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb74066e40 msgr2=0x7fcb74069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb74066e40 0x7fcb74069300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb88007a90 tx=0x7fcb880079e0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 -- 172.21.15.114:0/3406178888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c2580 msgr2=0x7fcb9814dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c2580 0x7fcb9814dac0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000c390 tx=0x7fcb8000c850 comp rx=0 tx=0).stop 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 -- 172.21.15.114:0/3406178888 shutdown_connections 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcb9814f110 0x7fcb9814e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb74066e40 0x7fcb74069300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb980c2580 0x7fcb9814dac0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 --2- 172.21.15.114:0/3406178888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb980c1eb0 0x7fcb98151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 -- 172.21.15.114:0/3406178888 >> 172.21.15.114:0/3406178888 conn(0x7fcb980a8490 msgr2=0x7fcb9806dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 -- 172.21.15.114:0/3406178888 shutdown_connections 2024-02-17T12:17:38.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.701+0000 7fcb9f000640 1 -- 172.21.15.114:0/3406178888 wait complete. 2024-02-17T12:17:38.729 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-17T12:17:38.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:38.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-17T12:17:38.757 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:17:38.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:17:38.757 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-17T12:17:38.807 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:38.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.933+0000 7f2f86400640 1 Processor -- start 2024-02-17T12:17:38.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.933+0000 7f2f86400640 1 -- start start 2024-02-17T12:17:38.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f86400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f800c25a0 0x7f2f8006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f86400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f80156270 con 0x7f2f8006db50 2024-02-17T12:17:38.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f86400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f80156550 con 0x7f2f80152c50 2024-02-17T12:17:38.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f86400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f80071630 con 0x7f2f800c25a0 2024-02-17T12:17:38.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f7f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f800c25a0 0x7f2f8006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f7ea00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2f8006db50 0x7f2f8014ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49158/0 (socket says 172.21.15.114:49158) 2024-02-17T12:17:38.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f7ea00640 1 -- 172.21.15.114:0/815704756 learned_addr learned my addr 172.21.15.114:0/815704756 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:38.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f7f400640 1 -- 172.21.15.114:0/815704756 >> v1:172.21.15.116:6789/0 conn(0x7f2f80152c50 legacy=0x7f2f80153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f7f400640 1 -- 172.21.15.114:0/815704756 >> v1:172.21.15.114:6789/0 conn(0x7f2f8006db50 legacy=0x7f2f8014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f7f400640 1 -- 172.21.15.114:0/815704756 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80156830 con 0x7f2f800c25a0 2024-02-17T12:17:38.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f7e000640 1 -- 172.21.15.114:0/815704756 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332273037 0 0) 0x7f2f80156270 con 0x7f2f8006db50 2024-02-17T12:17:38.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f7f400640 1 --2- 172.21.15.114:0/815704756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 0x7f2f8006e980 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009d90 tx=0x7f2f7001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b8722c29bf24e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:38.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.937+0000 7f2f7e000640 1 -- 172.21.15.114:0/815704756 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700a5800 con 0x7f2f800c25a0 2024-02-17T12:17:38.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7e000640 1 -- 172.21.15.114:0/815704756 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f700a5960 con 0x7f2f800c25a0 2024-02-17T12:17:38.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7e000640 1 -- 172.21.15.114:0/815704756 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700a5cf0 con 0x7f2f800c25a0 2024-02-17T12:17:38.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 -- 172.21.15.114:0/815704756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 msgr2=0x7f2f8006e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 --2- 172.21.15.114:0/815704756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 0x7f2f8006e980 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009d90 tx=0x7f2f7001c820 comp rx=0 tx=0).stop 2024-02-17T12:17:38.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 -- 172.21.15.114:0/815704756 shutdown_connections 2024-02-17T12:17:38.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 --2- 172.21.15.114:0/815704756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 0x7f2f8006e980 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 -- 172.21.15.114:0/815704756 >> 172.21.15.114:0/815704756 conn(0x7f2f800a8490 msgr2=0x7f2f800a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:38.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 -- 172.21.15.114:0/815704756 shutdown_connections 2024-02-17T12:17:38.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 -- 172.21.15.114:0/815704756 wait complete. 2024-02-17T12:17:38.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 Processor -- start 2024-02-17T12:17:38.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 -- start start 2024-02-17T12:17:38.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8006db50 0x7f2f80155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 0x7f2f80154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f80152c50 0x7f2f80141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8014a110 con 0x7f2f800c25a0 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f801490f0 con 0x7f2f8006db50 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f86400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f801493d0 con 0x7f2f80152c50 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 0x7f2f80154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 0x7f2f80154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34612/0 (socket says 172.21.15.114:34612) 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7ea00640 1 -- 172.21.15.114:0/2615196239 learned_addr learned my addr 172.21.15.114:0/2615196239 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7f400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8006db50 0x7f2f80155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7fe00640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f80152c50 0x7f2f80141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7ea00640 1 -- 172.21.15.114:0/2615196239 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f80152c50 msgr2=0x7f2f80141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7ea00640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f80152c50 0x7f2f80141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7ea00640 1 -- 172.21.15.114:0/2615196239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8006db50 msgr2=0x7f2f80155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:38.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7ea00640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8006db50 0x7f2f80155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7ea00640 1 -- 172.21.15.114:0/2615196239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009a70 con 0x7f2f800c25a0 2024-02-17T12:17:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.941+0000 7f2f7f400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8006db50 0x7f2f80155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f7ea00640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 0x7f2f80154570 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800c4a0 tx=0x7f2f6800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f77400640 1 -- 172.21.15.114:0/2615196239 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f680074e0 con 0x7f2f800c25a0 2024-02-17T12:17:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f77400640 1 -- 172.21.15.114:0/2615196239 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f68007640 con 0x7f2f800c25a0 2024-02-17T12:17:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f77400640 1 -- 172.21.15.114:0/2615196239 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68004a30 con 0x7f2f800c25a0 2024-02-17T12:17:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f86400640 1 -- 172.21.15.114:0/2615196239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8013ff10 con 0x7f2f800c25a0 2024-02-17T12:17:38.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f86400640 1 -- 172.21.15.114:0/2615196239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f801404d0 con 0x7f2f800c25a0 2024-02-17T12:17:38.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f86400640 1 -- 172.21.15.114:0/2615196239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f801406f0 con 0x7f2f800c25a0 2024-02-17T12:17:38.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f77400640 1 -- 172.21.15.114:0/2615196239 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2f68004b90 con 0x7f2f800c25a0 2024-02-17T12:17:38.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f77400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f5c066e70 0x7f2f5c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:38.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f77400640 1 -- 172.21.15.114:0/2615196239 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2f68083fe0 con 0x7f2f800c25a0 2024-02-17T12:17:38.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f7f400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f5c066e70 0x7f2f5c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:38.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.945+0000 7f2f7f400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f5c066e70 0x7f2f5c069330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2f700af000 tx=0x7f2f700a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:38.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:38.949+0000 7f2f77400640 1 -- 172.21.15.114:0/2615196239 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2f68050940 con 0x7f2f800c25a0 2024-02-17T12:17:39.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.137+0000 7f2f86400640 1 -- 172.21.15.114:0/2615196239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f80074840 con 0x7f2f800c25a0 2024-02-17T12:17:39.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.137+0000 7f2f77400640 1 -- 172.21.15.114:0/2615196239 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6192 (secure 0 0 0) 0x7f2f68018070 con 0x7f2f800c25a0 2024-02-17T12:17:39.146 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:39.146 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:05.397716+0000","modified":"2024-02-17T12:17:08.427075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1473468479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1473468479},{"type":"v1","addr":"172.21.15.114:6837","nonce":1473468479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:22.698504+0000","modified":"2024-02-17T12:17:25.708127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4941},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4941":{"gid":4941,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/2833741536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2833741536},{"type":"v1","addr":"172.21.15.114:6836","nonce":2833741536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-02-17T12:17:39.146 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 22 2024-02-17T12:17:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 -- 172.21.15.114:0/2615196239 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f5c066e70 msgr2=0x7f2f5c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f5c066e70 0x7f2f5c069330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2f700af000 tx=0x7f2f700a7070 comp rx=0 tx=0).stop 2024-02-17T12:17:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 -- 172.21.15.114:0/2615196239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 msgr2=0x7f2f80154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 0x7f2f80154570 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800c4a0 tx=0x7f2f6800c960 comp rx=0 tx=0).stop 2024-02-17T12:17:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 -- 172.21.15.114:0/2615196239 shutdown_connections 2024-02-17T12:17:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f80152c50 0x7f2f80141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f5c066e70 0x7f2f5c069330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f800c25a0 0x7f2f80154570 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 --2- 172.21.15.114:0/2615196239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8006db50 0x7f2f80155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 -- 172.21.15.114:0/2615196239 >> 172.21.15.114:0/2615196239 conn(0x7f2f800a8490 msgr2=0x7f2f80153030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:39.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 -- 172.21.15.114:0/2615196239 shutdown_connections 2024-02-17T12:17:39.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.141+0000 7f2f86400640 1 -- 172.21.15.114:0/2615196239 wait complete. 2024-02-17T12:17:39.167 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:39.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.293+0000 7f90f5a00640 1 Processor -- start 2024-02-17T12:17:39.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.293+0000 7f90f5a00640 1 -- start start 2024-02-17T12:17:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90f5a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f90f014f110 0x7f90f00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90f5a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c2580 0x7f90f00aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90f5a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f00a9420 con 0x7f90f00c1eb0 2024-02-17T12:17:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90f5a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f014f4f0 con 0x7f90f014f110 2024-02-17T12:17:39.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90f5a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00aae80 con 0x7f90f00c2580 2024-02-17T12:17:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90ee000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c2580 0x7f90f00aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90ee000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c2580 0x7f90f00aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:56254/0 (socket says 172.21.15.114:56254) 2024-02-17T12:17:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90eea00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f90f014f110 0x7f90f00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90ee000640 1 -- 172.21.15.114:0/2296647159 learned_addr learned my addr 172.21.15.114:0/2296647159 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90ee000640 1 -- 172.21.15.114:0/2296647159 >> v2:172.21.15.116:3300/0 conn(0x7f90f014f110 msgr2=0x7f90f00c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:39.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90ee000640 1 --2- 172.21.15.114:0/2296647159 >> v2:172.21.15.116:3300/0 conn(0x7f90f014f110 0x7f90f00c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90ee000640 1 -- 172.21.15.114:0/2296647159 >> v1:172.21.15.116:6789/0 conn(0x7f90f00c1eb0 legacy=0x7f90f0155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.297+0000 7f90ee000640 1 -- 172.21.15.114:0/2296647159 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0152850 con 0x7f90f00c2580 2024-02-17T12:17:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90ee000640 1 --2- 172.21.15.114:0/2296647159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c2580 0x7f90f00aa150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009870 tx=0x7f90dc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9279895a886d6573 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90ed600640 1 -- 172.21.15.114:0/2296647159 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0a6040 con 0x7f90f00c2580 2024-02-17T12:17:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90ed600640 1 -- 172.21.15.114:0/2296647159 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0aa600 con 0x7f90f00c2580 2024-02-17T12:17:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90ed600640 1 -- 172.21.15.114:0/2296647159 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0aa990 con 0x7f90f00c2580 2024-02-17T12:17:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90f5a00640 1 -- 172.21.15.114:0/2296647159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c2580 msgr2=0x7f90f00aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90f5a00640 1 --2- 172.21.15.114:0/2296647159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c2580 0x7f90f00aa150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009870 tx=0x7f90dc01c4a0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90f5a00640 1 -- 172.21.15.114:0/2296647159 shutdown_connections 2024-02-17T12:17:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90f5a00640 1 --2- 172.21.15.114:0/2296647159 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c2580 0x7f90f00aa150 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90f5a00640 1 --2- 172.21.15.114:0/2296647159 >> v2:172.21.15.116:3300/0 conn(0x7f90f014f110 0x7f90f00c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90f5a00640 1 -- 172.21.15.114:0/2296647159 >> 172.21.15.114:0/2296647159 conn(0x7f90f00a8490 msgr2=0x7f90f00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90f5a00640 1 -- 172.21.15.114:0/2296647159 shutdown_connections 2024-02-17T12:17:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90f5a00640 1 -- 172.21.15.114:0/2296647159 wait complete. 2024-02-17T12:17:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90f5a00640 1 Processor -- start 2024-02-17T12:17:39.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.301+0000 7f90f5a00640 1 -- start start 2024-02-17T12:17:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90f5a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c1eb0 0x7f90f014d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90f5a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90f00c2580 0x7f90f00bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90f5a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90f014f110 0x7f90f01450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90f5a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f01f20d0 con 0x7f90f00c2580 2024-02-17T12:17:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90f5a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f01504b0 con 0x7f90f014f110 2024-02-17T12:17:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90f5a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f01edc00 con 0x7f90f00c1eb0 2024-02-17T12:17:39.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90ee000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90f00c2580 0x7f90f00bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90ee000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90f00c2580 0x7f90f00bf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34628/0 (socket says 172.21.15.114:34628) 2024-02-17T12:17:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90eea00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c1eb0 0x7f90f014d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90ee000640 1 -- 172.21.15.114:0/3762811467 learned_addr learned my addr 172.21.15.114:0/3762811467 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90ef400640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90f014f110 0x7f90f01450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90ee000640 1 -- 172.21.15.114:0/3762811467 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c1eb0 msgr2=0x7f90f014d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90ee000640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c1eb0 0x7f90f014d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90ee000640 1 -- 172.21.15.114:0/3762811467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90f014f110 msgr2=0x7f90f01450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90ee000640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90f014f110 0x7f90f01450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90ee000640 1 -- 172.21.15.114:0/3762811467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc0094d0 con 0x7f90f00c2580 2024-02-17T12:17:39.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90ee000640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90f00c2580 0x7f90f00bf7a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f90dc01ab50 tx=0x7f90dc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90e6a00640 1 -- 172.21.15.114:0/3762811467 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0b3600 con 0x7f90f00c2580 2024-02-17T12:17:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90e6a00640 1 -- 172.21.15.114:0/3762811467 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0b3780 con 0x7f90f00c2580 2024-02-17T12:17:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90e6a00640 1 -- 172.21.15.114:0/3762811467 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0b3b30 con 0x7f90f00c2580 2024-02-17T12:17:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90f5a00640 1 -- 172.21.15.114:0/3762811467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f0150640 con 0x7f90f00c2580 2024-02-17T12:17:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90f5a00640 1 -- 172.21.15.114:0/3762811467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f01f1830 con 0x7f90f00c2580 2024-02-17T12:17:39.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90f5a00640 1 -- 172.21.15.114:0/3762811467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f01edd70 con 0x7f90f00c2580 2024-02-17T12:17:39.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.305+0000 7f90e6a00640 1 -- 172.21.15.114:0/3762811467 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f90dc0b3c90 con 0x7f90f00c2580 2024-02-17T12:17:39.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.309+0000 7f90e6a00640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90d0066e40 0x7f90d0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.309+0000 7f90e6a00640 1 -- 172.21.15.114:0/3762811467 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f90dc11f2e0 con 0x7f90f00c2580 2024-02-17T12:17:39.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.309+0000 7f90eea00640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90d0066e40 0x7f90d0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.309+0000 7f90eea00640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90d0066e40 0x7f90d0069300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009ac0 tx=0x7f90e0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:39.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.313+0000 7f90e6a00640 1 -- 172.21.15.114:0/3762811467 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f90f01edd70 con 0x7f90f00c2580 2024-02-17T12:17:39.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 -- 172.21.15.114:0/3762811467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90f01edd70 con 0x7f90f00c2580 2024-02-17T12:17:39.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90e6a00640 1 -- 172.21.15.114:0/3762811467 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20407 (secure 0 0 0) 0x7f90f01edd70 con 0x7f90f00c2580 2024-02-17T12:17:39.481 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:39.481 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:24.325322+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:39.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 -- 172.21.15.114:0/3762811467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90d0066e40 msgr2=0x7f90d0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90d0066e40 0x7f90d0069300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009ac0 tx=0x7f90e0009190 comp rx=0 tx=0).stop 2024-02-17T12:17:39.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 -- 172.21.15.114:0/3762811467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90f00c2580 msgr2=0x7f90f00bf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90f00c2580 0x7f90f00bf7a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f90dc01ab50 tx=0x7f90dc01ace0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 -- 172.21.15.114:0/3762811467 shutdown_connections 2024-02-17T12:17:39.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90f014f110 0x7f90f01450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f90d0066e40 0x7f90d0069300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90f00c2580 0x7f90f00bf7a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 --2- 172.21.15.114:0/3762811467 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90f00c1eb0 0x7f90f014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.473+0000 7f90f5a00640 1 -- 172.21.15.114:0/3762811467 >> 172.21.15.114:0/3762811467 conn(0x7f90f00a8490 msgr2=0x7f90f0071260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:39.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.477+0000 7f90f5a00640 1 -- 172.21.15.114:0/3762811467 shutdown_connections 2024-02-17T12:17:39.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.477+0000 7f90f5a00640 1 -- 172.21.15.114:0/3762811467 wait complete. 2024-02-17T12:17:39.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:17:03.897758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:17:04.389290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:17:20.859567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:17:21.688611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:17:39.502 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:17:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d3800640 1 Processor -- start 2024-02-17T12:17:39.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d3800640 1 -- start start 2024-02-17T12:17:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d3800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa0cc14f110 0x7fa0cc0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d3800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 0x7fa0cc0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d3800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc0a9420 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d3800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc14f4f0 con 0x7fa0cc14f110 2024-02-17T12:17:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d3800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0aae80 con 0x7fa0cc0c2580 2024-02-17T12:17:39.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d1800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa0cc0c1eb0 0x7fa0cc155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49174/0 (socket says 172.21.15.114:49174) 2024-02-17T12:17:39.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d1800640 1 -- 172.21.15.114:0/2516181809 learned_addr learned my addr 172.21.15.114:0/2516181809 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:39.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0cbe00640 1 --2- 172.21.15.114:0/2516181809 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 0x7fa0cc0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d0e00640 1 --2- 172.21.15.114:0/2516181809 >> v2:172.21.15.116:3300/0 conn(0x7fa0cc14f110 0x7fa0cc0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0cb400640 1 -- 172.21.15.114:0/2516181809 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763217526 0 0) 0x7fa0cc0a9420 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0cb400640 1 -- 172.21.15.114:0/2516181809 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b0003530 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d0e00640 1 -- 172.21.15.114:0/2516181809 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 msgr2=0x7fa0cc0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:39.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d0e00640 1 --2- 172.21.15.114:0/2516181809 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 0x7fa0cc0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0cb400640 1 -- 172.21.15.114:0/2516181809 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2467225564 0 0) 0x7fa0b0003530 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d0e00640 1 -- 172.21.15.114:0/2516181809 >> v1:172.21.15.114:6789/0 conn(0x7fa0cc0c1eb0 legacy=0x7fa0cc155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.633+0000 7fa0d0e00640 1 -- 172.21.15.114:0/2516181809 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc152850 con 0x7fa0cc14f110 2024-02-17T12:17:39.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0d0e00640 1 --2- 172.21.15.114:0/2516181809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc14f110 0x7fa0cc0c65a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0097c0 tx=0x7fa0bc01c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55ad980698faa3dc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:39.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0cb400640 1 -- 172.21.15.114:0/2516181809 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4001a00 con 0x7fa0cc14f110 2024-02-17T12:17:39.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0cb400640 1 -- 172.21.15.114:0/2516181809 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc0a7050 con 0x7fa0cc14f110 2024-02-17T12:17:39.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0cb400640 1 -- 172.21.15.114:0/2516181809 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc0ab620 con 0x7fa0cc14f110 2024-02-17T12:17:39.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0d3800640 1 -- 172.21.15.114:0/2516181809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc14f110 msgr2=0x7fa0cc0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0d3800640 1 --2- 172.21.15.114:0/2516181809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc14f110 0x7fa0cc0c65a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0097c0 tx=0x7fa0bc01c300 comp rx=0 tx=0).stop 2024-02-17T12:17:39.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0d3800640 1 -- 172.21.15.114:0/2516181809 shutdown_connections 2024-02-17T12:17:39.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0d3800640 1 --2- 172.21.15.114:0/2516181809 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 0x7fa0cc0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0d3800640 1 --2- 172.21.15.114:0/2516181809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc14f110 0x7fa0cc0c65a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0d3800640 1 -- 172.21.15.114:0/2516181809 >> 172.21.15.114:0/2516181809 conn(0x7fa0cc0a8490 msgr2=0x7fa0cc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:39.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0d3800640 1 -- 172.21.15.114:0/2516181809 shutdown_connections 2024-02-17T12:17:39.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.637+0000 7fa0d3800640 1 -- 172.21.15.114:0/2516181809 wait complete. 2024-02-17T12:17:39.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d3800640 1 Processor -- start 2024-02-17T12:17:39.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d3800640 1 -- start start 2024-02-17T12:17:39.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d3800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0cc0c1eb0 0x7fa0cc1f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d3800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 0x7fa0cc150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d3800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc14f110 0x7fa0cc1ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d3800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc152e10 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d3800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc154e80 con 0x7fa0cc14f110 2024-02-17T12:17:39.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d3800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0c5900 con 0x7fa0cc0c2580 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0cc0c1eb0 0x7fa0cc1f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0cc0c1eb0 0x7fa0cc1f14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34640/0 (socket says 172.21.15.114:34640) 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d0e00640 1 -- 172.21.15.114:0/2103494418 learned_addr learned my addr 172.21.15.114:0/2103494418 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0cbe00640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 0x7fa0cc150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d1800640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc14f110 0x7fa0cc1ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d0e00640 1 -- 172.21.15.114:0/2103494418 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 msgr2=0x7fa0cc150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d0e00640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 0x7fa0cc150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d0e00640 1 -- 172.21.15.114:0/2103494418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc14f110 msgr2=0x7fa0cc1ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d0e00640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc14f110 0x7fa0cc1ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d0e00640 1 -- 172.21.15.114:0/2103494418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc009420 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0cbe00640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 0x7fa0cc150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:39.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d0e00640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0cc0c1eb0 0x7fa0cc1f14c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc01a9b0 tx=0x7fa0bc01ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:39.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0c8c00640 1 -- 172.21.15.114:0/2103494418 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc0b7450 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0c8c00640 1 -- 172.21.15.114:0/2103494418 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc0b75d0 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0c8c00640 1 -- 172.21.15.114:0/2103494418 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc0b7980 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d3800640 1 -- 172.21.15.114:0/2103494418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc1f1030 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.641+0000 7fa0d3800640 1 -- 172.21.15.114:0/2103494418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc0c5b50 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.645+0000 7fa0d3800640 1 -- 172.21.15.114:0/2103494418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc074840 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.645+0000 7fa0c8c00640 1 -- 172.21.15.114:0/2103494418 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa0bc0b7ae0 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.645+0000 7fa0c8c00640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0ac066e40 0x7fa0ac069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.645+0000 7fa0c8c00640 1 -- 172.21.15.114:0/2103494418 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa0bc11f560 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.645+0000 7fa0cbe00640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0ac066e40 0x7fa0ac069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.645+0000 7fa0cbe00640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0ac066e40 0x7fa0ac069300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0a8970 tx=0x7fa0b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:39.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.649+0000 7fa0c8c00640 1 -- 172.21.15.114:0/2103494418 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa0bc0ebfe0 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 -- 172.21.15.114:0/2103494418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0cc0c1380 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0c8c00640 1 -- 172.21.15.114:0/2103494418 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0bc0ef6a0 con 0x7fa0cc0c1eb0 2024-02-17T12:17:39.812 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:17:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 -- 172.21.15.114:0/2103494418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0ac066e40 msgr2=0x7fa0ac069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0ac066e40 0x7fa0ac069300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0a8970 tx=0x7fa0b8008040 comp rx=0 tx=0).stop 2024-02-17T12:17:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 -- 172.21.15.114:0/2103494418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0cc0c1eb0 msgr2=0x7fa0cc1f14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0cc0c1eb0 0x7fa0cc1f14c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc01a9b0 tx=0x7fa0bc01ab40 comp rx=0 tx=0).stop 2024-02-17T12:17:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 -- 172.21.15.114:0/2103494418 shutdown_connections 2024-02-17T12:17:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0cc14f110 0x7fa0cc1ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0cc0c2580 0x7fa0cc150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa0ac066e40 0x7fa0ac069300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 --2- 172.21.15.114:0/2103494418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0cc0c1eb0 0x7fa0cc1f14c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 -- 172.21.15.114:0/2103494418 >> 172.21.15.114:0/2103494418 conn(0x7fa0cc0a8490 msgr2=0x7fa0cc06b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 -- 172.21.15.114:0/2103494418 shutdown_connections 2024-02-17T12:17:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.805+0000 7fa0d3800640 1 -- 172.21.15.114:0/2103494418 wait complete. 2024-02-17T12:17:39.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:17:39.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.961+0000 7f01c8600640 1 Processor -- start 2024-02-17T12:17:39.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.961+0000 7f01c8600640 1 -- start start 2024-02-17T12:17:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01c8600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f01c00c1eb0 0x7f01c015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01c8600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c00a9420 con 0x7f01c00c2580 2024-02-17T12:17:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01c8600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c0152850 con 0x7f01c014f110 2024-02-17T12:17:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01c8600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c014f4f0 con 0x7f01c00c1eb0 2024-02-17T12:17:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01c6600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f01c00c1eb0 0x7f01c015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01c5200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f01c00c2580 0x7f01c00aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49184/0 (socket says 172.21.15.114:49184) 2024-02-17T12:17:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01c5200640 1 -- 172.21.15.114:0/1700241584 learned_addr learned my addr 172.21.15.114:0/1700241584 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01c6600640 1 -- 172.21.15.114:0/1700241584 >> v1:172.21.15.116:6789/0 conn(0x7f01c014f110 legacy=0x7f01c00c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:39.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01c6600640 1 -- 172.21.15.114:0/1700241584 >> v1:172.21.15.114:6789/0 conn(0x7f01c00c2580 legacy=0x7f01c00aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01c6600640 1 -- 172.21.15.114:0/1700241584 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c00a9670 con 0x7f01c00c1eb0 2024-02-17T12:17:39.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.965+0000 7f01bfe00640 1 -- 172.21.15.114:0/1700241584 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132764966 0 0) 0x7f01c00a9420 con 0x7f01c00c2580 2024-02-17T12:17:39.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c6600640 1 --2- 172.21.15.114:0/1700241584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c00c1eb0 0x7f01c015d3a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f01b80097c0 tx=0x7f01b801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f018ee6a295a05c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:39.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01bfe00640 1 -- 172.21.15.114:0/1700241584 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80ab600 con 0x7f01c00c1eb0 2024-02-17T12:17:39.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01bfe00640 1 -- 172.21.15.114:0/1700241584 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b80a7050 con 0x7f01c00c1eb0 2024-02-17T12:17:39.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01bfe00640 1 -- 172.21.15.114:0/1700241584 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80ab980 con 0x7f01c00c1eb0 2024-02-17T12:17:39.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 -- 172.21.15.114:0/1700241584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c00c1eb0 msgr2=0x7f01c015d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 --2- 172.21.15.114:0/1700241584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c00c1eb0 0x7f01c015d3a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f01b80097c0 tx=0x7f01b801c3d0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 -- 172.21.15.114:0/1700241584 shutdown_connections 2024-02-17T12:17:39.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 --2- 172.21.15.114:0/1700241584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c00c1eb0 0x7f01c015d3a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 -- 172.21.15.114:0/1700241584 >> 172.21.15.114:0/1700241584 conn(0x7f01c00a8490 msgr2=0x7f01c00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:39.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 -- 172.21.15.114:0/1700241584 shutdown_connections 2024-02-17T12:17:39.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 -- 172.21.15.114:0/1700241584 wait complete. 2024-02-17T12:17:39.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 Processor -- start 2024-02-17T12:17:39.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 -- start start 2024-02-17T12:17:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01c00c1eb0 0x7f01c014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f01c00c2580 0x7f01c013ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c014f110 0x7f01c013f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c014e960 con 0x7f01c014f110 2024-02-17T12:17:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c01ec560 con 0x7f01c00c1eb0 2024-02-17T12:17:39.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c8600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c01ec9f0 con 0x7f01c00c2580 2024-02-17T12:17:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c014f110 0x7f01c013f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c014f110 0x7f01c013f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34660/0 (socket says 172.21.15.114:34660) 2024-02-17T12:17:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.969+0000 7f01c6600640 1 -- 172.21.15.114:0/2859719007 learned_addr learned my addr 172.21.15.114:0/2859719007 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c5200640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f01c00c2580 0x7f01c013ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c5c00640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01c00c1eb0 0x7f01c014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c6600640 1 -- 172.21.15.114:0/2859719007 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f01c00c2580 msgr2=0x7f01c013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c6600640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f01c00c2580 0x7f01c013ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c6600640 1 -- 172.21.15.114:0/2859719007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01c00c1eb0 msgr2=0x7f01c014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c6600640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01c00c1eb0 0x7f01c014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:39.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c6600640 1 -- 172.21.15.114:0/2859719007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b8009420 con 0x7f01c014f110 2024-02-17T12:17:39.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c5c00640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01c00c1eb0 0x7f01c014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:39.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c6600640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c014f110 0x7f01c013f170 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f01b8018fe0 tx=0x7f01b801ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:39.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01bd600640 1 -- 172.21.15.114:0/2859719007 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80b7450 con 0x7f01c014f110 2024-02-17T12:17:39.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01bd600640 1 -- 172.21.15.114:0/2859719007 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b80b75b0 con 0x7f01c014f110 2024-02-17T12:17:39.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c8600640 1 -- 172.21.15.114:0/2859719007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c00c60c0 con 0x7f01c014f110 2024-02-17T12:17:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01bd600640 1 -- 172.21.15.114:0/2859719007 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80b7940 con 0x7f01c014f110 2024-02-17T12:17:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c8600640 1 -- 172.21.15.114:0/2859719007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c01ebf10 con 0x7f01c014f110 2024-02-17T12:17:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c8600640 1 -- 172.21.15.114:0/2859719007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c0074840 con 0x7f01c014f110 2024-02-17T12:17:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01bd600640 1 -- 172.21.15.114:0/2859719007 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f01b80b7aa0 con 0x7f01c014f110 2024-02-17T12:17:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01bd600640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f01a0066e40 0x7f01a0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01bd600640 1 -- 172.21.15.114:0/2859719007 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f01b811f690 con 0x7f01c014f110 2024-02-17T12:17:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.973+0000 7f01c5c00640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f01a0066e40 0x7f01a0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:39.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.977+0000 7f01c5c00640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f01a0066e40 0x7f01a0069300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f01b4007fd0 tx=0x7f01b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:39.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:39.977+0000 7f01bd600640 1 -- 172.21.15.114:0/2859719007 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f01b80ec110 con 0x7f01c014f110 2024-02-17T12:17:40.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 -- 172.21.15.114:0/2859719007 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01c00c2290 con 0x7f01c014f110 2024-02-17T12:17:40.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01bd600640 1 -- 172.21.15.114:0/2859719007 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f01b80ef7d0 con 0x7f01c014f110 2024-02-17T12:17:40.141 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:17:40.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 -- 172.21.15.114:0/2859719007 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f01a0066e40 msgr2=0x7f01a0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f01a0066e40 0x7f01a0069300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f01b4007fd0 tx=0x7f01b4009040 comp rx=0 tx=0).stop 2024-02-17T12:17:40.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 -- 172.21.15.114:0/2859719007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c014f110 msgr2=0x7f01c013f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c014f110 0x7f01c013f170 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f01b8018fe0 tx=0x7f01b801ac10 comp rx=0 tx=0).stop 2024-02-17T12:17:40.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 -- 172.21.15.114:0/2859719007 shutdown_connections 2024-02-17T12:17:40.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f01a0066e40 0x7f01a0069300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01c014f110 0x7f01c013f170 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f01c00c2580 0x7f01c013ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 --2- 172.21.15.114:0/2859719007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01c00c1eb0 0x7f01c014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 -- 172.21.15.114:0/2859719007 >> 172.21.15.114:0/2859719007 conn(0x7f01c00a8490 msgr2=0x7f01c00c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:40.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.133+0000 7f01c8600640 1 -- 172.21.15.114:0/2859719007 shutdown_connections 2024-02-17T12:17:40.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.137+0000 7f01c8600640 1 -- 172.21.15.114:0/2859719007 wait complete. 2024-02-17T12:17:40.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:17:40.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a2ac00640 1 Processor -- start 2024-02-17T12:17:40.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a2ac00640 1 -- start start 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a2ac00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0a240c58b0 0x7f0a241583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a2ac00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a240c4b30 0x7f0a2406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a2ac00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a2406c160 0x7f0a24155520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a2ac00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a240c6110 con 0x7f0a240c4b30 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a2ac00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a24155090 con 0x7f0a240c58b0 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a2ac00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a24159300 con 0x7f0a2406c160 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a23400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a240c4b30 0x7f0a2406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a23400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a240c4b30 0x7f0a2406bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34672/0 (socket says 172.21.15.114:34672) 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a23400640 1 -- 172.21.15.114:0/900179750 learned_addr learned my addr 172.21.15.114:0/900179750 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a23e00640 1 --2- 172.21.15.114:0/900179750 >> v2:172.21.15.116:3300/0 conn(0x7f0a240c58b0 0x7f0a241583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a28c00640 1 --2- 172.21.15.114:0/900179750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a2406c160 0x7f0a24155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a23400640 1 -- 172.21.15.114:0/900179750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a2406c160 msgr2=0x7f0a24155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:40.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a23400640 1 --2- 172.21.15.114:0/900179750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a2406c160 0x7f0a24155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a23400640 1 -- 172.21.15.114:0/900179750 >> v2:172.21.15.116:3300/0 conn(0x7f0a240c58b0 msgr2=0x7f0a241583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:40.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a23400640 1 --2- 172.21.15.114:0/900179750 >> v2:172.21.15.116:3300/0 conn(0x7f0a240c58b0 0x7f0a241583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.293+0000 7f0a23400640 1 -- 172.21.15.114:0/900179750 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a24158a60 con 0x7f0a240c4b30 2024-02-17T12:17:40.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a23400640 1 --2- 172.21.15.114:0/900179750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a240c4b30 0x7f0a2406bc20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0a24066c10 tx=0x7f0a1001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5e2852abdd948d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:40.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a22a00640 1 -- 172.21.15.114:0/900179750 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100aa610 con 0x7f0a240c4b30 2024-02-17T12:17:40.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a22a00640 1 -- 172.21.15.114:0/900179750 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a100a6040 con 0x7f0a240c4b30 2024-02-17T12:17:40.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a22a00640 1 -- 172.21.15.114:0/900179750 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100aa990 con 0x7f0a240c4b30 2024-02-17T12:17:40.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 -- 172.21.15.114:0/900179750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a240c4b30 msgr2=0x7f0a2406bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 --2- 172.21.15.114:0/900179750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a240c4b30 0x7f0a2406bc20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0a24066c10 tx=0x7f0a1001c4f0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 -- 172.21.15.114:0/900179750 shutdown_connections 2024-02-17T12:17:40.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 --2- 172.21.15.114:0/900179750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a2406c160 0x7f0a24155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 --2- 172.21.15.114:0/900179750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a240c4b30 0x7f0a2406bc20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 --2- 172.21.15.114:0/900179750 >> v2:172.21.15.116:3300/0 conn(0x7f0a240c58b0 0x7f0a241583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 -- 172.21.15.114:0/900179750 >> 172.21.15.114:0/900179750 conn(0x7f0a240c3730 msgr2=0x7f0a240c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:40.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 -- 172.21.15.114:0/900179750 shutdown_connections 2024-02-17T12:17:40.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 -- 172.21.15.114:0/900179750 wait complete. 2024-02-17T12:17:40.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 Processor -- start 2024-02-17T12:17:40.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.297+0000 7f0a2ac00640 1 -- start start 2024-02-17T12:17:40.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a2ac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2406c160 0x7f0a2406ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a2ac00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a240c4b30 0x7f0a2414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a2ac00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a240c58b0 0x7f0a2414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a2ac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240abaa0 con 0x7f0a2406c160 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a2ac00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241f1000 con 0x7f0a240c58b0 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a2ac00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241f12e0 con 0x7f0a240c4b30 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a23e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2406c160 0x7f0a2406ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a23e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2406c160 0x7f0a2406ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34686/0 (socket says 172.21.15.114:34686) 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a23e00640 1 -- 172.21.15.114:0/2645155613 learned_addr learned my addr 172.21.15.114:0/2645155613 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a28c00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a240c58b0 0x7f0a2414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a23400640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a240c4b30 0x7f0a2414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a23e00640 1 -- 172.21.15.114:0/2645155613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a240c4b30 msgr2=0x7f0a2414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a23e00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a240c4b30 0x7f0a2414dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a23e00640 1 -- 172.21.15.114:0/2645155613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a240c58b0 msgr2=0x7f0a2414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a23e00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a240c58b0 0x7f0a2414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a23e00640 1 -- 172.21.15.114:0/2645155613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100094d0 con 0x7f0a2406c160 2024-02-17T12:17:40.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a23e00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2406c160 0x7f0a2406ed30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0a14007e40 tx=0x7f0a1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:40.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a1be00640 1 -- 172.21.15.114:0/2645155613 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14014620 con 0x7f0a2406c160 2024-02-17T12:17:40.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a1be00640 1 -- 172.21.15.114:0/2645155613 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1400ee90 con 0x7f0a2406c160 2024-02-17T12:17:40.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a2ac00640 1 -- 172.21.15.114:0/2645155613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a241f15c0 con 0x7f0a2406c160 2024-02-17T12:17:40.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a1be00640 1 -- 172.21.15.114:0/2645155613 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a140149c0 con 0x7f0a2406c160 2024-02-17T12:17:40.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a2ac00640 1 -- 172.21.15.114:0/2645155613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a241f1b80 con 0x7f0a2406c160 2024-02-17T12:17:40.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a2ac00640 1 -- 172.21.15.114:0/2645155613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a24067170 con 0x7f0a2406c160 2024-02-17T12:17:40.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.301+0000 7f0a1be00640 1 -- 172.21.15.114:0/2645155613 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0a14014b20 con 0x7f0a2406c160 2024-02-17T12:17:40.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.305+0000 7f0a1be00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a04066e40 0x7f0a04069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.305+0000 7f0a1be00640 1 -- 172.21.15.114:0/2645155613 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0a14085860 con 0x7f0a2406c160 2024-02-17T12:17:40.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.305+0000 7f0a23400640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a04066e40 0x7f0a04069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.305+0000 7f0a23400640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a04066e40 0x7f0a04069300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a100ae000 tx=0x7f0a100a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:40.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.309+0000 7f0a1be00640 1 -- 172.21.15.114:0/2645155613 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0a140521c0 con 0x7f0a2406c160 2024-02-17T12:17:40.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 -- 172.21.15.114:0/2645155613 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a24074840 con 0x7f0a2406c160 2024-02-17T12:17:40.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a1be00640 1 -- 172.21.15.114:0/2645155613 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a14055880 con 0x7f0a2406c160 2024-02-17T12:17:40.472 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:17:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 -- 172.21.15.114:0/2645155613 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a04066e40 msgr2=0x7f0a04069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a04066e40 0x7f0a04069300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a100ae000 tx=0x7f0a100a7000 comp rx=0 tx=0).stop 2024-02-17T12:17:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 -- 172.21.15.114:0/2645155613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2406c160 msgr2=0x7f0a2406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2406c160 0x7f0a2406ed30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0a14007e40 tx=0x7f0a1400e4b0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 -- 172.21.15.114:0/2645155613 shutdown_connections 2024-02-17T12:17:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a240c58b0 0x7f0a2414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a240c4b30 0x7f0a2414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a04066e40 0x7f0a04069300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 --2- 172.21.15.114:0/2645155613 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2406c160 0x7f0a2406ed30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 -- 172.21.15.114:0/2645155613 >> 172.21.15.114:0/2645155613 conn(0x7f0a240c3730 msgr2=0x7f0a241521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:40.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 -- 172.21.15.114:0/2645155613 shutdown_connections 2024-02-17T12:17:40.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.465+0000 7f0a2ac00640 1 -- 172.21.15.114:0/2645155613 wait complete. 2024-02-17T12:17:40.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:17:40.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad14000640 1 Processor -- start 2024-02-17T12:17:40.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad14000640 1 -- start start 2024-02-17T12:17:40.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad14000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad0c0c25a0 0x7fad0c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad14000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad0c152c50 0x7fad0c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad14000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c156270 con 0x7fad0c06db50 2024-02-17T12:17:40.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad14000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c071630 con 0x7fad0c152c50 2024-02-17T12:17:40.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad14000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c156550 con 0x7fad0c0c25a0 2024-02-17T12:17:40.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad12000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad0c152c50 0x7fad0c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad12000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad0c152c50 0x7fad0c1530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34690/0 (socket says 172.21.15.114:34690) 2024-02-17T12:17:40.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad12000640 1 -- 172.21.15.114:0/2632026278 learned_addr learned my addr 172.21.15.114:0/2632026278 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:40.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.621+0000 7fad11600640 1 --2- 172.21.15.114:0/2632026278 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad0c0c25a0 0x7fad0c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad12000640 1 -- 172.21.15.114:0/2632026278 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad0c0c25a0 msgr2=0x7fad0c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:40.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad12000640 1 --2- 172.21.15.114:0/2632026278 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad0c0c25a0 0x7fad0c06e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad12000640 1 -- 172.21.15.114:0/2632026278 >> v1:172.21.15.116:6789/0 conn(0x7fad0c06db50 legacy=0x7fad0c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad12000640 1 -- 172.21.15.114:0/2632026278 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c156830 con 0x7fad0c152c50 2024-02-17T12:17:40.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad12000640 1 --2- 172.21.15.114:0/2632026278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 0x7fad0c1530e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fad04009e50 tx=0x7fad0401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29270f1ae205dc51 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:40.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad0be00640 1 -- 172.21.15.114:0/2632026278 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040a56c0 con 0x7fad0c152c50 2024-02-17T12:17:40.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad0be00640 1 -- 172.21.15.114:0/2632026278 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad040a5820 con 0x7fad0c152c50 2024-02-17T12:17:40.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad0be00640 1 -- 172.21.15.114:0/2632026278 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040a5bb0 con 0x7fad0c152c50 2024-02-17T12:17:40.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad14000640 1 -- 172.21.15.114:0/2632026278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 msgr2=0x7fad0c1530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad14000640 1 --2- 172.21.15.114:0/2632026278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 0x7fad0c1530e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fad04009e50 tx=0x7fad0401c8e0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad14000640 1 -- 172.21.15.114:0/2632026278 shutdown_connections 2024-02-17T12:17:40.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad14000640 1 --2- 172.21.15.114:0/2632026278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 0x7fad0c1530e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad14000640 1 --2- 172.21.15.114:0/2632026278 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad0c0c25a0 0x7fad0c06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad14000640 1 -- 172.21.15.114:0/2632026278 >> 172.21.15.114:0/2632026278 conn(0x7fad0c0a8490 msgr2=0x7fad0c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:40.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad14000640 1 -- 172.21.15.114:0/2632026278 shutdown_connections 2024-02-17T12:17:40.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.625+0000 7fad14000640 1 -- 172.21.15.114:0/2632026278 wait complete. 2024-02-17T12:17:40.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad14000640 1 Processor -- start 2024-02-17T12:17:40.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad14000640 1 -- start start 2024-02-17T12:17:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad14000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad0c06db50 0x7fad0c155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad14000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad0c0c25a0 0x7fad0c14d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad14000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 0x7fad0c140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad14000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1ef410 con 0x7fad0c152c50 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad14000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1422d0 con 0x7fad0c0c25a0 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad14000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1425b0 con 0x7fad0c06db50 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad12000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 0x7fad0c140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad11600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad0c06db50 0x7fad0c155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad12000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 0x7fad0c140080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34696/0 (socket says 172.21.15.114:34696) 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad12000640 1 -- 172.21.15.114:0/3702903783 learned_addr learned my addr 172.21.15.114:0/3702903783 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad10c00640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad0c0c25a0 0x7fad0c14d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad12000640 1 -- 172.21.15.114:0/3702903783 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad0c06db50 msgr2=0x7fad0c155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad12000640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad0c06db50 0x7fad0c155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad12000640 1 -- 172.21.15.114:0/3702903783 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad0c0c25a0 msgr2=0x7fad0c14d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad12000640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad0c0c25a0 0x7fad0c14d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad12000640 1 -- 172.21.15.114:0/3702903783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad04009b30 con 0x7fad0c152c50 2024-02-17T12:17:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad12000640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 0x7fad0c140080 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fad0401a510 tx=0x7fad04019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad09600640 1 -- 172.21.15.114:0/3702903783 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040b8670 con 0x7fad0c152c50 2024-02-17T12:17:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad09600640 1 -- 172.21.15.114:0/3702903783 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad040b87d0 con 0x7fad0c152c50 2024-02-17T12:17:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad09600640 1 -- 172.21.15.114:0/3702903783 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040b8b40 con 0x7fad0c152c50 2024-02-17T12:17:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad14000640 1 -- 172.21.15.114:0/3702903783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c13b460 con 0x7fad0c152c50 2024-02-17T12:17:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.629+0000 7fad14000640 1 -- 172.21.15.114:0/3702903783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c1ef0c0 con 0x7fad0c152c50 2024-02-17T12:17:40.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.633+0000 7fad14000640 1 -- 172.21.15.114:0/3702903783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c074840 con 0x7fad0c152c50 2024-02-17T12:17:40.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.633+0000 7fad09600640 1 -- 172.21.15.114:0/3702903783 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fad040b8ca0 con 0x7fad0c152c50 2024-02-17T12:17:40.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.633+0000 7fad09600640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf0066e40 0x7facf0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.633+0000 7fad09600640 1 -- 172.21.15.114:0/3702903783 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fad04120080 con 0x7fad0c152c50 2024-02-17T12:17:40.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.633+0000 7fad11600640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf0066e40 0x7facf0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.633+0000 7fad11600640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf0066e40 0x7facf0069300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7facfc009b60 tx=0x7facfc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:40.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.637+0000 7fad09600640 1 -- 172.21.15.114:0/3702903783 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fad04151cb0 con 0x7fad0c152c50 2024-02-17T12:17:40.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.789+0000 7fad14000640 1 -- 172.21.15.114:0/3702903783 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad0c150210 con 0x7fad0c152c50 2024-02-17T12:17:40.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.789+0000 7fad09600640 1 -- 172.21.15.114:0/3702903783 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v36) v1 ==== 105+0+11 (secure 0 0 0) 0x7fad040ecbb0 con 0x7fad0c152c50 2024-02-17T12:17:40.799 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:17:40.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 -- 172.21.15.114:0/3702903783 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf0066e40 msgr2=0x7facf0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf0066e40 0x7facf0069300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7facfc009b60 tx=0x7facfc009190 comp rx=0 tx=0).stop 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 -- 172.21.15.114:0/3702903783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 msgr2=0x7fad0c140080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 0x7fad0c140080 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fad0401a510 tx=0x7fad04019680 comp rx=0 tx=0).stop 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 -- 172.21.15.114:0/3702903783 shutdown_connections 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf0066e40 0x7facf0069300 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad0c152c50 0x7fad0c140080 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad0c0c25a0 0x7fad0c14d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 --2- 172.21.15.114:0/3702903783 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad0c06db50 0x7fad0c155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 -- 172.21.15.114:0/3702903783 >> 172.21.15.114:0/3702903783 conn(0x7fad0c0a8490 msgr2=0x7fad0c0c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 -- 172.21.15.114:0/3702903783 shutdown_connections 2024-02-17T12:17:40.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.793+0000 7fad14000640 1 -- 172.21.15.114:0/3702903783 wait complete. 2024-02-17T12:17:40.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:17:40.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.949+0000 7ff507800640 1 Processor -- start 2024-02-17T12:17:40.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.949+0000 7ff507800640 1 -- start start 2024-02-17T12:17:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.949+0000 7ff507800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff50014f110 0x7ff5000c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.949+0000 7ff507800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000c2580 0x7ff5000aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.949+0000 7ff507800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000a9420 con 0x7ff5000c1eb0 2024-02-17T12:17:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.949+0000 7ff507800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50014f4f0 con 0x7ff50014f110 2024-02-17T12:17:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.949+0000 7ff507800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000aae80 con 0x7ff5000c2580 2024-02-17T12:17:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.949+0000 7ff504e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff50014f110 0x7ff5000c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.949+0000 7ff504e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff50014f110 0x7ff5000c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34700/0 (socket says 172.21.15.114:34700) 2024-02-17T12:17:40.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.949+0000 7ff504e00640 1 -- 172.21.15.114:0/2106899612 learned_addr learned my addr 172.21.15.114:0/2106899612 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:40.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff504e00640 1 -- 172.21.15.114:0/2106899612 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000c2580 msgr2=0x7ff5000aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:40.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff4ffe00640 1 --2- 172.21.15.114:0/2106899612 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000c2580 0x7ff5000aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff504e00640 1 --2- 172.21.15.114:0/2106899612 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000c2580 0x7ff5000aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff504e00640 1 -- 172.21.15.114:0/2106899612 >> v1:172.21.15.116:6789/0 conn(0x7ff5000c1eb0 legacy=0x7ff500155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:40.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff504e00640 1 -- 172.21.15.114:0/2106899612 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff500152850 con 0x7ff50014f110 2024-02-17T12:17:40.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff4ffe00640 1 --2- 172.21.15.114:0/2106899612 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000c2580 0x7ff5000aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff504e00640 1 --2- 172.21.15.114:0/2106899612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50014f110 0x7ff5000c65a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009870 tx=0x7ff4e801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43eb6e5b1bc5d28 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff4ff400640 1 -- 172.21.15.114:0/2106899612 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80ab620 con 0x7ff50014f110 2024-02-17T12:17:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff4ff400640 1 -- 172.21.15.114:0/2106899612 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e80ab780 con 0x7ff50014f110 2024-02-17T12:17:40.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff4ff400640 1 -- 172.21.15.114:0/2106899612 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80abb10 con 0x7ff50014f110 2024-02-17T12:17:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff507800640 1 -- 172.21.15.114:0/2106899612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50014f110 msgr2=0x7ff5000c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff507800640 1 --2- 172.21.15.114:0/2106899612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50014f110 0x7ff5000c65a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009870 tx=0x7ff4e801c460 comp rx=0 tx=0).stop 2024-02-17T12:17:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff507800640 1 -- 172.21.15.114:0/2106899612 shutdown_connections 2024-02-17T12:17:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.953+0000 7ff507800640 1 --2- 172.21.15.114:0/2106899612 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5000c2580 0x7ff5000aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 --2- 172.21.15.114:0/2106899612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50014f110 0x7ff5000c65a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 -- 172.21.15.114:0/2106899612 >> 172.21.15.114:0/2106899612 conn(0x7ff5000a8490 msgr2=0x7ff5000a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 -- 172.21.15.114:0/2106899612 shutdown_connections 2024-02-17T12:17:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 -- 172.21.15.114:0/2106899612 wait complete. 2024-02-17T12:17:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 Processor -- start 2024-02-17T12:17:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 -- start start 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5000c1eb0 0x7ff50014a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5000c2580 0x7ff5001eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff50014f110 0x7ff500145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50014b420 con 0x7ff5000c1eb0 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5001edf50 con 0x7ff5000c2580 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50014ae60 con 0x7ff50014f110 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff504e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5000c1eb0 0x7ff50014a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff504e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5000c1eb0 0x7ff50014a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34706/0 (socket says 172.21.15.114:34706) 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff504e00640 1 -- 172.21.15.114:0/3487982815 learned_addr learned my addr 172.21.15.114:0/3487982815 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff4ffe00640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5000c2580 0x7ff5001eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff505800640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff50014f110 0x7ff500145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff504e00640 1 -- 172.21.15.114:0/3487982815 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff50014f110 msgr2=0x7ff500145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff504e00640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff50014f110 0x7ff500145220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff504e00640 1 -- 172.21.15.114:0/3487982815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5000c2580 msgr2=0x7ff5001eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:40.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff504e00640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5000c2580 0x7ff5001eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:40.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff504e00640 1 -- 172.21.15.114:0/3487982815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80094d0 con 0x7ff5000c1eb0 2024-02-17T12:17:40.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff504e00640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5000c1eb0 0x7ff50014a880 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80ad040 tx=0x7ff4e801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:40.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff4fcc00640 1 -- 172.21.15.114:0/3487982815 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80be3f0 con 0x7ff5000c1eb0 2024-02-17T12:17:40.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff4fcc00640 1 -- 172.21.15.114:0/3487982815 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e80be570 con 0x7ff5000c1eb0 2024-02-17T12:17:40.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff4fcc00640 1 -- 172.21.15.114:0/3487982815 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80be920 con 0x7ff5000c1eb0 2024-02-17T12:17:40.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 -- 172.21.15.114:0/3487982815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50014b140 con 0x7ff5000c1eb0 2024-02-17T12:17:40.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.957+0000 7ff507800640 1 -- 172.21.15.114:0/3487982815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5001f1390 con 0x7ff5000c1eb0 2024-02-17T12:17:40.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.961+0000 7ff507800640 1 -- 172.21.15.114:0/3487982815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5001f1580 con 0x7ff5000c1eb0 2024-02-17T12:17:40.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.961+0000 7ff4fcc00640 1 -- 172.21.15.114:0/3487982815 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff4e80b43f0 con 0x7ff5000c1eb0 2024-02-17T12:17:40.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.961+0000 7ff4fcc00640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff4dc066e70 0x7ff4dc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:40.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.961+0000 7ff4fcc00640 1 -- 172.21.15.114:0/3487982815 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff4e811f700 con 0x7ff5000c1eb0 2024-02-17T12:17:40.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.961+0000 7ff4ffe00640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff4dc066e70 0x7ff4dc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:40.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.961+0000 7ff4ffe00640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff4dc066e70 0x7ff4dc069330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff5000bfcd0 tx=0x7ff4f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:40.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:40.965+0000 7ff4fcc00640 1 -- 172.21.15.114:0/3487982815 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff4e80ec230 con 0x7ff5000c1eb0 2024-02-17T12:17:41.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.121+0000 7ff507800640 1 -- 172.21.15.114:0/3487982815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ff500074840 con 0x7ff5000c1eb0 2024-02-17T12:17:41.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.121+0000 7ff4fcc00640 1 -- 172.21.15.114:0/3487982815 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v36) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff4e80ef8f0 con 0x7ff5000c1eb0 2024-02-17T12:17:41.131 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:17:41.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 -- 172.21.15.114:0/3487982815 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff4dc066e70 msgr2=0x7ff4dc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff4dc066e70 0x7ff4dc069330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff5000bfcd0 tx=0x7ff4f0008040 comp rx=0 tx=0).stop 2024-02-17T12:17:41.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 -- 172.21.15.114:0/3487982815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5000c1eb0 msgr2=0x7ff50014a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5000c1eb0 0x7ff50014a880 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80ad040 tx=0x7ff4e801aca0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 -- 172.21.15.114:0/3487982815 shutdown_connections 2024-02-17T12:17:41.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff50014f110 0x7ff500145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5000c2580 0x7ff5001eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff4dc066e70 0x7ff4dc069330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 --2- 172.21.15.114:0/3487982815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5000c1eb0 0x7ff50014a880 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 -- 172.21.15.114:0/3487982815 >> 172.21.15.114:0/3487982815 conn(0x7ff5000a8490 msgr2=0x7ff5000a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:41.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 -- 172.21.15.114:0/3487982815 shutdown_connections 2024-02-17T12:17:41.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.125+0000 7ff507800640 1 -- 172.21.15.114:0/3487982815 wait complete. 2024-02-17T12:17:41.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:41.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.277+0000 7f7d7a400640 1 Processor -- start 2024-02-17T12:17:41.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.277+0000 7f7d7a400640 1 -- start start 2024-02-17T12:17:41.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d7a400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d7414f110 0x7f7d740c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d7a400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d740c2580 0x7f7d740aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d7a400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d740a9420 con 0x7f7d740c1eb0 2024-02-17T12:17:41.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d7a400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7414f4f0 con 0x7f7d7414f110 2024-02-17T12:17:41.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d7a400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740aae80 con 0x7f7d740c2580 2024-02-17T12:17:41.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d73400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d7414f110 0x7f7d740c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d73e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7d740c1eb0 0x7f7d74155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49192/0 (socket says 172.21.15.114:49192) 2024-02-17T12:17:41.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d73e00640 1 -- 172.21.15.114:0/1706060913 learned_addr learned my addr 172.21.15.114:0/1706060913 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:41.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d72a00640 1 --2- 172.21.15.114:0/1706060913 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d740c2580 0x7f7d740aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d73400640 1 -- 172.21.15.114:0/1706060913 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d740c2580 msgr2=0x7f7d740aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:41.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d73400640 1 --2- 172.21.15.114:0/1706060913 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d740c2580 0x7f7d740aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d73400640 1 -- 172.21.15.114:0/1706060913 >> v1:172.21.15.114:6789/0 conn(0x7f7d740c1eb0 legacy=0x7f7d74155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d73400640 1 -- 172.21.15.114:0/1706060913 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d74152850 con 0x7f7d7414f110 2024-02-17T12:17:41.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d72000640 1 -- 172.21.15.114:0/1706060913 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942666080 0 0) 0x7f7d740a9420 con 0x7f7d740c1eb0 2024-02-17T12:17:41.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d73400640 1 --2- 172.21.15.114:0/1706060913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d7414f110 0x7f7d740c65a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009d90 tx=0x7f7d6401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6af1314e5620ba6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:41.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d72000640 1 -- 172.21.15.114:0/1706060913 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d640a5970 con 0x7f7d7414f110 2024-02-17T12:17:41.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d72000640 1 -- 172.21.15.114:0/1706060913 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d640a5ad0 con 0x7f7d7414f110 2024-02-17T12:17:41.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.281+0000 7f7d72000640 1 -- 172.21.15.114:0/1706060913 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d640a5e60 con 0x7f7d7414f110 2024-02-17T12:17:41.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 -- 172.21.15.114:0/1706060913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d7414f110 msgr2=0x7f7d740c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 --2- 172.21.15.114:0/1706060913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d7414f110 0x7f7d740c65a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009d90 tx=0x7f7d6401c8b0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 -- 172.21.15.114:0/1706060913 shutdown_connections 2024-02-17T12:17:41.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 --2- 172.21.15.114:0/1706060913 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d740c2580 0x7f7d740aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 --2- 172.21.15.114:0/1706060913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d7414f110 0x7f7d740c65a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 -- 172.21.15.114:0/1706060913 >> 172.21.15.114:0/1706060913 conn(0x7f7d740a8490 msgr2=0x7f7d740a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:41.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 -- 172.21.15.114:0/1706060913 shutdown_connections 2024-02-17T12:17:41.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 -- 172.21.15.114:0/1706060913 wait complete. 2024-02-17T12:17:41.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 Processor -- start 2024-02-17T12:17:41.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 -- start start 2024-02-17T12:17:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d740c1eb0 0x7f7d7406e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d740c2580 0x7f7d741ef280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d7414f110 0x7f7d741ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d741494a0 con 0x7f7d740c2580 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d741eedf0 con 0x7f7d7414f110 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d7a400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74149f80 con 0x7f7d740c1eb0 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d72a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d740c2580 0x7f7d741ef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d72a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d740c2580 0x7f7d741ef280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34722/0 (socket says 172.21.15.114:34722) 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d72a00640 1 -- 172.21.15.114:0/586784968 learned_addr learned my addr 172.21.15.114:0/586784968 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d73400640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d740c1eb0 0x7f7d7406e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d73e00640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d7414f110 0x7f7d741ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d72a00640 1 -- 172.21.15.114:0/586784968 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d740c1eb0 msgr2=0x7f7d7406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d72a00640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d740c1eb0 0x7f7d7406e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d72a00640 1 -- 172.21.15.114:0/586784968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d7414f110 msgr2=0x7f7d741ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d72a00640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d7414f110 0x7f7d741ef7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d72a00640 1 -- 172.21.15.114:0/586784968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d64009a70 con 0x7f7d740c2580 2024-02-17T12:17:41.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.285+0000 7f7d73e00640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d7414f110 0x7f7d741ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:41.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d72a00640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d740c2580 0x7f7d741ef280 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00d7d0 tx=0x7f7d5c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:41.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d6b400640 1 -- 172.21.15.114:0/586784968 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c00b6c0 con 0x7f7d740c2580 2024-02-17T12:17:41.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d6b400640 1 -- 172.21.15.114:0/586784968 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c00b820 con 0x7f7d740c2580 2024-02-17T12:17:41.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d7a400640 1 -- 172.21.15.114:0/586784968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d741efd00 con 0x7f7d740c2580 2024-02-17T12:17:41.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d6b400640 1 -- 172.21.15.114:0/586784968 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c00bbd0 con 0x7f7d740c2580 2024-02-17T12:17:41.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d7a400640 1 -- 172.21.15.114:0/586784968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d74149c80 con 0x7f7d740c2580 2024-02-17T12:17:41.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d7a400640 1 -- 172.21.15.114:0/586784968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d74074840 con 0x7f7d740c2580 2024-02-17T12:17:41.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d6b400640 1 -- 172.21.15.114:0/586784968 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f7d5c00bd30 con 0x7f7d740c2580 2024-02-17T12:17:41.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d6b400640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7d50066e40 0x7f7d50069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d6b400640 1 -- 172.21.15.114:0/586784968 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d5c085240 con 0x7f7d740c2580 2024-02-17T12:17:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.289+0000 7f7d73400640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7d50066e40 0x7f7d50069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.293+0000 7f7d73400640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7d50066e40 0x7f7d50069300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d640af000 tx=0x7f7d640a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:41.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.293+0000 7f7d6b400640 1 -- 172.21.15.114:0/586784968 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7d5c051cc0 con 0x7f7d740c2580 2024-02-17T12:17:41.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 -- 172.21.15.114:0/586784968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d7406b9c0 con 0x7f7d740c2580 2024-02-17T12:17:41.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d6b400640 1 -- 172.21.15.114:0/586784968 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6192 (secure 0 0 0) 0x7f7d5c055380 con 0x7f7d740c2580 2024-02-17T12:17:41.488 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:41.488 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:05.397716+0000","modified":"2024-02-17T12:17:08.427075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1473468479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1473468479},{"type":"v1","addr":"172.21.15.114:6837","nonce":1473468479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:22.698504+0000","modified":"2024-02-17T12:17:25.708127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4941},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4941":{"gid":4941,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/2833741536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2833741536},{"type":"v1","addr":"172.21.15.114:6836","nonce":2833741536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-02-17T12:17:41.488 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 22 2024-02-17T12:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 -- 172.21.15.114:0/586784968 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7d50066e40 msgr2=0x7f7d50069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7d50066e40 0x7f7d50069300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d640af000 tx=0x7f7d640a7070 comp rx=0 tx=0).stop 2024-02-17T12:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 -- 172.21.15.114:0/586784968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d740c2580 msgr2=0x7f7d741ef280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d740c2580 0x7f7d741ef280 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00d7d0 tx=0x7f7d5c00dc90 comp rx=0 tx=0).stop 2024-02-17T12:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 -- 172.21.15.114:0/586784968 shutdown_connections 2024-02-17T12:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7d7414f110 0x7f7d741ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7d50066e40 0x7f7d50069300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d740c2580 0x7f7d741ef280 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 --2- 172.21.15.114:0/586784968 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7d740c1eb0 0x7f7d7406e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 -- 172.21.15.114:0/586784968 >> 172.21.15.114:0/586784968 conn(0x7f7d740a8490 msgr2=0x7f7d740a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:41.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 -- 172.21.15.114:0/586784968 shutdown_connections 2024-02-17T12:17:41.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.481+0000 7f7d7a400640 1 -- 172.21.15.114:0/586784968 wait complete. 2024-02-17T12:17:41.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed38c00640 1 Processor -- start 2024-02-17T12:17:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed38c00640 1 -- start start 2024-02-17T12:17:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed38c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fed340a6360 0x7fed341583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed38c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed34155090 con 0x7fed340c4b30 2024-02-17T12:17:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed38c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed34159300 con 0x7fed340c58b0 2024-02-17T12:17:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed38c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed340c6110 con 0x7fed340a6360 2024-02-17T12:17:41.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed32800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fed340a6360 0x7fed341583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed29400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fed340c4b30 0x7fed34155520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49202/0 (socket says 172.21.15.114:49202) 2024-02-17T12:17:41.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed29400640 1 -- 172.21.15.114:0/3418543549 learned_addr learned my addr 172.21.15.114:0/3418543549 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:41.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed32800640 1 -- 172.21.15.114:0/3418543549 >> v1:172.21.15.116:6789/0 conn(0x7fed340c58b0 legacy=0x7fed3406bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed32800640 1 -- 172.21.15.114:0/3418543549 >> v1:172.21.15.114:6789/0 conn(0x7fed340c4b30 legacy=0x7fed34155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.637+0000 7fed32800640 1 -- 172.21.15.114:0/3418543549 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed34158a60 con 0x7fed340a6360 2024-02-17T12:17:41.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed32800640 1 --2- 172.21.15.114:0/3418543549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 0x7fed341583d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009d90 tx=0x7fed2c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30db609261d59743 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:41.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed31400640 1 -- 172.21.15.114:0/3418543549 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0a5a00 con 0x7fed340a6360 2024-02-17T12:17:41.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed31400640 1 -- 172.21.15.114:0/3418543549 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c0a5b60 con 0x7fed340a6360 2024-02-17T12:17:41.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed31400640 1 -- 172.21.15.114:0/3418543549 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c0ad440 con 0x7fed340a6360 2024-02-17T12:17:41.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed38c00640 1 -- 172.21.15.114:0/3418543549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 msgr2=0x7fed341583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed38c00640 1 --2- 172.21.15.114:0/3418543549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 0x7fed341583d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009d90 tx=0x7fed2c01c940 comp rx=0 tx=0).stop 2024-02-17T12:17:41.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed38c00640 1 -- 172.21.15.114:0/3418543549 shutdown_connections 2024-02-17T12:17:41.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed38c00640 1 --2- 172.21.15.114:0/3418543549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 0x7fed341583d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed38c00640 1 -- 172.21.15.114:0/3418543549 >> 172.21.15.114:0/3418543549 conn(0x7fed340c3730 msgr2=0x7fed340c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:41.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed38c00640 1 -- 172.21.15.114:0/3418543549 shutdown_connections 2024-02-17T12:17:41.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed38c00640 1 -- 172.21.15.114:0/3418543549 wait complete. 2024-02-17T12:17:41.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.641+0000 7fed38c00640 1 Processor -- start 2024-02-17T12:17:41.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed38c00640 1 -- start start 2024-02-17T12:17:41.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed38c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 0x7fed341524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed38c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fed340c4b30 0x7fed341f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed38c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed340c58b0 0x7fed3414f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed38c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed341ed9d0 con 0x7fed340a6360 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed38c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed34151e20 con 0x7fed340c58b0 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed38c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed34150940 con 0x7fed340c4b30 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed31e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 0x7fed341524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed31e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 0x7fed341524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34734/0 (socket says 172.21.15.114:34734) 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed31e00640 1 -- 172.21.15.114:0/1578518133 learned_addr learned my addr 172.21.15.114:0/1578518133 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed31e00640 1 -- 172.21.15.114:0/1578518133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fed340c4b30 msgr2=0x7fed341f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed31e00640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fed340c4b30 0x7fed341f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed31e00640 1 -- 172.21.15.114:0/1578518133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed340c58b0 msgr2=0x7fed3414f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed31e00640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed340c58b0 0x7fed3414f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed31e00640 1 -- 172.21.15.114:0/1578518133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c009a70 con 0x7fed340a6360 2024-02-17T12:17:41.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed31e00640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 0x7fed341524b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c3c0 tx=0x7fed2400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:41.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed2aa00640 1 -- 172.21.15.114:0/1578518133 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240052d0 con 0x7fed340a6360 2024-02-17T12:17:41.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed2aa00640 1 -- 172.21.15.114:0/1578518133 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24005430 con 0x7fed340a6360 2024-02-17T12:17:41.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed2aa00640 1 -- 172.21.15.114:0/1578518133 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed24003840 con 0x7fed340a6360 2024-02-17T12:17:41.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed38c00640 1 -- 172.21.15.114:0/1578518133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed34150c20 con 0x7fed340a6360 2024-02-17T12:17:41.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed38c00640 1 -- 172.21.15.114:0/1578518133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3414faf0 con 0x7fed340a6360 2024-02-17T12:17:41.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.645+0000 7fed38c00640 1 -- 172.21.15.114:0/1578518133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed34067170 con 0x7fed340a6360 2024-02-17T12:17:41.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.649+0000 7fed2aa00640 1 -- 172.21.15.114:0/1578518133 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fed240039a0 con 0x7fed340a6360 2024-02-17T12:17:41.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.649+0000 7fed2aa00640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fed10066e40 0x7fed10069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.649+0000 7fed2aa00640 1 -- 172.21.15.114:0/1578518133 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fed24084330 con 0x7fed340a6360 2024-02-17T12:17:41.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.649+0000 7fed29400640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fed10066e40 0x7fed10069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.649+0000 7fed29400640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fed10066e40 0x7fed10069300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fed341529f0 tx=0x7fed1c007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:41.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.653+0000 7fed2aa00640 1 -- 172.21.15.114:0/1578518133 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed24050db0 con 0x7fed340a6360 2024-02-17T12:17:41.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.809+0000 7fed38c00640 1 -- 172.21.15.114:0/1578518133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed34074840 con 0x7fed340a6360 2024-02-17T12:17:41.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.809+0000 7fed2aa00640 1 -- 172.21.15.114:0/1578518133 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20407 (secure 0 0 0) 0x7fed24054470 con 0x7fed340a6360 2024-02-17T12:17:41.817 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:41.817 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:24.325322+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.809+0000 7fed38c00640 1 -- 172.21.15.114:0/1578518133 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fed10066e40 msgr2=0x7fed10069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.809+0000 7fed38c00640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fed10066e40 0x7fed10069300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fed341529f0 tx=0x7fed1c007a50 comp rx=0 tx=0).stop 2024-02-17T12:17:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.809+0000 7fed38c00640 1 -- 172.21.15.114:0/1578518133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 msgr2=0x7fed341524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.809+0000 7fed38c00640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 0x7fed341524b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c3c0 tx=0x7fed2400c880 comp rx=0 tx=0).stop 2024-02-17T12:17:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.813+0000 7fed38c00640 1 -- 172.21.15.114:0/1578518133 shutdown_connections 2024-02-17T12:17:41.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.813+0000 7fed38c00640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed340c58b0 0x7fed3414f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.813+0000 7fed38c00640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fed340c4b30 0x7fed341f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.813+0000 7fed38c00640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fed10066e40 0x7fed10069300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.813+0000 7fed38c00640 1 --2- 172.21.15.114:0/1578518133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed340a6360 0x7fed341524b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.813+0000 7fed38c00640 1 -- 172.21.15.114:0/1578518133 >> 172.21.15.114:0/1578518133 conn(0x7fed340c3730 msgr2=0x7fed340c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:41.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.813+0000 7fed38c00640 1 -- 172.21.15.114:0/1578518133 shutdown_connections 2024-02-17T12:17:41.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.813+0000 7fed38c00640 1 -- 172.21.15.114:0/1578518133 wait complete. 2024-02-17T12:17:41.838 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-17T12:17:41.838 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:41.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff057000640 1 Processor -- start 2024-02-17T12:17:41.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff057000640 1 -- start start 2024-02-17T12:17:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff057000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff0500714c0 0x7ff050156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff057000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff050152d30 0x7ff0501531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff057000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff050157270 con 0x7ff050150300 2024-02-17T12:17:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff057000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0500c6900 con 0x7ff0500714c0 2024-02-17T12:17:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff057000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c3580 con 0x7ff050152d30 2024-02-17T12:17:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff050150300 0x7ff0500aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49214/0 (socket says 172.21.15.114:49214) 2024-02-17T12:17:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04fe00640 1 -- 172.21.15.114:0/1675989097 learned_addr learned my addr 172.21.15.114:0/1675989097 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff055000640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff050152d30 0x7ff0501531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff047400640 1 --2- 172.21.15.114:0/1675989097 >> v2:172.21.15.116:3300/0 conn(0x7ff0500714c0 0x7ff050156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423696115 0 0) 0x7ff050157270 con 0x7ff050150300 2024-02-17T12:17:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff034003530 con 0x7ff050150300 2024-02-17T12:17:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1326388313 0 0) 0x7ff034003530 con 0x7ff050150300 2024-02-17T12:17:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff050152d30 msgr2=0x7ff0501531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff050152d30 0x7ff0501531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 >> v2:172.21.15.116:3300/0 conn(0x7ff0500714c0 msgr2=0x7ff050156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 --2- 172.21.15.114:0/1675989097 >> v2:172.21.15.116:3300/0 conn(0x7ff0500714c0 0x7ff050156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500c2fc0 con 0x7ff050150300 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7ff040001680 con 0x7ff050150300 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 >> v1:172.21.15.114:6789/0 conn(0x7ff050150300 legacy=0x7ff0500aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff034003980 0x7ff034003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0340047d0 0x7ff034004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff050152d30 0x7ff034005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c6900 con 0x7ff0340047d0 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c3580 con 0x7ff034003980 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03400b990 con 0x7ff050152d30 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.965+0000 7ff047400640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0340047d0 0x7ff034004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff04fe00640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff034003980 0x7ff034003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff055000640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff050152d30 0x7ff034005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff047400640 1 -- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff050152d30 msgr2=0x7ff034005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff047400640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff050152d30 0x7ff034005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff047400640 1 -- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff034003980 msgr2=0x7ff034003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff047400640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff034003980 0x7ff034003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff047400640 1 -- 172.21.15.114:0/1675989097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034003530 con 0x7ff0340047d0 2024-02-17T12:17:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff04fe00640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff034003980 0x7ff034003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:41.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff047400640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0340047d0 0x7ff034004c50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff038009b10 tx=0x7ff03801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16177431633d431f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:41.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380a64a0 con 0x7ff0340047d0 2024-02-17T12:17:41.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0380a6600 con 0x7ff0340047d0 2024-02-17T12:17:41.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff04f400640 1 -- 172.21.15.114:0/1675989097 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380a69b0 con 0x7ff0340047d0 2024-02-17T12:17:41.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff057000640 1 -- 172.21.15.114:0/1675989097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0340047d0 msgr2=0x7ff034004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff057000640 1 --2- 172.21.15.114:0/1675989097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0340047d0 0x7ff034004c50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff038009b10 tx=0x7ff03801cab0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.969+0000 7ff055000640 1 -- 172.21.15.114:0/1675989097 reap_dead start 2024-02-17T12:17:41.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 -- 172.21.15.114:0/1675989097 shutdown_connections 2024-02-17T12:17:41.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 -- 172.21.15.114:0/1675989097 >> 172.21.15.114:0/1675989097 conn(0x7ff0500c4f20 msgr2=0x7ff0500c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:41.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 -- 172.21.15.114:0/1675989097 shutdown_connections 2024-02-17T12:17:41.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 -- 172.21.15.114:0/1675989097 wait complete. 2024-02-17T12:17:41.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 Processor -- start 2024-02-17T12:17:41.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 -- start start 2024-02-17T12:17:41.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0340047d0 0x7ff0500c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501eda80 0x7ff0501edee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff0501f09c0 0x7ff0501f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500ad7c0 con 0x7ff0501eda80 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500ad9f0 con 0x7ff0340047d0 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff057000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500adcd0 con 0x7ff0501f09c0 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff047400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501eda80 0x7ff0501edee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff047400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501eda80 0x7ff0501edee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34748/0 (socket says 172.21.15.114:34748) 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff047400640 1 -- 172.21.15.114:0/740475001 learned_addr learned my addr 172.21.15.114:0/740475001 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff04fe00640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0340047d0 0x7ff0500c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff055000640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff0501f09c0 0x7ff0501f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff047400640 1 -- 172.21.15.114:0/740475001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff0501f09c0 msgr2=0x7ff0501f0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff047400640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff0501f09c0 0x7ff0501f0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff047400640 1 -- 172.21.15.114:0/740475001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0340047d0 msgr2=0x7ff0500c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff047400640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0340047d0 0x7ff0500c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff047400640 1 -- 172.21.15.114:0/740475001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500adfb0 con 0x7ff0501eda80 2024-02-17T12:17:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff047400640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501eda80 0x7ff0501edee0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff03801c8e0 tx=0x7ff034005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:41.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.973+0000 7ff04cc00640 1 -- 172.21.15.114:0/740475001 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380b5070 con 0x7ff0501eda80 2024-02-17T12:17:41.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.977+0000 7ff04cc00640 1 -- 172.21.15.114:0/740475001 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03800f000 con 0x7ff0501eda80 2024-02-17T12:17:41.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.977+0000 7ff04cc00640 1 -- 172.21.15.114:0/740475001 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380a7480 con 0x7ff0501eda80 2024-02-17T12:17:41.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.977+0000 7ff057000640 1 -- 172.21.15.114:0/740475001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0501ed560 con 0x7ff0501eda80 2024-02-17T12:17:41.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.977+0000 7ff057000640 1 -- 172.21.15.114:0/740475001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0500ae290 con 0x7ff0501eda80 2024-02-17T12:17:41.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.977+0000 7ff057000640 1 -- 172.21.15.114:0/740475001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0501ed6f0 con 0x7ff0501eda80 2024-02-17T12:17:41.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.977+0000 7ff04cc00640 1 -- 172.21.15.114:0/740475001 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff0380b9070 con 0x7ff0501eda80 2024-02-17T12:17:41.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.977+0000 7ff04cc00640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 0x7ff02c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:41.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.977+0000 7ff04cc00640 1 -- 172.21.15.114:0/740475001 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff03811e8b0 con 0x7ff0501eda80 2024-02-17T12:17:41.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.977+0000 7ff04fe00640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 0x7ff02c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:41.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.977+0000 7ff04fe00640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 0x7ff02c069300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff040001000 tx=0x7ff040007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:41.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:41.981+0000 7ff04cc00640 1 -- 172.21.15.114:0/740475001 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff0380eb3e0 con 0x7ff0501eda80 2024-02-17T12:17:42.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.169+0000 7ff057000640 1 -- 172.21.15.114:0/740475001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0500ad7c0 con 0x7ff0501eda80 2024-02-17T12:17:42.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.169+0000 7ff04cc00640 1 -- 172.21.15.114:0/740475001 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6192 (secure 0 0 0) 0x7ff0380c0020 con 0x7ff0501eda80 2024-02-17T12:17:42.179 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:42.179 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:05.397716+0000","modified":"2024-02-17T12:17:08.427075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1473468479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1473468479},{"type":"v1","addr":"172.21.15.114:6837","nonce":1473468479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:22.698504+0000","modified":"2024-02-17T12:17:25.708127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4941},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4941":{"gid":4941,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/2833741536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2833741536},{"type":"v1","addr":"172.21.15.114:6836","nonce":2833741536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-02-17T12:17:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 22 2024-02-17T12:17:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 -- 172.21.15.114:0/740475001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 msgr2=0x7ff02c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 0x7ff02c069300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff040001000 tx=0x7ff040007040 comp rx=0 tx=0).stop 2024-02-17T12:17:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 -- 172.21.15.114:0/740475001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501eda80 msgr2=0x7ff0501edee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501eda80 0x7ff0501edee0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff03801c8e0 tx=0x7ff034005800 comp rx=0 tx=0).stop 2024-02-17T12:17:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 -- 172.21.15.114:0/740475001 shutdown_connections 2024-02-17T12:17:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff0501f09c0 0x7ff0501f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff02c066e40 0x7ff02c069300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0501eda80 0x7ff0501edee0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 --2- 172.21.15.114:0/740475001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff0340047d0 0x7ff0500c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 -- 172.21.15.114:0/740475001 >> 172.21.15.114:0/740475001 conn(0x7ff0500c4f20 msgr2=0x7ff0500a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 -- 172.21.15.114:0/740475001 shutdown_connections 2024-02-17T12:17:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.173+0000 7ff057000640 1 -- 172.21.15.114:0/740475001 wait complete. 2024-02-17T12:17:42.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:42.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:17:42.304 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:17:42.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8fe00640 1 Processor -- start 2024-02-17T12:17:42.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8fe00640 1 -- start start 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b88152c50 0x7f6b881530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b88156270 con 0x7f6b880c25a0 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8fe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b88156550 con 0x7f6b8806db50 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8806f090 con 0x7f6b88152c50 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8d400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6b880c25a0 0x7f6b8806e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49226/0 (socket says 172.21.15.114:49226) 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8d400640 1 -- 172.21.15.114:0/1373221975 learned_addr learned my addr 172.21.15.114:0/1373221975 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8de00640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b88152c50 0x7f6b881530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350188106 0 0) 0x7f6b88156270 con 0x7f6b880c25a0 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b70003530 con 0x7f6b880c25a0 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509279930 0 0) 0x7f6b88156550 con 0x7f6b8806db50 2024-02-17T12:17:42.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b88156270 con 0x7f6b8806db50 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 76784853 0 0) 0x7f6b70003530 con 0x7f6b880c25a0 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b88152c50 msgr2=0x7f6b881530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b88152c50 0x7f6b881530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 >> v1:172.21.15.116:6789/0 conn(0x7f6b8806db50 legacy=0x7f6b8814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b88156830 con 0x7f6b880c25a0 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f6b7c0016a0 con 0x7f6b880c25a0 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 >> v1:172.21.15.114:6789/0 conn(0x7f6b880c25a0 legacy=0x7f6b8806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003b40 0x7f6b70003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b88152c50 0x7f6b700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70004d10 0x7f6b70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8806f090 con 0x7f6b70003b40 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7000bba0 con 0x7f6b70004d10 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7000bd60 con 0x7f6b88152c50 2024-02-17T12:17:42.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8d400640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003b40 0x7f6b70003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8ca00640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b88152c50 0x7f6b700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8de00640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70004d10 0x7f6b70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8d400640 1 -- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b88152c50 msgr2=0x7f6b700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8d400640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b88152c50 0x7f6b700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8d400640 1 -- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70004d10 msgr2=0x7f6b70005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8d400640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70004d10 0x7f6b70005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8d400640 1 -- 172.21.15.114:0/1373221975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70003530 con 0x7f6b70003b40 2024-02-17T12:17:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8de00640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70004d10 0x7f6b70005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.329+0000 7f6b8ca00640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b88152c50 0x7f6b700047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b8d400640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003b40 0x7f6b70003f40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c007fa0 tx=0x7f6b7c01cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7212df70a1cf75d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c005ae0 con 0x7f6b70003b40 2024-02-17T12:17:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c005c40 con 0x7f6b70003b40 2024-02-17T12:17:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b87e00640 1 -- 172.21.15.114:0/1373221975 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c007070 con 0x7f6b70003b40 2024-02-17T12:17:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1373221975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003b40 msgr2=0x7f6b70003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b8fe00640 1 --2- 172.21.15.114:0/1373221975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003b40 0x7f6b70003f40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c007fa0 tx=0x7f6b7c01cae0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b8de00640 1 -- 172.21.15.114:0/1373221975 reap_dead start 2024-02-17T12:17:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1373221975 shutdown_connections 2024-02-17T12:17:42.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1373221975 >> 172.21.15.114:0/1373221975 conn(0x7f6b880a8490 msgr2=0x7f6b880a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:42.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1373221975 shutdown_connections 2024-02-17T12:17:42.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.333+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1373221975 wait complete. 2024-02-17T12:17:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8fe00640 1 Processor -- start 2024-02-17T12:17:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8fe00640 1 -- start start 2024-02-17T12:17:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70003b40 0x7f6b88145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b881461c0 0x7f6b881ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b881edbd0 0x7f6b88143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b88154a50 con 0x7f6b881edbd0 2024-02-17T12:17:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b88154ee0 con 0x7f6b70003b40 2024-02-17T12:17:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8814f370 con 0x7f6b881461c0 2024-02-17T12:17:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b881edbd0 0x7f6b88143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b881edbd0 0x7f6b88143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34758/0 (socket says 172.21.15.114:34758) 2024-02-17T12:17:42.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8de00640 1 -- 172.21.15.114:0/1140517900 learned_addr learned my addr 172.21.15.114:0/1140517900 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8d400640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70003b40 0x7f6b88145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8ca00640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b881461c0 0x7f6b881ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8de00640 1 -- 172.21.15.114:0/1140517900 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b881461c0 msgr2=0x7f6b881ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8de00640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b881461c0 0x7f6b881ed690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8de00640 1 -- 172.21.15.114:0/1140517900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70003b40 msgr2=0x7f6b88145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8de00640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70003b40 0x7f6b88145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8de00640 1 -- 172.21.15.114:0/1140517900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b881f19f0 con 0x7f6b881edbd0 2024-02-17T12:17:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8de00640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b881edbd0 0x7f6b88143730 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6b880a91e0 tx=0x7f6b8000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b85600640 1 -- 172.21.15.114:0/1140517900 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80017400 con 0x7f6b881edbd0 2024-02-17T12:17:42.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b85600640 1 -- 172.21.15.114:0/1140517900 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b80011040 con 0x7f6b881edbd0 2024-02-17T12:17:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1140517900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8814f630 con 0x7f6b881edbd0 2024-02-17T12:17:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b85600640 1 -- 172.21.15.114:0/1140517900 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80017780 con 0x7f6b881edbd0 2024-02-17T12:17:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.337+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1140517900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b88153ef0 con 0x7f6b881edbd0 2024-02-17T12:17:42.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.341+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1140517900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8814f820 con 0x7f6b881edbd0 2024-02-17T12:17:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.341+0000 7f6b85600640 1 -- 172.21.15.114:0/1140517900 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6b800203b0 con 0x7f6b881edbd0 2024-02-17T12:17:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.341+0000 7f6b85600640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 0x7f6b68069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.341+0000 7f6b85600640 1 -- 172.21.15.114:0/1140517900 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6b80085120 con 0x7f6b881edbd0 2024-02-17T12:17:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.341+0000 7f6b8d400640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 0x7f6b68069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.341+0000 7f6b8d400640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 0x7f6b68069330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0ab000 tx=0x7f6b7c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:42.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.345+0000 7f6b85600640 1 -- 172.21.15.114:0/1140517900 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6b80051ba0 con 0x7f6b881edbd0 2024-02-17T12:17:42.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.529+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1140517900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b88074840 con 0x7f6b881edbd0 2024-02-17T12:17:42.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.529+0000 7f6b85600640 1 -- 172.21.15.114:0/1140517900 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6192 (secure 0 0 0) 0x7f6b80055260 con 0x7f6b881edbd0 2024-02-17T12:17:42.539 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:42.539 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:05.397716+0000","modified":"2024-02-17T12:17:08.427075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4947":{"gid":4947,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/1473468479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":1473468479},{"type":"v1","addr":"172.21.15.114:6837","nonce":1473468479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:22.698504+0000","modified":"2024-02-17T12:17:25.708127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4941},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4941":{"gid":4941,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/2833741536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2833741536},{"type":"v1","addr":"172.21.15.114:6836","nonce":2833741536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-02-17T12:17:42.539 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 22 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1140517900 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 msgr2=0x7f6b68069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 0x7f6b68069330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0ab000 tx=0x7f6b7c0a7070 comp rx=0 tx=0).stop 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1140517900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b881edbd0 msgr2=0x7f6b88143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b881edbd0 0x7f6b88143730 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6b880a91e0 tx=0x7f6b8000f4a0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1140517900 shutdown_connections 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 0x7f6b68069330 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b881edbd0 0x7f6b88143730 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b881461c0 0x7f6b881ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 --2- 172.21.15.114:0/1140517900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70003b40 0x7f6b88145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1140517900 >> 172.21.15.114:0/1140517900 conn(0x7f6b880a8490 msgr2=0x7f6b880c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1140517900 shutdown_connections 2024-02-17T12:17:42.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.533+0000 7f6b8fe00640 1 -- 172.21.15.114:0/1140517900 wait complete. 2024-02-17T12:17:42.559 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:42.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b4400640 1 Processor -- start 2024-02-17T12:17:42.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b4400640 1 -- start start 2024-02-17T12:17:42.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b4400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac0c6460 0x7f42ac06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b4400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ac155dd0 con 0x7f42ac154e30 2024-02-17T12:17:42.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b4400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ac1588c0 con 0x7f42ac152540 2024-02-17T12:17:42.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b4400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac155810 con 0x7f42ac0c6460 2024-02-17T12:17:42.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b2400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f42ac154e30 0x7f42ac0aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49238/0 (socket says 172.21.15.114:49238) 2024-02-17T12:17:42.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b2400640 1 -- 172.21.15.114:0/2172196042 learned_addr learned my addr 172.21.15.114:0/2172196042 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:42.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b1000640 1 --2- 172.21.15.114:0/2172196042 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac0c6460 0x7f42ac06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42abe00640 1 -- 172.21.15.114:0/2172196042 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739492002 0 0) 0x7f42ac155dd0 con 0x7f42ac154e30 2024-02-17T12:17:42.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42abe00640 1 -- 172.21.15.114:0/2172196042 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4294003530 con 0x7f42ac154e30 2024-02-17T12:17:42.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42abe00640 1 -- 172.21.15.114:0/2172196042 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076363856 0 0) 0x7f42ac1588c0 con 0x7f42ac152540 2024-02-17T12:17:42.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42abe00640 1 -- 172.21.15.114:0/2172196042 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42ac155dd0 con 0x7f42ac152540 2024-02-17T12:17:42.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b1000640 1 -- 172.21.15.114:0/2172196042 >> v1:172.21.15.116:6789/0 conn(0x7f42ac152540 legacy=0x7f42ac158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42abe00640 1 -- 172.21.15.114:0/2172196042 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3552285621 0 0) 0x7f4294003530 con 0x7f42ac154e30 2024-02-17T12:17:42.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b1000640 1 -- 172.21.15.114:0/2172196042 >> v1:172.21.15.114:6789/0 conn(0x7f42ac154e30 legacy=0x7f42ac0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.729+0000 7f42b1000640 1 -- 172.21.15.114:0/2172196042 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac155af0 con 0x7f42ac0c6460 2024-02-17T12:17:42.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42b1000640 1 --2- 172.21.15.114:0/2172196042 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac0c6460 0x7f42ac06ff80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42980097f0 tx=0x7f429801c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e9033c86064289 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:42.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42abe00640 1 -- 172.21.15.114:0/2172196042 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4001680 con 0x7f42ac0c6460 2024-02-17T12:17:42.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42abe00640 1 -- 172.21.15.114:0/2172196042 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42980a7050 con 0x7f42ac0c6460 2024-02-17T12:17:42.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42abe00640 1 -- 172.21.15.114:0/2172196042 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42980ab400 con 0x7f42ac0c6460 2024-02-17T12:17:42.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42b4400640 1 -- 172.21.15.114:0/2172196042 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac0c6460 msgr2=0x7f42ac06ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42b4400640 1 --2- 172.21.15.114:0/2172196042 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac0c6460 0x7f42ac06ff80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42980097f0 tx=0x7f429801c2e0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42b4400640 1 -- 172.21.15.114:0/2172196042 shutdown_connections 2024-02-17T12:17:42.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42b4400640 1 --2- 172.21.15.114:0/2172196042 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac0c6460 0x7f42ac06ff80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42b4400640 1 -- 172.21.15.114:0/2172196042 >> 172.21.15.114:0/2172196042 conn(0x7f42ac0c4f20 msgr2=0x7f42ac0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:42.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42b4400640 1 -- 172.21.15.114:0/2172196042 shutdown_connections 2024-02-17T12:17:42.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.733+0000 7f42b4400640 1 -- 172.21.15.114:0/2172196042 wait complete. 2024-02-17T12:17:42.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b4400640 1 Processor -- start 2024-02-17T12:17:42.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b4400640 1 -- start start 2024-02-17T12:17:42.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b4400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42ac0c6460 0x7f42ac1f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b4400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac152540 0x7f42ac143b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b4400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac154e30 0x7f42ac156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b4400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac1edf00 con 0x7f42ac0c6460 2024-02-17T12:17:42.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b4400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac152e80 con 0x7f42ac152540 2024-02-17T12:17:42.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b4400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac1ee0f0 con 0x7f42ac154e30 2024-02-17T12:17:42.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42ac0c6460 0x7f42ac1f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42ac0c6460 0x7f42ac1f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34762/0 (socket says 172.21.15.114:34762) 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b1a00640 1 -- 172.21.15.114:0/3977367564 learned_addr learned my addr 172.21.15.114:0/3977367564 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b1000640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac152540 0x7f42ac143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b2400640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac154e30 0x7f42ac156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b1a00640 1 -- 172.21.15.114:0/3977367564 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac154e30 msgr2=0x7f42ac156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b1a00640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac154e30 0x7f42ac156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b1a00640 1 -- 172.21.15.114:0/3977367564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac152540 msgr2=0x7f42ac143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b1a00640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac152540 0x7f42ac143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b1a00640 1 -- 172.21.15.114:0/3977367564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4298009420 con 0x7f42ac0c6460 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b1a00640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42ac0c6460 0x7f42ac1f15c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c870 tx=0x7f42a000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42a9600640 1 -- 172.21.15.114:0/3977367564 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0003b80 con 0x7f42ac0c6460 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42a9600640 1 -- 172.21.15.114:0/3977367564 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a0003ce0 con 0x7f42ac0c6460 2024-02-17T12:17:42.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b4400640 1 -- 172.21.15.114:0/3977367564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ac1f0ae0 con 0x7f42ac0c6460 2024-02-17T12:17:42.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42a9600640 1 -- 172.21.15.114:0/3977367564 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a000aa30 con 0x7f42ac0c6460 2024-02-17T12:17:42.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.737+0000 7f42b4400640 1 -- 172.21.15.114:0/3977367564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ac1f10a0 con 0x7f42ac0c6460 2024-02-17T12:17:42.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.741+0000 7f42b4400640 1 -- 172.21.15.114:0/3977367564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ac0c4d90 con 0x7f42ac0c6460 2024-02-17T12:17:42.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.741+0000 7f42a9600640 1 -- 172.21.15.114:0/3977367564 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f42a000ab90 con 0x7f42ac0c6460 2024-02-17T12:17:42.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.741+0000 7f42a9600640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f428c066e40 0x7f428c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:42.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.741+0000 7f42a9600640 1 -- 172.21.15.114:0/3977367564 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f42a0084c40 con 0x7f42ac0c6460 2024-02-17T12:17:42.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.741+0000 7f42b1000640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f428c066e40 0x7f428c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:42.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.741+0000 7f42b1000640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f428c066e40 0x7f428c069300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f42980ad000 tx=0x7f4298008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:42.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.745+0000 7f42a9600640 1 -- 172.21.15.114:0/3977367564 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f42a00516e0 con 0x7f42ac0c6460 2024-02-17T12:17:42.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.901+0000 7f42b4400640 1 -- 172.21.15.114:0/3977367564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42ac14d8f0 con 0x7f42ac0c6460 2024-02-17T12:17:42.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.901+0000 7f42a9600640 1 -- 172.21.15.114:0/3977367564 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+20407 (secure 0 0 0) 0x7f42a0054da0 con 0x7f42ac0c6460 2024-02-17T12:17:42.909 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:42.910 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:24.325322+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:03.897758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-17T12:17:04.389290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:42.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 -- 172.21.15.114:0/3977367564 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f428c066e40 msgr2=0x7f428c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f428c066e40 0x7f428c069300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f42980ad000 tx=0x7f4298008040 comp rx=0 tx=0).stop 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 -- 172.21.15.114:0/3977367564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42ac0c6460 msgr2=0x7f42ac1f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42ac0c6460 0x7f42ac1f15c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c870 tx=0x7f42a000cd30 comp rx=0 tx=0).stop 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 -- 172.21.15.114:0/3977367564 shutdown_connections 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f42ac154e30 0x7f42ac156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42ac152540 0x7f42ac143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f428c066e40 0x7f428c069300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 --2- 172.21.15.114:0/3977367564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42ac0c6460 0x7f42ac1f15c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 -- 172.21.15.114:0/3977367564 >> 172.21.15.114:0/3977367564 conn(0x7f42ac0c4f20 msgr2=0x7f42ac1544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 -- 172.21.15.114:0/3977367564 shutdown_connections 2024-02-17T12:17:42.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:42.905+0000 7f42b4400640 1 -- 172.21.15.114:0/3977367564 wait complete. 2024-02-17T12:17:42.931 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-17T12:17:43.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a0a800640 1 Processor -- start 2024-02-17T12:17:43.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a0a800640 1 -- start start 2024-02-17T12:17:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a0a800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1a0414f110 0x7f1a040c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a0a800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a040a9420 con 0x7f1a040c2580 2024-02-17T12:17:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a0a800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a04152850 con 0x7f1a040c1eb0 2024-02-17T12:17:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a0a800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0414f4f0 con 0x7f1a0414f110 2024-02-17T12:17:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1a040c2580 0x7f1a040aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49240/0 (socket says 172.21.15.114:49240) 2024-02-17T12:17:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02a00640 1 -- 172.21.15.114:0/788377145 learned_addr learned my addr 172.21.15.114:0/788377145 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a03400640 1 --2- 172.21.15.114:0/788377145 >> v2:172.21.15.116:3300/0 conn(0x7f1a0414f110 0x7f1a040c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974781845 0 0) 0x7f1a040a9420 con 0x7f1a040c2580 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19e8003530 con 0x7f1a040c2580 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 226529304 0 0) 0x7f19e8003530 con 0x7f1a040c2580 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 >> v2:172.21.15.116:3300/0 conn(0x7f1a0414f110 msgr2=0x7f1a040c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 --2- 172.21.15.114:0/788377145 >> v2:172.21.15.116:3300/0 conn(0x7f1a0414f110 0x7f1a040c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 >> v1:172.21.15.116:6789/0 conn(0x7f1a040c1eb0 legacy=0x7f1a0415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a040a9670 con 0x7f1a040c2580 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f19f0001680 con 0x7f1a040c2580 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 >> v1:172.21.15.114:6789/0 conn(0x7f1a040c2580 legacy=0x7f1a040aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19e8003980 0x7f19e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f19e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19e8005190 0x7f19e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0414f4f0 con 0x7f19e80047d0 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e800c130 con 0x7f19e8005190 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e800c2f0 con 0x7f19e8003980 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02a00640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f19e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a03400640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19e8003980 0x7f19e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a03e00640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19e8005190 0x7f19e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02a00640 1 -- 172.21.15.114:0/788377145 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19e8003980 msgr2=0x7f19e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02a00640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f19e8003980 0x7f19e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02a00640 1 -- 172.21.15.114:0/788377145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19e8005190 msgr2=0x7f19e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02a00640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19e8005190 0x7f19e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a02a00640 1 -- 172.21.15.114:0/788377145 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8003530 con 0x7f19e80047d0 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.061+0000 7f1a03e00640 1 -- 172.21.15.114:0/788377145 reap_dead start 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a02a00640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f19e8004c50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f19f000c190 tx=0x7f19f001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a53cd3f1e413fed server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00058e0 con 0x7f19e80047d0 2024-02-17T12:17:43.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f0005a40 con 0x7f19e80047d0 2024-02-17T12:17:43.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a02000640 1 -- 172.21.15.114:0/788377145 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0005e70 con 0x7f19e80047d0 2024-02-17T12:17:43.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a0a800640 1 -- 172.21.15.114:0/788377145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 msgr2=0x7f19e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a0a800640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f19e8004c50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f19f000c190 tx=0x7f19f001cc20 comp rx=0 tx=0).stop 2024-02-17T12:17:43.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a0a800640 1 -- 172.21.15.114:0/788377145 shutdown_connections 2024-02-17T12:17:43.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a0a800640 1 --2- 172.21.15.114:0/788377145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f19e8004c50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a0a800640 1 -- 172.21.15.114:0/788377145 >> 172.21.15.114:0/788377145 conn(0x7f1a040a8490 msgr2=0x7f1a040a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:43.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a0a800640 1 -- 172.21.15.114:0/788377145 shutdown_connections 2024-02-17T12:17:43.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.065+0000 7f1a0a800640 1 -- 172.21.15.114:0/788377145 wait complete. 2024-02-17T12:17:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 Processor -- start 2024-02-17T12:17:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 -- start start 2024-02-17T12:17:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f1a041ede80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a040c4b80 0x7f1a041ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a04141b60 0x7f1a04141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a04147c30 con 0x7f19e80047d0 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041ed9f0 con 0x7f1a04141b60 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040c5170 con 0x7f1a040c4b80 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a03400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f1a041ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a03400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f1a041ede80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34778/0 (socket says 172.21.15.114:34778) 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a03400640 1 -- 172.21.15.114:0/2464698745 learned_addr learned my addr 172.21.15.114:0/2464698745 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a03e00640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a04141b60 0x7f1a04141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a02a00640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a040c4b80 0x7f1a041ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a03400640 1 -- 172.21.15.114:0/2464698745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a040c4b80 msgr2=0x7f1a041ee3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a03400640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a040c4b80 0x7f1a041ee3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a03400640 1 -- 172.21.15.114:0/2464698745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a04141b60 msgr2=0x7f1a04141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a03400640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a04141b60 0x7f1a04141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a03400640 1 -- 172.21.15.114:0/2464698745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a040c5ce0 con 0x7f19e80047d0 2024-02-17T12:17:43.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a03400640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f1a041ede80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f19f4011aa0 tx=0x7f19f4011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:43.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f19fb400640 1 -- 172.21.15.114:0/2464698745 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400fb80 con 0x7f19e80047d0 2024-02-17T12:17:43.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f19fb400640 1 -- 172.21.15.114:0/2464698745 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f400fce0 con 0x7f19e80047d0 2024-02-17T12:17:43.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 -- 172.21.15.114:0/2464698745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a040c5fc0 con 0x7f19e80047d0 2024-02-17T12:17:43.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f19fb400640 1 -- 172.21.15.114:0/2464698745 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4014680 con 0x7f19e80047d0 2024-02-17T12:17:43.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 -- 172.21.15.114:0/2464698745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a041493c0 con 0x7f19e80047d0 2024-02-17T12:17:43.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.069+0000 7f1a0a800640 1 -- 172.21.15.114:0/2464698745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a040c5b40 con 0x7f19e80047d0 2024-02-17T12:17:43.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.073+0000 7f19fb400640 1 -- 172.21.15.114:0/2464698745 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f19f401d400 con 0x7f19e80047d0 2024-02-17T12:17:43.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.073+0000 7f19fb400640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f19e4066e40 0x7f19e4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.073+0000 7f19fb400640 1 -- 172.21.15.114:0/2464698745 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f19f40855b0 con 0x7f19e80047d0 2024-02-17T12:17:43.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.073+0000 7f1a02a00640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f19e4066e40 0x7f19e4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.073+0000 7f1a02a00640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f19e4066e40 0x7f19e4069300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f19f00ab000 tx=0x7f19f00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:43.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.077+0000 7f19fb400640 1 -- 172.21.15.114:0/2464698745 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1a040c5b40 con 0x7f19e80047d0 2024-02-17T12:17:43.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.265+0000 7f1a0a800640 1 -- 172.21.15.114:0/2464698745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1a040c5b40 con 0x7f19e80047d0 2024-02-17T12:17:43.273 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-02-17T12:17:43.265+0000 7f5091a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-17T12:17:43.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f19fb400640 1 -- 172.21.15.114:0/2464698745 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1a040c5b40 con 0x7f19e80047d0 2024-02-17T12:17:43.275 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-17T12:17:43.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 -- 172.21.15.114:0/2464698745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f19e4066e40 msgr2=0x7f19e4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f19e4066e40 0x7f19e4069300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f19f00ab000 tx=0x7f19f00a7070 comp rx=0 tx=0).stop 2024-02-17T12:17:43.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 -- 172.21.15.114:0/2464698745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 msgr2=0x7f1a041ede80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f1a041ede80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f19f4011aa0 tx=0x7f19f4011f60 comp rx=0 tx=0).stop 2024-02-17T12:17:43.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 -- 172.21.15.114:0/2464698745 shutdown_connections 2024-02-17T12:17:43.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a04141b60 0x7f1a04141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a040c4b80 0x7f1a041ee3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f19e4066e40 0x7f19e4069300 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 --2- 172.21.15.114:0/2464698745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19e80047d0 0x7f1a041ede80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 -- 172.21.15.114:0/2464698745 >> 172.21.15.114:0/2464698745 conn(0x7f1a040a8490 msgr2=0x7f1a0406ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:43.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 -- 172.21.15.114:0/2464698745 shutdown_connections 2024-02-17T12:17:43.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.269+0000 7f1a0a800640 1 -- 172.21.15.114:0/2464698745 wait complete. 2024-02-17T12:17:43.285 INFO:tasks.ceph.mds.c.smithi114.stderr: -2902> 2024-02-17T12:17:10.826+0000 7fba33400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:17:43.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-17T12:17:43.332 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-02-17T12:17:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe107200640 1 Processor -- start 2024-02-17T12:17:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe107200640 1 -- start start 2024-02-17T12:17:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe107200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe1000c25a0 0x7fe10006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe107200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe100152c50 0x7fe100153070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe107200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe100156270 con 0x7fe10006db50 2024-02-17T12:17:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe107200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe100071630 con 0x7fe100152c50 2024-02-17T12:17:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe107200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe100156550 con 0x7fe1000c25a0 2024-02-17T12:17:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe105200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe100152c50 0x7fe100153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe0ff400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe10006db50 0x7fe10014ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49250/0 (socket says 172.21.15.114:49250) 2024-02-17T12:17:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe0ff400640 1 -- 172.21.15.114:0/1946086209 learned_addr learned my addr 172.21.15.114:0/1946086209 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.429+0000 7fe0ffe00640 1 --2- 172.21.15.114:0/1946086209 >> v2:172.21.15.116:3300/0 conn(0x7fe1000c25a0 0x7fe10006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe105200640 1 -- 172.21.15.114:0/1946086209 >> v2:172.21.15.116:3300/0 conn(0x7fe1000c25a0 msgr2=0x7fe10006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe105200640 1 --2- 172.21.15.114:0/1946086209 >> v2:172.21.15.116:3300/0 conn(0x7fe1000c25a0 0x7fe10006e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe105200640 1 -- 172.21.15.114:0/1946086209 >> v1:172.21.15.114:6789/0 conn(0x7fe10006db50 legacy=0x7fe10014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe0fea00640 1 -- 172.21.15.114:0/1946086209 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680527996 0 0) 0x7fe100156270 con 0x7fe10006db50 2024-02-17T12:17:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe105200640 1 -- 172.21.15.114:0/1946086209 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100156830 con 0x7fe100152c50 2024-02-17T12:17:43.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe105200640 1 --2- 172.21.15.114:0/1946086209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe100152c50 0x7fe100153070 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe1000ab930 tx=0x7fe0f801c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1261ca20dab3a50c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe0fea00640 1 -- 172.21.15.114:0/1946086209 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80a57b0 con 0x7fe100152c50 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe0fea00640 1 -- 172.21.15.114:0/1946086209 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f80a5910 con 0x7fe100152c50 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe0fea00640 1 -- 172.21.15.114:0/1946086209 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80a5ca0 con 0x7fe100152c50 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe107200640 1 -- 172.21.15.114:0/1946086209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe100152c50 msgr2=0x7fe100153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe107200640 1 --2- 172.21.15.114:0/1946086209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe100152c50 0x7fe100153070 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe1000ab930 tx=0x7fe0f801c7e0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe107200640 1 -- 172.21.15.114:0/1946086209 shutdown_connections 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe107200640 1 --2- 172.21.15.114:0/1946086209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe100152c50 0x7fe100153070 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe107200640 1 --2- 172.21.15.114:0/1946086209 >> v2:172.21.15.116:3300/0 conn(0x7fe1000c25a0 0x7fe10006e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe107200640 1 -- 172.21.15.114:0/1946086209 >> 172.21.15.114:0/1946086209 conn(0x7fe1000a8490 msgr2=0x7fe1000a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.433+0000 7fe107200640 1 -- 172.21.15.114:0/1946086209 shutdown_connections 2024-02-17T12:17:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 -- 172.21.15.114:0/1946086209 wait complete. 2024-02-17T12:17:43.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 Processor -- start 2024-02-17T12:17:43.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 -- start start 2024-02-17T12:17:43.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10006db50 0x7fe1000c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1000c25a0 0x7fe1000aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe100152c50 0x7fe10013ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10013faa0 con 0x7fe10006db50 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10013f470 con 0x7fe100152c50 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10013eb90 con 0x7fe1000c25a0 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10006db50 0x7fe1000c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10006db50 0x7fe1000c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34810/0 (socket says 172.21.15.114:34810) 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ffe00640 1 -- 172.21.15.114:0/3038050601 learned_addr learned my addr 172.21.15.114:0/3038050601 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe105200640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe100152c50 0x7fe10013ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ff400640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1000c25a0 0x7fe1000aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ffe00640 1 -- 172.21.15.114:0/3038050601 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1000c25a0 msgr2=0x7fe1000aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ffe00640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1000c25a0 0x7fe1000aab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ffe00640 1 -- 172.21.15.114:0/3038050601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe100152c50 msgr2=0x7fe10013ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ffe00640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe100152c50 0x7fe10013ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ffe00640 1 -- 172.21.15.114:0/3038050601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f8009a70 con 0x7fe10006db50 2024-02-17T12:17:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe105200640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe100152c50 0x7fe10013ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ff400640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1000c25a0 0x7fe1000aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0ffe00640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10006db50 0x7fe1000c3fd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e930 tx=0x7fe0f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0f7e00640 1 -- 172.21.15.114:0/3038050601 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0009690 con 0x7fe10006db50 2024-02-17T12:17:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0f7e00640 1 -- 172.21.15.114:0/3038050601 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f000ca00 con 0x7fe10006db50 2024-02-17T12:17:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 -- 172.21.15.114:0/3038050601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10013ee70 con 0x7fe10006db50 2024-02-17T12:17:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe0f7e00640 1 -- 172.21.15.114:0/3038050601 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000cd70 con 0x7fe10006db50 2024-02-17T12:17:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.437+0000 7fe107200640 1 -- 172.21.15.114:0/3038050601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10013f730 con 0x7fe10006db50 2024-02-17T12:17:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.441+0000 7fe107200640 1 -- 172.21.15.114:0/3038050601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe100074840 con 0x7fe10006db50 2024-02-17T12:17:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.441+0000 7fe0f7e00640 1 -- 172.21.15.114:0/3038050601 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe0f0013470 con 0x7fe10006db50 2024-02-17T12:17:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.441+0000 7fe0f7e00640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe0e0066e40 0x7fe0e0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.441+0000 7fe0f7e00640 1 -- 172.21.15.114:0/3038050601 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fe0f0085160 con 0x7fe10006db50 2024-02-17T12:17:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.441+0000 7fe0ff400640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe0e0066e40 0x7fe0e0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.441+0000 7fe0ff400640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe0e0066e40 0x7fe0e0069300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe1000c4510 tx=0x7fe0ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:43.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.445+0000 7fe0f7e00640 1 -- 172.21.15.114:0/3038050601 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe0f0051bc0 con 0x7fe10006db50 2024-02-17T12:17:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:43.629+0000 7fe107200640 1 -- 172.21.15.114:0/3038050601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe100144b10 con 0x7fe10006db50 2024-02-17T12:17:44.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.269+0000 7fe0f7e00640 1 -- 172.21.15.114:0/3038050601 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe0f0055280 con 0x7fe10006db50 2024-02-17T12:17:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 -- 172.21.15.114:0/3038050601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe0e0066e40 msgr2=0x7fe0e0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe0e0066e40 0x7fe0e0069300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe1000c4510 tx=0x7fe0ec009040 comp rx=0 tx=0).stop 2024-02-17T12:17:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 -- 172.21.15.114:0/3038050601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10006db50 msgr2=0x7fe1000c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10006db50 0x7fe1000c3fd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e930 tx=0x7fe0f000edf0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 -- 172.21.15.114:0/3038050601 shutdown_connections 2024-02-17T12:17:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe100152c50 0x7fe10013ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1000c25a0 0x7fe1000aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe0e0066e40 0x7fe0e0069300 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 --2- 172.21.15.114:0/3038050601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10006db50 0x7fe1000c3fd0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 -- 172.21.15.114:0/3038050601 >> 172.21.15.114:0/3038050601 conn(0x7fe1000a8490 msgr2=0x7fe1000c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:44.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 -- 172.21.15.114:0/3038050601 shutdown_connections 2024-02-17T12:17:44.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.273+0000 7fe107200640 1 -- 172.21.15.114:0/3038050601 wait complete. 2024-02-17T12:17:44.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-17T12:17:44.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.477+0000 7fc301400640 1 Processor -- start 2024-02-17T12:17:44.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.477+0000 7fc301400640 1 -- start start 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.477+0000 7fc301400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0c38e0 0x7fc2fc06e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc301400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc2fc0a6590 0x7fc2fc0a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc301400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc153640 con 0x7fc2fc0a7020 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc301400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc0c3cc0 con 0x7fc2fc0a6590 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc301400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc1506a0 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2fb200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc2fc0a7020 0x7fc2fc1543a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49252/0 (socket says 172.21.15.114:49252) 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2fb200640 1 -- 172.21.15.114:0/1008256757 learned_addr learned my addr 172.21.15.114:0/1008256757 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2fa800640 1 --2- 172.21.15.114:0/1008256757 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0c38e0 0x7fc2fc06e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2f9e00640 1 --2- 172.21.15.114:0/1008256757 >> v2:172.21.15.116:3300/0 conn(0x7fc2fc0a6590 0x7fc2fc0a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2f9400640 1 -- 172.21.15.114:0/1008256757 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399755434 0 0) 0x7fc2fc153640 con 0x7fc2fc0a7020 2024-02-17T12:17:44.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2f9400640 1 -- 172.21.15.114:0/1008256757 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e0003530 con 0x7fc2fc0a7020 2024-02-17T12:17:44.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2fa800640 1 -- 172.21.15.114:0/1008256757 >> v2:172.21.15.116:3300/0 conn(0x7fc2fc0a6590 msgr2=0x7fc2fc0a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:44.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2fa800640 1 --2- 172.21.15.114:0/1008256757 >> v2:172.21.15.116:3300/0 conn(0x7fc2fc0a6590 0x7fc2fc0a6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2fa800640 1 -- 172.21.15.114:0/1008256757 >> v1:172.21.15.114:6789/0 conn(0x7fc2fc0a7020 legacy=0x7fc2fc1543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:44.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2f9400640 1 -- 172.21.15.114:0/1008256757 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 241793072 0 0) 0x7fc2e0003530 con 0x7fc2fc0a7020 2024-02-17T12:17:44.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2fa800640 1 -- 172.21.15.114:0/1008256757 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc153b70 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.481+0000 7fc2fa800640 1 --2- 172.21.15.114:0/1008256757 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0c38e0 0x7fc2fc06e860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0097c0 tx=0x7fc2ec01c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abf1471bab245e02 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:44.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2f9400640 1 -- 172.21.15.114:0/1008256757 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4001a00 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2f9400640 1 -- 172.21.15.114:0/1008256757 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec0a7050 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2f9400640 1 -- 172.21.15.114:0/1008256757 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0ab620 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 -- 172.21.15.114:0/1008256757 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0c38e0 msgr2=0x7fc2fc06e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:44.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 --2- 172.21.15.114:0/1008256757 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0c38e0 0x7fc2fc06e860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0097c0 tx=0x7fc2ec01c2a0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 -- 172.21.15.114:0/1008256757 shutdown_connections 2024-02-17T12:17:44.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 --2- 172.21.15.114:0/1008256757 >> v2:172.21.15.116:3300/0 conn(0x7fc2fc0a6590 0x7fc2fc0a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 --2- 172.21.15.114:0/1008256757 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0c38e0 0x7fc2fc06e860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 -- 172.21.15.114:0/1008256757 >> 172.21.15.114:0/1008256757 conn(0x7fc2fc06b210 msgr2=0x7fc2fc06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:44.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 -- 172.21.15.114:0/1008256757 shutdown_connections 2024-02-17T12:17:44.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 -- 172.21.15.114:0/1008256757 wait complete. 2024-02-17T12:17:44.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 Processor -- start 2024-02-17T12:17:44.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 -- start start 2024-02-17T12:17:44.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2fc0a6590 0x7fc2fc151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:44.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0a7020 0x7fc2fc14c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:44.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2fc0c38e0 0x7fc2fc14cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc0c5060 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc14d1e0 con 0x7fc2fc0a6590 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc301400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc0c52d0 con 0x7fc2fc0a7020 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2fb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2fc0c38e0 0x7fc2fc14cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2fb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2fc0c38e0 0x7fc2fc14cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34812/0 (socket says 172.21.15.114:34812) 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2fb200640 1 -- 172.21.15.114:0/2469240730 learned_addr learned my addr 172.21.15.114:0/2469240730 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2fa800640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2fc0a6590 0x7fc2fc151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2f9e00640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0a7020 0x7fc2fc14c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2fb200640 1 -- 172.21.15.114:0/2469240730 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0a7020 msgr2=0x7fc2fc14c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2fb200640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0a7020 0x7fc2fc14c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2fb200640 1 -- 172.21.15.114:0/2469240730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2fc0a6590 msgr2=0x7fc2fc151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2fb200640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2fc0a6590 0x7fc2fc151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.485+0000 7fc2fb200640 1 -- 172.21.15.114:0/2469240730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec009420 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc2fb200640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2fc0c38e0 0x7fc2fc14cca0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4001870 tx=0x7fc2f400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:44.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc2f2a00640 1 -- 172.21.15.114:0/2469240730 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4012400 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc2f2a00640 1 -- 172.21.15.114:0/2469240730 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4012560 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc301400640 1 -- 172.21.15.114:0/2469240730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2fc0c49e0 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc2f2a00640 1 -- 172.21.15.114:0/2469240730 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4012910 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc301400640 1 -- 172.21.15.114:0/2469240730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2fc0c4550 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc301400640 1 -- 172.21.15.114:0/2469240730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2fc0c0ac0 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc2f2a00640 1 -- 172.21.15.114:0/2469240730 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fc2f4012a70 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc2f2a00640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc2dc066e70 0x7fc2dc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:44.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc2f2a00640 1 -- 172.21.15.114:0/2469240730 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fc2f40853e0 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.489+0000 7fc2fa800640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc2dc066e70 0x7fc2dc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:44.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.493+0000 7fc2fa800640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc2dc066e70 0x7fc2dc069330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0097c0 tx=0x7fc2ec0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:44.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.493+0000 7fc2f2a00640 1 -- 172.21.15.114:0/2469240730 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc2f4051ec0 con 0x7fc2fc0c38e0 2024-02-17T12:17:44.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:44.649+0000 7fc301400640 1 -- 172.21.15.114:0/2469240730 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc2fc074840 con 0x7fc2fc0c38e0 2024-02-17T12:17:45.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.273+0000 7fc2f2a00640 1 -- 172.21.15.114:0/2469240730 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc2f4055580 con 0x7fc2fc0c38e0 2024-02-17T12:17:45.280 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-02-17T12:17:45.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.273+0000 7fc301400640 1 -- 172.21.15.114:0/2469240730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc2dc066e70 msgr2=0x7fc2dc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:45.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.273+0000 7fc301400640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc2dc066e70 0x7fc2dc069330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0097c0 tx=0x7fc2ec0a6000 comp rx=0 tx=0).stop 2024-02-17T12:17:45.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.273+0000 7fc301400640 1 -- 172.21.15.114:0/2469240730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2fc0c38e0 msgr2=0x7fc2fc14cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:45.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.273+0000 7fc301400640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2fc0c38e0 0x7fc2fc14cca0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4001870 tx=0x7fc2f400a430 comp rx=0 tx=0).stop 2024-02-17T12:17:45.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.277+0000 7fc301400640 1 -- 172.21.15.114:0/2469240730 shutdown_connections 2024-02-17T12:17:45.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.277+0000 7fc301400640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc2dc066e70 0x7fc2dc069330 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:45.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.277+0000 7fc301400640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2fc0c38e0 0x7fc2fc14cca0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:45.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.277+0000 7fc301400640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc2fc0a7020 0x7fc2fc14c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:45.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.277+0000 7fc301400640 1 --2- 172.21.15.114:0/2469240730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2fc0a6590 0x7fc2fc151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:45.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.277+0000 7fc301400640 1 -- 172.21.15.114:0/2469240730 >> 172.21.15.114:0/2469240730 conn(0x7fc2fc06b210 msgr2=0x7fc2fc14fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:45.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.277+0000 7fc301400640 1 -- 172.21.15.114:0/2469240730 shutdown_connections 2024-02-17T12:17:45.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.277+0000 7fc301400640 1 -- 172.21.15.114:0/2469240730 wait complete. 2024-02-17T12:17:45.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-17T12:17:45.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f3695400640 1 Processor -- start 2024-02-17T12:17:45.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f3695400640 1 -- start start 2024-02-17T12:17:45.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f3695400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3690150090 0x7f3690156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:45.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f3695400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f369006fcf0 0x7f36900a9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:45.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f3695400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369006f8f0 con 0x7f36900a99d0 2024-02-17T12:17:45.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f3695400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900c1ef0 con 0x7f369006fcf0 2024-02-17T12:17:45.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f3695400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900c26c0 con 0x7f3690150090 2024-02-17T12:17:45.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f368de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f369006fcf0 0x7f36900a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:45.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f368de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f369006fcf0 0x7f36900a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37130/0 (socket says 172.21.15.114:37130) 2024-02-17T12:17:45.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f368de00640 1 -- 172.21.15.114:0/32928317 learned_addr learned my addr 172.21.15.114:0/32928317 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:45.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f368e800640 1 --2- 172.21.15.114:0/32928317 >> v2:172.21.15.116:3300/0 conn(0x7f3690150090 0x7f3690156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:45.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f368de00640 1 -- 172.21.15.114:0/32928317 >> v2:172.21.15.116:3300/0 conn(0x7f3690150090 msgr2=0x7f3690156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:45.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f368de00640 1 --2- 172.21.15.114:0/32928317 >> v2:172.21.15.116:3300/0 conn(0x7f3690150090 0x7f3690156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:45.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f368de00640 1 -- 172.21.15.114:0/32928317 >> v1:172.21.15.116:6789/0 conn(0x7f36900a99d0 legacy=0x7f3690152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:45.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.441+0000 7f368de00640 1 -- 172.21.15.114:0/32928317 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900c2100 con 0x7f369006fcf0 2024-02-17T12:17:45.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f368de00640 1 --2- 172.21.15.114:0/32928317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369006fcf0 0x7f36900a9490 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f36900717e0 tx=0x7f367801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb65b8afb8ed46e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:45.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f368d400640 1 -- 172.21.15.114:0/32928317 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780ab600 con 0x7f369006fcf0 2024-02-17T12:17:45.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f368d400640 1 -- 172.21.15.114:0/32928317 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36780a7050 con 0x7f369006fcf0 2024-02-17T12:17:45.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f368d400640 1 -- 172.21.15.114:0/32928317 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780ab980 con 0x7f369006fcf0 2024-02-17T12:17:45.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f3695400640 1 -- 172.21.15.114:0/32928317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369006fcf0 msgr2=0x7f36900a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:45.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f3695400640 1 --2- 172.21.15.114:0/32928317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369006fcf0 0x7f36900a9490 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f36900717e0 tx=0x7f367801c430 comp rx=0 tx=0).stop 2024-02-17T12:17:45.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f3695400640 1 -- 172.21.15.114:0/32928317 shutdown_connections 2024-02-17T12:17:45.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f3695400640 1 --2- 172.21.15.114:0/32928317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f369006fcf0 0x7f36900a9490 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:45.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f3695400640 1 --2- 172.21.15.114:0/32928317 >> v2:172.21.15.116:3300/0 conn(0x7f3690150090 0x7f3690156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:45.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f3695400640 1 -- 172.21.15.114:0/32928317 >> 172.21.15.114:0/32928317 conn(0x7f36900c74f0 msgr2=0x7f36900c7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:45.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f3695400640 1 -- 172.21.15.114:0/32928317 shutdown_connections 2024-02-17T12:17:45.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.445+0000 7f3695400640 1 -- 172.21.15.114:0/32928317 wait complete. 2024-02-17T12:17:45.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 Processor -- start 2024-02-17T12:17:45.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 -- start start 2024-02-17T12:17:45.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f369006fcf0 0x7f3690153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:45.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f36900a99d0 0x7f36901f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:45.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3690150090 0x7f3690072820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:45.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369015bd00 con 0x7f3690150090 2024-02-17T12:17:45.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369015c4d0 con 0x7f369006fcf0 2024-02-17T12:17:45.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369015bf10 con 0x7f36900a99d0 2024-02-17T12:17:45.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3690150090 0x7f3690072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3690150090 0x7f3690072820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37134/0 (socket says 172.21.15.114:37134) 2024-02-17T12:17:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368f200640 1 -- 172.21.15.114:0/3813237947 learned_addr learned my addr 172.21.15.114:0/3813237947 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368e800640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f369006fcf0 0x7f3690153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368de00640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f36900a99d0 0x7f36901f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368f200640 1 -- 172.21.15.114:0/3813237947 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f36900a99d0 msgr2=0x7f36901f1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368f200640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f36900a99d0 0x7f36901f1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368f200640 1 -- 172.21.15.114:0/3813237947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f369006fcf0 msgr2=0x7f3690153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368f200640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f369006fcf0 0x7f3690153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368f200640 1 -- 172.21.15.114:0/3813237947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780094d0 con 0x7f3690150090 2024-02-17T12:17:45.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f368f200640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3690150090 0x7f3690072820 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f368800b440 tx=0x7f368800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:45.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3686a00640 1 -- 172.21.15.114:0/3813237947 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688011830 con 0x7f3690150090 2024-02-17T12:17:45.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3686a00640 1 -- 172.21.15.114:0/3813237947 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36880119b0 con 0x7f3690150090 2024-02-17T12:17:45.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3686a00640 1 -- 172.21.15.114:0/3813237947 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688011d60 con 0x7f3690150090 2024-02-17T12:17:45.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 -- 172.21.15.114:0/3813237947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369015c1f0 con 0x7f3690150090 2024-02-17T12:17:45.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 -- 172.21.15.114:0/3813237947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36900a6e30 con 0x7f3690150090 2024-02-17T12:17:45.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.449+0000 7f3695400640 1 -- 172.21.15.114:0/3813237947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3690155b20 con 0x7f3690150090 2024-02-17T12:17:45.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.453+0000 7f3686a00640 1 -- 172.21.15.114:0/3813237947 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f368801a400 con 0x7f3690150090 2024-02-17T12:17:45.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.453+0000 7f3686a00640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f366c066e70 0x7f366c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:45.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.453+0000 7f3686a00640 1 -- 172.21.15.114:0/3813237947 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f3688084bc0 con 0x7f3690150090 2024-02-17T12:17:45.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.453+0000 7f368e800640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f366c066e70 0x7f366c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:45.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.453+0000 7f368e800640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f366c066e70 0x7f366c069330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3680003b90 tx=0x7f36800098d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:45.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.457+0000 7f3686a00640 1 -- 172.21.15.114:0/3813237947 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3690155b20 con 0x7f3690150090 2024-02-17T12:17:45.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:45.613+0000 7f3695400640 1 -- 172.21.15.114:0/3813237947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3690155b20 con 0x7f3690150090 2024-02-17T12:17:46.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.273+0000 7f3686a00640 1 -- 172.21.15.114:0/3813237947 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3690155b20 con 0x7f3690150090 2024-02-17T12:17:46.282 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-02-17T12:17:46.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 -- 172.21.15.114:0/3813237947 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f366c066e70 msgr2=0x7f366c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f366c066e70 0x7f366c069330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3680003b90 tx=0x7f36800098d0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 -- 172.21.15.114:0/3813237947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3690150090 msgr2=0x7f3690072820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3690150090 0x7f3690072820 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f368800b440 tx=0x7f368800b900 comp rx=0 tx=0).stop 2024-02-17T12:17:46.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 -- 172.21.15.114:0/3813237947 shutdown_connections 2024-02-17T12:17:46.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f366c066e70 0x7f366c069330 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3680003b90 tx=0x7f36800098d0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3690150090 0x7f3690072820 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f36900a99d0 0x7f36901f1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 --2- 172.21.15.114:0/3813237947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f369006fcf0 0x7f3690153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 -- 172.21.15.114:0/3813237947 >> 172.21.15.114:0/3813237947 conn(0x7f36900c74f0 msgr2=0x7f369014df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:46.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 -- 172.21.15.114:0/3813237947 shutdown_connections 2024-02-17T12:17:46.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.277+0000 7f3695400640 1 -- 172.21.15.114:0/3813237947 wait complete. 2024-02-17T12:17:46.308 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:46.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb7b200640 1 Processor -- start 2024-02-17T12:17:46.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb7b200640 1 -- start start 2024-02-17T12:17:46.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb7b200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb740c25a0 0x7feb7406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb7b200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7feb7406db50 0x7feb7414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb7b200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb74156270 con 0x7feb74150490 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb7b200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb74071630 con 0x7feb740c25a0 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb7b200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb74156550 con 0x7feb7406db50 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb73e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb740c25a0 0x7feb7406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb79200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7feb74150490 0x7feb74152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55080/0 (socket says 172.21.15.114:55080) 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb79200640 1 -- 172.21.15.114:0/680764144 learned_addr learned my addr 172.21.15.114:0/680764144 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb73400640 1 --2- 172.21.15.114:0/680764144 >> v2:172.21.15.116:3300/0 conn(0x7feb7406db50 0x7feb7414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb73e00640 1 -- 172.21.15.114:0/680764144 >> v2:172.21.15.116:3300/0 conn(0x7feb7406db50 msgr2=0x7feb7414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb73e00640 1 --2- 172.21.15.114:0/680764144 >> v2:172.21.15.116:3300/0 conn(0x7feb7406db50 0x7feb7414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb73e00640 1 -- 172.21.15.114:0/680764144 >> v1:172.21.15.114:6789/0 conn(0x7feb74150490 legacy=0x7feb74152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.437+0000 7feb73e00640 1 -- 172.21.15.114:0/680764144 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74156830 con 0x7feb740c25a0 2024-02-17T12:17:46.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb73e00640 1 --2- 172.21.15.114:0/680764144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb740c25a0 0x7feb7406e980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7feb7406e260 tx=0x7feb6401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3914cbd1a4501e8e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:46.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb72a00640 1 -- 172.21.15.114:0/680764144 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb640a66f0 con 0x7feb740c25a0 2024-02-17T12:17:46.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb72a00640 1 -- 172.21.15.114:0/680764144 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb640a6850 con 0x7feb740c25a0 2024-02-17T12:17:46.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb72a00640 1 -- 172.21.15.114:0/680764144 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb640a6be0 con 0x7feb740c25a0 2024-02-17T12:17:46.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb7b200640 1 -- 172.21.15.114:0/680764144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb740c25a0 msgr2=0x7feb7406e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb7b200640 1 --2- 172.21.15.114:0/680764144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb740c25a0 0x7feb7406e980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7feb7406e260 tx=0x7feb6401c810 comp rx=0 tx=0).stop 2024-02-17T12:17:46.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb7b200640 1 -- 172.21.15.114:0/680764144 shutdown_connections 2024-02-17T12:17:46.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb7b200640 1 --2- 172.21.15.114:0/680764144 >> v2:172.21.15.116:3300/0 conn(0x7feb7406db50 0x7feb7414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb7b200640 1 --2- 172.21.15.114:0/680764144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb740c25a0 0x7feb7406e980 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb7b200640 1 -- 172.21.15.114:0/680764144 >> 172.21.15.114:0/680764144 conn(0x7feb740a8490 msgr2=0x7feb740a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:46.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb7b200640 1 -- 172.21.15.114:0/680764144 shutdown_connections 2024-02-17T12:17:46.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.441+0000 7feb7b200640 1 -- 172.21.15.114:0/680764144 wait complete. 2024-02-17T12:17:46.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb7b200640 1 Processor -- start 2024-02-17T12:17:46.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb7b200640 1 -- start start 2024-02-17T12:17:46.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb7b200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb7406db50 0x7feb7413c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb7b200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feb740c25a0 0x7feb740c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb7b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb74150490 0x7feb740bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb7b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb741f12e0 con 0x7feb74150490 2024-02-17T12:17:46.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb7b200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74140520 con 0x7feb7406db50 2024-02-17T12:17:46.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb7b200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb740ab3f0 con 0x7feb740c25a0 2024-02-17T12:17:46.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb79200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb74150490 0x7feb740bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb79200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb74150490 0x7feb740bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37156/0 (socket says 172.21.15.114:37156) 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb79200640 1 -- 172.21.15.114:0/3313732217 learned_addr learned my addr 172.21.15.114:0/3313732217 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb73e00640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb7406db50 0x7feb7413c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb73400640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feb740c25a0 0x7feb740c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb79200640 1 -- 172.21.15.114:0/3313732217 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feb740c25a0 msgr2=0x7feb740c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb79200640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feb740c25a0 0x7feb740c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb79200640 1 -- 172.21.15.114:0/3313732217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb7406db50 msgr2=0x7feb7413c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb79200640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb7406db50 0x7feb7413c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb79200640 1 -- 172.21.15.114:0/3313732217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb64009a70 con 0x7feb74150490 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb79200640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb74150490 0x7feb740bf830 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00c3c0 tx=0x7feb6c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb6be00640 1 -- 172.21.15.114:0/3313732217 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c005cf0 con 0x7feb74150490 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb6be00640 1 -- 172.21.15.114:0/3313732217 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c005e50 con 0x7feb74150490 2024-02-17T12:17:46.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb7b200640 1 -- 172.21.15.114:0/3313732217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb740c5fc0 con 0x7feb74150490 2024-02-17T12:17:46.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb6be00640 1 -- 172.21.15.114:0/3313732217 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0072f0 con 0x7feb74150490 2024-02-17T12:17:46.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.445+0000 7feb7b200640 1 -- 172.21.15.114:0/3313732217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb741f0c90 con 0x7feb74150490 2024-02-17T12:17:46.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.449+0000 7feb7b200640 1 -- 172.21.15.114:0/3313732217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb741f1470 con 0x7feb74150490 2024-02-17T12:17:46.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.449+0000 7feb6be00640 1 -- 172.21.15.114:0/3313732217 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7feb6c007450 con 0x7feb74150490 2024-02-17T12:17:46.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.449+0000 7feb6be00640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb54066e40 0x7feb54069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.449+0000 7feb6be00640 1 -- 172.21.15.114:0/3313732217 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7feb6c083e70 con 0x7feb74150490 2024-02-17T12:17:46.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.449+0000 7feb73e00640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb54066e40 0x7feb54069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.449+0000 7feb73e00640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb54066e40 0x7feb54069300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feb640af000 tx=0x7feb640a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:46.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.453+0000 7feb6be00640 1 -- 172.21.15.114:0/3313732217 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feb6c050d20 con 0x7feb74150490 2024-02-17T12:17:46.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.613+0000 7feb7b200640 1 -- 172.21.15.114:0/3313732217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb741f0ac0 con 0x7feb74150490 2024-02-17T12:17:46.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.613+0000 7feb6be00640 1 -- 172.21.15.114:0/3313732217 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16760 (secure 0 0 0) 0x7feb6c0543e0 con 0x7feb74150490 2024-02-17T12:17:46.621 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:46.621 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":39,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:46.277697+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/1473468479":"2024-02-18T12:17:43.271319+0000","172.21.15.114:6835/1473468479":"2024-02-18T12:17:43.271319+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:46.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 -- 172.21.15.114:0/3313732217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb54066e40 msgr2=0x7feb54069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb54066e40 0x7feb54069300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feb640af000 tx=0x7feb640a7000 comp rx=0 tx=0).stop 2024-02-17T12:17:46.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 -- 172.21.15.114:0/3313732217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb74150490 msgr2=0x7feb740bf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb74150490 0x7feb740bf830 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00c3c0 tx=0x7feb6c00c880 comp rx=0 tx=0).stop 2024-02-17T12:17:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 -- 172.21.15.114:0/3313732217 shutdown_connections 2024-02-17T12:17:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7feb54066e40 0x7feb54069300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb74150490 0x7feb740bf830 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feb740c25a0 0x7feb740c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 --2- 172.21.15.114:0/3313732217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb7406db50 0x7feb7413c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 -- 172.21.15.114:0/3313732217 >> 172.21.15.114:0/3313732217 conn(0x7feb740a8490 msgr2=0x7feb74072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 -- 172.21.15.114:0/3313732217 shutdown_connections 2024-02-17T12:17:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.617+0000 7feb7b200640 1 -- 172.21.15.114:0/3313732217 wait complete. 2024-02-17T12:17:46.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:17:20.859567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:17:21.688611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:17:46.643 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:17:46.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.769+0000 7f141bc00640 1 Processor -- start 2024-02-17T12:17:46.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.769+0000 7f141bc00640 1 -- start start 2024-02-17T12:17:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f141bc00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f14140c25a0 0x7f141406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f141bc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1414156270 con 0x7f141406db50 2024-02-17T12:17:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f141bc00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1414156550 con 0x7f1414152c50 2024-02-17T12:17:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f141bc00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1414071630 con 0x7f14140c25a0 2024-02-17T12:17:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f141406db50 0x7f141414ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55082/0 (socket says 172.21.15.114:55082) 2024-02-17T12:17:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413e00640 1 -- 172.21.15.114:0/2097322061 learned_addr learned my addr 172.21.15.114:0/2097322061 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1419200640 1 --2- 172.21.15.114:0/2097322061 >> v2:172.21.15.116:3300/0 conn(0x7f14140c25a0 0x7f141406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286575909 0 0) 0x7f1414156270 con 0x7f141406db50 2024-02-17T12:17:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f8003530 con 0x7f141406db50 2024-02-17T12:17:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2368817059 0 0) 0x7f13f8003530 con 0x7f141406db50 2024-02-17T12:17:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 >> v2:172.21.15.116:3300/0 conn(0x7f14140c25a0 msgr2=0x7f141406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 --2- 172.21.15.114:0/2097322061 >> v2:172.21.15.116:3300/0 conn(0x7f14140c25a0 0x7f141406e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 >> v1:172.21.15.116:6789/0 conn(0x7f1414152c50 legacy=0x7f1414153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1414156830 con 0x7f141406db50 2024-02-17T12:17:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f1400001680 con 0x7f141406db50 2024-02-17T12:17:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 >> v1:172.21.15.114:6789/0 conn(0x7f141406db50 legacy=0x7f141414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f8003980 0x7f13f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13f80047d0 0x7f13f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13f80052b0 0x7f13f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f800c150 con 0x7f13f80052b0 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f800c2c0 con 0x7f13f80047d0 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f800c480 con 0x7f13f8003980 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1419c00640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13f80052b0 0x7f13f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1413e00640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13f80047d0 0x7f13f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1419200640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f8003980 0x7f13f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1419c00640 1 -- 172.21.15.114:0/2097322061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f8003980 msgr2=0x7f13f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1419c00640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f8003980 0x7f13f8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1419c00640 1 -- 172.21.15.114:0/2097322061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13f80047d0 msgr2=0x7f13f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1419c00640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f13f80047d0 0x7f13f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1419c00640 1 -- 172.21.15.114:0/2097322061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f8003530 con 0x7f13f80052b0 2024-02-17T12:17:46.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.773+0000 7f1419200640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f8003980 0x7f13f8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f1419c00640 1 -- 172.21.15.114:0/2097322061 reap_dead start 2024-02-17T12:17:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f1419c00640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13f80052b0 0x7f13f800b990 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f140c001e40 tx=0x7f140c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e122a7d1d15c47 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c003980 con 0x7f13f80052b0 2024-02-17T12:17:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c003ae0 con 0x7f13f80052b0 2024-02-17T12:17:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f1413400640 1 -- 172.21.15.114:0/2097322061 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c003e70 con 0x7f13f80052b0 2024-02-17T12:17:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f141bc00640 1 -- 172.21.15.114:0/2097322061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13f80052b0 msgr2=0x7f13f800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f141bc00640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13f80052b0 0x7f13f800b990 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f140c001e40 tx=0x7f140c01c730 comp rx=0 tx=0).stop 2024-02-17T12:17:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f141bc00640 1 -- 172.21.15.114:0/2097322061 shutdown_connections 2024-02-17T12:17:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f141bc00640 1 --2- 172.21.15.114:0/2097322061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13f80052b0 0x7f13f800b990 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f141bc00640 1 -- 172.21.15.114:0/2097322061 >> 172.21.15.114:0/2097322061 conn(0x7f14140a8490 msgr2=0x7f14140a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f141bc00640 1 -- 172.21.15.114:0/2097322061 shutdown_connections 2024-02-17T12:17:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.777+0000 7f141bc00640 1 -- 172.21.15.114:0/2097322061 wait complete. 2024-02-17T12:17:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f141bc00640 1 Processor -- start 2024-02-17T12:17:46.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f141bc00640 1 -- start start 2024-02-17T12:17:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f141bc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f80052b0 0x7f141414ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f141bc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14141ec7c0 0x7f1414154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f141bc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141414ad90 0x7f1414141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f141bc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141414a900 con 0x7f141414ad90 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f141bc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14140c3700 con 0x7f14141ec7c0 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f141bc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14140c39e0 con 0x7f13f80052b0 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1419200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f80052b0 0x7f141414ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1413e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14141ec7c0 0x7f1414154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1419200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f80052b0 0x7f141414ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:59502/0 (socket says 172.21.15.114:59502) 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1413e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14141ec7c0 0x7f1414154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:48586/0 (socket says 172.21.15.114:48586) 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1419200640 1 -- 172.21.15.114:0/150713893 learned_addr learned my addr 172.21.15.114:0/150713893 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:46.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1419c00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141414ad90 0x7f1414141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1419200640 1 -- 172.21.15.114:0/150713893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14141ec7c0 msgr2=0x7f1414154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1419200640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14141ec7c0 0x7f1414154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1419200640 1 -- 172.21.15.114:0/150713893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141414ad90 msgr2=0x7f1414141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1419200640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141414ad90 0x7f1414141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1419200640 1 -- 172.21.15.114:0/150713893 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141414a590 con 0x7f13f80052b0 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1413e00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14141ec7c0 0x7f1414154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1419200640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f80052b0 0x7f141414ba30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1404009160 tx=0x7f14040119a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1410c00640 1 -- 172.21.15.114:0/150713893 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404004220 con 0x7f13f80052b0 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.781+0000 7f1410c00640 1 -- 172.21.15.114:0/150713893 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404004380 con 0x7f13f80052b0 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.785+0000 7f1410c00640 1 -- 172.21.15.114:0/150713893 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404015890 con 0x7f13f80052b0 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.785+0000 7f141bc00640 1 -- 172.21.15.114:0/150713893 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14141ecc40 con 0x7f13f80052b0 2024-02-17T12:17:46.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.785+0000 7f141bc00640 1 -- 172.21.15.114:0/150713893 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14141553f0 con 0x7f13f80052b0 2024-02-17T12:17:46.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.785+0000 7f141bc00640 1 -- 172.21.15.114:0/150713893 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1414074840 con 0x7f13f80052b0 2024-02-17T12:17:46.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.785+0000 7f1410c00640 1 -- 172.21.15.114:0/150713893 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f14040159f0 con 0x7f13f80052b0 2024-02-17T12:17:46.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.789+0000 7f1410c00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f13f4066e70 0x7f13f4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:46.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.789+0000 7f1410c00640 1 -- 172.21.15.114:0/150713893 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1404085240 con 0x7f13f80052b0 2024-02-17T12:17:46.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.789+0000 7f1413e00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f13f4066e70 0x7f13f4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:46.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.789+0000 7f1413e00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f13f4066e70 0x7f13f4069330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f14140c1d20 tx=0x7f1400001160 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.789+0000 7f1410c00640 1 -- 172.21.15.114:0/150713893 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f14040520f0 con 0x7f13f80052b0 2024-02-17T12:17:46.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 -- 172.21.15.114:0/150713893 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1414072b70 con 0x7f13f80052b0 2024-02-17T12:17:46.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f1410c00640 1 -- 172.21.15.114:0/150713893 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14040557b0 con 0x7f13f80052b0 2024-02-17T12:17:46.952 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:17:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 -- 172.21.15.114:0/150713893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f13f4066e70 msgr2=0x7f13f4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f13f4066e70 0x7f13f4069330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f14140c1d20 tx=0x7f1400001160 comp rx=0 tx=0).stop 2024-02-17T12:17:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 -- 172.21.15.114:0/150713893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f80052b0 msgr2=0x7f141414ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f80052b0 0x7f141414ba30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1404009160 tx=0x7f14040119a0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 -- 172.21.15.114:0/150713893 shutdown_connections 2024-02-17T12:17:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f13f4066e70 0x7f13f4069330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f141414ad90 0x7f1414141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14141ec7c0 0x7f1414154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 --2- 172.21.15.114:0/150713893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13f80052b0 0x7f141414ba30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:46.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 -- 172.21.15.114:0/150713893 >> 172.21.15.114:0/150713893 conn(0x7f14140a8490 msgr2=0x7f1414155830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:46.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 -- 172.21.15.114:0/150713893 shutdown_connections 2024-02-17T12:17:46.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:46.945+0000 7f141bc00640 1 -- 172.21.15.114:0/150713893 wait complete. 2024-02-17T12:17:46.973 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:17:47.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8ec0400640 1 Processor -- start 2024-02-17T12:17:47.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8ec0400640 1 -- start start 2024-02-17T12:17:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8ec0400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8eb80c25a0 0x7f8eb806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8ec0400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb8156270 con 0x7f8eb8152c50 2024-02-17T12:17:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8ec0400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb8156550 con 0x7f8eb806db50 2024-02-17T12:17:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8ec0400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb8071630 con 0x7f8eb80c25a0 2024-02-17T12:17:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8ebe400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8eb8152c50 0x7f8eb8153070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55088/0 (socket says 172.21.15.114:55088) 2024-02-17T12:17:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8ebe400640 1 -- 172.21.15.114:0/2100443135 learned_addr learned my addr 172.21.15.114:0/2100443135 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8ebda00640 1 --2- 172.21.15.114:0/2100443135 >> v2:172.21.15.116:3300/0 conn(0x7f8eb80c25a0 0x7f8eb806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8eb7e00640 1 -- 172.21.15.114:0/2100443135 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961382100 0 0) 0x7f8eb8156270 con 0x7f8eb8152c50 2024-02-17T12:17:47.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.105+0000 7f8eb7e00640 1 -- 172.21.15.114:0/2100443135 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ea0003530 con 0x7f8eb8152c50 2024-02-17T12:17:47.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8ebda00640 1 -- 172.21.15.114:0/2100443135 >> v1:172.21.15.116:6789/0 conn(0x7f8eb806db50 legacy=0x7f8eb814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8ebda00640 1 -- 172.21.15.114:0/2100443135 >> v1:172.21.15.114:6789/0 conn(0x7f8eb8152c50 legacy=0x7f8eb8153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8ebda00640 1 -- 172.21.15.114:0/2100443135 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8156830 con 0x7f8eb80c25a0 2024-02-17T12:17:47.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8ebda00640 1 --2- 172.21.15.114:0/2100443135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8eb80c25a0 0x7f8eb806e980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009d90 tx=0x7f8eac01c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bf5603d452ebf9d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:47.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8eb7e00640 1 -- 172.21.15.114:0/2100443135 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0a5800 con 0x7f8eb80c25a0 2024-02-17T12:17:47.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8eb7e00640 1 -- 172.21.15.114:0/2100443135 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac0a5960 con 0x7f8eb80c25a0 2024-02-17T12:17:47.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8eb7e00640 1 -- 172.21.15.114:0/2100443135 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0a5cf0 con 0x7f8eb80c25a0 2024-02-17T12:17:47.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8ec0400640 1 -- 172.21.15.114:0/2100443135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8eb80c25a0 msgr2=0x7f8eb806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8ec0400640 1 --2- 172.21.15.114:0/2100443135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8eb80c25a0 0x7f8eb806e980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009d90 tx=0x7f8eac01c820 comp rx=0 tx=0).stop 2024-02-17T12:17:47.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8ec0400640 1 -- 172.21.15.114:0/2100443135 shutdown_connections 2024-02-17T12:17:47.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8ec0400640 1 --2- 172.21.15.114:0/2100443135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8eb80c25a0 0x7f8eb806e980 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.109+0000 7f8ec0400640 1 -- 172.21.15.114:0/2100443135 >> 172.21.15.114:0/2100443135 conn(0x7f8eb80a8490 msgr2=0x7f8eb80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 -- 172.21.15.114:0/2100443135 shutdown_connections 2024-02-17T12:17:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 -- 172.21.15.114:0/2100443135 wait complete. 2024-02-17T12:17:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 Processor -- start 2024-02-17T12:17:47.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 -- start start 2024-02-17T12:17:47.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eb806db50 0x7f8eb80bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8eb80c25a0 0x7f8eb81f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8eb8152c50 0x7f8eb81f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb81f08e0 con 0x7f8eb806db50 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb81436f0 con 0x7f8eb8152c50 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb813a310 con 0x7f8eb80c25a0 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eb806db50 0x7f8eb80bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eb806db50 0x7f8eb80bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37182/0 (socket says 172.21.15.114:37182) 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebda00640 1 -- 172.21.15.114:0/944765766 learned_addr learned my addr 172.21.15.114:0/944765766 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebd000640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8eb80c25a0 0x7f8eb81f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebe400640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8eb8152c50 0x7f8eb81f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebda00640 1 -- 172.21.15.114:0/944765766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8eb80c25a0 msgr2=0x7f8eb81f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebda00640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8eb80c25a0 0x7f8eb81f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebda00640 1 -- 172.21.15.114:0/944765766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8eb8152c50 msgr2=0x7f8eb81f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebda00640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8eb8152c50 0x7f8eb81f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebda00640 1 -- 172.21.15.114:0/944765766 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac009a70 con 0x7f8eb806db50 2024-02-17T12:17:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ebda00640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eb806db50 0x7f8eb80bfa00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009d90 tx=0x7f8eac0195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8eb5600640 1 -- 172.21.15.114:0/944765766 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0b9860 con 0x7f8eb806db50 2024-02-17T12:17:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8eb5600640 1 -- 172.21.15.114:0/944765766 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac0b99c0 con 0x7f8eb806db50 2024-02-17T12:17:47.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8ec0400640 1 -- 172.21.15.114:0/944765766 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb813a030 con 0x7f8eb806db50 2024-02-17T12:17:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.113+0000 7f8eb5600640 1 -- 172.21.15.114:0/944765766 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0b9d70 con 0x7f8eb806db50 2024-02-17T12:17:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.117+0000 7f8ec0400640 1 -- 172.21.15.114:0/944765766 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb813bf30 con 0x7f8eb806db50 2024-02-17T12:17:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.117+0000 7f8ec0400640 1 -- 172.21.15.114:0/944765766 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb8074840 con 0x7f8eb806db50 2024-02-17T12:17:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.117+0000 7f8eb5600640 1 -- 172.21.15.114:0/944765766 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8eac0ad440 con 0x7f8eb806db50 2024-02-17T12:17:47.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.117+0000 7f8eb5600640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8e98066e40 0x7f8e98069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.117+0000 7f8eb5600640 1 -- 172.21.15.114:0/944765766 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f8eac11fd70 con 0x7f8eb806db50 2024-02-17T12:17:47.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.117+0000 7f8ebd000640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8e98066e40 0x7f8e98069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.117+0000 7f8ebd000640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8e98066e40 0x7f8e98069300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8147930 tx=0x7f8ea4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:47.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.121+0000 7f8eb5600640 1 -- 172.21.15.114:0/944765766 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8eac0ecaf0 con 0x7f8eb806db50 2024-02-17T12:17:47.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 -- 172.21.15.114:0/944765766 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8eb8147960 con 0x7f8eb806db50 2024-02-17T12:17:47.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8eb5600640 1 -- 172.21.15.114:0/944765766 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v39) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8eac0bd020 con 0x7f8eb806db50 2024-02-17T12:17:47.284 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:17:47.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 -- 172.21.15.114:0/944765766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8e98066e40 msgr2=0x7f8e98069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8e98066e40 0x7f8e98069300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8147930 tx=0x7f8ea4009040 comp rx=0 tx=0).stop 2024-02-17T12:17:47.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 -- 172.21.15.114:0/944765766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eb806db50 msgr2=0x7f8eb80bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eb806db50 0x7f8eb80bfa00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009d90 tx=0x7f8eac0195c0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 -- 172.21.15.114:0/944765766 shutdown_connections 2024-02-17T12:17:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8eb8152c50 0x7f8eb81f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8eb80c25a0 0x7f8eb81f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8e98066e40 0x7f8e98069300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 --2- 172.21.15.114:0/944765766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eb806db50 0x7f8eb80bfa00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 -- 172.21.15.114:0/944765766 >> 172.21.15.114:0/944765766 conn(0x7f8eb80a8490 msgr2=0x7f8eb80a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 -- 172.21.15.114:0/944765766 shutdown_connections 2024-02-17T12:17:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.277+0000 7f8ec0400640 1 -- 172.21.15.114:0/944765766 wait complete. 2024-02-17T12:17:47.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:17:47.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f4292200640 1 Processor -- start 2024-02-17T12:17:47.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f4292200640 1 -- start start 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f4292200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c0c1eb0 0x7f428c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f4292200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c0a9420 con 0x7f428c0c2580 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f4292200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c152850 con 0x7f428c14f110 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f4292200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c14f4f0 con 0x7f428c0c1eb0 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428aa00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f428c0c2580 0x7f428c0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55104/0 (socket says 172.21.15.114:55104) 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428aa00640 1 -- 172.21.15.114:0/2063882596 learned_addr learned my addr 172.21.15.114:0/2063882596 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428be00640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c0c1eb0 0x7f428c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426527655 0 0) 0x7f428c0a9420 con 0x7f428c0c2580 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4270003530 con 0x7f428c0c2580 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 812377315 0 0) 0x7f4270003530 con 0x7f428c0c2580 2024-02-17T12:17:47.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c0c1eb0 msgr2=0x7f428c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c0c1eb0 0x7f428c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 >> v1:172.21.15.116:6789/0 conn(0x7f428c14f110 legacy=0x7f428c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c0a9670 con 0x7f428c0c2580 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f4278001680 con 0x7f428c0c2580 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 >> v1:172.21.15.114:6789/0 conn(0x7f428c0c2580 legacy=0x7f428c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c0c1eb0 0x7f42700039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4270003ef0 0x7f42700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4270004d10 0x7f4270005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c14f4f0 con 0x7f4270004d10 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427000dce0 con 0x7f4270003ef0 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427000dea0 con 0x7f428c0c1eb0 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428be00640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4270004d10 0x7f4270005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428aa00640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4270003ef0 0x7f42700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428b400640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c0c1eb0 0x7f42700039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428be00640 1 -- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c0c1eb0 msgr2=0x7f42700039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428be00640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c0c1eb0 0x7f42700039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428be00640 1 -- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4270003ef0 msgr2=0x7f42700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428be00640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4270003ef0 0x7f42700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.441+0000 7f428be00640 1 -- 172.21.15.114:0/2063882596 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270003530 con 0x7f4270004d10 2024-02-17T12:17:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f428be00640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4270004d10 0x7f4270005190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4284009ab0 tx=0x7f428401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d37cd05600d707d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840a5640 con 0x7f4270004d10 2024-02-17T12:17:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42840a57a0 con 0x7f4270004d10 2024-02-17T12:17:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f428a000640 1 -- 172.21.15.114:0/2063882596 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840a5b50 con 0x7f4270004d10 2024-02-17T12:17:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f4292200640 1 -- 172.21.15.114:0/2063882596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4270004d10 msgr2=0x7f4270005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f4292200640 1 --2- 172.21.15.114:0/2063882596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4270004d10 0x7f4270005190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4284009ab0 tx=0x7f428401ca50 comp rx=0 tx=0).stop 2024-02-17T12:17:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f428be00640 1 -- 172.21.15.114:0/2063882596 reap_dead start 2024-02-17T12:17:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f4292200640 1 -- 172.21.15.114:0/2063882596 shutdown_connections 2024-02-17T12:17:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f4292200640 1 -- 172.21.15.114:0/2063882596 >> 172.21.15.114:0/2063882596 conn(0x7f428c0a8490 msgr2=0x7f428c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f4292200640 1 -- 172.21.15.114:0/2063882596 shutdown_connections 2024-02-17T12:17:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.445+0000 7f4292200640 1 -- 172.21.15.114:0/2063882596 wait complete. 2024-02-17T12:17:47.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4292200640 1 Processor -- start 2024-02-17T12:17:47.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4292200640 1 -- start start 2024-02-17T12:17:47.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4292200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f428c13ea10 0x7f428c13edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4292200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f428c0c5170 0x7f428c1eef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4292200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c13be40 0x7f428c13c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4292200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c142d40 con 0x7f428c0c5170 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4292200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0c6100 con 0x7f428c13ea10 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4292200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c1ef470 con 0x7f428c13be40 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f428c0c5170 0x7f428c1eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f428c0c5170 0x7f428c1eef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37200/0 (socket says 172.21.15.114:37200) 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428aa00640 1 -- 172.21.15.114:0/740510538 learned_addr learned my addr 172.21.15.114:0/740510538 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428b400640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f428c13ea10 0x7f428c13edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428be00640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c13be40 0x7f428c13c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428aa00640 1 -- 172.21.15.114:0/740510538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c13be40 msgr2=0x7f428c13c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428aa00640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c13be40 0x7f428c13c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428aa00640 1 -- 172.21.15.114:0/740510538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f428c13ea10 msgr2=0x7f428c13edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428aa00640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f428c13ea10 0x7f428c13edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428aa00640 1 -- 172.21.15.114:0/740510538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c0c4100 con 0x7f428c0c5170 2024-02-17T12:17:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428be00640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c13be40 0x7f428c13c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f428aa00640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f428c0c5170 0x7f428c1eef30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4278007110 tx=0x7f4278004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4283400640 1 -- 172.21.15.114:0/740510538 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780077b0 con 0x7f428c0c5170 2024-02-17T12:17:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4283400640 1 -- 172.21.15.114:0/740510538 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800f960 con 0x7f428c0c5170 2024-02-17T12:17:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4283400640 1 -- 172.21.15.114:0/740510538 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800fd10 con 0x7f428c0c5170 2024-02-17T12:17:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4292200640 1 -- 172.21.15.114:0/740510538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c0c5580 con 0x7f428c0c5170 2024-02-17T12:17:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.449+0000 7f4292200640 1 -- 172.21.15.114:0/740510538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c0c5b40 con 0x7f428c0c5170 2024-02-17T12:17:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.453+0000 7f4292200640 1 -- 172.21.15.114:0/740510538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c0c3f60 con 0x7f428c0c5170 2024-02-17T12:17:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.453+0000 7f4283400640 1 -- 172.21.15.114:0/740510538 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f427801d460 con 0x7f428c0c5170 2024-02-17T12:17:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.453+0000 7f4283400640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f426c066e40 0x7f426c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.453+0000 7f4283400640 1 -- 172.21.15.114:0/740510538 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f4278084c60 con 0x7f428c0c5170 2024-02-17T12:17:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.453+0000 7f428b400640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f426c066e40 0x7f426c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.453+0000 7f428b400640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f426c066e40 0x7f426c069300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f427c012450 tx=0x7f427c00a880 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:47.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.457+0000 7f4283400640 1 -- 172.21.15.114:0/740510538 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f428c0c3f60 con 0x7f428c0c5170 2024-02-17T12:17:47.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.609+0000 7f4292200640 1 -- 172.21.15.114:0/740510538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f428c0c3f60 con 0x7f428c0c5170 2024-02-17T12:17:47.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4283400640 1 -- 172.21.15.114:0/740510538 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v39) v1 ==== 101+0+11 (secure 0 0 0) 0x7f428c0c3f60 con 0x7f428c0c5170 2024-02-17T12:17:47.619 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:17:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 -- 172.21.15.114:0/740510538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f426c066e40 msgr2=0x7f426c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f426c066e40 0x7f426c069300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f427c012450 tx=0x7f427c00a880 comp rx=0 tx=0).stop 2024-02-17T12:17:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 -- 172.21.15.114:0/740510538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f428c0c5170 msgr2=0x7f428c1eef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f428c0c5170 0x7f428c1eef30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4278007110 tx=0x7f4278004f90 comp rx=0 tx=0).stop 2024-02-17T12:17:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 -- 172.21.15.114:0/740510538 shutdown_connections 2024-02-17T12:17:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f428c13be40 0x7f428c13c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f426c066e40 0x7f426c069300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f428c0c5170 0x7f428c1eef30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 --2- 172.21.15.114:0/740510538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f428c13ea10 0x7f428c13edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 -- 172.21.15.114:0/740510538 >> 172.21.15.114:0/740510538 conn(0x7f428c0a8490 msgr2=0x7f428c072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:47.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 -- 172.21.15.114:0/740510538 shutdown_connections 2024-02-17T12:17:47.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.613+0000 7f4292200640 1 -- 172.21.15.114:0/740510538 wait complete. 2024-02-17T12:17:47.640 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.765+0000 7f94e9000640 1 Processor -- start 2024-02-17T12:17:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.765+0000 7f94e9000640 1 -- start start 2024-02-17T12:17:47.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.765+0000 7f94e9000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f94e414f110 0x7f94e40c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.765+0000 7f94e9000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f94e40c2580 0x7f94e40aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e9000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e40a9420 con 0x7f94e40c1eb0 2024-02-17T12:17:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e9000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e414f4f0 con 0x7f94e414f110 2024-02-17T12:17:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e9000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e40aae80 con 0x7f94e40c2580 2024-02-17T12:17:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e1e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f94e414f110 0x7f94e40c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e1e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f94e414f110 0x7f94e40c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37210/0 (socket says 172.21.15.114:37210) 2024-02-17T12:17:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e1e00640 1 -- 172.21.15.114:0/1475757197 learned_addr learned my addr 172.21.15.114:0/1475757197 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e1400640 1 --2- 172.21.15.114:0/1475757197 >> v2:172.21.15.116:3300/0 conn(0x7f94e40c2580 0x7f94e40aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e1e00640 1 -- 172.21.15.114:0/1475757197 >> v2:172.21.15.116:3300/0 conn(0x7f94e40c2580 msgr2=0x7f94e40aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:47.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e1e00640 1 --2- 172.21.15.114:0/1475757197 >> v2:172.21.15.116:3300/0 conn(0x7f94e40c2580 0x7f94e40aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e1e00640 1 -- 172.21.15.114:0/1475757197 >> v1:172.21.15.116:6789/0 conn(0x7f94e40c1eb0 legacy=0x7f94e4155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:47.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e1e00640 1 -- 172.21.15.114:0/1475757197 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e4152850 con 0x7f94e414f110 2024-02-17T12:17:47.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e1e00640 1 --2- 172.21.15.114:0/1475757197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e414f110 0x7f94e40c65a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f94e406f0d0 tx=0x7f94d401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2404403a9649a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:47.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e0a00640 1 -- 172.21.15.114:0/1475757197 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40ab620 con 0x7f94e414f110 2024-02-17T12:17:47.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e0a00640 1 -- 172.21.15.114:0/1475757197 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d40ab780 con 0x7f94e414f110 2024-02-17T12:17:47.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.769+0000 7f94e0a00640 1 -- 172.21.15.114:0/1475757197 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40abb10 con 0x7f94e414f110 2024-02-17T12:17:47.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 -- 172.21.15.114:0/1475757197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e414f110 msgr2=0x7f94e40c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 --2- 172.21.15.114:0/1475757197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e414f110 0x7f94e40c65a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f94e406f0d0 tx=0x7f94d401c420 comp rx=0 tx=0).stop 2024-02-17T12:17:47.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 -- 172.21.15.114:0/1475757197 shutdown_connections 2024-02-17T12:17:47.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 --2- 172.21.15.114:0/1475757197 >> v2:172.21.15.116:3300/0 conn(0x7f94e40c2580 0x7f94e40aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 --2- 172.21.15.114:0/1475757197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e414f110 0x7f94e40c65a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 -- 172.21.15.114:0/1475757197 >> 172.21.15.114:0/1475757197 conn(0x7f94e40a8490 msgr2=0x7f94e40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:47.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 -- 172.21.15.114:0/1475757197 shutdown_connections 2024-02-17T12:17:47.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 -- 172.21.15.114:0/1475757197 wait complete. 2024-02-17T12:17:47.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 Processor -- start 2024-02-17T12:17:47.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 -- start start 2024-02-17T12:17:47.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94e40c1eb0 0x7f94e4142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e40c2580 0x7f94e41441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94e414f110 0x7f94e413ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e41422f0 con 0x7f94e40c2580 2024-02-17T12:17:47.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e414fcd0 con 0x7f94e414f110 2024-02-17T12:17:47.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e9000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e41edcc0 con 0x7f94e40c1eb0 2024-02-17T12:17:47.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e40c2580 0x7f94e41441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e40c2580 0x7f94e41441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37214/0 (socket says 172.21.15.114:37214) 2024-02-17T12:17:47.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1400640 1 -- 172.21.15.114:0/1594183666 learned_addr learned my addr 172.21.15.114:0/1594183666 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:47.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1e00640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94e40c1eb0 0x7f94e4142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e2800640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94e414f110 0x7f94e413ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1400640 1 -- 172.21.15.114:0/1594183666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94e40c1eb0 msgr2=0x7f94e4142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1400640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94e40c1eb0 0x7f94e4142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1400640 1 -- 172.21.15.114:0/1594183666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94e414f110 msgr2=0x7f94e413ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1400640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94e414f110 0x7f94e413ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1400640 1 -- 172.21.15.114:0/1594183666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d40094d0 con 0x7f94e40c2580 2024-02-17T12:17:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1e00640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94e40c1eb0 0x7f94e4142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.773+0000 7f94e1400640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e40c2580 0x7f94e41441b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f94d000d800 tx=0x7f94d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94da000640 1 -- 172.21.15.114:0/1594183666 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000b6c0 con 0x7f94e40c2580 2024-02-17T12:17:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94da000640 1 -- 172.21.15.114:0/1594183666 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d000b820 con 0x7f94e40c2580 2024-02-17T12:17:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94da000640 1 -- 172.21.15.114:0/1594183666 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000bbd0 con 0x7f94e40c2580 2024-02-17T12:17:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94e9000640 1 -- 172.21.15.114:0/1594183666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e4140fb0 con 0x7f94e40c2580 2024-02-17T12:17:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94e9000640 1 -- 172.21.15.114:0/1594183666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e4142c50 con 0x7f94e40c2580 2024-02-17T12:17:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94e9000640 1 -- 172.21.15.114:0/1594183666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e4074840 con 0x7f94e40c2580 2024-02-17T12:17:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94da000640 1 -- 172.21.15.114:0/1594183666 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f94d000bd30 con 0x7f94e40c2580 2024-02-17T12:17:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94da000640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94c4066e40 0x7f94c4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94da000640 1 -- 172.21.15.114:0/1594183666 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f94d0084fc0 con 0x7f94e40c2580 2024-02-17T12:17:47.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94e1e00640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94c4066e40 0x7f94c4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:47.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.777+0000 7f94e1e00640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94c4066e40 0x7f94c4069300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f94d40af000 tx=0x7f94d40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:47.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.781+0000 7f94da000640 1 -- 172.21.15.114:0/1594183666 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94d0051d40 con 0x7f94e40c2580 2024-02-17T12:17:47.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.965+0000 7f94e9000640 1 -- 172.21.15.114:0/1594183666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94e40c1380 con 0x7f94e40c2580 2024-02-17T12:17:47.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.965+0000 7f94da000640 1 -- 172.21.15.114:0/1594183666 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f94d0055400 con 0x7f94e40c2580 2024-02-17T12:17:47.975 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:47.975 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5535,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4030579941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4030579941},{"type":"v1","addr":"172.21.15.114:6837","nonce":4030579941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:22.698504+0000","modified":"2024-02-17T12:17:25.708127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4941},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4941":{"gid":4941,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/2833741536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2833741536},{"type":"v1","addr":"172.21.15.114:6836","nonce":2833741536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-02-17T12:17:47.975 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-02-17T12:17:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 -- 172.21.15.114:0/1594183666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94c4066e40 msgr2=0x7f94c4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94c4066e40 0x7f94c4069300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f94d40af000 tx=0x7f94d40a7000 comp rx=0 tx=0).stop 2024-02-17T12:17:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 -- 172.21.15.114:0/1594183666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e40c2580 msgr2=0x7f94e41441b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e40c2580 0x7f94e41441b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f94d000d800 tx=0x7f94d000dcc0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 -- 172.21.15.114:0/1594183666 shutdown_connections 2024-02-17T12:17:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94e414f110 0x7f94e413ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94c4066e40 0x7f94c4069300 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e40c2580 0x7f94e41441b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 --2- 172.21.15.114:0/1594183666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94e40c1eb0 0x7f94e4142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:47.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 -- 172.21.15.114:0/1594183666 >> 172.21.15.114:0/1594183666 conn(0x7f94e40a8490 msgr2=0x7f94e406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:47.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 -- 172.21.15.114:0/1594183666 shutdown_connections 2024-02-17T12:17:47.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:47.969+0000 7f94e9000640 1 -- 172.21.15.114:0/1594183666 wait complete. 2024-02-17T12:17:47.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:48.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.121+0000 7f4e90c00640 1 Processor -- start 2024-02-17T12:17:48.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.121+0000 7f4e90c00640 1 -- start start 2024-02-17T12:17:48.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e90c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 0x7f4e8c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e90c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e8c0c1eb0 0x7f4e8c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e90c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c0a9420 con 0x7f4e8c0c2580 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e90c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c14f4f0 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e90c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c0aae80 con 0x7f4e8c14f110 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e8a800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e8c0c1eb0 0x7f4e8c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e89400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4e8c0c2580 0x7f4e8c0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55108/0 (socket says 172.21.15.114:55108) 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e89400640 1 -- 172.21.15.114:0/3784833330 learned_addr learned my addr 172.21.15.114:0/3784833330 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e89e00640 1 --2- 172.21.15.114:0/3784833330 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 0x7f4e8c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e8a800640 1 -- 172.21.15.114:0/3784833330 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 msgr2=0x7f4e8c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e8a800640 1 --2- 172.21.15.114:0/3784833330 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 0x7f4e8c0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e8a800640 1 -- 172.21.15.114:0/3784833330 >> v1:172.21.15.114:6789/0 conn(0x7f4e8c0c2580 legacy=0x7f4e8c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e8a800640 1 -- 172.21.15.114:0/3784833330 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c152850 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e88a00640 1 -- 172.21.15.114:0/3784833330 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048381422 0 0) 0x7f4e8c0a9420 con 0x7f4e8c0c2580 2024-02-17T12:17:48.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.125+0000 7f4e89e00640 1 --2- 172.21.15.114:0/3784833330 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 0x7f4e8c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:48.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e8a800640 1 --2- 172.21.15.114:0/3784833330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 0x7f4e8c15c390 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009d90 tx=0x7f4e8401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e68d3662eb2334 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:48.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e88a00640 1 -- 172.21.15.114:0/3784833330 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840a5970 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e88a00640 1 -- 172.21.15.114:0/3784833330 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e840a5ad0 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e88a00640 1 -- 172.21.15.114:0/3784833330 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840a5e60 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 -- 172.21.15.114:0/3784833330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 msgr2=0x7f4e8c15c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 --2- 172.21.15.114:0/3784833330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 0x7f4e8c15c390 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009d90 tx=0x7f4e8401c8b0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 -- 172.21.15.114:0/3784833330 shutdown_connections 2024-02-17T12:17:48.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 --2- 172.21.15.114:0/3784833330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 0x7f4e8c15c390 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 --2- 172.21.15.114:0/3784833330 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 0x7f4e8c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 -- 172.21.15.114:0/3784833330 >> 172.21.15.114:0/3784833330 conn(0x7f4e8c0a8490 msgr2=0x7f4e8c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:48.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 -- 172.21.15.114:0/3784833330 shutdown_connections 2024-02-17T12:17:48.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 -- 172.21.15.114:0/3784833330 wait complete. 2024-02-17T12:17:48.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 Processor -- start 2024-02-17T12:17:48.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 -- start start 2024-02-17T12:17:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 0x7f4e8c14b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e8c0c2580 0x7f4e8c13f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 0x7f4e8c13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c143a90 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c14f880 con 0x7f4e8c0c2580 2024-02-17T12:17:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.129+0000 7f4e90c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c14fe40 con 0x7f4e8c14f110 2024-02-17T12:17:48.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e89e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 0x7f4e8c14b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e89e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 0x7f4e8c14b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37238/0 (socket says 172.21.15.114:37238) 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e89e00640 1 -- 172.21.15.114:0/1459140772 learned_addr learned my addr 172.21.15.114:0/1459140772 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e89400640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e8c0c2580 0x7f4e8c13f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e8a800640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 0x7f4e8c13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e89e00640 1 -- 172.21.15.114:0/1459140772 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 msgr2=0x7f4e8c13fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e89e00640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 0x7f4e8c13fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e89e00640 1 -- 172.21.15.114:0/1459140772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e8c0c2580 msgr2=0x7f4e8c13f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e89e00640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e8c0c2580 0x7f4e8c13f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e89e00640 1 -- 172.21.15.114:0/1459140772 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e84009a70 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e89e00640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 0x7f4e8c14b8b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00e840 tx=0x7f4e7c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:48.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e82000640 1 -- 172.21.15.114:0/1459140772 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00c8d0 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e82000640 1 -- 172.21.15.114:0/1459140772 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c00ca30 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e90c00640 1 -- 172.21.15.114:0/1459140772 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c1403a0 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e82000640 1 -- 172.21.15.114:0/1459140772 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00cdc0 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e90c00640 1 -- 172.21.15.114:0/1459140772 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c14fad0 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e90c00640 1 -- 172.21.15.114:0/1459140772 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c074840 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e82000640 1 -- 172.21.15.114:0/1459140772 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4e7c013410 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.133+0000 7f4e82000640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e6c066e40 0x7f4e6c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.137+0000 7f4e82000640 1 -- 172.21.15.114:0/1459140772 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f4e7c084810 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.137+0000 7f4e89400640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e6c066e40 0x7f4e6c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.137+0000 7f4e89400640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e6c066e40 0x7f4e6c069300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c148e40 tx=0x7f4e78007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:48.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.141+0000 7f4e82000640 1 -- 172.21.15.114:0/1459140772 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4e7c051630 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.297+0000 7f4e90c00640 1 -- 172.21.15.114:0/1459140772 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e8c0c1380 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.297+0000 7f4e82000640 1 -- 172.21.15.114:0/1459140772 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16760 (secure 0 0 0) 0x7f4e7c009480 con 0x7f4e8c0c1eb0 2024-02-17T12:17:48.306 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:48.306 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":39,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:46.277697+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/1473468479":"2024-02-18T12:17:43.271319+0000","172.21.15.114:6835/1473468479":"2024-02-18T12:17:43.271319+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:48.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 -- 172.21.15.114:0/1459140772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e6c066e40 msgr2=0x7f4e6c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e6c066e40 0x7f4e6c069300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c148e40 tx=0x7f4e78007b60 comp rx=0 tx=0).stop 2024-02-17T12:17:48.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 -- 172.21.15.114:0/1459140772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 msgr2=0x7f4e8c14b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 0x7f4e8c14b8b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00e840 tx=0x7f4e7c00ed00 comp rx=0 tx=0).stop 2024-02-17T12:17:48.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 -- 172.21.15.114:0/1459140772 shutdown_connections 2024-02-17T12:17:48.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e8c14f110 0x7f4e8c13fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e8c0c2580 0x7f4e8c13f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e6c066e40 0x7f4e6c069300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 --2- 172.21.15.114:0/1459140772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e8c0c1eb0 0x7f4e8c14b8b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 -- 172.21.15.114:0/1459140772 >> 172.21.15.114:0/1459140772 conn(0x7f4e8c0a8490 msgr2=0x7f4e8c0722f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:48.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 -- 172.21.15.114:0/1459140772 shutdown_connections 2024-02-17T12:17:48.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.301+0000 7f4e90c00640 1 -- 172.21.15.114:0/1459140772 wait complete. 2024-02-17T12:17:48.328 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-02-17T12:17:48.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:48.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9236c00640 1 Processor -- start 2024-02-17T12:17:48.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9236c00640 1 -- start start 2024-02-17T12:17:48.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9236c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f923006db50 0x7f923014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9236c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9230150490 0x7f9230152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9236c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9230156270 con 0x7f92300c25a0 2024-02-17T12:17:48.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9236c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923006f090 con 0x7f9230150490 2024-02-17T12:17:48.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9236c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9230071630 con 0x7f923006db50 2024-02-17T12:17:48.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9234c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9230150490 0x7f9230152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9234c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9230150490 0x7f9230152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37254/0 (socket says 172.21.15.114:37254) 2024-02-17T12:17:48.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9234c00640 1 -- 172.21.15.114:0/1888470779 learned_addr learned my addr 172.21.15.114:0/1888470779 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:48.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f922f400640 1 --2- 172.21.15.114:0/1888470779 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f923006db50 0x7f923014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9234c00640 1 -- 172.21.15.114:0/1888470779 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f923006db50 msgr2=0x7f923014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:48.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9234c00640 1 --2- 172.21.15.114:0/1888470779 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f923006db50 0x7f923014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9234c00640 1 -- 172.21.15.114:0/1888470779 >> v1:172.21.15.116:6789/0 conn(0x7f92300c25a0 legacy=0x7f923006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.457+0000 7f9234c00640 1 -- 172.21.15.114:0/1888470779 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9230156550 con 0x7f9230150490 2024-02-17T12:17:48.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9234c00640 1 --2- 172.21.15.114:0/1888470779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 0x7f9230152c50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9228009e50 tx=0x7f922801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95674f640d7f83b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f922ea00640 1 -- 172.21.15.114:0/1888470779 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92301539a0 con 0x7f9230150490 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f922ea00640 1 -- 172.21.15.114:0/1888470779 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92280a57a0 con 0x7f9230150490 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f922ea00640 1 -- 172.21.15.114:0/1888470779 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280a5b30 con 0x7f9230150490 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9236c00640 1 -- 172.21.15.114:0/1888470779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 msgr2=0x7f9230152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9236c00640 1 --2- 172.21.15.114:0/1888470779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 0x7f9230152c50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9228009e50 tx=0x7f922801c8e0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9236c00640 1 -- 172.21.15.114:0/1888470779 shutdown_connections 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9236c00640 1 --2- 172.21.15.114:0/1888470779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 0x7f9230152c50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9236c00640 1 --2- 172.21.15.114:0/1888470779 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f923006db50 0x7f923014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9236c00640 1 -- 172.21.15.114:0/1888470779 >> 172.21.15.114:0/1888470779 conn(0x7f92300a8490 msgr2=0x7f92300a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9236c00640 1 -- 172.21.15.114:0/1888470779 shutdown_connections 2024-02-17T12:17:48.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9236c00640 1 -- 172.21.15.114:0/1888470779 wait complete. 2024-02-17T12:17:48.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9236c00640 1 Processor -- start 2024-02-17T12:17:48.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.461+0000 7f9236c00640 1 -- start start 2024-02-17T12:17:48.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9236c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f923006db50 0x7f9230147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9236c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f92300c25a0 0x7f92301548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9236c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 0x7f9230154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9236c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92300c5970 con 0x7f9230150490 2024-02-17T12:17:48.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9236c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92301f1420 con 0x7f923006db50 2024-02-17T12:17:48.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9236c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9230155590 con 0x7f92300c25a0 2024-02-17T12:17:48.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9234c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 0x7f9230154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9234c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 0x7f9230154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37264/0 (socket says 172.21.15.114:37264) 2024-02-17T12:17:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9234c00640 1 -- 172.21.15.114:0/2384870456 learned_addr learned my addr 172.21.15.114:0/2384870456 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f922f400640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f92300c25a0 0x7f92301548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f922fe00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f923006db50 0x7f9230147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9234c00640 1 -- 172.21.15.114:0/2384870456 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f92300c25a0 msgr2=0x7f92301548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9234c00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f92300c25a0 0x7f92301548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9234c00640 1 -- 172.21.15.114:0/2384870456 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f923006db50 msgr2=0x7f9230147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9234c00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f923006db50 0x7f9230147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9234c00640 1 -- 172.21.15.114:0/2384870456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9228009b30 con 0x7f9230150490 2024-02-17T12:17:48.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9234c00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 0x7f9230154df0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f92280af040 tx=0x7f9228019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:48.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9227e00640 1 -- 172.21.15.114:0/2384870456 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280b8670 con 0x7f9230150490 2024-02-17T12:17:48.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9227e00640 1 -- 172.21.15.114:0/2384870456 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92280b87d0 con 0x7f9230150490 2024-02-17T12:17:48.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9236c00640 1 -- 172.21.15.114:0/2384870456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92301f1140 con 0x7f9230150490 2024-02-17T12:17:48.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9227e00640 1 -- 172.21.15.114:0/2384870456 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92280b8b60 con 0x7f9230150490 2024-02-17T12:17:48.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9236c00640 1 -- 172.21.15.114:0/2384870456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9230155b10 con 0x7f9230150490 2024-02-17T12:17:48.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9236c00640 1 -- 172.21.15.114:0/2384870456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92301553f0 con 0x7f9230150490 2024-02-17T12:17:48.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.465+0000 7f9227e00640 1 -- 172.21.15.114:0/2384870456 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f92280b8cc0 con 0x7f9230150490 2024-02-17T12:17:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.469+0000 7f9227e00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9210066e40 0x7f9210069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.469+0000 7f9227e00640 1 -- 172.21.15.114:0/2384870456 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f92281200d0 con 0x7f9230150490 2024-02-17T12:17:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.469+0000 7f922fe00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9210066e40 0x7f9210069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.469+0000 7f922fe00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9210066e40 0x7f9210069300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9220000f70 tx=0x7f9220009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:48.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.473+0000 7f9227e00640 1 -- 172.21.15.114:0/2384870456 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f92301553f0 con 0x7f9230150490 2024-02-17T12:17:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.657+0000 7f9236c00640 1 -- 172.21.15.114:0/2384870456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92300c4340 con 0x7f9230150490 2024-02-17T12:17:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9227e00640 1 -- 172.21.15.114:0/2384870456 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f92300c4340 con 0x7f9230150490 2024-02-17T12:17:48.668 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:48.668 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5535,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4030579941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4030579941},{"type":"v1","addr":"172.21.15.114:6837","nonce":4030579941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:22.698504+0000","modified":"2024-02-17T12:17:25.708127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4941},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4941":{"gid":4941,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/2833741536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2833741536},{"type":"v1","addr":"172.21.15.114:6836","nonce":2833741536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-02-17T12:17:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-02-17T12:17:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 -- 172.21.15.114:0/2384870456 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9210066e40 msgr2=0x7f9210069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9210066e40 0x7f9210069300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9220000f70 tx=0x7f9220009040 comp rx=0 tx=0).stop 2024-02-17T12:17:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 -- 172.21.15.114:0/2384870456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 msgr2=0x7f9230154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 0x7f9230154df0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f92280af040 tx=0x7f9228019680 comp rx=0 tx=0).stop 2024-02-17T12:17:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 -- 172.21.15.114:0/2384870456 shutdown_connections 2024-02-17T12:17:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9210066e40 0x7f9210069300 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9230150490 0x7f9230154df0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f92300c25a0 0x7f92301548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 --2- 172.21.15.114:0/2384870456 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f923006db50 0x7f9230147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 -- 172.21.15.114:0/2384870456 >> 172.21.15.114:0/2384870456 conn(0x7f92300a8490 msgr2=0x7f9230072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 -- 172.21.15.114:0/2384870456 shutdown_connections 2024-02-17T12:17:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.661+0000 7f9236c00640 1 -- 172.21.15.114:0/2384870456 wait complete. 2024-02-17T12:17:48.688 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:48.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.813+0000 7f141f200640 1 Processor -- start 2024-02-17T12:17:48.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141f200640 1 -- start start 2024-02-17T12:17:48.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141f200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f142006fdc0 0x7f1420152d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141f200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1420070c60 con 0x7f14200c2620 2024-02-17T12:17:48.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141f200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1420070370 con 0x7f1420150190 2024-02-17T12:17:48.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141f200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1420070610 con 0x7f142006fdc0 2024-02-17T12:17:48.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141e800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f14200c2620 0x7f14201532c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55116/0 (socket says 172.21.15.114:55116) 2024-02-17T12:17:48.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141e800640 1 -- 172.21.15.114:0/2345312902 learned_addr learned my addr 172.21.15.114:0/2345312902 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:48.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141d400640 1 --2- 172.21.15.114:0/2345312902 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f142006fdc0 0x7f1420152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141ca00640 1 -- 172.21.15.114:0/2345312902 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712353770 0 0) 0x7f1420070c60 con 0x7f14200c2620 2024-02-17T12:17:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141ca00640 1 -- 172.21.15.114:0/2345312902 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1404003530 con 0x7f14200c2620 2024-02-17T12:17:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141ca00640 1 -- 172.21.15.114:0/2345312902 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087476645 0 0) 0x7f1420070370 con 0x7f1420150190 2024-02-17T12:17:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141ca00640 1 -- 172.21.15.114:0/2345312902 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1420070c60 con 0x7f1420150190 2024-02-17T12:17:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141d400640 1 -- 172.21.15.114:0/2345312902 >> v1:172.21.15.116:6789/0 conn(0x7f1420150190 legacy=0x7f14200aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141d400640 1 -- 172.21.15.114:0/2345312902 >> v1:172.21.15.114:6789/0 conn(0x7f14200c2620 legacy=0x7f14201532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.817+0000 7f141d400640 1 -- 172.21.15.114:0/2345312902 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200708f0 con 0x7f142006fdc0 2024-02-17T12:17:48.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141d400640 1 --2- 172.21.15.114:0/2345312902 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f142006fdc0 0x7f1420152d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f140c0097f0 tx=0x7f140c01ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd662502447a6dd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:48.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141ca00640 1 -- 172.21.15.114:0/2345312902 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c0ad660 con 0x7f142006fdc0 2024-02-17T12:17:48.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141ca00640 1 -- 172.21.15.114:0/2345312902 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c0ad7c0 con 0x7f142006fdc0 2024-02-17T12:17:48.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141ca00640 1 -- 172.21.15.114:0/2345312902 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c0adb50 con 0x7f142006fdc0 2024-02-17T12:17:48.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141f200640 1 -- 172.21.15.114:0/2345312902 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f142006fdc0 msgr2=0x7f1420152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141f200640 1 --2- 172.21.15.114:0/2345312902 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f142006fdc0 0x7f1420152d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f140c0097f0 tx=0x7f140c01ceb0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141f200640 1 -- 172.21.15.114:0/2345312902 shutdown_connections 2024-02-17T12:17:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141f200640 1 --2- 172.21.15.114:0/2345312902 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f142006fdc0 0x7f1420152d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141f200640 1 -- 172.21.15.114:0/2345312902 >> 172.21.15.114:0/2345312902 conn(0x7f142006ed70 msgr2=0x7f142006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141f200640 1 -- 172.21.15.114:0/2345312902 shutdown_connections 2024-02-17T12:17:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141f200640 1 -- 172.21.15.114:0/2345312902 wait complete. 2024-02-17T12:17:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141f200640 1 Processor -- start 2024-02-17T12:17:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.821+0000 7f141f200640 1 -- start start 2024-02-17T12:17:48.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142006fdc0 0x7f14200a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141f200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14200c2620 0x7f14201eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141f200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1420150190 0x7f1420150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1420157190 con 0x7f142006fdc0 2024-02-17T12:17:48.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141f200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1420151f00 con 0x7f14200c2620 2024-02-17T12:17:48.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141f200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14200a9000 con 0x7f1420150190 2024-02-17T12:17:48.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142006fdc0 0x7f14200a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142006fdc0 0x7f14200a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37272/0 (socket says 172.21.15.114:37272) 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141de00640 1 -- 172.21.15.114:0/3499965759 learned_addr learned my addr 172.21.15.114:0/3499965759 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141e800640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1420150190 0x7f1420150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141d400640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14200c2620 0x7f14201eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141de00640 1 -- 172.21.15.114:0/3499965759 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1420150190 msgr2=0x7f1420150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141de00640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1420150190 0x7f1420150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141de00640 1 -- 172.21.15.114:0/3499965759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14200c2620 msgr2=0x7f14201eebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141de00640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14200c2620 0x7f14201eebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141de00640 1 -- 172.21.15.114:0/3499965759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c009420 con 0x7f142006fdc0 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141de00640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142006fdc0 0x7f14200a9490 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f141000c7d0 tx=0x7f141000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f1416000640 1 -- 172.21.15.114:0/3499965759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410003b80 con 0x7f142006fdc0 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f1416000640 1 -- 172.21.15.114:0/3499965759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410003d00 con 0x7f142006fdc0 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141f200640 1 -- 172.21.15.114:0/3499965759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1420148ad0 con 0x7f142006fdc0 2024-02-17T12:17:48.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f1416000640 1 -- 172.21.15.114:0/3499965759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141000aa90 con 0x7f142006fdc0 2024-02-17T12:17:48.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141f200640 1 -- 172.21.15.114:0/3499965759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14201487f0 con 0x7f142006fdc0 2024-02-17T12:17:48.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.825+0000 7f141f200640 1 -- 172.21.15.114:0/3499965759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1420068180 con 0x7f142006fdc0 2024-02-17T12:17:48.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.829+0000 7f1416000640 1 -- 172.21.15.114:0/3499965759 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f141000abf0 con 0x7f142006fdc0 2024-02-17T12:17:48.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.829+0000 7f1416000640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1400066e70 0x7f1400069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:48.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.829+0000 7f1416000640 1 -- 172.21.15.114:0/3499965759 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f14100847b0 con 0x7f142006fdc0 2024-02-17T12:17:48.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.829+0000 7f141d400640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1400066e70 0x7f1400069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:48.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.829+0000 7f141d400640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1400066e70 0x7f1400069330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f140c0af000 tx=0x7f140c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:48.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:48.833+0000 7f1416000640 1 -- 172.21.15.114:0/3499965759 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f14100515e0 con 0x7f142006fdc0 2024-02-17T12:17:49.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.017+0000 7f141f200640 1 -- 172.21.15.114:0/3499965759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f142004eef0 con 0x7f142006fdc0 2024-02-17T12:17:49.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f1416000640 1 -- 172.21.15.114:0/3499965759 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f1410054ca0 con 0x7f142006fdc0 2024-02-17T12:17:49.027 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:49.027 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5535,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4030579941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4030579941},{"type":"v1","addr":"172.21.15.114:6837","nonce":4030579941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:17:22.698504+0000","modified":"2024-02-17T12:17:25.708127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4941},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4941":{"gid":4941,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6836/2833741536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2833741536},{"type":"v1","addr":"172.21.15.114:6836","nonce":2833741536}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-02-17T12:17:49.028 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 24 2024-02-17T12:17:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 -- 172.21.15.114:0/3499965759 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1400066e70 msgr2=0x7f1400069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1400066e70 0x7f1400069330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f140c0af000 tx=0x7f140c008040 comp rx=0 tx=0).stop 2024-02-17T12:17:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 -- 172.21.15.114:0/3499965759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142006fdc0 msgr2=0x7f14200a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142006fdc0 0x7f14200a9490 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f141000c7d0 tx=0x7f141000cc90 comp rx=0 tx=0).stop 2024-02-17T12:17:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 -- 172.21.15.114:0/3499965759 shutdown_connections 2024-02-17T12:17:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1420150190 0x7f1420150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14200c2620 0x7f14201eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1400066e70 0x7f1400069330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 --2- 172.21.15.114:0/3499965759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142006fdc0 0x7f14200a9490 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 -- 172.21.15.114:0/3499965759 >> 172.21.15.114:0/3499965759 conn(0x7f142006ed70 msgr2=0x7f142014d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:49.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 -- 172.21.15.114:0/3499965759 shutdown_connections 2024-02-17T12:17:49.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.021+0000 7f141f200640 1 -- 172.21.15.114:0/3499965759 wait complete. 2024-02-17T12:17:49.048 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:49.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.173+0000 7f879ee00640 1 Processor -- start 2024-02-17T12:17:49.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.173+0000 7f879ee00640 1 -- start start 2024-02-17T12:17:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ee00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f879814f110 0x7f87980c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ee00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87980c1eb0 0x7f879815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ee00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87980a9420 con 0x7f87980c2580 2024-02-17T12:17:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ee00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879814f4f0 con 0x7f87980c1eb0 2024-02-17T12:17:49.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ee00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980aae80 con 0x7f879814f110 2024-02-17T12:17:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87980c1eb0 0x7f879815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87980c1eb0 0x7f879815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37276/0 (socket says 172.21.15.114:37276) 2024-02-17T12:17:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ce00640 1 -- 172.21.15.114:0/3403981752 learned_addr learned my addr 172.21.15.114:0/3403981752 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f8797e00640 1 --2- 172.21.15.114:0/3403981752 >> v2:172.21.15.116:3300/0 conn(0x7f879814f110 0x7f87980c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ce00640 1 -- 172.21.15.114:0/3403981752 >> v2:172.21.15.116:3300/0 conn(0x7f879814f110 msgr2=0x7f87980c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ce00640 1 --2- 172.21.15.114:0/3403981752 >> v2:172.21.15.116:3300/0 conn(0x7f879814f110 0x7f87980c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ce00640 1 -- 172.21.15.114:0/3403981752 >> v1:172.21.15.116:6789/0 conn(0x7f87980c2580 legacy=0x7f87980aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f879ce00640 1 -- 172.21.15.114:0/3403981752 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8798152850 con 0x7f87980c1eb0 2024-02-17T12:17:49.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.177+0000 7f8797e00640 1 --2- 172.21.15.114:0/3403981752 >> v2:172.21.15.116:3300/0 conn(0x7f879814f110 0x7f87980c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ce00640 1 --2- 172.21.15.114:0/3403981752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87980c1eb0 0x7f879815c390 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f879806dc70 tx=0x7f879001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787bfb334563bb38 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f8796a00640 1 -- 172.21.15.114:0/3403981752 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900ab620 con 0x7f87980c1eb0 2024-02-17T12:17:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f8796a00640 1 -- 172.21.15.114:0/3403981752 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87900ab780 con 0x7f87980c1eb0 2024-02-17T12:17:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f8796a00640 1 -- 172.21.15.114:0/3403981752 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900abb10 con 0x7f87980c1eb0 2024-02-17T12:17:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 -- 172.21.15.114:0/3403981752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87980c1eb0 msgr2=0x7f879815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 --2- 172.21.15.114:0/3403981752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87980c1eb0 0x7f879815c390 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f879806dc70 tx=0x7f879001c420 comp rx=0 tx=0).stop 2024-02-17T12:17:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 -- 172.21.15.114:0/3403981752 shutdown_connections 2024-02-17T12:17:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 --2- 172.21.15.114:0/3403981752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87980c1eb0 0x7f879815c390 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 --2- 172.21.15.114:0/3403981752 >> v2:172.21.15.116:3300/0 conn(0x7f879814f110 0x7f87980c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 -- 172.21.15.114:0/3403981752 >> 172.21.15.114:0/3403981752 conn(0x7f87980a8490 msgr2=0x7f87980a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 -- 172.21.15.114:0/3403981752 shutdown_connections 2024-02-17T12:17:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 -- 172.21.15.114:0/3403981752 wait complete. 2024-02-17T12:17:49.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 Processor -- start 2024-02-17T12:17:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 -- start start 2024-02-17T12:17:49.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87980c1eb0 0x7f87980c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.181+0000 7f879ee00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87980c2580 0x7f87980c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879814f110 0x7f879814d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879814cae0 con 0x7f879814f110 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ee00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879814cdc0 con 0x7f87980c1eb0 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ee00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879814d0a0 con 0x7f87980c2580 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879814f110 0x7f879814d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879814f110 0x7f879814d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37284/0 (socket says 172.21.15.114:37284) 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ce00640 1 -- 172.21.15.114:0/331389259 learned_addr learned my addr 172.21.15.114:0/331389259 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f8797e00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87980c1eb0 0x7f87980c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f8797400640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87980c2580 0x7f87980c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ce00640 1 -- 172.21.15.114:0/331389259 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87980c2580 msgr2=0x7f87980c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ce00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87980c2580 0x7f87980c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ce00640 1 -- 172.21.15.114:0/331389259 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87980c1eb0 msgr2=0x7f87980c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ce00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87980c1eb0 0x7f87980c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ce00640 1 -- 172.21.15.114:0/331389259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900094d0 con 0x7f879814f110 2024-02-17T12:17:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f8797e00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87980c1eb0 0x7f87980c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ce00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879814f110 0x7f879814d8a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f87900ad040 tx=0x7f879001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f878fe00640 1 -- 172.21.15.114:0/331389259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900be3f0 con 0x7f879814f110 2024-02-17T12:17:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f878fe00640 1 -- 172.21.15.114:0/331389259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87900be570 con 0x7f879814f110 2024-02-17T12:17:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ee00640 1 -- 172.21.15.114:0/331389259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879814d380 con 0x7f879814f110 2024-02-17T12:17:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f878fe00640 1 -- 172.21.15.114:0/331389259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900be920 con 0x7f879814f110 2024-02-17T12:17:49.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ee00640 1 -- 172.21.15.114:0/331389259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8798149670 con 0x7f879814f110 2024-02-17T12:17:49.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f879ee00640 1 -- 172.21.15.114:0/331389259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879814d5c0 con 0x7f879814f110 2024-02-17T12:17:49.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f878fe00640 1 -- 172.21.15.114:0/331389259 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f87900b43f0 con 0x7f879814f110 2024-02-17T12:17:49.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.185+0000 7f878fe00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8778066e70 0x7f8778069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.189+0000 7f878fe00640 1 -- 172.21.15.114:0/331389259 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f879011eef0 con 0x7f879814f110 2024-02-17T12:17:49.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.189+0000 7f8797e00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8778066e70 0x7f8778069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.189+0000 7f8797e00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8778066e70 0x7f8778069330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f878800e550 tx=0x7f8788007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:49.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.189+0000 7f878fe00640 1 -- 172.21.15.114:0/331389259 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f879814d5c0 con 0x7f879814f110 2024-02-17T12:17:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 -- 172.21.15.114:0/331389259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f879814d5c0 con 0x7f879814f110 2024-02-17T12:17:49.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f878fe00640 1 -- 172.21.15.114:0/331389259 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16760 (secure 0 0 0) 0x7f879814d5c0 con 0x7f879814f110 2024-02-17T12:17:49.356 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:49.357 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":39,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:46.277697+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:17:20.859567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:17:21.688611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/1473468479":"2024-02-18T12:17:43.271319+0000","172.21.15.114:6835/1473468479":"2024-02-18T12:17:43.271319+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:49.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 -- 172.21.15.114:0/331389259 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8778066e70 msgr2=0x7f8778069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8778066e70 0x7f8778069330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f878800e550 tx=0x7f8788007ab0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 -- 172.21.15.114:0/331389259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879814f110 msgr2=0x7f879814d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879814f110 0x7f879814d8a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f87900ad040 tx=0x7f879001ac60 comp rx=0 tx=0).stop 2024-02-17T12:17:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 -- 172.21.15.114:0/331389259 shutdown_connections 2024-02-17T12:17:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8778066e70 0x7f8778069330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f879814f110 0x7f879814d8a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87980c2580 0x7f87980c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 --2- 172.21.15.114:0/331389259 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f87980c1eb0 0x7f87980c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 -- 172.21.15.114:0/331389259 >> 172.21.15.114:0/331389259 conn(0x7f87980a8490 msgr2=0x7f87980bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:49.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 -- 172.21.15.114:0/331389259 shutdown_connections 2024-02-17T12:17:49.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.349+0000 7f879ee00640 1 -- 172.21.15.114:0/331389259 wait complete. 2024-02-17T12:17:49.377 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-02-17T12:17:49.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f521aa00640 1 Processor -- start 2024-02-17T12:17:49.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f521aa00640 1 -- start start 2024-02-17T12:17:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f521aa00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f521406db50 0x7f521414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f521aa00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5214156270 con 0x7f5214150490 2024-02-17T12:17:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f521aa00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5214156550 con 0x7f52140c25a0 2024-02-17T12:17:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f521aa00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521406f090 con 0x7f521406db50 2024-02-17T12:17:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f5218a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5214150490 0x7f5214152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55130/0 (socket says 172.21.15.114:55130) 2024-02-17T12:17:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f5218a00640 1 -- 172.21.15.114:0/94886656 learned_addr learned my addr 172.21.15.114:0/94886656 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:49.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f5213400640 1 --2- 172.21.15.114:0/94886656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f521406db50 0x7f521414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f5212a00640 1 -- 172.21.15.114:0/94886656 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107728669 0 0) 0x7f5214156270 con 0x7f5214150490 2024-02-17T12:17:49.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f5212a00640 1 -- 172.21.15.114:0/94886656 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f8003530 con 0x7f5214150490 2024-02-17T12:17:49.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f5212a00640 1 -- 172.21.15.114:0/94886656 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769688754 0 0) 0x7f5214156550 con 0x7f52140c25a0 2024-02-17T12:17:49.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f5212a00640 1 -- 172.21.15.114:0/94886656 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5214156270 con 0x7f52140c25a0 2024-02-17T12:17:49.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f5213400640 1 -- 172.21.15.114:0/94886656 >> v1:172.21.15.116:6789/0 conn(0x7f52140c25a0 legacy=0x7f521406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f5213400640 1 -- 172.21.15.114:0/94886656 >> v1:172.21.15.114:6789/0 conn(0x7f5214150490 legacy=0x7f5214152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.505+0000 7f5213400640 1 -- 172.21.15.114:0/94886656 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5214156830 con 0x7f521406db50 2024-02-17T12:17:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f5213400640 1 --2- 172.21.15.114:0/94886656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f521406db50 0x7f521414ff50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0097f0 tx=0x7f51fc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8faebb0372373870 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f5212a00640 1 -- 172.21.15.114:0/94886656 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0ab600 con 0x7f521406db50 2024-02-17T12:17:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f5212a00640 1 -- 172.21.15.114:0/94886656 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc0a7050 con 0x7f521406db50 2024-02-17T12:17:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f5212a00640 1 -- 172.21.15.114:0/94886656 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0ab980 con 0x7f521406db50 2024-02-17T12:17:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f521aa00640 1 -- 172.21.15.114:0/94886656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f521406db50 msgr2=0x7f521414ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f521aa00640 1 --2- 172.21.15.114:0/94886656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f521406db50 0x7f521414ff50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0097f0 tx=0x7f51fc01c3c0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f521aa00640 1 -- 172.21.15.114:0/94886656 shutdown_connections 2024-02-17T12:17:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f521aa00640 1 --2- 172.21.15.114:0/94886656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f521406db50 0x7f521414ff50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f521aa00640 1 -- 172.21.15.114:0/94886656 >> 172.21.15.114:0/94886656 conn(0x7f52140a8490 msgr2=0x7f52140a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f521aa00640 1 -- 172.21.15.114:0/94886656 shutdown_connections 2024-02-17T12:17:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.509+0000 7f521aa00640 1 -- 172.21.15.114:0/94886656 wait complete. 2024-02-17T12:17:49.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f521aa00640 1 Processor -- start 2024-02-17T12:17:49.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f521aa00640 1 -- start start 2024-02-17T12:17:49.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f521aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f521406db50 0x7f52140c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f521aa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52140c25a0 0x7f52141edc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f521aa00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5214150490 0x7f52140aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f521aa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521413d0b0 con 0x7f521406db50 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f521aa00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52141ed7b0 con 0x7f52140c25a0 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f521aa00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521413ff80 con 0x7f5214150490 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5213e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f521406db50 0x7f52140c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5213e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f521406db50 0x7f52140c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37290/0 (socket says 172.21.15.114:37290) 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5213e00640 1 -- 172.21.15.114:0/3223078054 learned_addr learned my addr 172.21.15.114:0/3223078054 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5213400640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52140c25a0 0x7f52141edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5218a00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5214150490 0x7f52140aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5213e00640 1 -- 172.21.15.114:0/3223078054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5214150490 msgr2=0x7f52140aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5213e00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5214150490 0x7f52140aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5213e00640 1 -- 172.21.15.114:0/3223078054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52140c25a0 msgr2=0x7f52141edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5213e00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52140c25a0 0x7f52141edc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5213e00640 1 -- 172.21.15.114:0/3223078054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc009420 con 0x7f521406db50 2024-02-17T12:17:49.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f5213e00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f521406db50 0x7f52140c3280 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f520400c800 tx=0x7f520400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:49.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f520be00640 1 -- 172.21.15.114:0/3223078054 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204003b80 con 0x7f521406db50 2024-02-17T12:17:49.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f520be00640 1 -- 172.21.15.114:0/3223078054 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204003d00 con 0x7f521406db50 2024-02-17T12:17:49.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f520be00640 1 -- 172.21.15.114:0/3223078054 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520400aa90 con 0x7f521406db50 2024-02-17T12:17:49.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f521aa00640 1 -- 172.21.15.114:0/3223078054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521413c7d0 con 0x7f521406db50 2024-02-17T12:17:49.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.513+0000 7f521aa00640 1 -- 172.21.15.114:0/3223078054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52140c37c0 con 0x7f521406db50 2024-02-17T12:17:49.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.517+0000 7f521aa00640 1 -- 172.21.15.114:0/3223078054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521413ccf0 con 0x7f521406db50 2024-02-17T12:17:49.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.517+0000 7f520be00640 1 -- 172.21.15.114:0/3223078054 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f520400abf0 con 0x7f521406db50 2024-02-17T12:17:49.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.517+0000 7f520be00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f51f0066e70 0x7f51f0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.517+0000 7f520be00640 1 -- 172.21.15.114:0/3223078054 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f5204084920 con 0x7f521406db50 2024-02-17T12:17:49.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.517+0000 7f5213400640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f51f0066e70 0x7f51f0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.517+0000 7f5213400640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f51f0066e70 0x7f51f0069330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0ad000 tx=0x7f51fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:49.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.521+0000 7f520be00640 1 -- 172.21.15.114:0/3223078054 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f52040516d0 con 0x7f521406db50 2024-02-17T12:17:49.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.705+0000 7f521aa00640 1 -- 172.21.15.114:0/3223078054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f52141ed5a0 con 0x7f521406db50 2024-02-17T12:17:49.715 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-02-17T12:17:49.705+0000 7f5091a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-17T12:17:49.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.709+0000 7f520be00640 1 -- 172.21.15.114:0/3223078054 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7f5204084070 con 0x7f521406db50 2024-02-17T12:17:49.717 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-17T12:17:49.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.709+0000 7f521aa00640 1 -- 172.21.15.114:0/3223078054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f51f0066e70 msgr2=0x7f51f0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.709+0000 7f521aa00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f51f0066e70 0x7f51f0069330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0ad000 tx=0x7f51fc008040 comp rx=0 tx=0).stop 2024-02-17T12:17:49.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.713+0000 7f521aa00640 1 -- 172.21.15.114:0/3223078054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f521406db50 msgr2=0x7f52140c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.713+0000 7f521aa00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f521406db50 0x7f52140c3280 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f520400c800 tx=0x7f520400ccc0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.713+0000 7f521aa00640 1 -- 172.21.15.114:0/3223078054 shutdown_connections 2024-02-17T12:17:49.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.713+0000 7f521aa00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5214150490 0x7f52140aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.713+0000 7f521aa00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52140c25a0 0x7f52141edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.713+0000 7f521aa00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f51f0066e70 0x7f51f0069330 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.713+0000 7f521aa00640 1 --2- 172.21.15.114:0/3223078054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f521406db50 0x7f52140c3280 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.713+0000 7f521aa00640 1 -- 172.21.15.114:0/3223078054 >> 172.21.15.114:0/3223078054 conn(0x7f52140a8490 msgr2=0x7f5214141080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:49.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.713+0000 7f521aa00640 1 -- 172.21.15.114:0/3223078054 shutdown_connections 2024-02-17T12:17:49.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.713+0000 7f521aa00640 1 -- 172.21.15.114:0/3223078054 wait complete. 2024-02-17T12:17:49.725 INFO:tasks.ceph.mds.a.smithi114.stderr: -2136> 2024-02-17T12:17:25.826+0000 7f0b5fc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:17:49.741 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-02-17T12:17:49.770 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-02-17T12:17:49.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.873+0000 7fdd1cc00640 1 Processor -- start 2024-02-17T12:17:49.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.873+0000 7fdd1cc00640 1 -- start start 2024-02-17T12:17:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.873+0000 7fdd1cc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd180c2580 0x7fdd180aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.873+0000 7fdd1cc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd180a9420 con 0x7fdd180c1eb0 2024-02-17T12:17:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.873+0000 7fdd1cc00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd18152850 con 0x7fdd1814f110 2024-02-17T12:17:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.873+0000 7fdd1cc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1814f4f0 con 0x7fdd180c2580 2024-02-17T12:17:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.873+0000 7fdd16800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdd180c1eb0 0x7fdd1815c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55138/0 (socket says 172.21.15.114:55138) 2024-02-17T12:17:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.873+0000 7fdd15400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd180c2580 0x7fdd180aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.873+0000 7fdd16800640 1 -- 172.21.15.114:0/1188639412 learned_addr learned my addr 172.21.15.114:0/1188639412 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:49.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd14a00640 1 -- 172.21.15.114:0/1188639412 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323616413 0 0) 0x7fdd180a9420 con 0x7fdd180c1eb0 2024-02-17T12:17:49.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd14a00640 1 -- 172.21.15.114:0/1188639412 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcfc003530 con 0x7fdd180c1eb0 2024-02-17T12:17:49.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd14a00640 1 -- 172.21.15.114:0/1188639412 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969831880 0 0) 0x7fdd18152850 con 0x7fdd1814f110 2024-02-17T12:17:49.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd15400640 1 -- 172.21.15.114:0/1188639412 >> v1:172.21.15.116:6789/0 conn(0x7fdd1814f110 legacy=0x7fdd180c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd15400640 1 -- 172.21.15.114:0/1188639412 >> v1:172.21.15.114:6789/0 conn(0x7fdd180c1eb0 legacy=0x7fdd1815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd15400640 1 -- 172.21.15.114:0/1188639412 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180a9670 con 0x7fdd180c2580 2024-02-17T12:17:49.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd15400640 1 --2- 172.21.15.114:0/1188639412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd180c2580 0x7fdd180aa150 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdd040097c0 tx=0x7fdd0401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd33f23ae627b49 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:49.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd14a00640 1 -- 172.21.15.114:0/1188639412 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040ab600 con 0x7fdd180c2580 2024-02-17T12:17:49.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd14a00640 1 -- 172.21.15.114:0/1188639412 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040a7050 con 0x7fdd180c2580 2024-02-17T12:17:49.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd14a00640 1 -- 172.21.15.114:0/1188639412 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040ab980 con 0x7fdd180c2580 2024-02-17T12:17:49.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.877+0000 7fdd1cc00640 1 -- 172.21.15.114:0/1188639412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd180c2580 msgr2=0x7fdd180aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 --2- 172.21.15.114:0/1188639412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd180c2580 0x7fdd180aa150 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdd040097c0 tx=0x7fdd0401c410 comp rx=0 tx=0).stop 2024-02-17T12:17:49.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 -- 172.21.15.114:0/1188639412 shutdown_connections 2024-02-17T12:17:49.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 --2- 172.21.15.114:0/1188639412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd180c2580 0x7fdd180aa150 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 -- 172.21.15.114:0/1188639412 >> 172.21.15.114:0/1188639412 conn(0x7fdd180a8490 msgr2=0x7fdd180a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:49.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 -- 172.21.15.114:0/1188639412 shutdown_connections 2024-02-17T12:17:49.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 -- 172.21.15.114:0/1188639412 wait complete. 2024-02-17T12:17:49.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 Processor -- start 2024-02-17T12:17:49.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 -- start start 2024-02-17T12:17:49.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd180c1eb0 0x7fdd181f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd180c2580 0x7fdd1813f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1814f110 0x7fdd181493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181f19d0 con 0x7fdd1814f110 2024-02-17T12:17:49.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18151370 con 0x7fdd180c1eb0 2024-02-17T12:17:49.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1813fe90 con 0x7fdd180c2580 2024-02-17T12:17:49.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd16800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1814f110 0x7fdd181493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd16800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1814f110 0x7fdd181493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37326/0 (socket says 172.21.15.114:37326) 2024-02-17T12:17:49.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd16800640 1 -- 172.21.15.114:0/787620123 learned_addr learned my addr 172.21.15.114:0/787620123 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd15e00640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd180c1eb0 0x7fdd181f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd15400640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd180c2580 0x7fdd1813f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd16800640 1 -- 172.21.15.114:0/787620123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd180c2580 msgr2=0x7fdd1813f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd16800640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd180c2580 0x7fdd1813f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd16800640 1 -- 172.21.15.114:0/787620123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd180c1eb0 msgr2=0x7fdd181f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd16800640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd180c1eb0 0x7fdd181f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd16800640 1 -- 172.21.15.114:0/787620123 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04009420 con 0x7fdd1814f110 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd16800640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1814f110 0x7fdd181493c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000cb40 tx=0x7fdd1000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd0e000640 1 -- 172.21.15.114:0/787620123 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000abe0 con 0x7fdd1814f110 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd0e000640 1 -- 172.21.15.114:0/787620123 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1000ad40 con 0x7fdd1814f110 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd0e000640 1 -- 172.21.15.114:0/787620123 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10012620 con 0x7fdd1814f110 2024-02-17T12:17:49.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.881+0000 7fdd1cc00640 1 -- 172.21.15.114:0/787620123 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd181ede60 con 0x7fdd1814f110 2024-02-17T12:17:49.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.885+0000 7fdd1cc00640 1 -- 172.21.15.114:0/787620123 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1814b290 con 0x7fdd1814f110 2024-02-17T12:17:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.885+0000 7fdd1cc00640 1 -- 172.21.15.114:0/787620123 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd181514e0 con 0x7fdd1814f110 2024-02-17T12:17:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.885+0000 7fdd0e000640 1 -- 172.21.15.114:0/787620123 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fdd10007070 con 0x7fdd1814f110 2024-02-17T12:17:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.885+0000 7fdd0e000640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 0x7fdcf8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.885+0000 7fdd0e000640 1 -- 172.21.15.114:0/787620123 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fdd10084970 con 0x7fdd1814f110 2024-02-17T12:17:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.885+0000 7fdd15e00640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 0x7fdcf8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:49.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.885+0000 7fdd15e00640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 0x7fdcf8069300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdd18150980 tx=0x7fdd08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:49.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:49.889+0000 7fdd0e000640 1 -- 172.21.15.114:0/787620123 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd181514e0 con 0x7fdd1814f110 2024-02-17T12:17:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.077+0000 7fdd1cc00640 1 -- 172.21.15.114:0/787620123 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdd181514e0 con 0x7fdd1814f110 2024-02-17T12:17:50.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd0e000640 1 -- 172.21.15.114:0/787620123 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 105+0+0 (secure 0 0 0) 0x7fdd181514e0 con 0x7fdd1814f110 2024-02-17T12:17:50.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 -- 172.21.15.114:0/787620123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 msgr2=0x7fdcf8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 0x7fdcf8069300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdd18150980 tx=0x7fdd08009040 comp rx=0 tx=0).stop 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 -- 172.21.15.114:0/787620123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1814f110 msgr2=0x7fdd181493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1814f110 0x7fdd181493c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdd1000cb40 tx=0x7fdd1000a060 comp rx=0 tx=0).stop 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 -- 172.21.15.114:0/787620123 shutdown_connections 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdcf8066e40 0x7fdcf8069300 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd1814f110 0x7fdd181493c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd180c2580 0x7fdd1813f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 --2- 172.21.15.114:0/787620123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd180c1eb0 0x7fdd181f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 -- 172.21.15.114:0/787620123 >> 172.21.15.114:0/787620123 conn(0x7fdd180a8490 msgr2=0x7fdd180c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 -- 172.21.15.114:0/787620123 shutdown_connections 2024-02-17T12:17:50.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.713+0000 7fdd1cc00640 1 -- 172.21.15.114:0/787620123 wait complete. 2024-02-17T12:17:50.743 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-02-17T12:17:50.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f3b400640 1 Processor -- start 2024-02-17T12:17:50.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f3b400640 1 -- start start 2024-02-17T12:17:50.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f3b400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340c38e0 0x7f8f3406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:50.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f3b400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8f340a6590 0x7f8f340a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:50.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f3b400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f34153640 con 0x7f8f340a7020 2024-02-17T12:17:50.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f3b400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f340c3cc0 con 0x7f8f340a6590 2024-02-17T12:17:50.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f3b400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f341506a0 con 0x7f8f340c38e0 2024-02-17T12:17:50.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f33e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8f340a6590 0x7f8f340a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:50.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f38a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340c38e0 0x7f8f3406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:50.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f33e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8f340a6590 0x7f8f340a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:48700/0 (socket says 172.21.15.114:48700) 2024-02-17T12:17:50.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f33e00640 1 -- 172.21.15.114:0/1232362775 learned_addr learned my addr 172.21.15.114:0/1232362775 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:50.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f38a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340c38e0 0x7f8f3406e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:59654/0 (socket says 172.21.15.114:59654) 2024-02-17T12:17:50.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f39400640 1 --1- 172.21.15.114:0/1232362775 >> v1:172.21.15.116:6789/0 conn(0x7f8f340a7020 0x7f8f341543a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:33002/0 (socket says 172.21.15.114:33002) 2024-02-17T12:17:50.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f33e00640 1 -- 172.21.15.114:0/1232362775 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340c38e0 msgr2=0x7f8f3406e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:50.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f33e00640 1 --2- 172.21.15.114:0/1232362775 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340c38e0 0x7f8f3406e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:50.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f33e00640 1 -- 172.21.15.114:0/1232362775 >> v1:172.21.15.116:6789/0 conn(0x7f8f340a7020 legacy=0x7f8f341543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:50.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.917+0000 7f8f33e00640 1 -- 172.21.15.114:0/1232362775 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34153b70 con 0x7f8f340a6590 2024-02-17T12:17:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f33e00640 1 --2- 172.21.15.114:0/1232362775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f340a6590 0x7f8f340a6ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f200098a0 tx=0x7f8f2001c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f02bab4dc5705f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f33400640 1 -- 172.21.15.114:0/1232362775 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f200ac640 con 0x7f8f340a6590 2024-02-17T12:17:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f33400640 1 -- 172.21.15.114:0/1232362775 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f200ac7a0 con 0x7f8f340a6590 2024-02-17T12:17:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f33400640 1 -- 172.21.15.114:0/1232362775 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f200acb30 con 0x7f8f340a6590 2024-02-17T12:17:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f3b400640 1 -- 172.21.15.114:0/1232362775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f340a6590 msgr2=0x7f8f340a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:50.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f3b400640 1 --2- 172.21.15.114:0/1232362775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f340a6590 0x7f8f340a6ae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f200098a0 tx=0x7f8f2001c420 comp rx=0 tx=0).stop 2024-02-17T12:17:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f3b400640 1 -- 172.21.15.114:0/1232362775 shutdown_connections 2024-02-17T12:17:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f3b400640 1 --2- 172.21.15.114:0/1232362775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f340a6590 0x7f8f340a6ae0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f3b400640 1 --2- 172.21.15.114:0/1232362775 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340c38e0 0x7f8f3406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f3b400640 1 -- 172.21.15.114:0/1232362775 >> 172.21.15.114:0/1232362775 conn(0x7f8f3406b210 msgr2=0x7f8f3406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f3b400640 1 -- 172.21.15.114:0/1232362775 shutdown_connections 2024-02-17T12:17:50.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f3b400640 1 -- 172.21.15.114:0/1232362775 wait complete. 2024-02-17T12:17:50.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.921+0000 7f8f3b400640 1 Processor -- start 2024-02-17T12:17:50.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f3b400640 1 -- start start 2024-02-17T12:17:50.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f3b400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340a6590 0x7f8f340bca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f3b400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f340a7020 0x7f8f341ee990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f3b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f340c38e0 0x7f8f3414c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f3b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340ab8a0 con 0x7f8f340c38e0 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f3b400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340abb80 con 0x7f8f340a7020 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f3b400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340bbfb0 con 0x7f8f340a6590 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f39400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f340c38e0 0x7f8f3414c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f39400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f340c38e0 0x7f8f3414c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37338/0 (socket says 172.21.15.114:37338) 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f39400640 1 -- 172.21.15.114:0/2333382147 learned_addr learned my addr 172.21.15.114:0/2333382147 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f38a00640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340a6590 0x7f8f340bca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f33e00640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f340a7020 0x7f8f341ee990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:50.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f39400640 1 -- 172.21.15.114:0/2333382147 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340a6590 msgr2=0x7f8f340bca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f39400640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340a6590 0x7f8f340bca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f39400640 1 -- 172.21.15.114:0/2333382147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f340a7020 msgr2=0x7f8f341ee990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f39400640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f340a7020 0x7f8f341ee990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f39400640 1 -- 172.21.15.114:0/2333382147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f200094d0 con 0x7f8f340c38e0 2024-02-17T12:17:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f39400640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f340c38e0 0x7f8f3414c2a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00c7a0 tx=0x7f8f2c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:50.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f30c00640 1 -- 172.21.15.114:0/2333382147 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00a640 con 0x7f8f340c38e0 2024-02-17T12:17:50.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f30c00640 1 -- 172.21.15.114:0/2333382147 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c00a7a0 con 0x7f8f340c38e0 2024-02-17T12:17:50.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f3b400640 1 -- 172.21.15.114:0/2333382147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f340bc290 con 0x7f8f340c38e0 2024-02-17T12:17:50.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f30c00640 1 -- 172.21.15.114:0/2333382147 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00ab10 con 0x7f8f340c38e0 2024-02-17T12:17:50.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f3b400640 1 -- 172.21.15.114:0/2333382147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3406ebd0 con 0x7f8f340c38e0 2024-02-17T12:17:50.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.925+0000 7f8f3b400640 1 -- 172.21.15.114:0/2333382147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f340bc7b0 con 0x7f8f340c38e0 2024-02-17T12:17:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.929+0000 7f8f30c00640 1 -- 172.21.15.114:0/2333382147 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8f2c00ac70 con 0x7f8f340c38e0 2024-02-17T12:17:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.929+0000 7f8f30c00640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f14066e40 0x7f8f14069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.929+0000 7f8f30c00640 1 -- 172.21.15.114:0/2333382147 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f8f2c084280 con 0x7f8f340c38e0 2024-02-17T12:17:50.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.929+0000 7f8f38a00640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f14066e40 0x7f8f14069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.929+0000 7f8f38a00640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f14066e40 0x7f8f14069300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009b60 tx=0x7f8f28009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:50.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:50.933+0000 7f8f30c00640 1 -- 172.21.15.114:0/2333382147 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8f340bc7b0 con 0x7f8f340c38e0 2024-02-17T12:17:51.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.085+0000 7f8f3b400640 1 -- 172.21.15.114:0/2333382147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f340bc7b0 con 0x7f8f340c38e0 2024-02-17T12:17:51.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.721+0000 7f8f30c00640 1 -- 172.21.15.114:0/2333382147 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8f340bc7b0 con 0x7f8f340c38e0 2024-02-17T12:17:51.728 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_metadata' removed 2024-02-17T12:17:51.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 -- 172.21.15.114:0/2333382147 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f14066e40 msgr2=0x7f8f14069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:51.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f14066e40 0x7f8f14069300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009b60 tx=0x7f8f28009190 comp rx=0 tx=0).stop 2024-02-17T12:17:51.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 -- 172.21.15.114:0/2333382147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f340c38e0 msgr2=0x7f8f3414c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:51.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f340c38e0 0x7f8f3414c2a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00c7a0 tx=0x7f8f2c00cc60 comp rx=0 tx=0).stop 2024-02-17T12:17:51.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 -- 172.21.15.114:0/2333382147 shutdown_connections 2024-02-17T12:17:51.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8f14066e40 0x7f8f14069300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:51.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f340c38e0 0x7f8f3414c2a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:51.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f340a7020 0x7f8f341ee990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:51.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 --2- 172.21.15.114:0/2333382147 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f340a6590 0x7f8f340bca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:51.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 -- 172.21.15.114:0/2333382147 >> 172.21.15.114:0/2333382147 conn(0x7f8f3406b210 msgr2=0x7f8f34150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:51.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 -- 172.21.15.114:0/2333382147 shutdown_connections 2024-02-17T12:17:51.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.725+0000 7f8f3b400640 1 -- 172.21.15.114:0/2333382147 wait complete. 2024-02-17T12:17:51.755 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-02-17T12:17:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13f200640 1 Processor -- start 2024-02-17T12:17:51.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13f200640 1 -- start start 2024-02-17T12:17:51.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13f200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1400c2e90 0x7fc1400c1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:51.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13f200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc1400c1f60 0x7fc1401589b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:51.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13f200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1400a66b0 con 0x7fc14006be80 2024-02-17T12:17:51.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13f200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1400c2390 con 0x7fc1400c2e90 2024-02-17T12:17:51.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13f200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400c5450 con 0x7fc1400c1f60 2024-02-17T12:17:51.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc135400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc1400c2e90 0x7fc1400c1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:51.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13de00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc14006be80 0x7fc1400c4a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:33014/0 (socket says 172.21.15.114:33014) 2024-02-17T12:17:51.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13de00640 1 -- 172.21.15.114:0/1786709946 learned_addr learned my addr 172.21.15.114:0/1786709946 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:51.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13e800640 1 --2- 172.21.15.114:0/1786709946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc1400c1f60 0x7fc1401589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:51.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc135400640 1 -- 172.21.15.114:0/1786709946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc1400c1f60 msgr2=0x7fc1401589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:51.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc135400640 1 --2- 172.21.15.114:0/1786709946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc1400c1f60 0x7fc1401589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:51.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc135400640 1 -- 172.21.15.114:0/1786709946 >> v1:172.21.15.116:6789/0 conn(0x7fc14006be80 legacy=0x7fc1400c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:51.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc13d400640 1 -- 172.21.15.114:0/1786709946 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761281498 0 0) 0x7fc1300014a0 con 0x7fc14006be80 2024-02-17T12:17:51.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.893+0000 7fc135400640 1 -- 172.21.15.114:0/1786709946 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1400c5730 con 0x7fc1400c2e90 2024-02-17T12:17:51.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc135400640 1 --2- 172.21.15.114:0/1786709946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 0x7fc1400c1a20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc1280097c0 tx=0x7fc12801c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5d1877c270e492 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:51.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13d400640 1 -- 172.21.15.114:0/1786709946 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280ab600 con 0x7fc1400c2e90 2024-02-17T12:17:51.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13d400640 1 -- 172.21.15.114:0/1786709946 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1280a7050 con 0x7fc1400c2e90 2024-02-17T12:17:51.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13d400640 1 -- 172.21.15.114:0/1786709946 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280ab980 con 0x7fc1400c2e90 2024-02-17T12:17:51.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13f200640 1 -- 172.21.15.114:0/1786709946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 msgr2=0x7fc1400c1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:51.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13f200640 1 --2- 172.21.15.114:0/1786709946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 0x7fc1400c1a20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc1280097c0 tx=0x7fc12801c120 comp rx=0 tx=0).stop 2024-02-17T12:17:51.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13f200640 1 -- 172.21.15.114:0/1786709946 shutdown_connections 2024-02-17T12:17:51.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13f200640 1 --2- 172.21.15.114:0/1786709946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc1400c1f60 0x7fc1401589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:51.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13f200640 1 --2- 172.21.15.114:0/1786709946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 0x7fc1400c1a20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:51.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13f200640 1 -- 172.21.15.114:0/1786709946 >> 172.21.15.114:0/1786709946 conn(0x7fc1400c3630 msgr2=0x7fc1400c3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:51.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13f200640 1 -- 172.21.15.114:0/1786709946 shutdown_connections 2024-02-17T12:17:51.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13f200640 1 -- 172.21.15.114:0/1786709946 wait complete. 2024-02-17T12:17:51.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13f200640 1 Processor -- start 2024-02-17T12:17:51.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.897+0000 7fc13f200640 1 -- start start 2024-02-17T12:17:51.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13f200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc14006be80 0x7fc1400a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:51.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13f200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc1400c1f60 0x7fc140153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:51.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 0x7fc140156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:51.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1401585f0 con 0x7fc1400c2e90 2024-02-17T12:17:51.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13f200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14006e360 con 0x7fc14006be80 2024-02-17T12:17:51.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13f200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1401566a0 con 0x7fc1400c1f60 2024-02-17T12:17:51.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 0x7fc140156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:51.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13de00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc14006be80 0x7fc1400a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:51.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 0x7fc140156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37362/0 (socket says 172.21.15.114:37362) 2024-02-17T12:17:51.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13de00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc14006be80 0x7fc1400a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:48714/0 (socket says 172.21.15.114:48714) 2024-02-17T12:17:51.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13de00640 1 -- 172.21.15.114:0/176782122 learned_addr learned my addr 172.21.15.114:0/176782122 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:51.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc135400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc1400c1f60 0x7fc140153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:51.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13de00640 1 -- 172.21.15.114:0/176782122 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc1400c1f60 msgr2=0x7fc140153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:51.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13de00640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc1400c1f60 0x7fc140153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:51.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13de00640 1 -- 172.21.15.114:0/176782122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 msgr2=0x7fc140156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:51.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13de00640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 0x7fc140156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:51.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13de00640 1 -- 172.21.15.114:0/176782122 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc128009420 con 0x7fc14006be80 2024-02-17T12:17:51.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13e800640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 0x7fc140156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:51.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13de00640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc14006be80 0x7fc1400a9be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c7c0 tx=0x7fc13000cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:51.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc136a00640 1 -- 172.21.15.114:0/176782122 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000a640 con 0x7fc14006be80 2024-02-17T12:17:51.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc136a00640 1 -- 172.21.15.114:0/176782122 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13000a7c0 con 0x7fc14006be80 2024-02-17T12:17:51.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc136a00640 1 -- 172.21.15.114:0/176782122 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000ab70 con 0x7fc14006be80 2024-02-17T12:17:51.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13f200640 1 -- 172.21.15.114:0/176782122 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14014af60 con 0x7fc14006be80 2024-02-17T12:17:51.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13f200640 1 -- 172.21.15.114:0/176782122 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc140158b00 con 0x7fc14006be80 2024-02-17T12:17:51.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.901+0000 7fc13f200640 1 -- 172.21.15.114:0/176782122 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc140067170 con 0x7fc14006be80 2024-02-17T12:17:51.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.905+0000 7fc136a00640 1 -- 172.21.15.114:0/176782122 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fc13000acd0 con 0x7fc14006be80 2024-02-17T12:17:51.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.905+0000 7fc136a00640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc11c066e40 0x7fc11c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:51.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.905+0000 7fc136a00640 1 -- 172.21.15.114:0/176782122 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5445+0+0 (secure 0 0 0) 0x7fc130084210 con 0x7fc14006be80 2024-02-17T12:17:51.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.905+0000 7fc135400640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc11c066e40 0x7fc11c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:51.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.905+0000 7fc135400640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc11c066e40 0x7fc11c069300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1280ad000 tx=0x7fc128008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:51.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:51.909+0000 7fc136a00640 1 -- 172.21.15.114:0/176782122 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc130051190 con 0x7fc14006be80 2024-02-17T12:17:52.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.061+0000 7fc13f200640 1 -- 172.21.15.114:0/176782122 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1400a6690 con 0x7fc14006be80 2024-02-17T12:17:52.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.729+0000 7fc136a00640 1 -- 172.21.15.114:0/176782122 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v42) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc1300180d0 con 0x7fc14006be80 2024-02-17T12:17:52.738 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_data' removed 2024-02-17T12:17:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 -- 172.21.15.114:0/176782122 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc11c066e40 msgr2=0x7fc11c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc11c066e40 0x7fc11c069300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc1280ad000 tx=0x7fc128008040 comp rx=0 tx=0).stop 2024-02-17T12:17:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 -- 172.21.15.114:0/176782122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc14006be80 msgr2=0x7fc1400a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:52.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc14006be80 0x7fc1400a9be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c7c0 tx=0x7fc13000cc80 comp rx=0 tx=0).stop 2024-02-17T12:17:52.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 -- 172.21.15.114:0/176782122 shutdown_connections 2024-02-17T12:17:52.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc11c066e40 0x7fc11c069300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:52.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1400c2e90 0x7fc140156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:52.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc1400c1f60 0x7fc140153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:52.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 --2- 172.21.15.114:0/176782122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc14006be80 0x7fc1400a9be0 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c7c0 tx=0x7fc13000cc80 comp rx=0 tx=0).stop 2024-02-17T12:17:52.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 -- 172.21.15.114:0/176782122 >> 172.21.15.114:0/176782122 conn(0x7fc1400c3630 msgr2=0x7fc1401513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:52.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 -- 172.21.15.114:0/176782122 shutdown_connections 2024-02-17T12:17:52.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.733+0000 7fc13f200640 1 -- 172.21.15.114:0/176782122 wait complete. 2024-02-17T12:17:52.765 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-02-17T12:17:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b7fc00640 1 Processor -- start 2024-02-17T12:17:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b7fc00640 1 -- start start 2024-02-17T12:17:52.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b7fc00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0b780c25a0 0x7f0b7806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b7fc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b78156270 con 0x7f0b7806db50 2024-02-17T12:17:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b7fc00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b78156550 con 0x7f0b78152c50 2024-02-17T12:17:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b7fc00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b78071630 con 0x7f0b780c25a0 2024-02-17T12:17:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b6fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0b7806db50 0x7f0b7814ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55150/0 (socket says 172.21.15.114:55150) 2024-02-17T12:17:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b6fe00640 1 -- 172.21.15.114:0/3745734247 learned_addr learned my addr 172.21.15.114:0/3745734247 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:52.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b7d200640 1 --2- 172.21.15.114:0/3745734247 >> v2:172.21.15.116:3300/0 conn(0x7f0b780c25a0 0x7f0b7806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:52.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b77e00640 1 -- 172.21.15.114:0/3745734247 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29556217 0 0) 0x7f0b78156270 con 0x7f0b7806db50 2024-02-17T12:17:52.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b77e00640 1 -- 172.21.15.114:0/3745734247 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b5c003530 con 0x7f0b7806db50 2024-02-17T12:17:52.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b77e00640 1 -- 172.21.15.114:0/3745734247 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490495429 0 0) 0x7f0b78156550 con 0x7f0b78152c50 2024-02-17T12:17:52.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b77e00640 1 -- 172.21.15.114:0/3745734247 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b78156270 con 0x7f0b78152c50 2024-02-17T12:17:52.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b77e00640 1 -- 172.21.15.114:0/3745734247 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4294518451 0 0) 0x7f0b5c003530 con 0x7f0b7806db50 2024-02-17T12:17:52.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b7d200640 1 -- 172.21.15.114:0/3745734247 >> v1:172.21.15.116:6789/0 conn(0x7f0b78152c50 legacy=0x7f0b78153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:52.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b7d200640 1 -- 172.21.15.114:0/3745734247 >> v1:172.21.15.114:6789/0 conn(0x7f0b7806db50 legacy=0x7f0b7814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:52.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.897+0000 7f0b7d200640 1 -- 172.21.15.114:0/3745734247 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b78156830 con 0x7f0b780c25a0 2024-02-17T12:17:52.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b7d200640 1 --2- 172.21.15.114:0/3745734247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b780c25a0 0x7f0b7806e980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097c0 tx=0x7f0b6801c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b1b26c6bab1a9b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:52.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b77e00640 1 -- 172.21.15.114:0/3745734247 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60001680 con 0x7f0b780c25a0 2024-02-17T12:17:52.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b77e00640 1 -- 172.21.15.114:0/3745734247 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b680a7050 con 0x7f0b780c25a0 2024-02-17T12:17:52.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b77e00640 1 -- 172.21.15.114:0/3745734247 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b680ab620 con 0x7f0b780c25a0 2024-02-17T12:17:52.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b7fc00640 1 -- 172.21.15.114:0/3745734247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b780c25a0 msgr2=0x7f0b7806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:52.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b7fc00640 1 --2- 172.21.15.114:0/3745734247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b780c25a0 0x7f0b7806e980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097c0 tx=0x7f0b6801c270 comp rx=0 tx=0).stop 2024-02-17T12:17:52.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b7fc00640 1 -- 172.21.15.114:0/3745734247 shutdown_connections 2024-02-17T12:17:52.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b7fc00640 1 --2- 172.21.15.114:0/3745734247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b780c25a0 0x7f0b7806e980 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:52.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b7fc00640 1 -- 172.21.15.114:0/3745734247 >> 172.21.15.114:0/3745734247 conn(0x7f0b780a8490 msgr2=0x7f0b780a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:52.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b7fc00640 1 -- 172.21.15.114:0/3745734247 shutdown_connections 2024-02-17T12:17:52.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.901+0000 7f0b7fc00640 1 -- 172.21.15.114:0/3745734247 wait complete. 2024-02-17T12:17:52.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7fc00640 1 Processor -- start 2024-02-17T12:17:52.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7fc00640 1 -- start start 2024-02-17T12:17:52.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7fc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b7806db50 0x7f0b781f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:52.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7fc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b780c25a0 0x7f0b781edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7fc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b78152c50 0x7f0b78153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7fc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78148820 con 0x7f0b780c25a0 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7fc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b781ed160 con 0x7f0b7806db50 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7fc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b781f1620 con 0x7f0b78152c50 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b6fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b780c25a0 0x7f0b781edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b6fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b780c25a0 0x7f0b781edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37364/0 (socket says 172.21.15.114:37364) 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b6fe00640 1 -- 172.21.15.114:0/488177452 learned_addr learned my addr 172.21.15.114:0/488177452 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7d200640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b7806db50 0x7f0b781f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7dc00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b78152c50 0x7f0b78153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b6fe00640 1 -- 172.21.15.114:0/488177452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b78152c50 msgr2=0x7f0b78153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b6fe00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b78152c50 0x7f0b78153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:52.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b6fe00640 1 -- 172.21.15.114:0/488177452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b7806db50 msgr2=0x7f0b781f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:52.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b6fe00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b7806db50 0x7f0b781f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:52.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b6fe00640 1 -- 172.21.15.114:0/488177452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68009420 con 0x7f0b780c25a0 2024-02-17T12:17:52.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7dc00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b78152c50 0x7f0b78153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:52.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b6fe00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b780c25a0 0x7f0b781edb70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c750 tx=0x7f0b6000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:52.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b75600640 1 -- 172.21.15.114:0/488177452 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60005af0 con 0x7f0b780c25a0 2024-02-17T12:17:52.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b75600640 1 -- 172.21.15.114:0/488177452 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b60005c50 con 0x7f0b780c25a0 2024-02-17T12:17:52.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7fc00640 1 -- 172.21.15.114:0/488177452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b781ed6e0 con 0x7f0b780c25a0 2024-02-17T12:17:52.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b75600640 1 -- 172.21.15.114:0/488177452 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60007070 con 0x7f0b780c25a0 2024-02-17T12:17:52.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.905+0000 7f0b7fc00640 1 -- 172.21.15.114:0/488177452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b78154480 con 0x7f0b780c25a0 2024-02-17T12:17:52.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.909+0000 7f0b7fc00640 1 -- 172.21.15.114:0/488177452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b781ed870 con 0x7f0b780c25a0 2024-02-17T12:17:52.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.909+0000 7f0b75600640 1 -- 172.21.15.114:0/488177452 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0b600071d0 con 0x7f0b780c25a0 2024-02-17T12:17:52.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.909+0000 7f0b75600640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0b54066e70 0x7f0b54069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:52.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.909+0000 7f0b75600640 1 -- 172.21.15.114:0/488177452 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0b600843c0 con 0x7f0b780c25a0 2024-02-17T12:17:52.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.909+0000 7f0b7d200640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0b54066e70 0x7f0b54069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:52.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.909+0000 7f0b7d200640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0b54066e70 0x7f0b54069330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0b680ad000 tx=0x7f0b68008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:52.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:52.913+0000 7f0b75600640 1 -- 172.21.15.114:0/488177452 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0b600514e0 con 0x7f0b780c25a0 2024-02-17T12:17:53.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.069+0000 7f0b7fc00640 1 -- 172.21.15.114:0/488177452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0b78074840 con 0x7f0b780c25a0 2024-02-17T12:17:53.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.073+0000 7f0b75600640 1 -- 172.21.15.114:0/488177452 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0b60054ba0 con 0x7f0b780c25a0 2024-02-17T12:17:53.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 -- 172.21.15.114:0/488177452 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0b54066e70 msgr2=0x7f0b54069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0b54066e70 0x7f0b54069330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0b680ad000 tx=0x7f0b68008040 comp rx=0 tx=0).stop 2024-02-17T12:17:53.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 -- 172.21.15.114:0/488177452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b780c25a0 msgr2=0x7f0b781edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b780c25a0 0x7f0b781edb70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c750 tx=0x7f0b6000cc10 comp rx=0 tx=0).stop 2024-02-17T12:17:53.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 -- 172.21.15.114:0/488177452 shutdown_connections 2024-02-17T12:17:53.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b78152c50 0x7f0b78153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0b54066e70 0x7f0b54069330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b780c25a0 0x7f0b781edb70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 --2- 172.21.15.114:0/488177452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0b7806db50 0x7f0b781f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 -- 172.21.15.114:0/488177452 >> 172.21.15.114:0/488177452 conn(0x7f0b780a8490 msgr2=0x7f0b7806e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:53.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 -- 172.21.15.114:0/488177452 shutdown_connections 2024-02-17T12:17:53.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.077+0000 7f0b7fc00640 1 -- 172.21.15.114:0/488177452 wait complete. 2024-02-17T12:17:53.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2024-02-17T12:17:53.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.229+0000 7f73a4200640 1 Processor -- start 2024-02-17T12:17:53.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.229+0000 7f73a4200640 1 -- start start 2024-02-17T12:17:53.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a4200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c152540 0x7f739c06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a4200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f739c0c6460 0x7f739c158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a4200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739c155dd0 con 0x7f739c154e30 2024-02-17T12:17:53.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a4200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739c1588c0 con 0x7f739c0c6460 2024-02-17T12:17:53.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a4200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c155810 con 0x7f739c152540 2024-02-17T12:17:53.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a0e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f739c0c6460 0x7f739c158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a1800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c152540 0x7f739c06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a2200640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f739c154e30 0x7f739c0aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:33030/0 (socket says 172.21.15.114:33030) 2024-02-17T12:17:53.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a1800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c152540 0x7f739c06ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:59702/0 (socket says 172.21.15.114:59702) 2024-02-17T12:17:53.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a2200640 1 -- 172.21.15.114:0/3997774962 learned_addr learned my addr 172.21.15.114:0/3997774962 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:53.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f739be00640 1 -- 172.21.15.114:0/3997774962 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219699211 0 0) 0x7f739c155dd0 con 0x7f739c154e30 2024-02-17T12:17:53.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f739be00640 1 -- 172.21.15.114:0/3997774962 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7384003530 con 0x7f739c154e30 2024-02-17T12:17:53.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a1800640 1 -- 172.21.15.114:0/3997774962 >> v2:172.21.15.116:3300/0 conn(0x7f739c0c6460 msgr2=0x7f739c158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:53.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a1800640 1 --2- 172.21.15.114:0/3997774962 >> v2:172.21.15.116:3300/0 conn(0x7f739c0c6460 0x7f739c158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a1800640 1 -- 172.21.15.114:0/3997774962 >> v1:172.21.15.116:6789/0 conn(0x7f739c154e30 legacy=0x7f739c0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a1800640 1 -- 172.21.15.114:0/3997774962 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c155af0 con 0x7f739c152540 2024-02-17T12:17:53.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.233+0000 7f73a0e00640 1 --2- 172.21.15.114:0/3997774962 >> v2:172.21.15.116:3300/0 conn(0x7f739c0c6460 0x7f739c158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:53.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a1800640 1 --2- 172.21.15.114:0/3997774962 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c152540 0x7f739c06ff80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f73900097c0 tx=0x7f739001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e277a74531326361 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:53.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f739be00640 1 -- 172.21.15.114:0/3997774962 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900ab600 con 0x7f739c152540 2024-02-17T12:17:53.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f739be00640 1 -- 172.21.15.114:0/3997774962 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73900a7050 con 0x7f739c152540 2024-02-17T12:17:53.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f739be00640 1 -- 172.21.15.114:0/3997774962 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900ab980 con 0x7f739c152540 2024-02-17T12:17:53.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 -- 172.21.15.114:0/3997774962 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c152540 msgr2=0x7f739c06ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 --2- 172.21.15.114:0/3997774962 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c152540 0x7f739c06ff80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f73900097c0 tx=0x7f739001c380 comp rx=0 tx=0).stop 2024-02-17T12:17:53.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 -- 172.21.15.114:0/3997774962 shutdown_connections 2024-02-17T12:17:53.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 --2- 172.21.15.114:0/3997774962 >> v2:172.21.15.116:3300/0 conn(0x7f739c0c6460 0x7f739c158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 --2- 172.21.15.114:0/3997774962 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c152540 0x7f739c06ff80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 -- 172.21.15.114:0/3997774962 >> 172.21.15.114:0/3997774962 conn(0x7f739c0c4f20 msgr2=0x7f739c0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:53.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 -- 172.21.15.114:0/3997774962 shutdown_connections 2024-02-17T12:17:53.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 -- 172.21.15.114:0/3997774962 wait complete. 2024-02-17T12:17:53.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 Processor -- start 2024-02-17T12:17:53.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 -- start start 2024-02-17T12:17:53.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f739c0c6460 0x7f739c0c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f739c152540 0x7f739c143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c154e30 0x7f739c143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c06c270 con 0x7f739c152540 2024-02-17T12:17:53.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c06bcf0 con 0x7f739c0c6460 2024-02-17T12:17:53.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a4200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c06d6d0 con 0x7f739c154e30 2024-02-17T12:17:53.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f739c152540 0x7f739c143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f739c152540 0x7f739c143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37378/0 (socket says 172.21.15.114:37378) 2024-02-17T12:17:53.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.237+0000 7f73a0e00640 1 -- 172.21.15.114:0/2010065013 learned_addr learned my addr 172.21.15.114:0/2010065013 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:53.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a1800640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f739c0c6460 0x7f739c0c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a2200640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c154e30 0x7f739c143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a0e00640 1 -- 172.21.15.114:0/2010065013 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c154e30 msgr2=0x7f739c143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a0e00640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c154e30 0x7f739c143b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a0e00640 1 -- 172.21.15.114:0/2010065013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f739c0c6460 msgr2=0x7f739c0c1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a0e00640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f739c0c6460 0x7f739c0c1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a0e00640 1 -- 172.21.15.114:0/2010065013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388009420 con 0x7f739c152540 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a2200640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c154e30 0x7f739c143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a0e00640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f739c152540 0x7f739c143640 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f738800ebe0 tx=0x7f738800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f7399600640 1 -- 172.21.15.114:0/2010065013 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800eee0 con 0x7f739c152540 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f7399600640 1 -- 172.21.15.114:0/2010065013 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738800cc30 con 0x7f739c152540 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a4200640 1 -- 172.21.15.114:0/2010065013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7390009420 con 0x7f739c152540 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f7399600640 1 -- 172.21.15.114:0/2010065013 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388013470 con 0x7f739c152540 2024-02-17T12:17:53.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a4200640 1 -- 172.21.15.114:0/2010065013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c06bf90 con 0x7f739c152540 2024-02-17T12:17:53.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f73a4200640 1 -- 172.21.15.114:0/2010065013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739c06bb00 con 0x7f739c152540 2024-02-17T12:17:53.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f7399600640 1 -- 172.21.15.114:0/2010065013 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f73880135d0 con 0x7f739c152540 2024-02-17T12:17:53.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f7399600640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f737c066e40 0x7f737c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.241+0000 7f7399600640 1 -- 172.21.15.114:0/2010065013 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7388084aa0 con 0x7f739c152540 2024-02-17T12:17:53.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.245+0000 7f73a1800640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f737c066e40 0x7f737c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.245+0000 7f73a1800640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f737c066e40 0x7f737c069300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f73900ad000 tx=0x7f73900a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:53.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.245+0000 7f7399600640 1 -- 172.21.15.114:0/2010065013 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7388051b40 con 0x7f739c152540 2024-02-17T12:17:53.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.457+0000 7f73a4200640 1 -- 172.21.15.114:0/2010065013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f739c06d840 con 0x7f739c152540 2024-02-17T12:17:53.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f7399600640 1 -- 172.21.15.114:0/2010065013 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v112) v1 ==== 159+0+0 (secure 0 0 0) 0x7f739c06d840 con 0x7f739c152540 2024-02-17T12:17:53.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 -- 172.21.15.114:0/2010065013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f737c066e40 msgr2=0x7f737c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f737c066e40 0x7f737c069300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f73900ad000 tx=0x7f73900a6000 comp rx=0 tx=0).stop 2024-02-17T12:17:53.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 -- 172.21.15.114:0/2010065013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f739c152540 msgr2=0x7f739c143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f739c152540 0x7f739c143640 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f738800ebe0 tx=0x7f738800c520 comp rx=0 tx=0).stop 2024-02-17T12:17:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 -- 172.21.15.114:0/2010065013 shutdown_connections 2024-02-17T12:17:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f739c154e30 0x7f739c143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f737c066e40 0x7f737c069300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f739c152540 0x7f739c143640 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 --2- 172.21.15.114:0/2010065013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f739c0c6460 0x7f739c0c1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 -- 172.21.15.114:0/2010065013 >> 172.21.15.114:0/2010065013 conn(0x7f739c0c4f20 msgr2=0x7f739c1546f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 -- 172.21.15.114:0/2010065013 shutdown_connections 2024-02-17T12:17:53.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.729+0000 7f73a4200640 1 -- 172.21.15.114:0/2010065013 wait complete. 2024-02-17T12:17:53.758 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2024-02-17T12:17:53.758 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-02-17T12:17:53.759 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:53.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc11200640 1 Processor -- start 2024-02-17T12:17:53.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc11200640 1 -- start start 2024-02-17T12:17:53.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc11200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc0c14f110 0x7fdc0c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc11200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c0a9420 con 0x7fdc0c0c2580 2024-02-17T12:17:53.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc11200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c152850 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc11200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c14f4f0 con 0x7fdc0c14f110 2024-02-17T12:17:53.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc09e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc0c14f110 0x7fdc0c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc09400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdc0c0c2580 0x7fdc0c0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55164/0 (socket says 172.21.15.114:55164) 2024-02-17T12:17:53.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc09400640 1 -- 172.21.15.114:0/1867391597 learned_addr learned my addr 172.21.15.114:0/1867391597 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:53.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc09e00640 1 -- 172.21.15.114:0/1867391597 >> v1:172.21.15.116:6789/0 conn(0x7fdc0c0c1eb0 legacy=0x7fdc0c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:53.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc09e00640 1 -- 172.21.15.114:0/1867391597 >> v1:172.21.15.114:6789/0 conn(0x7fdc0c0c2580 legacy=0x7fdc0c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc08a00640 1 -- 172.21.15.114:0/1867391597 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736595406 0 0) 0x7fdc0c0a9420 con 0x7fdc0c0c2580 2024-02-17T12:17:53.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.885+0000 7fdc09e00640 1 -- 172.21.15.114:0/1867391597 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c0a9670 con 0x7fdc0c14f110 2024-02-17T12:17:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc09e00640 1 --2- 172.21.15.114:0/1867391597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c14f110 0x7fdc0c0c65a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009d90 tx=0x7fdbfc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47546f1dd34586ca server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:53.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc08a00640 1 -- 172.21.15.114:0/1867391597 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0a5850 con 0x7fdc0c14f110 2024-02-17T12:17:53.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc08a00640 1 -- 172.21.15.114:0/1867391597 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc0a59b0 con 0x7fdc0c14f110 2024-02-17T12:17:53.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc08a00640 1 -- 172.21.15.114:0/1867391597 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0a5d40 con 0x7fdc0c14f110 2024-02-17T12:17:53.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc11200640 1 -- 172.21.15.114:0/1867391597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c14f110 msgr2=0x7fdc0c0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc11200640 1 --2- 172.21.15.114:0/1867391597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c14f110 0x7fdc0c0c65a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009d90 tx=0x7fdbfc01c8a0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc11200640 1 -- 172.21.15.114:0/1867391597 shutdown_connections 2024-02-17T12:17:53.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc11200640 1 --2- 172.21.15.114:0/1867391597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c14f110 0x7fdc0c0c65a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc11200640 1 -- 172.21.15.114:0/1867391597 >> 172.21.15.114:0/1867391597 conn(0x7fdc0c0a8490 msgr2=0x7fdc0c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:53.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc11200640 1 -- 172.21.15.114:0/1867391597 shutdown_connections 2024-02-17T12:17:53.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.889+0000 7fdc11200640 1 -- 172.21.15.114:0/1867391597 wait complete. 2024-02-17T12:17:53.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 Processor -- start 2024-02-17T12:17:53.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 -- start start 2024-02-17T12:17:53.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c0c1eb0 0x7fdc0c1f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc0c0c2580 0x7fdc0c06df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc0c14f110 0x7fdc0c1ed720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0c4520 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c1f11a0 con 0x7fdc0c14f110 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c14cf10 con 0x7fdc0c0c2580 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc09e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c0c1eb0 0x7fdc0c1f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc09e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c0c1eb0 0x7fdc0c1f1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37396/0 (socket says 172.21.15.114:37396) 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc09e00640 1 -- 172.21.15.114:0/3349811054 learned_addr learned my addr 172.21.15.114:0/3349811054 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc0a800640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc0c14f110 0x7fdc0c1ed720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc09400640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc0c0c2580 0x7fdc0c06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc09e00640 1 -- 172.21.15.114:0/3349811054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc0c0c2580 msgr2=0x7fdc0c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc09e00640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc0c0c2580 0x7fdc0c06df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc09e00640 1 -- 172.21.15.114:0/3349811054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc0c14f110 msgr2=0x7fdc0c1ed720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc09e00640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc0c14f110 0x7fdc0c1ed720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc09e00640 1 -- 172.21.15.114:0/3349811054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc009a70 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc0a800640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc0c14f110 0x7fdc0c1ed720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:53.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc09e00640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c0c1eb0 0x7fdc0c1f1630 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0194b0 tx=0x7fdbfc019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:53.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc02000640 1 -- 172.21.15.114:0/3349811054 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0ad850 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc02000640 1 -- 172.21.15.114:0/3349811054 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc0ad9b0 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 -- 172.21.15.114:0/3349811054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c143cd0 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc02000640 1 -- 172.21.15.114:0/3349811054 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0add20 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 -- 172.21.15.114:0/3349811054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c0c3f60 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.893+0000 7fdc11200640 1 -- 172.21.15.114:0/3349811054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c074840 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.897+0000 7fdc02000640 1 -- 172.21.15.114:0/3349811054 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fdbfc0b4050 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.897+0000 7fdc02000640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdbe8066ec0 0x7fdbe8069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:53.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.897+0000 7fdc02000640 1 -- 172.21.15.114:0/3349811054 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdbfc11f750 con 0x7fdc0c0c1eb0 2024-02-17T12:17:53.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.897+0000 7fdc09400640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdbe8066ec0 0x7fdbe8069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:53.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.897+0000 7fdc09400640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdbe8066ec0 0x7fdbe8069380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c06ec50 tx=0x7fdbf4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:53.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:53.901+0000 7fdc02000640 1 -- 172.21.15.114:0/3349811054 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdbfc0ec850 con 0x7fdc0c0c1eb0 2024-02-17T12:17:54.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 -- 172.21.15.114:0/3349811054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc0c0c1380 con 0x7fdc0c0c1eb0 2024-02-17T12:17:54.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc02000640 1 -- 172.21.15.114:0/3349811054 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+13166 (secure 0 0 0) 0x7fdbfc0eff10 con 0x7fdc0c0c1eb0 2024-02-17T12:17:54.065 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:54.065 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:52.726764+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6836/2833741536":"2024-02-18T12:17:49.713027+0000","172.21.15.114:6837/1473468479":"2024-02-18T12:17:43.271319+0000","172.21.15.114:6834/2833741536":"2024-02-18T12:17:49.713027+0000","172.21.15.114:6835/1473468479":"2024-02-18T12:17:43.271319+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:54.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 -- 172.21.15.114:0/3349811054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdbe8066ec0 msgr2=0x7fdbe8069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdbe8066ec0 0x7fdbe8069380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c06ec50 tx=0x7fdbf4009040 comp rx=0 tx=0).stop 2024-02-17T12:17:54.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 -- 172.21.15.114:0/3349811054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c0c1eb0 msgr2=0x7fdc0c1f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c0c1eb0 0x7fdc0c1f1630 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0194b0 tx=0x7fdbfc019640 comp rx=0 tx=0).stop 2024-02-17T12:17:54.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 -- 172.21.15.114:0/3349811054 shutdown_connections 2024-02-17T12:17:54.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc0c14f110 0x7fdc0c1ed720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc0c0c2580 0x7fdc0c06df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdbe8066ec0 0x7fdbe8069380 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 --2- 172.21.15.114:0/3349811054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc0c0c1eb0 0x7fdc0c1f1630 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.057+0000 7fdc11200640 1 -- 172.21.15.114:0/3349811054 >> 172.21.15.114:0/3349811054 conn(0x7fdc0c0a8490 msgr2=0x7fdc0c0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:54.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.061+0000 7fdc11200640 1 -- 172.21.15.114:0/3349811054 shutdown_connections 2024-02-17T12:17:54.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.061+0000 7fdc11200640 1 -- 172.21.15.114:0/3349811054 wait complete. 2024-02-17T12:17:54.086 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:17:54.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:17:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f914a800640 1 Processor -- start 2024-02-17T12:17:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f914a800640 1 -- start start 2024-02-17T12:17:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f914a800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9144152350 0x7f91441556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f914a800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91440c1760 0x7f91440c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f914a800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9144155c10 con 0x7f91440c3010 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f914a800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9144152730 con 0x7f9144152350 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f914a800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9144159180 con 0x7f91440c1760 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9149e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f91440c3010 0x7f91440c34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55180/0 (socket says 172.21.15.114:55180) 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9149e00640 1 -- 172.21.15.114:0/42547227 learned_addr learned my addr 172.21.15.114:0/42547227 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9148a00640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91440c1760 0x7f91440c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9149400640 1 --2- 172.21.15.114:0/42547227 >> v2:172.21.15.116:3300/0 conn(0x7f9144152350 0x7f91441556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878187972 0 0) 0x7f9144155c10 con 0x7f91440c3010 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f912c003530 con 0x7f91440c3010 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332334644 0 0) 0x7f912c003530 con 0x7f91440c3010 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91440c1760 msgr2=0x7f91440c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:54.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91440c1760 0x7f91440c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 >> v2:172.21.15.116:3300/0 conn(0x7f9144152350 msgr2=0x7f91441556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 --2- 172.21.15.114:0/42547227 >> v2:172.21.15.116:3300/0 conn(0x7f9144152350 0x7f91441556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144158570 con 0x7f91440c3010 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f913c001a00 con 0x7f91440c3010 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 >> v1:172.21.15.114:6789/0 conn(0x7f91440c3010 legacy=0x7f91440c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f912c003980 0x7f912c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f912c0047d0 0x7f912c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91440c1760 0x7f912c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144152730 con 0x7f912c003980 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144159180 con 0x7f912c0047d0 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c00b9e0 con 0x7f91440c1760 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9149400640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f912c003980 0x7f912c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9148a00640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f912c0047d0 0x7f912c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.217+0000 7f9149e00640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91440c1760 0x7f912c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9149400640 1 -- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91440c1760 msgr2=0x7f912c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9149400640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91440c1760 0x7f912c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9149400640 1 -- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f912c0047d0 msgr2=0x7f912c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9149400640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f912c0047d0 0x7f912c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9149400640 1 -- 172.21.15.114:0/42547227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c003530 con 0x7f912c003980 2024-02-17T12:17:54.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9149e00640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f91440c1760 0x7f912c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:54.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9149400640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f912c003980 0x7f912c003da0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9138009b10 tx=0x7f913801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0e9640491cdabd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:54.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91380a5590 con 0x7f912c003980 2024-02-17T12:17:54.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91380a56f0 con 0x7f912c003980 2024-02-17T12:17:54.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9143e00640 1 -- 172.21.15.114:0/42547227 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91380a5aa0 con 0x7f912c003980 2024-02-17T12:17:54.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f914a800640 1 -- 172.21.15.114:0/42547227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f912c003980 msgr2=0x7f912c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f914a800640 1 --2- 172.21.15.114:0/42547227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f912c003980 0x7f912c003da0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9138009b10 tx=0x7f913801ca80 comp rx=0 tx=0).stop 2024-02-17T12:17:54.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f9149e00640 1 -- 172.21.15.114:0/42547227 reap_dead start 2024-02-17T12:17:54.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f914a800640 1 -- 172.21.15.114:0/42547227 shutdown_connections 2024-02-17T12:17:54.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f914a800640 1 -- 172.21.15.114:0/42547227 >> 172.21.15.114:0/42547227 conn(0x7f91440c83b0 msgr2=0x7f91440c87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:54.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.221+0000 7f914a800640 1 -- 172.21.15.114:0/42547227 shutdown_connections 2024-02-17T12:17:54.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 -- 172.21.15.114:0/42547227 wait complete. 2024-02-17T12:17:54.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 Processor -- start 2024-02-17T12:17:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 -- start start 2024-02-17T12:17:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f912c003980 0x7f9144157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91441504c0 0x7f9144150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9144151050 0x7f914414c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914414fb80 con 0x7f91441504c0 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144157ad0 con 0x7f912c003980 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91441eda80 con 0x7f9144151050 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9148a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91441504c0 0x7f9144150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9148a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91441504c0 0x7f9144150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37406/0 (socket says 172.21.15.114:37406) 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9149400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f912c003980 0x7f9144157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9148a00640 1 -- 172.21.15.114:0/3408841899 learned_addr learned my addr 172.21.15.114:0/3408841899 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9149e00640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9144151050 0x7f914414c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9148a00640 1 -- 172.21.15.114:0/3408841899 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9144151050 msgr2=0x7f914414c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9148a00640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9144151050 0x7f914414c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9148a00640 1 -- 172.21.15.114:0/3408841899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f912c003980 msgr2=0x7f9144157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9148a00640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f912c003980 0x7f9144157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9148a00640 1 -- 172.21.15.114:0/3408841899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91441edd60 con 0x7f91441504c0 2024-02-17T12:17:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9148a00640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91441504c0 0x7f9144150b10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f91300119d0 tx=0x7f9130011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9141600640 1 -- 172.21.15.114:0/3408841899 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000faf0 con 0x7f91441504c0 2024-02-17T12:17:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9141600640 1 -- 172.21.15.114:0/3408841899 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913000fc50 con 0x7f91441504c0 2024-02-17T12:17:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f9141600640 1 -- 172.21.15.114:0/3408841899 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130014440 con 0x7f91441504c0 2024-02-17T12:17:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 -- 172.21.15.114:0/3408841899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914414fdd0 con 0x7f91441504c0 2024-02-17T12:17:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.225+0000 7f914a800640 1 -- 172.21.15.114:0/3408841899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91441514d0 con 0x7f91441504c0 2024-02-17T12:17:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.229+0000 7f914a800640 1 -- 172.21.15.114:0/3408841899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91441502f0 con 0x7f91441504c0 2024-02-17T12:17:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.229+0000 7f9141600640 1 -- 172.21.15.114:0/3408841899 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f91300145a0 con 0x7f91441504c0 2024-02-17T12:17:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.229+0000 7f9141600640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9124066e70 0x7f9124069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.229+0000 7f9141600640 1 -- 172.21.15.114:0/3408841899 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9130084ee0 con 0x7f91441504c0 2024-02-17T12:17:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.229+0000 7f9149400640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9124066e70 0x7f9124069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.229+0000 7f9149400640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9124066e70 0x7f9124069330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f91380af000 tx=0x7f91380046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.233+0000 7f9141600640 1 -- 172.21.15.114:0/3408841899 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9130052020 con 0x7f91441504c0 2024-02-17T12:17:54.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 -- 172.21.15.114:0/3408841899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91441edef0 con 0x7f91441504c0 2024-02-17T12:17:54.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f9141600640 1 -- 172.21.15.114:0/3408841899 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91300556e0 con 0x7f91441504c0 2024-02-17T12:17:54.396 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 -- 172.21.15.114:0/3408841899 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9124066e70 msgr2=0x7f9124069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9124066e70 0x7f9124069330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f91380af000 tx=0x7f91380046d0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 -- 172.21.15.114:0/3408841899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91441504c0 msgr2=0x7f9144150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91441504c0 0x7f9144150b10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f91300119d0 tx=0x7f9130011dd0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 -- 172.21.15.114:0/3408841899 shutdown_connections 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9144151050 0x7f914414c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9124066e70 0x7f9124069330 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91441504c0 0x7f9144150b10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 --2- 172.21.15.114:0/3408841899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f912c003980 0x7f9144157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 -- 172.21.15.114:0/3408841899 >> 172.21.15.114:0/3408841899 conn(0x7f91440c83b0 msgr2=0x7f91441477c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 -- 172.21.15.114:0/3408841899 shutdown_connections 2024-02-17T12:17:54.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.389+0000 7f914a800640 1 -- 172.21.15.114:0/3408841899 wait complete. 2024-02-17T12:17:54.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2024-02-17T12:17:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f08000640 1 Processor -- start 2024-02-17T12:17:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f08000640 1 -- start start 2024-02-17T12:17:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f08000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8f00150300 0x7f8f00156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f08000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 0x7f8f000aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f08000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f00157270 con 0x7f8f000aa6a0 2024-02-17T12:17:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f08000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f000c6900 con 0x7f8f00150300 2024-02-17T12:17:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f08000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000c3580 con 0x7f8f000714c0 2024-02-17T12:17:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f04c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 0x7f8f000aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f05600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8f00150300 0x7f8f00156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f04c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 0x7f8f000aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:59768/0 (socket says 172.21.15.114:59768) 2024-02-17T12:17:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f04c00640 1 -- 172.21.15.114:0/3552316401 learned_addr learned my addr 172.21.15.114:0/3552316401 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f05600640 1 --2- 172.21.15.114:0/3552316401 >> v2:172.21.15.116:3300/0 conn(0x7f8f00150300 0x7f8f00156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:48778/0 (socket says 172.21.15.114:48778) 2024-02-17T12:17:54.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f04c00640 1 -- 172.21.15.114:0/3552316401 >> v2:172.21.15.116:3300/0 conn(0x7f8f00150300 msgr2=0x7f8f00156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:54.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f04c00640 1 --2- 172.21.15.114:0/3552316401 >> v2:172.21.15.116:3300/0 conn(0x7f8f00150300 0x7f8f00156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f04c00640 1 -- 172.21.15.114:0/3552316401 >> v1:172.21.15.116:6789/0 conn(0x7f8f000aa6a0 legacy=0x7f8f00152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.545+0000 7f8f04c00640 1 -- 172.21.15.114:0/3552316401 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f000c2fc0 con 0x7f8f000714c0 2024-02-17T12:17:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8f04c00640 1 --2- 172.21.15.114:0/3552316401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 0x7f8f000aa160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009870 tx=0x7f8eec01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b04371dc76c5813b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8effe00640 1 -- 172.21.15.114:0/3552316401 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0ac620 con 0x7f8f000714c0 2024-02-17T12:17:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8effe00640 1 -- 172.21.15.114:0/3552316401 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec0ac780 con 0x7f8f000714c0 2024-02-17T12:17:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8effe00640 1 -- 172.21.15.114:0/3552316401 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0acb10 con 0x7f8f000714c0 2024-02-17T12:17:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8f08000640 1 -- 172.21.15.114:0/3552316401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 msgr2=0x7f8f000aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8f08000640 1 --2- 172.21.15.114:0/3552316401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 0x7f8f000aa160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009870 tx=0x7f8eec01c4d0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8f08000640 1 -- 172.21.15.114:0/3552316401 shutdown_connections 2024-02-17T12:17:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8f08000640 1 --2- 172.21.15.114:0/3552316401 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 0x7f8f000aa160 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8f08000640 1 --2- 172.21.15.114:0/3552316401 >> v2:172.21.15.116:3300/0 conn(0x7f8f00150300 0x7f8f00156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8f08000640 1 -- 172.21.15.114:0/3552316401 >> 172.21.15.114:0/3552316401 conn(0x7f8f000c4f20 msgr2=0x7f8f000c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8f08000640 1 -- 172.21.15.114:0/3552316401 shutdown_connections 2024-02-17T12:17:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.549+0000 7f8f08000640 1 -- 172.21.15.114:0/3552316401 wait complete. 2024-02-17T12:17:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 Processor -- start 2024-02-17T12:17:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 -- start start 2024-02-17T12:17:54.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 0x7f8f00144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000aa6a0 0x7f8f001eb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f00150300 0x7f8f001411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0014ae90 con 0x7f8f000aa6a0 2024-02-17T12:17:54.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f001ef8c0 con 0x7f8f00150300 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f00147430 con 0x7f8f000714c0 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f04c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000aa6a0 0x7f8f001eb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f04c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000aa6a0 0x7f8f001eb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37414/0 (socket says 172.21.15.114:37414) 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f04c00640 1 -- 172.21.15.114:0/965272195 learned_addr learned my addr 172.21.15.114:0/965272195 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f05600640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 0x7f8f00144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f06000640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f00150300 0x7f8f001411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f04c00640 1 -- 172.21.15.114:0/965272195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 msgr2=0x7f8f00144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f04c00640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 0x7f8f00144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f04c00640 1 -- 172.21.15.114:0/965272195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f00150300 msgr2=0x7f8f001411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f04c00640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f00150300 0x7f8f001411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f04c00640 1 -- 172.21.15.114:0/965272195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec0094d0 con 0x7f8f000aa6a0 2024-02-17T12:17:54.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f04c00640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000aa6a0 0x7f8f001eb9c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0af040 tx=0x7f8eec01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8efd600640 1 -- 172.21.15.114:0/965272195 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0b7420 con 0x7f8f000aa6a0 2024-02-17T12:17:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8efd600640 1 -- 172.21.15.114:0/965272195 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec0b7580 con 0x7f8f000aa6a0 2024-02-17T12:17:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 -- 172.21.15.114:0/965272195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f00147710 con 0x7f8f000aa6a0 2024-02-17T12:17:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8efd600640 1 -- 172.21.15.114:0/965272195 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0b7930 con 0x7f8f000aa6a0 2024-02-17T12:17:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 -- 172.21.15.114:0/965272195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0014a5b0 con 0x7f8f000aa6a0 2024-02-17T12:17:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.553+0000 7f8f08000640 1 -- 172.21.15.114:0/965272195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f00074840 con 0x7f8f000aa6a0 2024-02-17T12:17:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.557+0000 7f8efd600640 1 -- 172.21.15.114:0/965272195 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8eec0b3040 con 0x7f8f000aa6a0 2024-02-17T12:17:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.557+0000 7f8efd600640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 0x7f8ee0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.557+0000 7f8efd600640 1 -- 172.21.15.114:0/965272195 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8eec11eb40 con 0x7f8f000aa6a0 2024-02-17T12:17:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.557+0000 7f8f05600640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 0x7f8ee0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.557+0000 7f8f05600640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 0x7f8ee0069300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f00152110 tx=0x7f8ef4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:54.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.561+0000 7f8efd600640 1 -- 172.21.15.114:0/965272195 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8eec0ebc70 con 0x7f8f000aa6a0 2024-02-17T12:17:54.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:54.769+0000 7f8f08000640 1 -- 172.21.15.114:0/965272195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f8f000c5de0 con 0x7f8f000aa6a0 2024-02-17T12:17:55.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8efd600640 1 -- 172.21.15.114:0/965272195 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v114) v1 ==== 187+0+0 (secure 0 0 0) 0x7f8eec0ef330 con 0x7f8f000aa6a0 2024-02-17T12:17:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 -- 172.21.15.114:0/965272195 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 msgr2=0x7f8ee0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 0x7f8ee0069300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8f00152110 tx=0x7f8ef4009190 comp rx=0 tx=0).stop 2024-02-17T12:17:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 -- 172.21.15.114:0/965272195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000aa6a0 msgr2=0x7f8f001eb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000aa6a0 0x7f8f001eb9c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0af040 tx=0x7f8eec01ad10 comp rx=0 tx=0).stop 2024-02-17T12:17:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 -- 172.21.15.114:0/965272195 shutdown_connections 2024-02-17T12:17:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f00150300 0x7f8f001411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 0x7f8ee0069300 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000aa6a0 0x7f8f001eb9c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 --2- 172.21.15.114:0/965272195 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000714c0 0x7f8f00144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 -- 172.21.15.114:0/965272195 >> 172.21.15.114:0/965272195 conn(0x7f8f000c4f20 msgr2=0x7f8f0015ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:55.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 -- 172.21.15.114:0/965272195 shutdown_connections 2024-02-17T12:17:55.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.737+0000 7f8f08000640 1 -- 172.21.15.114:0/965272195 wait complete. 2024-02-17T12:17:55.768 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-02-17T12:17:55.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.897+0000 7fdfd5c00640 1 Processor -- start 2024-02-17T12:17:55.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfd5c00640 1 -- start start 2024-02-17T12:17:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfd5c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdfd0152c50 0x7fdfd0153070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfd5c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd0156270 con 0x7fdfd00c25a0 2024-02-17T12:17:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfd5c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd0156550 con 0x7fdfd006db50 2024-02-17T12:17:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfd5c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd006f090 con 0x7fdfd0152c50 2024-02-17T12:17:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcea00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdfd00c25a0 0x7fdfd006e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35040/0 (socket says 172.21.15.114:35040) 2024-02-17T12:17:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcea00640 1 -- 172.21.15.114:0/231495380 learned_addr learned my addr 172.21.15.114:0/231495380 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcf400640 1 --2- 172.21.15.114:0/231495380 >> v2:172.21.15.116:3300/0 conn(0x7fdfd0152c50 0x7fdfd0153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165024998 0 0) 0x7fdfd0156270 con 0x7fdfd00c25a0 2024-02-17T12:17:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb4003530 con 0x7fdfd00c25a0 2024-02-17T12:17:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 187190643 0 0) 0x7fdfb4003530 con 0x7fdfd00c25a0 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 >> v2:172.21.15.116:3300/0 conn(0x7fdfd0152c50 msgr2=0x7fdfd0153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 --2- 172.21.15.114:0/231495380 >> v2:172.21.15.116:3300/0 conn(0x7fdfd0152c50 0x7fdfd0153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 >> v1:172.21.15.116:6789/0 conn(0x7fdfd006db50 legacy=0x7fdfd014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0156830 con 0x7fdfd00c25a0 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fdfc0001680 con 0x7fdfd00c25a0 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 >> v1:172.21.15.114:6789/0 conn(0x7fdfd00c25a0 legacy=0x7fdfd006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfb4003980 0x7fdfb4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb40047d0 0x7fdfb4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfb40052b0 0x7fdfb400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd006f090 con 0x7fdfb40047d0 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb400c180 con 0x7fdfb40052b0 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb400c340 con 0x7fdfb4003980 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfce000640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb40047d0 0x7fdfb4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:55.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcea00640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfb4003980 0x7fdfb4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcf400640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfb40052b0 0x7fdfb400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfce000640 1 -- 172.21.15.114:0/231495380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfb4003980 msgr2=0x7fdfb4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfce000640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfb4003980 0x7fdfb4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfce000640 1 -- 172.21.15.114:0/231495380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfb40052b0 msgr2=0x7fdfb400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfce000640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfb40052b0 0x7fdfb400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfce000640 1 -- 172.21.15.114:0/231495380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb4003530 con 0x7fdfb40047d0 2024-02-17T12:17:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.901+0000 7fdfcf400640 1 -- 172.21.15.114:0/231495380 reap_dead start 2024-02-17T12:17:55.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfce000640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb40047d0 0x7fdfb4004c50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc001750 tx=0x7fdfbc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cdbb5176559ea8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:55.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0052d0 con 0x7fdfb40047d0 2024-02-17T12:17:55.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0a7050 con 0x7fdfb40047d0 2024-02-17T12:17:55.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfcd600640 1 -- 172.21.15.114:0/231495380 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc003600 con 0x7fdfb40047d0 2024-02-17T12:17:55.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfd5c00640 1 -- 172.21.15.114:0/231495380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb40047d0 msgr2=0x7fdfb4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:55.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfd5c00640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb40047d0 0x7fdfb4004c50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc001750 tx=0x7fdfbc01c3c0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfd5c00640 1 -- 172.21.15.114:0/231495380 shutdown_connections 2024-02-17T12:17:55.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfd5c00640 1 --2- 172.21.15.114:0/231495380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb40047d0 0x7fdfb4004c50 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfd5c00640 1 -- 172.21.15.114:0/231495380 >> 172.21.15.114:0/231495380 conn(0x7fdfd00a8490 msgr2=0x7fdfd00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:55.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfd5c00640 1 -- 172.21.15.114:0/231495380 shutdown_connections 2024-02-17T12:17:55.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.905+0000 7fdfd5c00640 1 -- 172.21.15.114:0/231495380 wait complete. 2024-02-17T12:17:55.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 Processor -- start 2024-02-17T12:17:55.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 -- start start 2024-02-17T12:17:55.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfb40047d0 0x7fdfd00c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:55.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfd014f560 0x7fdfd01e2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:55.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd00a9f10 0x7fdfd00aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:55.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd01f0950 con 0x7fdfd00a9f10 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd01f11f0 con 0x7fdfb40047d0 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00c4150 con 0x7fdfd014f560 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfcf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd00a9f10 0x7fdfd00aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfcf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd00a9f10 0x7fdfd00aa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35126/0 (socket says 172.21.15.114:35126) 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfcf400640 1 -- 172.21.15.114:0/888059738 learned_addr learned my addr 172.21.15.114:0/888059738 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfcea00640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfb40047d0 0x7fdfd00c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfce000640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfd014f560 0x7fdfd01e2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfcf400640 1 -- 172.21.15.114:0/888059738 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfd014f560 msgr2=0x7fdfd01e2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfcf400640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfd014f560 0x7fdfd01e2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfcf400640 1 -- 172.21.15.114:0/888059738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfb40047d0 msgr2=0x7fdfd00c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfcf400640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfb40047d0 0x7fdfd00c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfcf400640 1 -- 172.21.15.114:0/888059738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd01f0ba0 con 0x7fdfd00a9f10 2024-02-17T12:17:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfcf400640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd00a9f10 0x7fdfd00aa3c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00a91e0 tx=0x7fdfc80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfc6a00640 1 -- 172.21.15.114:0/888059738 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800e070 con 0x7fdfd00a9f10 2024-02-17T12:17:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfc6a00640 1 -- 172.21.15.114:0/888059738 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8011e10 con 0x7fdfd00a9f10 2024-02-17T12:17:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfc6a00640 1 -- 172.21.15.114:0/888059738 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80039a0 con 0x7fdfd00a9f10 2024-02-17T12:17:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 -- 172.21.15.114:0/888059738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd01f0e80 con 0x7fdfd00a9f10 2024-02-17T12:17:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 -- 172.21.15.114:0/888059738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd01e2d70 con 0x7fdfd00a9f10 2024-02-17T12:17:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.909+0000 7fdfd5c00640 1 -- 172.21.15.114:0/888059738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd01f1360 con 0x7fdfd00a9f10 2024-02-17T12:17:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.913+0000 7fdfc6a00640 1 -- 172.21.15.114:0/888059738 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fdfc8003b00 con 0x7fdfd00a9f10 2024-02-17T12:17:55.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.913+0000 7fdfc6a00640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdfb0066e70 0x7fdfb0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:55.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.913+0000 7fdfc6a00640 1 -- 172.21.15.114:0/888059738 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdfc8084dd0 con 0x7fdfd00a9f10 2024-02-17T12:17:55.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.913+0000 7fdfcea00640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdfb0066e70 0x7fdfb0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:55.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.913+0000 7fdfcea00640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdfb0066e70 0x7fdfb0069330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0001ca0 tx=0x7fdfc0007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:55.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:55.917+0000 7fdfc6a00640 1 -- 172.21.15.114:0/888059738 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdfc8055a30 con 0x7fdfd00a9f10 2024-02-17T12:17:56.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.069+0000 7fdfd5c00640 1 -- 172.21.15.114:0/888059738 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdfd0074840 con 0x7fdfd00a9f10 2024-02-17T12:17:56.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.073+0000 7fdfc6a00640 1 -- 172.21.15.114:0/888059738 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdfc80555c0 con 0x7fdfd00a9f10 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 -- 172.21.15.114:0/888059738 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdfb0066e70 msgr2=0x7fdfb0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdfb0066e70 0x7fdfb0069330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0001ca0 tx=0x7fdfc0007040 comp rx=0 tx=0).stop 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 -- 172.21.15.114:0/888059738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd00a9f10 msgr2=0x7fdfd00aa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd00a9f10 0x7fdfd00aa3c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00a91e0 tx=0x7fdfc80115a0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 -- 172.21.15.114:0/888059738 shutdown_connections 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdfb0066e70 0x7fdfb0069330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfd00a9f10 0x7fdfd00aa3c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdfd014f560 0x7fdfd01e2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 --2- 172.21.15.114:0/888059738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfb40047d0 0x7fdfd00c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 -- 172.21.15.114:0/888059738 >> 172.21.15.114:0/888059738 conn(0x7fdfd00a8490 msgr2=0x7fdfd01509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:56.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 -- 172.21.15.114:0/888059738 shutdown_connections 2024-02-17T12:17:56.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.077+0000 7fdfd5c00640 1 -- 172.21.15.114:0/888059738 wait complete. 2024-02-17T12:17:56.102 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-17T12:17:56.102 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:17:56.185 DEBUG:teuthology.orchestra.run.smithi116:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:17:56.233 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-17T12:17:56.233 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:17:56.234 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:56.242 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354568k,nr_inodes=4088642,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2004 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-17T12:17:56.242 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:17:56.242 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:17:56.251 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3897 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-02-17T12:17:56.251 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-02-17T12:17:56.251 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:17:56.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f8274c00640 1 Processor -- start 2024-02-17T12:17:56.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f8274c00640 1 -- start start 2024-02-17T12:17:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f8274c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8270152540 0x7f827006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f8274c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82700c6460 0x7f8270158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f8274c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8270155dd0 con 0x7f8270154e30 2024-02-17T12:17:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f8274c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82701588c0 con 0x7f82700c6460 2024-02-17T12:17:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f8274c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8270155810 con 0x7f8270152540 2024-02-17T12:17:56.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f826d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82700c6460 0x7f8270158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f826e800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8270154e30 0x7f82700aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35044/0 (socket says 172.21.15.114:35044) 2024-02-17T12:17:56.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f826e800640 1 -- 172.21.15.114:0/629267483 learned_addr learned my addr 172.21.15.114:0/629267483 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:56.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f826de00640 1 --2- 172.21.15.114:0/629267483 >> v2:172.21.15.116:3300/0 conn(0x7f8270152540 0x7f827006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f826d400640 1 -- 172.21.15.114:0/629267483 >> v2:172.21.15.116:3300/0 conn(0x7f8270152540 msgr2=0x7f827006ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:56.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f826d400640 1 --2- 172.21.15.114:0/629267483 >> v2:172.21.15.116:3300/0 conn(0x7f8270152540 0x7f827006ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f826d400640 1 -- 172.21.15.114:0/629267483 >> v1:172.21.15.114:6789/0 conn(0x7f8270154e30 legacy=0x7f82700aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f826d400640 1 -- 172.21.15.114:0/629267483 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8270155af0 con 0x7f82700c6460 2024-02-17T12:17:56.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f826de00640 1 --2- 172.21.15.114:0/629267483 >> v2:172.21.15.116:3300/0 conn(0x7f8270152540 0x7f827006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:56.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.409+0000 7f826ca00640 1 -- 172.21.15.114:0/629267483 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184976477 0 0) 0x7f8270155dd0 con 0x7f8270154e30 2024-02-17T12:17:56.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f826d400640 1 --2- 172.21.15.114:0/629267483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82700c6460 0x7f8270158d50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f827006dff0 tx=0x7f825801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27cce15ad88b1fc8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:56.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f826ca00640 1 -- 172.21.15.114:0/629267483 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580ab600 con 0x7f82700c6460 2024-02-17T12:17:56.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f826ca00640 1 -- 172.21.15.114:0/629267483 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82580a7050 con 0x7f82700c6460 2024-02-17T12:17:56.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f826ca00640 1 -- 172.21.15.114:0/629267483 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580ab980 con 0x7f82700c6460 2024-02-17T12:17:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f8274c00640 1 -- 172.21.15.114:0/629267483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82700c6460 msgr2=0x7f8270158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f8274c00640 1 --2- 172.21.15.114:0/629267483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82700c6460 0x7f8270158d50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f827006dff0 tx=0x7f825801c360 comp rx=0 tx=0).stop 2024-02-17T12:17:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f8274c00640 1 -- 172.21.15.114:0/629267483 shutdown_connections 2024-02-17T12:17:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f8274c00640 1 --2- 172.21.15.114:0/629267483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82700c6460 0x7f8270158d50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f8274c00640 1 --2- 172.21.15.114:0/629267483 >> v2:172.21.15.116:3300/0 conn(0x7f8270152540 0x7f827006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f8274c00640 1 -- 172.21.15.114:0/629267483 >> 172.21.15.114:0/629267483 conn(0x7f82700c4f20 msgr2=0x7f82700c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f8274c00640 1 -- 172.21.15.114:0/629267483 shutdown_connections 2024-02-17T12:17:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.413+0000 7f8274c00640 1 -- 172.21.15.114:0/629267483 wait complete. 2024-02-17T12:17:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 Processor -- start 2024-02-17T12:17:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 -- start start 2024-02-17T12:17:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82700c6460 0x7f827006be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8270152540 0x7f8270147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8270154e30 0x7f827006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82701f0890 con 0x7f8270154e30 2024-02-17T12:17:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8270157890 con 0x7f82700c6460 2024-02-17T12:17:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8270145450 con 0x7f8270152540 2024-02-17T12:17:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8270154e30 0x7f827006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8270154e30 0x7f827006d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35138/0 (socket says 172.21.15.114:35138) 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826e800640 1 -- 172.21.15.114:0/4235388859 learned_addr learned my addr 172.21.15.114:0/4235388859 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826de00640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82700c6460 0x7f827006be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826d400640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8270152540 0x7f8270147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826e800640 1 -- 172.21.15.114:0/4235388859 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8270152540 msgr2=0x7f8270147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826e800640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8270152540 0x7f8270147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826e800640 1 -- 172.21.15.114:0/4235388859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82700c6460 msgr2=0x7f827006be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826e800640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82700c6460 0x7f827006be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826e800640 1 -- 172.21.15.114:0/4235388859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8258009420 con 0x7f8270154e30 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826de00640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82700c6460 0x7f827006be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:56.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826d400640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8270152540 0x7f8270147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f826e800640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8270154e30 0x7f827006d7b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f826800c410 tx=0x7f826800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8266000640 1 -- 172.21.15.114:0/4235388859 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82680074e0 con 0x7f8270154e30 2024-02-17T12:17:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8266000640 1 -- 172.21.15.114:0/4235388859 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268007640 con 0x7f8270154e30 2024-02-17T12:17:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8266000640 1 -- 172.21.15.114:0/4235388859 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268004a30 con 0x7f8270154e30 2024-02-17T12:17:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 -- 172.21.15.114:0/4235388859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8270157ae0 con 0x7f8270154e30 2024-02-17T12:17:56.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 -- 172.21.15.114:0/4235388859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8270148200 con 0x7f8270154e30 2024-02-17T12:17:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.417+0000 7f8274c00640 1 -- 172.21.15.114:0/4235388859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82700c4d90 con 0x7f8270154e30 2024-02-17T12:17:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.421+0000 7f8266000640 1 -- 172.21.15.114:0/4235388859 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8268004b90 con 0x7f8270154e30 2024-02-17T12:17:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.421+0000 7f8266000640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f824c066e40 0x7f824c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.421+0000 7f8266000640 1 -- 172.21.15.114:0/4235388859 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f82680845f0 con 0x7f8270154e30 2024-02-17T12:17:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.421+0000 7f826de00640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f824c066e40 0x7f824c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.421+0000 7f826de00640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f824c066e40 0x7f824c069300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8260009b40 tx=0x7f82600039a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:56.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.425+0000 7f8266000640 1 -- 172.21.15.114:0/4235388859 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8268055110 con 0x7f8270154e30 2024-02-17T12:17:56.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.609+0000 7f8274c00640 1 -- 172.21.15.114:0/4235388859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8270074840 con 0x7f8270154e30 2024-02-17T12:17:56.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.609+0000 7f8266000640 1 -- 172.21.15.114:0/4235388859 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f8268001090 con 0x7f8270154e30 2024-02-17T12:17:56.618 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/1073614413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1073614413},{"type":"v1","addr":"172.21.15.116:6834","nonce":1073614413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3666398504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3666398504},{"type":"v1","addr":"172.21.15.116:6835","nonce":3666398504}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5535,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4030579941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4030579941},{"type":"v1","addr":"172.21.15.114:6837","nonce":4030579941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24},{"gid":5631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/762989687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":762989687},{"type":"v1","addr":"172.21.15.114:6836","nonce":762989687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[]} 2024-02-17T12:17:56.618 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 26 2024-02-17T12:17:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 -- 172.21.15.114:0/4235388859 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f824c066e40 msgr2=0x7f824c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f824c066e40 0x7f824c069300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8260009b40 tx=0x7f82600039a0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 -- 172.21.15.114:0/4235388859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8270154e30 msgr2=0x7f827006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8270154e30 0x7f827006d7b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f826800c410 tx=0x7f826800c8d0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 -- 172.21.15.114:0/4235388859 shutdown_connections 2024-02-17T12:17:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f824c066e40 0x7f824c069300 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8270154e30 0x7f827006d7b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8270152540 0x7f8270147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 --2- 172.21.15.114:0/4235388859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82700c6460 0x7f827006be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 -- 172.21.15.114:0/4235388859 >> 172.21.15.114:0/4235388859 conn(0x7f82700c4f20 msgr2=0x7f8270153770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:56.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 -- 172.21.15.114:0/4235388859 shutdown_connections 2024-02-17T12:17:56.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.613+0000 7f8274c00640 1 -- 172.21.15.114:0/4235388859 wait complete. 2024-02-17T12:17:56.640 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-17T12:17:56.640 INFO:tasks.ceph.mds.a:Stopping old one... 2024-02-17T12:17:56.641 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-17T12:17:56.641 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:17:56.641 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-17T12:17:56.641 INFO:tasks.ceph.mds.c:Stopping old one... 2024-02-17T12:17:56.641 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-17T12:17:56.642 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:17:56.642 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-17T12:17:56.642 INFO:tasks.ceph.mds.b:Stopping old one... 2024-02-17T12:17:56.642 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-17T12:17:56.642 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:17:56.642 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-17T12:17:56.642 INFO:tasks.ceph.mds.d:Stopping old one... 2024-02-17T12:17:56.643 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-17T12:17:56.643 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:17:56.657 INFO:tasks.ceph.mds.c:Stopped 2024-02-17T12:17:56.657 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-17T12:17:56.658 INFO:tasks.ceph.mds.a:Stopped 2024-02-17T12:17:56.658 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-17T12:17:56.659 INFO:tasks.ceph.mds.b:Stopped 2024-02-17T12:17:56.659 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-17T12:17:56.660 INFO:tasks.ceph.mds.d:Stopped 2024-02-17T12:17:56.660 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-17T12:17:56.701 INFO:tasks.ceph.mds.c:Started 2024-02-17T12:17:56.702 DEBUG:teuthology.parallel:result is None 2024-02-17T12:17:56.703 INFO:tasks.ceph.mds.a:Started 2024-02-17T12:17:56.703 DEBUG:teuthology.parallel:result is None 2024-02-17T12:17:56.705 INFO:tasks.ceph.mds.b:Started 2024-02-17T12:17:56.705 DEBUG:teuthology.parallel:result is None 2024-02-17T12:17:56.706 INFO:tasks.ceph.mds.d:Started 2024-02-17T12:17:56.707 DEBUG:teuthology.parallel:result is None 2024-02-17T12:17:56.707 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-02-17T12:17:56.788 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-02-17T12:17:56.788 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-02-17T12:17:56.798 INFO:tasks.ceph.mds.d.smithi116.stdout:starting mds.d at 2024-02-17T12:17:56.798 INFO:tasks.ceph.mds.b.smithi116.stdout:starting mds.b at 2024-02-17T12:17:56.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22c00640 1 Processor -- start 2024-02-17T12:17:56.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22c00640 1 -- start start 2024-02-17T12:17:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c1c150190 0x7f4c1c0aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4c1c0c2620 0x7f4c1c153490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c070c60 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c070370 con 0x7f4c1c0c2620 2024-02-17T12:17:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c070610 con 0x7f4c1c150190 2024-02-17T12:17:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4c1c0c2620 0x7f4c1c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4c1c0c2620 0x7f4c1c153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35178/0 (socket says 172.21.15.114:35178) 2024-02-17T12:17:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22200640 1 -- 172.21.15.114:0/198113331 learned_addr learned my addr 172.21.15.114:0/198113331 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:56.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c21800640 1 --2- 172.21.15.114:0/198113331 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c1c150190 0x7f4c1c0aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22200640 1 -- 172.21.15.114:0/198113331 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c1c150190 msgr2=0x7f4c1c0aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:56.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22200640 1 --2- 172.21.15.114:0/198113331 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c1c150190 0x7f4c1c0aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22200640 1 -- 172.21.15.114:0/198113331 >> v1:172.21.15.116:6789/0 conn(0x7f4c1c06fdc0 legacy=0x7f4c1c152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22200640 1 -- 172.21.15.114:0/198113331 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0708f0 con 0x7f4c1c0c2620 2024-02-17T12:17:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22200640 1 --2- 172.21.15.114:0/198113331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c0c2620 0x7f4c1c153490 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009e50 tx=0x7f4c1401d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977ee9d83c5bc906 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c1be00640 1 -- 172.21.15.114:0/198113331 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c140a5770 con 0x7f4c1c0c2620 2024-02-17T12:17:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c1be00640 1 -- 172.21.15.114:0/198113331 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c140a58d0 con 0x7f4c1c0c2620 2024-02-17T12:17:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c1be00640 1 -- 172.21.15.114:0/198113331 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c140a5c60 con 0x7f4c1c0c2620 2024-02-17T12:17:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22c00640 1 -- 172.21.15.114:0/198113331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c0c2620 msgr2=0x7f4c1c153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.845+0000 7f4c22c00640 1 --2- 172.21.15.114:0/198113331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c0c2620 0x7f4c1c153490 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009e50 tx=0x7f4c1401d400 comp rx=0 tx=0).stop 2024-02-17T12:17:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 -- 172.21.15.114:0/198113331 shutdown_connections 2024-02-17T12:17:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 --2- 172.21.15.114:0/198113331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c0c2620 0x7f4c1c153490 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 --2- 172.21.15.114:0/198113331 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c1c150190 0x7f4c1c0aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 -- 172.21.15.114:0/198113331 >> 172.21.15.114:0/198113331 conn(0x7f4c1c06ed70 msgr2=0x7f4c1c06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 -- 172.21.15.114:0/198113331 shutdown_connections 2024-02-17T12:17:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 -- 172.21.15.114:0/198113331 wait complete. 2024-02-17T12:17:56.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 Processor -- start 2024-02-17T12:17:56.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 -- start start 2024-02-17T12:17:56.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c06fdc0 0x7f4c1c0aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c1c0c2620 0x7f4c1c0a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c1c150190 0x7f4c1c1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0ac2b0 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c15d110 con 0x7f4c1c150190 2024-02-17T12:17:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0ad480 con 0x7f4c1c0c2620 2024-02-17T12:17:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c21800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c06fdc0 0x7f4c1c0aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c21800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c06fdc0 0x7f4c1c0aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35186/0 (socket says 172.21.15.114:35186) 2024-02-17T12:17:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c21800640 1 -- 172.21.15.114:0/3175091245 learned_addr learned my addr 172.21.15.114:0/3175091245 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22200640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c1c150190 0x7f4c1c1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c20e00640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c1c0c2620 0x7f4c1c0a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c21800640 1 -- 172.21.15.114:0/3175091245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c1c0c2620 msgr2=0x7f4c1c0a91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c21800640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c1c0c2620 0x7f4c1c0a91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c21800640 1 -- 172.21.15.114:0/3175091245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c1c150190 msgr2=0x7f4c1c1483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c21800640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c1c150190 0x7f4c1c1483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c21800640 1 -- 172.21.15.114:0/3175091245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14009b30 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22200640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c1c150190 0x7f4c1c1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c21800640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c06fdc0 0x7f4c1c0aca20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000d5f0 tx=0x7f4c1000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c19600640 1 -- 172.21.15.114:0/3175091245 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100125f0 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c19600640 1 -- 172.21.15.114:0/3175091245 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c10012750 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 -- 172.21.15.114:0/3175091245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c0abcf0 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c19600640 1 -- 172.21.15.114:0/3175091245 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10012b00 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.849+0000 7f4c22c00640 1 -- 172.21.15.114:0/3175091245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0a9b00 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.853+0000 7f4c22c00640 1 -- 172.21.15.114:0/3175091245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c068180 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.853+0000 7f4c19600640 1 -- 172.21.15.114:0/3175091245 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4c10012c60 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.853+0000 7f4c19600640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bfc066e40 0x7f4bfc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:56.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.853+0000 7f4c19600640 1 -- 172.21.15.114:0/3175091245 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4c10084c00 con 0x7f4c1c06fdc0 2024-02-17T12:17:56.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.853+0000 7f4c20e00640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bfc066e40 0x7f4bfc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:56.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.853+0000 7f4c20e00640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bfc066e40 0x7f4bfc069300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0c6b00 tx=0x7f4c08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:56.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:56.857+0000 7f4c19600640 1 -- 172.21.15.114:0/3175091245 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4c10051d30 con 0x7f4c1c06fdc0 2024-02-17T12:17:57.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.021+0000 7f4c22c00640 1 -- 172.21.15.114:0/3175091245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4c1c04eef0 con 0x7f4c1c06fdc0 2024-02-17T12:17:57.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c19600640 1 -- 172.21.15.114:0/3175091245 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4c100553f0 con 0x7f4c1c06fdc0 2024-02-17T12:17:57.761 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-02-17T12:17:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 -- 172.21.15.114:0/3175091245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bfc066e40 msgr2=0x7f4bfc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bfc066e40 0x7f4bfc069300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0c6b00 tx=0x7f4c08009040 comp rx=0 tx=0).stop 2024-02-17T12:17:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 -- 172.21.15.114:0/3175091245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c06fdc0 msgr2=0x7f4c1c0aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c06fdc0 0x7f4c1c0aca20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000d5f0 tx=0x7f4c1000dab0 comp rx=0 tx=0).stop 2024-02-17T12:17:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 -- 172.21.15.114:0/3175091245 shutdown_connections 2024-02-17T12:17:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c1c150190 0x7f4c1c1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c1c0c2620 0x7f4c1c0a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bfc066e40 0x7f4bfc069300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 --2- 172.21.15.114:0/3175091245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c1c06fdc0 0x7f4c1c0aca20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 -- 172.21.15.114:0/3175091245 >> 172.21.15.114:0/3175091245 conn(0x7f4c1c06ed70 msgr2=0x7f4c1c152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:57.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 -- 172.21.15.114:0/3175091245 shutdown_connections 2024-02-17T12:17:57.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.757+0000 7f4c22c00640 1 -- 172.21.15.114:0/3175091245 wait complete. 2024-02-17T12:17:57.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-02-17T12:17:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f8000640 1 Processor -- start 2024-02-17T12:17:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f8000640 1 -- start start 2024-02-17T12:17:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f8000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2f0152540 0x7fe2f006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f8000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2f00c6460 0x7fe2f0158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f8000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f0155dd0 con 0x7fe2f0154e30 2024-02-17T12:17:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f8000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f01588c0 con 0x7fe2f00c6460 2024-02-17T12:17:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f8000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0155810 con 0x7fe2f0152540 2024-02-17T12:17:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f4c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2f00c6460 0x7fe2f0158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f4c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2f00c6460 0x7fe2f0158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35192/0 (socket says 172.21.15.114:35192) 2024-02-17T12:17:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f4c00640 1 -- 172.21.15.114:0/3844213728 learned_addr learned my addr 172.21.15.114:0/3844213728 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f5600640 1 --2- 172.21.15.114:0/3844213728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2f0152540 0x7fe2f006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f4c00640 1 -- 172.21.15.114:0/3844213728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2f0152540 msgr2=0x7fe2f006ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f4c00640 1 --2- 172.21.15.114:0/3844213728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2f0152540 0x7fe2f006ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f4c00640 1 -- 172.21.15.114:0/3844213728 >> v1:172.21.15.116:6789/0 conn(0x7fe2f0154e30 legacy=0x7fe2f00aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.925+0000 7fe2f4c00640 1 -- 172.21.15.114:0/3844213728 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0155af0 con 0x7fe2f00c6460 2024-02-17T12:17:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2f4c00640 1 --2- 172.21.15.114:0/3844213728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f00c6460 0x7fe2f0158d50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009870 tx=0x7fe2dc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8ad2b569f479f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2efe00640 1 -- 172.21.15.114:0/3844213728 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc004230 con 0x7fe2f00c6460 2024-02-17T12:17:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2efe00640 1 -- 172.21.15.114:0/3844213728 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc0a7050 con 0x7fe2f00c6460 2024-02-17T12:17:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2efe00640 1 -- 172.21.15.114:0/3844213728 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc003620 con 0x7fe2f00c6460 2024-02-17T12:17:57.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2f8000640 1 -- 172.21.15.114:0/3844213728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f00c6460 msgr2=0x7fe2f0158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:57.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2f8000640 1 --2- 172.21.15.114:0/3844213728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f00c6460 0x7fe2f0158d50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009870 tx=0x7fe2dc01c440 comp rx=0 tx=0).stop 2024-02-17T12:17:57.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2f8000640 1 -- 172.21.15.114:0/3844213728 shutdown_connections 2024-02-17T12:17:57.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2f8000640 1 --2- 172.21.15.114:0/3844213728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f00c6460 0x7fe2f0158d50 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:57.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2f8000640 1 --2- 172.21.15.114:0/3844213728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2f0152540 0x7fe2f006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:57.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2f8000640 1 -- 172.21.15.114:0/3844213728 >> 172.21.15.114:0/3844213728 conn(0x7fe2f00c4f20 msgr2=0x7fe2f00c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:57.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2f8000640 1 -- 172.21.15.114:0/3844213728 shutdown_connections 2024-02-17T12:17:57.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.929+0000 7fe2f8000640 1 -- 172.21.15.114:0/3844213728 wait complete. 2024-02-17T12:17:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f8000640 1 Processor -- start 2024-02-17T12:17:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f8000640 1 -- start start 2024-02-17T12:17:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f8000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2f00c6460 0x7fe2f00a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f8000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f0152540 0x7fe2f014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f8000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f0154e30 0x7fe2f014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f8000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0144490 con 0x7fe2f0152540 2024-02-17T12:17:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f8000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0144700 con 0x7fe2f0154e30 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f8000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f006c660 con 0x7fe2f00c6460 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f0152540 0x7fe2f014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f0152540 0x7fe2f014c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35202/0 (socket says 172.21.15.114:35202) 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f4c00640 1 -- 172.21.15.114:0/829207281 learned_addr learned my addr 172.21.15.114:0/829207281 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f6000640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f0154e30 0x7fe2f014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f5600640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2f00c6460 0x7fe2f00a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f4c00640 1 -- 172.21.15.114:0/829207281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2f00c6460 msgr2=0x7fe2f00a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f4c00640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2f00c6460 0x7fe2f00a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f4c00640 1 -- 172.21.15.114:0/829207281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f0154e30 msgr2=0x7fe2f014c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f4c00640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f0154e30 0x7fe2f014c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f4c00640 1 -- 172.21.15.114:0/829207281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0094d0 con 0x7fe2f0152540 2024-02-17T12:17:57.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f4c00640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f0152540 0x7fe2f014c170 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0ae040 tx=0x7fe2dc0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2ed600640 1 -- 172.21.15.114:0/829207281 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc003bb0 con 0x7fe2f0152540 2024-02-17T12:17:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2ed600640 1 -- 172.21.15.114:0/829207281 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc003d10 con 0x7fe2f0152540 2024-02-17T12:17:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f8000640 1 -- 172.21.15.114:0/829207281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f006c940 con 0x7fe2f0152540 2024-02-17T12:17:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2ed600640 1 -- 172.21.15.114:0/829207281 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0ab680 con 0x7fe2f0152540 2024-02-17T12:17:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.933+0000 7fe2f8000640 1 -- 172.21.15.114:0/829207281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f006cf00 con 0x7fe2f0152540 2024-02-17T12:17:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.937+0000 7fe2f8000640 1 -- 172.21.15.114:0/829207281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f006d0f0 con 0x7fe2f0152540 2024-02-17T12:17:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.937+0000 7fe2ed600640 1 -- 172.21.15.114:0/829207281 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe2dc0ab7e0 con 0x7fe2f0152540 2024-02-17T12:17:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.937+0000 7fe2ed600640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2d0066e70 0x7fe2d0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.937+0000 7fe2ed600640 1 -- 172.21.15.114:0/829207281 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe2dc11eb90 con 0x7fe2f0152540 2024-02-17T12:17:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.937+0000 7fe2f5600640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2d0066e70 0x7fe2d0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.937+0000 7fe2f5600640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2d0066e70 0x7fe2d0069330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4003b90 tx=0x7fe2e40098a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:57.941+0000 7fe2ed600640 1 -- 172.21.15.114:0/829207281 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe2dc0ebe00 con 0x7fe2f0152540 2024-02-17T12:17:58.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 -- 172.21.15.114:0/829207281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe2f0074840 con 0x7fe2f0152540 2024-02-17T12:17:58.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2ed600640 1 -- 172.21.15.114:0/829207281 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5021 (secure 0 0 0) 0x7fe2dc0b9090 con 0x7fe2f0152540 2024-02-17T12:17:58.156 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:58.156 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:17:58.156 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-02-17T12:17:58.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.156 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlC5lYABAA6azd56jLhAjZE9g08V7QEg==", 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-02-17T12:17:58.157 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlN91JDBAA39pNGkFXITBkFPknKh80Zg==", 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlcfWBBxAAcGpOI9tt2XFAE53Z5D3IGQ==", 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:17:58.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9Bl6zR5ExAAhNGl0iGdaBXJGCuUW+v7mg==", 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.159 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBVo9BlIUGPHxAAYFvkX6XSdQ2zrMlbG0tyLQ==", 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-02-17T12:17:58.160 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBYo9BlhFOpJRAAw6abcA91k7UIqP7ZI0DJXw==", 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBbo9BlcGMaLBAAowE5MXll20j9H2Bu9ENlHA==", 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.161 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBeo9BlCjw4MxAAj8jUcH+AdAKzUGE1FV93AA==", 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-02-17T12:17:58.162 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBko9BleeA4OxAAyqyptyDYwOEwVuofLJ2FIA==", 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBoo9BlDQvsBBAARlmMLmSs370Rf6QXYzUURw==", 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:58.163 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBro9Bl/IOLCxAACdC11z4y11nLvXVOngFJJA==", 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.164 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBuo9Bl2traERAAej15lW/SHoN/AF0WWZUHQA==", 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlaXt+FxAAn4YhbPPnUC6y0giRDPuYyQ==", 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.165 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlffPTGhAA6uMply4Nxw6KXsGwVHriZg==", 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw pool=cephfs2_data" 2024-02-17T12:17:58.166 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBRo9Bl3p5kIBAAlqg+W5lq86eSDqVE/pYx9Q==", 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.168 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.testuser", 2024-02-17T12:17:58.168 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDco9BlQSTJBRAAk9inCLXcElmys8nQK+rN9g==", 2024-02-17T12:17:58.168 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.168 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow rw fsname=cephfs", 2024-02-17T12:17:58.168 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r fsname=cephfs", 2024-02-17T12:17:58.168 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-02-17T12:17:58.168 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.169 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-02-17T12:17:58.169 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBRo9BlkgiBNxAAv1cRMj0JAsCW3C1QET2fxg==", 2024-02-17T12:17:58.169 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.169 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-02-17T12:17:58.169 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-02-17T12:17:58.169 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.169 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:17:58.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:58.170 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-02-17T12:17:58.170 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBRo9Bl3bHCMxAAWLsuBBXWkaHkJFObZxBxpQ==", 2024-02-17T12:17:58.170 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:17:58.170 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-02-17T12:17:58.170 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-02-17T12:17:58.170 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:17:58.170 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.170 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:58.170 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-02-17T12:17:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:17:58.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 -- 172.21.15.114:0/829207281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2d0066e70 msgr2=0x7fe2d0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2d0066e70 0x7fe2d0069330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4003b90 tx=0x7fe2e40098a0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 -- 172.21.15.114:0/829207281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f0152540 msgr2=0x7fe2f014c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f0152540 0x7fe2f014c170 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0ae040 tx=0x7fe2dc0191e0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 -- 172.21.15.114:0/829207281 shutdown_connections 2024-02-17T12:17:58.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2f0154e30 0x7fe2f014c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe2d0066e70 0x7fe2d0069330 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2f0152540 0x7fe2f014c170 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 --2- 172.21.15.114:0/829207281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe2f00c6460 0x7fe2f00a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 -- 172.21.15.114:0/829207281 >> 172.21.15.114:0/829207281 conn(0x7fe2f00c4f20 msgr2=0x7fe2f014e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:58.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 -- 172.21.15.114:0/829207281 shutdown_connections 2024-02-17T12:17:58.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.153+0000 7fe2f8000640 1 -- 172.21.15.114:0/829207281 wait complete. 2024-02-17T12:17:58.177 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2024-02-17T12:17:58.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0b2800640 1 Processor -- start 2024-02-17T12:17:58.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0b2800640 1 -- start start 2024-02-17T12:17:58.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0b2800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa0ac0c1eb0 0x7fa0ac15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0b2800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ac0a9420 con 0x7fa0ac0c2580 2024-02-17T12:17:58.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0b2800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ac152850 con 0x7fa0ac14f110 2024-02-17T12:17:58.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0b2800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac14f4f0 con 0x7fa0ac0c1eb0 2024-02-17T12:17:58.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aaa00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa0ac0c2580 0x7fa0ac0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35068/0 (socket says 172.21.15.114:35068) 2024-02-17T12:17:58.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aaa00640 1 -- 172.21.15.114:0/1118230470 learned_addr learned my addr 172.21.15.114:0/1118230470 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:58.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761975084 0 0) 0x7fa0ac0a9420 con 0x7fa0ac0c2580 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa090005740 con 0x7fa0ac0c2580 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0abe00640 1 --2- 172.21.15.114:0/1118230470 >> v2:172.21.15.116:3300/0 conn(0x7fa0ac0c1eb0 0x7fa0ac15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4007951609 0 0) 0x7fa090005740 con 0x7fa0ac0c2580 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 >> v2:172.21.15.116:3300/0 conn(0x7fa0ac0c1eb0 msgr2=0x7fa0ac15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 --2- 172.21.15.114:0/1118230470 >> v2:172.21.15.116:3300/0 conn(0x7fa0ac0c1eb0 0x7fa0ac15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 >> v1:172.21.15.116:6789/0 conn(0x7fa0ac14f110 legacy=0x7fa0ac0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac0a9670 con 0x7fa0ac0c2580 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fa094001680 con 0x7fa0ac0c2580 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 >> v1:172.21.15.114:6789/0 conn(0x7fa0ac0c2580 legacy=0x7fa0ac0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa090005be0 0x7fa090006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0900069e0 0x7fa090006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0900073f0 0x7fa09000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac14f4f0 con 0x7fa0900069e0 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09000e340 con 0x7fa090005be0 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09000e500 con 0x7fa0900073f0 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0aaa00640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0900069e0 0x7fa090006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.309+0000 7fa0ab400640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa090005be0 0x7fa090006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0abe00640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0900073f0 0x7fa09000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0aaa00640 1 -- 172.21.15.114:0/1118230470 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0900073f0 msgr2=0x7fa09000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0aaa00640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0900073f0 0x7fa09000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0aaa00640 1 -- 172.21.15.114:0/1118230470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa090005be0 msgr2=0x7fa090006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0aaa00640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa090005be0 0x7fa090006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0aaa00640 1 -- 172.21.15.114:0/1118230470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa090005740 con 0x7fa0900069e0 2024-02-17T12:17:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0abe00640 1 -- 172.21.15.114:0/1118230470 reap_dead start 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0aaa00640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0900069e0 0x7fa090006e60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0c29a0 tx=0x7fa09401caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24d921c9c348c01 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940058e0 con 0x7fa0900069e0 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094005a40 con 0x7fa0900069e0 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0aa000640 1 -- 172.21.15.114:0/1118230470 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094005df0 con 0x7fa0900069e0 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0b2800640 1 -- 172.21.15.114:0/1118230470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0900069e0 msgr2=0x7fa090006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0b2800640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0900069e0 0x7fa090006e60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0c29a0 tx=0x7fa09401caa0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0b2800640 1 -- 172.21.15.114:0/1118230470 shutdown_connections 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0b2800640 1 --2- 172.21.15.114:0/1118230470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0900069e0 0x7fa090006e60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0b2800640 1 -- 172.21.15.114:0/1118230470 >> 172.21.15.114:0/1118230470 conn(0x7fa0ac0a8490 msgr2=0x7fa0ac0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.313+0000 7fa0b2800640 1 -- 172.21.15.114:0/1118230470 shutdown_connections 2024-02-17T12:17:58.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 -- 172.21.15.114:0/1118230470 wait complete. 2024-02-17T12:17:58.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 Processor -- start 2024-02-17T12:17:58.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 -- start start 2024-02-17T12:17:58.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0900069e0 0x7fa0ac1f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ac1f1180 0x7fa0ac13f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0ac13fe60 0x7fa0ac0c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0c5a40 con 0x7fa0ac1f1180 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac151460 con 0x7fa0900069e0 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac150850 con 0x7fa0ac13fe60 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0aaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ac1f1180 0x7fa0ac13f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0aaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ac1f1180 0x7fa0ac13f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35220/0 (socket says 172.21.15.114:35220) 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0aaa00640 1 -- 172.21.15.114:0/560482271 learned_addr learned my addr 172.21.15.114:0/560482271 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0ab400640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0900069e0 0x7fa0ac1f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0abe00640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0ac13fe60 0x7fa0ac0c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0aaa00640 1 -- 172.21.15.114:0/560482271 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0ac13fe60 msgr2=0x7fa0ac0c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0aaa00640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0ac13fe60 0x7fa0ac0c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0aaa00640 1 -- 172.21.15.114:0/560482271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0900069e0 msgr2=0x7fa0ac1f0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0aaa00640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0900069e0 0x7fa0ac1f0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0aaa00640 1 -- 172.21.15.114:0/560482271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac150b30 con 0x7fa0ac1f1180 2024-02-17T12:17:58.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0aaa00640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ac1f1180 0x7fa0ac13f920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa09401cf80 tx=0x7fa090007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:58.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0a3400640 1 -- 172.21.15.114:0/560482271 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940b4070 con 0x7fa0ac1f1180 2024-02-17T12:17:58.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0a3400640 1 -- 172.21.15.114:0/560482271 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094001480 con 0x7fa0ac1f1180 2024-02-17T12:17:58.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0a3400640 1 -- 172.21.15.114:0/560482271 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940a5e10 con 0x7fa0ac1f1180 2024-02-17T12:17:58.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 -- 172.21.15.114:0/560482271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac150e10 con 0x7fa0ac1f1180 2024-02-17T12:17:58.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.317+0000 7fa0b2800640 1 -- 172.21.15.114:0/560482271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac14c890 con 0x7fa0ac1f1180 2024-02-17T12:17:58.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.321+0000 7fa0b2800640 1 -- 172.21.15.114:0/560482271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ac151610 con 0x7fa0ac1f1180 2024-02-17T12:17:58.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.321+0000 7fa0a3400640 1 -- 172.21.15.114:0/560482271 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa094005bb0 con 0x7fa0ac1f1180 2024-02-17T12:17:58.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.321+0000 7fa0a3400640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 0x7fa088069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.321+0000 7fa0a3400640 1 -- 172.21.15.114:0/560482271 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa09411db20 con 0x7fa0ac1f1180 2024-02-17T12:17:58.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.321+0000 7fa0ab400640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 0x7fa088069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.321+0000 7fa0ab400640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 0x7fa088069300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa09c000c10 tx=0x7fa09c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:58.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.325+0000 7fa0a3400640 1 -- 172.21.15.114:0/560482271 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa0ac151610 con 0x7fa0ac1f1180 2024-02-17T12:17:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.533+0000 7fa0b2800640 1 -- 172.21.15.114:0/560482271 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7fa0ac1515d0 con 0x7fa0ac1f1180 2024-02-17T12:17:58.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.533+0000 7fa0a3400640 1 -- 172.21.15.114:0/560482271 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v12) v1 ==== 85+0+0 (secure 0 0 0) 0x7fa094005e60 con 0x7fa0ac1f1180 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 -- 172.21.15.114:0/560482271 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 msgr2=0x7fa088069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 0x7fa088069300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa09c000c10 tx=0x7fa09c009040 comp rx=0 tx=0).stop 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 -- 172.21.15.114:0/560482271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ac1f1180 msgr2=0x7fa0ac13f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ac1f1180 0x7fa0ac13f920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa09401cf80 tx=0x7fa090007a10 comp rx=0 tx=0).stop 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 -- 172.21.15.114:0/560482271 shutdown_connections 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0ac13fe60 0x7fa0ac0c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 0x7fa088069300 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ac1f1180 0x7fa0ac13f920 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 --2- 172.21.15.114:0/560482271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0900069e0 0x7fa0ac1f0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 -- 172.21.15.114:0/560482271 >> 172.21.15.114:0/560482271 conn(0x7fa0ac0a8490 msgr2=0x7fa0ac0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 -- 172.21.15.114:0/560482271 shutdown_connections 2024-02-17T12:17:58.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.537+0000 7fa0b2800640 1 -- 172.21.15.114:0/560482271 wait complete. 2024-02-17T12:17:58.559 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:17:58.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.689+0000 7f2464800640 1 Processor -- start 2024-02-17T12:17:58.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.689+0000 7f2464800640 1 -- start start 2024-02-17T12:17:58.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.689+0000 7f2464800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c06db50 0x7f245c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.689+0000 7f2464800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f245c150490 0x7f245c152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.689+0000 7f2464800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245c156270 con 0x7f245c0c25a0 2024-02-17T12:17:58.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.689+0000 7f2464800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c06f090 con 0x7f245c150490 2024-02-17T12:17:58.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.689+0000 7f2464800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c071630 con 0x7f245c06db50 2024-02-17T12:17:58.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.689+0000 7f2461e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f245c0c25a0 0x7f245c06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35070/0 (socket says 172.21.15.114:35070) 2024-02-17T12:17:58.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.689+0000 7f2461e00640 1 -- 172.21.15.114:0/3057939578 learned_addr learned my addr 172.21.15.114:0/3057939578 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:58.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.689+0000 7f2462800640 1 --2- 172.21.15.114:0/3057939578 >> v2:172.21.15.114:3300/0 conn(0x7f245c150490 0x7f245c152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2461400640 1 --2- 172.21.15.114:0/3057939578 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c06db50 0x7f245c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2460a00640 1 -- 172.21.15.114:0/3057939578 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966942406 0 0) 0x7f245c156270 con 0x7f245c0c25a0 2024-02-17T12:17:58.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2462800640 1 -- 172.21.15.114:0/3057939578 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c06db50 msgr2=0x7f245c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:58.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2462800640 1 --2- 172.21.15.114:0/3057939578 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c06db50 0x7f245c14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2462800640 1 -- 172.21.15.114:0/3057939578 >> v1:172.21.15.114:6789/0 conn(0x7f245c0c25a0 legacy=0x7f245c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2462800640 1 -- 172.21.15.114:0/3057939578 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c156550 con 0x7f245c150490 2024-02-17T12:17:58.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2462800640 1 --2- 172.21.15.114:0/3057939578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c150490 0x7f245c152c50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2458009d90 tx=0x7f245801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68e0d0fd5c16d03 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:58.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2460a00640 1 -- 172.21.15.114:0/3057939578 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c1539a0 con 0x7f245c150490 2024-02-17T12:17:58.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2460a00640 1 -- 172.21.15.114:0/3057939578 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24580a58e0 con 0x7f245c150490 2024-02-17T12:17:58.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2460a00640 1 -- 172.21.15.114:0/3057939578 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24580a5c70 con 0x7f245c150490 2024-02-17T12:17:58.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2464800640 1 -- 172.21.15.114:0/3057939578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c150490 msgr2=0x7f245c152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.693+0000 7f2464800640 1 --2- 172.21.15.114:0/3057939578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c150490 0x7f245c152c50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2458009d90 tx=0x7f245801c820 comp rx=0 tx=0).stop 2024-02-17T12:17:58.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 -- 172.21.15.114:0/3057939578 shutdown_connections 2024-02-17T12:17:58.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 --2- 172.21.15.114:0/3057939578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c150490 0x7f245c152c50 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 --2- 172.21.15.114:0/3057939578 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c06db50 0x7f245c14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 -- 172.21.15.114:0/3057939578 >> 172.21.15.114:0/3057939578 conn(0x7f245c0a8490 msgr2=0x7f245c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:58.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 -- 172.21.15.114:0/3057939578 shutdown_connections 2024-02-17T12:17:58.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 -- 172.21.15.114:0/3057939578 wait complete. 2024-02-17T12:17:58.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 Processor -- start 2024-02-17T12:17:58.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 -- start start 2024-02-17T12:17:58.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c06db50 0x7f245c13fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c0c25a0 0x7f245c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f245c150490 0x7f245c146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c14f130 con 0x7f245c06db50 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c1ee700 con 0x7f245c150490 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c14ec30 con 0x7f245c0c25a0 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c06db50 0x7f245c13fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c06db50 0x7f245c13fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35236/0 (socket says 172.21.15.114:35236) 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461e00640 1 -- 172.21.15.114:0/2143078712 learned_addr learned my addr 172.21.15.114:0/2143078712 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2462800640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f245c150490 0x7f245c146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461400640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c0c25a0 0x7f245c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461e00640 1 -- 172.21.15.114:0/2143078712 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c0c25a0 msgr2=0x7f245c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461e00640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c0c25a0 0x7f245c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461e00640 1 -- 172.21.15.114:0/2143078712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f245c150490 msgr2=0x7f245c146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461e00640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f245c150490 0x7f245c146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461e00640 1 -- 172.21.15.114:0/2143078712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458009a70 con 0x7f245c06db50 2024-02-17T12:17:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461400640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c0c25a0 0x7f245c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:17:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2461e00640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c06db50 0x7f245c13fb40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f24500011f0 tx=0x7f245000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2456000640 1 -- 172.21.15.114:0/2143078712 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500074e0 con 0x7f245c06db50 2024-02-17T12:17:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2456000640 1 -- 172.21.15.114:0/2143078712 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450007640 con 0x7f245c06db50 2024-02-17T12:17:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 -- 172.21.15.114:0/2143078712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c14f550 con 0x7f245c06db50 2024-02-17T12:17:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2456000640 1 -- 172.21.15.114:0/2143078712 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450004a10 con 0x7f245c06db50 2024-02-17T12:17:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.697+0000 7f2464800640 1 -- 172.21.15.114:0/2143078712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c1ee950 con 0x7f245c06db50 2024-02-17T12:17:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.701+0000 7f2464800640 1 -- 172.21.15.114:0/2143078712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c14fa70 con 0x7f245c06db50 2024-02-17T12:17:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.701+0000 7f2456000640 1 -- 172.21.15.114:0/2143078712 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2450004b70 con 0x7f245c06db50 2024-02-17T12:17:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.701+0000 7f2456000640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2440066e40 0x7f2440069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.701+0000 7f2456000640 1 -- 172.21.15.114:0/2143078712 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2450083b50 con 0x7f245c06db50 2024-02-17T12:17:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.701+0000 7f2461400640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2440066e40 0x7f2440069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:58.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.701+0000 7f2461400640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2440066e40 0x7f2440069300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f245c147310 tx=0x7f244c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:58.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.705+0000 7f2456000640 1 -- 172.21.15.114:0/2143078712 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2450050d30 con 0x7f245c06db50 2024-02-17T12:17:58.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.865+0000 7f2464800640 1 -- 172.21.15.114:0/2143078712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f245c1eeb70 con 0x7f245c06db50 2024-02-17T12:17:58.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.865+0000 7f2456000640 1 -- 172.21.15.114:0/2143078712 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+12903 (secure 0 0 0) 0x7f2450018020 con 0x7f245c06db50 2024-02-17T12:17:58.871 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:58.871 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:17:57.767155+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:17:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 -- 172.21.15.114:0/2143078712 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2440066e40 msgr2=0x7f2440069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2440066e40 0x7f2440069300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f245c147310 tx=0x7f244c008040 comp rx=0 tx=0).stop 2024-02-17T12:17:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 -- 172.21.15.114:0/2143078712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c06db50 msgr2=0x7f245c13fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c06db50 0x7f245c13fb40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f24500011f0 tx=0x7f245000c9b0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 -- 172.21.15.114:0/2143078712 shutdown_connections 2024-02-17T12:17:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f245c150490 0x7f245c146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f245c0c25a0 0x7f245c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2440066e40 0x7f2440069300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 --2- 172.21.15.114:0/2143078712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f245c06db50 0x7f245c13fb40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 -- 172.21.15.114:0/2143078712 >> 172.21.15.114:0/2143078712 conn(0x7f245c0a8490 msgr2=0x7f245c0c1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 -- 172.21.15.114:0/2143078712 shutdown_connections 2024-02-17T12:17:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:58.869+0000 7f2464800640 1 -- 172.21.15.114:0/2143078712 wait complete. 2024-02-17T12:17:58.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:17:58.892 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:17:59.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.025+0000 7fbe8d200640 1 Processor -- start 2024-02-17T12:17:59.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.025+0000 7fbe8d200640 1 -- start start 2024-02-17T12:17:59.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.025+0000 7fbe8d200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbe8814f110 0x7fbe880c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.025+0000 7fbe8d200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe880c2580 0x7fbe880aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.025+0000 7fbe8d200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe880a9420 con 0x7fbe880c1eb0 2024-02-17T12:17:59.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.025+0000 7fbe8d200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8814f4f0 con 0x7fbe8814f110 2024-02-17T12:17:59.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.025+0000 7fbe8d200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880aae80 con 0x7fbe880c2580 2024-02-17T12:17:59.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe85400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe880c2580 0x7fbe880aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe85e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbe8814f110 0x7fbe880c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe86800640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fbe880c1eb0 0x7fbe88155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:49226/0 (socket says 172.21.15.114:49226) 2024-02-17T12:17:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe86800640 1 -- 172.21.15.114:0/130462049 learned_addr learned my addr 172.21.15.114:0/130462049 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe85400640 1 -- 172.21.15.114:0/130462049 >> v2:172.21.15.116:3300/0 conn(0x7fbe8814f110 msgr2=0x7fbe880c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe85400640 1 --2- 172.21.15.114:0/130462049 >> v2:172.21.15.116:3300/0 conn(0x7fbe8814f110 0x7fbe880c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe85400640 1 -- 172.21.15.114:0/130462049 >> v1:172.21.15.116:6789/0 conn(0x7fbe880c1eb0 legacy=0x7fbe88155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe85400640 1 -- 172.21.15.114:0/130462049 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88152850 con 0x7fbe880c2580 2024-02-17T12:17:59.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe85e00640 1 --2- 172.21.15.114:0/130462049 >> v2:172.21.15.116:3300/0 conn(0x7fbe8814f110 0x7fbe880c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:17:59.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe85400640 1 --2- 172.21.15.114:0/130462049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe880c2580 0x7fbe880aa150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe740097c0 tx=0x7fbe7401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb582c3966219631 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:59.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe84a00640 1 -- 172.21.15.114:0/130462049 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740ac640 con 0x7fbe880c2580 2024-02-17T12:17:59.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe84a00640 1 -- 172.21.15.114:0/130462049 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe740ac7a0 con 0x7fbe880c2580 2024-02-17T12:17:59.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.029+0000 7fbe84a00640 1 -- 172.21.15.114:0/130462049 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740acb30 con 0x7fbe880c2580 2024-02-17T12:17:59.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 -- 172.21.15.114:0/130462049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe880c2580 msgr2=0x7fbe880aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 --2- 172.21.15.114:0/130462049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe880c2580 0x7fbe880aa150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe740097c0 tx=0x7fbe7401c3e0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 -- 172.21.15.114:0/130462049 shutdown_connections 2024-02-17T12:17:59.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 --2- 172.21.15.114:0/130462049 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe880c2580 0x7fbe880aa150 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 --2- 172.21.15.114:0/130462049 >> v2:172.21.15.116:3300/0 conn(0x7fbe8814f110 0x7fbe880c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 -- 172.21.15.114:0/130462049 >> 172.21.15.114:0/130462049 conn(0x7fbe880a8490 msgr2=0x7fbe880a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:59.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 -- 172.21.15.114:0/130462049 shutdown_connections 2024-02-17T12:17:59.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 -- 172.21.15.114:0/130462049 wait complete. 2024-02-17T12:17:59.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 Processor -- start 2024-02-17T12:17:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 -- start start 2024-02-17T12:17:59.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe880c1eb0 0x7fbe88153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe880c2580 0x7fbe8806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe8814f110 0x7fbe881f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8814cd70 con 0x7fbe880c1eb0 2024-02-17T12:17:59.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88151c00 con 0x7fbe880c2580 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe8d200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe881f1650 con 0x7fbe8814f110 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe85e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe880c1eb0 0x7fbe88153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe85e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe880c1eb0 0x7fbe88153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35250/0 (socket says 172.21.15.114:35250) 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe85e00640 1 -- 172.21.15.114:0/3749506514 learned_addr learned my addr 172.21.15.114:0/3749506514 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe85400640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe880c2580 0x7fbe8806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe86800640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe8814f110 0x7fbe881f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe85e00640 1 -- 172.21.15.114:0/3749506514 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe8814f110 msgr2=0x7fbe881f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe85e00640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe8814f110 0x7fbe881f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe85e00640 1 -- 172.21.15.114:0/3749506514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe880c2580 msgr2=0x7fbe8806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe85e00640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe880c2580 0x7fbe8806eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe85e00640 1 -- 172.21.15.114:0/3749506514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78009420 con 0x7fbe880c1eb0 2024-02-17T12:17:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.033+0000 7fbe86800640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe8814f110 0x7fbe881f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:17:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe85e00640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe880c1eb0 0x7fbe88153110 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800e9b0 tx=0x7fbe7800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe7e000640 1 -- 172.21.15.114:0/3749506514 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800ca00 con 0x7fbe880c1eb0 2024-02-17T12:17:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe7e000640 1 -- 172.21.15.114:0/3749506514 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7800cb60 con 0x7fbe880c1eb0 2024-02-17T12:17:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe8d200640 1 -- 172.21.15.114:0/3749506514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe74009420 con 0x7fbe880c1eb0 2024-02-17T12:17:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe7e000640 1 -- 172.21.15.114:0/3749506514 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78013470 con 0x7fbe880c1eb0 2024-02-17T12:17:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe8d200640 1 -- 172.21.15.114:0/3749506514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8814acf0 con 0x7fbe880c1eb0 2024-02-17T12:17:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe8d200640 1 -- 172.21.15.114:0/3749506514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe88074840 con 0x7fbe880c1eb0 2024-02-17T12:17:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe7e000640 1 -- 172.21.15.114:0/3749506514 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbe780135d0 con 0x7fbe880c1eb0 2024-02-17T12:17:59.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe7e000640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbe68066e40 0x7fbe68069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe7e000640 1 -- 172.21.15.114:0/3749506514 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe78084d20 con 0x7fbe880c1eb0 2024-02-17T12:17:59.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.037+0000 7fbe85400640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbe68066e40 0x7fbe68069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.041+0000 7fbe85400640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbe68066e40 0x7fbe68069300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbe740ae000 tx=0x7fbe74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.041+0000 7fbe7e000640 1 -- 172.21.15.114:0/3749506514 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbe78051e50 con 0x7fbe880c1eb0 2024-02-17T12:17:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 -- 172.21.15.114:0/3749506514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe88148f50 con 0x7fbe880c1eb0 2024-02-17T12:17:59.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe7e000640 1 -- 172.21.15.114:0/3749506514 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe78055510 con 0x7fbe880c1eb0 2024-02-17T12:17:59.200 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:17:59.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 -- 172.21.15.114:0/3749506514 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbe68066e40 msgr2=0x7fbe68069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbe68066e40 0x7fbe68069300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbe740ae000 tx=0x7fbe74008040 comp rx=0 tx=0).stop 2024-02-17T12:17:59.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 -- 172.21.15.114:0/3749506514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe880c1eb0 msgr2=0x7fbe88153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe880c1eb0 0x7fbe88153110 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800e9b0 tx=0x7fbe7800ee70 comp rx=0 tx=0).stop 2024-02-17T12:17:59.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 -- 172.21.15.114:0/3749506514 shutdown_connections 2024-02-17T12:17:59.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbe8814f110 0x7fbe881f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe880c2580 0x7fbe8806eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbe68066e40 0x7fbe68069300 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 --2- 172.21.15.114:0/3749506514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe880c1eb0 0x7fbe88153110 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 -- 172.21.15.114:0/3749506514 >> 172.21.15.114:0/3749506514 conn(0x7fbe880a8490 msgr2=0x7fbe880a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:59.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 -- 172.21.15.114:0/3749506514 shutdown_connections 2024-02-17T12:17:59.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.197+0000 7fbe8d200640 1 -- 172.21.15.114:0/3749506514 wait complete. 2024-02-17T12:17:59.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T12:17:59.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.353+0000 7f0699800640 1 Processor -- start 2024-02-17T12:17:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.353+0000 7f0699800640 1 -- start start 2024-02-17T12:17:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.353+0000 7f0699800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0694152570 0x7f06940c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.353+0000 7f0699800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06940c1920 0x7f06941551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.353+0000 7f0699800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06940c8000 con 0x7f06940c5330 2024-02-17T12:17:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.353+0000 7f0699800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0694070ef0 con 0x7f06940c1920 2024-02-17T12:17:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.353+0000 7f0699800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06940c7a00 con 0x7f0694152570 2024-02-17T12:17:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.353+0000 7f0693400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06940c1920 0x7f06941551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0693400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06940c1920 0x7f06941551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35264/0 (socket says 172.21.15.114:35264) 2024-02-17T12:17:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0693400640 1 -- 172.21.15.114:0/1876736137 learned_addr learned my addr 172.21.15.114:0/1876736137 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0693e00640 1 --2- 172.21.15.114:0/1876736137 >> v2:172.21.15.116:3300/0 conn(0x7f0694152570 0x7f06940c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0693400640 1 -- 172.21.15.114:0/1876736137 >> v2:172.21.15.116:3300/0 conn(0x7f0694152570 msgr2=0x7f06940c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0693400640 1 --2- 172.21.15.114:0/1876736137 >> v2:172.21.15.116:3300/0 conn(0x7f0694152570 0x7f06940c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0693400640 1 -- 172.21.15.114:0/1876736137 >> v1:172.21.15.116:6789/0 conn(0x7f06940c5330 legacy=0x7f06941556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0693400640 1 -- 172.21.15.114:0/1876736137 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694070c10 con 0x7f06940c1920 2024-02-17T12:17:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0693400640 1 --2- 172.21.15.114:0/1876736137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06940c1920 0x7f06941551b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0694070170 tx=0x7f067c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9bd67117ca7f8c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0692a00640 1 -- 172.21.15.114:0/1876736137 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c0aa610 con 0x7f06940c1920 2024-02-17T12:17:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0692a00640 1 -- 172.21.15.114:0/1876736137 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c0a6040 con 0x7f06940c1920 2024-02-17T12:17:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.357+0000 7f0692a00640 1 -- 172.21.15.114:0/1876736137 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c0aa990 con 0x7f06940c1920 2024-02-17T12:17:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 -- 172.21.15.114:0/1876736137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06940c1920 msgr2=0x7f06941551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 --2- 172.21.15.114:0/1876736137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06940c1920 0x7f06941551b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0694070170 tx=0x7f067c01c490 comp rx=0 tx=0).stop 2024-02-17T12:17:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 -- 172.21.15.114:0/1876736137 shutdown_connections 2024-02-17T12:17:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 --2- 172.21.15.114:0/1876736137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06940c1920 0x7f06941551b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 --2- 172.21.15.114:0/1876736137 >> v2:172.21.15.116:3300/0 conn(0x7f0694152570 0x7f06940c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 -- 172.21.15.114:0/1876736137 >> 172.21.15.114:0/1876736137 conn(0x7f0694066960 msgr2=0x7f0694066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 -- 172.21.15.114:0/1876736137 shutdown_connections 2024-02-17T12:17:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 -- 172.21.15.114:0/1876736137 wait complete. 2024-02-17T12:17:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 Processor -- start 2024-02-17T12:17:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 -- start start 2024-02-17T12:17:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06940c1920 0x7f069406c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06940c5330 0x7f06941ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0694152570 0x7f06940a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06941ee5c0 con 0x7f0694152570 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06941f0b30 con 0x7f06940c5330 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0699800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06941466c0 con 0x7f06940c1920 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0698e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0694152570 0x7f06940a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0698e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0694152570 0x7f06940a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35268/0 (socket says 172.21.15.114:35268) 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0693e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06940c1920 0x7f069406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0698e00640 1 -- 172.21.15.114:0/3722456678 learned_addr learned my addr 172.21.15.114:0/3722456678 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0693400640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06940c5330 0x7f06941ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0698e00640 1 -- 172.21.15.114:0/3722456678 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06940c1920 msgr2=0x7f069406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0698e00640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06940c1920 0x7f069406c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0698e00640 1 -- 172.21.15.114:0/3722456678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06940c5330 msgr2=0x7f06941ed5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0698e00640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06940c5330 0x7f06941ed5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0698e00640 1 -- 172.21.15.114:0/3722456678 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c0094d0 con 0x7f0694152570 2024-02-17T12:17:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.361+0000 7f0698e00640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0694152570 0x7f06940a8b60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f068c00c430 tx=0x7f068c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f068be00640 1 -- 172.21.15.114:0/3722456678 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c005220 con 0x7f0694152570 2024-02-17T12:17:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f068be00640 1 -- 172.21.15.114:0/3722456678 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c005380 con 0x7f0694152570 2024-02-17T12:17:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f068be00640 1 -- 172.21.15.114:0/3722456678 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c007270 con 0x7f0694152570 2024-02-17T12:17:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f0699800640 1 -- 172.21.15.114:0/3722456678 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06941469a0 con 0x7f0694152570 2024-02-17T12:17:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f0699800640 1 -- 172.21.15.114:0/3722456678 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06941f0df0 con 0x7f0694152570 2024-02-17T12:17:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f0699800640 1 -- 172.21.15.114:0/3722456678 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06941f0fe0 con 0x7f0694152570 2024-02-17T12:17:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f068be00640 1 -- 172.21.15.114:0/3722456678 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f068c0073d0 con 0x7f0694152570 2024-02-17T12:17:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f068be00640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0670066e40 0x7f0670069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f068be00640 1 -- 172.21.15.114:0/3722456678 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f068c083b30 con 0x7f0694152570 2024-02-17T12:17:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f0693e00640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0670066e40 0x7f0670069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.365+0000 7f0693e00640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0670066e40 0x7f0670069300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0684003ab0 tx=0x7f0684009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:59.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.369+0000 7f068be00640 1 -- 172.21.15.114:0/3722456678 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f068c050d10 con 0x7f0694152570 2024-02-17T12:17:59.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 -- 172.21.15.114:0/3722456678 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f069404eef0 con 0x7f0694152570 2024-02-17T12:17:59.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f068be00640 1 -- 172.21.15.114:0/3722456678 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+65 (secure 0 0 0) 0x7f068c0543d0 con 0x7f0694152570 2024-02-17T12:17:59.529 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:17:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-02-17T12:17:59.529 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:17:59.529 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-02-17T12:17:59.529 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-02-17T12:17:59.529 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:17:59.529 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-02-17T12:17:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 -- 172.21.15.114:0/3722456678 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0670066e40 msgr2=0x7f0670069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0670066e40 0x7f0670069300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0684003ab0 tx=0x7f0684009830 comp rx=0 tx=0).stop 2024-02-17T12:17:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 -- 172.21.15.114:0/3722456678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0694152570 msgr2=0x7f06940a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0694152570 0x7f06940a8b60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f068c00c430 tx=0x7f068c00c8f0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 -- 172.21.15.114:0/3722456678 shutdown_connections 2024-02-17T12:17:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0670066e40 0x7f0670069300 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0694152570 0x7f06940a8b60 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06940c5330 0x7f06941ed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 --2- 172.21.15.114:0/3722456678 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06940c1920 0x7f069406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 -- 172.21.15.114:0/3722456678 >> 172.21.15.114:0/3722456678 conn(0x7f0694066960 msgr2=0x7f06940c6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 -- 172.21.15.114:0/3722456678 shutdown_connections 2024-02-17T12:17:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.525+0000 7f0699800640 1 -- 172.21.15.114:0/3722456678 wait complete. 2024-02-17T12:17:59.550 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-17T12:17:59.550 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-17T12:17:59.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f2396200640 1 Processor -- start 2024-02-17T12:17:59.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f2396200640 1 -- start start 2024-02-17T12:17:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f2396200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2390152350 0x7f2390155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f2396200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2390158900 0x7f2390158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f2396200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2390159290 con 0x7f23900709d0 2024-02-17T12:17:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f2396200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23901584b0 con 0x7f2390158900 2024-02-17T12:17:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f2396200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23900c3a40 con 0x7f2390152350 2024-02-17T12:17:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f238fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2390158900 0x7f2390158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f238ea00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f23900709d0 0x7f23900c8410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35074/0 (socket says 172.21.15.114:35074) 2024-02-17T12:17:59.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f238ea00640 1 -- 172.21.15.114:0/817538624 learned_addr learned my addr 172.21.15.114:0/817538624 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:17:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f238f400640 1 --2- 172.21.15.114:0/817538624 >> v2:172.21.15.116:3300/0 conn(0x7f2390152350 0x7f2390155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f238e000640 1 -- 172.21.15.114:0/817538624 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847760532 0 0) 0x7f2390159290 con 0x7f23900709d0 2024-02-17T12:17:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f238e000640 1 -- 172.21.15.114:0/817538624 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2374003530 con 0x7f23900709d0 2024-02-17T12:17:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f238fe00640 1 -- 172.21.15.114:0/817538624 >> v2:172.21.15.116:3300/0 conn(0x7f2390152350 msgr2=0x7f2390155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:17:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f238fe00640 1 --2- 172.21.15.114:0/817538624 >> v2:172.21.15.116:3300/0 conn(0x7f2390152350 0x7f2390155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f238fe00640 1 -- 172.21.15.114:0/817538624 >> v1:172.21.15.114:6789/0 conn(0x7f23900709d0 legacy=0x7f23900c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.685+0000 7f238fe00640 1 -- 172.21.15.114:0/817538624 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900c3d20 con 0x7f2390158900 2024-02-17T12:17:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f238fe00640 1 --2- 172.21.15.114:0/817538624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 0x7f2390158d50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f23900c9090 tx=0x7f238801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a5dbd9f574e495 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f238e000640 1 -- 172.21.15.114:0/817538624 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23880a5920 con 0x7f2390158900 2024-02-17T12:17:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f238e000640 1 -- 172.21.15.114:0/817538624 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23880a5a80 con 0x7f2390158900 2024-02-17T12:17:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f238e000640 1 -- 172.21.15.114:0/817538624 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23880a5e10 con 0x7f2390158900 2024-02-17T12:17:59.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f2396200640 1 -- 172.21.15.114:0/817538624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 msgr2=0x7f2390158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f2396200640 1 --2- 172.21.15.114:0/817538624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 0x7f2390158d50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f23900c9090 tx=0x7f238801c930 comp rx=0 tx=0).stop 2024-02-17T12:17:59.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f2396200640 1 -- 172.21.15.114:0/817538624 shutdown_connections 2024-02-17T12:17:59.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f2396200640 1 --2- 172.21.15.114:0/817538624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 0x7f2390158d50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f2396200640 1 --2- 172.21.15.114:0/817538624 >> v2:172.21.15.116:3300/0 conn(0x7f2390152350 0x7f2390155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f2396200640 1 -- 172.21.15.114:0/817538624 >> 172.21.15.114:0/817538624 conn(0x7f23900aa260 msgr2=0x7f23900aa670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:17:59.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f2396200640 1 -- 172.21.15.114:0/817538624 shutdown_connections 2024-02-17T12:17:59.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.689+0000 7f2396200640 1 -- 172.21.15.114:0/817538624 wait complete. 2024-02-17T12:17:59.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 Processor -- start 2024-02-17T12:17:59.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 -- start start 2024-02-17T12:17:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900709d0 0x7f23900c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2390152350 0x7f2390151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 0x7f2390151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23901ee330 con 0x7f2390158900 2024-02-17T12:17:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23901521a0 con 0x7f2390152350 2024-02-17T12:17:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23900a8d10 con 0x7f23900709d0 2024-02-17T12:17:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 0x7f2390151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 0x7f2390151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35296/0 (socket says 172.21.15.114:35296) 2024-02-17T12:17:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238fe00640 1 -- 172.21.15.114:0/1371809995 learned_addr learned my addr 172.21.15.114:0/1371809995 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:17:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238ea00640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2390152350 0x7f2390151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238f400640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900709d0 0x7f23900c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238fe00640 1 -- 172.21.15.114:0/1371809995 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900709d0 msgr2=0x7f23900c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238fe00640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900709d0 0x7f23900c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238fe00640 1 -- 172.21.15.114:0/1371809995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2390152350 msgr2=0x7f2390151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:17:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238fe00640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2390152350 0x7f2390151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:17:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238fe00640 1 -- 172.21.15.114:0/1371809995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388009a70 con 0x7f2390158900 2024-02-17T12:17:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f238fe00640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 0x7f2390151c60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2388019540 tx=0x7f23880196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2387400640 1 -- 172.21.15.114:0/1371809995 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23880adcc0 con 0x7f2390158900 2024-02-17T12:17:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2387400640 1 -- 172.21.15.114:0/1371809995 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23880ade20 con 0x7f2390158900 2024-02-17T12:17:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 -- 172.21.15.114:0/1371809995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23901ed3f0 con 0x7f2390158900 2024-02-17T12:17:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2387400640 1 -- 172.21.15.114:0/1371809995 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23880b9690 con 0x7f2390158900 2024-02-17T12:17:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 -- 172.21.15.114:0/1371809995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23901ed990 con 0x7f2390158900 2024-02-17T12:17:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.693+0000 7f2396200640 1 -- 172.21.15.114:0/1371809995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2390074840 con 0x7f2390158900 2024-02-17T12:17:59.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.697+0000 7f2387400640 1 -- 172.21.15.114:0/1371809995 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f23880b97f0 con 0x7f2390158900 2024-02-17T12:17:59.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.697+0000 7f2387400640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2370066e40 0x7f2370069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:17:59.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.697+0000 7f2387400640 1 -- 172.21.15.114:0/1371809995 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f238811fcf0 con 0x7f2390158900 2024-02-17T12:17:59.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.697+0000 7f238f400640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2370066e40 0x7f2370069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:17:59.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.697+0000 7f238f400640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2370066e40 0x7f2370069300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f23901553c0 tx=0x7f2380009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:17:59.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.701+0000 7f2387400640 1 -- 172.21.15.114:0/1371809995 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2388124070 con 0x7f2390158900 2024-02-17T12:17:59.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:17:59.857+0000 7f2396200640 1 -- 172.21.15.114:0/1371809995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f23900c7e50 con 0x7f2390158900 2024-02-17T12:18:00.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.765+0000 7f2387400640 1 -- 172.21.15.114:0/1371809995 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f23880ecf70 con 0x7f2390158900 2024-02-17T12:18:00.770 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-02-17T12:18:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 -- 172.21.15.114:0/1371809995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2370066e40 msgr2=0x7f2370069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2370066e40 0x7f2370069300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f23901553c0 tx=0x7f2380009190 comp rx=0 tx=0).stop 2024-02-17T12:18:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 -- 172.21.15.114:0/1371809995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 msgr2=0x7f2390151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 0x7f2390151c60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2388019540 tx=0x7f23880196d0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 -- 172.21.15.114:0/1371809995 shutdown_connections 2024-02-17T12:18:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2370066e40 0x7f2370069300 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2390158900 0x7f2390151c60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2390152350 0x7f2390151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 --2- 172.21.15.114:0/1371809995 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f23900709d0 0x7f23900c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 -- 172.21.15.114:0/1371809995 >> 172.21.15.114:0/1371809995 conn(0x7f23900aa260 msgr2=0x7f23900a9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 -- 172.21.15.114:0/1371809995 shutdown_connections 2024-02-17T12:18:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.769+0000 7f2396200640 1 -- 172.21.15.114:0/1371809995 wait complete. 2024-02-17T12:18:00.797 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T12:18:00.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.933+0000 7f8823000640 1 Processor -- start 2024-02-17T12:18:00.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f8823000640 1 -- start start 2024-02-17T12:18:00.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f8823000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f881c0c25a0 0x7f881c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:00.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f8823000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f881c06db50 0x7f881c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f8823000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f881c150490 0x7f881c152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f8823000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c071630 con 0x7f881c0c25a0 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f8823000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c156270 con 0x7f881c150490 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f8823000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c156550 con 0x7f881c06db50 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f881be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f881c0c25a0 0x7f881c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f881be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f881c0c25a0 0x7f881c06e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35312/0 (socket says 172.21.15.114:35312) 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f881be00640 1 -- 172.21.15.114:0/3221395575 learned_addr learned my addr 172.21.15.114:0/3221395575 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f881b400640 1 --2- 172.21.15.114:0/3221395575 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f881c06db50 0x7f881c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f8821000640 1 --2- 172.21.15.114:0/3221395575 >> v2:172.21.15.116:3300/0 conn(0x7f881c150490 0x7f881c152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f881be00640 1 -- 172.21.15.114:0/3221395575 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f881c06db50 msgr2=0x7f881c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f881be00640 1 --2- 172.21.15.114:0/3221395575 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f881c06db50 0x7f881c14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f881be00640 1 -- 172.21.15.114:0/3221395575 >> v2:172.21.15.116:3300/0 conn(0x7f881c150490 msgr2=0x7f881c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f881be00640 1 --2- 172.21.15.114:0/3221395575 >> v2:172.21.15.116:3300/0 conn(0x7f881c150490 0x7f881c152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.937+0000 7f881be00640 1 -- 172.21.15.114:0/3221395575 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c156830 con 0x7f881c0c25a0 2024-02-17T12:18:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f881be00640 1 --2- 172.21.15.114:0/3221395575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c0c25a0 0x7f881c06e980 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f881c0c0780 tx=0x7f880c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1d2eeb9b74ce5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f881aa00640 1 -- 172.21.15.114:0/3221395575 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c1539a0 con 0x7f881c0c25a0 2024-02-17T12:18:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f881aa00640 1 -- 172.21.15.114:0/3221395575 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c0ac410 con 0x7f881c0c25a0 2024-02-17T12:18:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f881aa00640 1 -- 172.21.15.114:0/3221395575 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0ac7a0 con 0x7f881c0c25a0 2024-02-17T12:18:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 -- 172.21.15.114:0/3221395575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c0c25a0 msgr2=0x7f881c06e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 --2- 172.21.15.114:0/3221395575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c0c25a0 0x7f881c06e980 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f881c0c0780 tx=0x7f880c01c3d0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 -- 172.21.15.114:0/3221395575 shutdown_connections 2024-02-17T12:18:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 --2- 172.21.15.114:0/3221395575 >> v2:172.21.15.116:3300/0 conn(0x7f881c150490 0x7f881c152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 --2- 172.21.15.114:0/3221395575 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f881c06db50 0x7f881c14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 --2- 172.21.15.114:0/3221395575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c0c25a0 0x7f881c06e980 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 -- 172.21.15.114:0/3221395575 >> 172.21.15.114:0/3221395575 conn(0x7f881c0a8490 msgr2=0x7f881c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 -- 172.21.15.114:0/3221395575 shutdown_connections 2024-02-17T12:18:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 -- 172.21.15.114:0/3221395575 wait complete. 2024-02-17T12:18:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 Processor -- start 2024-02-17T12:18:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.941+0000 7f8823000640 1 -- start start 2024-02-17T12:18:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8823000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c06db50 0x7f881c0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8823000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f881c0c25a0 0x7f881c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8823000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f881c150490 0x7f881c1403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8823000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c1413e0 con 0x7f881c06db50 2024-02-17T12:18:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8823000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0c1450 con 0x7f881c0c25a0 2024-02-17T12:18:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8823000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0c1710 con 0x7f881c150490 2024-02-17T12:18:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f881be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c06db50 0x7f881c0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f881be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c06db50 0x7f881c0bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35328/0 (socket says 172.21.15.114:35328) 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f881be00640 1 -- 172.21.15.114:0/2311319621 learned_addr learned my addr 172.21.15.114:0/2311319621 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8821000640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f881c150490 0x7f881c1403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f881b400640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f881c0c25a0 0x7f881c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f881be00640 1 -- 172.21.15.114:0/2311319621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f881c150490 msgr2=0x7f881c1403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f881be00640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f881c150490 0x7f881c1403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f881be00640 1 -- 172.21.15.114:0/2311319621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f881c0c25a0 msgr2=0x7f881c13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f881be00640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f881c0c25a0 0x7f881c13fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f881be00640 1 -- 172.21.15.114:0/2311319621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c0094d0 con 0x7f881c06db50 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f881be00640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c06db50 0x7f881c0bfa00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f880c0af040 tx=0x7f880c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8813e00640 1 -- 172.21.15.114:0/2311319621 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0ace00 con 0x7f881c06db50 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8813e00640 1 -- 172.21.15.114:0/2311319621 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c0b65f0 con 0x7f881c06db50 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8823000640 1 -- 172.21.15.114:0/2311319621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c140d90 con 0x7f881c06db50 2024-02-17T12:18:00.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8813e00640 1 -- 172.21.15.114:0/2311319621 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0b69a0 con 0x7f881c06db50 2024-02-17T12:18:00.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8823000640 1 -- 172.21.15.114:0/2311319621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c0bff40 con 0x7f881c06db50 2024-02-17T12:18:00.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8823000640 1 -- 172.21.15.114:0/2311319621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c141550 con 0x7f881c06db50 2024-02-17T12:18:00.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.945+0000 7f8813e00640 1 -- 172.21.15.114:0/2311319621 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f880c0b6b00 con 0x7f881c06db50 2024-02-17T12:18:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.949+0000 7f8813e00640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87fc066e40 0x7f87fc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.949+0000 7f8813e00640 1 -- 172.21.15.114:0/2311319621 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f880c11fbc0 con 0x7f881c06db50 2024-02-17T12:18:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.949+0000 7f881b400640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87fc066e40 0x7f87fc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:00.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.949+0000 7f881b400640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87fc066e40 0x7f87fc069300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f881c074370 tx=0x7f8808008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:00.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:00.953+0000 7f8813e00640 1 -- 172.21.15.114:0/2311319621 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f880c0ecc70 con 0x7f881c06db50 2024-02-17T12:18:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.109+0000 7f8823000640 1 -- 172.21.15.114:0/2311319621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f881c074840 con 0x7f881c06db50 2024-02-17T12:18:01.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.773+0000 7f8813e00640 1 -- 172.21.15.114:0/2311319621 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7f880c0b10d0 con 0x7f881c06db50 2024-02-17T12:18:01.777 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-02-17T12:18:01.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 -- 172.21.15.114:0/2311319621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87fc066e40 msgr2=0x7f87fc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:01.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87fc066e40 0x7f87fc069300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f881c074370 tx=0x7f8808008040 comp rx=0 tx=0).stop 2024-02-17T12:18:01.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 -- 172.21.15.114:0/2311319621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c06db50 msgr2=0x7f881c0bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:01.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c06db50 0x7f881c0bfa00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f880c0af040 tx=0x7f880c019170 comp rx=0 tx=0).stop 2024-02-17T12:18:01.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 -- 172.21.15.114:0/2311319621 shutdown_connections 2024-02-17T12:18:01.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f881c150490 0x7f881c1403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:01.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f881c0c25a0 0x7f881c13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:01.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87fc066e40 0x7f87fc069300 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:01.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 --2- 172.21.15.114:0/2311319621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f881c06db50 0x7f881c0bfa00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:01.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 -- 172.21.15.114:0/2311319621 >> 172.21.15.114:0/2311319621 conn(0x7f881c0a8490 msgr2=0x7f881c0721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:01.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 -- 172.21.15.114:0/2311319621 shutdown_connections 2024-02-17T12:18:01.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.777+0000 7f8823000640 1 -- 172.21.15.114:0/2311319621 wait complete. 2024-02-17T12:18:01.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-17T12:18:01.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3928600640 1 Processor -- start 2024-02-17T12:18:01.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3928600640 1 -- start start 2024-02-17T12:18:01.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3928600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f39200c25a0 0x7f392006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:01.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3928600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f392006db50 0x7f392014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:01.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3928600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3920156270 con 0x7f3920150490 2024-02-17T12:18:01.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3928600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3920071630 con 0x7f39200c25a0 2024-02-17T12:18:01.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3928600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3920156550 con 0x7f392006db50 2024-02-17T12:18:01.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3925200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f392006db50 0x7f392014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:01.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3926600640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f3920150490 0x7f3920152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:49246/0 (socket says 172.21.15.114:49246) 2024-02-17T12:18:01.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3925c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f39200c25a0 0x7f392006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:01.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3926600640 1 -- 172.21.15.114:0/217352554 learned_addr learned my addr 172.21.15.114:0/217352554 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:01.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f391fe00640 1 -- 172.21.15.114:0/217352554 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594542702 0 0) 0x7f3920156270 con 0x7f3920150490 2024-02-17T12:18:01.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f391fe00640 1 -- 172.21.15.114:0/217352554 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3908003530 con 0x7f3920150490 2024-02-17T12:18:01.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3925200640 1 -- 172.21.15.114:0/217352554 >> v2:172.21.15.116:3300/0 conn(0x7f39200c25a0 msgr2=0x7f392006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:01.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3925200640 1 --2- 172.21.15.114:0/217352554 >> v2:172.21.15.116:3300/0 conn(0x7f39200c25a0 0x7f392006e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:01.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3925200640 1 -- 172.21.15.114:0/217352554 >> v1:172.21.15.116:6789/0 conn(0x7f3920150490 legacy=0x7f3920152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:01.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3925200640 1 -- 172.21.15.114:0/217352554 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3920156830 con 0x7f392006db50 2024-02-17T12:18:01.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.953+0000 7f3925c00640 1 --2- 172.21.15.114:0/217352554 >> v2:172.21.15.116:3300/0 conn(0x7f39200c25a0 0x7f392006e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:01.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f3925200640 1 --2- 172.21.15.114:0/217352554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f392006db50 0x7f392014ff50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f390c0097c0 tx=0x7f390c01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64da3dc654b3dced server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:01.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f391fe00640 1 -- 172.21.15.114:0/217352554 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c0ab600 con 0x7f392006db50 2024-02-17T12:18:01.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f391fe00640 1 -- 172.21.15.114:0/217352554 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c0a7050 con 0x7f392006db50 2024-02-17T12:18:01.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f391fe00640 1 -- 172.21.15.114:0/217352554 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c0ab980 con 0x7f392006db50 2024-02-17T12:18:01.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f3928600640 1 -- 172.21.15.114:0/217352554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f392006db50 msgr2=0x7f392014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:01.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f3928600640 1 --2- 172.21.15.114:0/217352554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f392006db50 0x7f392014ff50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f390c0097c0 tx=0x7f390c01c350 comp rx=0 tx=0).stop 2024-02-17T12:18:01.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f3928600640 1 -- 172.21.15.114:0/217352554 shutdown_connections 2024-02-17T12:18:01.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f3928600640 1 --2- 172.21.15.114:0/217352554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f392006db50 0x7f392014ff50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:01.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f3928600640 1 --2- 172.21.15.114:0/217352554 >> v2:172.21.15.116:3300/0 conn(0x7f39200c25a0 0x7f392006e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:01.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f3928600640 1 -- 172.21.15.114:0/217352554 >> 172.21.15.114:0/217352554 conn(0x7f39200a8490 msgr2=0x7f39200a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:01.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f3928600640 1 -- 172.21.15.114:0/217352554 shutdown_connections 2024-02-17T12:18:01.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.957+0000 7f3928600640 1 -- 172.21.15.114:0/217352554 wait complete. 2024-02-17T12:18:01.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 Processor -- start 2024-02-17T12:18:01.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 -- start start 2024-02-17T12:18:01.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392006db50 0x7f3920144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:01.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39200c25a0 0x7f39201f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3920150490 0x7f392013fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3920148820 con 0x7f392006db50 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39201f0db0 con 0x7f39200c25a0 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39201559b0 con 0x7f3920150490 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3925c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392006db50 0x7f3920144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3925c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392006db50 0x7f3920144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35338/0 (socket says 172.21.15.114:35338) 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3925c00640 1 -- 172.21.15.114:0/2279449580 learned_addr learned my addr 172.21.15.114:0/2279449580 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3926600640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3920150490 0x7f392013fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3925200640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39200c25a0 0x7f39201f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3925c00640 1 -- 172.21.15.114:0/2279449580 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3920150490 msgr2=0x7f392013fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3925c00640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3920150490 0x7f392013fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3925c00640 1 -- 172.21.15.114:0/2279449580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39200c25a0 msgr2=0x7f39201f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3925c00640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39200c25a0 0x7f39201f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3925c00640 1 -- 172.21.15.114:0/2279449580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3914009420 con 0x7f392006db50 2024-02-17T12:18:01.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3925c00640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392006db50 0x7f3920144330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f391400ebe0 tx=0x7f391400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:01.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f391d600640 1 -- 172.21.15.114:0/2279449580 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391400eee0 con 0x7f392006db50 2024-02-17T12:18:01.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f391d600640 1 -- 172.21.15.114:0/2279449580 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391400cc30 con 0x7f392006db50 2024-02-17T12:18:01.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f391d600640 1 -- 172.21.15.114:0/2279449580 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914013470 con 0x7f392006db50 2024-02-17T12:18:01.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 -- 172.21.15.114:0/2279449580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c009420 con 0x7f392006db50 2024-02-17T12:18:01.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 -- 172.21.15.114:0/2279449580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3920141030 con 0x7f392006db50 2024-02-17T12:18:01.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.961+0000 7f3928600640 1 -- 172.21.15.114:0/2279449580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3920155ed0 con 0x7f392006db50 2024-02-17T12:18:01.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.965+0000 7f391d600640 1 -- 172.21.15.114:0/2279449580 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f39140135d0 con 0x7f392006db50 2024-02-17T12:18:01.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.965+0000 7f391d600640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3900066e40 0x7f3900069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:01.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.965+0000 7f391d600640 1 -- 172.21.15.114:0/2279449580 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3914085410 con 0x7f392006db50 2024-02-17T12:18:01.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.965+0000 7f3925200640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3900066e40 0x7f3900069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:01.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.965+0000 7f3925200640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3900066e40 0x7f3900069300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f390c0ad000 tx=0x7f390c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:01.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:01.969+0000 7f391d600640 1 -- 172.21.15.114:0/2279449580 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3914052380 con 0x7f392006db50 2024-02-17T12:18:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.153+0000 7f3928600640 1 -- 172.21.15.114:0/2279449580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3920074840 con 0x7f392006db50 2024-02-17T12:18:02.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.777+0000 7f391d600640 1 -- 172.21.15.114:0/2279449580 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3914055a40 con 0x7f392006db50 2024-02-17T12:18:02.779 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 8 and data pool 9 2024-02-17T12:18:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.781+0000 7f3928600640 1 -- 172.21.15.114:0/2279449580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3900066e40 msgr2=0x7f3900069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.781+0000 7f3928600640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3900066e40 0x7f3900069300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f390c0ad000 tx=0x7f390c008040 comp rx=0 tx=0).stop 2024-02-17T12:18:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.781+0000 7f3928600640 1 -- 172.21.15.114:0/2279449580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392006db50 msgr2=0x7f3920144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:02.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.781+0000 7f3928600640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392006db50 0x7f3920144330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f391400ebe0 tx=0x7f391400c520 comp rx=0 tx=0).stop 2024-02-17T12:18:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.785+0000 7f3928600640 1 -- 172.21.15.114:0/2279449580 shutdown_connections 2024-02-17T12:18:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.785+0000 7f3928600640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3920150490 0x7f392013fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.785+0000 7f3928600640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39200c25a0 0x7f39201f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.785+0000 7f3928600640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3900066e40 0x7f3900069300 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.785+0000 7f3928600640 1 --2- 172.21.15.114:0/2279449580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f392006db50 0x7f3920144330 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.785+0000 7f3928600640 1 -- 172.21.15.114:0/2279449580 >> 172.21.15.114:0/2279449580 conn(0x7f39200a8490 msgr2=0x7f3920142250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.789+0000 7f3928600640 1 -- 172.21.15.114:0/2279449580 shutdown_connections 2024-02-17T12:18:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.789+0000 7f3928600640 1 -- 172.21.15.114:0/2279449580 wait complete. 2024-02-17T12:18:02.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:02.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcde6a00640 1 Processor -- start 2024-02-17T12:18:02.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcde6a00640 1 -- start start 2024-02-17T12:18:02.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcde6a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcde014f110 0x7fcde00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:02.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcde6a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 0x7fcde00aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcde6a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcde00c1eb0 0x7fcde0155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcde6a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde014f4f0 con 0x7fcde014f110 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcde6a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde00aae80 con 0x7fcde00c1eb0 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcde6a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde00a9420 con 0x7fcde00c2580 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcddfe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcde014f110 0x7fcde00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcddfe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcde014f110 0x7fcde00c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35348/0 (socket says 172.21.15.114:35348) 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcddfe00640 1 -- 172.21.15.114:0/257897616 learned_addr learned my addr 172.21.15.114:0/257897616 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcde4a00640 1 --2- 172.21.15.114:0/257897616 >> v2:172.21.15.116:3300/0 conn(0x7fcde00c1eb0 0x7fcde0155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcddf400640 1 --2- 172.21.15.114:0/257897616 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 0x7fcde00aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcddfe00640 1 -- 172.21.15.114:0/257897616 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 msgr2=0x7fcde00aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcddfe00640 1 --2- 172.21.15.114:0/257897616 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 0x7fcde00aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcddfe00640 1 -- 172.21.15.114:0/257897616 >> v2:172.21.15.116:3300/0 conn(0x7fcde00c1eb0 msgr2=0x7fcde0155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:02.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcddfe00640 1 --2- 172.21.15.114:0/257897616 >> v2:172.21.15.116:3300/0 conn(0x7fcde00c1eb0 0x7fcde0155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.961+0000 7fcddfe00640 1 -- 172.21.15.114:0/257897616 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0152850 con 0x7fcde014f110 2024-02-17T12:18:02.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcddfe00640 1 --2- 172.21.15.114:0/257897616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde014f110 0x7fcde00c65a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcde00c1090 tx=0x7fcdc801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91ddd3b6adac47c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:02.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcddea00640 1 -- 172.21.15.114:0/257897616 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80ab620 con 0x7fcde014f110 2024-02-17T12:18:02.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcddea00640 1 -- 172.21.15.114:0/257897616 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc80ab780 con 0x7fcde014f110 2024-02-17T12:18:02.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcddea00640 1 -- 172.21.15.114:0/257897616 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80abb10 con 0x7fcde014f110 2024-02-17T12:18:02.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcde6a00640 1 -- 172.21.15.114:0/257897616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde014f110 msgr2=0x7fcde00c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:02.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcde6a00640 1 --2- 172.21.15.114:0/257897616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde014f110 0x7fcde00c65a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcde00c1090 tx=0x7fcdc801c460 comp rx=0 tx=0).stop 2024-02-17T12:18:02.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcde6a00640 1 -- 172.21.15.114:0/257897616 shutdown_connections 2024-02-17T12:18:02.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcde6a00640 1 --2- 172.21.15.114:0/257897616 >> v2:172.21.15.116:3300/0 conn(0x7fcde00c1eb0 0x7fcde0155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcde6a00640 1 --2- 172.21.15.114:0/257897616 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 0x7fcde00aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcde6a00640 1 --2- 172.21.15.114:0/257897616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde014f110 0x7fcde00c65a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcde6a00640 1 -- 172.21.15.114:0/257897616 >> 172.21.15.114:0/257897616 conn(0x7fcde00a8490 msgr2=0x7fcde00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:02.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcde6a00640 1 -- 172.21.15.114:0/257897616 shutdown_connections 2024-02-17T12:18:02.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.965+0000 7fcde6a00640 1 -- 172.21.15.114:0/257897616 wait complete. 2024-02-17T12:18:02.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde6a00640 1 Processor -- start 2024-02-17T12:18:02.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde6a00640 1 -- start start 2024-02-17T12:18:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde00c1eb0 0x7fcde0150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde6a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 0x7fcde014ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde6a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde014f110 0x7fcde014bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde6a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde014a200 con 0x7fcde00c1eb0 2024-02-17T12:18:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde6a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde01f18e0 con 0x7fcde014f110 2024-02-17T12:18:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde6a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0149f20 con 0x7fcde00c2580 2024-02-17T12:18:02.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde00c1eb0 0x7fcde0150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde00c1eb0 0x7fcde0150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35358/0 (socket says 172.21.15.114:35358) 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddfe00640 1 -- 172.21.15.114:0/3168409479 learned_addr learned my addr 172.21.15.114:0/3168409479 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddf400640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 0x7fcde014ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde4a00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde014f110 0x7fcde014bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddfe00640 1 -- 172.21.15.114:0/3168409479 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 msgr2=0x7fcde014ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddfe00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 0x7fcde014ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddfe00640 1 -- 172.21.15.114:0/3168409479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde014f110 msgr2=0x7fcde014bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddfe00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde014f110 0x7fcde014bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddfe00640 1 -- 172.21.15.114:0/3168409479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc80094d0 con 0x7fcde00c1eb0 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddf400640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 0x7fcde014ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcddfe00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde00c1eb0 0x7fcde0150230 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80ad040 tx=0x7fcdc801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcdd7e00640 1 -- 172.21.15.114:0/3168409479 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80be3f0 con 0x7fcde00c1eb0 2024-02-17T12:18:02.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcdd7e00640 1 -- 172.21.15.114:0/3168409479 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc80be570 con 0x7fcde00c1eb0 2024-02-17T12:18:02.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcdd7e00640 1 -- 172.21.15.114:0/3168409479 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80be920 con 0x7fcde00c1eb0 2024-02-17T12:18:02.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde6a00640 1 -- 172.21.15.114:0/3168409479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde0151260 con 0x7fcde00c1eb0 2024-02-17T12:18:02.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.969+0000 7fcde6a00640 1 -- 172.21.15.114:0/3168409479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde01520f0 con 0x7fcde00c1eb0 2024-02-17T12:18:02.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.973+0000 7fcde6a00640 1 -- 172.21.15.114:0/3168409479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde0074840 con 0x7fcde00c1eb0 2024-02-17T12:18:02.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.973+0000 7fcdd7e00640 1 -- 172.21.15.114:0/3168409479 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fcdc80b43f0 con 0x7fcde00c1eb0 2024-02-17T12:18:02.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.973+0000 7fcdd7e00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcdbc066e40 0x7fcdbc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:02.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.973+0000 7fcdd7e00640 1 -- 172.21.15.114:0/3168409479 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdc811f4a0 con 0x7fcde00c1eb0 2024-02-17T12:18:02.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.973+0000 7fcddf400640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcdbc066e40 0x7fcdbc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:02.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.973+0000 7fcddf400640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcdbc066e40 0x7fcdbc069300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcde0072d00 tx=0x7fcdd0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:02.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:02.977+0000 7fcdd7e00640 1 -- 172.21.15.114:0/3168409479 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcdc80ec280 con 0x7fcde00c1eb0 2024-02-17T12:18:03.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.133+0000 7fcde6a00640 1 -- 172.21.15.114:0/3168409479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcde00c1380 con 0x7fcde00c1eb0 2024-02-17T12:18:03.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcdd7e00640 1 -- 172.21.15.114:0/3168409479 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16690 (secure 0 0 0) 0x7fcdc80ef940 con 0x7fcde00c1eb0 2024-02-17T12:18:03.139 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:03.139 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":49,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:02.156719+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:03.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 -- 172.21.15.114:0/3168409479 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcdbc066e40 msgr2=0x7fcdbc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcdbc066e40 0x7fcdbc069300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcde0072d00 tx=0x7fcdd0008040 comp rx=0 tx=0).stop 2024-02-17T12:18:03.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 -- 172.21.15.114:0/3168409479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde00c1eb0 msgr2=0x7fcde0150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde00c1eb0 0x7fcde0150230 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80ad040 tx=0x7fcdc801aca0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 -- 172.21.15.114:0/3168409479 shutdown_connections 2024-02-17T12:18:03.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde014f110 0x7fcde014bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcde00c2580 0x7fcde014ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcdbc066e40 0x7fcdbc069300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 --2- 172.21.15.114:0/3168409479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcde00c1eb0 0x7fcde0150230 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 -- 172.21.15.114:0/3168409479 >> 172.21.15.114:0/3168409479 conn(0x7fcde00a8490 msgr2=0x7fcde00c29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:03.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 -- 172.21.15.114:0/3168409479 shutdown_connections 2024-02-17T12:18:03.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.137+0000 7fcde6a00640 1 -- 172.21.15.114:0/3168409479 wait complete. 2024-02-17T12:18:03.160 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:03.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.293+0000 7f4b70000640 1 Processor -- start 2024-02-17T12:18:03.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.293+0000 7f4b70000640 1 -- start start 2024-02-17T12:18:03.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.293+0000 7f4b70000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4b680c1eb0 0x7f4b6815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:03.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b70000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b680a9420 con 0x7f4b680c2580 2024-02-17T12:18:03.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b70000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b68152850 con 0x7f4b6814f110 2024-02-17T12:18:03.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b70000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6814f4f0 con 0x7f4b680c1eb0 2024-02-17T12:18:03.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b6cc00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4b680c2580 0x7f4b680aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35084/0 (socket says 172.21.15.114:35084) 2024-02-17T12:18:03.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b6cc00640 1 -- 172.21.15.114:0/2889335446 learned_addr learned my addr 172.21.15.114:0/2889335446 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:03.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b6e000640 1 --2- 172.21.15.114:0/2889335446 >> v2:172.21.15.116:3300/0 conn(0x7f4b680c1eb0 0x7f4b6815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:03.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b67e00640 1 -- 172.21.15.114:0/2889335446 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790590676 0 0) 0x7f4b680a9420 con 0x7f4b680c2580 2024-02-17T12:18:03.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b67e00640 1 -- 172.21.15.114:0/2889335446 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b50003530 con 0x7f4b680c2580 2024-02-17T12:18:03.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b67e00640 1 -- 172.21.15.114:0/2889335446 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890499352 0 0) 0x7f4b68152850 con 0x7f4b6814f110 2024-02-17T12:18:03.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b67e00640 1 -- 172.21.15.114:0/2889335446 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b680a9420 con 0x7f4b6814f110 2024-02-17T12:18:03.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b67e00640 1 -- 172.21.15.114:0/2889335446 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3071541559 0 0) 0x7f4b50003530 con 0x7f4b680c2580 2024-02-17T12:18:03.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b6e000640 1 -- 172.21.15.114:0/2889335446 >> v1:172.21.15.116:6789/0 conn(0x7f4b6814f110 legacy=0x7f4b680c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b6e000640 1 -- 172.21.15.114:0/2889335446 >> v1:172.21.15.114:6789/0 conn(0x7f4b680c2580 legacy=0x7f4b680aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.297+0000 7f4b6e000640 1 -- 172.21.15.114:0/2889335446 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b680a9670 con 0x7f4b680c1eb0 2024-02-17T12:18:03.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b6e000640 1 --2- 172.21.15.114:0/2889335446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b680c1eb0 0x7f4b6815d3a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009d90 tx=0x7f4b6001c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db12f28f859cfd2f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:03.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b67e00640 1 -- 172.21.15.114:0/2889335446 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54001680 con 0x7f4b680c1eb0 2024-02-17T12:18:03.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b67e00640 1 -- 172.21.15.114:0/2889335446 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b600a5530 con 0x7f4b680c1eb0 2024-02-17T12:18:03.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b67e00640 1 -- 172.21.15.114:0/2889335446 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b600a58c0 con 0x7f4b680c1eb0 2024-02-17T12:18:03.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 -- 172.21.15.114:0/2889335446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b680c1eb0 msgr2=0x7f4b6815d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 --2- 172.21.15.114:0/2889335446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b680c1eb0 0x7f4b6815d3a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009d90 tx=0x7f4b6001c800 comp rx=0 tx=0).stop 2024-02-17T12:18:03.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 -- 172.21.15.114:0/2889335446 shutdown_connections 2024-02-17T12:18:03.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 --2- 172.21.15.114:0/2889335446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b680c1eb0 0x7f4b6815d3a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 -- 172.21.15.114:0/2889335446 >> 172.21.15.114:0/2889335446 conn(0x7f4b680a8490 msgr2=0x7f4b680a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:03.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 -- 172.21.15.114:0/2889335446 shutdown_connections 2024-02-17T12:18:03.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 -- 172.21.15.114:0/2889335446 wait complete. 2024-02-17T12:18:03.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 Processor -- start 2024-02-17T12:18:03.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 -- start start 2024-02-17T12:18:03.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b680c1eb0 0x7f4b6814e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:03.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b680c2580 0x7f4b6814a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:03.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b6814f110 0x7f4b681ee320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:03.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68141150 con 0x7f4b680c1eb0 2024-02-17T12:18:03.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b681409c0 con 0x7f4b680c2580 2024-02-17T12:18:03.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b70000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68141820 con 0x7f4b6814f110 2024-02-17T12:18:03.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b6d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b680c1eb0 0x7f4b6814e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:03.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b6d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b680c1eb0 0x7f4b6814e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35364/0 (socket says 172.21.15.114:35364) 2024-02-17T12:18:03.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b6d600640 1 -- 172.21.15.114:0/699809982 learned_addr learned my addr 172.21.15.114:0/699809982 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:03.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b6cc00640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b680c2580 0x7f4b6814a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:03.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.301+0000 7f4b6e000640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b6814f110 0x7f4b681ee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:03.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b6d600640 1 -- 172.21.15.114:0/699809982 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b6814f110 msgr2=0x7f4b681ee320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b6d600640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b6814f110 0x7f4b681ee320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b6d600640 1 -- 172.21.15.114:0/699809982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b680c2580 msgr2=0x7f4b6814a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b6d600640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b680c2580 0x7f4b6814a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b6d600640 1 -- 172.21.15.114:0/699809982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60009a70 con 0x7f4b680c1eb0 2024-02-17T12:18:03.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b6cc00640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b680c2580 0x7f4b6814a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:03.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b6d600640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b680c1eb0 0x7f4b6814e4d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00c490 tx=0x7f4b5c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:03.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b65600640 1 -- 172.21.15.114:0/699809982 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0052d0 con 0x7f4b680c1eb0 2024-02-17T12:18:03.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b65600640 1 -- 172.21.15.114:0/699809982 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c005430 con 0x7f4b680c1eb0 2024-02-17T12:18:03.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b65600640 1 -- 172.21.15.114:0/699809982 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c012870 con 0x7f4b680c1eb0 2024-02-17T12:18:03.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b70000640 1 -- 172.21.15.114:0/699809982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b68141b00 con 0x7f4b680c1eb0 2024-02-17T12:18:03.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b70000640 1 -- 172.21.15.114:0/699809982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6814ace0 con 0x7f4b680c1eb0 2024-02-17T12:18:03.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b70000640 1 -- 172.21.15.114:0/699809982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6814e290 con 0x7f4b680c1eb0 2024-02-17T12:18:03.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b65600640 1 -- 172.21.15.114:0/699809982 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4b5c0129d0 con 0x7f4b680c1eb0 2024-02-17T12:18:03.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b65600640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4b48066e40 0x7f4b48069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:03.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b65600640 1 -- 172.21.15.114:0/699809982 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b5c084640 con 0x7f4b680c1eb0 2024-02-17T12:18:03.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.305+0000 7f4b6cc00640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4b48066e40 0x7f4b48069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:03.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.309+0000 7f4b6cc00640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4b48066e40 0x7f4b48069300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4b681f2950 tx=0x7f4b54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:03.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.309+0000 7f4b65600640 1 -- 172.21.15.114:0/699809982 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b5c051420 con 0x7f4b680c1eb0 2024-02-17T12:18:03.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 -- 172.21.15.114:0/699809982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b68074840 con 0x7f4b680c1eb0 2024-02-17T12:18:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b65600640 1 -- 172.21.15.114:0/699809982 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16690 (secure 0 0 0) 0x7f4b5c054ae0 con 0x7f4b680c1eb0 2024-02-17T12:18:03.473 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:03.473 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":49,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:02.156719+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 -- 172.21.15.114:0/699809982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4b48066e40 msgr2=0x7f4b48069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4b48066e40 0x7f4b48069300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4b681f2950 tx=0x7f4b54009040 comp rx=0 tx=0).stop 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 -- 172.21.15.114:0/699809982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b680c1eb0 msgr2=0x7f4b6814e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b680c1eb0 0x7f4b6814e4d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00c490 tx=0x7f4b5c00c950 comp rx=0 tx=0).stop 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 -- 172.21.15.114:0/699809982 shutdown_connections 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4b6814f110 0x7f4b681ee320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b680c2580 0x7f4b6814a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4b48066e40 0x7f4b48069300 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 --2- 172.21.15.114:0/699809982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b680c1eb0 0x7f4b6814e4d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 -- 172.21.15.114:0/699809982 >> 172.21.15.114:0/699809982 conn(0x7f4b680a8490 msgr2=0x7f4b68144320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 -- 172.21.15.114:0/699809982 shutdown_connections 2024-02-17T12:18:03.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.469+0000 7f4b70000640 1 -- 172.21.15.114:0/699809982 wait complete. 2024-02-17T12:18:03.494 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-17T12:18:03.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.625+0000 7f9b7d000640 1 Processor -- start 2024-02-17T12:18:03.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b7d000640 1 -- start start 2024-02-17T12:18:03.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b7d000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 0x7f9b7806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:03.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b7d000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b78156270 con 0x7f9b78152c50 2024-02-17T12:18:03.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b7d000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b78156550 con 0x7f9b7806db50 2024-02-17T12:18:03.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b7d000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78071630 con 0x7f9b780c25a0 2024-02-17T12:18:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b76800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9b78152c50 0x7f9b781530e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35092/0 (socket says 172.21.15.114:35092) 2024-02-17T12:18:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b76800640 1 -- 172.21.15.114:0/1862990552 learned_addr learned my addr 172.21.15.114:0/1862990552 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b75e00640 1 --2- 172.21.15.114:0/1862990552 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 0x7f9b7806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b74a00640 1 -- 172.21.15.114:0/1862990552 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330199 0 0) 0x7f9b78156270 con 0x7f9b78152c50 2024-02-17T12:18:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b74a00640 1 -- 172.21.15.114:0/1862990552 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b5c003530 con 0x7f9b78152c50 2024-02-17T12:18:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b74a00640 1 -- 172.21.15.114:0/1862990552 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092641856 0 0) 0x7f9b78156550 con 0x7f9b7806db50 2024-02-17T12:18:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b74a00640 1 -- 172.21.15.114:0/1862990552 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b78156270 con 0x7f9b7806db50 2024-02-17T12:18:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b75e00640 1 -- 172.21.15.114:0/1862990552 >> v1:172.21.15.116:6789/0 conn(0x7f9b7806db50 legacy=0x7f9b7814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b75e00640 1 -- 172.21.15.114:0/1862990552 >> v1:172.21.15.114:6789/0 conn(0x7f9b78152c50 legacy=0x7f9b781530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b74a00640 1 -- 172.21.15.114:0/1862990552 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1331494549 0 0) 0x7f9b5c003530 con 0x7f9b78152c50 2024-02-17T12:18:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.629+0000 7f9b75e00640 1 -- 172.21.15.114:0/1862990552 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78156830 con 0x7f9b780c25a0 2024-02-17T12:18:03.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b75e00640 1 --2- 172.21.15.114:0/1862990552 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 0x7f9b7806e980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009dc0 tx=0x7f9b6801c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84fb96622eaff247 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b74a00640 1 -- 172.21.15.114:0/1862990552 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70001680 con 0x7f9b780c25a0 2024-02-17T12:18:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b74a00640 1 -- 172.21.15.114:0/1862990552 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b680a64d0 con 0x7f9b780c25a0 2024-02-17T12:18:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b74a00640 1 -- 172.21.15.114:0/1862990552 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b680a6860 con 0x7f9b780c25a0 2024-02-17T12:18:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b7d000640 1 -- 172.21.15.114:0/1862990552 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 msgr2=0x7f9b7806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b7d000640 1 --2- 172.21.15.114:0/1862990552 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 0x7f9b7806e980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009dc0 tx=0x7f9b6801c760 comp rx=0 tx=0).stop 2024-02-17T12:18:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b7d000640 1 -- 172.21.15.114:0/1862990552 shutdown_connections 2024-02-17T12:18:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b7d000640 1 --2- 172.21.15.114:0/1862990552 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 0x7f9b7806e980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b7d000640 1 -- 172.21.15.114:0/1862990552 >> 172.21.15.114:0/1862990552 conn(0x7f9b780a8490 msgr2=0x7f9b780a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b7d000640 1 -- 172.21.15.114:0/1862990552 shutdown_connections 2024-02-17T12:18:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b7d000640 1 -- 172.21.15.114:0/1862990552 wait complete. 2024-02-17T12:18:03.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b7d000640 1 Processor -- start 2024-02-17T12:18:03.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.633+0000 7f9b7d000640 1 -- start start 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b7d000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b7806db50 0x7f9b7814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b7d000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 0x7f9b781509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b7d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b78152c50 0x7f9b78148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b7d000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781f1250 con 0x7f9b78152c50 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b7d000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781f1760 con 0x7f9b7806db50 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b7d000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781489d0 con 0x7f9b780c25a0 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b76800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b78152c50 0x7f9b78148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b76800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b78152c50 0x7f9b78148490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35372/0 (socket says 172.21.15.114:35372) 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b76800640 1 -- 172.21.15.114:0/128006137 learned_addr learned my addr 172.21.15.114:0/128006137 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b75400640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 0x7f9b781509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b75e00640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b7806db50 0x7f9b7814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b76800640 1 -- 172.21.15.114:0/128006137 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 msgr2=0x7f9b781509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b76800640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 0x7f9b781509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b76800640 1 -- 172.21.15.114:0/128006137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b7806db50 msgr2=0x7f9b7814f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b76800640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b7806db50 0x7f9b7814f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b76800640 1 -- 172.21.15.114:0/128006137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b68009a70 con 0x7f9b78152c50 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b76800640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b78152c50 0x7f9b78148490 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c730 tx=0x7f9b7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b6e000640 1 -- 172.21.15.114:0/128006137 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70005ae0 con 0x7f9b78152c50 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b6e000640 1 -- 172.21.15.114:0/128006137 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b70005c40 con 0x7f9b78152c50 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b6e000640 1 -- 172.21.15.114:0/128006137 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70007070 con 0x7f9b78152c50 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b7d000640 1 -- 172.21.15.114:0/128006137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b781f1480 con 0x7f9b78152c50 2024-02-17T12:18:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b7d000640 1 -- 172.21.15.114:0/128006137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b78152710 con 0x7f9b78152c50 2024-02-17T12:18:03.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.637+0000 7f9b7d000640 1 -- 172.21.15.114:0/128006137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b78152930 con 0x7f9b78152c50 2024-02-17T12:18:03.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.641+0000 7f9b6e000640 1 -- 172.21.15.114:0/128006137 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9b700071d0 con 0x7f9b78152c50 2024-02-17T12:18:03.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.641+0000 7f9b6e000640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b58066e40 0x7f9b58069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:03.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.641+0000 7f9b6e000640 1 -- 172.21.15.114:0/128006137 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b70084560 con 0x7f9b78152c50 2024-02-17T12:18:03.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.641+0000 7f9b75e00640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b58066e40 0x7f9b58069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:03.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.641+0000 7f9b75e00640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b58066e40 0x7f9b58069300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9b680af000 tx=0x7f9b680a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:03.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.645+0000 7f9b6e000640 1 -- 172.21.15.114:0/128006137 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9b70051410 con 0x7f9b78152c50 2024-02-17T12:18:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:03.837+0000 7f9b7d000640 1 -- 172.21.15.114:0/128006137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9b78074840 con 0x7f9b78152c50 2024-02-17T12:18:04.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.805+0000 7f9b6e000640 1 -- 172.21.15.114:0/128006137 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9b70054ad0 con 0x7f9b78152c50 2024-02-17T12:18:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 -- 172.21.15.114:0/128006137 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b58066e40 msgr2=0x7f9b58069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b58066e40 0x7f9b58069300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9b680af000 tx=0x7f9b680a7000 comp rx=0 tx=0).stop 2024-02-17T12:18:04.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 -- 172.21.15.114:0/128006137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b78152c50 msgr2=0x7f9b78148490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b78152c50 0x7f9b78148490 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000c730 tx=0x7f9b7000cbf0 comp rx=0 tx=0).stop 2024-02-17T12:18:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 -- 172.21.15.114:0/128006137 shutdown_connections 2024-02-17T12:18:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b58066e40 0x7f9b58069300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b78152c50 0x7f9b78148490 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b780c25a0 0x7f9b781509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 --2- 172.21.15.114:0/128006137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b7806db50 0x7f9b7814f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 -- 172.21.15.114:0/128006137 >> 172.21.15.114:0/128006137 conn(0x7f9b780a8490 msgr2=0x7f9b780c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 -- 172.21.15.114:0/128006137 shutdown_connections 2024-02-17T12:18:04.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.809+0000 7f9b7d000640 1 -- 172.21.15.114:0/128006137 wait complete. 2024-02-17T12:18:04.835 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-17T12:18:04.836 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-17T12:18:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.973+0000 7f8f07400640 1 Processor -- start 2024-02-17T12:18:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.973+0000 7f8f07400640 1 -- start start 2024-02-17T12:18:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.973+0000 7f8f07400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8f000c25a0 0x7f8f0006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.973+0000 7f8f07400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f0006db50 0x7f8f0014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.973+0000 7f8f07400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f00156270 con 0x7f8f00150490 2024-02-17T12:18:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.973+0000 7f8f07400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f00071630 con 0x7f8f000c25a0 2024-02-17T12:18:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.973+0000 7f8f07400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f00156550 con 0x7f8f0006db50 2024-02-17T12:18:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.973+0000 7f8f04a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8f000c25a0 0x7f8f0006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.973+0000 7f8f04a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8f000c25a0 0x7f8f0006e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35388/0 (socket says 172.21.15.114:35388) 2024-02-17T12:18:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.973+0000 7f8f04a00640 1 -- 172.21.15.114:0/1899313489 learned_addr learned my addr 172.21.15.114:0/1899313489 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.977+0000 7f8effe00640 1 --2- 172.21.15.114:0/1899313489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f0006db50 0x7f8f0014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.977+0000 7f8f04a00640 1 -- 172.21.15.114:0/1899313489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f0006db50 msgr2=0x7f8f0014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.977+0000 7f8f04a00640 1 --2- 172.21.15.114:0/1899313489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f0006db50 0x7f8f0014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.977+0000 7f8f04a00640 1 -- 172.21.15.114:0/1899313489 >> v1:172.21.15.116:6789/0 conn(0x7f8f00150490 legacy=0x7f8f00152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.977+0000 7f8f04a00640 1 -- 172.21.15.114:0/1899313489 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00156830 con 0x7f8f000c25a0 2024-02-17T12:18:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.977+0000 7f8f04a00640 1 --2- 172.21.15.114:0/1899313489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000c25a0 0x7f8f0006e980 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009870 tx=0x7f8ef001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14cb6ae61ab9188 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.977+0000 7f8eff400640 1 -- 172.21.15.114:0/1899313489 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00a7070 con 0x7f8f000c25a0 2024-02-17T12:18:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.977+0000 7f8eff400640 1 -- 172.21.15.114:0/1899313489 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef00ab430 con 0x7f8f000c25a0 2024-02-17T12:18:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.977+0000 7f8eff400640 1 -- 172.21.15.114:0/1899313489 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00ab7c0 con 0x7f8f000c25a0 2024-02-17T12:18:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.977+0000 7f8f07400640 1 -- 172.21.15.114:0/1899313489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000c25a0 msgr2=0x7f8f0006e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 --2- 172.21.15.114:0/1899313489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000c25a0 0x7f8f0006e980 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009870 tx=0x7f8ef001c410 comp rx=0 tx=0).stop 2024-02-17T12:18:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 -- 172.21.15.114:0/1899313489 shutdown_connections 2024-02-17T12:18:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 --2- 172.21.15.114:0/1899313489 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f0006db50 0x7f8f0014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 --2- 172.21.15.114:0/1899313489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f000c25a0 0x7f8f0006e980 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 -- 172.21.15.114:0/1899313489 >> 172.21.15.114:0/1899313489 conn(0x7f8f000a8490 msgr2=0x7f8f000a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 -- 172.21.15.114:0/1899313489 shutdown_connections 2024-02-17T12:18:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 -- 172.21.15.114:0/1899313489 wait complete. 2024-02-17T12:18:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 Processor -- start 2024-02-17T12:18:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 -- start start 2024-02-17T12:18:04.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f0006db50 0x7f8f001434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:04.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000c25a0 0x7f8f001ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:04.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f00150490 0x7f8f00141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:04.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f00144580 con 0x7f8f00150490 2024-02-17T12:18:04.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f001ed160 con 0x7f8f0006db50 2024-02-17T12:18:04.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f00143d70 con 0x7f8f000c25a0 2024-02-17T12:18:04.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f05400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f00150490 0x7f8f00141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:04.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f05400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f00150490 0x7f8f00141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35400/0 (socket says 172.21.15.114:35400) 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f05400640 1 -- 172.21.15.114:0/2682560286 learned_addr learned my addr 172.21.15.114:0/2682560286 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8effe00640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000c25a0 0x7f8f001ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f04a00640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f0006db50 0x7f8f001434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f05400640 1 -- 172.21.15.114:0/2682560286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000c25a0 msgr2=0x7f8f001ed890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f05400640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000c25a0 0x7f8f001ed890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f05400640 1 -- 172.21.15.114:0/2682560286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f0006db50 msgr2=0x7f8f001434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f05400640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f0006db50 0x7f8f001434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f05400640 1 -- 172.21.15.114:0/2682560286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00094d0 con 0x7f8f00150490 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f05400640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f00150490 0x7f8f00141a60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800c730 tx=0x7f8ef800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8efcc00640 1 -- 172.21.15.114:0/2682560286 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8003b80 con 0x7f8f00150490 2024-02-17T12:18:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8efcc00640 1 -- 172.21.15.114:0/2682560286 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef8003ce0 con 0x7f8f00150490 2024-02-17T12:18:04.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 -- 172.21.15.114:0/2682560286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f001ed400 con 0x7f8f00150490 2024-02-17T12:18:04.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8efcc00640 1 -- 172.21.15.114:0/2682560286 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8005310 con 0x7f8f00150490 2024-02-17T12:18:04.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.981+0000 7f8f07400640 1 -- 172.21.15.114:0/2682560286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f001442a0 con 0x7f8f00150490 2024-02-17T12:18:04.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.985+0000 7f8f07400640 1 -- 172.21.15.114:0/2682560286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f001ed590 con 0x7f8f00150490 2024-02-17T12:18:04.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.985+0000 7f8efcc00640 1 -- 172.21.15.114:0/2682560286 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8ef8005680 con 0x7f8f00150490 2024-02-17T12:18:04.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.985+0000 7f8efcc00640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 0x7f8ee0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:04.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.985+0000 7f8efcc00640 1 -- 172.21.15.114:0/2682560286 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ef8084910 con 0x7f8f00150490 2024-02-17T12:18:04.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.985+0000 7f8f04a00640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 0x7f8ee0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:04.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.985+0000 7f8f04a00640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 0x7f8ee0069300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00af000 tx=0x7f8ef0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:04.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:04.989+0000 7f8efcc00640 1 -- 172.21.15.114:0/2682560286 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8ef8051710 con 0x7f8f00150490 2024-02-17T12:18:05.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.177+0000 7f8f07400640 1 -- 172.21.15.114:0/2682560286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8f00074840 con 0x7f8f00150490 2024-02-17T12:18:05.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.813+0000 7f8efcc00640 1 -- 172.21.15.114:0/2682560286 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8ef8054dd0 con 0x7f8f00150490 2024-02-17T12:18:05.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 -- 172.21.15.114:0/2682560286 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 msgr2=0x7f8ee0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:05.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 0x7f8ee0069300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00af000 tx=0x7f8ef0008040 comp rx=0 tx=0).stop 2024-02-17T12:18:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 -- 172.21.15.114:0/2682560286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f00150490 msgr2=0x7f8f00141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f00150490 0x7f8f00141a60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800c730 tx=0x7f8ef800cbf0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 -- 172.21.15.114:0/2682560286 shutdown_connections 2024-02-17T12:18:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee0066e40 0x7f8ee0069300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f00150490 0x7f8f00141a60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f000c25a0 0x7f8f001ed890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 --2- 172.21.15.114:0/2682560286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f0006db50 0x7f8f001434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 -- 172.21.15.114:0/2682560286 >> 172.21.15.114:0/2682560286 conn(0x7f8f000a8490 msgr2=0x7f8f000a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 -- 172.21.15.114:0/2682560286 shutdown_connections 2024-02-17T12:18:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.817+0000 7f8f07400640 1 -- 172.21.15.114:0/2682560286 wait complete. 2024-02-17T12:18:05.841 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-17T12:18:05.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:05.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5889600640 1 Processor -- start 2024-02-17T12:18:05.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5889600640 1 -- start start 2024-02-17T12:18:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5889600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5884158660 0x7f58840c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5889600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f588406bd20 0x7f588406c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5889600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5884159150 con 0x7f58840c59a0 2024-02-17T12:18:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5889600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58840c3440 con 0x7f588406bd20 2024-02-17T12:18:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5889600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58840c6800 con 0x7f5884158660 2024-02-17T12:18:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5883400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f58840c59a0 0x7f5884158a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32984/0 (socket says 172.21.15.114:32984) 2024-02-17T12:18:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5883400640 1 -- 172.21.15.114:0/791833938 learned_addr learned my addr 172.21.15.114:0/791833938 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:05.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5883e00640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5884158660 0x7f58840c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5888c00640 1 --2- 172.21.15.114:0/791833938 >> v2:172.21.15.116:3300/0 conn(0x7f588406bd20 0x7f588406c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.973+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749439929 0 0) 0x7f5870001120 con 0x7f58840c59a0 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5868003530 con 0x7f58840c59a0 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1438141972 0 0) 0x7f5868003530 con 0x7f58840c59a0 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5884158660 msgr2=0x7f58840c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5884158660 0x7f58840c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 >> v2:172.21.15.116:3300/0 conn(0x7f588406bd20 msgr2=0x7f588406c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 --2- 172.21.15.114:0/791833938 >> v2:172.21.15.116:3300/0 conn(0x7f588406bd20 0x7f588406c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58840c5510 con 0x7f58840c59a0 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f5870001810 con 0x7f58840c59a0 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 >> v1:172.21.15.114:6789/0 conn(0x7f58840c59a0 legacy=0x7f5884158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5884158660 0x7f5868003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5868003f00 0x7f58680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5868004d10 0x7f5868005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58840c3440 con 0x7f5868004d10 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58840c6800 con 0x7f5868003f00 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586800b9e0 con 0x7f5884158660 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5888c00640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5868004d10 0x7f5868005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5883e00640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5884158660 0x7f5868003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5883400640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5868003f00 0x7f58680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5888c00640 1 -- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5884158660 msgr2=0x7f5868003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5888c00640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5884158660 0x7f5868003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5888c00640 1 -- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5868003f00 msgr2=0x7f58680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5888c00640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5868003f00 0x7f58680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5888c00640 1 -- 172.21.15.114:0/791833938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868003530 con 0x7f5868004d10 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.977+0000 7f5888c00640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5868004d10 0x7f5868005190 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f587c00e170 tx=0x7f587c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3190d6a271b3e89d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c0a5ba0 con 0x7f5868004d10 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c00f040 con 0x7f5868004d10 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5882a00640 1 -- 172.21.15.114:0/791833938 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c0ad440 con 0x7f5868004d10 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 -- 172.21.15.114:0/791833938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5868004d10 msgr2=0x7f5868005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 --2- 172.21.15.114:0/791833938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5868004d10 0x7f5868005190 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f587c00e170 tx=0x7f587c01cca0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5888c00640 1 -- 172.21.15.114:0/791833938 reap_dead start 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 -- 172.21.15.114:0/791833938 shutdown_connections 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 -- 172.21.15.114:0/791833938 >> 172.21.15.114:0/791833938 conn(0x7f5884066960 msgr2=0x7f5884066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 -- 172.21.15.114:0/791833938 shutdown_connections 2024-02-17T12:18:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 -- 172.21.15.114:0/791833938 wait complete. 2024-02-17T12:18:05.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 Processor -- start 2024-02-17T12:18:05.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 -- start start 2024-02-17T12:18:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58841ed480 0x7f58841ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58840ad3f0 0x7f58840ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5884147d50 0x7f58840ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588414c410 con 0x7f5884147d50 2024-02-17T12:18:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58841eb420 con 0x7f58841ed480 2024-02-17T12:18:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5889600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58841ee1e0 con 0x7f58840ad3f0 2024-02-17T12:18:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5888c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5884147d50 0x7f58840ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5888c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5884147d50 0x7f58840ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41620/0 (socket says 172.21.15.114:41620) 2024-02-17T12:18:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5883e00640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58841ed480 0x7f58841ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5888c00640 1 -- 172.21.15.114:0/625774044 learned_addr learned my addr 172.21.15.114:0/625774044 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.981+0000 7f5883400640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58840ad3f0 0x7f58840ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f5888c00640 1 -- 172.21.15.114:0/625774044 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58840ad3f0 msgr2=0x7f58840ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f5888c00640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58840ad3f0 0x7f58840ac340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f5888c00640 1 -- 172.21.15.114:0/625774044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58841ed480 msgr2=0x7f58841ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f5888c00640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58841ed480 0x7f58841ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f5888c00640 1 -- 172.21.15.114:0/625774044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588414c620 con 0x7f5884147d50 2024-02-17T12:18:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f5888c00640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5884147d50 0x7f58840ac880 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f587c00e170 tx=0x7f587c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:05.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f587be00640 1 -- 172.21.15.114:0/625774044 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c0039a0 con 0x7f5884147d50 2024-02-17T12:18:05.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f587be00640 1 -- 172.21.15.114:0/625774044 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c003b00 con 0x7f5884147d50 2024-02-17T12:18:05.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f5889600640 1 -- 172.21.15.114:0/625774044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58840abe20 con 0x7f5884147d50 2024-02-17T12:18:05.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f587be00640 1 -- 172.21.15.114:0/625774044 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c003e70 con 0x7f5884147d50 2024-02-17T12:18:05.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f5889600640 1 -- 172.21.15.114:0/625774044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58841edda0 con 0x7f5884147d50 2024-02-17T12:18:05.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f5889600640 1 -- 172.21.15.114:0/625774044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5884068180 con 0x7f5884147d50 2024-02-17T12:18:05.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f587be00640 1 -- 172.21.15.114:0/625774044 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f587c0b4040 con 0x7f5884147d50 2024-02-17T12:18:05.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f587be00640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5864066e40 0x7f5864069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:05.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f587be00640 1 -- 172.21.15.114:0/625774044 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f587c11e7a0 con 0x7f5884147d50 2024-02-17T12:18:05.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.985+0000 7f5883e00640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5864066e40 0x7f5864069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:05.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.989+0000 7f5883e00640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5864066e40 0x7f5864069300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5874009be0 tx=0x7f5874009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:05.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:05.989+0000 7f587be00640 1 -- 172.21.15.114:0/625774044 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f587c0eb6f0 con 0x7f5884147d50 2024-02-17T12:18:06.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.177+0000 7f5889600640 1 -- 172.21.15.114:0/625774044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f588404eef0 con 0x7f5884147d50 2024-02-17T12:18:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.177+0000 7f587be00640 1 -- 172.21.15.114:0/625774044 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f587c0b2090 con 0x7f5884147d50 2024-02-17T12:18:06.181 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:06.181 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1690237872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1690237872},{"type":"v1","addr":"172.21.15.114:6836","nonce":1690237872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:02.157066+0000","modified":"2024-02-17T12:18:05.178755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/105000653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":105000653},{"type":"v1","addr":"172.21.15.114:6837","nonce":105000653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-02-17T12:18:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 33 2024-02-17T12:18:06.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 -- 172.21.15.114:0/625774044 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5864066e40 msgr2=0x7f5864069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5864066e40 0x7f5864069300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5874009be0 tx=0x7f5874009190 comp rx=0 tx=0).stop 2024-02-17T12:18:06.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 -- 172.21.15.114:0/625774044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5884147d50 msgr2=0x7f58840ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5884147d50 0x7f58840ac880 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f587c00e170 tx=0x7f587c009750 comp rx=0 tx=0).stop 2024-02-17T12:18:06.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 -- 172.21.15.114:0/625774044 shutdown_connections 2024-02-17T12:18:06.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5864066e40 0x7f5864069300 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5884147d50 0x7f58840ac880 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58840ad3f0 0x7f58840ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 --2- 172.21.15.114:0/625774044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58841ed480 0x7f58841ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 -- 172.21.15.114:0/625774044 >> 172.21.15.114:0/625774044 conn(0x7f5884066960 msgr2=0x7f588414b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:06.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 -- 172.21.15.114:0/625774044 shutdown_connections 2024-02-17T12:18:06.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.181+0000 7f5889600640 1 -- 172.21.15.114:0/625774044 wait complete. 2024-02-17T12:18:06.203 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.333+0000 7f9435200640 1 Processor -- start 2024-02-17T12:18:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.333+0000 7f9435200640 1 -- start start 2024-02-17T12:18:06.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.333+0000 7f9435200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f943014f110 0x7f94300c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.333+0000 7f9435200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f94300c2580 0x7f94300aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.333+0000 7f9435200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94300a9420 con 0x7f94300c1eb0 2024-02-17T12:18:06.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.333+0000 7f9435200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943014f4f0 con 0x7f943014f110 2024-02-17T12:18:06.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.333+0000 7f9435200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94300aae80 con 0x7f94300c2580 2024-02-17T12:18:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.333+0000 7f942de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f943014f110 0x7f94300c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f943014f110 0x7f94300c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41632/0 (socket says 172.21.15.114:41632) 2024-02-17T12:18:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942de00640 1 -- 172.21.15.114:0/1094162964 learned_addr learned my addr 172.21.15.114:0/1094162964 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942e800640 1 --1- 172.21.15.114:0/1094162964 >> v1:172.21.15.114:6789/0 conn(0x7f94300c1eb0 0x7f9430155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32990/0 (socket says 172.21.15.114:32990) 2024-02-17T12:18:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942d400640 1 --2- 172.21.15.114:0/1094162964 >> v2:172.21.15.116:3300/0 conn(0x7f94300c2580 0x7f94300aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942de00640 1 -- 172.21.15.114:0/1094162964 >> v2:172.21.15.116:3300/0 conn(0x7f94300c2580 msgr2=0x7f94300aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942de00640 1 --2- 172.21.15.114:0/1094162964 >> v2:172.21.15.116:3300/0 conn(0x7f94300c2580 0x7f94300aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942de00640 1 -- 172.21.15.114:0/1094162964 >> v1:172.21.15.114:6789/0 conn(0x7f94300c1eb0 legacy=0x7f9430155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942de00640 1 -- 172.21.15.114:0/1094162964 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430152850 con 0x7f943014f110 2024-02-17T12:18:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942de00640 1 --2- 172.21.15.114:0/1094162964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 0x7f94300c65a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f943006f0d0 tx=0x7f942001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81de6550582389e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942ca00640 1 -- 172.21.15.114:0/1094162964 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94200ab660 con 0x7f943014f110 2024-02-17T12:18:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942ca00640 1 -- 172.21.15.114:0/1094162964 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94200ab7c0 con 0x7f943014f110 2024-02-17T12:18:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f942ca00640 1 -- 172.21.15.114:0/1094162964 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94200abb50 con 0x7f943014f110 2024-02-17T12:18:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f9435200640 1 -- 172.21.15.114:0/1094162964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 msgr2=0x7f94300c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.337+0000 7f9435200640 1 --2- 172.21.15.114:0/1094162964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 0x7f94300c65a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f943006f0d0 tx=0x7f942001c460 comp rx=0 tx=0).stop 2024-02-17T12:18:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 -- 172.21.15.114:0/1094162964 shutdown_connections 2024-02-17T12:18:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 --2- 172.21.15.114:0/1094162964 >> v2:172.21.15.116:3300/0 conn(0x7f94300c2580 0x7f94300aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 --2- 172.21.15.114:0/1094162964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 0x7f94300c65a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 -- 172.21.15.114:0/1094162964 >> 172.21.15.114:0/1094162964 conn(0x7f94300a8490 msgr2=0x7f94300a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 -- 172.21.15.114:0/1094162964 shutdown_connections 2024-02-17T12:18:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 -- 172.21.15.114:0/1094162964 wait complete. 2024-02-17T12:18:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 Processor -- start 2024-02-17T12:18:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 -- start start 2024-02-17T12:18:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94300c1eb0 0x7f943006e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94300c2580 0x7f943013d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 0x7f943013d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94301f1d20 con 0x7f943014f110 2024-02-17T12:18:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9430149e90 con 0x7f94300c2580 2024-02-17T12:18:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943013de10 con 0x7f94300c1eb0 2024-02-17T12:18:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 0x7f943013d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 0x7f943013d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41648/0 (socket says 172.21.15.114:41648) 2024-02-17T12:18:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942e800640 1 -- 172.21.15.114:0/1460882822 learned_addr learned my addr 172.21.15.114:0/1460882822 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942de00640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94300c1eb0 0x7f943006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942d400640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94300c2580 0x7f943013d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942e800640 1 -- 172.21.15.114:0/1460882822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94300c1eb0 msgr2=0x7f943006e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942e800640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94300c1eb0 0x7f943006e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942e800640 1 -- 172.21.15.114:0/1460882822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94300c2580 msgr2=0x7f943013d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942e800640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94300c2580 0x7f943013d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942e800640 1 -- 172.21.15.114:0/1460882822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94200094d0 con 0x7f943014f110 2024-02-17T12:18:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f942e800640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 0x7f943013d8d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f942800c7d0 tx=0x7f942800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9426000640 1 -- 172.21.15.114:0/1460882822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800a640 con 0x7f943014f110 2024-02-17T12:18:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9426000640 1 -- 172.21.15.114:0/1460882822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942800a7a0 con 0x7f943014f110 2024-02-17T12:18:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9435200640 1 -- 172.21.15.114:0/1460882822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9430149560 con 0x7f943014f110 2024-02-17T12:18:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.341+0000 7f9426000640 1 -- 172.21.15.114:0/1460882822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800ab10 con 0x7f943014f110 2024-02-17T12:18:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.345+0000 7f9435200640 1 -- 172.21.15.114:0/1460882822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9430149b20 con 0x7f943014f110 2024-02-17T12:18:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.345+0000 7f9435200640 1 -- 172.21.15.114:0/1460882822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943014a040 con 0x7f943014f110 2024-02-17T12:18:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.345+0000 7f9426000640 1 -- 172.21.15.114:0/1460882822 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f942800ac70 con 0x7f943014f110 2024-02-17T12:18:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.345+0000 7f9426000640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9410066e40 0x7f9410069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.345+0000 7f9426000640 1 -- 172.21.15.114:0/1460882822 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9428084140 con 0x7f943014f110 2024-02-17T12:18:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.345+0000 7f942de00640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9410066e40 0x7f9410069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.345+0000 7f942de00640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9410066e40 0x7f9410069300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f94200af000 tx=0x7f94200b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:06.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.349+0000 7f9426000640 1 -- 172.21.15.114:0/1460882822 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f943014a040 con 0x7f943014f110 2024-02-17T12:18:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.505+0000 7f9435200640 1 -- 172.21.15.114:0/1460882822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f943014a040 con 0x7f943014f110 2024-02-17T12:18:06.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.505+0000 7f9426000640 1 -- 172.21.15.114:0/1460882822 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16677 (secure 0 0 0) 0x7f943014a040 con 0x7f943014f110 2024-02-17T12:18:06.509 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:06.509 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":50,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:03.787001+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 -- 172.21.15.114:0/1460882822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9410066e40 msgr2=0x7f9410069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9410066e40 0x7f9410069300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f94200af000 tx=0x7f94200b6040 comp rx=0 tx=0).stop 2024-02-17T12:18:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 -- 172.21.15.114:0/1460882822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 msgr2=0x7f943013d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 0x7f943013d8d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f942800c7d0 tx=0x7f942800cc90 comp rx=0 tx=0).stop 2024-02-17T12:18:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 -- 172.21.15.114:0/1460882822 shutdown_connections 2024-02-17T12:18:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9410066e40 0x7f9410069300 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f943014f110 0x7f943013d8d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94300c2580 0x7f943013d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 --2- 172.21.15.114:0/1460882822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94300c1eb0 0x7f943006e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 -- 172.21.15.114:0/1460882822 >> 172.21.15.114:0/1460882822 conn(0x7f94300a8490 msgr2=0x7f943006b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 -- 172.21.15.114:0/1460882822 shutdown_connections 2024-02-17T12:18:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.509+0000 7f9435200640 1 -- 172.21.15.114:0/1460882822 wait complete. 2024-02-17T12:18:06.530 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T12:18:06.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:18:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.661+0000 7f3655200640 1 Processor -- start 2024-02-17T12:18:06.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.661+0000 7f3655200640 1 -- start start 2024-02-17T12:18:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.661+0000 7f3655200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f365006db50 0x7f365014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.661+0000 7f3655200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3650156270 con 0x7f3650150490 2024-02-17T12:18:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.661+0000 7f3655200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3650156550 con 0x7f36500c25a0 2024-02-17T12:18:06.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.661+0000 7f3655200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365006f090 con 0x7f365006db50 2024-02-17T12:18:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.661+0000 7f364d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f365006db50 0x7f365014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.661+0000 7f364d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f365006db50 0x7f365014ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41650/0 (socket says 172.21.15.114:41650) 2024-02-17T12:18:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.661+0000 7f364e800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3650150490 0x7f3650152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:32992/0 (socket says 172.21.15.114:32992) 2024-02-17T12:18:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.661+0000 7f364d400640 1 -- 172.21.15.114:0/1393231437 learned_addr learned my addr 172.21.15.114:0/1393231437 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f364d400640 1 -- 172.21.15.114:0/1393231437 >> v1:172.21.15.116:6789/0 conn(0x7f36500c25a0 legacy=0x7f365006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f364d400640 1 -- 172.21.15.114:0/1393231437 >> v1:172.21.15.114:6789/0 conn(0x7f3650150490 legacy=0x7f3650152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f364d400640 1 -- 172.21.15.114:0/1393231437 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650156830 con 0x7f365006db50 2024-02-17T12:18:06.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f364ca00640 1 -- 172.21.15.114:0/1393231437 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001851266 0 0) 0x7f3650156270 con 0x7f3650150490 2024-02-17T12:18:06.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f364d400640 1 --2- 172.21.15.114:0/1393231437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365006db50 0x7f365014ff50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3638009870 tx=0x7f363801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab1bd9a4b6a5f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:06.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f364ca00640 1 -- 172.21.15.114:0/1393231437 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380ab600 con 0x7f365006db50 2024-02-17T12:18:06.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f364ca00640 1 -- 172.21.15.114:0/1393231437 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36380a7050 con 0x7f365006db50 2024-02-17T12:18:06.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f364ca00640 1 -- 172.21.15.114:0/1393231437 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380ab980 con 0x7f365006db50 2024-02-17T12:18:06.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f3655200640 1 -- 172.21.15.114:0/1393231437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365006db50 msgr2=0x7f365014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f3655200640 1 --2- 172.21.15.114:0/1393231437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365006db50 0x7f365014ff50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3638009870 tx=0x7f363801c440 comp rx=0 tx=0).stop 2024-02-17T12:18:06.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.665+0000 7f3655200640 1 -- 172.21.15.114:0/1393231437 shutdown_connections 2024-02-17T12:18:06.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 --2- 172.21.15.114:0/1393231437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365006db50 0x7f365014ff50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 -- 172.21.15.114:0/1393231437 >> 172.21.15.114:0/1393231437 conn(0x7f36500a8490 msgr2=0x7f36500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:06.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 -- 172.21.15.114:0/1393231437 shutdown_connections 2024-02-17T12:18:06.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 -- 172.21.15.114:0/1393231437 wait complete. 2024-02-17T12:18:06.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 Processor -- start 2024-02-17T12:18:06.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 -- start start 2024-02-17T12:18:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f365006db50 0x7f3650139c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36500c25a0 0x7f36500bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3650150490 0x7f365014dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365013fe90 con 0x7f36500c25a0 2024-02-17T12:18:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500ab1f0 con 0x7f3650150490 2024-02-17T12:18:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3650140130 con 0x7f365006db50 2024-02-17T12:18:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36500c25a0 0x7f36500bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36500c25a0 0x7f36500bf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41656/0 (socket says 172.21.15.114:41656) 2024-02-17T12:18:06.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364d400640 1 -- 172.21.15.114:0/2771501421 learned_addr learned my addr 172.21.15.114:0/2771501421 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364e800640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3650150490 0x7f365014dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364de00640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f365006db50 0x7f3650139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364d400640 1 -- 172.21.15.114:0/2771501421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f365006db50 msgr2=0x7f3650139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364d400640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f365006db50 0x7f3650139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364d400640 1 -- 172.21.15.114:0/2771501421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3650150490 msgr2=0x7f365014dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364d400640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3650150490 0x7f365014dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364d400640 1 -- 172.21.15.114:0/2771501421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36380094d0 con 0x7f36500c25a0 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364de00640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f365006db50 0x7f3650139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f364d400640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36500c25a0 0x7f36500bf7a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f36380ae040 tx=0x7f363801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3646000640 1 -- 172.21.15.114:0/2771501421 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380b6620 con 0x7f36500c25a0 2024-02-17T12:18:06.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3646000640 1 -- 172.21.15.114:0/2771501421 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36380b67a0 con 0x7f36500c25a0 2024-02-17T12:18:06.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3646000640 1 -- 172.21.15.114:0/2771501421 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380b6b50 con 0x7f36500c25a0 2024-02-17T12:18:06.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 -- 172.21.15.114:0/2771501421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3650140410 con 0x7f36500c25a0 2024-02-17T12:18:06.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.669+0000 7f3655200640 1 -- 172.21.15.114:0/2771501421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36501410f0 con 0x7f36500c25a0 2024-02-17T12:18:06.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.673+0000 7f3655200640 1 -- 172.21.15.114:0/2771501421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3650074840 con 0x7f36500c25a0 2024-02-17T12:18:06.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.673+0000 7f3646000640 1 -- 172.21.15.114:0/2771501421 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f36380b2040 con 0x7f36500c25a0 2024-02-17T12:18:06.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.673+0000 7f3646000640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f362c066e40 0x7f362c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:06.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.673+0000 7f3646000640 1 -- 172.21.15.114:0/2771501421 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f363811ee40 con 0x7f36500c25a0 2024-02-17T12:18:06.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.673+0000 7f364de00640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f362c066e40 0x7f362c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:06.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.673+0000 7f364de00640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f362c066e40 0x7f362c069300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f36400012f0 tx=0x7f3640009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:06.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.677+0000 7f3646000640 1 -- 172.21.15.114:0/2771501421 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f36380ebd70 con 0x7f36500c25a0 2024-02-17T12:18:06.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.829+0000 7f3655200640 1 -- 172.21.15.114:0/2771501421 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3650074ac0 con 0x7f362c066e40 2024-02-17T12:18:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.837+0000 7f3646000640 1 -- 172.21.15.114:0/2771501421 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279349 (secure 0 0 0) 0x7f3650074ac0 con 0x7f362c066e40 2024-02-17T12:18:06.843 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:06.845 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 -- 172.21.15.114:0/2771501421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f362c066e40 msgr2=0x7f362c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f362c066e40 0x7f362c069300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f36400012f0 tx=0x7f3640009040 comp rx=0 tx=0).stop 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 -- 172.21.15.114:0/2771501421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36500c25a0 msgr2=0x7f36500bf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36500c25a0 0x7f36500bf7a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f36380ae040 tx=0x7f363801ac80 comp rx=0 tx=0).stop 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 -- 172.21.15.114:0/2771501421 shutdown_connections 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3650150490 0x7f365014dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f362c066e40 0x7f362c069300 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36500c25a0 0x7f36500bf7a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 --2- 172.21.15.114:0/2771501421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f365006db50 0x7f3650139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 -- 172.21.15.114:0/2771501421 >> 172.21.15.114:0/2771501421 conn(0x7f36500a8490 msgr2=0x7f36501421a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 -- 172.21.15.114:0/2771501421 shutdown_connections 2024-02-17T12:18:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:06.841+0000 7f3655200640 1 -- 172.21.15.114:0/2771501421 wait complete. 2024-02-17T12:18:06.863 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-02-17T12:18:05.237412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592070,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":225880,"kb_used_data":5520,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748840,"statfs":{"total":773094113280,"available":772862812160,"internally_reserved":0,"allocated":5652480,"data_stored":3023061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1702,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.465923"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867789+0000","last_change":"2024-02-17T12:18:02.804326+0000","last_active":"2024-02-17T12:18:03.867789+0000","last_peered":"2024-02-17T12:18:03.867789+0000","last_clean":"2024-02-17T12:18:03.867789+0000","last_became_active":"2024-02-17T12:18:02.804074+0000","last_became_peered":"2024-02-17T12:18:02.804074+0000","last_unstale":"2024-02-17T12:18:03.867789+0000","last_undegraded":"2024-02-17T12:18:03.867789+0000","last_fullsized":"2024-02-17T12:18:03.867789+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:47.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173302+0000","last_change":"2024-02-17T12:18:02.807196+0000","last_active":"2024-02-17T12:18:04.173302+0000","last_peered":"2024-02-17T12:18:04.173302+0000","last_clean":"2024-02-17T12:18:04.173302+0000","last_became_active":"2024-02-17T12:18:02.806894+0000","last_became_peered":"2024-02-17T12:18:02.806894+0000","last_unstale":"2024-02-17T12:18:04.173302+0000","last_undegraded":"2024-02-17T12:18:04.173302+0000","last_fullsized":"2024-02-17T12:18:04.173302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:12.749708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867694+0000","last_change":"2024-02-17T12:18:02.802996+0000","last_active":"2024-02-17T12:18:03.867694+0000","last_peered":"2024-02-17T12:18:03.867694+0000","last_clean":"2024-02-17T12:18:03.867694+0000","last_became_active":"2024-02-17T12:18:02.802690+0000","last_became_peered":"2024-02-17T12:18:02.802690+0000","last_unstale":"2024-02-17T12:18:03.867694+0000","last_undegraded":"2024-02-17T12:18:03.867694+0000","last_fullsized":"2024-02-17T12:18:03.867694+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:59.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802402+0000","last_change":"2024-02-17T12:18:02.799654+0000","last_active":"2024-02-17T12:18:03.802402+0000","last_peered":"2024-02-17T12:18:03.802402+0000","last_clean":"2024-02-17T12:18:03.802402+0000","last_became_active":"2024-02-17T12:18:02.799356+0000","last_became_peered":"2024-02-17T12:18:02.799356+0000","last_unstale":"2024-02-17T12:18:03.802402+0000","last_undegraded":"2024-02-17T12:18:03.802402+0000","last_fullsized":"2024-02-17T12:18:03.802402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:29.710017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802908+0000","last_change":"2024-02-17T12:18:02.794591+0000","last_active":"2024-02-17T12:18:03.802908+0000","last_peered":"2024-02-17T12:18:03.802908+0000","last_clean":"2024-02-17T12:18:03.802908+0000","last_became_active":"2024-02-17T12:18:02.794309+0000","last_became_peered":"2024-02-17T12:18:02.794309+0000","last_unstale":"2024-02-17T12:18:03.802908+0000","last_undegraded":"2024-02-17T12:18:03.802908+0000","last_fullsized":"2024-02-17T12:18:03.802908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:18.132994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802492+0000","last_change":"2024-02-17T12:18:02.798437+0000","last_active":"2024-02-17T12:18:03.802492+0000","last_peered":"2024-02-17T12:18:03.802492+0000","last_clean":"2024-02-17T12:18:03.802492+0000","last_became_active":"2024-02-17T12:18:02.798145+0000","last_became_peered":"2024-02-17T12:18:02.798145+0000","last_unstale":"2024-02-17T12:18:03.802492+0000","last_undegraded":"2024-02-17T12:18:03.802492+0000","last_fullsized":"2024-02-17T12:18:03.802492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:29.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802419+0000","last_change":"2024-02-17T12:18:02.797013+0000","last_active":"2024-02-17T12:18:03.802419+0000","last_peered":"2024-02-17T12:18:03.802419+0000","last_clean":"2024-02-17T12:18:03.802419+0000","last_became_active":"2024-02-17T12:18:02.796734+0000","last_became_peered":"2024-02-17T12:18:02.796734+0000","last_unstale":"2024-02-17T12:18:03.802419+0000","last_undegraded":"2024-02-17T12:18:03.802419+0000","last_fullsized":"2024-02-17T12:18:03.802419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:32.566741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173764+0000","last_change":"2024-02-17T12:18:02.809074+0000","last_active":"2024-02-17T12:18:04.173764+0000","last_peered":"2024-02-17T12:18:04.173764+0000","last_clean":"2024-02-17T12:18:04.173764+0000","last_became_active":"2024-02-17T12:18:02.808683+0000","last_became_peered":"2024-02-17T12:18:02.808683+0000","last_unstale":"2024-02-17T12:18:04.173764+0000","last_undegraded":"2024-02-17T12:18:04.173764+0000","last_fullsized":"2024-02-17T12:18:04.173764+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:46:21.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867919+0000","last_change":"2024-02-17T12:18:02.803587+0000","last_active":"2024-02-17T12:18:03.867919+0000","last_peered":"2024-02-17T12:18:03.867919+0000","last_clean":"2024-02-17T12:18:03.867919+0000","last_became_active":"2024-02-17T12:18:02.803312+0000","last_became_peered":"2024-02-17T12:18:02.803312+0000","last_unstale":"2024-02-17T12:18:03.867919+0000","last_undegraded":"2024-02-17T12:18:03.867919+0000","last_fullsized":"2024-02-17T12:18:03.867919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:54:01.696616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173161+0000","last_change":"2024-02-17T12:18:02.809894+0000","last_active":"2024-02-17T12:18:04.173161+0000","last_peered":"2024-02-17T12:18:04.173161+0000","last_clean":"2024-02-17T12:18:04.173161+0000","last_became_active":"2024-02-17T12:18:02.807451+0000","last_became_peered":"2024-02-17T12:18:02.807451+0000","last_unstale":"2024-02-17T12:18:04.173161+0000","last_undegraded":"2024-02-17T12:18:04.173161+0000","last_fullsized":"2024-02-17T12:18:04.173161+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:05:50.249065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173537+0000","last_change":"2024-02-17T12:18:02.807916+0000","last_active":"2024-02-17T12:18:04.173537+0000","last_peered":"2024-02-17T12:18:04.173537+0000","last_clean":"2024-02-17T12:18:04.173537+0000","last_became_active":"2024-02-17T12:18:02.806754+0000","last_became_peered":"2024-02-17T12:18:02.806754+0000","last_unstale":"2024-02-17T12:18:04.173537+0000","last_undegraded":"2024-02-17T12:18:04.173537+0000","last_fullsized":"2024-02-17T12:18:04.173537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.985986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867898+0000","last_change":"2024-02-17T12:18:02.798267+0000","last_active":"2024-02-17T12:18:03.867898+0000","last_peered":"2024-02-17T12:18:03.867898+0000","last_clean":"2024-02-17T12:18:03.867898+0000","last_became_active":"2024-02-17T12:18:02.797624+0000","last_became_peered":"2024-02-17T12:18:02.797624+0000","last_unstale":"2024-02-17T12:18:03.867898+0000","last_undegraded":"2024-02-17T12:18:03.867898+0000","last_fullsized":"2024-02-17T12:18:03.867898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:17:06.691178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867831+0000","last_change":"2024-02-17T12:18:02.804711+0000","last_active":"2024-02-17T12:18:03.867831+0000","last_peered":"2024-02-17T12:18:03.867831+0000","last_clean":"2024-02-17T12:18:03.867831+0000","last_became_active":"2024-02-17T12:18:02.804459+0000","last_became_peered":"2024-02-17T12:18:02.804459+0000","last_unstale":"2024-02-17T12:18:03.867831+0000","last_undegraded":"2024-02-17T12:18:03.867831+0000","last_fullsized":"2024-02-17T12:18:03.867831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:47.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173099+0000","last_change":"2024-02-17T12:18:02.807169+0000","last_active":"2024-02-17T12:18:04.173099+0000","last_peered":"2024-02-17T12:18:04.173099+0000","last_clean":"2024-02-17T12:18:04.173099+0000","last_became_active":"2024-02-17T12:18:02.806918+0000","last_became_peered":"2024-02-17T12:18:02.806918+0000","last_unstale":"2024-02-17T12:18:04.173099+0000","last_undegraded":"2024-02-17T12:18:04.173099+0000","last_fullsized":"2024-02-17T12:18:04.173099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:17.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867681+0000","last_change":"2024-02-17T12:18:02.795014+0000","last_active":"2024-02-17T12:18:03.867681+0000","last_peered":"2024-02-17T12:18:03.867681+0000","last_clean":"2024-02-17T12:18:03.867681+0000","last_became_active":"2024-02-17T12:18:02.794759+0000","last_became_peered":"2024-02-17T12:18:02.794759+0000","last_unstale":"2024-02-17T12:18:03.867681+0000","last_undegraded":"2024-02-17T12:18:03.867681+0000","last_fullsized":"2024-02-17T12:18:03.867681+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:21.971723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802683+0000","last_change":"2024-02-17T12:18:01.798801+0000","last_active":"2024-02-17T12:18:03.802683+0000","last_peered":"2024-02-17T12:18:03.802683+0000","last_clean":"2024-02-17T12:18:03.802683+0000","last_became_active":"2024-02-17T12:18:01.798516+0000","last_became_peered":"2024-02-17T12:18:01.798516+0000","last_unstale":"2024-02-17T12:18:03.802683+0000","last_undegraded":"2024-02-17T12:18:03.802683+0000","last_fullsized":"2024-02-17T12:18:03.802683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:04:53.798642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802379+0000","last_change":"2024-02-17T12:18:01.800493+0000","last_active":"2024-02-17T12:18:03.802379+0000","last_peered":"2024-02-17T12:18:03.802379+0000","last_clean":"2024-02-17T12:18:03.802379+0000","last_became_active":"2024-02-17T12:18:01.800206+0000","last_became_peered":"2024-02-17T12:18:01.800206+0000","last_unstale":"2024-02-17T12:18:03.802379+0000","last_undegraded":"2024-02-17T12:18:03.802379+0000","last_fullsized":"2024-02-17T12:18:03.802379+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:33.603620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802978+0000","last_change":"2024-02-17T12:18:02.797952+0000","last_active":"2024-02-17T12:18:03.802978+0000","last_peered":"2024-02-17T12:18:03.802978+0000","last_clean":"2024-02-17T12:18:03.802978+0000","last_became_active":"2024-02-17T12:18:02.797675+0000","last_became_peered":"2024-02-17T12:18:02.797675+0000","last_unstale":"2024-02-17T12:18:03.802978+0000","last_undegraded":"2024-02-17T12:18:03.802978+0000","last_fullsized":"2024-02-17T12:18:03.802978+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:01.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173763+0000","last_change":"2024-02-17T12:18:01.801850+0000","last_active":"2024-02-17T12:18:04.173763+0000","last_peered":"2024-02-17T12:18:04.173763+0000","last_clean":"2024-02-17T12:18:04.173763+0000","last_became_active":"2024-02-17T12:18:01.801516+0000","last_became_peered":"2024-02-17T12:18:01.801516+0000","last_unstale":"2024-02-17T12:18:04.173763+0000","last_undegraded":"2024-02-17T12:18:04.173763+0000","last_fullsized":"2024-02-17T12:18:04.173763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:28.630666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173640+0000","last_change":"2024-02-17T12:18:02.813957+0000","last_active":"2024-02-17T12:18:04.173640+0000","last_peered":"2024-02-17T12:18:04.173640+0000","last_clean":"2024-02-17T12:18:04.173640+0000","last_became_active":"2024-02-17T12:18:02.813647+0000","last_became_peered":"2024-02-17T12:18:02.813647+0000","last_unstale":"2024-02-17T12:18:04.173640+0000","last_undegraded":"2024-02-17T12:18:04.173640+0000","last_fullsized":"2024-02-17T12:18:04.173640+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:41.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173815+0000","last_change":"2024-02-17T12:18:01.805403+0000","last_active":"2024-02-17T12:18:04.173815+0000","last_peered":"2024-02-17T12:18:04.173815+0000","last_clean":"2024-02-17T12:18:04.173815+0000","last_became_active":"2024-02-17T12:18:01.805059+0000","last_became_peered":"2024-02-17T12:18:01.805059+0000","last_unstale":"2024-02-17T12:18:04.173815+0000","last_undegraded":"2024-02-17T12:18:04.173815+0000","last_fullsized":"2024-02-17T12:18:04.173815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:14.495937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173478+0000","last_change":"2024-02-17T12:18:02.810198+0000","last_active":"2024-02-17T12:18:04.173478+0000","last_peered":"2024-02-17T12:18:04.173478+0000","last_clean":"2024-02-17T12:18:04.173478+0000","last_became_active":"2024-02-17T12:18:02.809131+0000","last_became_peered":"2024-02-17T12:18:02.809131+0000","last_unstale":"2024-02-17T12:18:04.173478+0000","last_undegraded":"2024-02-17T12:18:04.173478+0000","last_fullsized":"2024-02-17T12:18:04.173478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:01:23.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802836+0000","last_change":"2024-02-17T12:18:01.802710+0000","last_active":"2024-02-17T12:18:03.802836+0000","last_peered":"2024-02-17T12:18:03.802836+0000","last_clean":"2024-02-17T12:18:03.802836+0000","last_became_active":"2024-02-17T12:18:01.802365+0000","last_became_peered":"2024-02-17T12:18:01.802365+0000","last_unstale":"2024-02-17T12:18:03.802836+0000","last_undegraded":"2024-02-17T12:18:03.802836+0000","last_fullsized":"2024-02-17T12:18:03.802836+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:45.771679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173374+0000","last_change":"2024-02-17T12:18:02.808057+0000","last_active":"2024-02-17T12:18:04.173374+0000","last_peered":"2024-02-17T12:18:04.173374+0000","last_clean":"2024-02-17T12:18:04.173374+0000","last_became_active":"2024-02-17T12:18:02.807629+0000","last_became_peered":"2024-02-17T12:18:02.807629+0000","last_unstale":"2024-02-17T12:18:04.173374+0000","last_undegraded":"2024-02-17T12:18:04.173374+0000","last_fullsized":"2024-02-17T12:18:04.173374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:58:48.506743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802474+0000","last_change":"2024-02-17T12:18:02.810137+0000","last_active":"2024-02-17T12:18:03.802474+0000","last_peered":"2024-02-17T12:18:03.802474+0000","last_clean":"2024-02-17T12:18:03.802474+0000","last_became_active":"2024-02-17T12:18:02.809877+0000","last_became_peered":"2024-02-17T12:18:02.809877+0000","last_unstale":"2024-02-17T12:18:03.802474+0000","last_undegraded":"2024-02-17T12:18:03.802474+0000","last_fullsized":"2024-02-17T12:18:03.802474+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:15.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173954+0000","last_change":"2024-02-17T12:18:02.808594+0000","last_active":"2024-02-17T12:18:04.173954+0000","last_peered":"2024-02-17T12:18:04.173954+0000","last_clean":"2024-02-17T12:18:04.173954+0000","last_became_active":"2024-02-17T12:18:02.808035+0000","last_became_peered":"2024-02-17T12:18:02.808035+0000","last_unstale":"2024-02-17T12:18:04.173954+0000","last_undegraded":"2024-02-17T12:18:04.173954+0000","last_fullsized":"2024-02-17T12:18:04.173954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:58.050395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173264+0000","last_change":"2024-02-17T12:18:01.789017+0000","last_active":"2024-02-17T12:18:04.173264+0000","last_peered":"2024-02-17T12:18:04.173264+0000","last_clean":"2024-02-17T12:18:04.173264+0000","last_became_active":"2024-02-17T12:18:01.788529+0000","last_became_peered":"2024-02-17T12:18:01.788529+0000","last_unstale":"2024-02-17T12:18:04.173264+0000","last_undegraded":"2024-02-17T12:18:04.173264+0000","last_fullsized":"2024-02-17T12:18:04.173264+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:31.560281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.174014+0000","last_change":"2024-02-17T12:18:02.808518+0000","last_active":"2024-02-17T12:18:04.174014+0000","last_peered":"2024-02-17T12:18:04.174014+0000","last_clean":"2024-02-17T12:18:04.174014+0000","last_became_active":"2024-02-17T12:18:02.808255+0000","last_became_peered":"2024-02-17T12:18:02.808255+0000","last_unstale":"2024-02-17T12:18:04.174014+0000","last_undegraded":"2024-02-17T12:18:04.174014+0000","last_fullsized":"2024-02-17T12:18:04.174014+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:58:40.908163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173707+0000","last_change":"2024-02-17T12:18:02.811327+0000","last_active":"2024-02-17T12:18:04.173707+0000","last_peered":"2024-02-17T12:18:04.173707+0000","last_clean":"2024-02-17T12:18:04.173707+0000","last_became_active":"2024-02-17T12:18:02.809620+0000","last_became_peered":"2024-02-17T12:18:02.809620+0000","last_unstale":"2024-02-17T12:18:04.173707+0000","last_undegraded":"2024-02-17T12:18:04.173707+0000","last_fullsized":"2024-02-17T12:18:04.173707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:40:08.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173892+0000","last_change":"2024-02-17T12:18:02.808303+0000","last_active":"2024-02-17T12:18:04.173892+0000","last_peered":"2024-02-17T12:18:04.173892+0000","last_clean":"2024-02-17T12:18:04.173892+0000","last_became_active":"2024-02-17T12:18:02.807743+0000","last_became_peered":"2024-02-17T12:18:02.807743+0000","last_unstale":"2024-02-17T12:18:04.173892+0000","last_undegraded":"2024-02-17T12:18:04.173892+0000","last_fullsized":"2024-02-17T12:18:04.173892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:55.025562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802606+0000","last_change":"2024-02-17T12:18:01.802694+0000","last_active":"2024-02-17T12:18:03.802606+0000","last_peered":"2024-02-17T12:18:03.802606+0000","last_clean":"2024-02-17T12:18:03.802606+0000","last_became_active":"2024-02-17T12:18:01.802326+0000","last_became_peered":"2024-02-17T12:18:01.802326+0000","last_unstale":"2024-02-17T12:18:03.802606+0000","last_undegraded":"2024-02-17T12:18:03.802606+0000","last_fullsized":"2024-02-17T12:18:03.802606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:33:51.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173053+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:18:04.173053+0000","last_peered":"2024-02-17T12:18:04.173053+0000","last_clean":"2024-02-17T12:18:04.173053+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:18:04.173053+0000","last_undegraded":"2024-02-17T12:18:04.173053+0000","last_fullsized":"2024-02-17T12:18:04.173053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1702,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":14,"acting":14,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":222990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.755}]},{"osd":2,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.69499999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.82299999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.73699999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":540672,"data_stored":222990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.90800000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.82599999999999996}]},{"osd":3,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.65400000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":222990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40600000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.67800000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":222990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.1779999999999999,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.436},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.6399999999999997,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.2779999999999996,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.66000000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":813358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.495}]},{"osd":4,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.88},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.69099999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.78900000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.84599999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.68100000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":832377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.58399999999999996}]},{"osd":2,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.77800000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.754}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.83599999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":243461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.755},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72299999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":585728,"data_stored":241905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.439},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48399999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:18:06.869 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:18:07.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cdbc00640 1 Processor -- start 2024-02-17T12:18:07.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cdbc00640 1 -- start start 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cdbc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8cd4152510 0x7f8cd40c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cdbc00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8cd40c0640 0x7f8cd415f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cdbc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd406e890 con 0x7f8cd406ef60 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cdbc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd40c2670 con 0x7f8cd4152510 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cdbc00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd4158370 con 0x7f8cd40c0640 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cd9200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8cd4152510 0x7f8cd40c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cd3e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8cd406ef60 0x7f8cd4158800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33002/0 (socket says 172.21.15.114:33002) 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cd3e00640 1 -- 172.21.15.114:0/3791095175 learned_addr learned my addr 172.21.15.114:0/3791095175 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cd9c00640 1 --2- 172.21.15.114:0/3791095175 >> v2:172.21.15.116:3300/0 conn(0x7f8cd40c0640 0x7f8cd415f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cd9200640 1 -- 172.21.15.114:0/3791095175 >> v2:172.21.15.116:3300/0 conn(0x7f8cd40c0640 msgr2=0x7f8cd415f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:07.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cd9200640 1 --2- 172.21.15.114:0/3791095175 >> v2:172.21.15.116:3300/0 conn(0x7f8cd40c0640 0x7f8cd415f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cd9200640 1 -- 172.21.15.114:0/3791095175 >> v1:172.21.15.114:6789/0 conn(0x7f8cd406ef60 legacy=0x7f8cd4158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.037+0000 7f8cd9200640 1 -- 172.21.15.114:0/3791095175 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd406e5b0 con 0x7f8cd4152510 2024-02-17T12:18:07.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cd9200640 1 --2- 172.21.15.114:0/3791095175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd4152510 0x7f8cd40c65a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4070b20 tx=0x7f8cc401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b993e136d1010a72 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:07.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cd3400640 1 -- 172.21.15.114:0/3791095175 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40a5930 con 0x7f8cd4152510 2024-02-17T12:18:07.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cd3400640 1 -- 172.21.15.114:0/3791095175 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40a5a90 con 0x7f8cd4152510 2024-02-17T12:18:07.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cd3400640 1 -- 172.21.15.114:0/3791095175 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40a5e20 con 0x7f8cd4152510 2024-02-17T12:18:07.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cdbc00640 1 -- 172.21.15.114:0/3791095175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd4152510 msgr2=0x7f8cd40c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cdbc00640 1 --2- 172.21.15.114:0/3791095175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd4152510 0x7f8cd40c65a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4070b20 tx=0x7f8cc401c870 comp rx=0 tx=0).stop 2024-02-17T12:18:07.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cdbc00640 1 -- 172.21.15.114:0/3791095175 shutdown_connections 2024-02-17T12:18:07.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cdbc00640 1 --2- 172.21.15.114:0/3791095175 >> v2:172.21.15.116:3300/0 conn(0x7f8cd40c0640 0x7f8cd415f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cdbc00640 1 --2- 172.21.15.114:0/3791095175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd4152510 0x7f8cd40c65a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cdbc00640 1 -- 172.21.15.114:0/3791095175 >> 172.21.15.114:0/3791095175 conn(0x7f8cd40a8490 msgr2=0x7f8cd40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:07.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cdbc00640 1 -- 172.21.15.114:0/3791095175 shutdown_connections 2024-02-17T12:18:07.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.041+0000 7f8cdbc00640 1 -- 172.21.15.114:0/3791095175 wait complete. 2024-02-17T12:18:07.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cdbc00640 1 Processor -- start 2024-02-17T12:18:07.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cdbc00640 1 -- start start 2024-02-17T12:18:07.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cdbc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8cd406ef60 0x7f8cd414c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cdbc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd40c0640 0x7f8cd41ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cdbc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cd4152510 0x7f8cd41f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cdbc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd414cf10 con 0x7f8cd40c0640 2024-02-17T12:18:07.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cdbc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd40c6140 con 0x7f8cd4152510 2024-02-17T12:18:07.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cdbc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd414e3f0 con 0x7f8cd406ef60 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd40c0640 0x7f8cd41ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd40c0640 0x7f8cd41ed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41680/0 (socket says 172.21.15.114:41680) 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd3e00640 1 -- 172.21.15.114:0/333911349 learned_addr learned my addr 172.21.15.114:0/333911349 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd9200640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8cd406ef60 0x7f8cd414c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd9c00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cd4152510 0x7f8cd41f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd3e00640 1 -- 172.21.15.114:0/333911349 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8cd406ef60 msgr2=0x7f8cd414c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd3e00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8cd406ef60 0x7f8cd414c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd3e00640 1 -- 172.21.15.114:0/333911349 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cd4152510 msgr2=0x7f8cd41f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd3e00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cd4152510 0x7f8cd41f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd3e00640 1 -- 172.21.15.114:0/333911349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc4009a70 con 0x7f8cd40c0640 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd9200640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8cd406ef60 0x7f8cd414c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:07.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd3e00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd40c0640 0x7f8cd41ed7c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00c370 tx=0x7f8cbc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:07.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd0c00640 1 -- 172.21.15.114:0/333911349 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc005cf0 con 0x7f8cd40c0640 2024-02-17T12:18:07.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd0c00640 1 -- 172.21.15.114:0/333911349 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc005e50 con 0x7f8cd40c0640 2024-02-17T12:18:07.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cdbc00640 1 -- 172.21.15.114:0/333911349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd414e6d0 con 0x7f8cd40c0640 2024-02-17T12:18:07.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cd0c00640 1 -- 172.21.15.114:0/333911349 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc0072f0 con 0x7f8cd40c0640 2024-02-17T12:18:07.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.045+0000 7f8cdbc00640 1 -- 172.21.15.114:0/333911349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd41f0d30 con 0x7f8cd40c0640 2024-02-17T12:18:07.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.049+0000 7f8cdbc00640 1 -- 172.21.15.114:0/333911349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd4074840 con 0x7f8cd40c0640 2024-02-17T12:18:07.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.049+0000 7f8cd0c00640 1 -- 172.21.15.114:0/333911349 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8cbc007450 con 0x7f8cd40c0640 2024-02-17T12:18:07.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.049+0000 7f8cd0c00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8cb0066e40 0x7f8cb0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.049+0000 7f8cd0c00640 1 -- 172.21.15.114:0/333911349 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cbc083fc0 con 0x7f8cd40c0640 2024-02-17T12:18:07.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.049+0000 7f8cd9200640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8cb0066e40 0x7f8cb0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.049+0000 7f8cd9200640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8cb0066e40 0x7f8cb0069300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40af000 tx=0x7f8cc40a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:07.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.053+0000 7f8cd0c00640 1 -- 172.21.15.114:0/333911349 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8cbc050da0 con 0x7f8cd40c0640 2024-02-17T12:18:07.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.205+0000 7f8cdbc00640 1 -- 172.21.15.114:0/333911349 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cd40c0420 con 0x7f8cb0066e40 2024-02-17T12:18:07.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.213+0000 7f8cd0c00640 1 -- 172.21.15.114:0/333911349 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279349 (secure 0 0 0) 0x7f8cd40c0420 con 0x7f8cb0066e40 2024-02-17T12:18:07.218 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:07.220 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:18:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 -- 172.21.15.114:0/333911349 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8cb0066e40 msgr2=0x7f8cb0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8cb0066e40 0x7f8cb0069300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40af000 tx=0x7f8cc40a7070 comp rx=0 tx=0).stop 2024-02-17T12:18:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 -- 172.21.15.114:0/333911349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd40c0640 msgr2=0x7f8cd41ed7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd40c0640 0x7f8cd41ed7c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00c370 tx=0x7f8cbc00c830 comp rx=0 tx=0).stop 2024-02-17T12:18:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 -- 172.21.15.114:0/333911349 shutdown_connections 2024-02-17T12:18:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cd4152510 0x7f8cd41f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8cb0066e40 0x7f8cb0069300 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd40c0640 0x7f8cd41ed7c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 --2- 172.21.15.114:0/333911349 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8cd406ef60 0x7f8cd414c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 -- 172.21.15.114:0/333911349 >> 172.21.15.114:0/333911349 conn(0x7f8cd40a8490 msgr2=0x7f8cd40c0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:07.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 -- 172.21.15.114:0/333911349 shutdown_connections 2024-02-17T12:18:07.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.217+0000 7f8cdbc00640 1 -- 172.21.15.114:0/333911349 wait complete. 2024-02-17T12:18:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-02-17T12:18:05.237412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592070,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":225880,"kb_used_data":5520,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748840,"statfs":{"total":773094113280,"available":772862812160,"internally_reserved":0,"allocated":5652480,"data_stored":3023061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1702,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.465923"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867789+0000","last_change":"2024-02-17T12:18:02.804326+0000","last_active":"2024-02-17T12:18:03.867789+0000","last_peered":"2024-02-17T12:18:03.867789+0000","last_clean":"2024-02-17T12:18:03.867789+0000","last_became_active":"2024-02-17T12:18:02.804074+0000","last_became_peered":"2024-02-17T12:18:02.804074+0000","last_unstale":"2024-02-17T12:18:03.867789+0000","last_undegraded":"2024-02-17T12:18:03.867789+0000","last_fullsized":"2024-02-17T12:18:03.867789+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:47.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173302+0000","last_change":"2024-02-17T12:18:02.807196+0000","last_active":"2024-02-17T12:18:04.173302+0000","last_peered":"2024-02-17T12:18:04.173302+0000","last_clean":"2024-02-17T12:18:04.173302+0000","last_became_active":"2024-02-17T12:18:02.806894+0000","last_became_peered":"2024-02-17T12:18:02.806894+0000","last_unstale":"2024-02-17T12:18:04.173302+0000","last_undegraded":"2024-02-17T12:18:04.173302+0000","last_fullsized":"2024-02-17T12:18:04.173302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:12.749708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867694+0000","last_change":"2024-02-17T12:18:02.802996+0000","last_active":"2024-02-17T12:18:03.867694+0000","last_peered":"2024-02-17T12:18:03.867694+0000","last_clean":"2024-02-17T12:18:03.867694+0000","last_became_active":"2024-02-17T12:18:02.802690+0000","last_became_peered":"2024-02-17T12:18:02.802690+0000","last_unstale":"2024-02-17T12:18:03.867694+0000","last_undegraded":"2024-02-17T12:18:03.867694+0000","last_fullsized":"2024-02-17T12:18:03.867694+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:59.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802402+0000","last_change":"2024-02-17T12:18:02.799654+0000","last_active":"2024-02-17T12:18:03.802402+0000","last_peered":"2024-02-17T12:18:03.802402+0000","last_clean":"2024-02-17T12:18:03.802402+0000","last_became_active":"2024-02-17T12:18:02.799356+0000","last_became_peered":"2024-02-17T12:18:02.799356+0000","last_unstale":"2024-02-17T12:18:03.802402+0000","last_undegraded":"2024-02-17T12:18:03.802402+0000","last_fullsized":"2024-02-17T12:18:03.802402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:29.710017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802908+0000","last_change":"2024-02-17T12:18:02.794591+0000","last_active":"2024-02-17T12:18:03.802908+0000","last_peered":"2024-02-17T12:18:03.802908+0000","last_clean":"2024-02-17T12:18:03.802908+0000","last_became_active":"2024-02-17T12:18:02.794309+0000","last_became_peered":"2024-02-17T12:18:02.794309+0000","last_unstale":"2024-02-17T12:18:03.802908+0000","last_undegraded":"2024-02-17T12:18:03.802908+0000","last_fullsized":"2024-02-17T12:18:03.802908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:18.132994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802492+0000","last_change":"2024-02-17T12:18:02.798437+0000","last_active":"2024-02-17T12:18:03.802492+0000","last_peered":"2024-02-17T12:18:03.802492+0000","last_clean":"2024-02-17T12:18:03.802492+0000","last_became_active":"2024-02-17T12:18:02.798145+0000","last_became_peered":"2024-02-17T12:18:02.798145+0000","last_unstale":"2024-02-17T12:18:03.802492+0000","last_undegraded":"2024-02-17T12:18:03.802492+0000","last_fullsized":"2024-02-17T12:18:03.802492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:29.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802419+0000","last_change":"2024-02-17T12:18:02.797013+0000","last_active":"2024-02-17T12:18:03.802419+0000","last_peered":"2024-02-17T12:18:03.802419+0000","last_clean":"2024-02-17T12:18:03.802419+0000","last_became_active":"2024-02-17T12:18:02.796734+0000","last_became_peered":"2024-02-17T12:18:02.796734+0000","last_unstale":"2024-02-17T12:18:03.802419+0000","last_undegraded":"2024-02-17T12:18:03.802419+0000","last_fullsized":"2024-02-17T12:18:03.802419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:32.566741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173764+0000","last_change":"2024-02-17T12:18:02.809074+0000","last_active":"2024-02-17T12:18:04.173764+0000","last_peered":"2024-02-17T12:18:04.173764+0000","last_clean":"2024-02-17T12:18:04.173764+0000","last_became_active":"2024-02-17T12:18:02.808683+0000","last_became_peered":"2024-02-17T12:18:02.808683+0000","last_unstale":"2024-02-17T12:18:04.173764+0000","last_undegraded":"2024-02-17T12:18:04.173764+0000","last_fullsized":"2024-02-17T12:18:04.173764+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:46:21.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867919+0000","last_change":"2024-02-17T12:18:02.803587+0000","last_active":"2024-02-17T12:18:03.867919+0000","last_peered":"2024-02-17T12:18:03.867919+0000","last_clean":"2024-02-17T12:18:03.867919+0000","last_became_active":"2024-02-17T12:18:02.803312+0000","last_became_peered":"2024-02-17T12:18:02.803312+0000","last_unstale":"2024-02-17T12:18:03.867919+0000","last_undegraded":"2024-02-17T12:18:03.867919+0000","last_fullsized":"2024-02-17T12:18:03.867919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:54:01.696616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173161+0000","last_change":"2024-02-17T12:18:02.809894+0000","last_active":"2024-02-17T12:18:04.173161+0000","last_peered":"2024-02-17T12:18:04.173161+0000","last_clean":"2024-02-17T12:18:04.173161+0000","last_became_active":"2024-02-17T12:18:02.807451+0000","last_became_peered":"2024-02-17T12:18:02.807451+0000","last_unstale":"2024-02-17T12:18:04.173161+0000","last_undegraded":"2024-02-17T12:18:04.173161+0000","last_fullsized":"2024-02-17T12:18:04.173161+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:05:50.249065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173537+0000","last_change":"2024-02-17T12:18:02.807916+0000","last_active":"2024-02-17T12:18:04.173537+0000","last_peered":"2024-02-17T12:18:04.173537+0000","last_clean":"2024-02-17T12:18:04.173537+0000","last_became_active":"2024-02-17T12:18:02.806754+0000","last_became_peered":"2024-02-17T12:18:02.806754+0000","last_unstale":"2024-02-17T12:18:04.173537+0000","last_undegraded":"2024-02-17T12:18:04.173537+0000","last_fullsized":"2024-02-17T12:18:04.173537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.985986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867898+0000","last_change":"2024-02-17T12:18:02.798267+0000","last_active":"2024-02-17T12:18:03.867898+0000","last_peered":"2024-02-17T12:18:03.867898+0000","last_clean":"2024-02-17T12:18:03.867898+0000","last_became_active":"2024-02-17T12:18:02.797624+0000","last_became_peered":"2024-02-17T12:18:02.797624+0000","last_unstale":"2024-02-17T12:18:03.867898+0000","last_undegraded":"2024-02-17T12:18:03.867898+0000","last_fullsized":"2024-02-17T12:18:03.867898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:17:06.691178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867831+0000","last_change":"2024-02-17T12:18:02.804711+0000","last_active":"2024-02-17T12:18:03.867831+0000","last_peered":"2024-02-17T12:18:03.867831+0000","last_clean":"2024-02-17T12:18:03.867831+0000","last_became_active":"2024-02-17T12:18:02.804459+0000","last_became_peered":"2024-02-17T12:18:02.804459+0000","last_unstale":"2024-02-17T12:18:03.867831+0000","last_undegraded":"2024-02-17T12:18:03.867831+0000","last_fullsized":"2024-02-17T12:18:03.867831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:47.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173099+0000","last_change":"2024-02-17T12:18:02.807169+0000","last_active":"2024-02-17T12:18:04.173099+0000","last_peered":"2024-02-17T12:18:04.173099+0000","last_clean":"2024-02-17T12:18:04.173099+0000","last_became_active":"2024-02-17T12:18:02.806918+0000","last_became_peered":"2024-02-17T12:18:02.806918+0000","last_unstale":"2024-02-17T12:18:04.173099+0000","last_undegraded":"2024-02-17T12:18:04.173099+0000","last_fullsized":"2024-02-17T12:18:04.173099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:17.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867681+0000","last_change":"2024-02-17T12:18:02.795014+0000","last_active":"2024-02-17T12:18:03.867681+0000","last_peered":"2024-02-17T12:18:03.867681+0000","last_clean":"2024-02-17T12:18:03.867681+0000","last_became_active":"2024-02-17T12:18:02.794759+0000","last_became_peered":"2024-02-17T12:18:02.794759+0000","last_unstale":"2024-02-17T12:18:03.867681+0000","last_undegraded":"2024-02-17T12:18:03.867681+0000","last_fullsized":"2024-02-17T12:18:03.867681+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:21.971723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802683+0000","last_change":"2024-02-17T12:18:01.798801+0000","last_active":"2024-02-17T12:18:03.802683+0000","last_peered":"2024-02-17T12:18:03.802683+0000","last_clean":"2024-02-17T12:18:03.802683+0000","last_became_active":"2024-02-17T12:18:01.798516+0000","last_became_peered":"2024-02-17T12:18:01.798516+0000","last_unstale":"2024-02-17T12:18:03.802683+0000","last_undegraded":"2024-02-17T12:18:03.802683+0000","last_fullsized":"2024-02-17T12:18:03.802683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:04:53.798642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802379+0000","last_change":"2024-02-17T12:18:01.800493+0000","last_active":"2024-02-17T12:18:03.802379+0000","last_peered":"2024-02-17T12:18:03.802379+0000","last_clean":"2024-02-17T12:18:03.802379+0000","last_became_active":"2024-02-17T12:18:01.800206+0000","last_became_peered":"2024-02-17T12:18:01.800206+0000","last_unstale":"2024-02-17T12:18:03.802379+0000","last_undegraded":"2024-02-17T12:18:03.802379+0000","last_fullsized":"2024-02-17T12:18:03.802379+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:33.603620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802978+0000","last_change":"2024-02-17T12:18:02.797952+0000","last_active":"2024-02-17T12:18:03.802978+0000","last_peered":"2024-02-17T12:18:03.802978+0000","last_clean":"2024-02-17T12:18:03.802978+0000","last_became_active":"2024-02-17T12:18:02.797675+0000","last_became_peered":"2024-02-17T12:18:02.797675+0000","last_unstale":"2024-02-17T12:18:03.802978+0000","last_undegraded":"2024-02-17T12:18:03.802978+0000","last_fullsized":"2024-02-17T12:18:03.802978+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:01.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173763+0000","last_change":"2024-02-17T12:18:01.801850+0000","last_active":"2024-02-17T12:18:04.173763+0000","last_peered":"2024-02-17T12:18:04.173763+0000","last_clean":"2024-02-17T12:18:04.173763+0000","last_became_active":"2024-02-17T12:18:01.801516+0000","last_became_peered":"2024-02-17T12:18:01.801516+0000","last_unstale":"2024-02-17T12:18:04.173763+0000","last_undegraded":"2024-02-17T12:18:04.173763+0000","last_fullsized":"2024-02-17T12:18:04.173763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:28.630666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173640+0000","last_change":"2024-02-17T12:18:02.813957+0000","last_active":"2024-02-17T12:18:04.173640+0000","last_peered":"2024-02-17T12:18:04.173640+0000","last_clean":"2024-02-17T12:18:04.173640+0000","last_became_active":"2024-02-17T12:18:02.813647+0000","last_became_peered":"2024-02-17T12:18:02.813647+0000","last_unstale":"2024-02-17T12:18:04.173640+0000","last_undegraded":"2024-02-17T12:18:04.173640+0000","last_fullsized":"2024-02-17T12:18:04.173640+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:41.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173815+0000","last_change":"2024-02-17T12:18:01.805403+0000","last_active":"2024-02-17T12:18:04.173815+0000","last_peered":"2024-02-17T12:18:04.173815+0000","last_clean":"2024-02-17T12:18:04.173815+0000","last_became_active":"2024-02-17T12:18:01.805059+0000","last_became_peered":"2024-02-17T12:18:01.805059+0000","last_unstale":"2024-02-17T12:18:04.173815+0000","last_undegraded":"2024-02-17T12:18:04.173815+0000","last_fullsized":"2024-02-17T12:18:04.173815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:14.495937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173478+0000","last_change":"2024-02-17T12:18:02.810198+0000","last_active":"2024-02-17T12:18:04.173478+0000","last_peered":"2024-02-17T12:18:04.173478+0000","last_clean":"2024-02-17T12:18:04.173478+0000","last_became_active":"2024-02-17T12:18:02.809131+0000","last_became_peered":"2024-02-17T12:18:02.809131+0000","last_unstale":"2024-02-17T12:18:04.173478+0000","last_undegraded":"2024-02-17T12:18:04.173478+0000","last_fullsized":"2024-02-17T12:18:04.173478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:01:23.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802836+0000","last_change":"2024-02-17T12:18:01.802710+0000","last_active":"2024-02-17T12:18:03.802836+0000","last_peered":"2024-02-17T12:18:03.802836+0000","last_clean":"2024-02-17T12:18:03.802836+0000","last_became_active":"2024-02-17T12:18:01.802365+0000","last_became_peered":"2024-02-17T12:18:01.802365+0000","last_unstale":"2024-02-17T12:18:03.802836+0000","last_undegraded":"2024-02-17T12:18:03.802836+0000","last_fullsized":"2024-02-17T12:18:03.802836+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:45.771679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173374+0000","last_change":"2024-02-17T12:18:02.808057+0000","last_active":"2024-02-17T12:18:04.173374+0000","last_peered":"2024-02-17T12:18:04.173374+0000","last_clean":"2024-02-17T12:18:04.173374+0000","last_became_active":"2024-02-17T12:18:02.807629+0000","last_became_peered":"2024-02-17T12:18:02.807629+0000","last_unstale":"2024-02-17T12:18:04.173374+0000","last_undegraded":"2024-02-17T12:18:04.173374+0000","last_fullsized":"2024-02-17T12:18:04.173374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:58:48.506743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802474+0000","last_change":"2024-02-17T12:18:02.810137+0000","last_active":"2024-02-17T12:18:03.802474+0000","last_peered":"2024-02-17T12:18:03.802474+0000","last_clean":"2024-02-17T12:18:03.802474+0000","last_became_active":"2024-02-17T12:18:02.809877+0000","last_became_peered":"2024-02-17T12:18:02.809877+0000","last_unstale":"2024-02-17T12:18:03.802474+0000","last_undegraded":"2024-02-17T12:18:03.802474+0000","last_fullsized":"2024-02-17T12:18:03.802474+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:15.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173954+0000","last_change":"2024-02-17T12:18:02.808594+0000","last_active":"2024-02-17T12:18:04.173954+0000","last_peered":"2024-02-17T12:18:04.173954+0000","last_clean":"2024-02-17T12:18:04.173954+0000","last_became_active":"2024-02-17T12:18:02.808035+0000","last_became_peered":"2024-02-17T12:18:02.808035+0000","last_unstale":"2024-02-17T12:18:04.173954+0000","last_undegraded":"2024-02-17T12:18:04.173954+0000","last_fullsized":"2024-02-17T12:18:04.173954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:58.050395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173264+0000","last_change":"2024-02-17T12:18:01.789017+0000","last_active":"2024-02-17T12:18:04.173264+0000","last_peered":"2024-02-17T12:18:04.173264+0000","last_clean":"2024-02-17T12:18:04.173264+0000","last_became_active":"2024-02-17T12:18:01.788529+0000","last_became_peered":"2024-02-17T12:18:01.788529+0000","last_unstale":"2024-02-17T12:18:04.173264+0000","last_undegraded":"2024-02-17T12:18:04.173264+0000","last_fullsized":"2024-02-17T12:18:04.173264+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:31.560281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.174014+0000","last_change":"2024-02-17T12:18:02.808518+0000","last_active":"2024-02-17T12:18:04.174014+0000","last_peered":"2024-02-17T12:18:04.174014+0000","last_clean":"2024-02-17T12:18:04.174014+0000","last_became_active":"2024-02-17T12:18:02.808255+0000","last_became_peered":"2024-02-17T12:18:02.808255+0000","last_unstale":"2024-02-17T12:18:04.174014+0000","last_undegraded":"2024-02-17T12:18:04.174014+0000","last_fullsized":"2024-02-17T12:18:04.174014+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:58:40.908163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173707+0000","last_change":"2024-02-17T12:18:02.811327+0000","last_active":"2024-02-17T12:18:04.173707+0000","last_peered":"2024-02-17T12:18:04.173707+0000","last_clean":"2024-02-17T12:18:04.173707+0000","last_became_active":"2024-02-17T12:18:02.809620+0000","last_became_peered":"2024-02-17T12:18:02.809620+0000","last_unstale":"2024-02-17T12:18:04.173707+0000","last_undegraded":"2024-02-17T12:18:04.173707+0000","last_fullsized":"2024-02-17T12:18:04.173707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:40:08.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173892+0000","last_change":"2024-02-17T12:18:02.808303+0000","last_active":"2024-02-17T12:18:04.173892+0000","last_peered":"2024-02-17T12:18:04.173892+0000","last_clean":"2024-02-17T12:18:04.173892+0000","last_became_active":"2024-02-17T12:18:02.807743+0000","last_became_peered":"2024-02-17T12:18:02.807743+0000","last_unstale":"2024-02-17T12:18:04.173892+0000","last_undegraded":"2024-02-17T12:18:04.173892+0000","last_fullsized":"2024-02-17T12:18:04.173892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:55.025562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802606+0000","last_change":"2024-02-17T12:18:01.802694+0000","last_active":"2024-02-17T12:18:03.802606+0000","last_peered":"2024-02-17T12:18:03.802606+0000","last_clean":"2024-02-17T12:18:03.802606+0000","last_became_active":"2024-02-17T12:18:01.802326+0000","last_became_peered":"2024-02-17T12:18:01.802326+0000","last_unstale":"2024-02-17T12:18:03.802606+0000","last_undegraded":"2024-02-17T12:18:03.802606+0000","last_fullsized":"2024-02-17T12:18:03.802606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:33:51.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:01.769487+0000","last_change":"2024-02-17T12:18:01.769487+0000","last_active":"2024-02-17T12:18:01.769487+0000","last_peered":"2024-02-17T12:18:01.769487+0000","last_clean":"2024-02-17T12:18:01.769487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:01.769487+0000","last_undegraded":"2024-02-17T12:18:01.769487+0000","last_fullsized":"2024-02-17T12:18:01.769487+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:00.763027+0000","last_change":"2024-02-17T12:18:00.763027+0000","last_active":"2024-02-17T12:18:00.763027+0000","last_peered":"2024-02-17T12:18:00.763027+0000","last_clean":"2024-02-17T12:18:00.763027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:00.763027+0000","last_undegraded":"2024-02-17T12:18:00.763027+0000","last_fullsized":"2024-02-17T12:18:00.763027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173053+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:18:04.173053+0000","last_peered":"2024-02-17T12:18:04.173053+0000","last_clean":"2024-02-17T12:18:04.173053+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:18:04.173053+0000","last_undegraded":"2024-02-17T12:18:04.173053+0000","last_fullsized":"2024-02-17T12:18:04.173053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1702,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":14,"acting":14,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":222990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.755}]},{"osd":2,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.69499999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.82299999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.73699999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":540672,"data_stored":222990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.90800000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.79300000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.82599999999999996}]},{"osd":3,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.65400000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":222990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40600000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.67800000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":222990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.1779999999999999,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.436},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.6399999999999997,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.2779999999999996,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.73199999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":0.71799999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.66000000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1134592,"data_stored":813358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.38600000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.495}]},{"osd":4,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.88},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.69099999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.78900000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.84599999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.68100000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":832377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.58399999999999996}]},{"osd":2,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.77800000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.754}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.83599999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":243461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.755},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72299999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":585728,"data_stored":241905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.439},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48399999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:18:07.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:18:07.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.409+0000 7f4142a00640 1 Processor -- start 2024-02-17T12:18:07.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.409+0000 7f4142a00640 1 -- start start 2024-02-17T12:18:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f4142a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f413c0ab5d0 0x7f413c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f4142a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413c0aa150 con 0x7f413c06ef50 2024-02-17T12:18:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f4142a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413c0c1e90 con 0x7f413c14e9b0 2024-02-17T12:18:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f4142a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413c14ed90 con 0x7f413c0ab5d0 2024-02-17T12:18:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f4140a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f413c0ab5d0 0x7f413c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f4140a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f413c0ab5d0 0x7f413c1519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41694/0 (socket says 172.21.15.114:41694) 2024-02-17T12:18:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f4140a00640 1 -- 172.21.15.114:0/76243735 learned_addr learned my addr 172.21.15.114:0/76243735 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:07.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f413b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f413c06ef50 0x7f413c06dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33004/0 (socket says 172.21.15.114:33004) 2024-02-17T12:18:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f4140a00640 1 -- 172.21.15.114:0/76243735 >> v1:172.21.15.116:6789/0 conn(0x7f413c14e9b0 legacy=0x7f413c1512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f4140a00640 1 -- 172.21.15.114:0/76243735 >> v1:172.21.15.114:6789/0 conn(0x7f413c06ef50 legacy=0x7f413c06dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f4140a00640 1 -- 172.21.15.114:0/76243735 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c152000 con 0x7f413c0ab5d0 2024-02-17T12:18:07.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.413+0000 7f413aa00640 1 -- 172.21.15.114:0/76243735 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818328279 0 0) 0x7f413c0aa150 con 0x7f413c06ef50 2024-02-17T12:18:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4140a00640 1 --2- 172.21.15.114:0/76243735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c0ab5d0 0x7f413c1519b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4134009870 tx=0x7f413401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3580d61864d07c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f413aa00640 1 -- 172.21.15.114:0/76243735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41340a9640 con 0x7f413c0ab5d0 2024-02-17T12:18:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f413aa00640 1 -- 172.21.15.114:0/76243735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41340a97a0 con 0x7f413c0ab5d0 2024-02-17T12:18:07.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f413aa00640 1 -- 172.21.15.114:0/76243735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41340a9b30 con 0x7f413c0ab5d0 2024-02-17T12:18:07.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 -- 172.21.15.114:0/76243735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c0ab5d0 msgr2=0x7f413c1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 --2- 172.21.15.114:0/76243735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c0ab5d0 0x7f413c1519b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4134009870 tx=0x7f413401c560 comp rx=0 tx=0).stop 2024-02-17T12:18:07.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 -- 172.21.15.114:0/76243735 shutdown_connections 2024-02-17T12:18:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 --2- 172.21.15.114:0/76243735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c0ab5d0 0x7f413c1519b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 -- 172.21.15.114:0/76243735 >> 172.21.15.114:0/76243735 conn(0x7f413c0a8490 msgr2=0x7f413c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 -- 172.21.15.114:0/76243735 shutdown_connections 2024-02-17T12:18:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 -- 172.21.15.114:0/76243735 wait complete. 2024-02-17T12:18:07.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 Processor -- start 2024-02-17T12:18:07.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 -- start start 2024-02-17T12:18:07.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c06ef50 0x7f413c14a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f413c0ab5d0 0x7f413c147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f413c14e9b0 0x7f413c147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.417+0000 7f4142a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c154020 con 0x7f413c06ef50 2024-02-17T12:18:07.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4142a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c154570 con 0x7f413c14e9b0 2024-02-17T12:18:07.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4142a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413c154850 con 0x7f413c0ab5d0 2024-02-17T12:18:07.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f413be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c06ef50 0x7f413c14a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f413be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c06ef50 0x7f413c14a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41700/0 (socket says 172.21.15.114:41700) 2024-02-17T12:18:07.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f413be00640 1 -- 172.21.15.114:0/846053823 learned_addr learned my addr 172.21.15.114:0/846053823 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4140a00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f413c14e9b0 0x7f413c147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f413b400640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f413c0ab5d0 0x7f413c147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f413be00640 1 -- 172.21.15.114:0/846053823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f413c0ab5d0 msgr2=0x7f413c147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f413be00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f413c0ab5d0 0x7f413c147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f413be00640 1 -- 172.21.15.114:0/846053823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f413c14e9b0 msgr2=0x7f413c147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f413be00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f413c14e9b0 0x7f413c147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f413be00640 1 -- 172.21.15.114:0/846053823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340094d0 con 0x7f413c06ef50 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f413be00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c06ef50 0x7f413c14a140 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f412c00c7a0 tx=0x7f412c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4133e00640 1 -- 172.21.15.114:0/846053823 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c003b80 con 0x7f413c06ef50 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4133e00640 1 -- 172.21.15.114:0/846053823 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c003ce0 con 0x7f413c06ef50 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4142a00640 1 -- 172.21.15.114:0/846053823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413c154b30 con 0x7f413c06ef50 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4133e00640 1 -- 172.21.15.114:0/846053823 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c00aa90 con 0x7f413c06ef50 2024-02-17T12:18:07.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4142a00640 1 -- 172.21.15.114:0/846053823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413c1550f0 con 0x7f413c06ef50 2024-02-17T12:18:07.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4142a00640 1 -- 172.21.15.114:0/846053823 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413c074840 con 0x7f413c06ef50 2024-02-17T12:18:07.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4133e00640 1 -- 172.21.15.114:0/846053823 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f412c00abf0 con 0x7f413c06ef50 2024-02-17T12:18:07.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.421+0000 7f4133e00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4118066e40 0x7f4118069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.425+0000 7f4133e00640 1 -- 172.21.15.114:0/846053823 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f412c0848d0 con 0x7f413c06ef50 2024-02-17T12:18:07.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.425+0000 7f413b400640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4118066e40 0x7f4118069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.425+0000 7f413b400640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4118066e40 0x7f4118069300 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4124007fd0 tx=0x7f4124007ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:07.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.429+0000 7f4133e00640 1 -- 172.21.15.114:0/846053823 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f412c0516b0 con 0x7f413c06ef50 2024-02-17T12:18:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.577+0000 7f4142a00640 1 -- 172.21.15.114:0/846053823 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f413c0c0d70 con 0x7f4118066e40 2024-02-17T12:18:07.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.585+0000 7f4133e00640 1 -- 172.21.15.114:0/846053823 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289103 (secure 0 0 0) 0x7f413c0c0d70 con 0x7f4118066e40 2024-02-17T12:18:07.594 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:07.596 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:18:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 -- 172.21.15.114:0/846053823 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4118066e40 msgr2=0x7f4118069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4118066e40 0x7f4118069300 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4124007fd0 tx=0x7f4124007ba0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 -- 172.21.15.114:0/846053823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c06ef50 msgr2=0x7f413c14a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c06ef50 0x7f413c14a140 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f412c00c7a0 tx=0x7f412c00cc60 comp rx=0 tx=0).stop 2024-02-17T12:18:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 -- 172.21.15.114:0/846053823 shutdown_connections 2024-02-17T12:18:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f413c14e9b0 0x7f413c147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f413c0ab5d0 0x7f413c147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4118066e40 0x7f4118069300 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 --2- 172.21.15.114:0/846053823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f413c06ef50 0x7f413c14a140 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 -- 172.21.15.114:0/846053823 >> 172.21.15.114:0/846053823 conn(0x7f413c0a8490 msgr2=0x7f413c14db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:07.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 -- 172.21.15.114:0/846053823 shutdown_connections 2024-02-17T12:18:07.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.589+0000 7f4142a00640 1 -- 172.21.15.114:0/846053823 wait complete. 2024-02-17T12:18:07.612 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-02-17T12:18:07.237922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230312,"kb_used_data":5796,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744408,"statfs":{"total":773094113280,"available":772858273792,"internally_reserved":0,"allocated":5935104,"data_stored":3151848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001406"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867789+0000","last_change":"2024-02-17T12:18:02.804326+0000","last_active":"2024-02-17T12:18:03.867789+0000","last_peered":"2024-02-17T12:18:03.867789+0000","last_clean":"2024-02-17T12:18:03.867789+0000","last_became_active":"2024-02-17T12:18:02.804074+0000","last_became_peered":"2024-02-17T12:18:02.804074+0000","last_unstale":"2024-02-17T12:18:03.867789+0000","last_undegraded":"2024-02-17T12:18:03.867789+0000","last_fullsized":"2024-02-17T12:18:03.867789+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:47.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173023+0000","last_change":"2024-02-17T12:18:02.808706+0000","last_active":"2024-02-17T12:18:04.173023+0000","last_peered":"2024-02-17T12:18:04.173023+0000","last_clean":"2024-02-17T12:18:04.173023+0000","last_became_active":"2024-02-17T12:18:02.808520+0000","last_became_peered":"2024-02-17T12:18:02.808520+0000","last_unstale":"2024-02-17T12:18:04.173023+0000","last_undegraded":"2024-02-17T12:18:04.173023+0000","last_fullsized":"2024-02-17T12:18:04.173023+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:27.642044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173302+0000","last_change":"2024-02-17T12:18:02.807196+0000","last_active":"2024-02-17T12:18:04.173302+0000","last_peered":"2024-02-17T12:18:04.173302+0000","last_clean":"2024-02-17T12:18:04.173302+0000","last_became_active":"2024-02-17T12:18:02.806894+0000","last_became_peered":"2024-02-17T12:18:02.806894+0000","last_unstale":"2024-02-17T12:18:04.173302+0000","last_undegraded":"2024-02-17T12:18:04.173302+0000","last_fullsized":"2024-02-17T12:18:04.173302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:12.749708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801692+0000","last_change":"2024-02-17T12:18:02.814770+0000","last_active":"2024-02-17T12:18:03.801692+0000","last_peered":"2024-02-17T12:18:03.801692+0000","last_clean":"2024-02-17T12:18:03.801692+0000","last_became_active":"2024-02-17T12:18:02.809466+0000","last_became_peered":"2024-02-17T12:18:02.809466+0000","last_unstale":"2024-02-17T12:18:03.801692+0000","last_undegraded":"2024-02-17T12:18:03.801692+0000","last_fullsized":"2024-02-17T12:18:03.801692+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867694+0000","last_change":"2024-02-17T12:18:02.802996+0000","last_active":"2024-02-17T12:18:03.867694+0000","last_peered":"2024-02-17T12:18:03.867694+0000","last_clean":"2024-02-17T12:18:03.867694+0000","last_became_active":"2024-02-17T12:18:02.802690+0000","last_became_peered":"2024-02-17T12:18:02.802690+0000","last_unstale":"2024-02-17T12:18:03.867694+0000","last_undegraded":"2024-02-17T12:18:03.867694+0000","last_fullsized":"2024-02-17T12:18:03.867694+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:59.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802123+0000","last_change":"2024-02-17T12:18:02.812986+0000","last_active":"2024-02-17T12:18:03.802123+0000","last_peered":"2024-02-17T12:18:03.802123+0000","last_clean":"2024-02-17T12:18:03.802123+0000","last_became_active":"2024-02-17T12:18:02.809576+0000","last_became_peered":"2024-02-17T12:18:02.809576+0000","last_unstale":"2024-02-17T12:18:03.802123+0000","last_undegraded":"2024-02-17T12:18:03.802123+0000","last_fullsized":"2024-02-17T12:18:03.802123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802402+0000","last_change":"2024-02-17T12:18:02.799654+0000","last_active":"2024-02-17T12:18:03.802402+0000","last_peered":"2024-02-17T12:18:03.802402+0000","last_clean":"2024-02-17T12:18:03.802402+0000","last_became_active":"2024-02-17T12:18:02.799356+0000","last_became_peered":"2024-02-17T12:18:02.799356+0000","last_unstale":"2024-02-17T12:18:03.802402+0000","last_undegraded":"2024-02-17T12:18:03.802402+0000","last_fullsized":"2024-02-17T12:18:03.802402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:29.710017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172274+0000","last_change":"2024-02-17T12:18:02.800189+0000","last_active":"2024-02-17T12:18:04.172274+0000","last_peered":"2024-02-17T12:18:04.172274+0000","last_clean":"2024-02-17T12:18:04.172274+0000","last_became_active":"2024-02-17T12:18:02.799866+0000","last_became_peered":"2024-02-17T12:18:02.799866+0000","last_unstale":"2024-02-17T12:18:04.172274+0000","last_undegraded":"2024-02-17T12:18:04.172274+0000","last_fullsized":"2024-02-17T12:18:04.172274+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:52.152034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802908+0000","last_change":"2024-02-17T12:18:02.794591+0000","last_active":"2024-02-17T12:18:03.802908+0000","last_peered":"2024-02-17T12:18:03.802908+0000","last_clean":"2024-02-17T12:18:03.802908+0000","last_became_active":"2024-02-17T12:18:02.794309+0000","last_became_peered":"2024-02-17T12:18:02.794309+0000","last_unstale":"2024-02-17T12:18:03.802908+0000","last_undegraded":"2024-02-17T12:18:03.802908+0000","last_fullsized":"2024-02-17T12:18:03.802908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:18.132994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172280+0000","last_change":"2024-02-17T12:18:02.802586+0000","last_active":"2024-02-17T12:18:04.172280+0000","last_peered":"2024-02-17T12:18:04.172280+0000","last_clean":"2024-02-17T12:18:04.172280+0000","last_became_active":"2024-02-17T12:18:02.802328+0000","last_became_peered":"2024-02-17T12:18:02.802328+0000","last_unstale":"2024-02-17T12:18:04.172280+0000","last_undegraded":"2024-02-17T12:18:04.172280+0000","last_fullsized":"2024-02-17T12:18:04.172280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:30.894335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172283+0000","last_change":"2024-02-17T12:18:02.803729+0000","last_active":"2024-02-17T12:18:04.172283+0000","last_peered":"2024-02-17T12:18:04.172283+0000","last_clean":"2024-02-17T12:18:04.172283+0000","last_became_active":"2024-02-17T12:18:02.803504+0000","last_became_peered":"2024-02-17T12:18:02.803504+0000","last_unstale":"2024-02-17T12:18:04.172283+0000","last_undegraded":"2024-02-17T12:18:04.172283+0000","last_fullsized":"2024-02-17T12:18:04.172283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:50.631061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801865+0000","last_change":"2024-02-17T12:18:02.814562+0000","last_active":"2024-02-17T12:18:03.801865+0000","last_peered":"2024-02-17T12:18:03.801865+0000","last_clean":"2024-02-17T12:18:03.801865+0000","last_became_active":"2024-02-17T12:18:02.809011+0000","last_became_peered":"2024-02-17T12:18:02.809011+0000","last_unstale":"2024-02-17T12:18:03.801865+0000","last_undegraded":"2024-02-17T12:18:03.801865+0000","last_fullsized":"2024-02-17T12:18:03.801865+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173551+0000","last_change":"2024-02-17T12:18:02.800228+0000","last_active":"2024-02-17T12:18:04.173551+0000","last_peered":"2024-02-17T12:18:04.173551+0000","last_clean":"2024-02-17T12:18:04.173551+0000","last_became_active":"2024-02-17T12:18:02.799965+0000","last_became_peered":"2024-02-17T12:18:02.799965+0000","last_unstale":"2024-02-17T12:18:04.173551+0000","last_undegraded":"2024-02-17T12:18:04.173551+0000","last_fullsized":"2024-02-17T12:18:04.173551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:05.435817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802492+0000","last_change":"2024-02-17T12:18:02.798437+0000","last_active":"2024-02-17T12:18:03.802492+0000","last_peered":"2024-02-17T12:18:03.802492+0000","last_clean":"2024-02-17T12:18:03.802492+0000","last_became_active":"2024-02-17T12:18:02.798145+0000","last_became_peered":"2024-02-17T12:18:02.798145+0000","last_unstale":"2024-02-17T12:18:03.802492+0000","last_undegraded":"2024-02-17T12:18:03.802492+0000","last_fullsized":"2024-02-17T12:18:03.802492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:29.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802419+0000","last_change":"2024-02-17T12:18:02.797013+0000","last_active":"2024-02-17T12:18:03.802419+0000","last_peered":"2024-02-17T12:18:03.802419+0000","last_clean":"2024-02-17T12:18:03.802419+0000","last_became_active":"2024-02-17T12:18:02.796734+0000","last_became_peered":"2024-02-17T12:18:02.796734+0000","last_unstale":"2024-02-17T12:18:03.802419+0000","last_undegraded":"2024-02-17T12:18:03.802419+0000","last_fullsized":"2024-02-17T12:18:03.802419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:32.566741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802025+0000","last_change":"2024-02-17T12:18:02.809976+0000","last_active":"2024-02-17T12:18:03.802025+0000","last_peered":"2024-02-17T12:18:03.802025+0000","last_clean":"2024-02-17T12:18:03.802025+0000","last_became_active":"2024-02-17T12:18:02.809645+0000","last_became_peered":"2024-02-17T12:18:02.809645+0000","last_unstale":"2024-02-17T12:18:03.802025+0000","last_undegraded":"2024-02-17T12:18:03.802025+0000","last_fullsized":"2024-02-17T12:18:03.802025+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172807+0000","last_change":"2024-02-17T12:18:02.807700+0000","last_active":"2024-02-17T12:18:04.172807+0000","last_peered":"2024-02-17T12:18:04.172807+0000","last_clean":"2024-02-17T12:18:04.172807+0000","last_became_active":"2024-02-17T12:18:02.805575+0000","last_became_peered":"2024-02-17T12:18:02.805575+0000","last_unstale":"2024-02-17T12:18:04.172807+0000","last_undegraded":"2024-02-17T12:18:04.172807+0000","last_fullsized":"2024-02-17T12:18:04.172807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:52:33.882315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173764+0000","last_change":"2024-02-17T12:18:02.809074+0000","last_active":"2024-02-17T12:18:04.173764+0000","last_peered":"2024-02-17T12:18:04.173764+0000","last_clean":"2024-02-17T12:18:04.173764+0000","last_became_active":"2024-02-17T12:18:02.808683+0000","last_became_peered":"2024-02-17T12:18:02.808683+0000","last_unstale":"2024-02-17T12:18:04.173764+0000","last_undegraded":"2024-02-17T12:18:04.173764+0000","last_fullsized":"2024-02-17T12:18:04.173764+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:46:21.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867919+0000","last_change":"2024-02-17T12:18:02.803587+0000","last_active":"2024-02-17T12:18:03.867919+0000","last_peered":"2024-02-17T12:18:03.867919+0000","last_clean":"2024-02-17T12:18:03.867919+0000","last_became_active":"2024-02-17T12:18:02.803312+0000","last_became_peered":"2024-02-17T12:18:02.803312+0000","last_unstale":"2024-02-17T12:18:03.867919+0000","last_undegraded":"2024-02-17T12:18:03.867919+0000","last_fullsized":"2024-02-17T12:18:03.867919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:54:01.696616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172628+0000","last_change":"2024-02-17T12:18:02.815782+0000","last_active":"2024-02-17T12:18:04.172628+0000","last_peered":"2024-02-17T12:18:04.172628+0000","last_clean":"2024-02-17T12:18:04.172628+0000","last_became_active":"2024-02-17T12:18:02.815537+0000","last_became_peered":"2024-02-17T12:18:02.815537+0000","last_unstale":"2024-02-17T12:18:04.172628+0000","last_undegraded":"2024-02-17T12:18:04.172628+0000","last_fullsized":"2024-02-17T12:18:04.172628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:23.114440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173161+0000","last_change":"2024-02-17T12:18:02.809894+0000","last_active":"2024-02-17T12:18:04.173161+0000","last_peered":"2024-02-17T12:18:04.173161+0000","last_clean":"2024-02-17T12:18:04.173161+0000","last_became_active":"2024-02-17T12:18:02.807451+0000","last_became_peered":"2024-02-17T12:18:02.807451+0000","last_unstale":"2024-02-17T12:18:04.173161+0000","last_undegraded":"2024-02-17T12:18:04.173161+0000","last_fullsized":"2024-02-17T12:18:04.173161+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:05:50.249065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172966+0000","last_change":"2024-02-17T12:18:02.813079+0000","last_active":"2024-02-17T12:18:04.172966+0000","last_peered":"2024-02-17T12:18:04.172966+0000","last_clean":"2024-02-17T12:18:04.172966+0000","last_became_active":"2024-02-17T12:18:02.810630+0000","last_became_peered":"2024-02-17T12:18:02.810630+0000","last_unstale":"2024-02-17T12:18:04.172966+0000","last_undegraded":"2024-02-17T12:18:04.172966+0000","last_fullsized":"2024-02-17T12:18:04.172966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:32:22.683974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173537+0000","last_change":"2024-02-17T12:18:02.807916+0000","last_active":"2024-02-17T12:18:04.173537+0000","last_peered":"2024-02-17T12:18:04.173537+0000","last_clean":"2024-02-17T12:18:04.173537+0000","last_became_active":"2024-02-17T12:18:02.806754+0000","last_became_peered":"2024-02-17T12:18:02.806754+0000","last_unstale":"2024-02-17T12:18:04.173537+0000","last_undegraded":"2024-02-17T12:18:04.173537+0000","last_fullsized":"2024-02-17T12:18:04.173537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.985986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173008+0000","last_change":"2024-02-17T12:18:02.805691+0000","last_active":"2024-02-17T12:18:04.173008+0000","last_peered":"2024-02-17T12:18:04.173008+0000","last_clean":"2024-02-17T12:18:04.173008+0000","last_became_active":"2024-02-17T12:18:02.805396+0000","last_became_peered":"2024-02-17T12:18:02.805396+0000","last_unstale":"2024-02-17T12:18:04.173008+0000","last_undegraded":"2024-02-17T12:18:04.173008+0000","last_fullsized":"2024-02-17T12:18:04.173008+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:09:34.480729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867898+0000","last_change":"2024-02-17T12:18:02.798267+0000","last_active":"2024-02-17T12:18:03.867898+0000","last_peered":"2024-02-17T12:18:03.867898+0000","last_clean":"2024-02-17T12:18:03.867898+0000","last_became_active":"2024-02-17T12:18:02.797624+0000","last_became_peered":"2024-02-17T12:18:02.797624+0000","last_unstale":"2024-02-17T12:18:03.867898+0000","last_undegraded":"2024-02-17T12:18:03.867898+0000","last_fullsized":"2024-02-17T12:18:03.867898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:17:06.691178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801849+0000","last_change":"2024-02-17T12:18:02.802532+0000","last_active":"2024-02-17T12:18:03.801849+0000","last_peered":"2024-02-17T12:18:03.801849+0000","last_clean":"2024-02-17T12:18:03.801849+0000","last_became_active":"2024-02-17T12:18:02.801766+0000","last_became_peered":"2024-02-17T12:18:02.801766+0000","last_unstale":"2024-02-17T12:18:03.801849+0000","last_undegraded":"2024-02-17T12:18:03.801849+0000","last_fullsized":"2024-02-17T12:18:03.801849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802488+0000","last_change":"2024-02-17T12:18:02.797999+0000","last_active":"2024-02-17T12:18:03.802488+0000","last_peered":"2024-02-17T12:18:03.802488+0000","last_clean":"2024-02-17T12:18:03.802488+0000","last_became_active":"2024-02-17T12:18:02.797710+0000","last_became_peered":"2024-02-17T12:18:02.797710+0000","last_unstale":"2024-02-17T12:18:03.802488+0000","last_undegraded":"2024-02-17T12:18:03.802488+0000","last_fullsized":"2024-02-17T12:18:03.802488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867831+0000","last_change":"2024-02-17T12:18:02.804711+0000","last_active":"2024-02-17T12:18:03.867831+0000","last_peered":"2024-02-17T12:18:03.867831+0000","last_clean":"2024-02-17T12:18:03.867831+0000","last_became_active":"2024-02-17T12:18:02.804459+0000","last_became_peered":"2024-02-17T12:18:02.804459+0000","last_unstale":"2024-02-17T12:18:03.867831+0000","last_undegraded":"2024-02-17T12:18:03.867831+0000","last_fullsized":"2024-02-17T12:18:03.867831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:47.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172754+0000","last_change":"2024-02-17T12:18:02.802524+0000","last_active":"2024-02-17T12:18:04.172754+0000","last_peered":"2024-02-17T12:18:04.172754+0000","last_clean":"2024-02-17T12:18:04.172754+0000","last_became_active":"2024-02-17T12:18:02.802045+0000","last_became_peered":"2024-02-17T12:18:02.802045+0000","last_unstale":"2024-02-17T12:18:04.172754+0000","last_undegraded":"2024-02-17T12:18:04.172754+0000","last_fullsized":"2024-02-17T12:18:04.172754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:06:03.414827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173099+0000","last_change":"2024-02-17T12:18:02.807169+0000","last_active":"2024-02-17T12:18:04.173099+0000","last_peered":"2024-02-17T12:18:04.173099+0000","last_clean":"2024-02-17T12:18:04.173099+0000","last_became_active":"2024-02-17T12:18:02.806918+0000","last_became_peered":"2024-02-17T12:18:02.806918+0000","last_unstale":"2024-02-17T12:18:04.173099+0000","last_undegraded":"2024-02-17T12:18:04.173099+0000","last_fullsized":"2024-02-17T12:18:04.173099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:17.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867681+0000","last_change":"2024-02-17T12:18:02.795014+0000","last_active":"2024-02-17T12:18:03.867681+0000","last_peered":"2024-02-17T12:18:03.867681+0000","last_clean":"2024-02-17T12:18:03.867681+0000","last_became_active":"2024-02-17T12:18:02.794759+0000","last_became_peered":"2024-02-17T12:18:02.794759+0000","last_unstale":"2024-02-17T12:18:03.867681+0000","last_undegraded":"2024-02-17T12:18:03.867681+0000","last_fullsized":"2024-02-17T12:18:03.867681+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:21.971723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802084+0000","last_change":"2024-02-17T12:18:02.801322+0000","last_active":"2024-02-17T12:18:03.802084+0000","last_peered":"2024-02-17T12:18:03.802084+0000","last_clean":"2024-02-17T12:18:03.802084+0000","last_became_active":"2024-02-17T12:18:02.801073+0000","last_became_peered":"2024-02-17T12:18:02.801073+0000","last_unstale":"2024-02-17T12:18:03.802084+0000","last_undegraded":"2024-02-17T12:18:03.802084+0000","last_fullsized":"2024-02-17T12:18:03.802084+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802729+0000","last_change":"2024-02-17T12:18:02.811882+0000","last_active":"2024-02-17T12:18:03.802729+0000","last_peered":"2024-02-17T12:18:03.802729+0000","last_clean":"2024-02-17T12:18:03.802729+0000","last_became_active":"2024-02-17T12:18:02.811448+0000","last_became_peered":"2024-02-17T12:18:02.811448+0000","last_unstale":"2024-02-17T12:18:03.802729+0000","last_undegraded":"2024-02-17T12:18:03.802729+0000","last_fullsized":"2024-02-17T12:18:03.802729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:46.432214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.803068+0000","last_change":"2024-02-17T12:18:01.796858+0000","last_active":"2024-02-17T12:18:03.803068+0000","last_peered":"2024-02-17T12:18:03.803068+0000","last_clean":"2024-02-17T12:18:03.803068+0000","last_became_active":"2024-02-17T12:18:01.796498+0000","last_became_peered":"2024-02-17T12:18:01.796498+0000","last_unstale":"2024-02-17T12:18:03.803068+0000","last_undegraded":"2024-02-17T12:18:03.803068+0000","last_fullsized":"2024-02-17T12:18:03.803068+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172457+0000","last_change":"2024-02-17T12:18:02.808663+0000","last_active":"2024-02-17T12:18:04.172457+0000","last_peered":"2024-02-17T12:18:04.172457+0000","last_clean":"2024-02-17T12:18:04.172457+0000","last_became_active":"2024-02-17T12:18:02.808402+0000","last_became_peered":"2024-02-17T12:18:02.808402+0000","last_unstale":"2024-02-17T12:18:04.172457+0000","last_undegraded":"2024-02-17T12:18:04.172457+0000","last_fullsized":"2024-02-17T12:18:04.172457+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:00.777830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172810+0000","last_change":"2024-02-17T12:18:01.790619+0000","last_active":"2024-02-17T12:18:04.172810+0000","last_peered":"2024-02-17T12:18:04.172810+0000","last_clean":"2024-02-17T12:18:04.172810+0000","last_became_active":"2024-02-17T12:18:01.790344+0000","last_became_peered":"2024-02-17T12:18:01.790344+0000","last_unstale":"2024-02-17T12:18:04.172810+0000","last_undegraded":"2024-02-17T12:18:04.172810+0000","last_fullsized":"2024-02-17T12:18:04.172810+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:45.425754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802701+0000","last_change":"2024-02-17T12:18:02.804685+0000","last_active":"2024-02-17T12:18:03.802701+0000","last_peered":"2024-02-17T12:18:03.802701+0000","last_clean":"2024-02-17T12:18:03.802701+0000","last_became_active":"2024-02-17T12:18:02.803980+0000","last_became_peered":"2024-02-17T12:18:02.803980+0000","last_unstale":"2024-02-17T12:18:03.802701+0000","last_undegraded":"2024-02-17T12:18:03.802701+0000","last_fullsized":"2024-02-17T12:18:03.802701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:32.327387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802681+0000","last_change":"2024-02-17T12:18:01.801344+0000","last_active":"2024-02-17T12:18:03.802681+0000","last_peered":"2024-02-17T12:18:03.802681+0000","last_clean":"2024-02-17T12:18:03.802681+0000","last_became_active":"2024-02-17T12:18:01.801092+0000","last_became_peered":"2024-02-17T12:18:01.801092+0000","last_unstale":"2024-02-17T12:18:03.802681+0000","last_undegraded":"2024-02-17T12:18:03.802681+0000","last_fullsized":"2024-02-17T12:18:03.802681+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802550+0000","last_change":"2024-02-17T12:18:02.806603+0000","last_active":"2024-02-17T12:18:03.802550+0000","last_peered":"2024-02-17T12:18:03.802550+0000","last_clean":"2024-02-17T12:18:03.802550+0000","last_became_active":"2024-02-17T12:18:02.806021+0000","last_became_peered":"2024-02-17T12:18:02.806021+0000","last_unstale":"2024-02-17T12:18:03.802550+0000","last_undegraded":"2024-02-17T12:18:03.802550+0000","last_fullsized":"2024-02-17T12:18:03.802550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:57.248220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801990+0000","last_change":"2024-02-17T12:18:01.790249+0000","last_active":"2024-02-17T12:18:03.801990+0000","last_peered":"2024-02-17T12:18:03.801990+0000","last_clean":"2024-02-17T12:18:03.801990+0000","last_became_active":"2024-02-17T12:18:01.789970+0000","last_became_peered":"2024-02-17T12:18:01.789970+0000","last_unstale":"2024-02-17T12:18:03.801990+0000","last_undegraded":"2024-02-17T12:18:03.801990+0000","last_fullsized":"2024-02-17T12:18:03.801990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173114+0000","last_change":"2024-02-17T12:18:02.811065+0000","last_active":"2024-02-17T12:18:04.173114+0000","last_peered":"2024-02-17T12:18:04.173114+0000","last_clean":"2024-02-17T12:18:04.173114+0000","last_became_active":"2024-02-17T12:18:02.810598+0000","last_became_peered":"2024-02-17T12:18:02.810598+0000","last_unstale":"2024-02-17T12:18:04.173114+0000","last_undegraded":"2024-02-17T12:18:04.173114+0000","last_fullsized":"2024-02-17T12:18:04.173114+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:11:46.553742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802683+0000","last_change":"2024-02-17T12:18:01.798801+0000","last_active":"2024-02-17T12:18:03.802683+0000","last_peered":"2024-02-17T12:18:03.802683+0000","last_clean":"2024-02-17T12:18:03.802683+0000","last_became_active":"2024-02-17T12:18:01.798516+0000","last_became_peered":"2024-02-17T12:18:01.798516+0000","last_unstale":"2024-02-17T12:18:03.802683+0000","last_undegraded":"2024-02-17T12:18:03.802683+0000","last_fullsized":"2024-02-17T12:18:03.802683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:04:53.798642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173209+0000","last_change":"2024-02-17T12:18:02.802301+0000","last_active":"2024-02-17T12:18:04.173209+0000","last_peered":"2024-02-17T12:18:04.173209+0000","last_clean":"2024-02-17T12:18:04.173209+0000","last_became_active":"2024-02-17T12:18:02.801632+0000","last_became_peered":"2024-02-17T12:18:02.801632+0000","last_unstale":"2024-02-17T12:18:04.173209+0000","last_undegraded":"2024-02-17T12:18:04.173209+0000","last_fullsized":"2024-02-17T12:18:04.173209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:34:13.159578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802099+0000","last_change":"2024-02-17T12:18:01.800510+0000","last_active":"2024-02-17T12:18:03.802099+0000","last_peered":"2024-02-17T12:18:03.802099+0000","last_clean":"2024-02-17T12:18:03.802099+0000","last_became_active":"2024-02-17T12:18:01.799483+0000","last_became_peered":"2024-02-17T12:18:01.799483+0000","last_unstale":"2024-02-17T12:18:03.802099+0000","last_undegraded":"2024-02-17T12:18:03.802099+0000","last_fullsized":"2024-02-17T12:18:03.802099+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173162+0000","last_change":"2024-02-17T12:18:02.811246+0000","last_active":"2024-02-17T12:18:04.173162+0000","last_peered":"2024-02-17T12:18:04.173162+0000","last_clean":"2024-02-17T12:18:04.173162+0000","last_became_active":"2024-02-17T12:18:02.810989+0000","last_became_peered":"2024-02-17T12:18:02.810989+0000","last_unstale":"2024-02-17T12:18:04.173162+0000","last_undegraded":"2024-02-17T12:18:04.173162+0000","last_fullsized":"2024-02-17T12:18:04.173162+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:56:31.198120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801161+0000","last_change":"2024-02-17T12:18:01.798316+0000","last_active":"2024-02-17T12:18:03.801161+0000","last_peered":"2024-02-17T12:18:03.801161+0000","last_clean":"2024-02-17T12:18:03.801161+0000","last_became_active":"2024-02-17T12:18:01.797041+0000","last_became_peered":"2024-02-17T12:18:01.797041+0000","last_unstale":"2024-02-17T12:18:03.801161+0000","last_undegraded":"2024-02-17T12:18:03.801161+0000","last_fullsized":"2024-02-17T12:18:03.801161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172480+0000","last_change":"2024-02-17T12:18:02.801971+0000","last_active":"2024-02-17T12:18:04.172480+0000","last_peered":"2024-02-17T12:18:04.172480+0000","last_clean":"2024-02-17T12:18:04.172480+0000","last_became_active":"2024-02-17T12:18:02.801727+0000","last_became_peered":"2024-02-17T12:18:02.801727+0000","last_unstale":"2024-02-17T12:18:04.172480+0000","last_undegraded":"2024-02-17T12:18:04.172480+0000","last_fullsized":"2024-02-17T12:18:04.172480+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:06:15.526935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802379+0000","last_change":"2024-02-17T12:18:01.800493+0000","last_active":"2024-02-17T12:18:03.802379+0000","last_peered":"2024-02-17T12:18:03.802379+0000","last_clean":"2024-02-17T12:18:03.802379+0000","last_became_active":"2024-02-17T12:18:01.800206+0000","last_became_peered":"2024-02-17T12:18:01.800206+0000","last_unstale":"2024-02-17T12:18:03.802379+0000","last_undegraded":"2024-02-17T12:18:03.802379+0000","last_fullsized":"2024-02-17T12:18:03.802379+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:33.603620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802978+0000","last_change":"2024-02-17T12:18:02.797952+0000","last_active":"2024-02-17T12:18:03.802978+0000","last_peered":"2024-02-17T12:18:03.802978+0000","last_clean":"2024-02-17T12:18:03.802978+0000","last_became_active":"2024-02-17T12:18:02.797675+0000","last_became_peered":"2024-02-17T12:18:02.797675+0000","last_unstale":"2024-02-17T12:18:03.802978+0000","last_undegraded":"2024-02-17T12:18:03.802978+0000","last_fullsized":"2024-02-17T12:18:03.802978+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:01.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173763+0000","last_change":"2024-02-17T12:18:01.801850+0000","last_active":"2024-02-17T12:18:04.173763+0000","last_peered":"2024-02-17T12:18:04.173763+0000","last_clean":"2024-02-17T12:18:04.173763+0000","last_became_active":"2024-02-17T12:18:01.801516+0000","last_became_peered":"2024-02-17T12:18:01.801516+0000","last_unstale":"2024-02-17T12:18:04.173763+0000","last_undegraded":"2024-02-17T12:18:04.173763+0000","last_fullsized":"2024-02-17T12:18:04.173763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:28.630666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173640+0000","last_change":"2024-02-17T12:18:02.813957+0000","last_active":"2024-02-17T12:18:04.173640+0000","last_peered":"2024-02-17T12:18:04.173640+0000","last_clean":"2024-02-17T12:18:04.173640+0000","last_became_active":"2024-02-17T12:18:02.813647+0000","last_became_peered":"2024-02-17T12:18:02.813647+0000","last_unstale":"2024-02-17T12:18:04.173640+0000","last_undegraded":"2024-02-17T12:18:04.173640+0000","last_fullsized":"2024-02-17T12:18:04.173640+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:41.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172902+0000","last_change":"2024-02-17T12:18:01.799508+0000","last_active":"2024-02-17T12:18:04.172902+0000","last_peered":"2024-02-17T12:18:04.172902+0000","last_clean":"2024-02-17T12:18:04.172902+0000","last_became_active":"2024-02-17T12:18:01.798598+0000","last_became_peered":"2024-02-17T12:18:01.798598+0000","last_unstale":"2024-02-17T12:18:04.172902+0000","last_undegraded":"2024-02-17T12:18:04.172902+0000","last_fullsized":"2024-02-17T12:18:04.172902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:45.103353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171977+0000","last_change":"2024-02-17T12:18:02.787850+0000","last_active":"2024-02-17T12:18:04.171977+0000","last_peered":"2024-02-17T12:18:04.171977+0000","last_clean":"2024-02-17T12:18:04.171977+0000","last_became_active":"2024-02-17T12:18:02.787578+0000","last_became_peered":"2024-02-17T12:18:02.787578+0000","last_unstale":"2024-02-17T12:18:04.171977+0000","last_undegraded":"2024-02-17T12:18:04.171977+0000","last_fullsized":"2024-02-17T12:18:04.171977+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:29.854264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173815+0000","last_change":"2024-02-17T12:18:01.805403+0000","last_active":"2024-02-17T12:18:04.173815+0000","last_peered":"2024-02-17T12:18:04.173815+0000","last_clean":"2024-02-17T12:18:04.173815+0000","last_became_active":"2024-02-17T12:18:01.805059+0000","last_became_peered":"2024-02-17T12:18:01.805059+0000","last_unstale":"2024-02-17T12:18:04.173815+0000","last_undegraded":"2024-02-17T12:18:04.173815+0000","last_fullsized":"2024-02-17T12:18:04.173815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:14.495937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173478+0000","last_change":"2024-02-17T12:18:02.810198+0000","last_active":"2024-02-17T12:18:04.173478+0000","last_peered":"2024-02-17T12:18:04.173478+0000","last_clean":"2024-02-17T12:18:04.173478+0000","last_became_active":"2024-02-17T12:18:02.809131+0000","last_became_peered":"2024-02-17T12:18:02.809131+0000","last_unstale":"2024-02-17T12:18:04.173478+0000","last_undegraded":"2024-02-17T12:18:04.173478+0000","last_fullsized":"2024-02-17T12:18:04.173478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:01:23.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802836+0000","last_change":"2024-02-17T12:18:01.802710+0000","last_active":"2024-02-17T12:18:03.802836+0000","last_peered":"2024-02-17T12:18:03.802836+0000","last_clean":"2024-02-17T12:18:03.802836+0000","last_became_active":"2024-02-17T12:18:01.802365+0000","last_became_peered":"2024-02-17T12:18:01.802365+0000","last_unstale":"2024-02-17T12:18:03.802836+0000","last_undegraded":"2024-02-17T12:18:03.802836+0000","last_fullsized":"2024-02-17T12:18:03.802836+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:45.771679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801283+0000","last_change":"2024-02-17T12:18:02.809855+0000","last_active":"2024-02-17T12:18:03.801283+0000","last_peered":"2024-02-17T12:18:03.801283+0000","last_clean":"2024-02-17T12:18:03.801283+0000","last_became_active":"2024-02-17T12:18:02.809577+0000","last_became_peered":"2024-02-17T12:18:02.809577+0000","last_unstale":"2024-02-17T12:18:03.801283+0000","last_undegraded":"2024-02-17T12:18:03.801283+0000","last_fullsized":"2024-02-17T12:18:03.801283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:17:49.657379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172597+0000","last_change":"2024-02-17T12:18:01.792615+0000","last_active":"2024-02-17T12:18:04.172597+0000","last_peered":"2024-02-17T12:18:04.172597+0000","last_clean":"2024-02-17T12:18:04.172597+0000","last_became_active":"2024-02-17T12:18:01.792287+0000","last_became_peered":"2024-02-17T12:18:01.792287+0000","last_unstale":"2024-02-17T12:18:04.172597+0000","last_undegraded":"2024-02-17T12:18:04.172597+0000","last_fullsized":"2024-02-17T12:18:04.172597+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:56.241760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173374+0000","last_change":"2024-02-17T12:18:02.808057+0000","last_active":"2024-02-17T12:18:04.173374+0000","last_peered":"2024-02-17T12:18:04.173374+0000","last_clean":"2024-02-17T12:18:04.173374+0000","last_became_active":"2024-02-17T12:18:02.807629+0000","last_became_peered":"2024-02-17T12:18:02.807629+0000","last_unstale":"2024-02-17T12:18:04.173374+0000","last_undegraded":"2024-02-17T12:18:04.173374+0000","last_fullsized":"2024-02-17T12:18:04.173374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:58:48.506743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173899+0000","last_change":"2024-02-17T12:18:01.797715+0000","last_active":"2024-02-17T12:18:04.173899+0000","last_peered":"2024-02-17T12:18:04.173899+0000","last_clean":"2024-02-17T12:18:04.173899+0000","last_became_active":"2024-02-17T12:18:01.797435+0000","last_became_peered":"2024-02-17T12:18:01.797435+0000","last_unstale":"2024-02-17T12:18:04.173899+0000","last_undegraded":"2024-02-17T12:18:04.173899+0000","last_fullsized":"2024-02-17T12:18:04.173899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:49.624601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802474+0000","last_change":"2024-02-17T12:18:02.810137+0000","last_active":"2024-02-17T12:18:03.802474+0000","last_peered":"2024-02-17T12:18:03.802474+0000","last_clean":"2024-02-17T12:18:03.802474+0000","last_became_active":"2024-02-17T12:18:02.809877+0000","last_became_peered":"2024-02-17T12:18:02.809877+0000","last_unstale":"2024-02-17T12:18:03.802474+0000","last_undegraded":"2024-02-17T12:18:03.802474+0000","last_fullsized":"2024-02-17T12:18:03.802474+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:15.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801165+0000","last_change":"2024-02-17T12:18:01.790794+0000","last_active":"2024-02-17T12:18:03.801165+0000","last_peered":"2024-02-17T12:18:03.801165+0000","last_clean":"2024-02-17T12:18:03.801165+0000","last_became_active":"2024-02-17T12:18:01.790500+0000","last_became_peered":"2024-02-17T12:18:01.790500+0000","last_unstale":"2024-02-17T12:18:03.801165+0000","last_undegraded":"2024-02-17T12:18:03.801165+0000","last_fullsized":"2024-02-17T12:18:03.801165+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173954+0000","last_change":"2024-02-17T12:18:02.808594+0000","last_active":"2024-02-17T12:18:04.173954+0000","last_peered":"2024-02-17T12:18:04.173954+0000","last_clean":"2024-02-17T12:18:04.173954+0000","last_became_active":"2024-02-17T12:18:02.808035+0000","last_became_peered":"2024-02-17T12:18:02.808035+0000","last_unstale":"2024-02-17T12:18:04.173954+0000","last_undegraded":"2024-02-17T12:18:04.173954+0000","last_fullsized":"2024-02-17T12:18:04.173954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:58.050395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173264+0000","last_change":"2024-02-17T12:18:01.789017+0000","last_active":"2024-02-17T12:18:04.173264+0000","last_peered":"2024-02-17T12:18:04.173264+0000","last_clean":"2024-02-17T12:18:04.173264+0000","last_became_active":"2024-02-17T12:18:01.788529+0000","last_became_peered":"2024-02-17T12:18:01.788529+0000","last_unstale":"2024-02-17T12:18:04.173264+0000","last_undegraded":"2024-02-17T12:18:04.173264+0000","last_fullsized":"2024-02-17T12:18:04.173264+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:31.560281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.174014+0000","last_change":"2024-02-17T12:18:02.808518+0000","last_active":"2024-02-17T12:18:04.174014+0000","last_peered":"2024-02-17T12:18:04.174014+0000","last_clean":"2024-02-17T12:18:04.174014+0000","last_became_active":"2024-02-17T12:18:02.808255+0000","last_became_peered":"2024-02-17T12:18:02.808255+0000","last_unstale":"2024-02-17T12:18:04.174014+0000","last_undegraded":"2024-02-17T12:18:04.174014+0000","last_fullsized":"2024-02-17T12:18:04.174014+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:58:40.908163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172893+0000","last_change":"2024-02-17T12:18:01.802794+0000","last_active":"2024-02-17T12:18:04.172893+0000","last_peered":"2024-02-17T12:18:04.172893+0000","last_clean":"2024-02-17T12:18:04.172893+0000","last_became_active":"2024-02-17T12:18:01.802366+0000","last_became_peered":"2024-02-17T12:18:01.802366+0000","last_unstale":"2024-02-17T12:18:04.172893+0000","last_undegraded":"2024-02-17T12:18:04.172893+0000","last_fullsized":"2024-02-17T12:18:04.172893+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:45:00.445775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801994+0000","last_change":"2024-02-17T12:18:02.810942+0000","last_active":"2024-02-17T12:18:03.801994+0000","last_peered":"2024-02-17T12:18:03.801994+0000","last_clean":"2024-02-17T12:18:03.801994+0000","last_became_active":"2024-02-17T12:18:02.810651+0000","last_became_peered":"2024-02-17T12:18:02.810651+0000","last_unstale":"2024-02-17T12:18:03.801994+0000","last_undegraded":"2024-02-17T12:18:03.801994+0000","last_fullsized":"2024-02-17T12:18:03.801994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802822+0000","last_change":"2024-02-17T12:18:01.797601+0000","last_active":"2024-02-17T12:18:03.802822+0000","last_peered":"2024-02-17T12:18:03.802822+0000","last_clean":"2024-02-17T12:18:03.802822+0000","last_became_active":"2024-02-17T12:18:01.796341+0000","last_became_peered":"2024-02-17T12:18:01.796341+0000","last_unstale":"2024-02-17T12:18:03.802822+0000","last_undegraded":"2024-02-17T12:18:03.802822+0000","last_fullsized":"2024-02-17T12:18:03.802822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172807+0000","last_change":"2024-02-17T12:18:02.803894+0000","last_active":"2024-02-17T12:18:04.172807+0000","last_peered":"2024-02-17T12:18:04.172807+0000","last_clean":"2024-02-17T12:18:04.172807+0000","last_became_active":"2024-02-17T12:18:02.803553+0000","last_became_peered":"2024-02-17T12:18:02.803553+0000","last_unstale":"2024-02-17T12:18:04.172807+0000","last_undegraded":"2024-02-17T12:18:04.172807+0000","last_fullsized":"2024-02-17T12:18:04.172807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:35:24.727572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801624+0000","last_change":"2024-02-17T12:18:01.789546+0000","last_active":"2024-02-17T12:18:03.801624+0000","last_peered":"2024-02-17T12:18:03.801624+0000","last_clean":"2024-02-17T12:18:03.801624+0000","last_became_active":"2024-02-17T12:18:01.789258+0000","last_became_peered":"2024-02-17T12:18:01.789258+0000","last_unstale":"2024-02-17T12:18:03.801624+0000","last_undegraded":"2024-02-17T12:18:03.801624+0000","last_fullsized":"2024-02-17T12:18:03.801624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173707+0000","last_change":"2024-02-17T12:18:02.811327+0000","last_active":"2024-02-17T12:18:04.173707+0000","last_peered":"2024-02-17T12:18:04.173707+0000","last_clean":"2024-02-17T12:18:04.173707+0000","last_became_active":"2024-02-17T12:18:02.809620+0000","last_became_peered":"2024-02-17T12:18:02.809620+0000","last_unstale":"2024-02-17T12:18:04.173707+0000","last_undegraded":"2024-02-17T12:18:04.173707+0000","last_fullsized":"2024-02-17T12:18:04.173707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:40:08.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802594+0000","last_change":"2024-02-17T12:18:01.798265+0000","last_active":"2024-02-17T12:18:03.802594+0000","last_peered":"2024-02-17T12:18:03.802594+0000","last_clean":"2024-02-17T12:18:03.802594+0000","last_became_active":"2024-02-17T12:18:01.797931+0000","last_became_peered":"2024-02-17T12:18:01.797931+0000","last_unstale":"2024-02-17T12:18:03.802594+0000","last_undegraded":"2024-02-17T12:18:03.802594+0000","last_fullsized":"2024-02-17T12:18:03.802594+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801311+0000","last_change":"2024-02-17T12:18:02.800381+0000","last_active":"2024-02-17T12:18:03.801311+0000","last_peered":"2024-02-17T12:18:03.801311+0000","last_clean":"2024-02-17T12:18:03.801311+0000","last_became_active":"2024-02-17T12:18:02.800042+0000","last_became_peered":"2024-02-17T12:18:02.800042+0000","last_unstale":"2024-02-17T12:18:03.801311+0000","last_undegraded":"2024-02-17T12:18:03.801311+0000","last_fullsized":"2024-02-17T12:18:03.801311+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:27.558546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172826+0000","last_change":"2024-02-17T12:18:01.795914+0000","last_active":"2024-02-17T12:18:04.172826+0000","last_peered":"2024-02-17T12:18:04.172826+0000","last_clean":"2024-02-17T12:18:04.172826+0000","last_became_active":"2024-02-17T12:18:01.794847+0000","last_became_peered":"2024-02-17T12:18:01.794847+0000","last_unstale":"2024-02-17T12:18:04.172826+0000","last_undegraded":"2024-02-17T12:18:04.172826+0000","last_fullsized":"2024-02-17T12:18:04.172826+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:31.320927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802473+0000","last_change":"2024-02-17T12:18:02.807547+0000","last_active":"2024-02-17T12:18:03.802473+0000","last_peered":"2024-02-17T12:18:03.802473+0000","last_clean":"2024-02-17T12:18:03.802473+0000","last_became_active":"2024-02-17T12:18:02.807209+0000","last_became_peered":"2024-02-17T12:18:02.807209+0000","last_unstale":"2024-02-17T12:18:03.802473+0000","last_undegraded":"2024-02-17T12:18:03.802473+0000","last_fullsized":"2024-02-17T12:18:03.802473+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171947+0000","last_change":"2024-02-17T12:18:01.803848+0000","last_active":"2024-02-17T12:18:04.171947+0000","last_peered":"2024-02-17T12:18:04.171947+0000","last_clean":"2024-02-17T12:18:04.171947+0000","last_became_active":"2024-02-17T12:18:01.803552+0000","last_became_peered":"2024-02-17T12:18:01.803552+0000","last_unstale":"2024-02-17T12:18:04.171947+0000","last_undegraded":"2024-02-17T12:18:04.171947+0000","last_fullsized":"2024-02-17T12:18:04.171947+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:25:02.826927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802107+0000","last_change":"2024-02-17T12:18:02.811800+0000","last_active":"2024-02-17T12:18:03.802107+0000","last_peered":"2024-02-17T12:18:03.802107+0000","last_clean":"2024-02-17T12:18:03.802107+0000","last_became_active":"2024-02-17T12:18:02.811504+0000","last_became_peered":"2024-02-17T12:18:02.811504+0000","last_unstale":"2024-02-17T12:18:03.802107+0000","last_undegraded":"2024-02-17T12:18:03.802107+0000","last_fullsized":"2024-02-17T12:18:03.802107+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801149+0000","last_change":"2024-02-17T12:18:01.800860+0000","last_active":"2024-02-17T12:18:03.801149+0000","last_peered":"2024-02-17T12:18:03.801149+0000","last_clean":"2024-02-17T12:18:03.801149+0000","last_became_active":"2024-02-17T12:18:01.800569+0000","last_became_peered":"2024-02-17T12:18:01.800569+0000","last_unstale":"2024-02-17T12:18:03.801149+0000","last_undegraded":"2024-02-17T12:18:03.801149+0000","last_fullsized":"2024-02-17T12:18:03.801149+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801841+0000","last_change":"2024-02-17T12:18:02.812763+0000","last_active":"2024-02-17T12:18:03.801841+0000","last_peered":"2024-02-17T12:18:03.801841+0000","last_clean":"2024-02-17T12:18:03.801841+0000","last_became_active":"2024-02-17T12:18:02.812512+0000","last_became_peered":"2024-02-17T12:18:02.812512+0000","last_unstale":"2024-02-17T12:18:03.801841+0000","last_undegraded":"2024-02-17T12:18:03.801841+0000","last_fullsized":"2024-02-17T12:18:03.801841+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172534+0000","last_change":"2024-02-17T12:18:01.805847+0000","last_active":"2024-02-17T12:18:04.172534+0000","last_peered":"2024-02-17T12:18:04.172534+0000","last_clean":"2024-02-17T12:18:04.172534+0000","last_became_active":"2024-02-17T12:18:01.805591+0000","last_became_peered":"2024-02-17T12:18:01.805591+0000","last_unstale":"2024-02-17T12:18:04.172534+0000","last_undegraded":"2024-02-17T12:18:04.172534+0000","last_fullsized":"2024-02-17T12:18:04.172534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:52:05.403651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801873+0000","last_change":"2024-02-17T12:18:02.809740+0000","last_active":"2024-02-17T12:18:03.801873+0000","last_peered":"2024-02-17T12:18:03.801873+0000","last_clean":"2024-02-17T12:18:03.801873+0000","last_became_active":"2024-02-17T12:18:02.809407+0000","last_became_peered":"2024-02-17T12:18:02.809407+0000","last_unstale":"2024-02-17T12:18:03.801873+0000","last_undegraded":"2024-02-17T12:18:03.801873+0000","last_fullsized":"2024-02-17T12:18:03.801873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.789123+0000","last_change":"2024-02-17T12:18:01.794714+0000","last_active":"2024-02-17T12:18:04.789123+0000","last_peered":"2024-02-17T12:18:04.789123+0000","last_clean":"2024-02-17T12:18:04.789123+0000","last_became_active":"2024-02-17T12:18:01.794439+0000","last_became_peered":"2024-02-17T12:18:01.794439+0000","last_unstale":"2024-02-17T12:18:04.789123+0000","last_undegraded":"2024-02-17T12:18:04.789123+0000","last_fullsized":"2024-02-17T12:18:04.789123+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172069+0000","last_change":"2024-02-17T12:18:02.794702+0000","last_active":"2024-02-17T12:18:04.172069+0000","last_peered":"2024-02-17T12:18:04.172069+0000","last_clean":"2024-02-17T12:18:04.172069+0000","last_became_active":"2024-02-17T12:18:02.794412+0000","last_became_peered":"2024-02-17T12:18:02.794412+0000","last_unstale":"2024-02-17T12:18:04.172069+0000","last_undegraded":"2024-02-17T12:18:04.172069+0000","last_fullsized":"2024-02-17T12:18:04.172069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:05:00.914700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173653+0000","last_change":"2024-02-17T12:18:01.800872+0000","last_active":"2024-02-17T12:18:04.173653+0000","last_peered":"2024-02-17T12:18:04.173653+0000","last_clean":"2024-02-17T12:18:04.173653+0000","last_became_active":"2024-02-17T12:18:01.800563+0000","last_became_peered":"2024-02-17T12:18:01.800563+0000","last_unstale":"2024-02-17T12:18:04.173653+0000","last_undegraded":"2024-02-17T12:18:04.173653+0000","last_fullsized":"2024-02-17T12:18:04.173653+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:28.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802821+0000","last_change":"2024-02-17T12:18:02.806343+0000","last_active":"2024-02-17T12:18:03.802821+0000","last_peered":"2024-02-17T12:18:03.802821+0000","last_clean":"2024-02-17T12:18:03.802821+0000","last_became_active":"2024-02-17T12:18:02.805514+0000","last_became_peered":"2024-02-17T12:18:02.805514+0000","last_unstale":"2024-02-17T12:18:03.802821+0000","last_undegraded":"2024-02-17T12:18:03.802821+0000","last_fullsized":"2024-02-17T12:18:03.802821+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:46.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801971+0000","last_change":"2024-02-17T12:18:01.801897+0000","last_active":"2024-02-17T12:18:03.801971+0000","last_peered":"2024-02-17T12:18:03.801971+0000","last_clean":"2024-02-17T12:18:03.801971+0000","last_became_active":"2024-02-17T12:18:01.801572+0000","last_became_peered":"2024-02-17T12:18:01.801572+0000","last_unstale":"2024-02-17T12:18:03.801971+0000","last_undegraded":"2024-02-17T12:18:03.801971+0000","last_fullsized":"2024-02-17T12:18:03.801971+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173181+0000","last_change":"2024-02-17T12:18:02.808806+0000","last_active":"2024-02-17T12:18:04.173181+0000","last_peered":"2024-02-17T12:18:04.173181+0000","last_clean":"2024-02-17T12:18:04.173181+0000","last_became_active":"2024-02-17T12:18:02.808546+0000","last_became_peered":"2024-02-17T12:18:02.808546+0000","last_unstale":"2024-02-17T12:18:04.173181+0000","last_undegraded":"2024-02-17T12:18:04.173181+0000","last_fullsized":"2024-02-17T12:18:04.173181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:25.157077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171862+0000","last_change":"2024-02-17T12:18:01.798282+0000","last_active":"2024-02-17T12:18:04.171862+0000","last_peered":"2024-02-17T12:18:04.171862+0000","last_clean":"2024-02-17T12:18:04.171862+0000","last_became_active":"2024-02-17T12:18:01.797970+0000","last_became_peered":"2024-02-17T12:18:01.797970+0000","last_unstale":"2024-02-17T12:18:04.171862+0000","last_undegraded":"2024-02-17T12:18:04.171862+0000","last_fullsized":"2024-02-17T12:18:04.171862+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:52:16.655449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173892+0000","last_change":"2024-02-17T12:18:02.808303+0000","last_active":"2024-02-17T12:18:04.173892+0000","last_peered":"2024-02-17T12:18:04.173892+0000","last_clean":"2024-02-17T12:18:04.173892+0000","last_became_active":"2024-02-17T12:18:02.807743+0000","last_became_peered":"2024-02-17T12:18:02.807743+0000","last_unstale":"2024-02-17T12:18:04.173892+0000","last_undegraded":"2024-02-17T12:18:04.173892+0000","last_fullsized":"2024-02-17T12:18:04.173892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:55.025562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802606+0000","last_change":"2024-02-17T12:18:01.802694+0000","last_active":"2024-02-17T12:18:03.802606+0000","last_peered":"2024-02-17T12:18:03.802606+0000","last_clean":"2024-02-17T12:18:03.802606+0000","last_became_active":"2024-02-17T12:18:01.802326+0000","last_became_peered":"2024-02-17T12:18:01.802326+0000","last_unstale":"2024-02-17T12:18:03.802606+0000","last_undegraded":"2024-02-17T12:18:03.802606+0000","last_fullsized":"2024-02-17T12:18:03.802606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:33:51.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171727+0000","last_change":"2024-02-17T12:18:02.805983+0000","last_active":"2024-02-17T12:18:04.171727+0000","last_peered":"2024-02-17T12:18:04.171727+0000","last_clean":"2024-02-17T12:18:04.171727+0000","last_became_active":"2024-02-17T12:18:02.805699+0000","last_became_peered":"2024-02-17T12:18:02.805699+0000","last_unstale":"2024-02-17T12:18:04.171727+0000","last_undegraded":"2024-02-17T12:18:04.171727+0000","last_fullsized":"2024-02-17T12:18:04.171727+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:44.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171810+0000","last_change":"2024-02-17T12:18:01.801438+0000","last_active":"2024-02-17T12:18:04.171810+0000","last_peered":"2024-02-17T12:18:04.171810+0000","last_clean":"2024-02-17T12:18:04.171810+0000","last_became_active":"2024-02-17T12:18:01.801221+0000","last_became_peered":"2024-02-17T12:18:01.801221+0000","last_unstale":"2024-02-17T12:18:04.171810+0000","last_undegraded":"2024-02-17T12:18:04.171810+0000","last_fullsized":"2024-02-17T12:18:04.171810+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:09.649370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172593+0000","last_change":"2024-02-17T12:18:02.806745+0000","last_active":"2024-02-17T12:18:04.172593+0000","last_peered":"2024-02-17T12:18:04.172593+0000","last_clean":"2024-02-17T12:18:04.172593+0000","last_became_active":"2024-02-17T12:18:02.806429+0000","last_became_peered":"2024-02-17T12:18:02.806429+0000","last_unstale":"2024-02-17T12:18:04.172593+0000","last_undegraded":"2024-02-17T12:18:04.172593+0000","last_fullsized":"2024-02-17T12:18:04.172593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:58.938533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172457+0000","last_change":"2024-02-17T12:18:01.793256+0000","last_active":"2024-02-17T12:18:04.172457+0000","last_peered":"2024-02-17T12:18:04.172457+0000","last_clean":"2024-02-17T12:18:04.172457+0000","last_became_active":"2024-02-17T12:18:01.793033+0000","last_became_peered":"2024-02-17T12:18:01.793033+0000","last_unstale":"2024-02-17T12:18:04.172457+0000","last_undegraded":"2024-02-17T12:18:04.172457+0000","last_fullsized":"2024-02-17T12:18:04.172457+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:46.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172434+0000","last_change":"2024-02-17T12:18:02.800813+0000","last_active":"2024-02-17T12:18:04.172434+0000","last_peered":"2024-02-17T12:18:04.172434+0000","last_clean":"2024-02-17T12:18:04.172434+0000","last_became_active":"2024-02-17T12:18:02.800551+0000","last_became_peered":"2024-02-17T12:18:02.800551+0000","last_unstale":"2024-02-17T12:18:04.172434+0000","last_undegraded":"2024-02-17T12:18:04.172434+0000","last_fullsized":"2024-02-17T12:18:04.172434+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:47:58.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173630+0000","last_change":"2024-02-17T12:18:01.796062+0000","last_active":"2024-02-17T12:18:04.173630+0000","last_peered":"2024-02-17T12:18:04.173630+0000","last_clean":"2024-02-17T12:18:04.173630+0000","last_became_active":"2024-02-17T12:18:01.795616+0000","last_became_peered":"2024-02-17T12:18:01.795616+0000","last_unstale":"2024-02-17T12:18:04.173630+0000","last_undegraded":"2024-02-17T12:18:04.173630+0000","last_fullsized":"2024-02-17T12:18:04.173630+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:04:59.908240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173053+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:18:04.173053+0000","last_peered":"2024-02-17T12:18:04.173053+0000","last_clean":"2024-02-17T12:18:04.173053+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:18:04.173053+0000","last_undegraded":"2024-02-17T12:18:04.173053+0000","last_fullsized":"2024-02-17T12:18:04.173053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":248149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.502}]},{"osd":1,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.63200000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78700000000000003}]},{"osd":4,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58599999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.91000000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.89100000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":248801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.67100000000000004}]},{"osd":1,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.624}]},{"osd":2,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.73299999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.503},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.65200000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":248205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.499}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.44900000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.745}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.88600000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":248239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.1779999999999999,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.34000000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.6399999999999997,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.46899999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.2779999999999996,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":0.63700000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.624}]}]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1200128,"data_stored":840711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54200000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.75800000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.83699999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85999999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":832377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.58399999999999996}]},{"osd":2,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.77800000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.754}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.83599999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":243461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.755},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72299999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":585728,"data_stored":241905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.439},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48399999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:18:07.617 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-17T12:18:07.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0998a00640 1 Processor -- start 2024-02-17T12:18:07.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0998a00640 1 -- start start 2024-02-17T12:18:07.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0998a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09940abe70 0x7f09941566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0998a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f099406e840 0x7f0994156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0998a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0994157170 con 0x7f09940c2b80 2024-02-17T12:18:07.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0998a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09940c1d80 con 0x7f09940abe70 2024-02-17T12:18:07.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0998a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09940c0f50 con 0x7f099406e840 2024-02-17T12:18:07.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0991e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09940abe70 0x7f09941566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0992800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f09940c2b80 0x7f09940c2fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33016/0 (socket says 172.21.15.114:33016) 2024-02-17T12:18:07.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0992800640 1 -- 172.21.15.114:0/2764361844 learned_addr learned my addr 172.21.15.114:0/2764361844 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:07.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0991400640 1 --2- 172.21.15.114:0/2764361844 >> v2:172.21.15.116:3300/0 conn(0x7f099406e840 0x7f0994156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0991e00640 1 -- 172.21.15.114:0/2764361844 >> v2:172.21.15.116:3300/0 conn(0x7f099406e840 msgr2=0x7f0994156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0991e00640 1 --2- 172.21.15.114:0/2764361844 >> v2:172.21.15.116:3300/0 conn(0x7f099406e840 0x7f0994156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0991e00640 1 -- 172.21.15.114:0/2764361844 >> v1:172.21.15.114:6789/0 conn(0x7f09940c2b80 legacy=0x7f09940c2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0991e00640 1 -- 172.21.15.114:0/2764361844 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09941561f0 con 0x7f09940abe70 2024-02-17T12:18:07.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.785+0000 7f0991400640 1 --2- 172.21.15.114:0/2764361844 >> v2:172.21.15.116:3300/0 conn(0x7f099406e840 0x7f0994156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:07.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0991e00640 1 --2- 172.21.15.114:0/2764361844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940abe70 0x7f09941566f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0994073260 tx=0x7f098401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608a346aa0c7518e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:07.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0990a00640 1 -- 172.21.15.114:0/2764361844 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09840ab650 con 0x7f09940abe70 2024-02-17T12:18:07.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0990a00640 1 -- 172.21.15.114:0/2764361844 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09840ab7b0 con 0x7f09940abe70 2024-02-17T12:18:07.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0990a00640 1 -- 172.21.15.114:0/2764361844 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09840abb40 con 0x7f09940abe70 2024-02-17T12:18:07.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0998a00640 1 -- 172.21.15.114:0/2764361844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940abe70 msgr2=0x7f09941566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0998a00640 1 --2- 172.21.15.114:0/2764361844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940abe70 0x7f09941566f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0994073260 tx=0x7f098401c450 comp rx=0 tx=0).stop 2024-02-17T12:18:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0998a00640 1 -- 172.21.15.114:0/2764361844 shutdown_connections 2024-02-17T12:18:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0998a00640 1 --2- 172.21.15.114:0/2764361844 >> v2:172.21.15.116:3300/0 conn(0x7f099406e840 0x7f0994156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0998a00640 1 --2- 172.21.15.114:0/2764361844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940abe70 0x7f09941566f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0998a00640 1 -- 172.21.15.114:0/2764361844 >> 172.21.15.114:0/2764361844 conn(0x7f09940c6550 msgr2=0x7f09940c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0998a00640 1 -- 172.21.15.114:0/2764361844 shutdown_connections 2024-02-17T12:18:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.789+0000 7f0998a00640 1 -- 172.21.15.114:0/2764361844 wait complete. 2024-02-17T12:18:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 Processor -- start 2024-02-17T12:18:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 -- start start 2024-02-17T12:18:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099406e840 0x7f09940a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09940abe70 0x7f09941ee710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c2b80 0x7f09940a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940bba80 con 0x7f09940c2b80 2024-02-17T12:18:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09941ef3f0 con 0x7f099406e840 2024-02-17T12:18:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09941ef110 con 0x7f09940abe70 2024-02-17T12:18:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0992800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c2b80 0x7f09940a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0992800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c2b80 0x7f09940a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41728/0 (socket says 172.21.15.114:41728) 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0992800640 1 -- 172.21.15.114:0/2621651634 learned_addr learned my addr 172.21.15.114:0/2621651634 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0991e00640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099406e840 0x7f09940a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0991400640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09940abe70 0x7f09941ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0992800640 1 -- 172.21.15.114:0/2621651634 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09940abe70 msgr2=0x7f09941ee710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0992800640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09940abe70 0x7f09941ee710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0992800640 1 -- 172.21.15.114:0/2621651634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099406e840 msgr2=0x7f09940a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0992800640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099406e840 0x7f09940a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0992800640 1 -- 172.21.15.114:0/2621651634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0984009420 con 0x7f09940c2b80 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0991400640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09940abe70 0x7f09941ee710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0992800640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c2b80 0x7f09940a99e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f098c00ca20 tx=0x7f098c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f098a000640 1 -- 172.21.15.114:0/2621651634 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00abd0 con 0x7f09940c2b80 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f098a000640 1 -- 172.21.15.114:0/2621651634 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c00ad30 con 0x7f09940c2b80 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f098a000640 1 -- 172.21.15.114:0/2621651634 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c012620 con 0x7f09940c2b80 2024-02-17T12:18:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 -- 172.21.15.114:0/2621651634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09940bb6a0 con 0x7f09940c2b80 2024-02-17T12:18:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 -- 172.21.15.114:0/2621651634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09941eee20 con 0x7f09940c2b80 2024-02-17T12:18:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.793+0000 7f0998a00640 1 -- 172.21.15.114:0/2621651634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0994074840 con 0x7f09940c2b80 2024-02-17T12:18:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.797+0000 7f098a000640 1 -- 172.21.15.114:0/2621651634 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f098c012780 con 0x7f09940c2b80 2024-02-17T12:18:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.797+0000 7f098a000640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0974066e70 0x7f0974069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.797+0000 7f098a000640 1 -- 172.21.15.114:0/2621651634 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f098c084880 con 0x7f09940c2b80 2024-02-17T12:18:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.797+0000 7f0991e00640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0974066e70 0x7f0974069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.797+0000 7f0991e00640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0974066e70 0x7f0974069330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f09840af000 tx=0x7f09840a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:07.801+0000 7f098a000640 1 -- 172.21.15.114:0/2621651634 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f098c051710 con 0x7f09940c2b80 2024-02-17T12:18:08.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.009+0000 7f0998a00640 1 -- 172.21.15.114:0/2621651634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f09940a6020 con 0x7f09940c2b80 2024-02-17T12:18:08.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.009+0000 7f098a000640 1 -- 172.21.15.114:0/2621651634 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1561 (secure 0 0 0) 0x7f098c017630 con 0x7f09940c2b80 2024-02-17T12:18:08.014 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:08.014 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":129,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1708172169,"num_in_osds":8,"osd_in_since":1708172160,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":235839488,"bytes_avail":772858273792,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":33,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5709}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-02-17T12:17:11.226618+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-17T12:18:08.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 -- 172.21.15.114:0/2621651634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0974066e70 msgr2=0x7f0974069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0974066e70 0x7f0974069330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f09840af000 tx=0x7f09840a7000 comp rx=0 tx=0).stop 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 -- 172.21.15.114:0/2621651634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c2b80 msgr2=0x7f09940a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c2b80 0x7f09940a99e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f098c00ca20 tx=0x7f098c00cee0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 -- 172.21.15.114:0/2621651634 shutdown_connections 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0974066e70 0x7f0974069330 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09940c2b80 0x7f09940a99e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f09940abe70 0x7f09941ee710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 --2- 172.21.15.114:0/2621651634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f099406e840 0x7f09940a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 -- 172.21.15.114:0/2621651634 >> 172.21.15.114:0/2621651634 conn(0x7f09940c6550 msgr2=0x7f09940c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 -- 172.21.15.114:0/2621651634 shutdown_connections 2024-02-17T12:18:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.013+0000 7f0998a00640 1 -- 172.21.15.114:0/2621651634 wait complete. 2024-02-17T12:18:08.036 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-17T12:18:08.036 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:18:08.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.165+0000 7fa3b0400640 1 Processor -- start 2024-02-17T12:18:08.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3b0400640 1 -- start start 2024-02-17T12:18:08.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3b0400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3a80c4b30 0x7fa3a81583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:08.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3b0400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a8155090 con 0x7fa3a80a6360 2024-02-17T12:18:08.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3b0400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a8159300 con 0x7fa3a80c58b0 2024-02-17T12:18:08.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3b0400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a80c6110 con 0x7fa3a80c4b30 2024-02-17T12:18:08.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3ad000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3a80c4b30 0x7fa3a81583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:08.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3ae400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa3a80a6360 0x7fa3a8155520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33030/0 (socket says 172.21.15.114:33030) 2024-02-17T12:18:08.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3ae400640 1 -- 172.21.15.114:0/4137937483 learned_addr learned my addr 172.21.15.114:0/4137937483 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:08.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3ad000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3a80c4b30 0x7fa3a81583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41742/0 (socket says 172.21.15.114:41742) 2024-02-17T12:18:08.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3ad000640 1 -- 172.21.15.114:0/4137937483 >> v1:172.21.15.116:6789/0 conn(0x7fa3a80c58b0 legacy=0x7fa3a806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:08.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3ad000640 1 -- 172.21.15.114:0/4137937483 >> v1:172.21.15.114:6789/0 conn(0x7fa3a80a6360 legacy=0x7fa3a8155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:08.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.169+0000 7fa3ad000640 1 -- 172.21.15.114:0/4137937483 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8158a60 con 0x7fa3a80c4b30 2024-02-17T12:18:08.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3ad000640 1 --2- 172.21.15.114:0/4137937483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80c4b30 0x7fa3a81583d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa3940097c0 tx=0x7fa39401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba0959cc8fe1891 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3a7e00640 1 -- 172.21.15.114:0/4137937483 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940ab670 con 0x7fa3a80c4b30 2024-02-17T12:18:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3a7e00640 1 -- 172.21.15.114:0/4137937483 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3940ab7d0 con 0x7fa3a80c4b30 2024-02-17T12:18:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3a7e00640 1 -- 172.21.15.114:0/4137937483 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940abb60 con 0x7fa3a80c4b30 2024-02-17T12:18:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3b0400640 1 -- 172.21.15.114:0/4137937483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80c4b30 msgr2=0x7fa3a81583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3b0400640 1 --2- 172.21.15.114:0/4137937483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80c4b30 0x7fa3a81583d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa3940097c0 tx=0x7fa39401c470 comp rx=0 tx=0).stop 2024-02-17T12:18:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3b0400640 1 -- 172.21.15.114:0/4137937483 shutdown_connections 2024-02-17T12:18:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3b0400640 1 --2- 172.21.15.114:0/4137937483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80c4b30 0x7fa3a81583d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3b0400640 1 -- 172.21.15.114:0/4137937483 >> 172.21.15.114:0/4137937483 conn(0x7fa3a80c3730 msgr2=0x7fa3a80c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3b0400640 1 -- 172.21.15.114:0/4137937483 shutdown_connections 2024-02-17T12:18:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3b0400640 1 -- 172.21.15.114:0/4137937483 wait complete. 2024-02-17T12:18:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3b0400640 1 Processor -- start 2024-02-17T12:18:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.173+0000 7fa3b0400640 1 -- start start 2024-02-17T12:18:08.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3b0400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80a6360 0x7fa3a81f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:08.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3b0400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a80c4b30 0x7fa3a81ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:08.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3b0400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3a80c58b0 0x7fa3a806b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3b0400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81527d0 con 0x7fa3a80a6360 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3b0400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81ed4e0 con 0x7fa3a80c4b30 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3b0400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a8150980 con 0x7fa3a80c58b0 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ada00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80a6360 0x7fa3a81f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ada00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80a6360 0x7fa3a81f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41758/0 (socket says 172.21.15.114:41758) 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ada00640 1 -- 172.21.15.114:0/3765529438 learned_addr learned my addr 172.21.15.114:0/3765529438 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ae400640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3a80c58b0 0x7fa3a806b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ad000640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a80c4b30 0x7fa3a81ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ada00640 1 -- 172.21.15.114:0/3765529438 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3a80c58b0 msgr2=0x7fa3a806b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ada00640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3a80c58b0 0x7fa3a806b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ada00640 1 -- 172.21.15.114:0/3765529438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a80c4b30 msgr2=0x7fa3a81ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ada00640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a80c4b30 0x7fa3a81ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ada00640 1 -- 172.21.15.114:0/3765529438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394009420 con 0x7fa3a80a6360 2024-02-17T12:18:08.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3ada00640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80a6360 0x7fa3a81f0f20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c3c0 tx=0x7fa39c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:08.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3a5600640 1 -- 172.21.15.114:0/3765529438 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0052d0 con 0x7fa3a80a6360 2024-02-17T12:18:08.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3a5600640 1 -- 172.21.15.114:0/3765529438 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c005430 con 0x7fa3a80a6360 2024-02-17T12:18:08.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3a5600640 1 -- 172.21.15.114:0/3765529438 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c003840 con 0x7fa3a80a6360 2024-02-17T12:18:08.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3b0400640 1 -- 172.21.15.114:0/3765529438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a8150c60 con 0x7fa3a80a6360 2024-02-17T12:18:08.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3b0400640 1 -- 172.21.15.114:0/3765529438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a806bb70 con 0x7fa3a80a6360 2024-02-17T12:18:08.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3b0400640 1 -- 172.21.15.114:0/3765529438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a8067170 con 0x7fa3a80a6360 2024-02-17T12:18:08.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.177+0000 7fa3a5600640 1 -- 172.21.15.114:0/3765529438 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa39c0039a0 con 0x7fa3a80a6360 2024-02-17T12:18:08.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.181+0000 7fa3a5600640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa388066e40 0x7fa388069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:08.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.181+0000 7fa3a5600640 1 -- 172.21.15.114:0/3765529438 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa39c083fe0 con 0x7fa3a80a6360 2024-02-17T12:18:08.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.181+0000 7fa3ad000640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa388066e40 0x7fa388069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:08.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.181+0000 7fa3ad000640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa388066e40 0x7fa388069300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa3940af000 tx=0x7fa3940a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:08.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.185+0000 7fa3a5600640 1 -- 172.21.15.114:0/3765529438 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa39c050dc0 con 0x7fa3a80a6360 2024-02-17T12:18:08.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.333+0000 7fa3b0400640 1 -- 172.21.15.114:0/3765529438 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3a80c5c90 con 0x7fa388066e40 2024-02-17T12:18:08.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.341+0000 7fa3a5600640 1 -- 172.21.15.114:0/3765529438 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289103 (secure 0 0 0) 0x7fa3940ab9c0 con 0x7fa388066e40 2024-02-17T12:18:08.349 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:08.350 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:18:08.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 -- 172.21.15.114:0/3765529438 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa388066e40 msgr2=0x7fa388069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa388066e40 0x7fa388069300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa3940af000 tx=0x7fa3940a7000 comp rx=0 tx=0).stop 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 -- 172.21.15.114:0/3765529438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80a6360 msgr2=0x7fa3a81f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80a6360 0x7fa3a81f0f20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c3c0 tx=0x7fa39c00c880 comp rx=0 tx=0).stop 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 -- 172.21.15.114:0/3765529438 shutdown_connections 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3a80c58b0 0x7fa3a806b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a80c4b30 0x7fa3a81ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa388066e40 0x7fa388069300 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 --2- 172.21.15.114:0/3765529438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a80a6360 0x7fa3a81f0f20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 -- 172.21.15.114:0/3765529438 >> 172.21.15.114:0/3765529438 conn(0x7fa3a80c3730 msgr2=0x7fa3a8153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 -- 172.21.15.114:0/3765529438 shutdown_connections 2024-02-17T12:18:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:08.345+0000 7fa3b0400640 1 -- 172.21.15.114:0/3765529438 wait complete. 2024-02-17T12:18:08.369 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-02-17T12:18:07.237922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230312,"kb_used_data":5796,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744408,"statfs":{"total":773094113280,"available":772858273792,"internally_reserved":0,"allocated":5935104,"data_stored":3151848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001406"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867789+0000","last_change":"2024-02-17T12:18:02.804326+0000","last_active":"2024-02-17T12:18:03.867789+0000","last_peered":"2024-02-17T12:18:03.867789+0000","last_clean":"2024-02-17T12:18:03.867789+0000","last_became_active":"2024-02-17T12:18:02.804074+0000","last_became_peered":"2024-02-17T12:18:02.804074+0000","last_unstale":"2024-02-17T12:18:03.867789+0000","last_undegraded":"2024-02-17T12:18:03.867789+0000","last_fullsized":"2024-02-17T12:18:03.867789+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:47.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173023+0000","last_change":"2024-02-17T12:18:02.808706+0000","last_active":"2024-02-17T12:18:04.173023+0000","last_peered":"2024-02-17T12:18:04.173023+0000","last_clean":"2024-02-17T12:18:04.173023+0000","last_became_active":"2024-02-17T12:18:02.808520+0000","last_became_peered":"2024-02-17T12:18:02.808520+0000","last_unstale":"2024-02-17T12:18:04.173023+0000","last_undegraded":"2024-02-17T12:18:04.173023+0000","last_fullsized":"2024-02-17T12:18:04.173023+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:27.642044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173302+0000","last_change":"2024-02-17T12:18:02.807196+0000","last_active":"2024-02-17T12:18:04.173302+0000","last_peered":"2024-02-17T12:18:04.173302+0000","last_clean":"2024-02-17T12:18:04.173302+0000","last_became_active":"2024-02-17T12:18:02.806894+0000","last_became_peered":"2024-02-17T12:18:02.806894+0000","last_unstale":"2024-02-17T12:18:04.173302+0000","last_undegraded":"2024-02-17T12:18:04.173302+0000","last_fullsized":"2024-02-17T12:18:04.173302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:12.749708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801692+0000","last_change":"2024-02-17T12:18:02.814770+0000","last_active":"2024-02-17T12:18:03.801692+0000","last_peered":"2024-02-17T12:18:03.801692+0000","last_clean":"2024-02-17T12:18:03.801692+0000","last_became_active":"2024-02-17T12:18:02.809466+0000","last_became_peered":"2024-02-17T12:18:02.809466+0000","last_unstale":"2024-02-17T12:18:03.801692+0000","last_undegraded":"2024-02-17T12:18:03.801692+0000","last_fullsized":"2024-02-17T12:18:03.801692+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867694+0000","last_change":"2024-02-17T12:18:02.802996+0000","last_active":"2024-02-17T12:18:03.867694+0000","last_peered":"2024-02-17T12:18:03.867694+0000","last_clean":"2024-02-17T12:18:03.867694+0000","last_became_active":"2024-02-17T12:18:02.802690+0000","last_became_peered":"2024-02-17T12:18:02.802690+0000","last_unstale":"2024-02-17T12:18:03.867694+0000","last_undegraded":"2024-02-17T12:18:03.867694+0000","last_fullsized":"2024-02-17T12:18:03.867694+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:59.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802123+0000","last_change":"2024-02-17T12:18:02.812986+0000","last_active":"2024-02-17T12:18:03.802123+0000","last_peered":"2024-02-17T12:18:03.802123+0000","last_clean":"2024-02-17T12:18:03.802123+0000","last_became_active":"2024-02-17T12:18:02.809576+0000","last_became_peered":"2024-02-17T12:18:02.809576+0000","last_unstale":"2024-02-17T12:18:03.802123+0000","last_undegraded":"2024-02-17T12:18:03.802123+0000","last_fullsized":"2024-02-17T12:18:03.802123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802402+0000","last_change":"2024-02-17T12:18:02.799654+0000","last_active":"2024-02-17T12:18:03.802402+0000","last_peered":"2024-02-17T12:18:03.802402+0000","last_clean":"2024-02-17T12:18:03.802402+0000","last_became_active":"2024-02-17T12:18:02.799356+0000","last_became_peered":"2024-02-17T12:18:02.799356+0000","last_unstale":"2024-02-17T12:18:03.802402+0000","last_undegraded":"2024-02-17T12:18:03.802402+0000","last_fullsized":"2024-02-17T12:18:03.802402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:29.710017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172274+0000","last_change":"2024-02-17T12:18:02.800189+0000","last_active":"2024-02-17T12:18:04.172274+0000","last_peered":"2024-02-17T12:18:04.172274+0000","last_clean":"2024-02-17T12:18:04.172274+0000","last_became_active":"2024-02-17T12:18:02.799866+0000","last_became_peered":"2024-02-17T12:18:02.799866+0000","last_unstale":"2024-02-17T12:18:04.172274+0000","last_undegraded":"2024-02-17T12:18:04.172274+0000","last_fullsized":"2024-02-17T12:18:04.172274+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:52.152034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802908+0000","last_change":"2024-02-17T12:18:02.794591+0000","last_active":"2024-02-17T12:18:03.802908+0000","last_peered":"2024-02-17T12:18:03.802908+0000","last_clean":"2024-02-17T12:18:03.802908+0000","last_became_active":"2024-02-17T12:18:02.794309+0000","last_became_peered":"2024-02-17T12:18:02.794309+0000","last_unstale":"2024-02-17T12:18:03.802908+0000","last_undegraded":"2024-02-17T12:18:03.802908+0000","last_fullsized":"2024-02-17T12:18:03.802908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:18.132994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172280+0000","last_change":"2024-02-17T12:18:02.802586+0000","last_active":"2024-02-17T12:18:04.172280+0000","last_peered":"2024-02-17T12:18:04.172280+0000","last_clean":"2024-02-17T12:18:04.172280+0000","last_became_active":"2024-02-17T12:18:02.802328+0000","last_became_peered":"2024-02-17T12:18:02.802328+0000","last_unstale":"2024-02-17T12:18:04.172280+0000","last_undegraded":"2024-02-17T12:18:04.172280+0000","last_fullsized":"2024-02-17T12:18:04.172280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:30.894335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172283+0000","last_change":"2024-02-17T12:18:02.803729+0000","last_active":"2024-02-17T12:18:04.172283+0000","last_peered":"2024-02-17T12:18:04.172283+0000","last_clean":"2024-02-17T12:18:04.172283+0000","last_became_active":"2024-02-17T12:18:02.803504+0000","last_became_peered":"2024-02-17T12:18:02.803504+0000","last_unstale":"2024-02-17T12:18:04.172283+0000","last_undegraded":"2024-02-17T12:18:04.172283+0000","last_fullsized":"2024-02-17T12:18:04.172283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:50.631061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801865+0000","last_change":"2024-02-17T12:18:02.814562+0000","last_active":"2024-02-17T12:18:03.801865+0000","last_peered":"2024-02-17T12:18:03.801865+0000","last_clean":"2024-02-17T12:18:03.801865+0000","last_became_active":"2024-02-17T12:18:02.809011+0000","last_became_peered":"2024-02-17T12:18:02.809011+0000","last_unstale":"2024-02-17T12:18:03.801865+0000","last_undegraded":"2024-02-17T12:18:03.801865+0000","last_fullsized":"2024-02-17T12:18:03.801865+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173551+0000","last_change":"2024-02-17T12:18:02.800228+0000","last_active":"2024-02-17T12:18:04.173551+0000","last_peered":"2024-02-17T12:18:04.173551+0000","last_clean":"2024-02-17T12:18:04.173551+0000","last_became_active":"2024-02-17T12:18:02.799965+0000","last_became_peered":"2024-02-17T12:18:02.799965+0000","last_unstale":"2024-02-17T12:18:04.173551+0000","last_undegraded":"2024-02-17T12:18:04.173551+0000","last_fullsized":"2024-02-17T12:18:04.173551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:05.435817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802492+0000","last_change":"2024-02-17T12:18:02.798437+0000","last_active":"2024-02-17T12:18:03.802492+0000","last_peered":"2024-02-17T12:18:03.802492+0000","last_clean":"2024-02-17T12:18:03.802492+0000","last_became_active":"2024-02-17T12:18:02.798145+0000","last_became_peered":"2024-02-17T12:18:02.798145+0000","last_unstale":"2024-02-17T12:18:03.802492+0000","last_undegraded":"2024-02-17T12:18:03.802492+0000","last_fullsized":"2024-02-17T12:18:03.802492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:29.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802419+0000","last_change":"2024-02-17T12:18:02.797013+0000","last_active":"2024-02-17T12:18:03.802419+0000","last_peered":"2024-02-17T12:18:03.802419+0000","last_clean":"2024-02-17T12:18:03.802419+0000","last_became_active":"2024-02-17T12:18:02.796734+0000","last_became_peered":"2024-02-17T12:18:02.796734+0000","last_unstale":"2024-02-17T12:18:03.802419+0000","last_undegraded":"2024-02-17T12:18:03.802419+0000","last_fullsized":"2024-02-17T12:18:03.802419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:32.566741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802025+0000","last_change":"2024-02-17T12:18:02.809976+0000","last_active":"2024-02-17T12:18:03.802025+0000","last_peered":"2024-02-17T12:18:03.802025+0000","last_clean":"2024-02-17T12:18:03.802025+0000","last_became_active":"2024-02-17T12:18:02.809645+0000","last_became_peered":"2024-02-17T12:18:02.809645+0000","last_unstale":"2024-02-17T12:18:03.802025+0000","last_undegraded":"2024-02-17T12:18:03.802025+0000","last_fullsized":"2024-02-17T12:18:03.802025+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172807+0000","last_change":"2024-02-17T12:18:02.807700+0000","last_active":"2024-02-17T12:18:04.172807+0000","last_peered":"2024-02-17T12:18:04.172807+0000","last_clean":"2024-02-17T12:18:04.172807+0000","last_became_active":"2024-02-17T12:18:02.805575+0000","last_became_peered":"2024-02-17T12:18:02.805575+0000","last_unstale":"2024-02-17T12:18:04.172807+0000","last_undegraded":"2024-02-17T12:18:04.172807+0000","last_fullsized":"2024-02-17T12:18:04.172807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:52:33.882315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173764+0000","last_change":"2024-02-17T12:18:02.809074+0000","last_active":"2024-02-17T12:18:04.173764+0000","last_peered":"2024-02-17T12:18:04.173764+0000","last_clean":"2024-02-17T12:18:04.173764+0000","last_became_active":"2024-02-17T12:18:02.808683+0000","last_became_peered":"2024-02-17T12:18:02.808683+0000","last_unstale":"2024-02-17T12:18:04.173764+0000","last_undegraded":"2024-02-17T12:18:04.173764+0000","last_fullsized":"2024-02-17T12:18:04.173764+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:46:21.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867919+0000","last_change":"2024-02-17T12:18:02.803587+0000","last_active":"2024-02-17T12:18:03.867919+0000","last_peered":"2024-02-17T12:18:03.867919+0000","last_clean":"2024-02-17T12:18:03.867919+0000","last_became_active":"2024-02-17T12:18:02.803312+0000","last_became_peered":"2024-02-17T12:18:02.803312+0000","last_unstale":"2024-02-17T12:18:03.867919+0000","last_undegraded":"2024-02-17T12:18:03.867919+0000","last_fullsized":"2024-02-17T12:18:03.867919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:54:01.696616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172628+0000","last_change":"2024-02-17T12:18:02.815782+0000","last_active":"2024-02-17T12:18:04.172628+0000","last_peered":"2024-02-17T12:18:04.172628+0000","last_clean":"2024-02-17T12:18:04.172628+0000","last_became_active":"2024-02-17T12:18:02.815537+0000","last_became_peered":"2024-02-17T12:18:02.815537+0000","last_unstale":"2024-02-17T12:18:04.172628+0000","last_undegraded":"2024-02-17T12:18:04.172628+0000","last_fullsized":"2024-02-17T12:18:04.172628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:23.114440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173161+0000","last_change":"2024-02-17T12:18:02.809894+0000","last_active":"2024-02-17T12:18:04.173161+0000","last_peered":"2024-02-17T12:18:04.173161+0000","last_clean":"2024-02-17T12:18:04.173161+0000","last_became_active":"2024-02-17T12:18:02.807451+0000","last_became_peered":"2024-02-17T12:18:02.807451+0000","last_unstale":"2024-02-17T12:18:04.173161+0000","last_undegraded":"2024-02-17T12:18:04.173161+0000","last_fullsized":"2024-02-17T12:18:04.173161+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:05:50.249065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172966+0000","last_change":"2024-02-17T12:18:02.813079+0000","last_active":"2024-02-17T12:18:04.172966+0000","last_peered":"2024-02-17T12:18:04.172966+0000","last_clean":"2024-02-17T12:18:04.172966+0000","last_became_active":"2024-02-17T12:18:02.810630+0000","last_became_peered":"2024-02-17T12:18:02.810630+0000","last_unstale":"2024-02-17T12:18:04.172966+0000","last_undegraded":"2024-02-17T12:18:04.172966+0000","last_fullsized":"2024-02-17T12:18:04.172966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:32:22.683974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173537+0000","last_change":"2024-02-17T12:18:02.807916+0000","last_active":"2024-02-17T12:18:04.173537+0000","last_peered":"2024-02-17T12:18:04.173537+0000","last_clean":"2024-02-17T12:18:04.173537+0000","last_became_active":"2024-02-17T12:18:02.806754+0000","last_became_peered":"2024-02-17T12:18:02.806754+0000","last_unstale":"2024-02-17T12:18:04.173537+0000","last_undegraded":"2024-02-17T12:18:04.173537+0000","last_fullsized":"2024-02-17T12:18:04.173537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.985986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173008+0000","last_change":"2024-02-17T12:18:02.805691+0000","last_active":"2024-02-17T12:18:04.173008+0000","last_peered":"2024-02-17T12:18:04.173008+0000","last_clean":"2024-02-17T12:18:04.173008+0000","last_became_active":"2024-02-17T12:18:02.805396+0000","last_became_peered":"2024-02-17T12:18:02.805396+0000","last_unstale":"2024-02-17T12:18:04.173008+0000","last_undegraded":"2024-02-17T12:18:04.173008+0000","last_fullsized":"2024-02-17T12:18:04.173008+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:09:34.480729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867898+0000","last_change":"2024-02-17T12:18:02.798267+0000","last_active":"2024-02-17T12:18:03.867898+0000","last_peered":"2024-02-17T12:18:03.867898+0000","last_clean":"2024-02-17T12:18:03.867898+0000","last_became_active":"2024-02-17T12:18:02.797624+0000","last_became_peered":"2024-02-17T12:18:02.797624+0000","last_unstale":"2024-02-17T12:18:03.867898+0000","last_undegraded":"2024-02-17T12:18:03.867898+0000","last_fullsized":"2024-02-17T12:18:03.867898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:17:06.691178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801849+0000","last_change":"2024-02-17T12:18:02.802532+0000","last_active":"2024-02-17T12:18:03.801849+0000","last_peered":"2024-02-17T12:18:03.801849+0000","last_clean":"2024-02-17T12:18:03.801849+0000","last_became_active":"2024-02-17T12:18:02.801766+0000","last_became_peered":"2024-02-17T12:18:02.801766+0000","last_unstale":"2024-02-17T12:18:03.801849+0000","last_undegraded":"2024-02-17T12:18:03.801849+0000","last_fullsized":"2024-02-17T12:18:03.801849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802488+0000","last_change":"2024-02-17T12:18:02.797999+0000","last_active":"2024-02-17T12:18:03.802488+0000","last_peered":"2024-02-17T12:18:03.802488+0000","last_clean":"2024-02-17T12:18:03.802488+0000","last_became_active":"2024-02-17T12:18:02.797710+0000","last_became_peered":"2024-02-17T12:18:02.797710+0000","last_unstale":"2024-02-17T12:18:03.802488+0000","last_undegraded":"2024-02-17T12:18:03.802488+0000","last_fullsized":"2024-02-17T12:18:03.802488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867831+0000","last_change":"2024-02-17T12:18:02.804711+0000","last_active":"2024-02-17T12:18:03.867831+0000","last_peered":"2024-02-17T12:18:03.867831+0000","last_clean":"2024-02-17T12:18:03.867831+0000","last_became_active":"2024-02-17T12:18:02.804459+0000","last_became_peered":"2024-02-17T12:18:02.804459+0000","last_unstale":"2024-02-17T12:18:03.867831+0000","last_undegraded":"2024-02-17T12:18:03.867831+0000","last_fullsized":"2024-02-17T12:18:03.867831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:47.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172754+0000","last_change":"2024-02-17T12:18:02.802524+0000","last_active":"2024-02-17T12:18:04.172754+0000","last_peered":"2024-02-17T12:18:04.172754+0000","last_clean":"2024-02-17T12:18:04.172754+0000","last_became_active":"2024-02-17T12:18:02.802045+0000","last_became_peered":"2024-02-17T12:18:02.802045+0000","last_unstale":"2024-02-17T12:18:04.172754+0000","last_undegraded":"2024-02-17T12:18:04.172754+0000","last_fullsized":"2024-02-17T12:18:04.172754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:06:03.414827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173099+0000","last_change":"2024-02-17T12:18:02.807169+0000","last_active":"2024-02-17T12:18:04.173099+0000","last_peered":"2024-02-17T12:18:04.173099+0000","last_clean":"2024-02-17T12:18:04.173099+0000","last_became_active":"2024-02-17T12:18:02.806918+0000","last_became_peered":"2024-02-17T12:18:02.806918+0000","last_unstale":"2024-02-17T12:18:04.173099+0000","last_undegraded":"2024-02-17T12:18:04.173099+0000","last_fullsized":"2024-02-17T12:18:04.173099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:17.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867681+0000","last_change":"2024-02-17T12:18:02.795014+0000","last_active":"2024-02-17T12:18:03.867681+0000","last_peered":"2024-02-17T12:18:03.867681+0000","last_clean":"2024-02-17T12:18:03.867681+0000","last_became_active":"2024-02-17T12:18:02.794759+0000","last_became_peered":"2024-02-17T12:18:02.794759+0000","last_unstale":"2024-02-17T12:18:03.867681+0000","last_undegraded":"2024-02-17T12:18:03.867681+0000","last_fullsized":"2024-02-17T12:18:03.867681+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:21.971723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802084+0000","last_change":"2024-02-17T12:18:02.801322+0000","last_active":"2024-02-17T12:18:03.802084+0000","last_peered":"2024-02-17T12:18:03.802084+0000","last_clean":"2024-02-17T12:18:03.802084+0000","last_became_active":"2024-02-17T12:18:02.801073+0000","last_became_peered":"2024-02-17T12:18:02.801073+0000","last_unstale":"2024-02-17T12:18:03.802084+0000","last_undegraded":"2024-02-17T12:18:03.802084+0000","last_fullsized":"2024-02-17T12:18:03.802084+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802729+0000","last_change":"2024-02-17T12:18:02.811882+0000","last_active":"2024-02-17T12:18:03.802729+0000","last_peered":"2024-02-17T12:18:03.802729+0000","last_clean":"2024-02-17T12:18:03.802729+0000","last_became_active":"2024-02-17T12:18:02.811448+0000","last_became_peered":"2024-02-17T12:18:02.811448+0000","last_unstale":"2024-02-17T12:18:03.802729+0000","last_undegraded":"2024-02-17T12:18:03.802729+0000","last_fullsized":"2024-02-17T12:18:03.802729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:46.432214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.803068+0000","last_change":"2024-02-17T12:18:01.796858+0000","last_active":"2024-02-17T12:18:03.803068+0000","last_peered":"2024-02-17T12:18:03.803068+0000","last_clean":"2024-02-17T12:18:03.803068+0000","last_became_active":"2024-02-17T12:18:01.796498+0000","last_became_peered":"2024-02-17T12:18:01.796498+0000","last_unstale":"2024-02-17T12:18:03.803068+0000","last_undegraded":"2024-02-17T12:18:03.803068+0000","last_fullsized":"2024-02-17T12:18:03.803068+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172457+0000","last_change":"2024-02-17T12:18:02.808663+0000","last_active":"2024-02-17T12:18:04.172457+0000","last_peered":"2024-02-17T12:18:04.172457+0000","last_clean":"2024-02-17T12:18:04.172457+0000","last_became_active":"2024-02-17T12:18:02.808402+0000","last_became_peered":"2024-02-17T12:18:02.808402+0000","last_unstale":"2024-02-17T12:18:04.172457+0000","last_undegraded":"2024-02-17T12:18:04.172457+0000","last_fullsized":"2024-02-17T12:18:04.172457+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:00.777830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172810+0000","last_change":"2024-02-17T12:18:01.790619+0000","last_active":"2024-02-17T12:18:04.172810+0000","last_peered":"2024-02-17T12:18:04.172810+0000","last_clean":"2024-02-17T12:18:04.172810+0000","last_became_active":"2024-02-17T12:18:01.790344+0000","last_became_peered":"2024-02-17T12:18:01.790344+0000","last_unstale":"2024-02-17T12:18:04.172810+0000","last_undegraded":"2024-02-17T12:18:04.172810+0000","last_fullsized":"2024-02-17T12:18:04.172810+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:45.425754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802701+0000","last_change":"2024-02-17T12:18:02.804685+0000","last_active":"2024-02-17T12:18:03.802701+0000","last_peered":"2024-02-17T12:18:03.802701+0000","last_clean":"2024-02-17T12:18:03.802701+0000","last_became_active":"2024-02-17T12:18:02.803980+0000","last_became_peered":"2024-02-17T12:18:02.803980+0000","last_unstale":"2024-02-17T12:18:03.802701+0000","last_undegraded":"2024-02-17T12:18:03.802701+0000","last_fullsized":"2024-02-17T12:18:03.802701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:32.327387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802681+0000","last_change":"2024-02-17T12:18:01.801344+0000","last_active":"2024-02-17T12:18:03.802681+0000","last_peered":"2024-02-17T12:18:03.802681+0000","last_clean":"2024-02-17T12:18:03.802681+0000","last_became_active":"2024-02-17T12:18:01.801092+0000","last_became_peered":"2024-02-17T12:18:01.801092+0000","last_unstale":"2024-02-17T12:18:03.802681+0000","last_undegraded":"2024-02-17T12:18:03.802681+0000","last_fullsized":"2024-02-17T12:18:03.802681+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802550+0000","last_change":"2024-02-17T12:18:02.806603+0000","last_active":"2024-02-17T12:18:03.802550+0000","last_peered":"2024-02-17T12:18:03.802550+0000","last_clean":"2024-02-17T12:18:03.802550+0000","last_became_active":"2024-02-17T12:18:02.806021+0000","last_became_peered":"2024-02-17T12:18:02.806021+0000","last_unstale":"2024-02-17T12:18:03.802550+0000","last_undegraded":"2024-02-17T12:18:03.802550+0000","last_fullsized":"2024-02-17T12:18:03.802550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:57.248220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801990+0000","last_change":"2024-02-17T12:18:01.790249+0000","last_active":"2024-02-17T12:18:03.801990+0000","last_peered":"2024-02-17T12:18:03.801990+0000","last_clean":"2024-02-17T12:18:03.801990+0000","last_became_active":"2024-02-17T12:18:01.789970+0000","last_became_peered":"2024-02-17T12:18:01.789970+0000","last_unstale":"2024-02-17T12:18:03.801990+0000","last_undegraded":"2024-02-17T12:18:03.801990+0000","last_fullsized":"2024-02-17T12:18:03.801990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173114+0000","last_change":"2024-02-17T12:18:02.811065+0000","last_active":"2024-02-17T12:18:04.173114+0000","last_peered":"2024-02-17T12:18:04.173114+0000","last_clean":"2024-02-17T12:18:04.173114+0000","last_became_active":"2024-02-17T12:18:02.810598+0000","last_became_peered":"2024-02-17T12:18:02.810598+0000","last_unstale":"2024-02-17T12:18:04.173114+0000","last_undegraded":"2024-02-17T12:18:04.173114+0000","last_fullsized":"2024-02-17T12:18:04.173114+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:11:46.553742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802683+0000","last_change":"2024-02-17T12:18:01.798801+0000","last_active":"2024-02-17T12:18:03.802683+0000","last_peered":"2024-02-17T12:18:03.802683+0000","last_clean":"2024-02-17T12:18:03.802683+0000","last_became_active":"2024-02-17T12:18:01.798516+0000","last_became_peered":"2024-02-17T12:18:01.798516+0000","last_unstale":"2024-02-17T12:18:03.802683+0000","last_undegraded":"2024-02-17T12:18:03.802683+0000","last_fullsized":"2024-02-17T12:18:03.802683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:04:53.798642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173209+0000","last_change":"2024-02-17T12:18:02.802301+0000","last_active":"2024-02-17T12:18:04.173209+0000","last_peered":"2024-02-17T12:18:04.173209+0000","last_clean":"2024-02-17T12:18:04.173209+0000","last_became_active":"2024-02-17T12:18:02.801632+0000","last_became_peered":"2024-02-17T12:18:02.801632+0000","last_unstale":"2024-02-17T12:18:04.173209+0000","last_undegraded":"2024-02-17T12:18:04.173209+0000","last_fullsized":"2024-02-17T12:18:04.173209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:34:13.159578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802099+0000","last_change":"2024-02-17T12:18:01.800510+0000","last_active":"2024-02-17T12:18:03.802099+0000","last_peered":"2024-02-17T12:18:03.802099+0000","last_clean":"2024-02-17T12:18:03.802099+0000","last_became_active":"2024-02-17T12:18:01.799483+0000","last_became_peered":"2024-02-17T12:18:01.799483+0000","last_unstale":"2024-02-17T12:18:03.802099+0000","last_undegraded":"2024-02-17T12:18:03.802099+0000","last_fullsized":"2024-02-17T12:18:03.802099+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173162+0000","last_change":"2024-02-17T12:18:02.811246+0000","last_active":"2024-02-17T12:18:04.173162+0000","last_peered":"2024-02-17T12:18:04.173162+0000","last_clean":"2024-02-17T12:18:04.173162+0000","last_became_active":"2024-02-17T12:18:02.810989+0000","last_became_peered":"2024-02-17T12:18:02.810989+0000","last_unstale":"2024-02-17T12:18:04.173162+0000","last_undegraded":"2024-02-17T12:18:04.173162+0000","last_fullsized":"2024-02-17T12:18:04.173162+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:56:31.198120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801161+0000","last_change":"2024-02-17T12:18:01.798316+0000","last_active":"2024-02-17T12:18:03.801161+0000","last_peered":"2024-02-17T12:18:03.801161+0000","last_clean":"2024-02-17T12:18:03.801161+0000","last_became_active":"2024-02-17T12:18:01.797041+0000","last_became_peered":"2024-02-17T12:18:01.797041+0000","last_unstale":"2024-02-17T12:18:03.801161+0000","last_undegraded":"2024-02-17T12:18:03.801161+0000","last_fullsized":"2024-02-17T12:18:03.801161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172480+0000","last_change":"2024-02-17T12:18:02.801971+0000","last_active":"2024-02-17T12:18:04.172480+0000","last_peered":"2024-02-17T12:18:04.172480+0000","last_clean":"2024-02-17T12:18:04.172480+0000","last_became_active":"2024-02-17T12:18:02.801727+0000","last_became_peered":"2024-02-17T12:18:02.801727+0000","last_unstale":"2024-02-17T12:18:04.172480+0000","last_undegraded":"2024-02-17T12:18:04.172480+0000","last_fullsized":"2024-02-17T12:18:04.172480+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:06:15.526935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802379+0000","last_change":"2024-02-17T12:18:01.800493+0000","last_active":"2024-02-17T12:18:03.802379+0000","last_peered":"2024-02-17T12:18:03.802379+0000","last_clean":"2024-02-17T12:18:03.802379+0000","last_became_active":"2024-02-17T12:18:01.800206+0000","last_became_peered":"2024-02-17T12:18:01.800206+0000","last_unstale":"2024-02-17T12:18:03.802379+0000","last_undegraded":"2024-02-17T12:18:03.802379+0000","last_fullsized":"2024-02-17T12:18:03.802379+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:33.603620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802978+0000","last_change":"2024-02-17T12:18:02.797952+0000","last_active":"2024-02-17T12:18:03.802978+0000","last_peered":"2024-02-17T12:18:03.802978+0000","last_clean":"2024-02-17T12:18:03.802978+0000","last_became_active":"2024-02-17T12:18:02.797675+0000","last_became_peered":"2024-02-17T12:18:02.797675+0000","last_unstale":"2024-02-17T12:18:03.802978+0000","last_undegraded":"2024-02-17T12:18:03.802978+0000","last_fullsized":"2024-02-17T12:18:03.802978+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:01.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173763+0000","last_change":"2024-02-17T12:18:01.801850+0000","last_active":"2024-02-17T12:18:04.173763+0000","last_peered":"2024-02-17T12:18:04.173763+0000","last_clean":"2024-02-17T12:18:04.173763+0000","last_became_active":"2024-02-17T12:18:01.801516+0000","last_became_peered":"2024-02-17T12:18:01.801516+0000","last_unstale":"2024-02-17T12:18:04.173763+0000","last_undegraded":"2024-02-17T12:18:04.173763+0000","last_fullsized":"2024-02-17T12:18:04.173763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:28.630666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173640+0000","last_change":"2024-02-17T12:18:02.813957+0000","last_active":"2024-02-17T12:18:04.173640+0000","last_peered":"2024-02-17T12:18:04.173640+0000","last_clean":"2024-02-17T12:18:04.173640+0000","last_became_active":"2024-02-17T12:18:02.813647+0000","last_became_peered":"2024-02-17T12:18:02.813647+0000","last_unstale":"2024-02-17T12:18:04.173640+0000","last_undegraded":"2024-02-17T12:18:04.173640+0000","last_fullsized":"2024-02-17T12:18:04.173640+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:41.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172902+0000","last_change":"2024-02-17T12:18:01.799508+0000","last_active":"2024-02-17T12:18:04.172902+0000","last_peered":"2024-02-17T12:18:04.172902+0000","last_clean":"2024-02-17T12:18:04.172902+0000","last_became_active":"2024-02-17T12:18:01.798598+0000","last_became_peered":"2024-02-17T12:18:01.798598+0000","last_unstale":"2024-02-17T12:18:04.172902+0000","last_undegraded":"2024-02-17T12:18:04.172902+0000","last_fullsized":"2024-02-17T12:18:04.172902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:45.103353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171977+0000","last_change":"2024-02-17T12:18:02.787850+0000","last_active":"2024-02-17T12:18:04.171977+0000","last_peered":"2024-02-17T12:18:04.171977+0000","last_clean":"2024-02-17T12:18:04.171977+0000","last_became_active":"2024-02-17T12:18:02.787578+0000","last_became_peered":"2024-02-17T12:18:02.787578+0000","last_unstale":"2024-02-17T12:18:04.171977+0000","last_undegraded":"2024-02-17T12:18:04.171977+0000","last_fullsized":"2024-02-17T12:18:04.171977+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:29.854264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173815+0000","last_change":"2024-02-17T12:18:01.805403+0000","last_active":"2024-02-17T12:18:04.173815+0000","last_peered":"2024-02-17T12:18:04.173815+0000","last_clean":"2024-02-17T12:18:04.173815+0000","last_became_active":"2024-02-17T12:18:01.805059+0000","last_became_peered":"2024-02-17T12:18:01.805059+0000","last_unstale":"2024-02-17T12:18:04.173815+0000","last_undegraded":"2024-02-17T12:18:04.173815+0000","last_fullsized":"2024-02-17T12:18:04.173815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:14.495937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173478+0000","last_change":"2024-02-17T12:18:02.810198+0000","last_active":"2024-02-17T12:18:04.173478+0000","last_peered":"2024-02-17T12:18:04.173478+0000","last_clean":"2024-02-17T12:18:04.173478+0000","last_became_active":"2024-02-17T12:18:02.809131+0000","last_became_peered":"2024-02-17T12:18:02.809131+0000","last_unstale":"2024-02-17T12:18:04.173478+0000","last_undegraded":"2024-02-17T12:18:04.173478+0000","last_fullsized":"2024-02-17T12:18:04.173478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:01:23.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802836+0000","last_change":"2024-02-17T12:18:01.802710+0000","last_active":"2024-02-17T12:18:03.802836+0000","last_peered":"2024-02-17T12:18:03.802836+0000","last_clean":"2024-02-17T12:18:03.802836+0000","last_became_active":"2024-02-17T12:18:01.802365+0000","last_became_peered":"2024-02-17T12:18:01.802365+0000","last_unstale":"2024-02-17T12:18:03.802836+0000","last_undegraded":"2024-02-17T12:18:03.802836+0000","last_fullsized":"2024-02-17T12:18:03.802836+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:45.771679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801283+0000","last_change":"2024-02-17T12:18:02.809855+0000","last_active":"2024-02-17T12:18:03.801283+0000","last_peered":"2024-02-17T12:18:03.801283+0000","last_clean":"2024-02-17T12:18:03.801283+0000","last_became_active":"2024-02-17T12:18:02.809577+0000","last_became_peered":"2024-02-17T12:18:02.809577+0000","last_unstale":"2024-02-17T12:18:03.801283+0000","last_undegraded":"2024-02-17T12:18:03.801283+0000","last_fullsized":"2024-02-17T12:18:03.801283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:17:49.657379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172597+0000","last_change":"2024-02-17T12:18:01.792615+0000","last_active":"2024-02-17T12:18:04.172597+0000","last_peered":"2024-02-17T12:18:04.172597+0000","last_clean":"2024-02-17T12:18:04.172597+0000","last_became_active":"2024-02-17T12:18:01.792287+0000","last_became_peered":"2024-02-17T12:18:01.792287+0000","last_unstale":"2024-02-17T12:18:04.172597+0000","last_undegraded":"2024-02-17T12:18:04.172597+0000","last_fullsized":"2024-02-17T12:18:04.172597+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:56.241760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173374+0000","last_change":"2024-02-17T12:18:02.808057+0000","last_active":"2024-02-17T12:18:04.173374+0000","last_peered":"2024-02-17T12:18:04.173374+0000","last_clean":"2024-02-17T12:18:04.173374+0000","last_became_active":"2024-02-17T12:18:02.807629+0000","last_became_peered":"2024-02-17T12:18:02.807629+0000","last_unstale":"2024-02-17T12:18:04.173374+0000","last_undegraded":"2024-02-17T12:18:04.173374+0000","last_fullsized":"2024-02-17T12:18:04.173374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:58:48.506743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173899+0000","last_change":"2024-02-17T12:18:01.797715+0000","last_active":"2024-02-17T12:18:04.173899+0000","last_peered":"2024-02-17T12:18:04.173899+0000","last_clean":"2024-02-17T12:18:04.173899+0000","last_became_active":"2024-02-17T12:18:01.797435+0000","last_became_peered":"2024-02-17T12:18:01.797435+0000","last_unstale":"2024-02-17T12:18:04.173899+0000","last_undegraded":"2024-02-17T12:18:04.173899+0000","last_fullsized":"2024-02-17T12:18:04.173899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:49.624601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802474+0000","last_change":"2024-02-17T12:18:02.810137+0000","last_active":"2024-02-17T12:18:03.802474+0000","last_peered":"2024-02-17T12:18:03.802474+0000","last_clean":"2024-02-17T12:18:03.802474+0000","last_became_active":"2024-02-17T12:18:02.809877+0000","last_became_peered":"2024-02-17T12:18:02.809877+0000","last_unstale":"2024-02-17T12:18:03.802474+0000","last_undegraded":"2024-02-17T12:18:03.802474+0000","last_fullsized":"2024-02-17T12:18:03.802474+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:15.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801165+0000","last_change":"2024-02-17T12:18:01.790794+0000","last_active":"2024-02-17T12:18:03.801165+0000","last_peered":"2024-02-17T12:18:03.801165+0000","last_clean":"2024-02-17T12:18:03.801165+0000","last_became_active":"2024-02-17T12:18:01.790500+0000","last_became_peered":"2024-02-17T12:18:01.790500+0000","last_unstale":"2024-02-17T12:18:03.801165+0000","last_undegraded":"2024-02-17T12:18:03.801165+0000","last_fullsized":"2024-02-17T12:18:03.801165+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173954+0000","last_change":"2024-02-17T12:18:02.808594+0000","last_active":"2024-02-17T12:18:04.173954+0000","last_peered":"2024-02-17T12:18:04.173954+0000","last_clean":"2024-02-17T12:18:04.173954+0000","last_became_active":"2024-02-17T12:18:02.808035+0000","last_became_peered":"2024-02-17T12:18:02.808035+0000","last_unstale":"2024-02-17T12:18:04.173954+0000","last_undegraded":"2024-02-17T12:18:04.173954+0000","last_fullsized":"2024-02-17T12:18:04.173954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:58.050395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173264+0000","last_change":"2024-02-17T12:18:01.789017+0000","last_active":"2024-02-17T12:18:04.173264+0000","last_peered":"2024-02-17T12:18:04.173264+0000","last_clean":"2024-02-17T12:18:04.173264+0000","last_became_active":"2024-02-17T12:18:01.788529+0000","last_became_peered":"2024-02-17T12:18:01.788529+0000","last_unstale":"2024-02-17T12:18:04.173264+0000","last_undegraded":"2024-02-17T12:18:04.173264+0000","last_fullsized":"2024-02-17T12:18:04.173264+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:31.560281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.174014+0000","last_change":"2024-02-17T12:18:02.808518+0000","last_active":"2024-02-17T12:18:04.174014+0000","last_peered":"2024-02-17T12:18:04.174014+0000","last_clean":"2024-02-17T12:18:04.174014+0000","last_became_active":"2024-02-17T12:18:02.808255+0000","last_became_peered":"2024-02-17T12:18:02.808255+0000","last_unstale":"2024-02-17T12:18:04.174014+0000","last_undegraded":"2024-02-17T12:18:04.174014+0000","last_fullsized":"2024-02-17T12:18:04.174014+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:58:40.908163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172893+0000","last_change":"2024-02-17T12:18:01.802794+0000","last_active":"2024-02-17T12:18:04.172893+0000","last_peered":"2024-02-17T12:18:04.172893+0000","last_clean":"2024-02-17T12:18:04.172893+0000","last_became_active":"2024-02-17T12:18:01.802366+0000","last_became_peered":"2024-02-17T12:18:01.802366+0000","last_unstale":"2024-02-17T12:18:04.172893+0000","last_undegraded":"2024-02-17T12:18:04.172893+0000","last_fullsized":"2024-02-17T12:18:04.172893+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:45:00.445775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801994+0000","last_change":"2024-02-17T12:18:02.810942+0000","last_active":"2024-02-17T12:18:03.801994+0000","last_peered":"2024-02-17T12:18:03.801994+0000","last_clean":"2024-02-17T12:18:03.801994+0000","last_became_active":"2024-02-17T12:18:02.810651+0000","last_became_peered":"2024-02-17T12:18:02.810651+0000","last_unstale":"2024-02-17T12:18:03.801994+0000","last_undegraded":"2024-02-17T12:18:03.801994+0000","last_fullsized":"2024-02-17T12:18:03.801994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802822+0000","last_change":"2024-02-17T12:18:01.797601+0000","last_active":"2024-02-17T12:18:03.802822+0000","last_peered":"2024-02-17T12:18:03.802822+0000","last_clean":"2024-02-17T12:18:03.802822+0000","last_became_active":"2024-02-17T12:18:01.796341+0000","last_became_peered":"2024-02-17T12:18:01.796341+0000","last_unstale":"2024-02-17T12:18:03.802822+0000","last_undegraded":"2024-02-17T12:18:03.802822+0000","last_fullsized":"2024-02-17T12:18:03.802822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172807+0000","last_change":"2024-02-17T12:18:02.803894+0000","last_active":"2024-02-17T12:18:04.172807+0000","last_peered":"2024-02-17T12:18:04.172807+0000","last_clean":"2024-02-17T12:18:04.172807+0000","last_became_active":"2024-02-17T12:18:02.803553+0000","last_became_peered":"2024-02-17T12:18:02.803553+0000","last_unstale":"2024-02-17T12:18:04.172807+0000","last_undegraded":"2024-02-17T12:18:04.172807+0000","last_fullsized":"2024-02-17T12:18:04.172807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:35:24.727572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801624+0000","last_change":"2024-02-17T12:18:01.789546+0000","last_active":"2024-02-17T12:18:03.801624+0000","last_peered":"2024-02-17T12:18:03.801624+0000","last_clean":"2024-02-17T12:18:03.801624+0000","last_became_active":"2024-02-17T12:18:01.789258+0000","last_became_peered":"2024-02-17T12:18:01.789258+0000","last_unstale":"2024-02-17T12:18:03.801624+0000","last_undegraded":"2024-02-17T12:18:03.801624+0000","last_fullsized":"2024-02-17T12:18:03.801624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173707+0000","last_change":"2024-02-17T12:18:02.811327+0000","last_active":"2024-02-17T12:18:04.173707+0000","last_peered":"2024-02-17T12:18:04.173707+0000","last_clean":"2024-02-17T12:18:04.173707+0000","last_became_active":"2024-02-17T12:18:02.809620+0000","last_became_peered":"2024-02-17T12:18:02.809620+0000","last_unstale":"2024-02-17T12:18:04.173707+0000","last_undegraded":"2024-02-17T12:18:04.173707+0000","last_fullsized":"2024-02-17T12:18:04.173707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:40:08.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802594+0000","last_change":"2024-02-17T12:18:01.798265+0000","last_active":"2024-02-17T12:18:03.802594+0000","last_peered":"2024-02-17T12:18:03.802594+0000","last_clean":"2024-02-17T12:18:03.802594+0000","last_became_active":"2024-02-17T12:18:01.797931+0000","last_became_peered":"2024-02-17T12:18:01.797931+0000","last_unstale":"2024-02-17T12:18:03.802594+0000","last_undegraded":"2024-02-17T12:18:03.802594+0000","last_fullsized":"2024-02-17T12:18:03.802594+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801311+0000","last_change":"2024-02-17T12:18:02.800381+0000","last_active":"2024-02-17T12:18:03.801311+0000","last_peered":"2024-02-17T12:18:03.801311+0000","last_clean":"2024-02-17T12:18:03.801311+0000","last_became_active":"2024-02-17T12:18:02.800042+0000","last_became_peered":"2024-02-17T12:18:02.800042+0000","last_unstale":"2024-02-17T12:18:03.801311+0000","last_undegraded":"2024-02-17T12:18:03.801311+0000","last_fullsized":"2024-02-17T12:18:03.801311+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:27.558546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172826+0000","last_change":"2024-02-17T12:18:01.795914+0000","last_active":"2024-02-17T12:18:04.172826+0000","last_peered":"2024-02-17T12:18:04.172826+0000","last_clean":"2024-02-17T12:18:04.172826+0000","last_became_active":"2024-02-17T12:18:01.794847+0000","last_became_peered":"2024-02-17T12:18:01.794847+0000","last_unstale":"2024-02-17T12:18:04.172826+0000","last_undegraded":"2024-02-17T12:18:04.172826+0000","last_fullsized":"2024-02-17T12:18:04.172826+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:31.320927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802473+0000","last_change":"2024-02-17T12:18:02.807547+0000","last_active":"2024-02-17T12:18:03.802473+0000","last_peered":"2024-02-17T12:18:03.802473+0000","last_clean":"2024-02-17T12:18:03.802473+0000","last_became_active":"2024-02-17T12:18:02.807209+0000","last_became_peered":"2024-02-17T12:18:02.807209+0000","last_unstale":"2024-02-17T12:18:03.802473+0000","last_undegraded":"2024-02-17T12:18:03.802473+0000","last_fullsized":"2024-02-17T12:18:03.802473+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171947+0000","last_change":"2024-02-17T12:18:01.803848+0000","last_active":"2024-02-17T12:18:04.171947+0000","last_peered":"2024-02-17T12:18:04.171947+0000","last_clean":"2024-02-17T12:18:04.171947+0000","last_became_active":"2024-02-17T12:18:01.803552+0000","last_became_peered":"2024-02-17T12:18:01.803552+0000","last_unstale":"2024-02-17T12:18:04.171947+0000","last_undegraded":"2024-02-17T12:18:04.171947+0000","last_fullsized":"2024-02-17T12:18:04.171947+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:25:02.826927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802107+0000","last_change":"2024-02-17T12:18:02.811800+0000","last_active":"2024-02-17T12:18:03.802107+0000","last_peered":"2024-02-17T12:18:03.802107+0000","last_clean":"2024-02-17T12:18:03.802107+0000","last_became_active":"2024-02-17T12:18:02.811504+0000","last_became_peered":"2024-02-17T12:18:02.811504+0000","last_unstale":"2024-02-17T12:18:03.802107+0000","last_undegraded":"2024-02-17T12:18:03.802107+0000","last_fullsized":"2024-02-17T12:18:03.802107+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801149+0000","last_change":"2024-02-17T12:18:01.800860+0000","last_active":"2024-02-17T12:18:03.801149+0000","last_peered":"2024-02-17T12:18:03.801149+0000","last_clean":"2024-02-17T12:18:03.801149+0000","last_became_active":"2024-02-17T12:18:01.800569+0000","last_became_peered":"2024-02-17T12:18:01.800569+0000","last_unstale":"2024-02-17T12:18:03.801149+0000","last_undegraded":"2024-02-17T12:18:03.801149+0000","last_fullsized":"2024-02-17T12:18:03.801149+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801841+0000","last_change":"2024-02-17T12:18:02.812763+0000","last_active":"2024-02-17T12:18:03.801841+0000","last_peered":"2024-02-17T12:18:03.801841+0000","last_clean":"2024-02-17T12:18:03.801841+0000","last_became_active":"2024-02-17T12:18:02.812512+0000","last_became_peered":"2024-02-17T12:18:02.812512+0000","last_unstale":"2024-02-17T12:18:03.801841+0000","last_undegraded":"2024-02-17T12:18:03.801841+0000","last_fullsized":"2024-02-17T12:18:03.801841+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172534+0000","last_change":"2024-02-17T12:18:01.805847+0000","last_active":"2024-02-17T12:18:04.172534+0000","last_peered":"2024-02-17T12:18:04.172534+0000","last_clean":"2024-02-17T12:18:04.172534+0000","last_became_active":"2024-02-17T12:18:01.805591+0000","last_became_peered":"2024-02-17T12:18:01.805591+0000","last_unstale":"2024-02-17T12:18:04.172534+0000","last_undegraded":"2024-02-17T12:18:04.172534+0000","last_fullsized":"2024-02-17T12:18:04.172534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:52:05.403651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801873+0000","last_change":"2024-02-17T12:18:02.809740+0000","last_active":"2024-02-17T12:18:03.801873+0000","last_peered":"2024-02-17T12:18:03.801873+0000","last_clean":"2024-02-17T12:18:03.801873+0000","last_became_active":"2024-02-17T12:18:02.809407+0000","last_became_peered":"2024-02-17T12:18:02.809407+0000","last_unstale":"2024-02-17T12:18:03.801873+0000","last_undegraded":"2024-02-17T12:18:03.801873+0000","last_fullsized":"2024-02-17T12:18:03.801873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.789123+0000","last_change":"2024-02-17T12:18:01.794714+0000","last_active":"2024-02-17T12:18:04.789123+0000","last_peered":"2024-02-17T12:18:04.789123+0000","last_clean":"2024-02-17T12:18:04.789123+0000","last_became_active":"2024-02-17T12:18:01.794439+0000","last_became_peered":"2024-02-17T12:18:01.794439+0000","last_unstale":"2024-02-17T12:18:04.789123+0000","last_undegraded":"2024-02-17T12:18:04.789123+0000","last_fullsized":"2024-02-17T12:18:04.789123+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172069+0000","last_change":"2024-02-17T12:18:02.794702+0000","last_active":"2024-02-17T12:18:04.172069+0000","last_peered":"2024-02-17T12:18:04.172069+0000","last_clean":"2024-02-17T12:18:04.172069+0000","last_became_active":"2024-02-17T12:18:02.794412+0000","last_became_peered":"2024-02-17T12:18:02.794412+0000","last_unstale":"2024-02-17T12:18:04.172069+0000","last_undegraded":"2024-02-17T12:18:04.172069+0000","last_fullsized":"2024-02-17T12:18:04.172069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:05:00.914700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173653+0000","last_change":"2024-02-17T12:18:01.800872+0000","last_active":"2024-02-17T12:18:04.173653+0000","last_peered":"2024-02-17T12:18:04.173653+0000","last_clean":"2024-02-17T12:18:04.173653+0000","last_became_active":"2024-02-17T12:18:01.800563+0000","last_became_peered":"2024-02-17T12:18:01.800563+0000","last_unstale":"2024-02-17T12:18:04.173653+0000","last_undegraded":"2024-02-17T12:18:04.173653+0000","last_fullsized":"2024-02-17T12:18:04.173653+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:28.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802821+0000","last_change":"2024-02-17T12:18:02.806343+0000","last_active":"2024-02-17T12:18:03.802821+0000","last_peered":"2024-02-17T12:18:03.802821+0000","last_clean":"2024-02-17T12:18:03.802821+0000","last_became_active":"2024-02-17T12:18:02.805514+0000","last_became_peered":"2024-02-17T12:18:02.805514+0000","last_unstale":"2024-02-17T12:18:03.802821+0000","last_undegraded":"2024-02-17T12:18:03.802821+0000","last_fullsized":"2024-02-17T12:18:03.802821+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:46.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801971+0000","last_change":"2024-02-17T12:18:01.801897+0000","last_active":"2024-02-17T12:18:03.801971+0000","last_peered":"2024-02-17T12:18:03.801971+0000","last_clean":"2024-02-17T12:18:03.801971+0000","last_became_active":"2024-02-17T12:18:01.801572+0000","last_became_peered":"2024-02-17T12:18:01.801572+0000","last_unstale":"2024-02-17T12:18:03.801971+0000","last_undegraded":"2024-02-17T12:18:03.801971+0000","last_fullsized":"2024-02-17T12:18:03.801971+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173181+0000","last_change":"2024-02-17T12:18:02.808806+0000","last_active":"2024-02-17T12:18:04.173181+0000","last_peered":"2024-02-17T12:18:04.173181+0000","last_clean":"2024-02-17T12:18:04.173181+0000","last_became_active":"2024-02-17T12:18:02.808546+0000","last_became_peered":"2024-02-17T12:18:02.808546+0000","last_unstale":"2024-02-17T12:18:04.173181+0000","last_undegraded":"2024-02-17T12:18:04.173181+0000","last_fullsized":"2024-02-17T12:18:04.173181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:25.157077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171862+0000","last_change":"2024-02-17T12:18:01.798282+0000","last_active":"2024-02-17T12:18:04.171862+0000","last_peered":"2024-02-17T12:18:04.171862+0000","last_clean":"2024-02-17T12:18:04.171862+0000","last_became_active":"2024-02-17T12:18:01.797970+0000","last_became_peered":"2024-02-17T12:18:01.797970+0000","last_unstale":"2024-02-17T12:18:04.171862+0000","last_undegraded":"2024-02-17T12:18:04.171862+0000","last_fullsized":"2024-02-17T12:18:04.171862+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:52:16.655449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173892+0000","last_change":"2024-02-17T12:18:02.808303+0000","last_active":"2024-02-17T12:18:04.173892+0000","last_peered":"2024-02-17T12:18:04.173892+0000","last_clean":"2024-02-17T12:18:04.173892+0000","last_became_active":"2024-02-17T12:18:02.807743+0000","last_became_peered":"2024-02-17T12:18:02.807743+0000","last_unstale":"2024-02-17T12:18:04.173892+0000","last_undegraded":"2024-02-17T12:18:04.173892+0000","last_fullsized":"2024-02-17T12:18:04.173892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:55.025562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802606+0000","last_change":"2024-02-17T12:18:01.802694+0000","last_active":"2024-02-17T12:18:03.802606+0000","last_peered":"2024-02-17T12:18:03.802606+0000","last_clean":"2024-02-17T12:18:03.802606+0000","last_became_active":"2024-02-17T12:18:01.802326+0000","last_became_peered":"2024-02-17T12:18:01.802326+0000","last_unstale":"2024-02-17T12:18:03.802606+0000","last_undegraded":"2024-02-17T12:18:03.802606+0000","last_fullsized":"2024-02-17T12:18:03.802606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:33:51.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171727+0000","last_change":"2024-02-17T12:18:02.805983+0000","last_active":"2024-02-17T12:18:04.171727+0000","last_peered":"2024-02-17T12:18:04.171727+0000","last_clean":"2024-02-17T12:18:04.171727+0000","last_became_active":"2024-02-17T12:18:02.805699+0000","last_became_peered":"2024-02-17T12:18:02.805699+0000","last_unstale":"2024-02-17T12:18:04.171727+0000","last_undegraded":"2024-02-17T12:18:04.171727+0000","last_fullsized":"2024-02-17T12:18:04.171727+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:44.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171810+0000","last_change":"2024-02-17T12:18:01.801438+0000","last_active":"2024-02-17T12:18:04.171810+0000","last_peered":"2024-02-17T12:18:04.171810+0000","last_clean":"2024-02-17T12:18:04.171810+0000","last_became_active":"2024-02-17T12:18:01.801221+0000","last_became_peered":"2024-02-17T12:18:01.801221+0000","last_unstale":"2024-02-17T12:18:04.171810+0000","last_undegraded":"2024-02-17T12:18:04.171810+0000","last_fullsized":"2024-02-17T12:18:04.171810+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:09.649370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172593+0000","last_change":"2024-02-17T12:18:02.806745+0000","last_active":"2024-02-17T12:18:04.172593+0000","last_peered":"2024-02-17T12:18:04.172593+0000","last_clean":"2024-02-17T12:18:04.172593+0000","last_became_active":"2024-02-17T12:18:02.806429+0000","last_became_peered":"2024-02-17T12:18:02.806429+0000","last_unstale":"2024-02-17T12:18:04.172593+0000","last_undegraded":"2024-02-17T12:18:04.172593+0000","last_fullsized":"2024-02-17T12:18:04.172593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:58.938533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172457+0000","last_change":"2024-02-17T12:18:01.793256+0000","last_active":"2024-02-17T12:18:04.172457+0000","last_peered":"2024-02-17T12:18:04.172457+0000","last_clean":"2024-02-17T12:18:04.172457+0000","last_became_active":"2024-02-17T12:18:01.793033+0000","last_became_peered":"2024-02-17T12:18:01.793033+0000","last_unstale":"2024-02-17T12:18:04.172457+0000","last_undegraded":"2024-02-17T12:18:04.172457+0000","last_fullsized":"2024-02-17T12:18:04.172457+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:46.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172434+0000","last_change":"2024-02-17T12:18:02.800813+0000","last_active":"2024-02-17T12:18:04.172434+0000","last_peered":"2024-02-17T12:18:04.172434+0000","last_clean":"2024-02-17T12:18:04.172434+0000","last_became_active":"2024-02-17T12:18:02.800551+0000","last_became_peered":"2024-02-17T12:18:02.800551+0000","last_unstale":"2024-02-17T12:18:04.172434+0000","last_undegraded":"2024-02-17T12:18:04.172434+0000","last_fullsized":"2024-02-17T12:18:04.172434+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:47:58.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173630+0000","last_change":"2024-02-17T12:18:01.796062+0000","last_active":"2024-02-17T12:18:04.173630+0000","last_peered":"2024-02-17T12:18:04.173630+0000","last_clean":"2024-02-17T12:18:04.173630+0000","last_became_active":"2024-02-17T12:18:01.795616+0000","last_became_peered":"2024-02-17T12:18:01.795616+0000","last_unstale":"2024-02-17T12:18:04.173630+0000","last_undegraded":"2024-02-17T12:18:04.173630+0000","last_fullsized":"2024-02-17T12:18:04.173630+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:04:59.908240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173053+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:18:04.173053+0000","last_peered":"2024-02-17T12:18:04.173053+0000","last_clean":"2024-02-17T12:18:04.173053+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:18:04.173053+0000","last_undegraded":"2024-02-17T12:18:04.173053+0000","last_fullsized":"2024-02-17T12:18:04.173053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":248149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.502}]},{"osd":1,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.63200000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78700000000000003}]},{"osd":4,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58599999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.91000000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.89100000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":248801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.67100000000000004}]},{"osd":1,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.624}]},{"osd":2,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.57099999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.73299999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60199999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.503},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.65200000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":248205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.499}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.44900000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.745}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.88600000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":248239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.1779999999999999,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.34000000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.6399999999999997,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.46899999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.2779999999999996,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":0.63700000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.624}]}]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1200128,"data_stored":840711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54200000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.75800000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.83699999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85999999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":832377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.58399999999999996}]},{"osd":2,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.77800000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.754}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.83599999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":243461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.755},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72299999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":585728,"data_stored":241905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.439},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48399999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:18:08.765 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-02-17T12:18:08.761+0000 7f1ca4a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:18:11.375 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:18:11.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48f5c00640 1 Processor -- start 2024-02-17T12:18:11.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48f5c00640 1 -- start start 2024-02-17T12:18:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48f5c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f48f0150300 0x7f48f0156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48f5c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f48f00714c0 0x7f48f00aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48f5c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f0157270 con 0x7f48f00aa6a0 2024-02-17T12:18:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48f5c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f00c6900 con 0x7f48f00714c0 2024-02-17T12:18:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48f5c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f00c3580 con 0x7f48f0150300 2024-02-17T12:18:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48ee000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f48f00714c0 0x7f48f00aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48ee000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f48f00714c0 0x7f48f00aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41774/0 (socket says 172.21.15.114:41774) 2024-02-17T12:18:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48ee000640 1 -- 172.21.15.114:0/2118851057 learned_addr learned my addr 172.21.15.114:0/2118851057 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48eea00640 1 --2- 172.21.15.114:0/2118851057 >> v2:172.21.15.116:3300/0 conn(0x7f48f0150300 0x7f48f0156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:11.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48ee000640 1 -- 172.21.15.114:0/2118851057 >> v2:172.21.15.116:3300/0 conn(0x7f48f0150300 msgr2=0x7f48f0156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:11.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48ee000640 1 --2- 172.21.15.114:0/2118851057 >> v2:172.21.15.116:3300/0 conn(0x7f48f0150300 0x7f48f0156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48ee000640 1 -- 172.21.15.114:0/2118851057 >> v1:172.21.15.114:6789/0 conn(0x7f48f00aa6a0 legacy=0x7f48f0152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:11.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.517+0000 7f48ee000640 1 -- 172.21.15.114:0/2118851057 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00c2fc0 con 0x7f48f00714c0 2024-02-17T12:18:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48ee000640 1 --2- 172.21.15.114:0/2118851057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 0x7f48f00aa160 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f48f006dfa0 tx=0x7f48d801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceab80910060c165 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48ed600640 1 -- 172.21.15.114:0/2118851057 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80ad680 con 0x7f48f00714c0 2024-02-17T12:18:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48ed600640 1 -- 172.21.15.114:0/2118851057 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d80ad7e0 con 0x7f48f00714c0 2024-02-17T12:18:11.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48ed600640 1 -- 172.21.15.114:0/2118851057 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80adb70 con 0x7f48f00714c0 2024-02-17T12:18:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48f5c00640 1 -- 172.21.15.114:0/2118851057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 msgr2=0x7f48f00aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48f5c00640 1 --2- 172.21.15.114:0/2118851057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 0x7f48f00aa160 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f48f006dfa0 tx=0x7f48d801c490 comp rx=0 tx=0).stop 2024-02-17T12:18:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48f5c00640 1 -- 172.21.15.114:0/2118851057 shutdown_connections 2024-02-17T12:18:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48f5c00640 1 --2- 172.21.15.114:0/2118851057 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 0x7f48f00aa160 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48f5c00640 1 --2- 172.21.15.114:0/2118851057 >> v2:172.21.15.116:3300/0 conn(0x7f48f0150300 0x7f48f0156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48f5c00640 1 -- 172.21.15.114:0/2118851057 >> 172.21.15.114:0/2118851057 conn(0x7f48f00c4f20 msgr2=0x7f48f00c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:11.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48f5c00640 1 -- 172.21.15.114:0/2118851057 shutdown_connections 2024-02-17T12:18:11.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.521+0000 7f48f5c00640 1 -- 172.21.15.114:0/2118851057 wait complete. 2024-02-17T12:18:11.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48f5c00640 1 Processor -- start 2024-02-17T12:18:11.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48f5c00640 1 -- start start 2024-02-17T12:18:11.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48f5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 0x7f48f014b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48f5c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48f00aa6a0 0x7f48f014ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48f5c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f48f0150300 0x7f48f0149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48f5c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0157090 con 0x7f48f00714c0 2024-02-17T12:18:11.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48f5c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0156920 con 0x7f48f00aa6a0 2024-02-17T12:18:11.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48f5c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00ae2c0 con 0x7f48f0150300 2024-02-17T12:18:11.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48eea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 0x7f48f014b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:11.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48eea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 0x7f48f014b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41786/0 (socket says 172.21.15.114:41786) 2024-02-17T12:18:11.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48eea00640 1 -- 172.21.15.114:0/2783381848 learned_addr learned my addr 172.21.15.114:0/2783381848 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48eea00640 1 -- 172.21.15.114:0/2783381848 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f48f0150300 msgr2=0x7f48f0149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48eea00640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f48f0150300 0x7f48f0149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48eea00640 1 -- 172.21.15.114:0/2783381848 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48f00aa6a0 msgr2=0x7f48f014ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48eea00640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48f00aa6a0 0x7f48f014ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48eea00640 1 -- 172.21.15.114:0/2783381848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d80094d0 con 0x7f48f00714c0 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48eea00640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 0x7f48f014b180 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f48e0007e40 tx=0x7f48e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48e6a00640 1 -- 172.21.15.114:0/2783381848 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0014620 con 0x7f48f00714c0 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48e6a00640 1 -- 172.21.15.114:0/2783381848 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e000ee90 con 0x7f48f00714c0 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48f5c00640 1 -- 172.21.15.114:0/2783381848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f01edd20 con 0x7f48f00714c0 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48e6a00640 1 -- 172.21.15.114:0/2783381848 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e00149a0 con 0x7f48f00714c0 2024-02-17T12:18:11.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.525+0000 7f48f5c00640 1 -- 172.21.15.114:0/2783381848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f0156b70 con 0x7f48f00714c0 2024-02-17T12:18:11.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.529+0000 7f48f5c00640 1 -- 172.21.15.114:0/2783381848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f0074840 con 0x7f48f00714c0 2024-02-17T12:18:11.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.529+0000 7f48e6a00640 1 -- 172.21.15.114:0/2783381848 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f48e0014b00 con 0x7f48f00714c0 2024-02-17T12:18:11.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.529+0000 7f48e6a00640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f48cc066e70 0x7f48cc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.529+0000 7f48e6a00640 1 -- 172.21.15.114:0/2783381848 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48e0085410 con 0x7f48f00714c0 2024-02-17T12:18:11.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.529+0000 7f48ee000640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f48cc066e70 0x7f48cc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:11.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.529+0000 7f48ee000640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f48cc066e70 0x7f48cc069330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f48d80af000 tx=0x7f48d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:11.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.533+0000 7f48e6a00640 1 -- 172.21.15.114:0/2783381848 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f48e0052160 con 0x7f48f00714c0 2024-02-17T12:18:11.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.685+0000 7f48f5c00640 1 -- 172.21.15.114:0/2783381848 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48f00706d0 con 0x7f48cc066e70 2024-02-17T12:18:11.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.689+0000 7f48e6a00640 1 -- 172.21.15.114:0/2783381848 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288933 (secure 0 0 0) 0x7f48f00706d0 con 0x7f48cc066e70 2024-02-17T12:18:11.697 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:11.699 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:18:11.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 -- 172.21.15.114:0/2783381848 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f48cc066e70 msgr2=0x7f48cc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:11.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f48cc066e70 0x7f48cc069330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f48d80af000 tx=0x7f48d8008040 comp rx=0 tx=0).stop 2024-02-17T12:18:11.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 -- 172.21.15.114:0/2783381848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 msgr2=0x7f48f014b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:11.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 0x7f48f014b180 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f48e0007e40 tx=0x7f48e000e4b0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 -- 172.21.15.114:0/2783381848 shutdown_connections 2024-02-17T12:18:11.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f48f0150300 0x7f48f0149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48f00aa6a0 0x7f48f014ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f48cc066e70 0x7f48cc069330 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 --2- 172.21.15.114:0/2783381848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f48f00714c0 0x7f48f014b180 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 -- 172.21.15.114:0/2783381848 >> 172.21.15.114:0/2783381848 conn(0x7f48f00c4f20 msgr2=0x7f48f00c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:11.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 -- 172.21.15.114:0/2783381848 shutdown_connections 2024-02-17T12:18:11.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.693+0000 7f48f5c00640 1 -- 172.21.15.114:0/2783381848 wait complete. 2024-02-17T12:18:11.718 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-02-17T12:18:11.238647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230360,"kb_used_data":5832,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744360,"statfs":{"total":773094113280,"available":772858224640,"internally_reserved":0,"allocated":5971968,"data_stored":3170748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.456160"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867789+0000","last_change":"2024-02-17T12:18:02.804326+0000","last_active":"2024-02-17T12:18:03.867789+0000","last_peered":"2024-02-17T12:18:03.867789+0000","last_clean":"2024-02-17T12:18:03.867789+0000","last_became_active":"2024-02-17T12:18:02.804074+0000","last_became_peered":"2024-02-17T12:18:02.804074+0000","last_unstale":"2024-02-17T12:18:03.867789+0000","last_undegraded":"2024-02-17T12:18:03.867789+0000","last_fullsized":"2024-02-17T12:18:03.867789+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:47.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173023+0000","last_change":"2024-02-17T12:18:02.808706+0000","last_active":"2024-02-17T12:18:04.173023+0000","last_peered":"2024-02-17T12:18:04.173023+0000","last_clean":"2024-02-17T12:18:04.173023+0000","last_became_active":"2024-02-17T12:18:02.808520+0000","last_became_peered":"2024-02-17T12:18:02.808520+0000","last_unstale":"2024-02-17T12:18:04.173023+0000","last_undegraded":"2024-02-17T12:18:04.173023+0000","last_fullsized":"2024-02-17T12:18:04.173023+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:27.642044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173302+0000","last_change":"2024-02-17T12:18:02.807196+0000","last_active":"2024-02-17T12:18:04.173302+0000","last_peered":"2024-02-17T12:18:04.173302+0000","last_clean":"2024-02-17T12:18:04.173302+0000","last_became_active":"2024-02-17T12:18:02.806894+0000","last_became_peered":"2024-02-17T12:18:02.806894+0000","last_unstale":"2024-02-17T12:18:04.173302+0000","last_undegraded":"2024-02-17T12:18:04.173302+0000","last_fullsized":"2024-02-17T12:18:04.173302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:12.749708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801692+0000","last_change":"2024-02-17T12:18:02.814770+0000","last_active":"2024-02-17T12:18:03.801692+0000","last_peered":"2024-02-17T12:18:03.801692+0000","last_clean":"2024-02-17T12:18:03.801692+0000","last_became_active":"2024-02-17T12:18:02.809466+0000","last_became_peered":"2024-02-17T12:18:02.809466+0000","last_unstale":"2024-02-17T12:18:03.801692+0000","last_undegraded":"2024-02-17T12:18:03.801692+0000","last_fullsized":"2024-02-17T12:18:03.801692+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867694+0000","last_change":"2024-02-17T12:18:02.802996+0000","last_active":"2024-02-17T12:18:03.867694+0000","last_peered":"2024-02-17T12:18:03.867694+0000","last_clean":"2024-02-17T12:18:03.867694+0000","last_became_active":"2024-02-17T12:18:02.802690+0000","last_became_peered":"2024-02-17T12:18:02.802690+0000","last_unstale":"2024-02-17T12:18:03.867694+0000","last_undegraded":"2024-02-17T12:18:03.867694+0000","last_fullsized":"2024-02-17T12:18:03.867694+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:59.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802123+0000","last_change":"2024-02-17T12:18:02.812986+0000","last_active":"2024-02-17T12:18:03.802123+0000","last_peered":"2024-02-17T12:18:03.802123+0000","last_clean":"2024-02-17T12:18:03.802123+0000","last_became_active":"2024-02-17T12:18:02.809576+0000","last_became_peered":"2024-02-17T12:18:02.809576+0000","last_unstale":"2024-02-17T12:18:03.802123+0000","last_undegraded":"2024-02-17T12:18:03.802123+0000","last_fullsized":"2024-02-17T12:18:03.802123+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802402+0000","last_change":"2024-02-17T12:18:02.799654+0000","last_active":"2024-02-17T12:18:03.802402+0000","last_peered":"2024-02-17T12:18:03.802402+0000","last_clean":"2024-02-17T12:18:03.802402+0000","last_became_active":"2024-02-17T12:18:02.799356+0000","last_became_peered":"2024-02-17T12:18:02.799356+0000","last_unstale":"2024-02-17T12:18:03.802402+0000","last_undegraded":"2024-02-17T12:18:03.802402+0000","last_fullsized":"2024-02-17T12:18:03.802402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:29.710017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172274+0000","last_change":"2024-02-17T12:18:02.800189+0000","last_active":"2024-02-17T12:18:04.172274+0000","last_peered":"2024-02-17T12:18:04.172274+0000","last_clean":"2024-02-17T12:18:04.172274+0000","last_became_active":"2024-02-17T12:18:02.799866+0000","last_became_peered":"2024-02-17T12:18:02.799866+0000","last_unstale":"2024-02-17T12:18:04.172274+0000","last_undegraded":"2024-02-17T12:18:04.172274+0000","last_fullsized":"2024-02-17T12:18:04.172274+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:52.152034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802908+0000","last_change":"2024-02-17T12:18:02.794591+0000","last_active":"2024-02-17T12:18:03.802908+0000","last_peered":"2024-02-17T12:18:03.802908+0000","last_clean":"2024-02-17T12:18:03.802908+0000","last_became_active":"2024-02-17T12:18:02.794309+0000","last_became_peered":"2024-02-17T12:18:02.794309+0000","last_unstale":"2024-02-17T12:18:03.802908+0000","last_undegraded":"2024-02-17T12:18:03.802908+0000","last_fullsized":"2024-02-17T12:18:03.802908+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:18.132994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172280+0000","last_change":"2024-02-17T12:18:02.802586+0000","last_active":"2024-02-17T12:18:04.172280+0000","last_peered":"2024-02-17T12:18:04.172280+0000","last_clean":"2024-02-17T12:18:04.172280+0000","last_became_active":"2024-02-17T12:18:02.802328+0000","last_became_peered":"2024-02-17T12:18:02.802328+0000","last_unstale":"2024-02-17T12:18:04.172280+0000","last_undegraded":"2024-02-17T12:18:04.172280+0000","last_fullsized":"2024-02-17T12:18:04.172280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:30.894335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172283+0000","last_change":"2024-02-17T12:18:02.803729+0000","last_active":"2024-02-17T12:18:04.172283+0000","last_peered":"2024-02-17T12:18:04.172283+0000","last_clean":"2024-02-17T12:18:04.172283+0000","last_became_active":"2024-02-17T12:18:02.803504+0000","last_became_peered":"2024-02-17T12:18:02.803504+0000","last_unstale":"2024-02-17T12:18:04.172283+0000","last_undegraded":"2024-02-17T12:18:04.172283+0000","last_fullsized":"2024-02-17T12:18:04.172283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:50.631061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801865+0000","last_change":"2024-02-17T12:18:02.814562+0000","last_active":"2024-02-17T12:18:03.801865+0000","last_peered":"2024-02-17T12:18:03.801865+0000","last_clean":"2024-02-17T12:18:03.801865+0000","last_became_active":"2024-02-17T12:18:02.809011+0000","last_became_peered":"2024-02-17T12:18:02.809011+0000","last_unstale":"2024-02-17T12:18:03.801865+0000","last_undegraded":"2024-02-17T12:18:03.801865+0000","last_fullsized":"2024-02-17T12:18:03.801865+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173551+0000","last_change":"2024-02-17T12:18:02.800228+0000","last_active":"2024-02-17T12:18:04.173551+0000","last_peered":"2024-02-17T12:18:04.173551+0000","last_clean":"2024-02-17T12:18:04.173551+0000","last_became_active":"2024-02-17T12:18:02.799965+0000","last_became_peered":"2024-02-17T12:18:02.799965+0000","last_unstale":"2024-02-17T12:18:04.173551+0000","last_undegraded":"2024-02-17T12:18:04.173551+0000","last_fullsized":"2024-02-17T12:18:04.173551+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:05.435817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802492+0000","last_change":"2024-02-17T12:18:02.798437+0000","last_active":"2024-02-17T12:18:03.802492+0000","last_peered":"2024-02-17T12:18:03.802492+0000","last_clean":"2024-02-17T12:18:03.802492+0000","last_became_active":"2024-02-17T12:18:02.798145+0000","last_became_peered":"2024-02-17T12:18:02.798145+0000","last_unstale":"2024-02-17T12:18:03.802492+0000","last_undegraded":"2024-02-17T12:18:03.802492+0000","last_fullsized":"2024-02-17T12:18:03.802492+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:29.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802419+0000","last_change":"2024-02-17T12:18:02.797013+0000","last_active":"2024-02-17T12:18:03.802419+0000","last_peered":"2024-02-17T12:18:03.802419+0000","last_clean":"2024-02-17T12:18:03.802419+0000","last_became_active":"2024-02-17T12:18:02.796734+0000","last_became_peered":"2024-02-17T12:18:02.796734+0000","last_unstale":"2024-02-17T12:18:03.802419+0000","last_undegraded":"2024-02-17T12:18:03.802419+0000","last_fullsized":"2024-02-17T12:18:03.802419+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:32.566741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802025+0000","last_change":"2024-02-17T12:18:02.809976+0000","last_active":"2024-02-17T12:18:03.802025+0000","last_peered":"2024-02-17T12:18:03.802025+0000","last_clean":"2024-02-17T12:18:03.802025+0000","last_became_active":"2024-02-17T12:18:02.809645+0000","last_became_peered":"2024-02-17T12:18:02.809645+0000","last_unstale":"2024-02-17T12:18:03.802025+0000","last_undegraded":"2024-02-17T12:18:03.802025+0000","last_fullsized":"2024-02-17T12:18:03.802025+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172807+0000","last_change":"2024-02-17T12:18:02.807700+0000","last_active":"2024-02-17T12:18:04.172807+0000","last_peered":"2024-02-17T12:18:04.172807+0000","last_clean":"2024-02-17T12:18:04.172807+0000","last_became_active":"2024-02-17T12:18:02.805575+0000","last_became_peered":"2024-02-17T12:18:02.805575+0000","last_unstale":"2024-02-17T12:18:04.172807+0000","last_undegraded":"2024-02-17T12:18:04.172807+0000","last_fullsized":"2024-02-17T12:18:04.172807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:52:33.882315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173764+0000","last_change":"2024-02-17T12:18:02.809074+0000","last_active":"2024-02-17T12:18:04.173764+0000","last_peered":"2024-02-17T12:18:04.173764+0000","last_clean":"2024-02-17T12:18:04.173764+0000","last_became_active":"2024-02-17T12:18:02.808683+0000","last_became_peered":"2024-02-17T12:18:02.808683+0000","last_unstale":"2024-02-17T12:18:04.173764+0000","last_undegraded":"2024-02-17T12:18:04.173764+0000","last_fullsized":"2024-02-17T12:18:04.173764+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:46:21.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867919+0000","last_change":"2024-02-17T12:18:02.803587+0000","last_active":"2024-02-17T12:18:03.867919+0000","last_peered":"2024-02-17T12:18:03.867919+0000","last_clean":"2024-02-17T12:18:03.867919+0000","last_became_active":"2024-02-17T12:18:02.803312+0000","last_became_peered":"2024-02-17T12:18:02.803312+0000","last_unstale":"2024-02-17T12:18:03.867919+0000","last_undegraded":"2024-02-17T12:18:03.867919+0000","last_fullsized":"2024-02-17T12:18:03.867919+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:54:01.696616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172628+0000","last_change":"2024-02-17T12:18:02.815782+0000","last_active":"2024-02-17T12:18:04.172628+0000","last_peered":"2024-02-17T12:18:04.172628+0000","last_clean":"2024-02-17T12:18:04.172628+0000","last_became_active":"2024-02-17T12:18:02.815537+0000","last_became_peered":"2024-02-17T12:18:02.815537+0000","last_unstale":"2024-02-17T12:18:04.172628+0000","last_undegraded":"2024-02-17T12:18:04.172628+0000","last_fullsized":"2024-02-17T12:18:04.172628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:23.114440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173161+0000","last_change":"2024-02-17T12:18:02.809894+0000","last_active":"2024-02-17T12:18:04.173161+0000","last_peered":"2024-02-17T12:18:04.173161+0000","last_clean":"2024-02-17T12:18:04.173161+0000","last_became_active":"2024-02-17T12:18:02.807451+0000","last_became_peered":"2024-02-17T12:18:02.807451+0000","last_unstale":"2024-02-17T12:18:04.173161+0000","last_undegraded":"2024-02-17T12:18:04.173161+0000","last_fullsized":"2024-02-17T12:18:04.173161+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:05:50.249065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172966+0000","last_change":"2024-02-17T12:18:02.813079+0000","last_active":"2024-02-17T12:18:04.172966+0000","last_peered":"2024-02-17T12:18:04.172966+0000","last_clean":"2024-02-17T12:18:04.172966+0000","last_became_active":"2024-02-17T12:18:02.810630+0000","last_became_peered":"2024-02-17T12:18:02.810630+0000","last_unstale":"2024-02-17T12:18:04.172966+0000","last_undegraded":"2024-02-17T12:18:04.172966+0000","last_fullsized":"2024-02-17T12:18:04.172966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:32:22.683974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173537+0000","last_change":"2024-02-17T12:18:02.807916+0000","last_active":"2024-02-17T12:18:04.173537+0000","last_peered":"2024-02-17T12:18:04.173537+0000","last_clean":"2024-02-17T12:18:04.173537+0000","last_became_active":"2024-02-17T12:18:02.806754+0000","last_became_peered":"2024-02-17T12:18:02.806754+0000","last_unstale":"2024-02-17T12:18:04.173537+0000","last_undegraded":"2024-02-17T12:18:04.173537+0000","last_fullsized":"2024-02-17T12:18:04.173537+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.985986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173008+0000","last_change":"2024-02-17T12:18:02.805691+0000","last_active":"2024-02-17T12:18:04.173008+0000","last_peered":"2024-02-17T12:18:04.173008+0000","last_clean":"2024-02-17T12:18:04.173008+0000","last_became_active":"2024-02-17T12:18:02.805396+0000","last_became_peered":"2024-02-17T12:18:02.805396+0000","last_unstale":"2024-02-17T12:18:04.173008+0000","last_undegraded":"2024-02-17T12:18:04.173008+0000","last_fullsized":"2024-02-17T12:18:04.173008+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:09:34.480729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867898+0000","last_change":"2024-02-17T12:18:02.798267+0000","last_active":"2024-02-17T12:18:03.867898+0000","last_peered":"2024-02-17T12:18:03.867898+0000","last_clean":"2024-02-17T12:18:03.867898+0000","last_became_active":"2024-02-17T12:18:02.797624+0000","last_became_peered":"2024-02-17T12:18:02.797624+0000","last_unstale":"2024-02-17T12:18:03.867898+0000","last_undegraded":"2024-02-17T12:18:03.867898+0000","last_fullsized":"2024-02-17T12:18:03.867898+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:17:06.691178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801849+0000","last_change":"2024-02-17T12:18:02.802532+0000","last_active":"2024-02-17T12:18:03.801849+0000","last_peered":"2024-02-17T12:18:03.801849+0000","last_clean":"2024-02-17T12:18:03.801849+0000","last_became_active":"2024-02-17T12:18:02.801766+0000","last_became_peered":"2024-02-17T12:18:02.801766+0000","last_unstale":"2024-02-17T12:18:03.801849+0000","last_undegraded":"2024-02-17T12:18:03.801849+0000","last_fullsized":"2024-02-17T12:18:03.801849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802488+0000","last_change":"2024-02-17T12:18:02.797999+0000","last_active":"2024-02-17T12:18:03.802488+0000","last_peered":"2024-02-17T12:18:03.802488+0000","last_clean":"2024-02-17T12:18:03.802488+0000","last_became_active":"2024-02-17T12:18:02.797710+0000","last_became_peered":"2024-02-17T12:18:02.797710+0000","last_unstale":"2024-02-17T12:18:03.802488+0000","last_undegraded":"2024-02-17T12:18:03.802488+0000","last_fullsized":"2024-02-17T12:18:03.802488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867831+0000","last_change":"2024-02-17T12:18:02.804711+0000","last_active":"2024-02-17T12:18:03.867831+0000","last_peered":"2024-02-17T12:18:03.867831+0000","last_clean":"2024-02-17T12:18:03.867831+0000","last_became_active":"2024-02-17T12:18:02.804459+0000","last_became_peered":"2024-02-17T12:18:02.804459+0000","last_unstale":"2024-02-17T12:18:03.867831+0000","last_undegraded":"2024-02-17T12:18:03.867831+0000","last_fullsized":"2024-02-17T12:18:03.867831+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:47.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172754+0000","last_change":"2024-02-17T12:18:02.802524+0000","last_active":"2024-02-17T12:18:04.172754+0000","last_peered":"2024-02-17T12:18:04.172754+0000","last_clean":"2024-02-17T12:18:04.172754+0000","last_became_active":"2024-02-17T12:18:02.802045+0000","last_became_peered":"2024-02-17T12:18:02.802045+0000","last_unstale":"2024-02-17T12:18:04.172754+0000","last_undegraded":"2024-02-17T12:18:04.172754+0000","last_fullsized":"2024-02-17T12:18:04.172754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:06:03.414827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173099+0000","last_change":"2024-02-17T12:18:02.807169+0000","last_active":"2024-02-17T12:18:04.173099+0000","last_peered":"2024-02-17T12:18:04.173099+0000","last_clean":"2024-02-17T12:18:04.173099+0000","last_became_active":"2024-02-17T12:18:02.806918+0000","last_became_peered":"2024-02-17T12:18:02.806918+0000","last_unstale":"2024-02-17T12:18:04.173099+0000","last_undegraded":"2024-02-17T12:18:04.173099+0000","last_fullsized":"2024-02-17T12:18:04.173099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:17.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.867681+0000","last_change":"2024-02-17T12:18:02.795014+0000","last_active":"2024-02-17T12:18:03.867681+0000","last_peered":"2024-02-17T12:18:03.867681+0000","last_clean":"2024-02-17T12:18:03.867681+0000","last_became_active":"2024-02-17T12:18:02.794759+0000","last_became_peered":"2024-02-17T12:18:02.794759+0000","last_unstale":"2024-02-17T12:18:03.867681+0000","last_undegraded":"2024-02-17T12:18:03.867681+0000","last_fullsized":"2024-02-17T12:18:03.867681+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:21.971723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802084+0000","last_change":"2024-02-17T12:18:02.801322+0000","last_active":"2024-02-17T12:18:03.802084+0000","last_peered":"2024-02-17T12:18:03.802084+0000","last_clean":"2024-02-17T12:18:03.802084+0000","last_became_active":"2024-02-17T12:18:02.801073+0000","last_became_peered":"2024-02-17T12:18:02.801073+0000","last_unstale":"2024-02-17T12:18:03.802084+0000","last_undegraded":"2024-02-17T12:18:03.802084+0000","last_fullsized":"2024-02-17T12:18:03.802084+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802729+0000","last_change":"2024-02-17T12:18:02.811882+0000","last_active":"2024-02-17T12:18:03.802729+0000","last_peered":"2024-02-17T12:18:03.802729+0000","last_clean":"2024-02-17T12:18:03.802729+0000","last_became_active":"2024-02-17T12:18:02.811448+0000","last_became_peered":"2024-02-17T12:18:02.811448+0000","last_unstale":"2024-02-17T12:18:03.802729+0000","last_undegraded":"2024-02-17T12:18:03.802729+0000","last_fullsized":"2024-02-17T12:18:03.802729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:46.432214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.803068+0000","last_change":"2024-02-17T12:18:01.796858+0000","last_active":"2024-02-17T12:18:03.803068+0000","last_peered":"2024-02-17T12:18:03.803068+0000","last_clean":"2024-02-17T12:18:03.803068+0000","last_became_active":"2024-02-17T12:18:01.796498+0000","last_became_peered":"2024-02-17T12:18:01.796498+0000","last_unstale":"2024-02-17T12:18:03.803068+0000","last_undegraded":"2024-02-17T12:18:03.803068+0000","last_fullsized":"2024-02-17T12:18:03.803068+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172457+0000","last_change":"2024-02-17T12:18:02.808663+0000","last_active":"2024-02-17T12:18:04.172457+0000","last_peered":"2024-02-17T12:18:04.172457+0000","last_clean":"2024-02-17T12:18:04.172457+0000","last_became_active":"2024-02-17T12:18:02.808402+0000","last_became_peered":"2024-02-17T12:18:02.808402+0000","last_unstale":"2024-02-17T12:18:04.172457+0000","last_undegraded":"2024-02-17T12:18:04.172457+0000","last_fullsized":"2024-02-17T12:18:04.172457+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:00.777830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172810+0000","last_change":"2024-02-17T12:18:01.790619+0000","last_active":"2024-02-17T12:18:04.172810+0000","last_peered":"2024-02-17T12:18:04.172810+0000","last_clean":"2024-02-17T12:18:04.172810+0000","last_became_active":"2024-02-17T12:18:01.790344+0000","last_became_peered":"2024-02-17T12:18:01.790344+0000","last_unstale":"2024-02-17T12:18:04.172810+0000","last_undegraded":"2024-02-17T12:18:04.172810+0000","last_fullsized":"2024-02-17T12:18:04.172810+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:45.425754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802701+0000","last_change":"2024-02-17T12:18:02.804685+0000","last_active":"2024-02-17T12:18:03.802701+0000","last_peered":"2024-02-17T12:18:03.802701+0000","last_clean":"2024-02-17T12:18:03.802701+0000","last_became_active":"2024-02-17T12:18:02.803980+0000","last_became_peered":"2024-02-17T12:18:02.803980+0000","last_unstale":"2024-02-17T12:18:03.802701+0000","last_undegraded":"2024-02-17T12:18:03.802701+0000","last_fullsized":"2024-02-17T12:18:03.802701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:32.327387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802681+0000","last_change":"2024-02-17T12:18:01.801344+0000","last_active":"2024-02-17T12:18:03.802681+0000","last_peered":"2024-02-17T12:18:03.802681+0000","last_clean":"2024-02-17T12:18:03.802681+0000","last_became_active":"2024-02-17T12:18:01.801092+0000","last_became_peered":"2024-02-17T12:18:01.801092+0000","last_unstale":"2024-02-17T12:18:03.802681+0000","last_undegraded":"2024-02-17T12:18:03.802681+0000","last_fullsized":"2024-02-17T12:18:03.802681+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802550+0000","last_change":"2024-02-17T12:18:02.806603+0000","last_active":"2024-02-17T12:18:03.802550+0000","last_peered":"2024-02-17T12:18:03.802550+0000","last_clean":"2024-02-17T12:18:03.802550+0000","last_became_active":"2024-02-17T12:18:02.806021+0000","last_became_peered":"2024-02-17T12:18:02.806021+0000","last_unstale":"2024-02-17T12:18:03.802550+0000","last_undegraded":"2024-02-17T12:18:03.802550+0000","last_fullsized":"2024-02-17T12:18:03.802550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:57.248220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801990+0000","last_change":"2024-02-17T12:18:01.790249+0000","last_active":"2024-02-17T12:18:03.801990+0000","last_peered":"2024-02-17T12:18:03.801990+0000","last_clean":"2024-02-17T12:18:03.801990+0000","last_became_active":"2024-02-17T12:18:01.789970+0000","last_became_peered":"2024-02-17T12:18:01.789970+0000","last_unstale":"2024-02-17T12:18:03.801990+0000","last_undegraded":"2024-02-17T12:18:03.801990+0000","last_fullsized":"2024-02-17T12:18:03.801990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173114+0000","last_change":"2024-02-17T12:18:02.811065+0000","last_active":"2024-02-17T12:18:04.173114+0000","last_peered":"2024-02-17T12:18:04.173114+0000","last_clean":"2024-02-17T12:18:04.173114+0000","last_became_active":"2024-02-17T12:18:02.810598+0000","last_became_peered":"2024-02-17T12:18:02.810598+0000","last_unstale":"2024-02-17T12:18:04.173114+0000","last_undegraded":"2024-02-17T12:18:04.173114+0000","last_fullsized":"2024-02-17T12:18:04.173114+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:11:46.553742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802683+0000","last_change":"2024-02-17T12:18:01.798801+0000","last_active":"2024-02-17T12:18:03.802683+0000","last_peered":"2024-02-17T12:18:03.802683+0000","last_clean":"2024-02-17T12:18:03.802683+0000","last_became_active":"2024-02-17T12:18:01.798516+0000","last_became_peered":"2024-02-17T12:18:01.798516+0000","last_unstale":"2024-02-17T12:18:03.802683+0000","last_undegraded":"2024-02-17T12:18:03.802683+0000","last_fullsized":"2024-02-17T12:18:03.802683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:04:53.798642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173209+0000","last_change":"2024-02-17T12:18:02.802301+0000","last_active":"2024-02-17T12:18:04.173209+0000","last_peered":"2024-02-17T12:18:04.173209+0000","last_clean":"2024-02-17T12:18:04.173209+0000","last_became_active":"2024-02-17T12:18:02.801632+0000","last_became_peered":"2024-02-17T12:18:02.801632+0000","last_unstale":"2024-02-17T12:18:04.173209+0000","last_undegraded":"2024-02-17T12:18:04.173209+0000","last_fullsized":"2024-02-17T12:18:04.173209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:34:13.159578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802099+0000","last_change":"2024-02-17T12:18:01.800510+0000","last_active":"2024-02-17T12:18:03.802099+0000","last_peered":"2024-02-17T12:18:03.802099+0000","last_clean":"2024-02-17T12:18:03.802099+0000","last_became_active":"2024-02-17T12:18:01.799483+0000","last_became_peered":"2024-02-17T12:18:01.799483+0000","last_unstale":"2024-02-17T12:18:03.802099+0000","last_undegraded":"2024-02-17T12:18:03.802099+0000","last_fullsized":"2024-02-17T12:18:03.802099+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173162+0000","last_change":"2024-02-17T12:18:02.811246+0000","last_active":"2024-02-17T12:18:04.173162+0000","last_peered":"2024-02-17T12:18:04.173162+0000","last_clean":"2024-02-17T12:18:04.173162+0000","last_became_active":"2024-02-17T12:18:02.810989+0000","last_became_peered":"2024-02-17T12:18:02.810989+0000","last_unstale":"2024-02-17T12:18:04.173162+0000","last_undegraded":"2024-02-17T12:18:04.173162+0000","last_fullsized":"2024-02-17T12:18:04.173162+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:56:31.198120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801161+0000","last_change":"2024-02-17T12:18:01.798316+0000","last_active":"2024-02-17T12:18:03.801161+0000","last_peered":"2024-02-17T12:18:03.801161+0000","last_clean":"2024-02-17T12:18:03.801161+0000","last_became_active":"2024-02-17T12:18:01.797041+0000","last_became_peered":"2024-02-17T12:18:01.797041+0000","last_unstale":"2024-02-17T12:18:03.801161+0000","last_undegraded":"2024-02-17T12:18:03.801161+0000","last_fullsized":"2024-02-17T12:18:03.801161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172480+0000","last_change":"2024-02-17T12:18:02.801971+0000","last_active":"2024-02-17T12:18:04.172480+0000","last_peered":"2024-02-17T12:18:04.172480+0000","last_clean":"2024-02-17T12:18:04.172480+0000","last_became_active":"2024-02-17T12:18:02.801727+0000","last_became_peered":"2024-02-17T12:18:02.801727+0000","last_unstale":"2024-02-17T12:18:04.172480+0000","last_undegraded":"2024-02-17T12:18:04.172480+0000","last_fullsized":"2024-02-17T12:18:04.172480+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:06:15.526935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802379+0000","last_change":"2024-02-17T12:18:01.800493+0000","last_active":"2024-02-17T12:18:03.802379+0000","last_peered":"2024-02-17T12:18:03.802379+0000","last_clean":"2024-02-17T12:18:03.802379+0000","last_became_active":"2024-02-17T12:18:01.800206+0000","last_became_peered":"2024-02-17T12:18:01.800206+0000","last_unstale":"2024-02-17T12:18:03.802379+0000","last_undegraded":"2024-02-17T12:18:03.802379+0000","last_fullsized":"2024-02-17T12:18:03.802379+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:33.603620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802978+0000","last_change":"2024-02-17T12:18:02.797952+0000","last_active":"2024-02-17T12:18:03.802978+0000","last_peered":"2024-02-17T12:18:03.802978+0000","last_clean":"2024-02-17T12:18:03.802978+0000","last_became_active":"2024-02-17T12:18:02.797675+0000","last_became_peered":"2024-02-17T12:18:02.797675+0000","last_unstale":"2024-02-17T12:18:03.802978+0000","last_undegraded":"2024-02-17T12:18:03.802978+0000","last_fullsized":"2024-02-17T12:18:03.802978+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:01.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173763+0000","last_change":"2024-02-17T12:18:01.801850+0000","last_active":"2024-02-17T12:18:04.173763+0000","last_peered":"2024-02-17T12:18:04.173763+0000","last_clean":"2024-02-17T12:18:04.173763+0000","last_became_active":"2024-02-17T12:18:01.801516+0000","last_became_peered":"2024-02-17T12:18:01.801516+0000","last_unstale":"2024-02-17T12:18:04.173763+0000","last_undegraded":"2024-02-17T12:18:04.173763+0000","last_fullsized":"2024-02-17T12:18:04.173763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:28.630666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173640+0000","last_change":"2024-02-17T12:18:02.813957+0000","last_active":"2024-02-17T12:18:04.173640+0000","last_peered":"2024-02-17T12:18:04.173640+0000","last_clean":"2024-02-17T12:18:04.173640+0000","last_became_active":"2024-02-17T12:18:02.813647+0000","last_became_peered":"2024-02-17T12:18:02.813647+0000","last_unstale":"2024-02-17T12:18:04.173640+0000","last_undegraded":"2024-02-17T12:18:04.173640+0000","last_fullsized":"2024-02-17T12:18:04.173640+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:41.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172902+0000","last_change":"2024-02-17T12:18:01.799508+0000","last_active":"2024-02-17T12:18:04.172902+0000","last_peered":"2024-02-17T12:18:04.172902+0000","last_clean":"2024-02-17T12:18:04.172902+0000","last_became_active":"2024-02-17T12:18:01.798598+0000","last_became_peered":"2024-02-17T12:18:01.798598+0000","last_unstale":"2024-02-17T12:18:04.172902+0000","last_undegraded":"2024-02-17T12:18:04.172902+0000","last_fullsized":"2024-02-17T12:18:04.172902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:45.103353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171977+0000","last_change":"2024-02-17T12:18:02.787850+0000","last_active":"2024-02-17T12:18:04.171977+0000","last_peered":"2024-02-17T12:18:04.171977+0000","last_clean":"2024-02-17T12:18:04.171977+0000","last_became_active":"2024-02-17T12:18:02.787578+0000","last_became_peered":"2024-02-17T12:18:02.787578+0000","last_unstale":"2024-02-17T12:18:04.171977+0000","last_undegraded":"2024-02-17T12:18:04.171977+0000","last_fullsized":"2024-02-17T12:18:04.171977+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:29.854264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173815+0000","last_change":"2024-02-17T12:18:01.805403+0000","last_active":"2024-02-17T12:18:04.173815+0000","last_peered":"2024-02-17T12:18:04.173815+0000","last_clean":"2024-02-17T12:18:04.173815+0000","last_became_active":"2024-02-17T12:18:01.805059+0000","last_became_peered":"2024-02-17T12:18:01.805059+0000","last_unstale":"2024-02-17T12:18:04.173815+0000","last_undegraded":"2024-02-17T12:18:04.173815+0000","last_fullsized":"2024-02-17T12:18:04.173815+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:14.495937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173478+0000","last_change":"2024-02-17T12:18:02.810198+0000","last_active":"2024-02-17T12:18:04.173478+0000","last_peered":"2024-02-17T12:18:04.173478+0000","last_clean":"2024-02-17T12:18:04.173478+0000","last_became_active":"2024-02-17T12:18:02.809131+0000","last_became_peered":"2024-02-17T12:18:02.809131+0000","last_unstale":"2024-02-17T12:18:04.173478+0000","last_undegraded":"2024-02-17T12:18:04.173478+0000","last_fullsized":"2024-02-17T12:18:04.173478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:01:23.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802836+0000","last_change":"2024-02-17T12:18:01.802710+0000","last_active":"2024-02-17T12:18:03.802836+0000","last_peered":"2024-02-17T12:18:03.802836+0000","last_clean":"2024-02-17T12:18:03.802836+0000","last_became_active":"2024-02-17T12:18:01.802365+0000","last_became_peered":"2024-02-17T12:18:01.802365+0000","last_unstale":"2024-02-17T12:18:03.802836+0000","last_undegraded":"2024-02-17T12:18:03.802836+0000","last_fullsized":"2024-02-17T12:18:03.802836+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:45.771679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801283+0000","last_change":"2024-02-17T12:18:02.809855+0000","last_active":"2024-02-17T12:18:03.801283+0000","last_peered":"2024-02-17T12:18:03.801283+0000","last_clean":"2024-02-17T12:18:03.801283+0000","last_became_active":"2024-02-17T12:18:02.809577+0000","last_became_peered":"2024-02-17T12:18:02.809577+0000","last_unstale":"2024-02-17T12:18:03.801283+0000","last_undegraded":"2024-02-17T12:18:03.801283+0000","last_fullsized":"2024-02-17T12:18:03.801283+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:17:49.657379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172597+0000","last_change":"2024-02-17T12:18:01.792615+0000","last_active":"2024-02-17T12:18:04.172597+0000","last_peered":"2024-02-17T12:18:04.172597+0000","last_clean":"2024-02-17T12:18:04.172597+0000","last_became_active":"2024-02-17T12:18:01.792287+0000","last_became_peered":"2024-02-17T12:18:01.792287+0000","last_unstale":"2024-02-17T12:18:04.172597+0000","last_undegraded":"2024-02-17T12:18:04.172597+0000","last_fullsized":"2024-02-17T12:18:04.172597+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:56.241760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173374+0000","last_change":"2024-02-17T12:18:02.808057+0000","last_active":"2024-02-17T12:18:04.173374+0000","last_peered":"2024-02-17T12:18:04.173374+0000","last_clean":"2024-02-17T12:18:04.173374+0000","last_became_active":"2024-02-17T12:18:02.807629+0000","last_became_peered":"2024-02-17T12:18:02.807629+0000","last_unstale":"2024-02-17T12:18:04.173374+0000","last_undegraded":"2024-02-17T12:18:04.173374+0000","last_fullsized":"2024-02-17T12:18:04.173374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:58:48.506743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173899+0000","last_change":"2024-02-17T12:18:01.797715+0000","last_active":"2024-02-17T12:18:04.173899+0000","last_peered":"2024-02-17T12:18:04.173899+0000","last_clean":"2024-02-17T12:18:04.173899+0000","last_became_active":"2024-02-17T12:18:01.797435+0000","last_became_peered":"2024-02-17T12:18:01.797435+0000","last_unstale":"2024-02-17T12:18:04.173899+0000","last_undegraded":"2024-02-17T12:18:04.173899+0000","last_fullsized":"2024-02-17T12:18:04.173899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:49.624601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802474+0000","last_change":"2024-02-17T12:18:02.810137+0000","last_active":"2024-02-17T12:18:03.802474+0000","last_peered":"2024-02-17T12:18:03.802474+0000","last_clean":"2024-02-17T12:18:03.802474+0000","last_became_active":"2024-02-17T12:18:02.809877+0000","last_became_peered":"2024-02-17T12:18:02.809877+0000","last_unstale":"2024-02-17T12:18:03.802474+0000","last_undegraded":"2024-02-17T12:18:03.802474+0000","last_fullsized":"2024-02-17T12:18:03.802474+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:15.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801165+0000","last_change":"2024-02-17T12:18:01.790794+0000","last_active":"2024-02-17T12:18:03.801165+0000","last_peered":"2024-02-17T12:18:03.801165+0000","last_clean":"2024-02-17T12:18:03.801165+0000","last_became_active":"2024-02-17T12:18:01.790500+0000","last_became_peered":"2024-02-17T12:18:01.790500+0000","last_unstale":"2024-02-17T12:18:03.801165+0000","last_undegraded":"2024-02-17T12:18:03.801165+0000","last_fullsized":"2024-02-17T12:18:03.801165+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173954+0000","last_change":"2024-02-17T12:18:02.808594+0000","last_active":"2024-02-17T12:18:04.173954+0000","last_peered":"2024-02-17T12:18:04.173954+0000","last_clean":"2024-02-17T12:18:04.173954+0000","last_became_active":"2024-02-17T12:18:02.808035+0000","last_became_peered":"2024-02-17T12:18:02.808035+0000","last_unstale":"2024-02-17T12:18:04.173954+0000","last_undegraded":"2024-02-17T12:18:04.173954+0000","last_fullsized":"2024-02-17T12:18:04.173954+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:58.050395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173264+0000","last_change":"2024-02-17T12:18:01.789017+0000","last_active":"2024-02-17T12:18:04.173264+0000","last_peered":"2024-02-17T12:18:04.173264+0000","last_clean":"2024-02-17T12:18:04.173264+0000","last_became_active":"2024-02-17T12:18:01.788529+0000","last_became_peered":"2024-02-17T12:18:01.788529+0000","last_unstale":"2024-02-17T12:18:04.173264+0000","last_undegraded":"2024-02-17T12:18:04.173264+0000","last_fullsized":"2024-02-17T12:18:04.173264+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:31.560281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.174014+0000","last_change":"2024-02-17T12:18:02.808518+0000","last_active":"2024-02-17T12:18:04.174014+0000","last_peered":"2024-02-17T12:18:04.174014+0000","last_clean":"2024-02-17T12:18:04.174014+0000","last_became_active":"2024-02-17T12:18:02.808255+0000","last_became_peered":"2024-02-17T12:18:02.808255+0000","last_unstale":"2024-02-17T12:18:04.174014+0000","last_undegraded":"2024-02-17T12:18:04.174014+0000","last_fullsized":"2024-02-17T12:18:04.174014+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:58:40.908163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172893+0000","last_change":"2024-02-17T12:18:01.802794+0000","last_active":"2024-02-17T12:18:04.172893+0000","last_peered":"2024-02-17T12:18:04.172893+0000","last_clean":"2024-02-17T12:18:04.172893+0000","last_became_active":"2024-02-17T12:18:01.802366+0000","last_became_peered":"2024-02-17T12:18:01.802366+0000","last_unstale":"2024-02-17T12:18:04.172893+0000","last_undegraded":"2024-02-17T12:18:04.172893+0000","last_fullsized":"2024-02-17T12:18:04.172893+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:45:00.445775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801994+0000","last_change":"2024-02-17T12:18:02.810942+0000","last_active":"2024-02-17T12:18:03.801994+0000","last_peered":"2024-02-17T12:18:03.801994+0000","last_clean":"2024-02-17T12:18:03.801994+0000","last_became_active":"2024-02-17T12:18:02.810651+0000","last_became_peered":"2024-02-17T12:18:02.810651+0000","last_unstale":"2024-02-17T12:18:03.801994+0000","last_undegraded":"2024-02-17T12:18:03.801994+0000","last_fullsized":"2024-02-17T12:18:03.801994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802822+0000","last_change":"2024-02-17T12:18:01.797601+0000","last_active":"2024-02-17T12:18:03.802822+0000","last_peered":"2024-02-17T12:18:03.802822+0000","last_clean":"2024-02-17T12:18:03.802822+0000","last_became_active":"2024-02-17T12:18:01.796341+0000","last_became_peered":"2024-02-17T12:18:01.796341+0000","last_unstale":"2024-02-17T12:18:03.802822+0000","last_undegraded":"2024-02-17T12:18:03.802822+0000","last_fullsized":"2024-02-17T12:18:03.802822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172807+0000","last_change":"2024-02-17T12:18:02.803894+0000","last_active":"2024-02-17T12:18:04.172807+0000","last_peered":"2024-02-17T12:18:04.172807+0000","last_clean":"2024-02-17T12:18:04.172807+0000","last_became_active":"2024-02-17T12:18:02.803553+0000","last_became_peered":"2024-02-17T12:18:02.803553+0000","last_unstale":"2024-02-17T12:18:04.172807+0000","last_undegraded":"2024-02-17T12:18:04.172807+0000","last_fullsized":"2024-02-17T12:18:04.172807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:35:24.727572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801624+0000","last_change":"2024-02-17T12:18:01.789546+0000","last_active":"2024-02-17T12:18:03.801624+0000","last_peered":"2024-02-17T12:18:03.801624+0000","last_clean":"2024-02-17T12:18:03.801624+0000","last_became_active":"2024-02-17T12:18:01.789258+0000","last_became_peered":"2024-02-17T12:18:01.789258+0000","last_unstale":"2024-02-17T12:18:03.801624+0000","last_undegraded":"2024-02-17T12:18:03.801624+0000","last_fullsized":"2024-02-17T12:18:03.801624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173707+0000","last_change":"2024-02-17T12:18:02.811327+0000","last_active":"2024-02-17T12:18:04.173707+0000","last_peered":"2024-02-17T12:18:04.173707+0000","last_clean":"2024-02-17T12:18:04.173707+0000","last_became_active":"2024-02-17T12:18:02.809620+0000","last_became_peered":"2024-02-17T12:18:02.809620+0000","last_unstale":"2024-02-17T12:18:04.173707+0000","last_undegraded":"2024-02-17T12:18:04.173707+0000","last_fullsized":"2024-02-17T12:18:04.173707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:40:08.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802594+0000","last_change":"2024-02-17T12:18:01.798265+0000","last_active":"2024-02-17T12:18:03.802594+0000","last_peered":"2024-02-17T12:18:03.802594+0000","last_clean":"2024-02-17T12:18:03.802594+0000","last_became_active":"2024-02-17T12:18:01.797931+0000","last_became_peered":"2024-02-17T12:18:01.797931+0000","last_unstale":"2024-02-17T12:18:03.802594+0000","last_undegraded":"2024-02-17T12:18:03.802594+0000","last_fullsized":"2024-02-17T12:18:03.802594+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801311+0000","last_change":"2024-02-17T12:18:02.800381+0000","last_active":"2024-02-17T12:18:03.801311+0000","last_peered":"2024-02-17T12:18:03.801311+0000","last_clean":"2024-02-17T12:18:03.801311+0000","last_became_active":"2024-02-17T12:18:02.800042+0000","last_became_peered":"2024-02-17T12:18:02.800042+0000","last_unstale":"2024-02-17T12:18:03.801311+0000","last_undegraded":"2024-02-17T12:18:03.801311+0000","last_fullsized":"2024-02-17T12:18:03.801311+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:27.558546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172826+0000","last_change":"2024-02-17T12:18:01.795914+0000","last_active":"2024-02-17T12:18:04.172826+0000","last_peered":"2024-02-17T12:18:04.172826+0000","last_clean":"2024-02-17T12:18:04.172826+0000","last_became_active":"2024-02-17T12:18:01.794847+0000","last_became_peered":"2024-02-17T12:18:01.794847+0000","last_unstale":"2024-02-17T12:18:04.172826+0000","last_undegraded":"2024-02-17T12:18:04.172826+0000","last_fullsized":"2024-02-17T12:18:04.172826+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:31.320927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802473+0000","last_change":"2024-02-17T12:18:02.807547+0000","last_active":"2024-02-17T12:18:03.802473+0000","last_peered":"2024-02-17T12:18:03.802473+0000","last_clean":"2024-02-17T12:18:03.802473+0000","last_became_active":"2024-02-17T12:18:02.807209+0000","last_became_peered":"2024-02-17T12:18:02.807209+0000","last_unstale":"2024-02-17T12:18:03.802473+0000","last_undegraded":"2024-02-17T12:18:03.802473+0000","last_fullsized":"2024-02-17T12:18:03.802473+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171947+0000","last_change":"2024-02-17T12:18:01.803848+0000","last_active":"2024-02-17T12:18:04.171947+0000","last_peered":"2024-02-17T12:18:04.171947+0000","last_clean":"2024-02-17T12:18:04.171947+0000","last_became_active":"2024-02-17T12:18:01.803552+0000","last_became_peered":"2024-02-17T12:18:01.803552+0000","last_unstale":"2024-02-17T12:18:04.171947+0000","last_undegraded":"2024-02-17T12:18:04.171947+0000","last_fullsized":"2024-02-17T12:18:04.171947+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:25:02.826927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802107+0000","last_change":"2024-02-17T12:18:02.811800+0000","last_active":"2024-02-17T12:18:03.802107+0000","last_peered":"2024-02-17T12:18:03.802107+0000","last_clean":"2024-02-17T12:18:03.802107+0000","last_became_active":"2024-02-17T12:18:02.811504+0000","last_became_peered":"2024-02-17T12:18:02.811504+0000","last_unstale":"2024-02-17T12:18:03.802107+0000","last_undegraded":"2024-02-17T12:18:03.802107+0000","last_fullsized":"2024-02-17T12:18:03.802107+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801149+0000","last_change":"2024-02-17T12:18:01.800860+0000","last_active":"2024-02-17T12:18:03.801149+0000","last_peered":"2024-02-17T12:18:03.801149+0000","last_clean":"2024-02-17T12:18:03.801149+0000","last_became_active":"2024-02-17T12:18:01.800569+0000","last_became_peered":"2024-02-17T12:18:01.800569+0000","last_unstale":"2024-02-17T12:18:03.801149+0000","last_undegraded":"2024-02-17T12:18:03.801149+0000","last_fullsized":"2024-02-17T12:18:03.801149+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801841+0000","last_change":"2024-02-17T12:18:02.812763+0000","last_active":"2024-02-17T12:18:03.801841+0000","last_peered":"2024-02-17T12:18:03.801841+0000","last_clean":"2024-02-17T12:18:03.801841+0000","last_became_active":"2024-02-17T12:18:02.812512+0000","last_became_peered":"2024-02-17T12:18:02.812512+0000","last_unstale":"2024-02-17T12:18:03.801841+0000","last_undegraded":"2024-02-17T12:18:03.801841+0000","last_fullsized":"2024-02-17T12:18:03.801841+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172534+0000","last_change":"2024-02-17T12:18:01.805847+0000","last_active":"2024-02-17T12:18:04.172534+0000","last_peered":"2024-02-17T12:18:04.172534+0000","last_clean":"2024-02-17T12:18:04.172534+0000","last_became_active":"2024-02-17T12:18:01.805591+0000","last_became_peered":"2024-02-17T12:18:01.805591+0000","last_unstale":"2024-02-17T12:18:04.172534+0000","last_undegraded":"2024-02-17T12:18:04.172534+0000","last_fullsized":"2024-02-17T12:18:04.172534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:52:05.403651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801873+0000","last_change":"2024-02-17T12:18:02.809740+0000","last_active":"2024-02-17T12:18:03.801873+0000","last_peered":"2024-02-17T12:18:03.801873+0000","last_clean":"2024-02-17T12:18:03.801873+0000","last_became_active":"2024-02-17T12:18:02.809407+0000","last_became_peered":"2024-02-17T12:18:02.809407+0000","last_unstale":"2024-02-17T12:18:03.801873+0000","last_undegraded":"2024-02-17T12:18:03.801873+0000","last_fullsized":"2024-02-17T12:18:03.801873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.789123+0000","last_change":"2024-02-17T12:18:01.794714+0000","last_active":"2024-02-17T12:18:04.789123+0000","last_peered":"2024-02-17T12:18:04.789123+0000","last_clean":"2024-02-17T12:18:04.789123+0000","last_became_active":"2024-02-17T12:18:01.794439+0000","last_became_peered":"2024-02-17T12:18:01.794439+0000","last_unstale":"2024-02-17T12:18:04.789123+0000","last_undegraded":"2024-02-17T12:18:04.789123+0000","last_fullsized":"2024-02-17T12:18:04.789123+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172069+0000","last_change":"2024-02-17T12:18:02.794702+0000","last_active":"2024-02-17T12:18:04.172069+0000","last_peered":"2024-02-17T12:18:04.172069+0000","last_clean":"2024-02-17T12:18:04.172069+0000","last_became_active":"2024-02-17T12:18:02.794412+0000","last_became_peered":"2024-02-17T12:18:02.794412+0000","last_unstale":"2024-02-17T12:18:04.172069+0000","last_undegraded":"2024-02-17T12:18:04.172069+0000","last_fullsized":"2024-02-17T12:18:04.172069+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:05:00.914700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173653+0000","last_change":"2024-02-17T12:18:01.800872+0000","last_active":"2024-02-17T12:18:04.173653+0000","last_peered":"2024-02-17T12:18:04.173653+0000","last_clean":"2024-02-17T12:18:04.173653+0000","last_became_active":"2024-02-17T12:18:01.800563+0000","last_became_peered":"2024-02-17T12:18:01.800563+0000","last_unstale":"2024-02-17T12:18:04.173653+0000","last_undegraded":"2024-02-17T12:18:04.173653+0000","last_fullsized":"2024-02-17T12:18:04.173653+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:28.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802821+0000","last_change":"2024-02-17T12:18:02.806343+0000","last_active":"2024-02-17T12:18:03.802821+0000","last_peered":"2024-02-17T12:18:03.802821+0000","last_clean":"2024-02-17T12:18:03.802821+0000","last_became_active":"2024-02-17T12:18:02.805514+0000","last_became_peered":"2024-02-17T12:18:02.805514+0000","last_unstale":"2024-02-17T12:18:03.802821+0000","last_undegraded":"2024-02-17T12:18:03.802821+0000","last_fullsized":"2024-02-17T12:18:03.802821+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:46.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.801971+0000","last_change":"2024-02-17T12:18:01.801897+0000","last_active":"2024-02-17T12:18:03.801971+0000","last_peered":"2024-02-17T12:18:03.801971+0000","last_clean":"2024-02-17T12:18:03.801971+0000","last_became_active":"2024-02-17T12:18:01.801572+0000","last_became_peered":"2024-02-17T12:18:01.801572+0000","last_unstale":"2024-02-17T12:18:03.801971+0000","last_undegraded":"2024-02-17T12:18:03.801971+0000","last_fullsized":"2024-02-17T12:18:03.801971+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173181+0000","last_change":"2024-02-17T12:18:02.808806+0000","last_active":"2024-02-17T12:18:04.173181+0000","last_peered":"2024-02-17T12:18:04.173181+0000","last_clean":"2024-02-17T12:18:04.173181+0000","last_became_active":"2024-02-17T12:18:02.808546+0000","last_became_peered":"2024-02-17T12:18:02.808546+0000","last_unstale":"2024-02-17T12:18:04.173181+0000","last_undegraded":"2024-02-17T12:18:04.173181+0000","last_fullsized":"2024-02-17T12:18:04.173181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:25.157077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171862+0000","last_change":"2024-02-17T12:18:01.798282+0000","last_active":"2024-02-17T12:18:04.171862+0000","last_peered":"2024-02-17T12:18:04.171862+0000","last_clean":"2024-02-17T12:18:04.171862+0000","last_became_active":"2024-02-17T12:18:01.797970+0000","last_became_peered":"2024-02-17T12:18:01.797970+0000","last_unstale":"2024-02-17T12:18:04.171862+0000","last_undegraded":"2024-02-17T12:18:04.171862+0000","last_fullsized":"2024-02-17T12:18:04.171862+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:52:16.655449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173892+0000","last_change":"2024-02-17T12:18:02.808303+0000","last_active":"2024-02-17T12:18:04.173892+0000","last_peered":"2024-02-17T12:18:04.173892+0000","last_clean":"2024-02-17T12:18:04.173892+0000","last_became_active":"2024-02-17T12:18:02.807743+0000","last_became_peered":"2024-02-17T12:18:02.807743+0000","last_unstale":"2024-02-17T12:18:04.173892+0000","last_undegraded":"2024-02-17T12:18:04.173892+0000","last_fullsized":"2024-02-17T12:18:04.173892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:55.025562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:03.802606+0000","last_change":"2024-02-17T12:18:01.802694+0000","last_active":"2024-02-17T12:18:03.802606+0000","last_peered":"2024-02-17T12:18:03.802606+0000","last_clean":"2024-02-17T12:18:03.802606+0000","last_became_active":"2024-02-17T12:18:01.802326+0000","last_became_peered":"2024-02-17T12:18:01.802326+0000","last_unstale":"2024-02-17T12:18:03.802606+0000","last_undegraded":"2024-02-17T12:18:03.802606+0000","last_fullsized":"2024-02-17T12:18:03.802606+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:33:51.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171727+0000","last_change":"2024-02-17T12:18:02.805983+0000","last_active":"2024-02-17T12:18:04.171727+0000","last_peered":"2024-02-17T12:18:04.171727+0000","last_clean":"2024-02-17T12:18:04.171727+0000","last_became_active":"2024-02-17T12:18:02.805699+0000","last_became_peered":"2024-02-17T12:18:02.805699+0000","last_unstale":"2024-02-17T12:18:04.171727+0000","last_undegraded":"2024-02-17T12:18:04.171727+0000","last_fullsized":"2024-02-17T12:18:04.171727+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:44.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.171810+0000","last_change":"2024-02-17T12:18:01.801438+0000","last_active":"2024-02-17T12:18:04.171810+0000","last_peered":"2024-02-17T12:18:04.171810+0000","last_clean":"2024-02-17T12:18:04.171810+0000","last_became_active":"2024-02-17T12:18:01.801221+0000","last_became_peered":"2024-02-17T12:18:01.801221+0000","last_unstale":"2024-02-17T12:18:04.171810+0000","last_undegraded":"2024-02-17T12:18:04.171810+0000","last_fullsized":"2024-02-17T12:18:04.171810+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:09.649370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172593+0000","last_change":"2024-02-17T12:18:02.806745+0000","last_active":"2024-02-17T12:18:04.172593+0000","last_peered":"2024-02-17T12:18:04.172593+0000","last_clean":"2024-02-17T12:18:04.172593+0000","last_became_active":"2024-02-17T12:18:02.806429+0000","last_became_peered":"2024-02-17T12:18:02.806429+0000","last_unstale":"2024-02-17T12:18:04.172593+0000","last_undegraded":"2024-02-17T12:18:04.172593+0000","last_fullsized":"2024-02-17T12:18:04.172593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:58.938533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172457+0000","last_change":"2024-02-17T12:18:01.793256+0000","last_active":"2024-02-17T12:18:04.172457+0000","last_peered":"2024-02-17T12:18:04.172457+0000","last_clean":"2024-02-17T12:18:04.172457+0000","last_became_active":"2024-02-17T12:18:01.793033+0000","last_became_peered":"2024-02-17T12:18:01.793033+0000","last_unstale":"2024-02-17T12:18:04.172457+0000","last_undegraded":"2024-02-17T12:18:04.172457+0000","last_fullsized":"2024-02-17T12:18:04.172457+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:46.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.172434+0000","last_change":"2024-02-17T12:18:02.800813+0000","last_active":"2024-02-17T12:18:04.172434+0000","last_peered":"2024-02-17T12:18:04.172434+0000","last_clean":"2024-02-17T12:18:04.172434+0000","last_became_active":"2024-02-17T12:18:02.800551+0000","last_became_peered":"2024-02-17T12:18:02.800551+0000","last_unstale":"2024-02-17T12:18:04.172434+0000","last_undegraded":"2024-02-17T12:18:04.172434+0000","last_fullsized":"2024-02-17T12:18:04.172434+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:47:58.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173630+0000","last_change":"2024-02-17T12:18:01.796062+0000","last_active":"2024-02-17T12:18:04.173630+0000","last_peered":"2024-02-17T12:18:04.173630+0000","last_clean":"2024-02-17T12:18:04.173630+0000","last_became_active":"2024-02-17T12:18:01.795616+0000","last_became_peered":"2024-02-17T12:18:01.795616+0000","last_unstale":"2024-02-17T12:18:04.173630+0000","last_undegraded":"2024-02-17T12:18:04.173630+0000","last_fullsized":"2024-02-17T12:18:04.173630+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:04:59.908240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-02-17T12:18:04.173053+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:18:04.173053+0000","last_peered":"2024-02-17T12:18:04.173053+0000","last_clean":"2024-02-17T12:18:04.173053+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:18:04.173053+0000","last_undegraded":"2024-02-17T12:18:04.173053+0000","last_fullsized":"2024-02-17T12:18:04.173053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":589824,"data_stored":248149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.96199999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":1.044},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":1.0209999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.97799999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.0700000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":248801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.65800000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.753}]},{"osd":4,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.79500000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":248205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.39100000000000001}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.31},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.57799999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":248239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.1779999999999999,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.432},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.6399999999999997,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.751}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":6.3959999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.84499999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.2779999999999996,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.73299999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.872},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":5.375,"5min":5.375,"15min":5.375},"last":0.67300000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.82399999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1200128,"data_stored":840711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.873}]},{"osd":5,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.83699999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.75},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.85799999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:17:12 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.80500000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1191936,"data_stored":838677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.8919999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.77500000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.67200000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.76400000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.627},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":2.8370000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72299999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.54900000000000004}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.748},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70299999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":249761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.755},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72299999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.73799999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:17:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:17:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":598016,"data_stored":248205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.317},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42899999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.67400000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:18:11.722 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T12:18:11.723 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-02-17T12:18:11.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4759800640 1 Processor -- start 2024-02-17T12:18:11.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4759800640 1 -- start start 2024-02-17T12:18:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4759800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f475414f110 0x7f47540c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4759800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f47540c1eb0 0x7f475415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4759800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47540a9420 con 0x7f47540c2580 2024-02-17T12:18:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4759800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475414f4f0 con 0x7f47540c1eb0 2024-02-17T12:18:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4759800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47540aae80 con 0x7f475414f110 2024-02-17T12:18:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4753400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f47540c1eb0 0x7f475415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4753400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f47540c1eb0 0x7f475415c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41792/0 (socket says 172.21.15.114:41792) 2024-02-17T12:18:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4753400640 1 -- 172.21.15.114:0/1615995793 learned_addr learned my addr 172.21.15.114:0/1615995793 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4752a00640 1 --2- 172.21.15.114:0/1615995793 >> v2:172.21.15.116:3300/0 conn(0x7f475414f110 0x7f47540c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4753400640 1 -- 172.21.15.114:0/1615995793 >> v2:172.21.15.116:3300/0 conn(0x7f475414f110 msgr2=0x7f47540c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4753400640 1 --2- 172.21.15.114:0/1615995793 >> v2:172.21.15.116:3300/0 conn(0x7f475414f110 0x7f47540c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4753400640 1 -- 172.21.15.114:0/1615995793 >> v1:172.21.15.116:6789/0 conn(0x7f47540c2580 legacy=0x7f47540aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.897+0000 7f4753400640 1 -- 172.21.15.114:0/1615995793 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754152850 con 0x7f47540c1eb0 2024-02-17T12:18:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4753400640 1 --2- 172.21.15.114:0/1615995793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47540c1eb0 0x7f475415c390 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f475406dc70 tx=0x7f474c01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a200a1e6a70a737e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4751600640 1 -- 172.21.15.114:0/1615995793 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00b2d0 con 0x7f47540c1eb0 2024-02-17T12:18:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4751600640 1 -- 172.21.15.114:0/1615995793 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c00b430 con 0x7f47540c1eb0 2024-02-17T12:18:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4751600640 1 -- 172.21.15.114:0/1615995793 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0a7b20 con 0x7f47540c1eb0 2024-02-17T12:18:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4759800640 1 -- 172.21.15.114:0/1615995793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47540c1eb0 msgr2=0x7f475415c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4759800640 1 --2- 172.21.15.114:0/1615995793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47540c1eb0 0x7f475415c390 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f475406dc70 tx=0x7f474c01eb30 comp rx=0 tx=0).stop 2024-02-17T12:18:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4759800640 1 -- 172.21.15.114:0/1615995793 shutdown_connections 2024-02-17T12:18:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4759800640 1 --2- 172.21.15.114:0/1615995793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47540c1eb0 0x7f475415c390 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4759800640 1 --2- 172.21.15.114:0/1615995793 >> v2:172.21.15.116:3300/0 conn(0x7f475414f110 0x7f47540c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4759800640 1 -- 172.21.15.114:0/1615995793 >> 172.21.15.114:0/1615995793 conn(0x7f47540a8490 msgr2=0x7f47540a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4759800640 1 -- 172.21.15.114:0/1615995793 shutdown_connections 2024-02-17T12:18:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.901+0000 7f4759800640 1 -- 172.21.15.114:0/1615995793 wait complete. 2024-02-17T12:18:11.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 Processor -- start 2024-02-17T12:18:11.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 -- start start 2024-02-17T12:18:11.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47540c1eb0 0x7f47540bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47540c2580 0x7f4754142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f475414f110 0x7f4754142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47541465f0 con 0x7f475414f110 2024-02-17T12:18:11.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4754147520 con 0x7f47540c1eb0 2024-02-17T12:18:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4754149430 con 0x7f47540c2580 2024-02-17T12:18:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4753400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f475414f110 0x7f4754142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4753400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f475414f110 0x7f4754142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41808/0 (socket says 172.21.15.114:41808) 2024-02-17T12:18:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4753400640 1 -- 172.21.15.114:0/2101581824 learned_addr learned my addr 172.21.15.114:0/2101581824 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4752a00640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47540c1eb0 0x7f47540bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4752000640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47540c2580 0x7f4754142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4753400640 1 -- 172.21.15.114:0/2101581824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47540c2580 msgr2=0x7f4754142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4753400640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47540c2580 0x7f4754142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4753400640 1 -- 172.21.15.114:0/2101581824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47540c1eb0 msgr2=0x7f47540bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4753400640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47540c1eb0 0x7f47540bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4753400640 1 -- 172.21.15.114:0/2101581824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c00bd40 con 0x7f475414f110 2024-02-17T12:18:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4753400640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f475414f110 0x7f4754142c60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f474c01b740 tx=0x7f474c01b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f474aa00640 1 -- 172.21.15.114:0/2101581824 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c009800 con 0x7f475414f110 2024-02-17T12:18:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f474aa00640 1 -- 172.21.15.114:0/2101581824 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c009960 con 0x7f475414f110 2024-02-17T12:18:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f474aa00640 1 -- 172.21.15.114:0/2101581824 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c009d10 con 0x7f475414f110 2024-02-17T12:18:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 -- 172.21.15.114:0/2101581824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47541515c0 con 0x7f475414f110 2024-02-17T12:18:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 -- 172.21.15.114:0/2101581824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47541f1c30 con 0x7f475414f110 2024-02-17T12:18:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.905+0000 7f4759800640 1 -- 172.21.15.114:0/2101581824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47541f17b0 con 0x7f475414f110 2024-02-17T12:18:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.909+0000 7f474aa00640 1 -- 172.21.15.114:0/2101581824 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f474c0c3460 con 0x7f475414f110 2024-02-17T12:18:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.909+0000 7f474aa00640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4734066e40 0x7f4734069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.909+0000 7f474aa00640 1 -- 172.21.15.114:0/2101581824 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f474c11fec0 con 0x7f475414f110 2024-02-17T12:18:11.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.909+0000 7f4752a00640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4734066e40 0x7f4734069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.909+0000 7f4752a00640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4734066e40 0x7f4734069300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4744009b60 tx=0x7f4744009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:11.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:11.913+0000 7f474aa00640 1 -- 172.21.15.114:0/2101581824 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f47541f17b0 con 0x7f475414f110 2024-02-17T12:18:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.117+0000 7f4759800640 1 -- 172.21.15.114:0/2101581824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f47541f17b0 con 0x7f475414f110 2024-02-17T12:18:12.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.121+0000 7f474aa00640 1 -- 172.21.15.114:0/2101581824 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f47541f17b0 con 0x7f475414f110 2024-02-17T12:18:12.125 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-02-17T12:18:12.125 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlaXt+FxAAn4YhbPPnUC6y0giRDPuYyQ== 2024-02-17T12:18:12.125 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-02-17T12:18:12.125 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-02-17T12:18:12.125 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-02-17T12:18:12.126 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-02-17T12:18:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 -- 172.21.15.114:0/2101581824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4734066e40 msgr2=0x7f4734069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4734066e40 0x7f4734069300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4744009b60 tx=0x7f4744009190 comp rx=0 tx=0).stop 2024-02-17T12:18:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 -- 172.21.15.114:0/2101581824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f475414f110 msgr2=0x7f4754142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f475414f110 0x7f4754142c60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f474c01b740 tx=0x7f474c01b8d0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 -- 172.21.15.114:0/2101581824 shutdown_connections 2024-02-17T12:18:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4734066e40 0x7f4734069300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f475414f110 0x7f4754142c60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f47540c2580 0x7f4754142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 --2- 172.21.15.114:0/2101581824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47540c1eb0 0x7f47540bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 -- 172.21.15.114:0/2101581824 >> 172.21.15.114:0/2101581824 conn(0x7f47540a8490 msgr2=0x7f47540a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 -- 172.21.15.114:0/2101581824 shutdown_connections 2024-02-17T12:18:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.125+0000 7f4759800640 1 -- 172.21.15.114:0/2101581824 wait complete. 2024-02-17T12:18:12.146 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:12.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.277+0000 7fecb3a00640 1 Processor -- start 2024-02-17T12:18:12.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.277+0000 7fecb3a00640 1 -- start start 2024-02-17T12:18:12.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.277+0000 7fecb3a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fecac0c25a0 0x7fecac06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:12.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.277+0000 7fecb3a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac152c50 0x7fecac1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:12.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.277+0000 7fecb3a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecac156270 con 0x7fecac06db50 2024-02-17T12:18:12.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.277+0000 7fecb3a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecac071630 con 0x7fecac0c25a0 2024-02-17T12:18:12.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.277+0000 7fecb3a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac156550 con 0x7fecac152c50 2024-02-17T12:18:12.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecb1a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac152c50 0x7fecac1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:12.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecabe00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fecac06db50 0x7fecac14ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:44750/0 (socket says 172.21.15.114:44750) 2024-02-17T12:18:12.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecb1000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fecac0c25a0 0x7fecac06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:12.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecabe00640 1 -- 172.21.15.114:0/4115734166 learned_addr learned my addr 172.21.15.114:0/4115734166 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:12.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecb1a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac152c50 0x7fecac1530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:52366/0 (socket says 172.21.15.114:52366) 2024-02-17T12:18:12.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecb1000640 1 -- 172.21.15.114:0/4115734166 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac152c50 msgr2=0x7fecac1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:12.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecb1000640 1 --2- 172.21.15.114:0/4115734166 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac152c50 0x7fecac1530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecb1000640 1 -- 172.21.15.114:0/4115734166 >> v1:172.21.15.116:6789/0 conn(0x7fecac06db50 legacy=0x7fecac14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:12.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecb1000640 1 -- 172.21.15.114:0/4115734166 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac156830 con 0x7fecac0c25a0 2024-02-17T12:18:12.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecb1a00640 1 --2- 172.21.15.114:0/4115734166 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac152c50 0x7fecac1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:12.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecb1000640 1 --2- 172.21.15.114:0/4115734166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecac0c25a0 0x7fecac06e980 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009d90 tx=0x7fec9c01c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbfb2ace9d85bef9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:12.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecab400640 1 -- 172.21.15.114:0/4115734166 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0a5800 con 0x7fecac0c25a0 2024-02-17T12:18:12.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecab400640 1 -- 172.21.15.114:0/4115734166 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c0a5960 con 0x7fecac0c25a0 2024-02-17T12:18:12.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.281+0000 7fecab400640 1 -- 172.21.15.114:0/4115734166 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0a5cf0 con 0x7fecac0c25a0 2024-02-17T12:18:12.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 -- 172.21.15.114:0/4115734166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecac0c25a0 msgr2=0x7fecac06e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:12.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 --2- 172.21.15.114:0/4115734166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecac0c25a0 0x7fecac06e980 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009d90 tx=0x7fec9c01c820 comp rx=0 tx=0).stop 2024-02-17T12:18:12.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 -- 172.21.15.114:0/4115734166 shutdown_connections 2024-02-17T12:18:12.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 --2- 172.21.15.114:0/4115734166 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac152c50 0x7fecac1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 --2- 172.21.15.114:0/4115734166 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecac0c25a0 0x7fecac06e980 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 -- 172.21.15.114:0/4115734166 >> 172.21.15.114:0/4115734166 conn(0x7fecac0a8490 msgr2=0x7fecac0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:12.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 -- 172.21.15.114:0/4115734166 shutdown_connections 2024-02-17T12:18:12.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 -- 172.21.15.114:0/4115734166 wait complete. 2024-02-17T12:18:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 Processor -- start 2024-02-17T12:18:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 -- start start 2024-02-17T12:18:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecac06db50 0x7fecac147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac0c25a0 0x7fecac0c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecac152c50 0x7fecac0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac1ec500 con 0x7fecac152c50 2024-02-17T12:18:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac149140 con 0x7fecac06db50 2024-02-17T12:18:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb3a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac149350 con 0x7fecac0c25a0 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecac152c50 0x7fecac0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecac152c50 0x7fecac0c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41812/0 (socket says 172.21.15.114:41812) 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb1a00640 1 -- 172.21.15.114:0/505639073 learned_addr learned my addr 172.21.15.114:0/505639073 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb1000640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecac06db50 0x7fecac147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecabe00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac0c25a0 0x7fecac0c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb1a00640 1 -- 172.21.15.114:0/505639073 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac0c25a0 msgr2=0x7fecac0c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb1a00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac0c25a0 0x7fecac0c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb1a00640 1 -- 172.21.15.114:0/505639073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecac06db50 msgr2=0x7fecac147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb1a00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecac06db50 0x7fecac147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.285+0000 7fecb1a00640 1 -- 172.21.15.114:0/505639073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4009420 con 0x7fecac152c50 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7fecb1a00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecac152c50 0x7fecac0c5c80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7feca400e930 tx=0x7feca400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7feca8c00640 1 -- 172.21.15.114:0/505639073 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4009680 con 0x7fecac152c50 2024-02-17T12:18:12.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7feca8c00640 1 -- 172.21.15.114:0/505639073 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4004020 con 0x7fecac152c50 2024-02-17T12:18:12.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7fecb3a00640 1 -- 172.21.15.114:0/505639073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c009a70 con 0x7fecac152c50 2024-02-17T12:18:12.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7feca8c00640 1 -- 172.21.15.114:0/505639073 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40043f0 con 0x7fecac152c50 2024-02-17T12:18:12.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7fecb3a00640 1 -- 172.21.15.114:0/505639073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecac149910 con 0x7fecac152c50 2024-02-17T12:18:12.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7fecb3a00640 1 -- 172.21.15.114:0/505639073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecac074840 con 0x7fecac152c50 2024-02-17T12:18:12.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7feca8c00640 1 -- 172.21.15.114:0/505639073 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7feca400c940 con 0x7fecac152c50 2024-02-17T12:18:12.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7feca8c00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec8c066e40 0x7fec8c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:12.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7feca8c00640 1 -- 172.21.15.114:0/505639073 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feca40848b0 con 0x7fecac152c50 2024-02-17T12:18:12.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.289+0000 7fecb1000640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec8c066e40 0x7fec8c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:12.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.293+0000 7fecb1000640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec8c066e40 0x7fec8c069300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0af000 tx=0x7fec9c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:12.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.293+0000 7feca8c00640 1 -- 172.21.15.114:0/505639073 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feca40516b0 con 0x7fecac152c50 2024-02-17T12:18:12.356 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:18:12.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:18:12.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.493+0000 7fecb3a00640 1 -- 172.21.15.114:0/505639073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecac0c4030 con 0x7fecac152c50 2024-02-17T12:18:12.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.493+0000 7feca8c00640 1 -- 172.21.15.114:0/505639073 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4944 (secure 0 0 0) 0x7feca4017090 con 0x7fecac152c50 2024-02-17T12:18:12.497 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:12.497 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1690237872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1690237872},{"type":"v1","addr":"172.21.15.114:6836","nonce":1690237872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:02.157066+0000","modified":"2024-02-17T12:18:05.178755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/105000653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":105000653},{"type":"v1","addr":"172.21.15.114:6837","nonce":105000653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-02-17T12:18:12.497 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 33 2024-02-17T12:18:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.493+0000 7fecb3a00640 1 -- 172.21.15.114:0/505639073 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec8c066e40 msgr2=0x7fec8c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.493+0000 7fecb3a00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec8c066e40 0x7fec8c069300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0af000 tx=0x7fec9c0a7070 comp rx=0 tx=0).stop 2024-02-17T12:18:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.497+0000 7fecb3a00640 1 -- 172.21.15.114:0/505639073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecac152c50 msgr2=0x7fecac0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.497+0000 7fecb3a00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecac152c50 0x7fecac0c5c80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7feca400e930 tx=0x7feca400edf0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.497+0000 7fecb3a00640 1 -- 172.21.15.114:0/505639073 shutdown_connections 2024-02-17T12:18:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.497+0000 7fecb3a00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec8c066e40 0x7fec8c069300 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.497+0000 7fecb3a00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecac152c50 0x7fecac0c5c80 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.497+0000 7fecb3a00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fecac0c25a0 0x7fecac0c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.497+0000 7fecb3a00640 1 --2- 172.21.15.114:0/505639073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecac06db50 0x7fecac147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.497+0000 7fecb3a00640 1 -- 172.21.15.114:0/505639073 >> 172.21.15.114:0/505639073 conn(0x7fecac0a8490 msgr2=0x7fecac0722f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.497+0000 7fecb3a00640 1 -- 172.21.15.114:0/505639073 shutdown_connections 2024-02-17T12:18:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:12.497+0000 7fecb3a00640 1 -- 172.21.15.114:0/505639073 wait complete. 2024-02-17T12:18:12.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T12:18:02.157066+0000', 'modified': '2024-02-17T12:18:05.178755+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5709}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5709': {'gid': 5709, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6837/105000653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 105000653}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 105000653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-17T12:18:12.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-17T12:18:12.921 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-02-17T12:18:13.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.053+0000 7f0098200640 1 Processor -- start 2024-02-17T12:18:13.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.053+0000 7f0098200640 1 -- start start 2024-02-17T12:18:13.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0098200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f009006db50 0x7f009014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0098200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0090150490 0x7f0090152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0098200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0090156270 con 0x7f00900c25a0 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0098200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009006f090 con 0x7f009006db50 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0098200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0090071630 con 0x7f0090150490 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0094e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f009006db50 0x7f009014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0094e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f009006db50 0x7f009014ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41820/0 (socket says 172.21.15.114:41820) 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0094e00640 1 -- 172.21.15.114:0/1775020112 learned_addr learned my addr 172.21.15.114:0/1775020112 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0096200640 1 --2- 172.21.15.114:0/1775020112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0090150490 0x7f0090152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0094e00640 1 -- 172.21.15.114:0/1775020112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0090150490 msgr2=0x7f0090152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0094e00640 1 --2- 172.21.15.114:0/1775020112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0090150490 0x7f0090152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0094e00640 1 -- 172.21.15.114:0/1775020112 >> v1:172.21.15.114:6789/0 conn(0x7f00900c25a0 legacy=0x7f009006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0094e00640 1 -- 172.21.15.114:0/1775020112 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0090156550 con 0x7f009006db50 2024-02-17T12:18:13.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f008fe00640 1 -- 172.21.15.114:0/1775020112 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827637959 0 0) 0x7f0090156270 con 0x7f00900c25a0 2024-02-17T12:18:13.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0096200640 1 --2- 172.21.15.114:0/1775020112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0090150490 0x7f0090152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:13.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f0094e00640 1 --2- 172.21.15.114:0/1775020112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 0x7f009014ff50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0084009870 tx=0x7f008401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2a9e289d43d425 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:13.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f008fe00640 1 -- 172.21.15.114:0/1775020112 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840a7070 con 0x7f009006db50 2024-02-17T12:18:13.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f008fe00640 1 -- 172.21.15.114:0/1775020112 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00840ab430 con 0x7f009006db50 2024-02-17T12:18:13.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.057+0000 7f008fe00640 1 -- 172.21.15.114:0/1775020112 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00901539a0 con 0x7f009006db50 2024-02-17T12:18:13.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 -- 172.21.15.114:0/1775020112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 msgr2=0x7f009014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 --2- 172.21.15.114:0/1775020112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 0x7f009014ff50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0084009870 tx=0x7f008401c410 comp rx=0 tx=0).stop 2024-02-17T12:18:13.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 -- 172.21.15.114:0/1775020112 shutdown_connections 2024-02-17T12:18:13.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 --2- 172.21.15.114:0/1775020112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0090150490 0x7f0090152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 --2- 172.21.15.114:0/1775020112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 0x7f009014ff50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 -- 172.21.15.114:0/1775020112 >> 172.21.15.114:0/1775020112 conn(0x7f00900a8490 msgr2=0x7f00900a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:13.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 -- 172.21.15.114:0/1775020112 shutdown_connections 2024-02-17T12:18:13.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 -- 172.21.15.114:0/1775020112 wait complete. 2024-02-17T12:18:13.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 Processor -- start 2024-02-17T12:18:13.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 -- start start 2024-02-17T12:18:13.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 0x7f0090141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00900c25a0 0x7f00900c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0090150490 0x7f00900c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00901eb2e0 con 0x7f009006db50 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0090140490 con 0x7f0090150490 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0098200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00900c1d40 con 0x7f00900c25a0 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0095800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 0x7f0090141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0095800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 0x7f0090141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41830/0 (socket says 172.21.15.114:41830) 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0095800640 1 -- 172.21.15.114:0/2307193603 learned_addr learned my addr 172.21.15.114:0/2307193603 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0096200640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0090150490 0x7f00900c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0094e00640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00900c25a0 0x7f00900c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0095800640 1 -- 172.21.15.114:0/2307193603 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00900c25a0 msgr2=0x7f00900c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0095800640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00900c25a0 0x7f00900c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0095800640 1 -- 172.21.15.114:0/2307193603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0090150490 msgr2=0x7f00900c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0095800640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0090150490 0x7f00900c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0095800640 1 -- 172.21.15.114:0/2307193603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840094d0 con 0x7f009006db50 2024-02-17T12:18:13.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0094e00640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00900c25a0 0x7f00900c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:13.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.061+0000 7f0095800640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 0x7f0090141cd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f008000c550 tx=0x7f008000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:13.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f008d600640 1 -- 172.21.15.114:0/2307193603 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800052d0 con 0x7f009006db50 2024-02-17T12:18:13.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f008d600640 1 -- 172.21.15.114:0/2307193603 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0080005430 con 0x7f009006db50 2024-02-17T12:18:13.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f0098200640 1 -- 172.21.15.114:0/2307193603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0090140700 con 0x7f009006db50 2024-02-17T12:18:13.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f008d600640 1 -- 172.21.15.114:0/2307193603 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080012870 con 0x7f009006db50 2024-02-17T12:18:13.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f0098200640 1 -- 172.21.15.114:0/2307193603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00901eaf00 con 0x7f009006db50 2024-02-17T12:18:13.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f008d600640 1 -- 172.21.15.114:0/2307193603 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f00800129d0 con 0x7f009006db50 2024-02-17T12:18:13.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f008d600640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0074066e40 0x7f0074069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f008d600640 1 -- 172.21.15.114:0/2307193603 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00800846a0 con 0x7f009006db50 2024-02-17T12:18:13.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f0094e00640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0074066e40 0x7f0074069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f009b6e9000 1 Processor -- start 2024-02-17T12:18:13.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f009b6e9000 1 -- start start 2024-02-17T12:18:13.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.065+0000 7f0094e00640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0074066e40 0x7f0074069300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f00840af000 tx=0x7f0084008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:13.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x5612614d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4000 0x5612614d43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d4920 0x56126151d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561261399d00 con 0x5612614d36e0 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56126132b430 con 0x5612614d4920 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x561261328960 con 0x5612614d4000 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0095800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x5612614d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0095800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x5612614d3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41842/0 (socket says 172.21.15.114:41842) 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0095800640 1 -- 172.21.15.114:0/126346908 learned_addr learned my addr 172.21.15.114:0/126346908 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0094e00640 1 --2- 172.21.15.114:0/126346908 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4000 0x5612614d43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0096200640 1 --2- 172.21.15.114:0/126346908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d4920 0x56126151d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0095800640 1 -- 172.21.15.114:0/126346908 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4000 msgr2=0x5612614d43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0095800640 1 --2- 172.21.15.114:0/126346908 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4000 0x5612614d43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0095800640 1 -- 172.21.15.114:0/126346908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d4920 msgr2=0x56126151d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0095800640 1 --2- 172.21.15.114:0/126346908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d4920 0x56126151d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0095800640 1 -- 172.21.15.114:0/126346908 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56126101a890 con 0x5612614d36e0 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f0095800640 1 --2- 172.21.15.114:0/126346908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x5612614d3ac0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f00800515c0 tx=0x7f0080001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb457078aaabf35 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f007e000640 1 -- 172.21.15.114:0/126346908 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080071ea0 con 0x5612614d36e0 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f007e000640 1 -- 172.21.15.114:0/126346908 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008005d870 con 0x5612614d36e0 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f007e000640 1 -- 172.21.15.114:0/126346908 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080053460 con 0x5612614d36e0 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 -- 172.21.15.114:0/126346908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 msgr2=0x5612614d3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 --2- 172.21.15.114:0/126346908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x5612614d3ac0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f00800515c0 tx=0x7f0080001090 comp rx=0 tx=0).stop 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 -- 172.21.15.114:0/126346908 shutdown_connections 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 --2- 172.21.15.114:0/126346908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d4920 0x56126151d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 --2- 172.21.15.114:0/126346908 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4000 0x5612614d43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 --2- 172.21.15.114:0/126346908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x5612614d3ac0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 -- 172.21.15.114:0/126346908 >> 172.21.15.114:0/126346908 conn(0x561261511670 msgr2=0x561261513a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 -- 172.21.15.114:0/126346908 shutdown_connections 2024-02-17T12:18:13.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 -- 172.21.15.114:0/126346908 wait complete. 2024-02-17T12:18:13.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 -- start start 2024-02-17T12:18:13.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 Processor -- start 2024-02-17T12:18:13.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d36e0 0x56126150fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.069+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x5612615103a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4920 0x5612615148b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561261324140 con 0x5612614d4000 2024-02-17T12:18:13.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612612be630 con 0x5612614d36e0 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612612be2d0 con 0x5612614d4920 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 10 client.0 _ll_register_callbacks cb 0x5612613d41c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0094e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x5612615103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0094e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x5612615103a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41848/0 (socket says 172.21.15.114:41848) 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0094e00640 1 -- 172.21.15.114:0/2802073255 learned_addr learned my addr 172.21.15.114:0/2802073255 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0096200640 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4920 0x5612615148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0095800640 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d36e0 0x56126150fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0094e00640 1 -- 172.21.15.114:0/2802073255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4920 msgr2=0x5612615148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0094e00640 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4920 0x5612615148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0094e00640 1 -- 172.21.15.114:0/2802073255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d36e0 msgr2=0x56126150fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0094e00640 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d36e0 0x56126150fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0094e00640 1 -- 172.21.15.114:0/2802073255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00901eaf00 con 0x5612614d4000 2024-02-17T12:18:13.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0094e00640 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x5612615103a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f008401a040 tx=0x7f008401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d3cb28f2322e02 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0072a00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0072a00640 1 -- 172.21.15.114:0/2802073255 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840bb050 con 0x5612614d4000 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0072a00640 1 -- 172.21.15.114:0/2802073255 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00840c2410 con 0x5612614d4000 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- 172.21.15.114:0/2802073255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612612d7850 con 0x5612614d4000 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0072a00640 1 -- 172.21.15.114:0/2802073255 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00840c25d0 con 0x5612614d4000 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 10 client.5892 fetch_fsmap learned FSMap version 33 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- 172.21.15.114:0/2802073255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x5612612e3e70 con 0x5612614d4000 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0072a00640 1 -- 172.21.15.114:0/2802073255 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5612612d7850 con 0x5612614d4000 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0072a00640 1 -- 172.21.15.114:0/2802073255 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f00840c2730 con 0x5612614d4000 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 10 client.5892 fetch_fsmap finished waiting for FSMap version 33 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 10 client.5892 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 20 client.5892 populate_metadata read hostname 'smithi114' 2024-02-17T12:18:13.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.114:6835/105000653,v1:172.21.15.114:6837/105000653] conn(0x561261515650 0x561261515a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 4 client.5892 mds_command: new command op to 5709 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- 172.21.15.114:0/2802073255 --> [v2:172.21.15.114:6835/105000653,v1:172.21.15.114:6837/105000653] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561261320f20 con 0x561261515650 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0095800640 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.114:6835/105000653,v1:172.21.15.114:6837/105000653] conn(0x561261515650 0x561261515a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0095800640 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.114:6835/105000653,v1:172.21.15.114:6837/105000653] conn(0x561261515650 0x561261515a30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c46e12cb1b7df23 server_cookie=a00e5cc89da41cd3 in_seq=0 out_seq=0 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0072a00640 10 client.5892 ms_handle_connect on v2:172.21.15.114:6835/105000653 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0072a00640 1 -- 172.21.15.114:0/2802073255 <== mds.0 v2:172.21.15.114:6835/105000653 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561261320f20 con 0x561261515650 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0072a00640 10 client.5892 handle_command_reply: tid=0 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 client.5892 shutdown 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- 172.21.15.114:0/2802073255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 msgr2=0x5612615103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x5612615103a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f008401a040 tx=0x7f008401ac50 comp rx=0 tx=0).stop 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- 172.21.15.114:0/2802073255 shutdown_connections 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.114:6835/105000653,v1:172.21.15.114:6837/105000653] conn(0x561261515650 0x561261515a30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4920 0x5612615148b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x5612615103a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 --2- 172.21.15.114:0/2802073255 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d36e0 0x56126150fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- 172.21.15.114:0/2802073255 >> 172.21.15.114:0/2802073255 conn(0x561261511670 msgr2=0x5612614d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:13.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f0072a00640 0 client.5892 ms_handle_reset on v2:172.21.15.114:6835/105000653 2024-02-17T12:18:13.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- 172.21.15.114:0/2802073255 shutdown_connections 2024-02-17T12:18:13.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 1 -- 172.21.15.114:0/2802073255 wait complete. 2024-02-17T12:18:13.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.073+0000 7f009b6e9000 20 client.5892 trim_cache size 0 max 16384 2024-02-17T12:18:13.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f009b6e9000 1 Processor -- start 2024-02-17T12:18:13.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f009b6e9000 1 -- start start 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561261511670 0x5612614d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x56126151e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4000 0x56126151ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f009b6e9000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x561260fdb940 con 0x5612614d36e0 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f009b6e9000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561261321540 con 0x561261511670 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f009b6e9000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x561261321950 con 0x5612614d4000 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f0094e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x56126151e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f0094e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x56126151e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41852/0 (socket says 172.21.15.114:41852) 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.089+0000 7f0094e00640 1 -- 172.21.15.114:0/2843871084 learned_addr learned my addr 172.21.15.114:0/2843871084 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 -- 172.21.15.114:0/2843871084 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4000 msgr2=0x56126151ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 --2- 172.21.15.114:0/2843871084 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4000 0x56126151ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 -- 172.21.15.114:0/2843871084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561261511670 msgr2=0x5612614d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:13.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 --2- 172.21.15.114:0/2843871084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561261511670 0x5612614d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 -- 172.21.15.114:0/2843871084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612612c9e10 con 0x5612614d36e0 2024-02-17T12:18:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 --2- 172.21.15.114:0/2843871084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x56126151e840 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0084019020 tx=0x7f00840be000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3a61fcb307eb7d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f007d600640 1 -- 172.21.15.114:0/2843871084 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840d7070 con 0x5612614d36e0 2024-02-17T12:18:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f007d600640 1 -- 172.21.15.114:0/2843871084 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00840bc040 con 0x5612614d36e0 2024-02-17T12:18:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f007d600640 1 -- 172.21.15.114:0/2843871084 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840bb040 con 0x5612614d36e0 2024-02-17T12:18:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 -- 172.21.15.114:0/2843871084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 msgr2=0x56126151e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 --2- 172.21.15.114:0/2843871084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x56126151e840 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0084019020 tx=0x7f00840be000 comp rx=0 tx=0).stop 2024-02-17T12:18:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 -- 172.21.15.114:0/2843871084 shutdown_connections 2024-02-17T12:18:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 --2- 172.21.15.114:0/2843871084 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x5612614d4000 0x56126151ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 --2- 172.21.15.114:0/2843871084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d36e0 0x56126151e840 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 --2- 172.21.15.114:0/2843871084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561261511670 0x5612614d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 -- 172.21.15.114:0/2843871084 >> 172.21.15.114:0/2843871084 conn(0x56126151e010 msgr2=0x5612614d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 -- 172.21.15.114:0/2843871084 shutdown_connections 2024-02-17T12:18:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 -- 172.21.15.114:0/2843871084 wait complete. 2024-02-17T12:18:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 -- start start 2024-02-17T12:18:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 Processor -- start 2024-02-17T12:18:13.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d36e0 0x56126157c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x56126157c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x561261511670 0x561261521ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612612e6a60 con 0x5612614d4000 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612614cdc60 con 0x5612614d36e0 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612612e92b0 con 0x561261511670 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f009b6e9000 10 client.0 _ll_register_callbacks cb 0x5612612cd010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x56126157c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x56126157c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41862/0 (socket says 172.21.15.114:41862) 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 -- 172.21.15.114:0/1421882919 learned_addr learned my addr 172.21.15.114:0/1421882919 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0095800640 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d36e0 0x56126157c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0096200640 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x561261511670 0x561261521ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 -- 172.21.15.114:0/1421882919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x561261511670 msgr2=0x561261521ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x561261511670 0x561261521ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 -- 172.21.15.114:0/1421882919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d36e0 msgr2=0x56126157c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d36e0 0x56126157c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.093+0000 7f0094e00640 1 -- 172.21.15.114:0/1421882919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612612e3e70 con 0x5612614d4000 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0094e00640 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x56126157c8f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f008401a040 tx=0x7f0084009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300a9b1fd072ebd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0072a00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0072a00640 1 -- 172.21.15.114:0/1421882919 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00840d7070 con 0x5612614d4000 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0072a00640 1 -- 172.21.15.114:0/1421882919 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0084004040 con 0x5612614d4000 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 -- 172.21.15.114:0/1421882919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561261514990 con 0x5612614d4000 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0072a00640 1 -- 172.21.15.114:0/1421882919 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00840bb040 con 0x5612614d4000 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 10 client.5898 fetch_fsmap learned FSMap version 33 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 -- 172.21.15.114:0/1421882919 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x56126101acc0 con 0x5612614d4000 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0072a00640 1 -- 172.21.15.114:0/1421882919 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561261514990 con 0x5612614d4000 2024-02-17T12:18:13.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0072a00640 1 -- 172.21.15.114:0/1421882919 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0084004240 con 0x5612614d4000 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 10 client.5898 fetch_fsmap finished waiting for FSMap version 33 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 10 client.5898 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 20 client.5898 populate_metadata read hostname 'smithi114' 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.114:6835/105000653,v1:172.21.15.114:6837/105000653] conn(0x5612614d4920 0x5612615223e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 4 client.5898 mds_command: new command op to 5709 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 -- 172.21.15.114:0/1421882919 --> [v2:172.21.15.114:6835/105000653,v1:172.21.15.114:6837/105000653] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5612612a9e80 con 0x5612614d4920 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0095800640 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.114:6835/105000653,v1:172.21.15.114:6837/105000653] conn(0x5612614d4920 0x5612615223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0072a00640 10 client.5898 ms_handle_connect on v2:172.21.15.114:6835/105000653 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0095800640 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.114:6835/105000653,v1:172.21.15.114:6837/105000653] conn(0x5612614d4920 0x5612615223e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d74f846bedc2f890 server_cookie=91a601998cd063d0 in_seq=0 out_seq=0 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0072a00640 1 -- 172.21.15.114:0/1421882919 <== mds.0 v2:172.21.15.114:6835/105000653 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x5612612a9e80 con 0x5612614d4920 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0072a00640 10 client.5898 handle_command_reply: tid=0 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 client.5898 shutdown 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 -- 172.21.15.114:0/1421882919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 msgr2=0x56126157c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x56126157c8f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f008401a040 tx=0x7f0084009240 comp rx=0 tx=0).stop 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 -- 172.21.15.114:0/1421882919 shutdown_connections 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.114:6835/105000653,v1:172.21.15.114:6837/105000653] conn(0x5612614d4920 0x5612615223e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x561261511670 0x561261521ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5612614d4000 0x56126157c8f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 --2- 172.21.15.114:0/1421882919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5612614d36e0 0x56126157c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0072a00640 0 client.5898 ms_handle_reset on v2:172.21.15.114:6835/105000653 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 -- 172.21.15.114:0/1421882919 >> 172.21.15.114:0/1421882919 conn(0x56126151e010 msgr2=0x5612614d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 -- 172.21.15.114:0/1421882919 shutdown_connections 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 1 -- 172.21.15.114:0/1421882919 wait complete. 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f009b6e9000 20 client.5898 trim_cache size 0 max 16384 2024-02-17T12:18:13.105 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "718e3165-e11b-4138-adc9-584dcfeb6e24", 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5709, 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.320610129, 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 33, 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 50, 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 50, 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 16.308694391 2024-02-17T12:18:13.106 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:18:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 -- 172.21.15.114:0/2307193603 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0074066e40 msgr2=0x7f0074069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0074066e40 0x7f0074069300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f00840af000 tx=0x7f0084008040 comp rx=0 tx=0).stop 2024-02-17T12:18:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 -- 172.21.15.114:0/2307193603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 msgr2=0x7f0090141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 0x7f0090141cd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f008000c550 tx=0x7f008000ca10 comp rx=0 tx=0).stop 2024-02-17T12:18:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 -- 172.21.15.114:0/2307193603 shutdown_connections 2024-02-17T12:18:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0090150490 0x7f00900c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00900c25a0 0x7f00900c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0074066e40 0x7f0074069300 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 --2- 172.21.15.114:0/2307193603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f009006db50 0x7f0090141cd0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 -- 172.21.15.114:0/2307193603 >> 172.21.15.114:0/2307193603 conn(0x7f00900a8490 msgr2=0x7f0090149d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:13.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 -- 172.21.15.114:0/2307193603 shutdown_connections 2024-02-17T12:18:13.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.097+0000 7f0098200640 1 -- 172.21.15.114:0/2307193603 wait complete. 2024-02-17T12:18:13.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:18:13.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f4b000640 1 Processor -- start 2024-02-17T12:18:13.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f4b000640 1 -- start start 2024-02-17T12:18:13.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f4b000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1f4414f110 0x7f1f440c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f4b000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1f440c2580 0x7f1f440aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f4b000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f440a9420 con 0x7f1f440c1eb0 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f4b000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4414f4f0 con 0x7f1f4414f110 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f4b000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440aae80 con 0x7f1f440c2580 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f43e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1f4414f110 0x7f1f440c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f49000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1f440c1eb0 0x7f1f44155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33052/0 (socket says 172.21.15.114:33052) 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f49000640 1 -- 172.21.15.114:0/1561365614 learned_addr learned my addr 172.21.15.114:0/1561365614 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.253+0000 7f1f43400640 1 --2- 172.21.15.114:0/1561365614 >> v2:172.21.15.116:3300/0 conn(0x7f1f440c2580 0x7f1f440aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f43e00640 1 -- 172.21.15.114:0/1561365614 >> v2:172.21.15.116:3300/0 conn(0x7f1f440c2580 msgr2=0x7f1f440aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f43e00640 1 --2- 172.21.15.114:0/1561365614 >> v2:172.21.15.116:3300/0 conn(0x7f1f440c2580 0x7f1f440aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f43e00640 1 -- 172.21.15.114:0/1561365614 >> v1:172.21.15.114:6789/0 conn(0x7f1f440c1eb0 legacy=0x7f1f44155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f43e00640 1 -- 172.21.15.114:0/1561365614 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44152850 con 0x7f1f4414f110 2024-02-17T12:18:13.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f42a00640 1 -- 172.21.15.114:0/1561365614 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055038829 0 0) 0x7f1f440a9420 con 0x7f1f440c1eb0 2024-02-17T12:18:13.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f43e00640 1 --2- 172.21.15.114:0/1561365614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 0x7f1f440c65a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1f4406f0d0 tx=0x7f1f3401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22e5a0e597e89b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:13.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f42a00640 1 -- 172.21.15.114:0/1561365614 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340ac620 con 0x7f1f4414f110 2024-02-17T12:18:13.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f42a00640 1 -- 172.21.15.114:0/1561365614 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f340ac780 con 0x7f1f4414f110 2024-02-17T12:18:13.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f42a00640 1 -- 172.21.15.114:0/1561365614 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340acb10 con 0x7f1f4414f110 2024-02-17T12:18:13.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f4b000640 1 -- 172.21.15.114:0/1561365614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 msgr2=0x7f1f440c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f4b000640 1 --2- 172.21.15.114:0/1561365614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 0x7f1f440c65a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1f4406f0d0 tx=0x7f1f3401c3c0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f4b000640 1 -- 172.21.15.114:0/1561365614 shutdown_connections 2024-02-17T12:18:13.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f4b000640 1 --2- 172.21.15.114:0/1561365614 >> v2:172.21.15.116:3300/0 conn(0x7f1f440c2580 0x7f1f440aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f4b000640 1 --2- 172.21.15.114:0/1561365614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 0x7f1f440c65a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f4b000640 1 -- 172.21.15.114:0/1561365614 >> 172.21.15.114:0/1561365614 conn(0x7f1f440a8490 msgr2=0x7f1f440a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:13.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f4b000640 1 -- 172.21.15.114:0/1561365614 shutdown_connections 2024-02-17T12:18:13.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.257+0000 7f1f4b000640 1 -- 172.21.15.114:0/1561365614 wait complete. 2024-02-17T12:18:13.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f4b000640 1 Processor -- start 2024-02-17T12:18:13.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f4b000640 1 -- start start 2024-02-17T12:18:13.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f4b000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f440c1eb0 0x7f1f440bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f4b000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f440c2580 0x7f1f44153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f4b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 0x7f1f441535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f4b000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441ee8c0 con 0x7f1f4414f110 2024-02-17T12:18:13.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f4b000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440c46e0 con 0x7f1f440c2580 2024-02-17T12:18:13.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f4b000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441ee340 con 0x7f1f440c1eb0 2024-02-17T12:18:13.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f49000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 0x7f1f441535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f49000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 0x7f1f441535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41878/0 (socket says 172.21.15.114:41878) 2024-02-17T12:18:13.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f49000640 1 -- 172.21.15.114:0/541684231 learned_addr learned my addr 172.21.15.114:0/541684231 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:13.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f43e00640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f440c1eb0 0x7f1f440bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f43400640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f440c2580 0x7f1f44153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f49000640 1 -- 172.21.15.114:0/541684231 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f440c1eb0 msgr2=0x7f1f440bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f49000640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f440c1eb0 0x7f1f440bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f49000640 1 -- 172.21.15.114:0/541684231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f440c2580 msgr2=0x7f1f44153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f49000640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f440c2580 0x7f1f44153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f49000640 1 -- 172.21.15.114:0/541684231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f34009420 con 0x7f1f4414f110 2024-02-17T12:18:13.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f43400640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f440c2580 0x7f1f44153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:13.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f49000640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 0x7f1f441535a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c7d0 tx=0x7f1f3c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:13.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f3be00640 1 -- 172.21.15.114:0/541684231 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00a640 con 0x7f1f4414f110 2024-02-17T12:18:13.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f3be00640 1 -- 172.21.15.114:0/541684231 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00a7a0 con 0x7f1f4414f110 2024-02-17T12:18:13.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f4b000640 1 -- 172.21.15.114:0/541684231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f441ee5e0 con 0x7f1f4414f110 2024-02-17T12:18:13.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f3be00640 1 -- 172.21.15.114:0/541684231 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00ab90 con 0x7f1f4414f110 2024-02-17T12:18:13.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.261+0000 7f1f4b000640 1 -- 172.21.15.114:0/541684231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f440c4370 con 0x7f1f4414f110 2024-02-17T12:18:13.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.265+0000 7f1f4b000640 1 -- 172.21.15.114:0/541684231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f44074840 con 0x7f1f4414f110 2024-02-17T12:18:13.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.265+0000 7f1f3be00640 1 -- 172.21.15.114:0/541684231 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1f3c00acf0 con 0x7f1f4414f110 2024-02-17T12:18:13.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.265+0000 7f1f3be00640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f24066e40 0x7f1f24069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:13.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.265+0000 7f1f3be00640 1 -- 172.21.15.114:0/541684231 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f3c084290 con 0x7f1f4414f110 2024-02-17T12:18:13.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.265+0000 7f1f43e00640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f24066e40 0x7f1f24069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:13.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.265+0000 7f1f43e00640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f24066e40 0x7f1f24069300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f340ae000 tx=0x7f1f340a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:13.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.269+0000 7f1f3be00640 1 -- 172.21.15.114:0/541684231 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1f3c051070 con 0x7f1f4414f110 2024-02-17T12:18:13.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.461+0000 7f1f4b000640 1 -- 172.21.15.114:0/541684231 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1f440c1380 con 0x7f1f4414f110 2024-02-17T12:18:13.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.461+0000 7f1f3be00640 1 -- 172.21.15.114:0/541684231 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1f3c054730 con 0x7f1f4414f110 2024-02-17T12:18:13.466 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:18:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 -- 172.21.15.114:0/541684231 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f24066e40 msgr2=0x7f1f24069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f24066e40 0x7f1f24069300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f340ae000 tx=0x7f1f340a7000 comp rx=0 tx=0).stop 2024-02-17T12:18:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 -- 172.21.15.114:0/541684231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 msgr2=0x7f1f441535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 0x7f1f441535a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c7d0 tx=0x7f1f3c00cc90 comp rx=0 tx=0).stop 2024-02-17T12:18:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 -- 172.21.15.114:0/541684231 shutdown_connections 2024-02-17T12:18:13.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f24066e40 0x7f1f24069300 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f4414f110 0x7f1f441535a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f440c2580 0x7f1f44153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 --2- 172.21.15.114:0/541684231 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1f440c1eb0 0x7f1f440bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:13.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 -- 172.21.15.114:0/541684231 >> 172.21.15.114:0/541684231 conn(0x7f1f440a8490 msgr2=0x7f1f440a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:13.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 -- 172.21.15.114:0/541684231 shutdown_connections 2024-02-17T12:18:13.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:13.465+0000 7f1f4b000640 1 -- 172.21.15.114:0/541684231 wait complete. 2024-02-17T12:18:13.487 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T12:18:13.487 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:18:13.487 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-02-17T12:18:13.487 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-17T12:18:13.487 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:18:13.487 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T12:18:13.487 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:18:13.487 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:18:13.488 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:18:13.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:13.488 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-02-17T12:18:13.497 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:18:13.497 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:18:13.497 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:18:13.497 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:13.497 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-02-17T12:18:13.497 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:13.497 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:13.497 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:13.497 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-02-17T12:18:13.497 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42393sec preferred_lft 42393sec 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:a0:c1:dc:19 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:18:13.498 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:13.499 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:18:13.499 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:13.499 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:18:13.499 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:13.499 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:18:13.499 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:13.499 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:18:13.499 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:18:13.499 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:18:13.499 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:13.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:13.500 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:18:13.560 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-02-17T12:18:13.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:13.562 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-02-17T12:18:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-02-17T12:18:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:18:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:18:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:18:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:18:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:18:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:18:13.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:13.618 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:18:13.618 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:18:13.618 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:18:13.618 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:18:13.618 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:18:13.618 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:18:13.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:13.706 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-02-17T12:18:13.714 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T12:18:13.715 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:18:13.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:13.715 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-02-17T12:18:13.778 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:18:13.778 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T12:18:13.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:18:13.826 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:18:13.877 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:18:13.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:13.878 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:18:13.964 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:18:13.965 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:18:13.965 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:18:13.979 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:18:13.979 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:18:13.980 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:18:13.980 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:18:13.980 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:18:13.988 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:18:13.988 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:18:13.988 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:18:13.989 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:18:13.989 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:18:13.989 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:18:13.989 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:18:13.989 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:18:13.993 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:18:13.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:13.993 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:18:14.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:14.057 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:18:14.113 INFO:teuthology.orchestra.run.smithi114.stdout:client5324 2024-02-17T12:18:14.113 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:18:14.114 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:14.163 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:18:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c67c00640 1 Processor -- start 2024-02-17T12:18:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c67c00640 1 -- start start 2024-02-17T12:18:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c67c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 0x7f0c600c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c67c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c600c2580 0x7f0c600aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c67c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0c600c1eb0 0x7f0c60155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c67c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6014f4f0 con 0x7f0c600c2580 2024-02-17T12:18:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c67c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c600aae80 con 0x7f0c600c1eb0 2024-02-17T12:18:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c67c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600a9420 con 0x7f0c6014f110 2024-02-17T12:18:14.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c5fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c600c2580 0x7f0c600aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:14.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c5fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c600c2580 0x7f0c600aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41884/0 (socket says 172.21.15.114:41884) 2024-02-17T12:18:14.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c5fe00640 1 -- 172.21.15.114:0/2207480631 learned_addr learned my addr 172.21.15.114:0/2207480631 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:14.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c65c00640 1 --2- 172.21.15.114:0/2207480631 >> v2:172.21.15.116:3300/0 conn(0x7f0c600c1eb0 0x7f0c60155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:14.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.341+0000 7f0c65200640 1 --2- 172.21.15.114:0/2207480631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 0x7f0c600c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:14.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c5fe00640 1 -- 172.21.15.114:0/2207480631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 msgr2=0x7f0c600c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:14.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c5fe00640 1 --2- 172.21.15.114:0/2207480631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 0x7f0c600c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c5fe00640 1 -- 172.21.15.114:0/2207480631 >> v2:172.21.15.116:3300/0 conn(0x7f0c600c1eb0 msgr2=0x7f0c60155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:14.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c5fe00640 1 --2- 172.21.15.114:0/2207480631 >> v2:172.21.15.116:3300/0 conn(0x7f0c600c1eb0 0x7f0c60155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c5fe00640 1 -- 172.21.15.114:0/2207480631 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c60152850 con 0x7f0c600c2580 2024-02-17T12:18:14.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c5fe00640 1 --2- 172.21.15.114:0/2207480631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c2580 0x7f0c600aa150 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0c600c1090 tx=0x7f0c4c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b181218a63863ac server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c5f400640 1 -- 172.21.15.114:0/2207480631 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0ab620 con 0x7f0c600c2580 2024-02-17T12:18:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c5f400640 1 -- 172.21.15.114:0/2207480631 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c0ab780 con 0x7f0c600c2580 2024-02-17T12:18:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c5f400640 1 -- 172.21.15.114:0/2207480631 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0abb10 con 0x7f0c600c2580 2024-02-17T12:18:14.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c67c00640 1 -- 172.21.15.114:0/2207480631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c2580 msgr2=0x7f0c600aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c67c00640 1 --2- 172.21.15.114:0/2207480631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c2580 0x7f0c600aa150 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0c600c1090 tx=0x7f0c4c01c460 comp rx=0 tx=0).stop 2024-02-17T12:18:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c67c00640 1 -- 172.21.15.114:0/2207480631 shutdown_connections 2024-02-17T12:18:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c67c00640 1 --2- 172.21.15.114:0/2207480631 >> v2:172.21.15.116:3300/0 conn(0x7f0c600c1eb0 0x7f0c60155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c67c00640 1 --2- 172.21.15.114:0/2207480631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c2580 0x7f0c600aa150 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c67c00640 1 --2- 172.21.15.114:0/2207480631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 0x7f0c600c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c67c00640 1 -- 172.21.15.114:0/2207480631 >> 172.21.15.114:0/2207480631 conn(0x7f0c600a8490 msgr2=0x7f0c600a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c67c00640 1 -- 172.21.15.114:0/2207480631 shutdown_connections 2024-02-17T12:18:14.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.345+0000 7f0c67c00640 1 -- 172.21.15.114:0/2207480631 wait complete. 2024-02-17T12:18:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c67c00640 1 Processor -- start 2024-02-17T12:18:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c67c00640 1 -- start start 2024-02-17T12:18:14.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c67c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c1eb0 0x7f0c60154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c67c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c600c2580 0x7f0c601ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c67c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 0x7f0c600c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c67c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60142c00 con 0x7f0c600c1eb0 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c67c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60154af0 con 0x7f0c600c2580 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c67c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c601efdc0 con 0x7f0c6014f110 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c1eb0 0x7f0c60154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c1eb0 0x7f0c60154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41896/0 (socket says 172.21.15.114:41896) 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65200640 1 -- 172.21.15.114:0/1868304408 learned_addr learned my addr 172.21.15.114:0/1868304408 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65c00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 0x7f0c600c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c5fe00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c600c2580 0x7f0c601ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65200640 1 -- 172.21.15.114:0/1868304408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 msgr2=0x7f0c600c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65200640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 0x7f0c600c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65200640 1 -- 172.21.15.114:0/1868304408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c600c2580 msgr2=0x7f0c601ef0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65200640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c600c2580 0x7f0c601ef0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65200640 1 -- 172.21.15.114:0/1868304408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0094d0 con 0x7f0c600c1eb0 2024-02-17T12:18:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65c00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 0x7f0c600c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c65200640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c1eb0 0x7f0c60154230 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400d830 tx=0x7f0c5400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c5cc00640 1 -- 172.21.15.114:0/1868304408 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400b6c0 con 0x7f0c600c1eb0 2024-02-17T12:18:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c5cc00640 1 -- 172.21.15.114:0/1868304408 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5400b820 con 0x7f0c600c1eb0 2024-02-17T12:18:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c67c00640 1 -- 172.21.15.114:0/1868304408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c600c5bc0 con 0x7f0c600c1eb0 2024-02-17T12:18:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c5cc00640 1 -- 172.21.15.114:0/1868304408 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400bb90 con 0x7f0c600c1eb0 2024-02-17T12:18:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.349+0000 7f0c67c00640 1 -- 172.21.15.114:0/1868304408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c60154d20 con 0x7f0c600c1eb0 2024-02-17T12:18:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.353+0000 7f0c67c00640 1 -- 172.21.15.114:0/1868304408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c60074840 con 0x7f0c600c1eb0 2024-02-17T12:18:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.353+0000 7f0c5cc00640 1 -- 172.21.15.114:0/1868304408 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0c5401e460 con 0x7f0c600c1eb0 2024-02-17T12:18:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.353+0000 7f0c5cc00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0c40066e40 0x7f0c40069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.353+0000 7f0c5cc00640 1 -- 172.21.15.114:0/1868304408 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c54085190 con 0x7f0c600c1eb0 2024-02-17T12:18:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.353+0000 7f0c5fe00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0c40066e40 0x7f0c40069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.353+0000 7f0c5fe00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0c40066e40 0x7f0c40069300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0af000 tx=0x7f0c4c0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.357+0000 7f0c5cc00640 1 -- 172.21.15.114:0/1868304408 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0c54051f70 con 0x7f0c600c1eb0 2024-02-17T12:18:14.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.545+0000 7f0c67c00640 1 -- 172.21.15.114:0/1868304408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0c600c1380 con 0x7f0c600c1eb0 2024-02-17T12:18:14.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.545+0000 7f0c5cc00640 1 -- 172.21.15.114:0/1868304408 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0c54055630 con 0x7f0c600c1eb0 2024-02-17T12:18:14.550 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:18:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 -- 172.21.15.114:0/1868304408 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0c40066e40 msgr2=0x7f0c40069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0c40066e40 0x7f0c40069300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0af000 tx=0x7f0c4c0b6040 comp rx=0 tx=0).stop 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 -- 172.21.15.114:0/1868304408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c1eb0 msgr2=0x7f0c60154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c1eb0 0x7f0c60154230 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400d830 tx=0x7f0c5400dcf0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 -- 172.21.15.114:0/1868304408 shutdown_connections 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0c6014f110 0x7f0c600c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0c600c2580 0x7f0c601ef0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0c40066e40 0x7f0c40069300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 --2- 172.21.15.114:0/1868304408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c600c1eb0 0x7f0c60154230 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 -- 172.21.15.114:0/1868304408 >> 172.21.15.114:0/1868304408 conn(0x7f0c600a8490 msgr2=0x7f0c6006dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 -- 172.21.15.114:0/1868304408 shutdown_connections 2024-02-17T12:18:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:14.549+0000 7f0c67c00640 1 -- 172.21.15.114:0/1868304408 wait complete. 2024-02-17T12:18:14.571 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T12:18:14.571 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:18:14.571 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-17T12:18:14.572 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-17T12:18:14.572 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T12:18:14.572 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T12:18:14.572 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:18:14.572 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:18:14.572 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:18:14.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:14.572 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-17T12:18:14.582 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:18:14.582 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:18:14.582 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:18:14.582 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:14.582 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-17T12:18:14.582 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42221sec preferred_lft 42221sec 2024-02-17T12:18:14.583 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 02:42:58:59:74:79 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:18:14.584 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T12:18:14.585 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:18:14.585 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:14.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:14.586 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:18:14.649 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-17T12:18:14.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:14.651 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-17T12:18:14.705 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-17T12:18:14.705 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:18:14.705 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:18:14.705 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:18:14.705 INFO:teuthology.orchestra.run.smithi116.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:18:14.705 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:18:14.705 INFO:teuthology.orchestra.run.smithi116.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:14.706 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:14.706 INFO:teuthology.orchestra.run.smithi116.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:14.706 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:18:14.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:14.706 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:18:14.706 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:18:14.706 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:18:14.706 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:18:14.706 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:18:14.706 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:18:14.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:14.803 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-17T12:18:14.811 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-17T12:18:14.812 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:18:14.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:14.812 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-02-17T12:18:14.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:18:14.874 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-17T12:18:14.926 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:18:14.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:18:14.927 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:18:14.977 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:18:14.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:14.977 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:18:15.069 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:18:15.069 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:18:15.069 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:18:15.085 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:18:15.085 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:18:15.085 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:18:15.085 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:18:15.085 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:18:15.095 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:18:15.095 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:18:15.095 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:18:15.095 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:18:15.095 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:18:15.095 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:18:15.095 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:18:15.095 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:18:15.099 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:18:15.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:15.100 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:18:15.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:15.119 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:18:15.176 INFO:teuthology.orchestra.run.smithi116.stdout:client5333 2024-02-17T12:18:15.177 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:18:15.177 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:15.226 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-02-17T12:18:15.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.365+0000 7fa34dc00640 1 Processor -- start 2024-02-17T12:18:15.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.365+0000 7fa34dc00640 1 -- start start 2024-02-17T12:18:15.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.365+0000 7fa34dc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3480c58b0 0x7fa3481583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.365+0000 7fa34dc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480a6360 0x7fa348155520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.365+0000 7fa34dc00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa348155090 con 0x7fa3480c4b30 2024-02-17T12:18:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.365+0000 7fa34dc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3480c6110 con 0x7fa3480c58b0 2024-02-17T12:18:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.365+0000 7fa34dc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa348159300 con 0x7fa3480a6360 2024-02-17T12:18:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.365+0000 7fa346a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3480c58b0 0x7fa3481583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.365+0000 7fa346a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3480c58b0 0x7fa3481583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35262/0 (socket says 172.21.15.114:35262) 2024-02-17T12:18:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.365+0000 7fa346a00640 1 -- 172.21.15.114:0/1294432202 learned_addr learned my addr 172.21.15.114:0/1294432202 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa347400640 1 --2- 172.21.15.114:0/1294432202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480a6360 0x7fa348155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa346a00640 1 -- 172.21.15.114:0/1294432202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480a6360 msgr2=0x7fa348155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:15.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa346a00640 1 --2- 172.21.15.114:0/1294432202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480a6360 0x7fa348155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa346a00640 1 -- 172.21.15.114:0/1294432202 >> v1:172.21.15.116:6789/0 conn(0x7fa3480c4b30 legacy=0x7fa34806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa346a00640 1 -- 172.21.15.114:0/1294432202 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa348158a60 con 0x7fa3480c58b0 2024-02-17T12:18:15.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa347400640 1 --2- 172.21.15.114:0/1294432202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480a6360 0x7fa348155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:15.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa346a00640 1 --2- 172.21.15.114:0/1294432202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 0x7fa3481583d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa338009e50 tx=0x7fa33801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53eb479427a4c975 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:15.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa345600640 1 -- 172.21.15.114:0/1294432202 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3380a57e0 con 0x7fa3480c58b0 2024-02-17T12:18:15.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa345600640 1 -- 172.21.15.114:0/1294432202 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3380a5940 con 0x7fa3480c58b0 2024-02-17T12:18:15.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa345600640 1 -- 172.21.15.114:0/1294432202 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3380a5cd0 con 0x7fa3480c58b0 2024-02-17T12:18:15.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa34dc00640 1 -- 172.21.15.114:0/1294432202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 msgr2=0x7fa3481583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa34dc00640 1 --2- 172.21.15.114:0/1294432202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 0x7fa3481583d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa338009e50 tx=0x7fa33801ca00 comp rx=0 tx=0).stop 2024-02-17T12:18:15.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa34dc00640 1 -- 172.21.15.114:0/1294432202 shutdown_connections 2024-02-17T12:18:15.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa34dc00640 1 --2- 172.21.15.114:0/1294432202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480a6360 0x7fa348155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa34dc00640 1 --2- 172.21.15.114:0/1294432202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 0x7fa3481583d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.369+0000 7fa34dc00640 1 -- 172.21.15.114:0/1294432202 >> 172.21.15.114:0/1294432202 conn(0x7fa3480c3730 msgr2=0x7fa3480c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:15.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 -- 172.21.15.114:0/1294432202 shutdown_connections 2024-02-17T12:18:15.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 -- 172.21.15.114:0/1294432202 wait complete. 2024-02-17T12:18:15.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 Processor -- start 2024-02-17T12:18:15.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 -- start start 2024-02-17T12:18:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3480a6360 0x7fa3480a8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480c4b30 0x7fa34814b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 0x7fa34814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa348157130 con 0x7fa3480c58b0 2024-02-17T12:18:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa348157e20 con 0x7fa3480a6360 2024-02-17T12:18:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34814c310 con 0x7fa3480c4b30 2024-02-17T12:18:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa347400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 0x7fa34814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa347400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 0x7fa34814ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35278/0 (socket says 172.21.15.114:35278) 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa347400640 1 -- 172.21.15.114:0/3688853997 learned_addr learned my addr 172.21.15.114:0/3688853997 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa346000640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480c4b30 0x7fa34814b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa346a00640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3480a6360 0x7fa3480a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa347400640 1 -- 172.21.15.114:0/3688853997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480c4b30 msgr2=0x7fa34814b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa347400640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480c4b30 0x7fa34814b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa347400640 1 -- 172.21.15.114:0/3688853997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3480a6360 msgr2=0x7fa3480a8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa347400640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3480a6360 0x7fa3480a8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa347400640 1 -- 172.21.15.114:0/3688853997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338009b30 con 0x7fa3480c58b0 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa347400640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 0x7fa34814ba50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa34000e810 tx=0x7fa34000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa33ea00640 1 -- 172.21.15.114:0/3688853997 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000c6d0 con 0x7fa3480c58b0 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa33ea00640 1 -- 172.21.15.114:0/3688853997 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34000c830 con 0x7fa3480c58b0 2024-02-17T12:18:15.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 -- 172.21.15.114:0/3688853997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3480a6dc0 con 0x7fa3480c58b0 2024-02-17T12:18:15.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa33ea00640 1 -- 172.21.15.114:0/3688853997 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000cbe0 con 0x7fa3480c58b0 2024-02-17T12:18:15.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.373+0000 7fa34dc00640 1 -- 172.21.15.114:0/3688853997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3480a7380 con 0x7fa3480c58b0 2024-02-17T12:18:15.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.377+0000 7fa34dc00640 1 -- 172.21.15.114:0/3688853997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa348067170 con 0x7fa3480c58b0 2024-02-17T12:18:15.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.377+0000 7fa33ea00640 1 -- 172.21.15.114:0/3688853997 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa34000cd40 con 0x7fa3480c58b0 2024-02-17T12:18:15.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.377+0000 7fa33ea00640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa324066e40 0x7fa324069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.377+0000 7fa33ea00640 1 -- 172.21.15.114:0/3688853997 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3400847d0 con 0x7fa3480c58b0 2024-02-17T12:18:15.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.377+0000 7fa346a00640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa324066e40 0x7fa324069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.377+0000 7fa346a00640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa324066e40 0x7fa324069300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa3380ae000 tx=0x7fa3380a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:15.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.381+0000 7fa33ea00640 1 -- 172.21.15.114:0/3688853997 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa3400515d0 con 0x7fa3480c58b0 2024-02-17T12:18:15.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 -- 172.21.15.114:0/3688853997 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fa3480a6c20 con 0x7fa3480c58b0 2024-02-17T12:18:15.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa33ea00640 1 -- 172.21.15.114:0/3688853997 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v13) v1 ==== 84+0+0 (secure 0 0 0) 0x7fa3480a6c20 con 0x7fa3480c58b0 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 -- 172.21.15.114:0/3688853997 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa324066e40 msgr2=0x7fa324069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa324066e40 0x7fa324069300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa3380ae000 tx=0x7fa3380a7070 comp rx=0 tx=0).stop 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 -- 172.21.15.114:0/3688853997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 msgr2=0x7fa34814ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 0x7fa34814ba50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa34000e810 tx=0x7fa34000ecd0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 -- 172.21.15.114:0/3688853997 shutdown_connections 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa324066e40 0x7fa324069300 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3480c58b0 0x7fa34814ba50 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3480c4b30 0x7fa34814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 --2- 172.21.15.114:0/3688853997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3480a6360 0x7fa3480a8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 -- 172.21.15.114:0/3688853997 >> 172.21.15.114:0/3688853997 conn(0x7fa3480c3730 msgr2=0x7fa348153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 -- 172.21.15.114:0/3688853997 shutdown_connections 2024-02-17T12:18:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.589+0000 7fa34dc00640 1 -- 172.21.15.114:0/3688853997 wait complete. 2024-02-17T12:18:15.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:15.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc761800640 1 Processor -- start 2024-02-17T12:18:15.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc761800640 1 -- start start 2024-02-17T12:18:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc761800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc75c14f110 0x7fc75c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc761800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc75c0c1eb0 0x7fc75c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc761800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0a9420 con 0x7fc75c0c2580 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc761800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c14f4f0 con 0x7fc75c0c1eb0 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc761800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c0aae80 con 0x7fc75c14f110 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc75b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc75c0c1eb0 0x7fc75c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc75b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc75c0c1eb0 0x7fc75c15c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35286/0 (socket says 172.21.15.114:35286) 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc75b400640 1 -- 172.21.15.114:0/766679089 learned_addr learned my addr 172.21.15.114:0/766679089 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc75aa00640 1 --2- 172.21.15.114:0/766679089 >> v2:172.21.15.116:3300/0 conn(0x7fc75c14f110 0x7fc75c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc75b400640 1 -- 172.21.15.114:0/766679089 >> v2:172.21.15.116:3300/0 conn(0x7fc75c14f110 msgr2=0x7fc75c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc75b400640 1 --2- 172.21.15.114:0/766679089 >> v2:172.21.15.116:3300/0 conn(0x7fc75c14f110 0x7fc75c0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc75b400640 1 -- 172.21.15.114:0/766679089 >> v1:172.21.15.116:6789/0 conn(0x7fc75c0c2580 legacy=0x7fc75c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc75b400640 1 -- 172.21.15.114:0/766679089 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c152850 con 0x7fc75c0c1eb0 2024-02-17T12:18:15.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.745+0000 7fc75aa00640 1 --2- 172.21.15.114:0/766679089 >> v2:172.21.15.116:3300/0 conn(0x7fc75c14f110 0x7fc75c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc75b400640 1 --2- 172.21.15.114:0/766679089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c1eb0 0x7fc75c15c390 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc75c06dc70 tx=0x7fc75401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8feb29dcf068900d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc759600640 1 -- 172.21.15.114:0/766679089 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540a57f0 con 0x7fc75c0c1eb0 2024-02-17T12:18:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc759600640 1 -- 172.21.15.114:0/766679089 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7540a5950 con 0x7fc75c0c1eb0 2024-02-17T12:18:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc759600640 1 -- 172.21.15.114:0/766679089 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540a5ce0 con 0x7fc75c0c1eb0 2024-02-17T12:18:15.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc761800640 1 -- 172.21.15.114:0/766679089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c1eb0 msgr2=0x7fc75c15c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc761800640 1 --2- 172.21.15.114:0/766679089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c1eb0 0x7fc75c15c390 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc75c06dc70 tx=0x7fc75401c930 comp rx=0 tx=0).stop 2024-02-17T12:18:15.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc761800640 1 -- 172.21.15.114:0/766679089 shutdown_connections 2024-02-17T12:18:15.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc761800640 1 --2- 172.21.15.114:0/766679089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c1eb0 0x7fc75c15c390 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc761800640 1 --2- 172.21.15.114:0/766679089 >> v2:172.21.15.116:3300/0 conn(0x7fc75c14f110 0x7fc75c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc761800640 1 -- 172.21.15.114:0/766679089 >> 172.21.15.114:0/766679089 conn(0x7fc75c0a8490 msgr2=0x7fc75c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:15.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc761800640 1 -- 172.21.15.114:0/766679089 shutdown_connections 2024-02-17T12:18:15.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.749+0000 7fc761800640 1 -- 172.21.15.114:0/766679089 wait complete. 2024-02-17T12:18:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 Processor -- start 2024-02-17T12:18:15.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 -- start start 2024-02-17T12:18:15.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc75c0c1eb0 0x7fc75c1f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c2580 0x7fc75c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc75c14f110 0x7fc75c0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c15e830 con 0x7fc75c0c2580 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c141cf0 con 0x7fc75c0c1eb0 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c141f40 con 0x7fc75c14f110 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c2580 0x7fc75c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75aa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc75c0c1eb0 0x7fc75c1f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c2580 0x7fc75c15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35292/0 (socket says 172.21.15.114:35292) 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75a000640 1 -- 172.21.15.114:0/349340066 learned_addr learned my addr 172.21.15.114:0/349340066 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75b400640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc75c14f110 0x7fc75c0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75a000640 1 -- 172.21.15.114:0/349340066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc75c14f110 msgr2=0x7fc75c0bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75a000640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc75c14f110 0x7fc75c0bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75a000640 1 -- 172.21.15.114:0/349340066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc75c0c1eb0 msgr2=0x7fc75c1f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75a000640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc75c0c1eb0 0x7fc75c1f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75a000640 1 -- 172.21.15.114:0/349340066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc754009b30 con 0x7fc75c0c2580 2024-02-17T12:18:15.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75aa00640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc75c0c1eb0 0x7fc75c1f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc75a000640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c2580 0x7fc75c15e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c430 tx=0x7fc74800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc752a00640 1 -- 172.21.15.114:0/349340066 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480052d0 con 0x7fc75c0c2580 2024-02-17T12:18:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc752a00640 1 -- 172.21.15.114:0/349340066 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748005430 con 0x7fc75c0c2580 2024-02-17T12:18:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc752a00640 1 -- 172.21.15.114:0/349340066 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748007260 con 0x7fc75c0c2580 2024-02-17T12:18:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 -- 172.21.15.114:0/349340066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c1f0d40 con 0x7fc75c0c2580 2024-02-17T12:18:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 -- 172.21.15.114:0/349340066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c1f1300 con 0x7fc75c0c2580 2024-02-17T12:18:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.753+0000 7fc761800640 1 -- 172.21.15.114:0/349340066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c1f14f0 con 0x7fc75c0c2580 2024-02-17T12:18:15.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.757+0000 7fc752a00640 1 -- 172.21.15.114:0/349340066 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fc7480073c0 con 0x7fc75c0c2580 2024-02-17T12:18:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.757+0000 7fc752a00640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc73c066e40 0x7fc73c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.757+0000 7fc752a00640 1 -- 172.21.15.114:0/349340066 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc748083dd0 con 0x7fc75c0c2580 2024-02-17T12:18:15.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.757+0000 7fc75aa00640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc73c066e40 0x7fc73c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:15.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.757+0000 7fc75aa00640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc73c066e40 0x7fc73c069300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009d40 tx=0x7fc74c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:15.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.761+0000 7fc752a00640 1 -- 172.21.15.114:0/349340066 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc748050c60 con 0x7fc75c0c2580 2024-02-17T12:18:15.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.913+0000 7fc761800640 1 -- 172.21.15.114:0/349340066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc75c074840 con 0x7fc75c0c2580 2024-02-17T12:18:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc752a00640 1 -- 172.21.15.114:0/349340066 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16677 (secure 0 0 0) 0x7fc748054320 con 0x7fc75c0c2580 2024-02-17T12:18:15.919 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:15.920 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":50,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:03.787001+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 -- 172.21.15.114:0/349340066 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc73c066e40 msgr2=0x7fc73c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc73c066e40 0x7fc73c069300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009d40 tx=0x7fc74c008040 comp rx=0 tx=0).stop 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 -- 172.21.15.114:0/349340066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c2580 msgr2=0x7fc75c15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c2580 0x7fc75c15e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c430 tx=0x7fc74800c8f0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 -- 172.21.15.114:0/349340066 shutdown_connections 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc75c14f110 0x7fc75c0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc73c066e40 0x7fc73c069300 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75c0c2580 0x7fc75c15e2f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 --2- 172.21.15.114:0/349340066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc75c0c1eb0 0x7fc75c1f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 -- 172.21.15.114:0/349340066 >> 172.21.15.114:0/349340066 conn(0x7fc75c0a8490 msgr2=0x7fc75c0c29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 -- 172.21.15.114:0/349340066 shutdown_connections 2024-02-17T12:18:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:15.917+0000 7fc761800640 1 -- 172.21.15.114:0/349340066 wait complete. 2024-02-17T12:18:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:17:59.900395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:18:01.152214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:18:15.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:18:16.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0326200640 1 Processor -- start 2024-02-17T12:18:16.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0326200640 1 -- start start 2024-02-17T12:18:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0326200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f032006ef60 0x7f0320158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0326200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032006e890 con 0x7f03200c0640 2024-02-17T12:18:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0326200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0320158370 con 0x7f0320152510 2024-02-17T12:18:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0326200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03200c2670 con 0x7f032006ef60 2024-02-17T12:18:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0316a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f032006ef60 0x7f0320158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f031fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f03200c0640 0x7f032015f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54668/0 (socket says 172.21.15.114:54668) 2024-02-17T12:18:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0316a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f032006ef60 0x7f0320158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35300/0 (socket says 172.21.15.114:35300) 2024-02-17T12:18:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f031fe00640 1 -- 172.21.15.114:0/1256735705 learned_addr learned my addr 172.21.15.114:0/1256735705 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:16.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0316a00640 1 -- 172.21.15.114:0/1256735705 >> v1:172.21.15.116:6789/0 conn(0x7f0320152510 legacy=0x7f03200c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0316a00640 1 -- 172.21.15.114:0/1256735705 >> v1:172.21.15.114:6789/0 conn(0x7f03200c0640 legacy=0x7f032015f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f0316a00640 1 -- 172.21.15.114:0/1256735705 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032006e5b0 con 0x7f032006ef60 2024-02-17T12:18:16.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.077+0000 7f031ea00640 1 -- 172.21.15.114:0/1256735705 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955697223 0 0) 0x7f032006e890 con 0x7f03200c0640 2024-02-17T12:18:16.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f0316a00640 1 --2- 172.21.15.114:0/1256735705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f032006ef60 0x7f0320158800 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f03080097c0 tx=0x7f030801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79578f06e181b1bc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:16.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f031ea00640 1 -- 172.21.15.114:0/1256735705 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03080ac640 con 0x7f032006ef60 2024-02-17T12:18:16.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f031ea00640 1 -- 172.21.15.114:0/1256735705 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03080ac7a0 con 0x7f032006ef60 2024-02-17T12:18:16.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f031ea00640 1 -- 172.21.15.114:0/1256735705 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03080acb30 con 0x7f032006ef60 2024-02-17T12:18:16.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f0326200640 1 -- 172.21.15.114:0/1256735705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f032006ef60 msgr2=0x7f0320158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f0326200640 1 --2- 172.21.15.114:0/1256735705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f032006ef60 0x7f0320158800 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f03080097c0 tx=0x7f030801c3e0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f0326200640 1 -- 172.21.15.114:0/1256735705 shutdown_connections 2024-02-17T12:18:16.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f0326200640 1 --2- 172.21.15.114:0/1256735705 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f032006ef60 0x7f0320158800 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f0326200640 1 -- 172.21.15.114:0/1256735705 >> 172.21.15.114:0/1256735705 conn(0x7f03200a8490 msgr2=0x7f03200a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:16.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f0326200640 1 -- 172.21.15.114:0/1256735705 shutdown_connections 2024-02-17T12:18:16.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f0326200640 1 -- 172.21.15.114:0/1256735705 wait complete. 2024-02-17T12:18:16.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f0326200640 1 Processor -- start 2024-02-17T12:18:16.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.081+0000 7f0326200640 1 -- start start 2024-02-17T12:18:16.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0326200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f032006ef60 0x7f03200c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0326200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03200c0640 0x7f0320153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0326200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0320152510 0x7f0320153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0326200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032014ead0 con 0x7f0320152510 2024-02-17T12:18:16.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0326200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0320146aa0 con 0x7f03200c0640 2024-02-17T12:18:16.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0326200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0320141750 con 0x7f032006ef60 2024-02-17T12:18:16.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f031fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0320152510 0x7f0320153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f031fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0320152510 0x7f0320153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35304/0 (socket says 172.21.15.114:35304) 2024-02-17T12:18:16.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f031fe00640 1 -- 172.21.15.114:0/1529121580 learned_addr learned my addr 172.21.15.114:0/1529121580 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:16.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0316a00640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03200c0640 0x7f0320153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f031f400640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f032006ef60 0x7f03200c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f031fe00640 1 -- 172.21.15.114:0/1529121580 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f032006ef60 msgr2=0x7f03200c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f031fe00640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f032006ef60 0x7f03200c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f031fe00640 1 -- 172.21.15.114:0/1529121580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03200c0640 msgr2=0x7f0320153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f031fe00640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03200c0640 0x7f0320153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f031fe00640 1 -- 172.21.15.114:0/1529121580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0308009420 con 0x7f0320152510 2024-02-17T12:18:16.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f031fe00640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0320152510 0x7f0320153eb0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f031800c3e0 tx=0x7f031800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:16.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0317e00640 1 -- 172.21.15.114:0/1529121580 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03180074e0 con 0x7f0320152510 2024-02-17T12:18:16.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0317e00640 1 -- 172.21.15.114:0/1529121580 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0318007660 con 0x7f0320152510 2024-02-17T12:18:16.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0326200640 1 -- 172.21.15.114:0/1529121580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03200c59e0 con 0x7f0320152510 2024-02-17T12:18:16.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0317e00640 1 -- 172.21.15.114:0/1529121580 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318004a30 con 0x7f0320152510 2024-02-17T12:18:16.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0326200640 1 -- 172.21.15.114:0/1529121580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03200c40d0 con 0x7f0320152510 2024-02-17T12:18:16.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0326200640 1 -- 172.21.15.114:0/1529121580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0320074840 con 0x7f0320152510 2024-02-17T12:18:16.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.085+0000 7f0317e00640 1 -- 172.21.15.114:0/1529121580 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0318004b90 con 0x7f0320152510 2024-02-17T12:18:16.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.089+0000 7f0317e00640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02fc066e40 0x7f02fc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.089+0000 7f0317e00640 1 -- 172.21.15.114:0/1529121580 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0318084720 con 0x7f0320152510 2024-02-17T12:18:16.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.089+0000 7f031f400640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02fc066e40 0x7f02fc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.089+0000 7f031f400640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02fc066e40 0x7f02fc069300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f03100012f0 tx=0x7f0310009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:16.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.093+0000 7f0317e00640 1 -- 172.21.15.114:0/1529121580 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0318051500 con 0x7f0320152510 2024-02-17T12:18:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 -- 172.21.15.114:0/1529121580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03200c0420 con 0x7f0320152510 2024-02-17T12:18:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0317e00640 1 -- 172.21.15.114:0/1529121580 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0318001090 con 0x7f0320152510 2024-02-17T12:18:16.252 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:18:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 -- 172.21.15.114:0/1529121580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02fc066e40 msgr2=0x7f02fc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02fc066e40 0x7f02fc069300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f03100012f0 tx=0x7f0310009040 comp rx=0 tx=0).stop 2024-02-17T12:18:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 -- 172.21.15.114:0/1529121580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0320152510 msgr2=0x7f0320153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0320152510 0x7f0320153eb0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f031800c3e0 tx=0x7f031800c8a0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 -- 172.21.15.114:0/1529121580 shutdown_connections 2024-02-17T12:18:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f02fc066e40 0x7f02fc069300 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0320152510 0x7f0320153eb0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03200c0640 0x7f0320153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 --2- 172.21.15.114:0/1529121580 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f032006ef60 0x7f03200c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 -- 172.21.15.114:0/1529121580 >> 172.21.15.114:0/1529121580 conn(0x7f03200a8490 msgr2=0x7f03200c0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 -- 172.21.15.114:0/1529121580 shutdown_connections 2024-02-17T12:18:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.249+0000 7f0326200640 1 -- 172.21.15.114:0/1529121580 wait complete. 2024-02-17T12:18:16.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:18:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.405+0000 7f61dd200640 1 Processor -- start 2024-02-17T12:18:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61dd200640 1 -- start start 2024-02-17T12:18:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61dd200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61d814f110 0x7f61d80c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61dd200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f61d80c1eb0 0x7f61d815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61dd200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d80a9420 con 0x7f61d80c2580 2024-02-17T12:18:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61dd200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d814f4f0 con 0x7f61d80c1eb0 2024-02-17T12:18:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61dd200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80aae80 con 0x7f61d814f110 2024-02-17T12:18:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61d6800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f61d80c1eb0 0x7f61d815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61d5400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f61d80c2580 0x7f61d80aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54672/0 (socket says 172.21.15.114:54672) 2024-02-17T12:18:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61d6800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f61d80c1eb0 0x7f61d815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35316/0 (socket says 172.21.15.114:35316) 2024-02-17T12:18:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61d5400640 1 -- 172.21.15.114:0/3009418563 learned_addr learned my addr 172.21.15.114:0/3009418563 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61d5e00640 1 --2- 172.21.15.114:0/3009418563 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61d814f110 0x7f61d80c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61d6800640 1 -- 172.21.15.114:0/3009418563 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61d814f110 msgr2=0x7f61d80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61d6800640 1 --2- 172.21.15.114:0/3009418563 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61d814f110 0x7f61d80c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61d6800640 1 -- 172.21.15.114:0/3009418563 >> v1:172.21.15.114:6789/0 conn(0x7f61d80c2580 legacy=0x7f61d80aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61d4a00640 1 -- 172.21.15.114:0/3009418563 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115771006 0 0) 0x7f61d80a9420 con 0x7f61d80c2580 2024-02-17T12:18:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.409+0000 7f61d6800640 1 -- 172.21.15.114:0/3009418563 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d8152850 con 0x7f61d80c1eb0 2024-02-17T12:18:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61d6800640 1 --2- 172.21.15.114:0/3009418563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 0x7f61d815c390 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f61d00097c0 tx=0x7f61d001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c00f13e73f12e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61d4a00640 1 -- 172.21.15.114:0/3009418563 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00ac640 con 0x7f61d80c1eb0 2024-02-17T12:18:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61d4a00640 1 -- 172.21.15.114:0/3009418563 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00ac7a0 con 0x7f61d80c1eb0 2024-02-17T12:18:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61d4a00640 1 -- 172.21.15.114:0/3009418563 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00acb30 con 0x7f61d80c1eb0 2024-02-17T12:18:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61dd200640 1 -- 172.21.15.114:0/3009418563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 msgr2=0x7f61d815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61dd200640 1 --2- 172.21.15.114:0/3009418563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 0x7f61d815c390 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f61d00097c0 tx=0x7f61d001c3e0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61dd200640 1 -- 172.21.15.114:0/3009418563 shutdown_connections 2024-02-17T12:18:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61dd200640 1 --2- 172.21.15.114:0/3009418563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 0x7f61d815c390 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61dd200640 1 --2- 172.21.15.114:0/3009418563 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61d814f110 0x7f61d80c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61dd200640 1 -- 172.21.15.114:0/3009418563 >> 172.21.15.114:0/3009418563 conn(0x7f61d80a8490 msgr2=0x7f61d80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61dd200640 1 -- 172.21.15.114:0/3009418563 shutdown_connections 2024-02-17T12:18:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61dd200640 1 -- 172.21.15.114:0/3009418563 wait complete. 2024-02-17T12:18:16.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61dd200640 1 Processor -- start 2024-02-17T12:18:16.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.413+0000 7f61dd200640 1 -- start start 2024-02-17T12:18:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61dd200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 0x7f61d8151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61dd200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61d80c2580 0x7f61d81e9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61dd200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61d814f110 0x7f61d81e9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61dd200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8150bd0 con 0x7f61d80c1eb0 2024-02-17T12:18:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61dd200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d81404c0 con 0x7f61d814f110 2024-02-17T12:18:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61dd200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d81504b0 con 0x7f61d80c2580 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 0x7f61d8151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 0x7f61d8151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35318/0 (socket says 172.21.15.114:35318) 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d5e00640 1 -- 172.21.15.114:0/4210948421 learned_addr learned my addr 172.21.15.114:0/4210948421 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d5400640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61d80c2580 0x7f61d81e9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d6800640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61d814f110 0x7f61d81e9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d5e00640 1 -- 172.21.15.114:0/4210948421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61d80c2580 msgr2=0x7f61d81e9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d5e00640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61d80c2580 0x7f61d81e9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d5e00640 1 -- 172.21.15.114:0/4210948421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61d814f110 msgr2=0x7f61d81e9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d5e00640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61d814f110 0x7f61d81e9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d5e00640 1 -- 172.21.15.114:0/4210948421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0009420 con 0x7f61d80c1eb0 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61d5e00640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 0x7f61d8151740 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f61c8007ef0 tx=0x7f61c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61ce000640 1 -- 172.21.15.114:0/4210948421 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8014620 con 0x7f61d80c1eb0 2024-02-17T12:18:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61ce000640 1 -- 172.21.15.114:0/4210948421 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c8014780 con 0x7f61d80c1eb0 2024-02-17T12:18:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61dd200640 1 -- 172.21.15.114:0/4210948421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d8150790 con 0x7f61d80c1eb0 2024-02-17T12:18:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61ce000640 1 -- 172.21.15.114:0/4210948421 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8014b30 con 0x7f61d80c1eb0 2024-02-17T12:18:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61dd200640 1 -- 172.21.15.114:0/4210948421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d813db90 con 0x7f61d80c1eb0 2024-02-17T12:18:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61dd200640 1 -- 172.21.15.114:0/4210948421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d8074840 con 0x7f61d80c1eb0 2024-02-17T12:18:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.417+0000 7f61ce000640 1 -- 172.21.15.114:0/4210948421 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f61c8014c90 con 0x7f61d80c1eb0 2024-02-17T12:18:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.421+0000 7f61ce000640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f61b4066e40 0x7f61b4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.421+0000 7f61ce000640 1 -- 172.21.15.114:0/4210948421 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61c80854f0 con 0x7f61d80c1eb0 2024-02-17T12:18:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.421+0000 7f61d5400640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f61b4066e40 0x7f61b4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.421+0000 7f61d5400640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f61b4066e40 0x7f61b4069300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f61d8072be0 tx=0x7f61c0007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:16.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.425+0000 7f61ce000640 1 -- 172.21.15.114:0/4210948421 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f61c8052240 con 0x7f61d80c1eb0 2024-02-17T12:18:16.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.577+0000 7f61dd200640 1 -- 172.21.15.114:0/4210948421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61d80c1380 con 0x7f61d80c1eb0 2024-02-17T12:18:16.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.577+0000 7f61ce000640 1 -- 172.21.15.114:0/4210948421 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61c8055900 con 0x7f61d80c1eb0 2024-02-17T12:18:16.581 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:18:16.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 -- 172.21.15.114:0/4210948421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f61b4066e40 msgr2=0x7f61b4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f61b4066e40 0x7f61b4069300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f61d8072be0 tx=0x7f61c0007b60 comp rx=0 tx=0).stop 2024-02-17T12:18:16.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 -- 172.21.15.114:0/4210948421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 msgr2=0x7f61d8151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 0x7f61d8151740 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f61c8007ef0 tx=0x7f61c800e4b0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 -- 172.21.15.114:0/4210948421 shutdown_connections 2024-02-17T12:18:16.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f61d814f110 0x7f61d81e9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f61d80c2580 0x7f61d81e9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f61b4066e40 0x7f61b4069300 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 --2- 172.21.15.114:0/4210948421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61d80c1eb0 0x7f61d8151740 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 -- 172.21.15.114:0/4210948421 >> 172.21.15.114:0/4210948421 conn(0x7f61d80a8490 msgr2=0x7f61d806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:16.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 -- 172.21.15.114:0/4210948421 shutdown_connections 2024-02-17T12:18:16.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.581+0000 7f61dd200640 1 -- 172.21.15.114:0/4210948421 wait complete. 2024-02-17T12:18:16.602 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:18:16.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007f400640 1 Processor -- start 2024-02-17T12:18:16.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007f400640 1 -- start start 2024-02-17T12:18:16.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007f400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f007814f110 0x7f00780c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00780c1eb0 0x7f007815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007f400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00780a9420 con 0x7f00780c2580 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007f400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007814f4f0 con 0x7f00780c1eb0 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007f400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00780aae80 con 0x7f007814f110 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00780c1eb0 0x7f007815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00780c1eb0 0x7f007815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35330/0 (socket says 172.21.15.114:35330) 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007d400640 1 -- 172.21.15.114:0/1520448780 learned_addr learned my addr 172.21.15.114:0/1520448780 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f0077e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f00780c2580 0x7f00780aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54676/0 (socket says 172.21.15.114:54676) 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007ca00640 1 --2- 172.21.15.114:0/1520448780 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f007814f110 0x7f00780c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007d400640 1 -- 172.21.15.114:0/1520448780 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f007814f110 msgr2=0x7f00780c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007d400640 1 --2- 172.21.15.114:0/1520448780 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f007814f110 0x7f00780c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007d400640 1 -- 172.21.15.114:0/1520448780 >> v1:172.21.15.114:6789/0 conn(0x7f00780c2580 legacy=0x7f00780aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f007d400640 1 -- 172.21.15.114:0/1520448780 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078152850 con 0x7f00780c1eb0 2024-02-17T12:18:16.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.737+0000 7f0077400640 1 -- 172.21.15.114:0/1520448780 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082396710 0 0) 0x7f00780a9420 con 0x7f00780c2580 2024-02-17T12:18:16.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007d400640 1 --2- 172.21.15.114:0/1520448780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00780c1eb0 0x7f007815c390 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0070009e50 tx=0x7f007001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446dd86a7d805b13 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:16.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f0077400640 1 -- 172.21.15.114:0/1520448780 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700a5830 con 0x7f00780c1eb0 2024-02-17T12:18:16.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f0077400640 1 -- 172.21.15.114:0/1520448780 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00700a5990 con 0x7f00780c1eb0 2024-02-17T12:18:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f0077400640 1 -- 172.21.15.114:0/1520448780 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700a5d20 con 0x7f00780c1eb0 2024-02-17T12:18:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007f400640 1 -- 172.21.15.114:0/1520448780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00780c1eb0 msgr2=0x7f007815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007f400640 1 --2- 172.21.15.114:0/1520448780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00780c1eb0 0x7f007815c390 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0070009e50 tx=0x7f007001c970 comp rx=0 tx=0).stop 2024-02-17T12:18:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007f400640 1 -- 172.21.15.114:0/1520448780 shutdown_connections 2024-02-17T12:18:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007f400640 1 --2- 172.21.15.114:0/1520448780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00780c1eb0 0x7f007815c390 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007f400640 1 --2- 172.21.15.114:0/1520448780 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f007814f110 0x7f00780c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007f400640 1 -- 172.21.15.114:0/1520448780 >> 172.21.15.114:0/1520448780 conn(0x7f00780a8490 msgr2=0x7f00780a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007f400640 1 -- 172.21.15.114:0/1520448780 shutdown_connections 2024-02-17T12:18:16.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007f400640 1 -- 172.21.15.114:0/1520448780 wait complete. 2024-02-17T12:18:16.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007f400640 1 Processor -- start 2024-02-17T12:18:16.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.741+0000 7f007f400640 1 -- start start 2024-02-17T12:18:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007f400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00780c1eb0 0x7f007813f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007f400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00780c2580 0x7f007813da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f007814f110 0x7f007813df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007f400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00780c0400 con 0x7f007814f110 2024-02-17T12:18:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007f400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00781511f0 con 0x7f00780c1eb0 2024-02-17T12:18:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007f400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007814e3f0 con 0x7f00780c2580 2024-02-17T12:18:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f007814f110 0x7f007813df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f007814f110 0x7f007813df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35340/0 (socket says 172.21.15.114:35340) 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007d400640 1 -- 172.21.15.114:0/2203595747 learned_addr learned my addr 172.21.15.114:0/2203595747 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f0077e00640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00780c2580 0x7f007813da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007ca00640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00780c1eb0 0x7f007813f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007d400640 1 -- 172.21.15.114:0/2203595747 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00780c2580 msgr2=0x7f007813da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007d400640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00780c2580 0x7f007813da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007d400640 1 -- 172.21.15.114:0/2203595747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00780c1eb0 msgr2=0x7f007813f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007d400640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00780c1eb0 0x7f007813f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007d400640 1 -- 172.21.15.114:0/2203595747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070009b30 con 0x7f007814f110 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007ca00640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00780c1eb0 0x7f007813f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f0077e00640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00780c2580 0x7f007813da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007d400640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f007814f110 0x7f007813df40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f007001a5a0 tx=0x7f0070019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f0074c00640 1 -- 172.21.15.114:0/2203595747 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700b8670 con 0x7f007814f110 2024-02-17T12:18:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f0074c00640 1 -- 172.21.15.114:0/2203595747 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00700b87d0 con 0x7f007814f110 2024-02-17T12:18:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f0074c00640 1 -- 172.21.15.114:0/2203595747 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700b8b40 con 0x7f007814f110 2024-02-17T12:18:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007f400640 1 -- 172.21.15.114:0/2203595747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007813e480 con 0x7f007814f110 2024-02-17T12:18:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007f400640 1 -- 172.21.15.114:0/2203595747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00780c0120 con 0x7f007814f110 2024-02-17T12:18:16.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f007f400640 1 -- 172.21.15.114:0/2203595747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0078074840 con 0x7f007814f110 2024-02-17T12:18:16.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.745+0000 7f0074c00640 1 -- 172.21.15.114:0/2203595747 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f00700b8ca0 con 0x7f007814f110 2024-02-17T12:18:16.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.749+0000 7f0074c00640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0058066e40 0x7f0058069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:16.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.749+0000 7f0074c00640 1 -- 172.21.15.114:0/2203595747 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f007011ff00 con 0x7f007814f110 2024-02-17T12:18:16.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.749+0000 7f007ca00640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0058066e40 0x7f0058069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:16.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.749+0000 7f007ca00640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0058066e40 0x7f0058069300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0068009ae0 tx=0x7f0068008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:16.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.753+0000 7f0074c00640 1 -- 172.21.15.114:0/2203595747 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f00700ecce0 con 0x7f007814f110 2024-02-17T12:18:16.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.905+0000 7f007f400640 1 -- 172.21.15.114:0/2203595747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f007806e830 con 0x7f007814f110 2024-02-17T12:18:16.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.905+0000 7f0074c00640 1 -- 172.21.15.114:0/2203595747 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00700f03a0 con 0x7f007814f110 2024-02-17T12:18:16.909 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:18:16.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 -- 172.21.15.114:0/2203595747 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0058066e40 msgr2=0x7f0058069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0058066e40 0x7f0058069300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0068009ae0 tx=0x7f0068008040 comp rx=0 tx=0).stop 2024-02-17T12:18:16.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 -- 172.21.15.114:0/2203595747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f007814f110 msgr2=0x7f007813df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:16.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f007814f110 0x7f007813df40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f007001a5a0 tx=0x7f0070019710 comp rx=0 tx=0).stop 2024-02-17T12:18:16.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 -- 172.21.15.114:0/2203595747 shutdown_connections 2024-02-17T12:18:16.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0058066e40 0x7f0058069300 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f007814f110 0x7f007813df40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00780c2580 0x7f007813da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 --2- 172.21.15.114:0/2203595747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00780c1eb0 0x7f007813f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:16.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 -- 172.21.15.114:0/2203595747 >> 172.21.15.114:0/2203595747 conn(0x7f00780a8490 msgr2=0x7f00780a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:16.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 -- 172.21.15.114:0/2203595747 shutdown_connections 2024-02-17T12:18:16.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:16.909+0000 7f007f400640 1 -- 172.21.15.114:0/2203595747 wait complete. 2024-02-17T12:18:16.931 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T12:18:17.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.061+0000 7f10e0c00640 1 Processor -- start 2024-02-17T12:18:17.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.061+0000 7f10e0c00640 1 -- start start 2024-02-17T12:18:17.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10e0c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f10dc06db50 0x7f10dc14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10e0c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f10dc150490 0x7f10dc152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10e0c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc156270 con 0x7f10dc0c25a0 2024-02-17T12:18:17.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10e0c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc06f090 con 0x7f10dc06db50 2024-02-17T12:18:17.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10e0c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc071630 con 0x7f10dc150490 2024-02-17T12:18:17.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d9400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f10dc06db50 0x7f10dc14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d9e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f10dc0c25a0 0x7f10dc06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54688/0 (socket says 172.21.15.114:54688) 2024-02-17T12:18:17.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d9e00640 1 -- 172.21.15.114:0/861564476 learned_addr learned my addr 172.21.15.114:0/861564476 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:17.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d9400640 1 -- 172.21.15.114:0/861564476 >> v2:172.21.15.116:3300/0 conn(0x7f10dc150490 msgr2=0x7f10dc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:17.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d9400640 1 --2- 172.21.15.114:0/861564476 >> v2:172.21.15.116:3300/0 conn(0x7f10dc150490 0x7f10dc152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d9400640 1 -- 172.21.15.114:0/861564476 >> v1:172.21.15.114:6789/0 conn(0x7f10dc0c25a0 legacy=0x7f10dc06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:17.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d9400640 1 -- 172.21.15.114:0/861564476 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc156550 con 0x7f10dc06db50 2024-02-17T12:18:17.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d8a00640 1 -- 172.21.15.114:0/861564476 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575632887 0 0) 0x7f10dc156270 con 0x7f10dc0c25a0 2024-02-17T12:18:17.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d9400640 1 --2- 172.21.15.114:0/861564476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc06db50 0x7f10dc14ff50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f10dc153cb0 tx=0x7f10c801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5916453e29d48c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:17.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d8a00640 1 -- 172.21.15.114:0/861564476 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc1539a0 con 0x7f10dc06db50 2024-02-17T12:18:17.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d8a00640 1 -- 172.21.15.114:0/861564476 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c80a7050 con 0x7f10dc06db50 2024-02-17T12:18:17.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.065+0000 7f10d8a00640 1 -- 172.21.15.114:0/861564476 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c80ab820 con 0x7f10dc06db50 2024-02-17T12:18:17.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 -- 172.21.15.114:0/861564476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc06db50 msgr2=0x7f10dc14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:17.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 --2- 172.21.15.114:0/861564476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc06db50 0x7f10dc14ff50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f10dc153cb0 tx=0x7f10c801c360 comp rx=0 tx=0).stop 2024-02-17T12:18:17.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 -- 172.21.15.114:0/861564476 shutdown_connections 2024-02-17T12:18:17.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 --2- 172.21.15.114:0/861564476 >> v2:172.21.15.116:3300/0 conn(0x7f10dc150490 0x7f10dc152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 --2- 172.21.15.114:0/861564476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc06db50 0x7f10dc14ff50 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 -- 172.21.15.114:0/861564476 >> 172.21.15.114:0/861564476 conn(0x7f10dc0a8490 msgr2=0x7f10dc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:17.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 -- 172.21.15.114:0/861564476 shutdown_connections 2024-02-17T12:18:17.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 -- 172.21.15.114:0/861564476 wait complete. 2024-02-17T12:18:17.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 Processor -- start 2024-02-17T12:18:17.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 -- start start 2024-02-17T12:18:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f10dc06db50 0x7f10dc148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10dc0c25a0 0x7f10dc13f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc150490 0x7f10dc141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0a9600 con 0x7f10dc150490 2024-02-17T12:18:17.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc1f0fe0 con 0x7f10dc0c25a0 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10e0c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc1eda80 con 0x7f10dc06db50 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10da800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc150490 0x7f10dc141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10da800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc150490 0x7f10dc141d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35360/0 (socket says 172.21.15.114:35360) 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10da800640 1 -- 172.21.15.114:0/1429040202 learned_addr learned my addr 172.21.15.114:0/1429040202 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10d9400640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10dc0c25a0 0x7f10dc13f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10d9e00640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f10dc06db50 0x7f10dc148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10da800640 1 -- 172.21.15.114:0/1429040202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f10dc06db50 msgr2=0x7f10dc148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10da800640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f10dc06db50 0x7f10dc148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10da800640 1 -- 172.21.15.114:0/1429040202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10dc0c25a0 msgr2=0x7f10dc13f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10da800640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10dc0c25a0 0x7f10dc13f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10da800640 1 -- 172.21.15.114:0/1429040202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8009420 con 0x7f10dc150490 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10d9400640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10dc0c25a0 0x7f10dc13f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:17.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.069+0000 7f10d9e00640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f10dc06db50 0x7f10dc148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10da800640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc150490 0x7f10dc141d60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f10d400b390 tx=0x7f10d400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10d2000640 1 -- 172.21.15.114:0/1429040202 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4011830 con 0x7f10dc150490 2024-02-17T12:18:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10d2000640 1 -- 172.21.15.114:0/1429040202 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d4011990 con 0x7f10dc150490 2024-02-17T12:18:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10d2000640 1 -- 172.21.15.114:0/1429040202 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4011d40 con 0x7f10dc150490 2024-02-17T12:18:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10e0c00640 1 -- 172.21.15.114:0/1429040202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc1f03d0 con 0x7f10dc150490 2024-02-17T12:18:17.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10e0c00640 1 -- 172.21.15.114:0/1429040202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc1f0990 con 0x7f10dc150490 2024-02-17T12:18:17.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10e0c00640 1 -- 172.21.15.114:0/1429040202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc1f1150 con 0x7f10dc150490 2024-02-17T12:18:17.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10d2000640 1 -- 172.21.15.114:0/1429040202 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f10d401a400 con 0x7f10dc150490 2024-02-17T12:18:17.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10d2000640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f10bc066e40 0x7f10bc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10d2000640 1 -- 172.21.15.114:0/1429040202 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10d4084b50 con 0x7f10dc150490 2024-02-17T12:18:17.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.073+0000 7f10d9e00640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f10bc066e40 0x7f10bc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.077+0000 7f10d9e00640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f10bc066e40 0x7f10bc069300 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f10cc007fd0 tx=0x7f10cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:17.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.077+0000 7f10d2000640 1 -- 172.21.15.114:0/1429040202 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f10d4051930 con 0x7f10dc150490 2024-02-17T12:18:17.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.233+0000 7f10e0c00640 1 -- 172.21.15.114:0/1429040202 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f10dc074840 con 0x7f10dc150490 2024-02-17T12:18:17.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.233+0000 7f10d2000640 1 -- 172.21.15.114:0/1429040202 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+207 (secure 0 0 0) 0x7f10d4015020 con 0x7f10dc150490 2024-02-17T12:18:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:17.238 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-02-17T12:18:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:18:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-02-17T12:18:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-02-17T12:18:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:18:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:18:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 8, 2024-02-17T12:18:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "cephfs_metadata" 2024-02-17T12:18:17.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:18:17.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:18:17.239 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 9, 2024-02-17T12:18:17.239 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "cephfs_data" 2024-02-17T12:18:17.239 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:18:17.239 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-02-17T12:18:17.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 -- 172.21.15.114:0/1429040202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f10bc066e40 msgr2=0x7f10bc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:17.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f10bc066e40 0x7f10bc069300 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f10cc007fd0 tx=0x7f10cc009040 comp rx=0 tx=0).stop 2024-02-17T12:18:17.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 -- 172.21.15.114:0/1429040202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc150490 msgr2=0x7f10dc141d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:17.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc150490 0x7f10dc141d60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f10d400b390 tx=0x7f10d400b850 comp rx=0 tx=0).stop 2024-02-17T12:18:17.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 -- 172.21.15.114:0/1429040202 shutdown_connections 2024-02-17T12:18:17.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f10bc066e40 0x7f10bc069300 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc150490 0x7f10dc141d60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f10dc0c25a0 0x7f10dc13f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 --2- 172.21.15.114:0/1429040202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f10dc06db50 0x7f10dc148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 -- 172.21.15.114:0/1429040202 >> 172.21.15.114:0/1429040202 conn(0x7f10dc0a8490 msgr2=0x7f10dc149cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:17.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 -- 172.21.15.114:0/1429040202 shutdown_connections 2024-02-17T12:18:17.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.237+0000 7f10e0c00640 1 -- 172.21.15.114:0/1429040202 wait complete. 2024-02-17T12:18:17.259 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-02-17T12:18:17.259 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-02-17T12:18:17.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.393+0000 7f49a8a00640 1 Processor -- start 2024-02-17T12:18:17.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.393+0000 7f49a8a00640 1 -- start start 2024-02-17T12:18:17.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a8a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f49a4150280 0x7f49a40a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a8a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a40a98f0 0x7f49a406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a8a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a40ab680 con 0x7f49a40c0d00 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a8a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a40aa940 con 0x7f49a4150280 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a8a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4150660 con 0x7f49a40a98f0 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a1e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f49a40c0d00 0x7f49a406da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54694/0 (socket says 172.21.15.114:54694) 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a1e00640 1 -- 172.21.15.114:0/380164503 learned_addr learned my addr 172.21.15.114:0/380164503 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a2800640 1 --2- 172.21.15.114:0/380164503 >> v2:172.21.15.116:3300/0 conn(0x7f49a4150280 0x7f49a40a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a3200640 1 --2- 172.21.15.114:0/380164503 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a40a98f0 0x7f49a406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a1400640 1 -- 172.21.15.114:0/380164503 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240747854 0 0) 0x7f49a40ab680 con 0x7f49a40c0d00 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a1400640 1 -- 172.21.15.114:0/380164503 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4988003530 con 0x7f49a40c0d00 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a3200640 1 -- 172.21.15.114:0/380164503 >> v2:172.21.15.116:3300/0 conn(0x7f49a4150280 msgr2=0x7f49a40a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a3200640 1 --2- 172.21.15.114:0/380164503 >> v2:172.21.15.116:3300/0 conn(0x7f49a4150280 0x7f49a40a93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a3200640 1 -- 172.21.15.114:0/380164503 >> v1:172.21.15.114:6789/0 conn(0x7f49a40c0d00 legacy=0x7f49a406da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a3200640 1 -- 172.21.15.114:0/380164503 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40ab960 con 0x7f49a40a98f0 2024-02-17T12:18:17.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.397+0000 7f49a2800640 1 --2- 172.21.15.114:0/380164503 >> v2:172.21.15.116:3300/0 conn(0x7f49a4150280 0x7f49a40a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:17.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a3200640 1 --2- 172.21.15.114:0/380164503 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a40a98f0 0x7f49a406e110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f499c009d90 tx=0x7f499c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af2e2eeac55e91d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:17.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a1400640 1 -- 172.21.15.114:0/380164503 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0a5830 con 0x7f49a40a98f0 2024-02-17T12:18:17.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a1400640 1 -- 172.21.15.114:0/380164503 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c0a5990 con 0x7f49a40a98f0 2024-02-17T12:18:17.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a1400640 1 -- 172.21.15.114:0/380164503 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0a5d20 con 0x7f49a40a98f0 2024-02-17T12:18:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a8a00640 1 -- 172.21.15.114:0/380164503 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a40a98f0 msgr2=0x7f49a406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a8a00640 1 --2- 172.21.15.114:0/380164503 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a40a98f0 0x7f49a406e110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f499c009d90 tx=0x7f499c01c970 comp rx=0 tx=0).stop 2024-02-17T12:18:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a8a00640 1 -- 172.21.15.114:0/380164503 shutdown_connections 2024-02-17T12:18:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a8a00640 1 --2- 172.21.15.114:0/380164503 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a40a98f0 0x7f49a406e110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a8a00640 1 --2- 172.21.15.114:0/380164503 >> v2:172.21.15.116:3300/0 conn(0x7f49a4150280 0x7f49a40a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a8a00640 1 -- 172.21.15.114:0/380164503 >> 172.21.15.114:0/380164503 conn(0x7f49a406ac10 msgr2=0x7f49a406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a8a00640 1 -- 172.21.15.114:0/380164503 shutdown_connections 2024-02-17T12:18:17.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a8a00640 1 -- 172.21.15.114:0/380164503 wait complete. 2024-02-17T12:18:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a8a00640 1 Processor -- start 2024-02-17T12:18:17.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.401+0000 7f49a8a00640 1 -- start start 2024-02-17T12:18:17.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49a40a98f0 0x7f49a40c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a8a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49a40c0d00 0x7f49a41f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a8a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a4150280 0x7f49a40723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4146ab0 con 0x7f49a40a98f0 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a8a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4070ba0 con 0x7f49a40c0d00 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a8a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4146d00 con 0x7f49a4150280 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49a40a98f0 0x7f49a40c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49a40a98f0 0x7f49a40c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35376/0 (socket says 172.21.15.114:35376) 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a2800640 1 -- 172.21.15.114:0/4291537918 learned_addr learned my addr 172.21.15.114:0/4291537918 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a1e00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49a40c0d00 0x7f49a41f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a3200640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a4150280 0x7f49a40723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a2800640 1 -- 172.21.15.114:0/4291537918 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a4150280 msgr2=0x7f49a40723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a2800640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a4150280 0x7f49a40723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a2800640 1 -- 172.21.15.114:0/4291537918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49a40c0d00 msgr2=0x7f49a41f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a2800640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49a40c0d00 0x7f49a41f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a2800640 1 -- 172.21.15.114:0/4291537918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4994009420 con 0x7f49a40a98f0 2024-02-17T12:18:17.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a3200640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a4150280 0x7f49a40723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:17.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a1e00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49a40c0d00 0x7f49a41f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:17.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a2800640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49a40a98f0 0x7f49a40c5ef0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f499400ebe0 tx=0x7f499400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:17.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f499aa00640 1 -- 172.21.15.114:0/4291537918 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499400eee0 con 0x7f49a40a98f0 2024-02-17T12:18:17.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f499aa00640 1 -- 172.21.15.114:0/4291537918 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499400cc30 con 0x7f49a40a98f0 2024-02-17T12:18:17.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a8a00640 1 -- 172.21.15.114:0/4291537918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c009a70 con 0x7f49a40a98f0 2024-02-17T12:18:17.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f499aa00640 1 -- 172.21.15.114:0/4291537918 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994013470 con 0x7f49a40a98f0 2024-02-17T12:18:17.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a8a00640 1 -- 172.21.15.114:0/4291537918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a41ee8e0 con 0x7f49a40a98f0 2024-02-17T12:18:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f49a8a00640 1 -- 172.21.15.114:0/4291537918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a41eead0 con 0x7f49a40a98f0 2024-02-17T12:18:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.405+0000 7f499aa00640 1 -- 172.21.15.114:0/4291537918 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f49940135d0 con 0x7f49a40a98f0 2024-02-17T12:18:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.409+0000 7f499aa00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4984066e40 0x7f4984069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.409+0000 7f499aa00640 1 -- 172.21.15.114:0/4291537918 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4994084d50 con 0x7f49a40a98f0 2024-02-17T12:18:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.409+0000 7f49a1e00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4984066e40 0x7f4984069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.409+0000 7f49a1e00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4984066e40 0x7f4984069300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f49a4157110 tx=0x7f4990009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:17.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.413+0000 7f499aa00640 1 -- 172.21.15.114:0/4291537918 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4994088030 con 0x7f49a40a98f0 2024-02-17T12:18:17.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:17.565+0000 7f49a8a00640 1 -- 172.21.15.114:0/4291537918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f49a40a96d0 con 0x7f49a40a98f0 2024-02-17T12:18:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f499aa00640 1 -- 172.21.15.114:0/4291537918 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v51) v1 ==== 140+0+0 (secure 0 0 0) 0x7f4994055670 con 0x7f49a40a98f0 2024-02-17T12:18:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_metadata' created 2024-02-17T12:18:18.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 -- 172.21.15.114:0/4291537918 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4984066e40 msgr2=0x7f4984069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:18.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4984066e40 0x7f4984069300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f49a4157110 tx=0x7f4990009040 comp rx=0 tx=0).stop 2024-02-17T12:18:18.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 -- 172.21.15.114:0/4291537918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49a40a98f0 msgr2=0x7f49a40c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:18.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49a40a98f0 0x7f49a40c5ef0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f499400ebe0 tx=0x7f499400c520 comp rx=0 tx=0).stop 2024-02-17T12:18:18.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 -- 172.21.15.114:0/4291537918 shutdown_connections 2024-02-17T12:18:18.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f49a4150280 0x7f49a40723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:18.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49a40c0d00 0x7f49a41f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:18.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4984066e40 0x7f4984069300 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:18.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 --2- 172.21.15.114:0/4291537918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49a40a98f0 0x7f49a40c5ef0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:18.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 -- 172.21.15.114:0/4291537918 >> 172.21.15.114:0/4291537918 conn(0x7f49a406ac10 msgr2=0x7f49a406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:18.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 -- 172.21.15.114:0/4291537918 shutdown_connections 2024-02-17T12:18:18.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.321+0000 7f49a8a00640 1 -- 172.21.15.114:0/4291537918 wait complete. 2024-02-17T12:18:18.351 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T12:18:18.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd8a4c00640 1 Processor -- start 2024-02-17T12:18:18.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd8a4c00640 1 -- start start 2024-02-17T12:18:18.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd8a4c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd8a014f110 0x7fd8a00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:18.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd8a4c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8a00c2580 0x7fd8a00aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:18.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd8a4c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a00a9420 con 0x7fd8a00c1eb0 2024-02-17T12:18:18.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd8a4c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a014f4f0 con 0x7fd8a014f110 2024-02-17T12:18:18.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd8a4c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00aae80 con 0x7fd8a00c2580 2024-02-17T12:18:18.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd89de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd8a014f110 0x7fd8a00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:18.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd89de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd8a014f110 0x7fd8a00c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35378/0 (socket says 172.21.15.114:35378) 2024-02-17T12:18:18.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd89de00640 1 -- 172.21.15.114:0/2194431814 learned_addr learned my addr 172.21.15.114:0/2194431814 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:18.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.489+0000 7fd89e800640 1 --1- 172.21.15.114:0/2194431814 >> v1:172.21.15.114:6789/0 conn(0x7fd8a00c1eb0 0x7fd8a0155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54704/0 (socket says 172.21.15.114:54704) 2024-02-17T12:18:18.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd89d400640 1 --2- 172.21.15.114:0/2194431814 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8a00c2580 0x7fd8a00aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:18.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd89de00640 1 -- 172.21.15.114:0/2194431814 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8a00c2580 msgr2=0x7fd8a00aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:18.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd89de00640 1 --2- 172.21.15.114:0/2194431814 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8a00c2580 0x7fd8a00aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:18.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd89de00640 1 -- 172.21.15.114:0/2194431814 >> v1:172.21.15.114:6789/0 conn(0x7fd8a00c1eb0 legacy=0x7fd8a0155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:18.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd89de00640 1 -- 172.21.15.114:0/2194431814 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a0152850 con 0x7fd8a014f110 2024-02-17T12:18:18.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd89de00640 1 --2- 172.21.15.114:0/2194431814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a014f110 0x7fd8a00c65a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd890009870 tx=0x7fd89001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbb43df8bdeb5e8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:18.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd89ca00640 1 -- 172.21.15.114:0/2194431814 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8900a6040 con 0x7fd8a014f110 2024-02-17T12:18:18.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd89ca00640 1 -- 172.21.15.114:0/2194431814 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8900aa600 con 0x7fd8a014f110 2024-02-17T12:18:18.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd89ca00640 1 -- 172.21.15.114:0/2194431814 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8900aa990 con 0x7fd8a014f110 2024-02-17T12:18:18.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd8a4c00640 1 -- 172.21.15.114:0/2194431814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a014f110 msgr2=0x7fd8a00c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:18.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.493+0000 7fd8a4c00640 1 --2- 172.21.15.114:0/2194431814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a014f110 0x7fd8a00c65a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd890009870 tx=0x7fd89001c4a0 comp rx=0 tx=0).stop 2024-02-17T12:18:18.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 -- 172.21.15.114:0/2194431814 shutdown_connections 2024-02-17T12:18:18.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 --2- 172.21.15.114:0/2194431814 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8a00c2580 0x7fd8a00aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:18.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 --2- 172.21.15.114:0/2194431814 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a014f110 0x7fd8a00c65a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:18.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 -- 172.21.15.114:0/2194431814 >> 172.21.15.114:0/2194431814 conn(0x7fd8a00a8490 msgr2=0x7fd8a00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:18.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 -- 172.21.15.114:0/2194431814 shutdown_connections 2024-02-17T12:18:18.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 -- 172.21.15.114:0/2194431814 wait complete. 2024-02-17T12:18:18.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 Processor -- start 2024-02-17T12:18:18.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 -- start start 2024-02-17T12:18:18.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8a00c1eb0 0x7fd8a015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:18.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a00c2580 0x7fd8a0153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:18.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8a014f110 0x7fd8a01530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a0153910 con 0x7fd8a00c2580 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a01517c0 con 0x7fd8a00c1eb0 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a00c5a40 con 0x7fd8a014f110 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a00c2580 0x7fd8a0153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a00c2580 0x7fd8a0153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35390/0 (socket says 172.21.15.114:35390) 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89d400640 1 -- 172.21.15.114:0/1257749531 learned_addr learned my addr 172.21.15.114:0/1257749531 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89de00640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8a00c1eb0 0x7fd8a015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89e800640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8a014f110 0x7fd8a01530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89d400640 1 -- 172.21.15.114:0/1257749531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8a014f110 msgr2=0x7fd8a01530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89d400640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8a014f110 0x7fd8a01530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89d400640 1 -- 172.21.15.114:0/1257749531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8a00c1eb0 msgr2=0x7fd8a015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89d400640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8a00c1eb0 0x7fd8a015c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89d400640 1 -- 172.21.15.114:0/1257749531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8900094d0 con 0x7fd8a00c2580 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd89d400640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a00c2580 0x7fd8a0153e10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e900 tx=0x7fd88c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:18.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd896000640 1 -- 172.21.15.114:0/1257749531 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c009690 con 0x7fd8a00c2580 2024-02-17T12:18:18.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd896000640 1 -- 172.21.15.114:0/1257749531 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c00ca00 con 0x7fd8a00c2580 2024-02-17T12:18:18.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd8a4c00640 1 -- 172.21.15.114:0/1257749531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a00c5d20 con 0x7fd8a00c2580 2024-02-17T12:18:18.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.497+0000 7fd896000640 1 -- 172.21.15.114:0/1257749531 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00cdb0 con 0x7fd8a00c2580 2024-02-17T12:18:18.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.501+0000 7fd8a4c00640 1 -- 172.21.15.114:0/1257749531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a014e8c0 con 0x7fd8a00c2580 2024-02-17T12:18:18.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.501+0000 7fd8a4c00640 1 -- 172.21.15.114:0/1257749531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a0074840 con 0x7fd8a00c2580 2024-02-17T12:18:18.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.501+0000 7fd896000640 1 -- 172.21.15.114:0/1257749531 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd88c013470 con 0x7fd8a00c2580 2024-02-17T12:18:18.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.501+0000 7fd896000640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd880066e40 0x7fd880069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:18.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.501+0000 7fd896000640 1 -- 172.21.15.114:0/1257749531 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6080+0+0 (secure 0 0 0) 0x7fd88c0855d0 con 0x7fd8a00c2580 2024-02-17T12:18:18.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.501+0000 7fd89de00640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd880066e40 0x7fd880069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:18.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.505+0000 7fd89de00640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd880066e40 0x7fd880069300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd8900ae000 tx=0x7fd8900b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:18.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.505+0000 7fd896000640 1 -- 172.21.15.114:0/1257749531 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd88c052310 con 0x7fd8a00c2580 2024-02-17T12:18:18.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:18.661+0000 7fd8a4c00640 1 -- 172.21.15.114:0/1257749531 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd8a00c1380 con 0x7fd8a00c2580 2024-02-17T12:18:19.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.321+0000 7fd896000640 1 -- 172.21.15.114:0/1257749531 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v52) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd88c0559d0 con 0x7fd8a00c2580 2024-02-17T12:18:19.327 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_data' created 2024-02-17T12:18:19.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 -- 172.21.15.114:0/1257749531 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd880066e40 msgr2=0x7fd880069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:19.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd880066e40 0x7fd880069300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd8900ae000 tx=0x7fd8900b5040 comp rx=0 tx=0).stop 2024-02-17T12:18:19.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 -- 172.21.15.114:0/1257749531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a00c2580 msgr2=0x7fd8a0153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:19.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a00c2580 0x7fd8a0153e10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e900 tx=0x7fd88c00edc0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 -- 172.21.15.114:0/1257749531 shutdown_connections 2024-02-17T12:18:19.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd8a014f110 0x7fd8a01530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd880066e40 0x7fd880069300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8a00c2580 0x7fd8a0153e10 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 --2- 172.21.15.114:0/1257749531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8a00c1eb0 0x7fd8a015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 -- 172.21.15.114:0/1257749531 >> 172.21.15.114:0/1257749531 conn(0x7fd8a00a8490 msgr2=0x7fd8a00726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 -- 172.21.15.114:0/1257749531 shutdown_connections 2024-02-17T12:18:19.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.325+0000 7fd8a4c00640 1 -- 172.21.15.114:0/1257749531 wait complete. 2024-02-17T12:18:19.365 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-02-17T12:18:19.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.497+0000 7fe17dc00640 1 Processor -- start 2024-02-17T12:18:19.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.497+0000 7fe17dc00640 1 -- start start 2024-02-17T12:18:19.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe17dc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe17806db50 0x7fe17814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:19.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe17dc00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe178150490 0x7fe178152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:19.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe17dc00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe178156270 con 0x7fe1780c25a0 2024-02-17T12:18:19.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe17dc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17806f090 con 0x7fe17806db50 2024-02-17T12:18:19.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe17dc00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe178071630 con 0x7fe178150490 2024-02-17T12:18:19.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe176000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe17806db50 0x7fe17814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:19.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe176000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe17806db50 0x7fe17814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35396/0 (socket says 172.21.15.114:35396) 2024-02-17T12:18:19.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe176000640 1 -- 172.21.15.114:0/3303945072 learned_addr learned my addr 172.21.15.114:0/3303945072 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe177400640 1 --2- 172.21.15.114:0/3303945072 >> v2:172.21.15.116:3300/0 conn(0x7fe178150490 0x7fe178152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe176000640 1 -- 172.21.15.114:0/3303945072 >> v2:172.21.15.116:3300/0 conn(0x7fe178150490 msgr2=0x7fe178152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe176000640 1 --2- 172.21.15.114:0/3303945072 >> v2:172.21.15.116:3300/0 conn(0x7fe178150490 0x7fe178152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe176000640 1 -- 172.21.15.114:0/3303945072 >> v1:172.21.15.116:6789/0 conn(0x7fe1780c25a0 legacy=0x7fe17806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe176000640 1 -- 172.21.15.114:0/3303945072 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178156550 con 0x7fe17806db50 2024-02-17T12:18:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.501+0000 7fe177400640 1 --2- 172.21.15.114:0/3303945072 >> v2:172.21.15.116:3300/0 conn(0x7fe178150490 0x7fe178152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:19.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe176000640 1 --2- 172.21.15.114:0/3303945072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 0x7fe17814ff50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe178153cb0 tx=0x7fe16001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58856a79dc4807f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:19.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe175600640 1 -- 172.21.15.114:0/3303945072 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1781539a0 con 0x7fe17806db50 2024-02-17T12:18:19.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe175600640 1 -- 172.21.15.114:0/3303945072 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1600a7050 con 0x7fe17806db50 2024-02-17T12:18:19.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe175600640 1 -- 172.21.15.114:0/3303945072 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600ab820 con 0x7fe17806db50 2024-02-17T12:18:19.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 -- 172.21.15.114:0/3303945072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 msgr2=0x7fe17814ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:19.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 --2- 172.21.15.114:0/3303945072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 0x7fe17814ff50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe178153cb0 tx=0x7fe16001c3c0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 -- 172.21.15.114:0/3303945072 shutdown_connections 2024-02-17T12:18:19.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 --2- 172.21.15.114:0/3303945072 >> v2:172.21.15.116:3300/0 conn(0x7fe178150490 0x7fe178152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 --2- 172.21.15.114:0/3303945072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 0x7fe17814ff50 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 -- 172.21.15.114:0/3303945072 >> 172.21.15.114:0/3303945072 conn(0x7fe1780a8490 msgr2=0x7fe1780a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:19.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 -- 172.21.15.114:0/3303945072 shutdown_connections 2024-02-17T12:18:19.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 -- 172.21.15.114:0/3303945072 wait complete. 2024-02-17T12:18:19.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 Processor -- start 2024-02-17T12:18:19.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 -- start start 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 0x7fe1780bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1780c25a0 0x7fe178141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe178150490 0x7fe17814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178146400 con 0x7fe17806db50 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780aa8b0 con 0x7fe178150490 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.505+0000 7fe17dc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe178146650 con 0x7fe1780c25a0 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe176a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 0x7fe1780bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe176a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 0x7fe1780bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35404/0 (socket says 172.21.15.114:35404) 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe176a00640 1 -- 172.21.15.114:0/712092071 learned_addr learned my addr 172.21.15.114:0/712092071 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe176000640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1780c25a0 0x7fe178141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:19.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe177400640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe178150490 0x7fe17814cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe176a00640 1 -- 172.21.15.114:0/712092071 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1780c25a0 msgr2=0x7fe178141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe176a00640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1780c25a0 0x7fe178141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe176a00640 1 -- 172.21.15.114:0/712092071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe178150490 msgr2=0x7fe17814cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe176a00640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe178150490 0x7fe17814cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe176a00640 1 -- 172.21.15.114:0/712092071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1600094d0 con 0x7fe17806db50 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe176a00640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 0x7fe1780bfa00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c7c0 tx=0x7fe16800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe16ea00640 1 -- 172.21.15.114:0/712092071 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16800aa50 con 0x7fe17806db50 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe16ea00640 1 -- 172.21.15.114:0/712092071 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16800abb0 con 0x7fe17806db50 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe17dc00640 1 -- 172.21.15.114:0/712092071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe178146930 con 0x7fe17806db50 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe16ea00640 1 -- 172.21.15.114:0/712092071 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168012420 con 0x7fe17806db50 2024-02-17T12:18:19.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe17dc00640 1 -- 172.21.15.114:0/712092071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1780aae50 con 0x7fe17806db50 2024-02-17T12:18:19.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe17dc00640 1 -- 172.21.15.114:0/712092071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe178074840 con 0x7fe17806db50 2024-02-17T12:18:19.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.509+0000 7fe16ea00640 1 -- 172.21.15.114:0/712092071 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe168012580 con 0x7fe17806db50 2024-02-17T12:18:19.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.513+0000 7fe16ea00640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe154066e40 0x7fe154069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:19.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.513+0000 7fe16ea00640 1 -- 172.21.15.114:0/712092071 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fe168085080 con 0x7fe17806db50 2024-02-17T12:18:19.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.513+0000 7fe176000640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe154066e40 0x7fe154069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:19.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.513+0000 7fe176000640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe154066e40 0x7fe154069300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe1600ad000 tx=0x7fe1600a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:19.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.517+0000 7fe16ea00640 1 -- 172.21.15.114:0/712092071 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe1680b6cb0 con 0x7fe17806db50 2024-02-17T12:18:19.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:19.701+0000 7fe17dc00640 1 -- 172.21.15.114:0/712092071 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fe1781471e0 con 0x7fe17806db50 2024-02-17T12:18:20.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.333+0000 7fe16ea00640 1 -- 172.21.15.114:0/712092071 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v34) v1 ==== 177+0+0 (secure 0 0 0) 0x7fe1680160c0 con 0x7fe17806db50 2024-02-17T12:18:20.338 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 10 and data pool 11 2024-02-17T12:18:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.337+0000 7fe17dc00640 1 -- 172.21.15.114:0/712092071 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe154066e40 msgr2=0x7fe154069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.337+0000 7fe17dc00640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe154066e40 0x7fe154069300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe1600ad000 tx=0x7fe1600a6000 comp rx=0 tx=0).stop 2024-02-17T12:18:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.337+0000 7fe17dc00640 1 -- 172.21.15.114:0/712092071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 msgr2=0x7fe1780bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.337+0000 7fe17dc00640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 0x7fe1780bfa00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c7c0 tx=0x7fe16800cc80 comp rx=0 tx=0).stop 2024-02-17T12:18:20.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.345+0000 7fe17dc00640 1 -- 172.21.15.114:0/712092071 shutdown_connections 2024-02-17T12:18:20.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.345+0000 7fe17dc00640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe178150490 0x7fe17814cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.345+0000 7fe17dc00640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe1780c25a0 0x7fe178141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.345+0000 7fe17dc00640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe154066e40 0x7fe154069300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.345+0000 7fe17dc00640 1 --2- 172.21.15.114:0/712092071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe17806db50 0x7fe1780bfa00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.345+0000 7fe17dc00640 1 -- 172.21.15.114:0/712092071 >> 172.21.15.114:0/712092071 conn(0x7fe1780a8490 msgr2=0x7fe1780c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:20.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.345+0000 7fe17dc00640 1 -- 172.21.15.114:0/712092071 shutdown_connections 2024-02-17T12:18:20.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.345+0000 7fe17dc00640 1 -- 172.21.15.114:0/712092071 wait complete. 2024-02-17T12:18:20.388 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:20.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f772d200640 1 Processor -- start 2024-02-17T12:18:20.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f772d200640 1 -- start start 2024-02-17T12:18:20.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f772d200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7728152540 0x7f772806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f772d200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7728155dd0 con 0x7f77280c6460 2024-02-17T12:18:20.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f772d200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77281588c0 con 0x7f7728154e30 2024-02-17T12:18:20.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f772d200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7728155810 con 0x7f7728152540 2024-02-17T12:18:20.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f7725400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f77280c6460 0x7f7728158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54710/0 (socket says 172.21.15.114:54710) 2024-02-17T12:18:20.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f7725400640 1 -- 172.21.15.114:0/2612817562 learned_addr learned my addr 172.21.15.114:0/2612817562 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:20.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f7725e00640 1 --2- 172.21.15.114:0/2612817562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7728152540 0x7f772806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f7724a00640 1 -- 172.21.15.114:0/2612817562 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581283632 0 0) 0x7f7728155dd0 con 0x7f77280c6460 2024-02-17T12:18:20.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f7724a00640 1 -- 172.21.15.114:0/2612817562 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f770c003530 con 0x7f77280c6460 2024-02-17T12:18:20.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f7724a00640 1 -- 172.21.15.114:0/2612817562 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041386575 0 0) 0x7f77281588c0 con 0x7f7728154e30 2024-02-17T12:18:20.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f7725e00640 1 -- 172.21.15.114:0/2612817562 >> v1:172.21.15.116:6789/0 conn(0x7f7728154e30 legacy=0x7f77280aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f7725e00640 1 -- 172.21.15.114:0/2612817562 >> v1:172.21.15.114:6789/0 conn(0x7f77280c6460 legacy=0x7f7728158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.521+0000 7f7725e00640 1 -- 172.21.15.114:0/2612817562 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7728155af0 con 0x7f7728152540 2024-02-17T12:18:20.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f7725e00640 1 --2- 172.21.15.114:0/2612817562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7728152540 0x7f772806ff80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77180097f0 tx=0x7f771801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72e9984e4077f04f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:20.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f7724a00640 1 -- 172.21.15.114:0/2612817562 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180ab600 con 0x7f7728152540 2024-02-17T12:18:20.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f7724a00640 1 -- 172.21.15.114:0/2612817562 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77180a7050 con 0x7f7728152540 2024-02-17T12:18:20.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f7724a00640 1 -- 172.21.15.114:0/2612817562 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180ab980 con 0x7f7728152540 2024-02-17T12:18:20.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f772d200640 1 -- 172.21.15.114:0/2612817562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7728152540 msgr2=0x7f772806ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f772d200640 1 --2- 172.21.15.114:0/2612817562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7728152540 0x7f772806ff80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77180097f0 tx=0x7f771801c3c0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f772d200640 1 -- 172.21.15.114:0/2612817562 shutdown_connections 2024-02-17T12:18:20.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f772d200640 1 --2- 172.21.15.114:0/2612817562 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7728152540 0x7f772806ff80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f772d200640 1 -- 172.21.15.114:0/2612817562 >> 172.21.15.114:0/2612817562 conn(0x7f77280c4f20 msgr2=0x7f77280c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:20.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f772d200640 1 -- 172.21.15.114:0/2612817562 shutdown_connections 2024-02-17T12:18:20.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.525+0000 7f772d200640 1 -- 172.21.15.114:0/2612817562 wait complete. 2024-02-17T12:18:20.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 Processor -- start 2024-02-17T12:18:20.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 -- start start 2024-02-17T12:18:20.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77280c6460 0x7f77281431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7728152540 0x7f772814aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7728154e30 0x7f77281489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772814afb0 con 0x7f77280c6460 2024-02-17T12:18:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772814b470 con 0x7f7728154e30 2024-02-17T12:18:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77281417b0 con 0x7f7728152540 2024-02-17T12:18:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f7725e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77280c6460 0x7f77281431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f7725e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77280c6460 0x7f77281431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35418/0 (socket says 172.21.15.114:35418) 2024-02-17T12:18:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f7725e00640 1 -- 172.21.15.114:0/3135739872 learned_addr learned my addr 172.21.15.114:0/3135739872 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f7725e00640 1 -- 172.21.15.114:0/3135739872 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7728152540 msgr2=0x7f772814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f7725e00640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7728152540 0x7f772814aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f7725e00640 1 -- 172.21.15.114:0/3135739872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7728154e30 msgr2=0x7f77281489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f7725e00640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7728154e30 0x7f77281489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f7725e00640 1 -- 172.21.15.114:0/3135739872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7718009420 con 0x7f77280c6460 2024-02-17T12:18:20.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f7725e00640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77280c6460 0x7f77281431a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f77180097f0 tx=0x7f7718019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f771e000640 1 -- 172.21.15.114:0/3135739872 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718004020 con 0x7f77280c6460 2024-02-17T12:18:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f771e000640 1 -- 172.21.15.114:0/3135739872 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7718004180 con 0x7f77280c6460 2024-02-17T12:18:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 -- 172.21.15.114:0/3135739872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7728141a90 con 0x7f77280c6460 2024-02-17T12:18:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f771e000640 1 -- 172.21.15.114:0/3135739872 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180044f0 con 0x7f77280c6460 2024-02-17T12:18:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 -- 172.21.15.114:0/3135739872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7728071850 con 0x7f77280c6460 2024-02-17T12:18:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.529+0000 7f772d200640 1 -- 172.21.15.114:0/3135739872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7728074840 con 0x7f77280c6460 2024-02-17T12:18:20.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.533+0000 7f771e000640 1 -- 172.21.15.114:0/3135739872 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f77180b2040 con 0x7f77280c6460 2024-02-17T12:18:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.533+0000 7f771e000640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7708066e40 0x7f7708069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.533+0000 7f771e000640 1 -- 172.21.15.114:0/3135739872 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f771811ecd0 con 0x7f77280c6460 2024-02-17T12:18:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.533+0000 7f7725400640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7708066e40 0x7f7708069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.533+0000 7f7725400640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7708066e40 0x7f7708069300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7714007fd0 tx=0x7f7714007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:20.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.537+0000 7f771e000640 1 -- 172.21.15.114:0/3135739872 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f77180eb6c0 con 0x7f77280c6460 2024-02-17T12:18:20.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.693+0000 7f772d200640 1 -- 172.21.15.114:0/3135739872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f772814a600 con 0x7f77280c6460 2024-02-17T12:18:20.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.693+0000 7f771e000640 1 -- 172.21.15.114:0/3135739872 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20471 (secure 0 0 0) 0x7f77180b0090 con 0x7f77280c6460 2024-02-17T12:18:20.697 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:20.697 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:19.704243+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.693+0000 7f772d200640 1 -- 172.21.15.114:0/3135739872 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7708066e40 msgr2=0x7f7708069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.693+0000 7f772d200640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7708066e40 0x7f7708069300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7714007fd0 tx=0x7f7714007900 comp rx=0 tx=0).stop 2024-02-17T12:18:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.693+0000 7f772d200640 1 -- 172.21.15.114:0/3135739872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77280c6460 msgr2=0x7f77281431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.693+0000 7f772d200640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77280c6460 0x7f77281431a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f77180097f0 tx=0x7f7718019160 comp rx=0 tx=0).stop 2024-02-17T12:18:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.697+0000 7f772d200640 1 -- 172.21.15.114:0/3135739872 shutdown_connections 2024-02-17T12:18:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.697+0000 7f772d200640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7728154e30 0x7f77281489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.697+0000 7f772d200640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7728152540 0x7f772814aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.697+0000 7f772d200640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7708066e40 0x7f7708069300 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.697+0000 7f772d200640 1 --2- 172.21.15.114:0/3135739872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77280c6460 0x7f77281431a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.697+0000 7f772d200640 1 -- 172.21.15.114:0/3135739872 >> 172.21.15.114:0/3135739872 conn(0x7f77280c4f20 msgr2=0x7f7728149710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:20.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.697+0000 7f772d200640 1 -- 172.21.15.114:0/3135739872 shutdown_connections 2024-02-17T12:18:20.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.697+0000 7f772d200640 1 -- 172.21.15.114:0/3135739872 wait complete. 2024-02-17T12:18:20.719 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:20.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.849+0000 7f4beac00640 1 Processor -- start 2024-02-17T12:18:20.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.849+0000 7f4beac00640 1 -- start start 2024-02-17T12:18:20.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4beac00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be40c2580 0x7f4be40aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4beac00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be40a9420 con 0x7f4be40c1eb0 2024-02-17T12:18:20.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4beac00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be4152850 con 0x7f4be414f110 2024-02-17T12:18:20.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4beac00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be414f4f0 con 0x7f4be40c2580 2024-02-17T12:18:20.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be8c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4be40c1eb0 0x7f4be415c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54712/0 (socket says 172.21.15.114:54712) 2024-02-17T12:18:20.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be8c00640 1 -- 172.21.15.114:0/2588496422 learned_addr learned my addr 172.21.15.114:0/2588496422 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:20.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be3400640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be40c2580 0x7f4be40aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293513790 0 0) 0x7f4be40a9420 con 0x7f4be40c1eb0 2024-02-17T12:18:20.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc8005740 con 0x7f4be40c1eb0 2024-02-17T12:18:20.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310314 0 0) 0x7f4bc8005740 con 0x7f4be40c1eb0 2024-02-17T12:18:20.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be40c2580 msgr2=0x7f4be40aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:20.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be40c2580 0x7f4be40aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 >> v1:172.21.15.116:6789/0 conn(0x7f4be414f110 legacy=0x7f4be40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be40a9670 con 0x7f4be40c1eb0 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f4bdc001680 con 0x7f4be40c1eb0 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 >> v1:172.21.15.114:6789/0 conn(0x7f4be40c1eb0 legacy=0x7f4be415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8005bc0 0x7f4bc8005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be40c2580 0x7f4bc80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bc8006f20 0x7f4bc80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be414f4f0 con 0x7f4bc8006f20 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc800dc50 con 0x7f4bc8005bc0 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc800de10 con 0x7f4be40c2580 2024-02-17T12:18:20.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be8c00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bc8006f20 0x7f4bc80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be3e00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8005bc0 0x7f4bc8005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be3400640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be40c2580 0x7f4bc80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be8c00640 1 -- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be40c2580 msgr2=0x7f4bc80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:20.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be8c00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be40c2580 0x7f4bc80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be8c00640 1 -- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8005bc0 msgr2=0x7f4bc8005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:20.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be8c00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8005bc0 0x7f4bc8005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be8c00640 1 -- 172.21.15.114:0/2588496422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc8005740 con 0x7f4bc8006f20 2024-02-17T12:18:20.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.853+0000 7f4be3e00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8005bc0 0x7f4bc8005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:20.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4be8c00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bc8006f20 0x7f4bc80073a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4be40c2320 tx=0x7f4bdc01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc542bb582b657ed server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:20.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc005ae0 con 0x7f4bc8006f20 2024-02-17T12:18:20.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc005c60 con 0x7f4bc8006f20 2024-02-17T12:18:20.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4be2a00640 1 -- 172.21.15.114:0/2588496422 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc0a57f0 con 0x7f4bc8006f20 2024-02-17T12:18:20.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4beac00640 1 -- 172.21.15.114:0/2588496422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bc8006f20 msgr2=0x7f4bc80073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4beac00640 1 --2- 172.21.15.114:0/2588496422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bc8006f20 0x7f4bc80073a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4be40c2320 tx=0x7f4bdc01cc20 comp rx=0 tx=0).stop 2024-02-17T12:18:20.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4be8c00640 1 -- 172.21.15.114:0/2588496422 reap_dead start 2024-02-17T12:18:20.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4beac00640 1 -- 172.21.15.114:0/2588496422 shutdown_connections 2024-02-17T12:18:20.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4beac00640 1 -- 172.21.15.114:0/2588496422 >> 172.21.15.114:0/2588496422 conn(0x7f4be40a8490 msgr2=0x7f4be40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:20.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4beac00640 1 -- 172.21.15.114:0/2588496422 shutdown_connections 2024-02-17T12:18:20.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4beac00640 1 -- 172.21.15.114:0/2588496422 wait complete. 2024-02-17T12:18:20.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4beac00640 1 Processor -- start 2024-02-17T12:18:20.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.857+0000 7f4beac00640 1 -- start start 2024-02-17T12:18:20.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4beac00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8006f20 0x7f4be40c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4beac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be41517b0 0x7f4be40c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4beac00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be414ffb0 0x7f4be4150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4beac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be414f840 con 0x7f4be41517b0 2024-02-17T12:18:20.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4beac00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be414db20 con 0x7f4bc8006f20 2024-02-17T12:18:20.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4beac00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be414de00 con 0x7f4be414ffb0 2024-02-17T12:18:20.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be41517b0 0x7f4be40c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be41517b0 0x7f4be40c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35448/0 (socket says 172.21.15.114:35448) 2024-02-17T12:18:20.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3400640 1 -- 172.21.15.114:0/1362239405 learned_addr learned my addr 172.21.15.114:0/1362239405 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3e00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8006f20 0x7f4be40c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be8c00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be414ffb0 0x7f4be4150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3400640 1 -- 172.21.15.114:0/1362239405 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be414ffb0 msgr2=0x7f4be4150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3400640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be414ffb0 0x7f4be4150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3400640 1 -- 172.21.15.114:0/1362239405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8006f20 msgr2=0x7f4be40c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3400640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8006f20 0x7f4be40c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:20.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3400640 1 -- 172.21.15.114:0/1362239405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be414e0e0 con 0x7f4be41517b0 2024-02-17T12:18:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3e00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8006f20 0x7f4be40c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4be3400640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be41517b0 0x7f4be40c49a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0011940 tx=0x7f4bd0011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4bdbe00640 1 -- 172.21.15.114:0/1362239405 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0004240 con 0x7f4be41517b0 2024-02-17T12:18:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4bdbe00640 1 -- 172.21.15.114:0/1362239405 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd00043a0 con 0x7f4be41517b0 2024-02-17T12:18:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4beac00640 1 -- 172.21.15.114:0/1362239405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be414fa90 con 0x7f4be41517b0 2024-02-17T12:18:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4bdbe00640 1 -- 172.21.15.114:0/1362239405 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000fb00 con 0x7f4be41517b0 2024-02-17T12:18:20.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4beac00640 1 -- 172.21.15.114:0/1362239405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be414d740 con 0x7f4be41517b0 2024-02-17T12:18:20.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4beac00640 1 -- 172.21.15.114:0/1362239405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be4074840 con 0x7f4be41517b0 2024-02-17T12:18:20.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.861+0000 7f4bdbe00640 1 -- 172.21.15.114:0/1362239405 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4bd000fc60 con 0x7f4be41517b0 2024-02-17T12:18:20.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.865+0000 7f4bdbe00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc4066e40 0x7f4bc4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:20.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.865+0000 7f4bdbe00640 1 -- 172.21.15.114:0/1362239405 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4bd0085570 con 0x7f4be41517b0 2024-02-17T12:18:20.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.865+0000 7f4be3e00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc4066e40 0x7f4bc4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:20.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.865+0000 7f4be3e00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc4066e40 0x7f4bc4069300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4007fd0 tx=0x7f4bd4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:20.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:20.869+0000 7f4bdbe00640 1 -- 172.21.15.114:0/1362239405 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4bd0051ff0 con 0x7f4be41517b0 2024-02-17T12:18:21.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.025+0000 7f4beac00640 1 -- 172.21.15.114:0/1362239405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4be414e270 con 0x7f4be41517b0 2024-02-17T12:18:21.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.025+0000 7f4bdbe00640 1 -- 172.21.15.114:0/1362239405 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20471 (secure 0 0 0) 0x7f4bd00556b0 con 0x7f4be41517b0 2024-02-17T12:18:21.030 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:21.030 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:19.704243+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 -- 172.21.15.114:0/1362239405 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc4066e40 msgr2=0x7f4bc4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc4066e40 0x7f4bc4069300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4007fd0 tx=0x7f4bd4009040 comp rx=0 tx=0).stop 2024-02-17T12:18:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 -- 172.21.15.114:0/1362239405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be41517b0 msgr2=0x7f4be40c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be41517b0 0x7f4be40c49a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0011940 tx=0x7f4bd0011e00 comp rx=0 tx=0).stop 2024-02-17T12:18:21.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 -- 172.21.15.114:0/1362239405 shutdown_connections 2024-02-17T12:18:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be414ffb0 0x7f4be4150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc4066e40 0x7f4bc4069300 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be41517b0 0x7f4be40c49a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 --2- 172.21.15.114:0/1362239405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4bc8006f20 0x7f4be40c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 -- 172.21.15.114:0/1362239405 >> 172.21.15.114:0/1362239405 conn(0x7f4be40a8490 msgr2=0x7f4be40bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:21.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 -- 172.21.15.114:0/1362239405 shutdown_connections 2024-02-17T12:18:21.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.029+0000 7f4beac00640 1 -- 172.21.15.114:0/1362239405 wait complete. 2024-02-17T12:18:21.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-02-17T12:18:21.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.185+0000 7f2b8de00640 1 Processor -- start 2024-02-17T12:18:21.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b8de00640 1 -- start start 2024-02-17T12:18:21.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b8de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 0x7f2b8806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:21.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b8de00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2b8806db50 0x7f2b8814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:21.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b8de00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b88156270 con 0x7f2b88150490 2024-02-17T12:18:21.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b8de00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b88071630 con 0x7f2b8806db50 2024-02-17T12:18:21.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b8de00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b88156550 con 0x7f2b880c25a0 2024-02-17T12:18:21.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b87400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2b88150490 0x7f2b88152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54724/0 (socket says 172.21.15.114:54724) 2024-02-17T12:18:21.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b87400640 1 -- 172.21.15.114:0/3894817725 learned_addr learned my addr 172.21.15.114:0/3894817725 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:21.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b86a00640 1 --2- 172.21.15.114:0/3894817725 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 0x7f2b8806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:21.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b86000640 1 --2- 172.21.15.114:0/3894817725 >> v2:172.21.15.116:3300/0 conn(0x7f2b8806db50 0x7f2b8814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:21.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b85600640 1 -- 172.21.15.114:0/3894817725 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987002327 0 0) 0x7f2b88156270 con 0x7f2b88150490 2024-02-17T12:18:21.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b85600640 1 -- 172.21.15.114:0/3894817725 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b6c003530 con 0x7f2b88150490 2024-02-17T12:18:21.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b86a00640 1 -- 172.21.15.114:0/3894817725 >> v2:172.21.15.116:3300/0 conn(0x7f2b8806db50 msgr2=0x7f2b8814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:21.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b86a00640 1 --2- 172.21.15.114:0/3894817725 >> v2:172.21.15.116:3300/0 conn(0x7f2b8806db50 0x7f2b8814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:21.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b86a00640 1 -- 172.21.15.114:0/3894817725 >> v1:172.21.15.114:6789/0 conn(0x7f2b88150490 legacy=0x7f2b88152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:21.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.189+0000 7f2b86a00640 1 -- 172.21.15.114:0/3894817725 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b88156830 con 0x7f2b880c25a0 2024-02-17T12:18:21.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b86a00640 1 --2- 172.21.15.114:0/3894817725 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 0x7f2b8806e980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b780097c0 tx=0x7f2b7801c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80cde97a1a013aee server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:21.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b85600640 1 -- 172.21.15.114:0/3894817725 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780ab600 con 0x7f2b880c25a0 2024-02-17T12:18:21.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b85600640 1 -- 172.21.15.114:0/3894817725 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b780a7050 con 0x7f2b880c25a0 2024-02-17T12:18:21.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b85600640 1 -- 172.21.15.114:0/3894817725 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780ab960 con 0x7f2b880c25a0 2024-02-17T12:18:21.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b8de00640 1 -- 172.21.15.114:0/3894817725 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 msgr2=0x7f2b8806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:21.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b8de00640 1 --2- 172.21.15.114:0/3894817725 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 0x7f2b8806e980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b780097c0 tx=0x7f2b7801c350 comp rx=0 tx=0).stop 2024-02-17T12:18:21.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b8de00640 1 -- 172.21.15.114:0/3894817725 shutdown_connections 2024-02-17T12:18:21.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b8de00640 1 --2- 172.21.15.114:0/3894817725 >> v2:172.21.15.116:3300/0 conn(0x7f2b8806db50 0x7f2b8814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:21.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b8de00640 1 --2- 172.21.15.114:0/3894817725 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 0x7f2b8806e980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:21.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b8de00640 1 -- 172.21.15.114:0/3894817725 >> 172.21.15.114:0/3894817725 conn(0x7f2b880a8490 msgr2=0x7f2b880a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:21.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b8de00640 1 -- 172.21.15.114:0/3894817725 shutdown_connections 2024-02-17T12:18:21.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b8de00640 1 -- 172.21.15.114:0/3894817725 wait complete. 2024-02-17T12:18:21.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b8de00640 1 Processor -- start 2024-02-17T12:18:21.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.193+0000 7f2b8de00640 1 -- start start 2024-02-17T12:18:21.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b8de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b8806db50 0x7f2b880aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:21.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b8de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 0x7f2b8813e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:21.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b8de00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b88150490 0x7f2b8813eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:21.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b8de00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b881509c0 con 0x7f2b8806db50 2024-02-17T12:18:21.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b8de00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b88151220 con 0x7f2b88150490 2024-02-17T12:18:21.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b8de00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8813f0d0 con 0x7f2b880c25a0 2024-02-17T12:18:21.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b86a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b8806db50 0x7f2b880aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:21.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b86a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b8806db50 0x7f2b880aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35452/0 (socket says 172.21.15.114:35452) 2024-02-17T12:18:21.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b86a00640 1 -- 172.21.15.114:0/930930079 learned_addr learned my addr 172.21.15.114:0/930930079 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:21.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b87400640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b88150490 0x7f2b8813eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:21.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b86000640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 0x7f2b8813e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:21.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b86a00640 1 -- 172.21.15.114:0/930930079 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 msgr2=0x7f2b8813e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:21.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b86a00640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 0x7f2b8813e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:21.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b86a00640 1 -- 172.21.15.114:0/930930079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b88150490 msgr2=0x7f2b8813eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:21.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b86a00640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b88150490 0x7f2b8813eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:21.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b86a00640 1 -- 172.21.15.114:0/930930079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78009420 con 0x7f2b8806db50 2024-02-17T12:18:21.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b86a00640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b8806db50 0x7f2b880aa900 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2b78019f80 tx=0x7f2b780190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:21.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b7f400640 1 -- 172.21.15.114:0/930930079 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780b4410 con 0x7f2b8806db50 2024-02-17T12:18:21.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b7f400640 1 -- 172.21.15.114:0/930930079 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b780b4570 con 0x7f2b8806db50 2024-02-17T12:18:21.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b8de00640 1 -- 172.21.15.114:0/930930079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b881ee0f0 con 0x7f2b8806db50 2024-02-17T12:18:21.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b7f400640 1 -- 172.21.15.114:0/930930079 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780b48e0 con 0x7f2b8806db50 2024-02-17T12:18:21.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b8de00640 1 -- 172.21.15.114:0/930930079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b88150eb0 con 0x7f2b8806db50 2024-02-17T12:18:21.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b8de00640 1 -- 172.21.15.114:0/930930079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b88074840 con 0x7f2b8806db50 2024-02-17T12:18:21.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.197+0000 7f2b7f400640 1 -- 172.21.15.114:0/930930079 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2b780b2040 con 0x7f2b8806db50 2024-02-17T12:18:21.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.201+0000 7f2b7f400640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b64066e40 0x7f2b64069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:21.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.201+0000 7f2b7f400640 1 -- 172.21.15.114:0/930930079 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2b7811ec10 con 0x7f2b8806db50 2024-02-17T12:18:21.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.201+0000 7f2b86000640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b64066e40 0x7f2b64069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:21.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.201+0000 7f2b86000640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b64066e40 0x7f2b64069300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2b88144560 tx=0x7f2b70009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:21.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.205+0000 7f2b7f400640 1 -- 172.21.15.114:0/930930079 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2b780eb740 con 0x7f2b8806db50 2024-02-17T12:18:21.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:21.397+0000 7f2b8de00640 1 -- 172.21.15.114:0/930930079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2b880a8bf0 con 0x7f2b8806db50 2024-02-17T12:18:22.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b7f400640 1 -- 172.21.15.114:0/930930079 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 119+0+0 (secure 0 0 0) 0x7f2b780b00b0 con 0x7f2b8806db50 2024-02-17T12:18:22.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 -- 172.21.15.114:0/930930079 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b64066e40 msgr2=0x7f2b64069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:22.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b64066e40 0x7f2b64069300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2b88144560 tx=0x7f2b70009190 comp rx=0 tx=0).stop 2024-02-17T12:18:22.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 -- 172.21.15.114:0/930930079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b8806db50 msgr2=0x7f2b880aa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:22.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b8806db50 0x7f2b880aa900 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2b78019f80 tx=0x7f2b780190f0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 -- 172.21.15.114:0/930930079 shutdown_connections 2024-02-17T12:18:22.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b88150490 0x7f2b8813eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b880c25a0 0x7f2b8813e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2b64066e40 0x7f2b64069300 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 --2- 172.21.15.114:0/930930079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b8806db50 0x7f2b880aa900 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 -- 172.21.15.114:0/930930079 >> 172.21.15.114:0/930930079 conn(0x7f2b880a8490 msgr2=0x7f2b880bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:22.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 -- 172.21.15.114:0/930930079 shutdown_connections 2024-02-17T12:18:22.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.377+0000 7f2b8de00640 1 -- 172.21.15.114:0/930930079 wait complete. 2024-02-17T12:18:22.406 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-17T12:18:22.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-02-17T12:18:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde5be00640 1 Processor -- start 2024-02-17T12:18:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde5be00640 1 -- start start 2024-02-17T12:18:22.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde5be00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fde540c2580 0x7fde540aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde5be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde540c1eb0 0x7fde5415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde5be00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde540a9420 con 0x7fde5414f110 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde5be00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5414f4f0 con 0x7fde540c1eb0 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde5be00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde540aae80 con 0x7fde540c2580 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde59e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde540c1eb0 0x7fde5415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde59e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde540c1eb0 0x7fde5415c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35458/0 (socket says 172.21.15.114:35458) 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde59e00640 1 -- 172.21.15.114:0/1597585734 learned_addr learned my addr 172.21.15.114:0/1597585734 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde58a00640 1 --2- 172.21.15.114:0/1597585734 >> v2:172.21.15.116:3300/0 conn(0x7fde540c2580 0x7fde540aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde59e00640 1 -- 172.21.15.114:0/1597585734 >> v2:172.21.15.116:3300/0 conn(0x7fde540c2580 msgr2=0x7fde540aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde59e00640 1 --2- 172.21.15.114:0/1597585734 >> v2:172.21.15.116:3300/0 conn(0x7fde540c2580 0x7fde540aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde59e00640 1 -- 172.21.15.114:0/1597585734 >> v1:172.21.15.116:6789/0 conn(0x7fde5414f110 legacy=0x7fde540c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.545+0000 7fde59e00640 1 -- 172.21.15.114:0/1597585734 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde54152850 con 0x7fde540c1eb0 2024-02-17T12:18:22.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde59e00640 1 --2- 172.21.15.114:0/1597585734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 0x7fde5415c390 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fde5406f0d0 tx=0x7fde4c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e4f77de8d5af9e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:22.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde53e00640 1 -- 172.21.15.114:0/1597585734 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0a57b0 con 0x7fde540c1eb0 2024-02-17T12:18:22.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde53e00640 1 -- 172.21.15.114:0/1597585734 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c0a5910 con 0x7fde540c1eb0 2024-02-17T12:18:22.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde53e00640 1 -- 172.21.15.114:0/1597585734 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0a5ca0 con 0x7fde540c1eb0 2024-02-17T12:18:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde5be00640 1 -- 172.21.15.114:0/1597585734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 msgr2=0x7fde5415c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde5be00640 1 --2- 172.21.15.114:0/1597585734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 0x7fde5415c390 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fde5406f0d0 tx=0x7fde4c01c8f0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde5be00640 1 -- 172.21.15.114:0/1597585734 shutdown_connections 2024-02-17T12:18:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde5be00640 1 --2- 172.21.15.114:0/1597585734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 0x7fde5415c390 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde5be00640 1 --2- 172.21.15.114:0/1597585734 >> v2:172.21.15.116:3300/0 conn(0x7fde540c2580 0x7fde540aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde5be00640 1 -- 172.21.15.114:0/1597585734 >> 172.21.15.114:0/1597585734 conn(0x7fde540a8490 msgr2=0x7fde540a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde5be00640 1 -- 172.21.15.114:0/1597585734 shutdown_connections 2024-02-17T12:18:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde5be00640 1 -- 172.21.15.114:0/1597585734 wait complete. 2024-02-17T12:18:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde5be00640 1 Processor -- start 2024-02-17T12:18:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.549+0000 7fde5be00640 1 -- start start 2024-02-17T12:18:22.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde5be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 0x7fde540c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:22.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde5be00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fde540c2580 0x7fde541f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:22.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde5be00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5414f110 0x7fde540c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:22.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde5be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde54151ab0 con 0x7fde540c1eb0 2024-02-17T12:18:22.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde5be00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde54142dd0 con 0x7fde5414f110 2024-02-17T12:18:22.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde5be00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde540c52b0 con 0x7fde540c2580 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde59400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 0x7fde540c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde59400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 0x7fde540c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35474/0 (socket says 172.21.15.114:35474) 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde59400640 1 -- 172.21.15.114:0/1588336289 learned_addr learned my addr 172.21.15.114:0/1588336289 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde58a00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fde540c2580 0x7fde541f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde59e00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5414f110 0x7fde540c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde59400640 1 -- 172.21.15.114:0/1588336289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fde540c2580 msgr2=0x7fde541f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde59400640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fde540c2580 0x7fde541f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde59400640 1 -- 172.21.15.114:0/1588336289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5414f110 msgr2=0x7fde540c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde59400640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5414f110 0x7fde540c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde59400640 1 -- 172.21.15.114:0/1588336289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c009b30 con 0x7fde540c1eb0 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde58a00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fde540c2580 0x7fde541f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde59400640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 0x7fde540c4d70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fde4800c480 tx=0x7fde4800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:22.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde51600640 1 -- 172.21.15.114:0/1588336289 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48012830 con 0x7fde540c1eb0 2024-02-17T12:18:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde51600640 1 -- 172.21.15.114:0/1588336289 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480129b0 con 0x7fde540c1eb0 2024-02-17T12:18:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde5be00640 1 -- 172.21.15.114:0/1588336289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde541f0b60 con 0x7fde540c1eb0 2024-02-17T12:18:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde51600640 1 -- 172.21.15.114:0/1588336289 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48012d60 con 0x7fde540c1eb0 2024-02-17T12:18:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde5be00640 1 -- 172.21.15.114:0/1588336289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde541ee080 con 0x7fde540c1eb0 2024-02-17T12:18:22.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde5be00640 1 -- 172.21.15.114:0/1588336289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde54074840 con 0x7fde540c1eb0 2024-02-17T12:18:22.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.553+0000 7fde51600640 1 -- 172.21.15.114:0/1588336289 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fde4801c460 con 0x7fde540c1eb0 2024-02-17T12:18:22.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.557+0000 7fde51600640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fde34066e40 0x7fde34069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:22.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.557+0000 7fde51600640 1 -- 172.21.15.114:0/1588336289 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fde48084cc0 con 0x7fde540c1eb0 2024-02-17T12:18:22.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.557+0000 7fde58a00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fde34066e40 0x7fde34069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:22.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.557+0000 7fde58a00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fde34066e40 0x7fde34069300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fde540c3fd0 tx=0x7fde40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:22.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.561+0000 7fde51600640 1 -- 172.21.15.114:0/1588336289 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde4808b080 con 0x7fde540c1eb0 2024-02-17T12:18:22.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:22.749+0000 7fde5be00640 1 -- 172.21.15.114:0/1588336289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fde540c1380 con 0x7fde540c1eb0 2024-02-17T12:18:22.767 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-02-17T12:18:22.761+0000 7fe836e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:18:23.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.381+0000 7fde51600640 1 -- 172.21.15.114:0/1588336289 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 123+0+0 (secure 0 0 0) 0x7fde48051740 con 0x7fde540c1eb0 2024-02-17T12:18:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 -- 172.21.15.114:0/1588336289 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fde34066e40 msgr2=0x7fde34069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fde34066e40 0x7fde34069300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fde540c3fd0 tx=0x7fde40008040 comp rx=0 tx=0).stop 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 -- 172.21.15.114:0/1588336289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 msgr2=0x7fde540c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 0x7fde540c4d70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fde4800c480 tx=0x7fde4800c940 comp rx=0 tx=0).stop 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 -- 172.21.15.114:0/1588336289 shutdown_connections 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5414f110 0x7fde540c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fde540c2580 0x7fde541f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fde34066e40 0x7fde34069300 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 --2- 172.21.15.114:0/1588336289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde540c1eb0 0x7fde540c4d70 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 -- 172.21.15.114:0/1588336289 >> 172.21.15.114:0/1588336289 conn(0x7fde540a8490 msgr2=0x7fde540c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 -- 172.21.15.114:0/1588336289 shutdown_connections 2024-02-17T12:18:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.385+0000 7fde5be00640 1 -- 172.21.15.114:0/1588336289 wait complete. 2024-02-17T12:18:23.410 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-02-17T12:18:23.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:23.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b0c400640 1 Processor -- start 2024-02-17T12:18:23.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b0c400640 1 -- start start 2024-02-17T12:18:23.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b0c400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6b04156d30 0x7f6b04153440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:23.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b0c400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b040c3580 con 0x7f6b040714c0 2024-02-17T12:18:23.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b0c400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b040c2fc0 con 0x7f6b04150300 2024-02-17T12:18:23.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b0c400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b040c6900 con 0x7f6b04156d30 2024-02-17T12:18:23.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b09000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6b040714c0 0x7f6b04152d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54730/0 (socket says 172.21.15.114:54730) 2024-02-17T12:18:23.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b09000640 1 -- 172.21.15.114:0/1547033167 learned_addr learned my addr 172.21.15.114:0/1547033167 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:23.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b0a400640 1 --2- 172.21.15.114:0/1547033167 >> v2:172.21.15.114:3300/0 conn(0x7f6b04156d30 0x7f6b04153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:23.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b0a400640 1 -- 172.21.15.114:0/1547033167 >> v1:172.21.15.116:6789/0 conn(0x7f6b04150300 legacy=0x7f6b040aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:23.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b0a400640 1 -- 172.21.15.114:0/1547033167 >> v1:172.21.15.114:6789/0 conn(0x7f6b040714c0 legacy=0x7f6b04152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.545+0000 7f6b0a400640 1 -- 172.21.15.114:0/1547033167 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b040c32a0 con 0x7f6b04156d30 2024-02-17T12:18:23.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b0a400640 1 --2- 172.21.15.114:0/1547033167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04156d30 0x7f6b04153440 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009d90 tx=0x7f6afc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe98eacb589477c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:23.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b03e00640 1 -- 172.21.15.114:0/1547033167 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0a57f0 con 0x7f6b04156d30 2024-02-17T12:18:23.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b03e00640 1 -- 172.21.15.114:0/1547033167 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc0a5950 con 0x7f6b04156d30 2024-02-17T12:18:23.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b03e00640 1 -- 172.21.15.114:0/1547033167 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0a5ce0 con 0x7f6b04156d30 2024-02-17T12:18:23.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b0c400640 1 -- 172.21.15.114:0/1547033167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04156d30 msgr2=0x7f6b04153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b0c400640 1 --2- 172.21.15.114:0/1547033167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04156d30 0x7f6b04153440 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009d90 tx=0x7f6afc01c8a0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b0c400640 1 -- 172.21.15.114:0/1547033167 shutdown_connections 2024-02-17T12:18:23.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b0c400640 1 --2- 172.21.15.114:0/1547033167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04156d30 0x7f6b04153440 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b0c400640 1 -- 172.21.15.114:0/1547033167 >> 172.21.15.114:0/1547033167 conn(0x7f6b040c4f20 msgr2=0x7f6b040c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:23.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b0c400640 1 -- 172.21.15.114:0/1547033167 shutdown_connections 2024-02-17T12:18:23.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b0c400640 1 -- 172.21.15.114:0/1547033167 wait complete. 2024-02-17T12:18:23.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b0c400640 1 Processor -- start 2024-02-17T12:18:23.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.549+0000 7f6b0c400640 1 -- start start 2024-02-17T12:18:23.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0c400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b040714c0 0x7f6b041ebe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:23.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04150300 0x7f6b041527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0c400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b04156d30 0x7f6b0414acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b040ad600 con 0x7f6b04150300 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0c400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0414a580 con 0x7f6b04156d30 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0c400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0414b9d0 con 0x7f6b040714c0 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b09000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04150300 0x7f6b041527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b09000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04150300 0x7f6b041527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35502/0 (socket says 172.21.15.114:35502) 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b09000640 1 -- 172.21.15.114:0/2332654727 learned_addr learned my addr 172.21.15.114:0/2332654727 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0a400640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b04156d30 0x7f6b0414acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b09a00640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b040714c0 0x7f6b041ebe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b09000640 1 -- 172.21.15.114:0/2332654727 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b040714c0 msgr2=0x7f6b041ebe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b09000640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b040714c0 0x7f6b041ebe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b09000640 1 -- 172.21.15.114:0/2332654727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b04156d30 msgr2=0x7f6b0414acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b09000640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b04156d30 0x7f6b0414acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b09000640 1 -- 172.21.15.114:0/2332654727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc009a70 con 0x7f6b04150300 2024-02-17T12:18:23.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0a400640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b04156d30 0x7f6b0414acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:23.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b09000640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04150300 0x7f6b041527c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6af000c420 tx=0x7f6af000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:23.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b01600640 1 -- 172.21.15.114:0/2332654727 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0005cf0 con 0x7f6b04150300 2024-02-17T12:18:23.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b01600640 1 -- 172.21.15.114:0/2332654727 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af0005e50 con 0x7f6b04150300 2024-02-17T12:18:23.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0c400640 1 -- 172.21.15.114:0/2332654727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0414c620 con 0x7f6b04150300 2024-02-17T12:18:23.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b01600640 1 -- 172.21.15.114:0/2332654727 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af00072f0 con 0x7f6b04150300 2024-02-17T12:18:23.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0c400640 1 -- 172.21.15.114:0/2332654727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0414cbe0 con 0x7f6b04150300 2024-02-17T12:18:23.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b0c400640 1 -- 172.21.15.114:0/2332654727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b04074840 con 0x7f6b04150300 2024-02-17T12:18:23.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.553+0000 7f6b01600640 1 -- 172.21.15.114:0/2332654727 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6af0007450 con 0x7f6b04150300 2024-02-17T12:18:23.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.557+0000 7f6b01600640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ae4066e70 0x7f6ae4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:23.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.557+0000 7f6b01600640 1 -- 172.21.15.114:0/2332654727 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6af0084280 con 0x7f6b04150300 2024-02-17T12:18:23.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.557+0000 7f6b09a00640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ae4066e70 0x7f6ae4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:23.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.557+0000 7f6b09a00640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ae4066e70 0x7f6ae4069330 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6b040ae9a0 tx=0x7f6af8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:23.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.561+0000 7f6b01600640 1 -- 172.21.15.114:0/2332654727 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6af0050da0 con 0x7f6b04150300 2024-02-17T12:18:23.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.745+0000 7f6b0c400640 1 -- 172.21.15.114:0/2332654727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b040c28c0 con 0x7f6b04150300 2024-02-17T12:18:23.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b01600640 1 -- 172.21.15.114:0/2332654727 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6188 (secure 0 0 0) 0x7f6af0054460 con 0x7f6b04150300 2024-02-17T12:18:23.751 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:23.751 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:02.157066+0000","modified":"2024-02-17T12:18:05.178755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/105000653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":105000653},{"type":"v1","addr":"172.21.15.114:6837","nonce":105000653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:19.704588+0000","modified":"2024-02-17T12:18:22.751088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1690237872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1690237872},{"type":"v1","addr":"172.21.15.114:6836","nonce":1690237872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-02-17T12:18:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 38 2024-02-17T12:18:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 -- 172.21.15.114:0/2332654727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ae4066e70 msgr2=0x7f6ae4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ae4066e70 0x7f6ae4069330 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6b040ae9a0 tx=0x7f6af8009040 comp rx=0 tx=0).stop 2024-02-17T12:18:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 -- 172.21.15.114:0/2332654727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04150300 msgr2=0x7f6b041527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04150300 0x7f6b041527c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6af000c420 tx=0x7f6af000c8e0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 -- 172.21.15.114:0/2332654727 shutdown_connections 2024-02-17T12:18:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b04156d30 0x7f6b0414acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6ae4066e70 0x7f6ae4069330 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b04150300 0x7f6b041527c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 --2- 172.21.15.114:0/2332654727 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b040714c0 0x7f6b041ebe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 -- 172.21.15.114:0/2332654727 >> 172.21.15.114:0/2332654727 conn(0x7f6b040c4f20 msgr2=0x7f6b041565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 -- 172.21.15.114:0/2332654727 shutdown_connections 2024-02-17T12:18:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.749+0000 7f6b0c400640 1 -- 172.21.15.114:0/2332654727 wait complete. 2024-02-17T12:18:23.772 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f394e600640 1 Processor -- start 2024-02-17T12:18:23.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f394e600640 1 -- start start 2024-02-17T12:18:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f394e600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3948070b60 0x7f3948156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f394e600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3948153250 con 0x7f394813be90 2024-02-17T12:18:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f394e600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394806e780 con 0x7f3948072d50 2024-02-17T12:18:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f394e600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3948156730 con 0x7f3948070b60 2024-02-17T12:18:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f394d200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f394813be90 0x7f3948152b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54732/0 (socket says 172.21.15.114:54732) 2024-02-17T12:18:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f394d200640 1 -- 172.21.15.114:0/3355759285 learned_addr learned my addr 172.21.15.114:0/3355759285 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f3947e00640 1 --2- 172.21.15.114:0/3355759285 >> v2:172.21.15.116:3300/0 conn(0x7f3948070b60 0x7f3948156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f3947400640 1 -- 172.21.15.114:0/3355759285 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203353151 0 0) 0x7f3948153250 con 0x7f394813be90 2024-02-17T12:18:23.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f3947400640 1 -- 172.21.15.114:0/3355759285 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f392c003530 con 0x7f394813be90 2024-02-17T12:18:23.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f3947e00640 1 -- 172.21.15.114:0/3355759285 >> v1:172.21.15.116:6789/0 conn(0x7f3948072d50 legacy=0x7f39480c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f3947e00640 1 -- 172.21.15.114:0/3355759285 >> v1:172.21.15.114:6789/0 conn(0x7f394813be90 legacy=0x7f3948152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.905+0000 7f3947e00640 1 -- 172.21.15.114:0/3355759285 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394806ea60 con 0x7f3948070b60 2024-02-17T12:18:23.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f3947e00640 1 --2- 172.21.15.114:0/3355759285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948070b60 0x7f3948156b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f39340097c0 tx=0x7f393401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad2897c7d39e46f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:23.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f3947400640 1 -- 172.21.15.114:0/3355759285 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340ac620 con 0x7f3948070b60 2024-02-17T12:18:23.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f3947400640 1 -- 172.21.15.114:0/3355759285 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340ac780 con 0x7f3948070b60 2024-02-17T12:18:23.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f3947400640 1 -- 172.21.15.114:0/3355759285 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340acb10 con 0x7f3948070b60 2024-02-17T12:18:23.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f394e600640 1 -- 172.21.15.114:0/3355759285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948070b60 msgr2=0x7f3948156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f394e600640 1 --2- 172.21.15.114:0/3355759285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948070b60 0x7f3948156b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f39340097c0 tx=0x7f393401c3e0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f394e600640 1 -- 172.21.15.114:0/3355759285 shutdown_connections 2024-02-17T12:18:23.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f394e600640 1 --2- 172.21.15.114:0/3355759285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948070b60 0x7f3948156b50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f394e600640 1 -- 172.21.15.114:0/3355759285 >> 172.21.15.114:0/3355759285 conn(0x7f39480a8660 msgr2=0x7f39480a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:23.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f394e600640 1 -- 172.21.15.114:0/3355759285 shutdown_connections 2024-02-17T12:18:23.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f394e600640 1 -- 172.21.15.114:0/3355759285 wait complete. 2024-02-17T12:18:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f394e600640 1 Processor -- start 2024-02-17T12:18:23.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.909+0000 7f394e600640 1 -- start start 2024-02-17T12:18:23.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394e600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3948070b60 0x7f39481eef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:23.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394e600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948072d50 0x7f39480c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:23.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394813be90 0x7f3948132700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:23.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394e600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3948136f50 con 0x7f394813be90 2024-02-17T12:18:23.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394e600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39481ef470 con 0x7f3948072d50 2024-02-17T12:18:23.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394e600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39481eb0b0 con 0x7f3948070b60 2024-02-17T12:18:23.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394813be90 0x7f3948132700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:23.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394813be90 0x7f3948132700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35508/0 (socket says 172.21.15.114:35508) 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394dc00640 1 -- 172.21.15.114:0/944336155 learned_addr learned my addr 172.21.15.114:0/944336155 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394d200640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3948070b60 0x7f39481eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f3947e00640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948072d50 0x7f39480c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394dc00640 1 -- 172.21.15.114:0/944336155 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3948070b60 msgr2=0x7f39481eef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394dc00640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3948070b60 0x7f39481eef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394dc00640 1 -- 172.21.15.114:0/944336155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948072d50 msgr2=0x7f39480c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394dc00640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948072d50 0x7f39480c1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394dc00640 1 -- 172.21.15.114:0/944336155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934009420 con 0x7f394813be90 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394d200640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3948070b60 0x7f39481eef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394dc00640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394813be90 0x7f3948132700 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f394000c430 tx=0x7f394000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f3944c00640 1 -- 172.21.15.114:0/944336155 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940005220 con 0x7f394813be90 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f3944c00640 1 -- 172.21.15.114:0/944336155 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3940005380 con 0x7f394813be90 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f3944c00640 1 -- 172.21.15.114:0/944336155 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940007270 con 0x7f394813be90 2024-02-17T12:18:23.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394e600640 1 -- 172.21.15.114:0/944336155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39480c5500 con 0x7f394813be90 2024-02-17T12:18:23.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394e600640 1 -- 172.21.15.114:0/944336155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39480c5ac0 con 0x7f394813be90 2024-02-17T12:18:23.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f394e600640 1 -- 172.21.15.114:0/944336155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394804eef0 con 0x7f394813be90 2024-02-17T12:18:23.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.913+0000 7f3944c00640 1 -- 172.21.15.114:0/944336155 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f39400073d0 con 0x7f394813be90 2024-02-17T12:18:23.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.917+0000 7f3944c00640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3928066e40 0x7f3928069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:23.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.917+0000 7f3944c00640 1 -- 172.21.15.114:0/944336155 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3940084390 con 0x7f394813be90 2024-02-17T12:18:23.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.917+0000 7f394d200640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3928066e40 0x7f3928069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:23.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.917+0000 7f394d200640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3928066e40 0x7f3928069300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3938005c10 tx=0x7f3938009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:23.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:23.921+0000 7f3944c00640 1 -- 172.21.15.114:0/944336155 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3940050e10 con 0x7f394813be90 2024-02-17T12:18:24.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.077+0000 7f394e600640 1 -- 172.21.15.114:0/944336155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f394806f060 con 0x7f394813be90 2024-02-17T12:18:24.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.077+0000 7f3944c00640 1 -- 172.21.15.114:0/944336155 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20458 (secure 0 0 0) 0x7f39400544d0 con 0x7f394813be90 2024-02-17T12:18:24.081 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:24.081 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:21.358057+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.077+0000 7f394e600640 1 -- 172.21.15.114:0/944336155 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3928066e40 msgr2=0x7f3928069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.077+0000 7f394e600640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3928066e40 0x7f3928069300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3938005c10 tx=0x7f3938009040 comp rx=0 tx=0).stop 2024-02-17T12:18:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.077+0000 7f394e600640 1 -- 172.21.15.114:0/944336155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394813be90 msgr2=0x7f3948132700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.077+0000 7f394e600640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394813be90 0x7f3948132700 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f394000c430 tx=0x7f394000c8f0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.081+0000 7f394e600640 1 -- 172.21.15.114:0/944336155 shutdown_connections 2024-02-17T12:18:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.081+0000 7f394e600640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3928066e40 0x7f3928069300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.081+0000 7f394e600640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f394813be90 0x7f3948132700 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.081+0000 7f394e600640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3948072d50 0x7f39480c1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.081+0000 7f394e600640 1 --2- 172.21.15.114:0/944336155 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3948070b60 0x7f39481eef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.081+0000 7f394e600640 1 -- 172.21.15.114:0/944336155 >> 172.21.15.114:0/944336155 conn(0x7f39480a8660 msgr2=0x7f39481558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:24.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.081+0000 7f394e600640 1 -- 172.21.15.114:0/944336155 shutdown_connections 2024-02-17T12:18:24.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.081+0000 7f394e600640 1 -- 172.21.15.114:0/944336155 wait complete. 2024-02-17T12:18:24.103 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T12:18:24.103 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:18:24.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.233+0000 7f69aee00640 1 Processor -- start 2024-02-17T12:18:24.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.233+0000 7f69aee00640 1 -- start start 2024-02-17T12:18:24.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.233+0000 7f69aee00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f69a80c58b0 0x7f69a81583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.233+0000 7f69aee00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a8155090 con 0x7f69a80a6360 2024-02-17T12:18:24.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.233+0000 7f69aee00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a8159300 con 0x7f69a80c4b30 2024-02-17T12:18:24.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.233+0000 7f69aee00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a80c6110 con 0x7f69a80c58b0 2024-02-17T12:18:24.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.233+0000 7f69ace00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f69a80a6360 0x7f69a8155520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54742/0 (socket says 172.21.15.114:54742) 2024-02-17T12:18:24.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.233+0000 7f69ace00640 1 -- 172.21.15.114:0/1106932586 learned_addr learned my addr 172.21.15.114:0/1106932586 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:24.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a7e00640 1 --2- 172.21.15.114:0/1106932586 >> v2:172.21.15.116:3300/0 conn(0x7f69a80c58b0 0x7f69a81583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a6a00640 1 -- 172.21.15.114:0/1106932586 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890823025 0 0) 0x7f69a8155090 con 0x7f69a80a6360 2024-02-17T12:18:24.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a6a00640 1 -- 172.21.15.114:0/1106932586 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f698c003530 con 0x7f69a80a6360 2024-02-17T12:18:24.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a6a00640 1 -- 172.21.15.114:0/1106932586 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562788930 0 0) 0x7f69a8159300 con 0x7f69a80c4b30 2024-02-17T12:18:24.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a6a00640 1 -- 172.21.15.114:0/1106932586 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69a8155090 con 0x7f69a80c4b30 2024-02-17T12:18:24.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a6a00640 1 -- 172.21.15.114:0/1106932586 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2272940957 0 0) 0x7f698c003530 con 0x7f69a80a6360 2024-02-17T12:18:24.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a7e00640 1 -- 172.21.15.114:0/1106932586 >> v1:172.21.15.116:6789/0 conn(0x7f69a80c4b30 legacy=0x7f69a806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a7e00640 1 -- 172.21.15.114:0/1106932586 >> v1:172.21.15.114:6789/0 conn(0x7f69a80a6360 legacy=0x7f69a8155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a7e00640 1 -- 172.21.15.114:0/1106932586 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a8158a60 con 0x7f69a80c58b0 2024-02-17T12:18:24.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a7e00640 1 --2- 172.21.15.114:0/1106932586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69a80c58b0 0x7f69a81583d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6998009d90 tx=0x7f699801c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ad1acae4bf9f593 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:24.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a6a00640 1 -- 172.21.15.114:0/1106932586 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0001680 con 0x7f69a80c58b0 2024-02-17T12:18:24.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a6a00640 1 -- 172.21.15.114:0/1106932586 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69980a56a0 con 0x7f69a80c58b0 2024-02-17T12:18:24.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.237+0000 7f69a6a00640 1 -- 172.21.15.114:0/1106932586 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69980a5a30 con 0x7f69a80c58b0 2024-02-17T12:18:24.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 -- 172.21.15.114:0/1106932586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69a80c58b0 msgr2=0x7f69a81583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 --2- 172.21.15.114:0/1106932586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69a80c58b0 0x7f69a81583d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6998009d90 tx=0x7f699801c860 comp rx=0 tx=0).stop 2024-02-17T12:18:24.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 -- 172.21.15.114:0/1106932586 shutdown_connections 2024-02-17T12:18:24.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 --2- 172.21.15.114:0/1106932586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69a80c58b0 0x7f69a81583d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 -- 172.21.15.114:0/1106932586 >> 172.21.15.114:0/1106932586 conn(0x7f69a80c3730 msgr2=0x7f69a80c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:24.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 -- 172.21.15.114:0/1106932586 shutdown_connections 2024-02-17T12:18:24.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 -- 172.21.15.114:0/1106932586 wait complete. 2024-02-17T12:18:24.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 Processor -- start 2024-02-17T12:18:24.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 -- start start 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69a80a6360 0x7f69a81f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a80c4b30 0x7f69a8157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69a80c58b0 0x7f69a81ed110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a81f1460 con 0x7f69a80c4b30 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a815a4a0 con 0x7f69a80c58b0 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69aee00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a80ab090 con 0x7f69a80a6360 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69a7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a80c4b30 0x7f69a8157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69a7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a80c4b30 0x7f69a8157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35522/0 (socket says 172.21.15.114:35522) 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69a7400640 1 -- 172.21.15.114:0/3252760668 learned_addr learned my addr 172.21.15.114:0/3252760668 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69a7e00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69a80a6360 0x7f69a81f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69ace00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69a80c58b0 0x7f69a81ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69a7400640 1 -- 172.21.15.114:0/3252760668 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69a80a6360 msgr2=0x7f69a81f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69a7400640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69a80a6360 0x7f69a81f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69a7400640 1 -- 172.21.15.114:0/3252760668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69a80c58b0 msgr2=0x7f69a81ed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69a7400640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69a80c58b0 0x7f69a81ed110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69a7400640 1 -- 172.21.15.114:0/3252760668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6998009a70 con 0x7f69a80c4b30 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.241+0000 7f69a7400640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a80c4b30 0x7f69a8157480 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f699000c500 tx=0x7f699000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f699fe00640 1 -- 172.21.15.114:0/3252760668 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900052d0 con 0x7f69a80c4b30 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f699fe00640 1 -- 172.21.15.114:0/3252760668 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6990005430 con 0x7f69a80c4b30 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f699fe00640 1 -- 172.21.15.114:0/3252760668 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990012870 con 0x7f69a80c4b30 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f69aee00640 1 -- 172.21.15.114:0/3252760668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a80ab370 con 0x7f69a80c4b30 2024-02-17T12:18:24.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f69aee00640 1 -- 172.21.15.114:0/3252760668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a815a130 con 0x7f69a80c4b30 2024-02-17T12:18:24.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f69aee00640 1 -- 172.21.15.114:0/3252760668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a8067170 con 0x7f69a80c4b30 2024-02-17T12:18:24.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f699fe00640 1 -- 172.21.15.114:0/3252760668 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f69900129d0 con 0x7f69a80c4b30 2024-02-17T12:18:24.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f699fe00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6984066e40 0x7f6984069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f699fe00640 1 -- 172.21.15.114:0/3252760668 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6990084a60 con 0x7f69a80c4b30 2024-02-17T12:18:24.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f69a7e00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6984066e40 0x7f6984069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.245+0000 7f69a7e00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6984066e40 0x7f6984069300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69980af000 tx=0x7f69980a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:24.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.249+0000 7f699fe00640 1 -- 172.21.15.114:0/3252760668 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6990051460 con 0x7f69a80c4b30 2024-02-17T12:18:24.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.401+0000 7f69aee00640 1 -- 172.21.15.114:0/3252760668 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69a80c6490 con 0x7f6984066e40 2024-02-17T12:18:24.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.417+0000 7f699fe00640 1 -- 172.21.15.114:0/3252760668 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+520265 (secure 0 0 0) 0x7f69a80c6490 con 0x7f6984066e40 2024-02-17T12:18:24.425 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:24.429 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:18:24.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 -- 172.21.15.114:0/3252760668 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6984066e40 msgr2=0x7f6984069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6984066e40 0x7f6984069300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69980af000 tx=0x7f69980a7070 comp rx=0 tx=0).stop 2024-02-17T12:18:24.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 -- 172.21.15.114:0/3252760668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a80c4b30 msgr2=0x7f69a8157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a80c4b30 0x7f69a8157480 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f699000c500 tx=0x7f699000c9c0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 -- 172.21.15.114:0/3252760668 shutdown_connections 2024-02-17T12:18:24.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69a80c58b0 0x7f69a81ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6984066e40 0x7f6984069300 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a80c4b30 0x7f69a8157480 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 --2- 172.21.15.114:0/3252760668 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69a80a6360 0x7f69a81f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 -- 172.21.15.114:0/3252760668 >> 172.21.15.114:0/3252760668 conn(0x7f69a80c3730 msgr2=0x7f69a80c2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:24.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 -- 172.21.15.114:0/3252760668 shutdown_connections 2024-02-17T12:18:24.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.421+0000 7f69aee00640 1 -- 172.21.15.114:0/3252760668 wait complete. 2024-02-17T12:18:24.444 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-02-17T12:18:23.241617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594281,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":328,"acting":328,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230472,"kb_used_data":5976,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744248,"statfs":{"total":773094113280,"available":772858109952,"internally_reserved":0,"allocated":6119424,"data_stored":3255642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1245,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.918288"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.337103+0000","last_change":"2024-02-17T12:18:19.337103+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.337103+0000","last_undegraded":"2024-02-17T12:18:19.337103+0000","last_fullsized":"2024-02-17T12:18:19.337103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333598+0000","last_change":"2024-02-17T12:18:02.804326+0000","last_active":"2024-02-17T12:18:18.333598+0000","last_peered":"2024-02-17T12:18:18.333598+0000","last_clean":"2024-02-17T12:18:18.333598+0000","last_became_active":"2024-02-17T12:18:02.804074+0000","last_became_peered":"2024-02-17T12:18:02.804074+0000","last_unstale":"2024-02-17T12:18:18.333598+0000","last_undegraded":"2024-02-17T12:18:18.333598+0000","last_fullsized":"2024-02-17T12:18:18.333598+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:47.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.341116+0000","last_change":"2024-02-17T12:18:19.341116+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.341116+0000","last_undegraded":"2024-02-17T12:18:19.341116+0000","last_fullsized":"2024-02-17T12:18:19.341116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342702+0000","last_change":"2024-02-17T12:18:02.808706+0000","last_active":"2024-02-17T12:18:19.342702+0000","last_peered":"2024-02-17T12:18:19.342702+0000","last_clean":"2024-02-17T12:18:19.342702+0000","last_became_active":"2024-02-17T12:18:02.808520+0000","last_became_peered":"2024-02-17T12:18:02.808520+0000","last_unstale":"2024-02-17T12:18:19.342702+0000","last_undegraded":"2024-02-17T12:18:19.342702+0000","last_fullsized":"2024-02-17T12:18:19.342702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:27.642044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.331952+0000","last_change":"2024-02-17T12:18:02.807196+0000","last_active":"2024-02-17T12:18:18.331952+0000","last_peered":"2024-02-17T12:18:18.331952+0000","last_clean":"2024-02-17T12:18:18.331952+0000","last_became_active":"2024-02-17T12:18:02.806894+0000","last_became_peered":"2024-02-17T12:18:02.806894+0000","last_unstale":"2024-02-17T12:18:18.331952+0000","last_undegraded":"2024-02-17T12:18:18.331952+0000","last_fullsized":"2024-02-17T12:18:18.331952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:12.749708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335776+0000","last_change":"2024-02-17T12:18:19.335776+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335776+0000","last_undegraded":"2024-02-17T12:18:19.335776+0000","last_fullsized":"2024-02-17T12:18:19.335776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.329620+0000","last_change":"2024-02-17T12:18:02.814770+0000","last_active":"2024-02-17T12:18:19.329620+0000","last_peered":"2024-02-17T12:18:19.329620+0000","last_clean":"2024-02-17T12:18:19.329620+0000","last_became_active":"2024-02-17T12:18:02.809466+0000","last_became_peered":"2024-02-17T12:18:02.809466+0000","last_unstale":"2024-02-17T12:18:19.329620+0000","last_undegraded":"2024-02-17T12:18:19.329620+0000","last_fullsized":"2024-02-17T12:18:19.329620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332409+0000","last_change":"2024-02-17T12:18:19.332409+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332409+0000","last_undegraded":"2024-02-17T12:18:19.332409+0000","last_fullsized":"2024-02-17T12:18:19.332409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332653+0000","last_change":"2024-02-17T12:18:02.802996+0000","last_active":"2024-02-17T12:18:18.332653+0000","last_peered":"2024-02-17T12:18:18.332653+0000","last_clean":"2024-02-17T12:18:18.332653+0000","last_became_active":"2024-02-17T12:18:02.802690+0000","last_became_peered":"2024-02-17T12:18:02.802690+0000","last_unstale":"2024-02-17T12:18:18.332653+0000","last_undegraded":"2024-02-17T12:18:18.332653+0000","last_fullsized":"2024-02-17T12:18:18.332653+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:59.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339125+0000","last_change":"2024-02-17T12:18:19.339125+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339125+0000","last_undegraded":"2024-02-17T12:18:19.339125+0000","last_fullsized":"2024-02-17T12:18:19.339125+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339236+0000","last_change":"2024-02-17T12:18:02.812986+0000","last_active":"2024-02-17T12:18:19.339236+0000","last_peered":"2024-02-17T12:18:19.339236+0000","last_clean":"2024-02-17T12:18:19.339236+0000","last_became_active":"2024-02-17T12:18:02.809576+0000","last_became_peered":"2024-02-17T12:18:02.809576+0000","last_unstale":"2024-02-17T12:18:19.339236+0000","last_undegraded":"2024-02-17T12:18:19.339236+0000","last_fullsized":"2024-02-17T12:18:19.339236+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328210+0000","last_change":"2024-02-17T12:18:02.799654+0000","last_active":"2024-02-17T12:18:18.328210+0000","last_peered":"2024-02-17T12:18:18.328210+0000","last_clean":"2024-02-17T12:18:18.328210+0000","last_became_active":"2024-02-17T12:18:02.799356+0000","last_became_peered":"2024-02-17T12:18:02.799356+0000","last_unstale":"2024-02-17T12:18:18.328210+0000","last_undegraded":"2024-02-17T12:18:18.328210+0000","last_fullsized":"2024-02-17T12:18:18.328210+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:29.710017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340431+0000","last_change":"2024-02-17T12:18:19.340431+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340431+0000","last_undegraded":"2024-02-17T12:18:19.340431+0000","last_fullsized":"2024-02-17T12:18:19.340431+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339634+0000","last_change":"2024-02-17T12:18:02.800189+0000","last_active":"2024-02-17T12:18:19.339634+0000","last_peered":"2024-02-17T12:18:19.339634+0000","last_clean":"2024-02-17T12:18:19.339634+0000","last_became_active":"2024-02-17T12:18:02.799866+0000","last_became_peered":"2024-02-17T12:18:02.799866+0000","last_unstale":"2024-02-17T12:18:19.339634+0000","last_undegraded":"2024-02-17T12:18:19.339634+0000","last_fullsized":"2024-02-17T12:18:19.339634+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:52.152034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328951+0000","last_change":"2024-02-17T12:18:02.794591+0000","last_active":"2024-02-17T12:18:18.328951+0000","last_peered":"2024-02-17T12:18:18.328951+0000","last_clean":"2024-02-17T12:18:18.328951+0000","last_became_active":"2024-02-17T12:18:02.794309+0000","last_became_peered":"2024-02-17T12:18:02.794309+0000","last_unstale":"2024-02-17T12:18:18.328951+0000","last_undegraded":"2024-02-17T12:18:18.328951+0000","last_fullsized":"2024-02-17T12:18:18.328951+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:18.132994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.342320+0000","last_change":"2024-02-17T12:18:19.342320+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.342320+0000","last_undegraded":"2024-02-17T12:18:19.342320+0000","last_fullsized":"2024-02-17T12:18:19.342320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344227+0000","last_change":"2024-02-17T12:18:02.802586+0000","last_active":"2024-02-17T12:18:19.344227+0000","last_peered":"2024-02-17T12:18:19.344227+0000","last_clean":"2024-02-17T12:18:19.344227+0000","last_became_active":"2024-02-17T12:18:02.802328+0000","last_became_peered":"2024-02-17T12:18:02.802328+0000","last_unstale":"2024-02-17T12:18:19.344227+0000","last_undegraded":"2024-02-17T12:18:19.344227+0000","last_fullsized":"2024-02-17T12:18:19.344227+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:30.894335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344849+0000","last_change":"2024-02-17T12:18:02.803729+0000","last_active":"2024-02-17T12:18:19.344849+0000","last_peered":"2024-02-17T12:18:19.344849+0000","last_clean":"2024-02-17T12:18:19.344849+0000","last_became_active":"2024-02-17T12:18:02.803504+0000","last_became_peered":"2024-02-17T12:18:02.803504+0000","last_unstale":"2024-02-17T12:18:19.344849+0000","last_undegraded":"2024-02-17T12:18:19.344849+0000","last_fullsized":"2024-02-17T12:18:19.344849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:50.631061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330710+0000","last_change":"2024-02-17T12:18:02.814562+0000","last_active":"2024-02-17T12:18:19.330710+0000","last_peered":"2024-02-17T12:18:19.330710+0000","last_clean":"2024-02-17T12:18:19.330710+0000","last_became_active":"2024-02-17T12:18:02.809011+0000","last_became_peered":"2024-02-17T12:18:02.809011+0000","last_unstale":"2024-02-17T12:18:19.330710+0000","last_undegraded":"2024-02-17T12:18:19.330710+0000","last_fullsized":"2024-02-17T12:18:19.330710+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335567+0000","last_change":"2024-02-17T12:18:19.335567+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335567+0000","last_undegraded":"2024-02-17T12:18:19.335567+0000","last_fullsized":"2024-02-17T12:18:19.335567+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345668+0000","last_change":"2024-02-17T12:18:02.800228+0000","last_active":"2024-02-17T12:18:19.345668+0000","last_peered":"2024-02-17T12:18:19.345668+0000","last_clean":"2024-02-17T12:18:19.345668+0000","last_became_active":"2024-02-17T12:18:02.799965+0000","last_became_peered":"2024-02-17T12:18:02.799965+0000","last_unstale":"2024-02-17T12:18:19.345668+0000","last_undegraded":"2024-02-17T12:18:19.345668+0000","last_fullsized":"2024-02-17T12:18:19.345668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:05.435817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328399+0000","last_change":"2024-02-17T12:18:02.798437+0000","last_active":"2024-02-17T12:18:18.328399+0000","last_peered":"2024-02-17T12:18:18.328399+0000","last_clean":"2024-02-17T12:18:18.328399+0000","last_became_active":"2024-02-17T12:18:02.798145+0000","last_became_peered":"2024-02-17T12:18:02.798145+0000","last_unstale":"2024-02-17T12:18:18.328399+0000","last_undegraded":"2024-02-17T12:18:18.328399+0000","last_fullsized":"2024-02-17T12:18:18.328399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:29.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332924+0000","last_change":"2024-02-17T12:18:19.332924+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332924+0000","last_undegraded":"2024-02-17T12:18:19.332924+0000","last_fullsized":"2024-02-17T12:18:19.332924+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328351+0000","last_change":"2024-02-17T12:18:02.797013+0000","last_active":"2024-02-17T12:18:18.328351+0000","last_peered":"2024-02-17T12:18:18.328351+0000","last_clean":"2024-02-17T12:18:18.328351+0000","last_became_active":"2024-02-17T12:18:02.796734+0000","last_became_peered":"2024-02-17T12:18:02.796734+0000","last_unstale":"2024-02-17T12:18:18.328351+0000","last_undegraded":"2024-02-17T12:18:18.328351+0000","last_fullsized":"2024-02-17T12:18:18.328351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:32.566741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.336921+0000","last_change":"2024-02-17T12:18:02.809976+0000","last_active":"2024-02-17T12:18:19.336921+0000","last_peered":"2024-02-17T12:18:19.336921+0000","last_clean":"2024-02-17T12:18:19.336921+0000","last_became_active":"2024-02-17T12:18:02.809645+0000","last_became_peered":"2024-02-17T12:18:02.809645+0000","last_unstale":"2024-02-17T12:18:19.336921+0000","last_undegraded":"2024-02-17T12:18:19.336921+0000","last_fullsized":"2024-02-17T12:18:19.336921+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340057+0000","last_change":"2024-02-17T12:18:19.340057+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340057+0000","last_undegraded":"2024-02-17T12:18:19.340057+0000","last_fullsized":"2024-02-17T12:18:19.340057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343660+0000","last_change":"2024-02-17T12:18:02.807700+0000","last_active":"2024-02-17T12:18:19.343660+0000","last_peered":"2024-02-17T12:18:19.343660+0000","last_clean":"2024-02-17T12:18:19.343660+0000","last_became_active":"2024-02-17T12:18:02.805575+0000","last_became_peered":"2024-02-17T12:18:02.805575+0000","last_unstale":"2024-02-17T12:18:19.343660+0000","last_undegraded":"2024-02-17T12:18:19.343660+0000","last_fullsized":"2024-02-17T12:18:19.343660+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:52:33.882315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333193+0000","last_change":"2024-02-17T12:18:19.333193+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333193+0000","last_undegraded":"2024-02-17T12:18:19.333193+0000","last_fullsized":"2024-02-17T12:18:19.333193+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333106+0000","last_change":"2024-02-17T12:18:02.809074+0000","last_active":"2024-02-17T12:18:18.333106+0000","last_peered":"2024-02-17T12:18:18.333106+0000","last_clean":"2024-02-17T12:18:18.333106+0000","last_became_active":"2024-02-17T12:18:02.808683+0000","last_became_peered":"2024-02-17T12:18:02.808683+0000","last_unstale":"2024-02-17T12:18:18.333106+0000","last_undegraded":"2024-02-17T12:18:18.333106+0000","last_fullsized":"2024-02-17T12:18:18.333106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:46:21.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333344+0000","last_change":"2024-02-17T12:18:02.803587+0000","last_active":"2024-02-17T12:18:18.333344+0000","last_peered":"2024-02-17T12:18:18.333344+0000","last_clean":"2024-02-17T12:18:18.333344+0000","last_became_active":"2024-02-17T12:18:02.803312+0000","last_became_peered":"2024-02-17T12:18:02.803312+0000","last_unstale":"2024-02-17T12:18:18.333344+0000","last_undegraded":"2024-02-17T12:18:18.333344+0000","last_fullsized":"2024-02-17T12:18:18.333344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:54:01.696616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.342713+0000","last_change":"2024-02-17T12:18:19.342713+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.342713+0000","last_undegraded":"2024-02-17T12:18:19.342713+0000","last_fullsized":"2024-02-17T12:18:19.342713+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343993+0000","last_change":"2024-02-17T12:18:02.815782+0000","last_active":"2024-02-17T12:18:19.343993+0000","last_peered":"2024-02-17T12:18:19.343993+0000","last_clean":"2024-02-17T12:18:19.343993+0000","last_became_active":"2024-02-17T12:18:02.815537+0000","last_became_peered":"2024-02-17T12:18:02.815537+0000","last_unstale":"2024-02-17T12:18:19.343993+0000","last_undegraded":"2024-02-17T12:18:19.343993+0000","last_fullsized":"2024-02-17T12:18:19.343993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:23.114440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332256+0000","last_change":"2024-02-17T12:18:02.809894+0000","last_active":"2024-02-17T12:18:18.332256+0000","last_peered":"2024-02-17T12:18:18.332256+0000","last_clean":"2024-02-17T12:18:18.332256+0000","last_became_active":"2024-02-17T12:18:02.807451+0000","last_became_peered":"2024-02-17T12:18:02.807451+0000","last_unstale":"2024-02-17T12:18:18.332256+0000","last_undegraded":"2024-02-17T12:18:18.332256+0000","last_fullsized":"2024-02-17T12:18:18.332256+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:05:50.249065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341901+0000","last_change":"2024-02-17T12:18:02.813079+0000","last_active":"2024-02-17T12:18:19.341901+0000","last_peered":"2024-02-17T12:18:19.341901+0000","last_clean":"2024-02-17T12:18:19.341901+0000","last_became_active":"2024-02-17T12:18:02.810630+0000","last_became_peered":"2024-02-17T12:18:02.810630+0000","last_unstale":"2024-02-17T12:18:19.341901+0000","last_undegraded":"2024-02-17T12:18:19.341901+0000","last_fullsized":"2024-02-17T12:18:19.341901+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:32:22.683974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332679+0000","last_change":"2024-02-17T12:18:02.807916+0000","last_active":"2024-02-17T12:18:18.332679+0000","last_peered":"2024-02-17T12:18:18.332679+0000","last_clean":"2024-02-17T12:18:18.332679+0000","last_became_active":"2024-02-17T12:18:02.806754+0000","last_became_peered":"2024-02-17T12:18:02.806754+0000","last_unstale":"2024-02-17T12:18:18.332679+0000","last_undegraded":"2024-02-17T12:18:18.332679+0000","last_fullsized":"2024-02-17T12:18:18.332679+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.985986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346146+0000","last_change":"2024-02-17T12:18:02.805691+0000","last_active":"2024-02-17T12:18:19.346146+0000","last_peered":"2024-02-17T12:18:19.346146+0000","last_clean":"2024-02-17T12:18:19.346146+0000","last_became_active":"2024-02-17T12:18:02.805396+0000","last_became_peered":"2024-02-17T12:18:02.805396+0000","last_unstale":"2024-02-17T12:18:19.346146+0000","last_undegraded":"2024-02-17T12:18:19.346146+0000","last_fullsized":"2024-02-17T12:18:19.346146+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:09:34.480729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.336674+0000","last_change":"2024-02-17T12:18:19.336674+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.336674+0000","last_undegraded":"2024-02-17T12:18:19.336674+0000","last_fullsized":"2024-02-17T12:18:19.336674+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333690+0000","last_change":"2024-02-17T12:18:02.798267+0000","last_active":"2024-02-17T12:18:18.333690+0000","last_peered":"2024-02-17T12:18:18.333690+0000","last_clean":"2024-02-17T12:18:18.333690+0000","last_became_active":"2024-02-17T12:18:02.797624+0000","last_became_peered":"2024-02-17T12:18:02.797624+0000","last_unstale":"2024-02-17T12:18:18.333690+0000","last_undegraded":"2024-02-17T12:18:18.333690+0000","last_fullsized":"2024-02-17T12:18:18.333690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:17:06.691178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.332906+0000","last_change":"2024-02-17T12:18:02.802532+0000","last_active":"2024-02-17T12:18:19.332906+0000","last_peered":"2024-02-17T12:18:19.332906+0000","last_clean":"2024-02-17T12:18:19.332906+0000","last_became_active":"2024-02-17T12:18:02.801766+0000","last_became_peered":"2024-02-17T12:18:02.801766+0000","last_unstale":"2024-02-17T12:18:19.332906+0000","last_undegraded":"2024-02-17T12:18:19.332906+0000","last_fullsized":"2024-02-17T12:18:19.332906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338177+0000","last_change":"2024-02-17T12:18:02.797999+0000","last_active":"2024-02-17T12:18:19.338177+0000","last_peered":"2024-02-17T12:18:19.338177+0000","last_clean":"2024-02-17T12:18:19.338177+0000","last_became_active":"2024-02-17T12:18:02.797710+0000","last_became_peered":"2024-02-17T12:18:02.797710+0000","last_unstale":"2024-02-17T12:18:19.338177+0000","last_undegraded":"2024-02-17T12:18:19.338177+0000","last_fullsized":"2024-02-17T12:18:19.338177+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332446+0000","last_change":"2024-02-17T12:18:19.332446+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332446+0000","last_undegraded":"2024-02-17T12:18:19.332446+0000","last_fullsized":"2024-02-17T12:18:19.332446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333297+0000","last_change":"2024-02-17T12:18:02.804711+0000","last_active":"2024-02-17T12:18:18.333297+0000","last_peered":"2024-02-17T12:18:18.333297+0000","last_clean":"2024-02-17T12:18:18.333297+0000","last_became_active":"2024-02-17T12:18:02.804459+0000","last_became_peered":"2024-02-17T12:18:02.804459+0000","last_unstale":"2024-02-17T12:18:18.333297+0000","last_undegraded":"2024-02-17T12:18:18.333297+0000","last_fullsized":"2024-02-17T12:18:18.333297+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:47.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.329892+0000","last_change":"2024-02-17T12:18:19.329892+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.329892+0000","last_undegraded":"2024-02-17T12:18:19.329892+0000","last_fullsized":"2024-02-17T12:18:19.329892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342440+0000","last_change":"2024-02-17T12:18:02.802524+0000","last_active":"2024-02-17T12:18:19.342440+0000","last_peered":"2024-02-17T12:18:19.342440+0000","last_clean":"2024-02-17T12:18:19.342440+0000","last_became_active":"2024-02-17T12:18:02.802045+0000","last_became_peered":"2024-02-17T12:18:02.802045+0000","last_unstale":"2024-02-17T12:18:19.342440+0000","last_undegraded":"2024-02-17T12:18:19.342440+0000","last_fullsized":"2024-02-17T12:18:19.342440+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:06:03.414827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335592+0000","last_change":"2024-02-17T12:18:19.335592+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335592+0000","last_undegraded":"2024-02-17T12:18:19.335592+0000","last_fullsized":"2024-02-17T12:18:19.335592+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332116+0000","last_change":"2024-02-17T12:18:02.807169+0000","last_active":"2024-02-17T12:18:18.332116+0000","last_peered":"2024-02-17T12:18:18.332116+0000","last_clean":"2024-02-17T12:18:18.332116+0000","last_became_active":"2024-02-17T12:18:02.806918+0000","last_became_peered":"2024-02-17T12:18:02.806918+0000","last_unstale":"2024-02-17T12:18:18.332116+0000","last_undegraded":"2024-02-17T12:18:18.332116+0000","last_fullsized":"2024-02-17T12:18:18.332116+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:17.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339441+0000","last_change":"2024-02-17T12:18:19.339441+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339441+0000","last_undegraded":"2024-02-17T12:18:19.339441+0000","last_fullsized":"2024-02-17T12:18:19.339441+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332550+0000","last_change":"2024-02-17T12:18:02.795014+0000","last_active":"2024-02-17T12:18:18.332550+0000","last_peered":"2024-02-17T12:18:18.332550+0000","last_clean":"2024-02-17T12:18:18.332550+0000","last_became_active":"2024-02-17T12:18:02.794759+0000","last_became_peered":"2024-02-17T12:18:02.794759+0000","last_unstale":"2024-02-17T12:18:18.332550+0000","last_undegraded":"2024-02-17T12:18:18.332550+0000","last_fullsized":"2024-02-17T12:18:18.332550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:21.971723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333734+0000","last_change":"2024-02-17T12:18:19.333734+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333734+0000","last_undegraded":"2024-02-17T12:18:19.333734+0000","last_fullsized":"2024-02-17T12:18:19.333734+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.337022+0000","last_change":"2024-02-17T12:18:02.801322+0000","last_active":"2024-02-17T12:18:19.337022+0000","last_peered":"2024-02-17T12:18:19.337022+0000","last_clean":"2024-02-17T12:18:19.337022+0000","last_became_active":"2024-02-17T12:18:02.801073+0000","last_became_peered":"2024-02-17T12:18:02.801073+0000","last_unstale":"2024-02-17T12:18:19.337022+0000","last_undegraded":"2024-02-17T12:18:19.337022+0000","last_fullsized":"2024-02-17T12:18:19.337022+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.343199+0000","last_change":"2024-02-17T12:18:19.343199+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.343199+0000","last_undegraded":"2024-02-17T12:18:19.343199+0000","last_fullsized":"2024-02-17T12:18:19.343199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.326340+0000","last_change":"2024-02-17T12:18:18.326340+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.326340+0000","last_undegraded":"2024-02-17T12:18:18.326340+0000","last_fullsized":"2024-02-17T12:18:18.326340+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338219+0000","last_change":"2024-02-17T12:18:02.811882+0000","last_active":"2024-02-17T12:18:19.338219+0000","last_peered":"2024-02-17T12:18:19.338219+0000","last_clean":"2024-02-17T12:18:19.338219+0000","last_became_active":"2024-02-17T12:18:02.811448+0000","last_became_peered":"2024-02-17T12:18:02.811448+0000","last_unstale":"2024-02-17T12:18:19.338219+0000","last_undegraded":"2024-02-17T12:18:19.338219+0000","last_fullsized":"2024-02-17T12:18:19.338219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:46.432214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340678+0000","last_change":"2024-02-17T12:18:01.796858+0000","last_active":"2024-02-17T12:18:19.340678+0000","last_peered":"2024-02-17T12:18:19.340678+0000","last_clean":"2024-02-17T12:18:19.340678+0000","last_became_active":"2024-02-17T12:18:01.796498+0000","last_became_peered":"2024-02-17T12:18:01.796498+0000","last_unstale":"2024-02-17T12:18:19.340678+0000","last_undegraded":"2024-02-17T12:18:19.340678+0000","last_fullsized":"2024-02-17T12:18:19.340678+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355683+0000","last_change":"2024-02-17T12:18:19.351335+0000","last_active":"2024-02-17T12:18:19.355683+0000","last_peered":"2024-02-17T12:18:19.355683+0000","last_clean":"2024-02-17T12:18:19.355683+0000","last_became_active":"2024-02-17T12:18:19.350932+0000","last_became_peered":"2024-02-17T12:18:19.350932+0000","last_unstale":"2024-02-17T12:18:19.355683+0000","last_undegraded":"2024-02-17T12:18:19.355683+0000","last_fullsized":"2024-02-17T12:18:19.355683+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:52.676828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344983+0000","last_change":"2024-02-17T12:18:02.808663+0000","last_active":"2024-02-17T12:18:19.344983+0000","last_peered":"2024-02-17T12:18:19.344983+0000","last_clean":"2024-02-17T12:18:19.344983+0000","last_became_active":"2024-02-17T12:18:02.808402+0000","last_became_peered":"2024-02-17T12:18:02.808402+0000","last_unstale":"2024-02-17T12:18:19.344983+0000","last_undegraded":"2024-02-17T12:18:19.344983+0000","last_fullsized":"2024-02-17T12:18:19.344983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:00.777830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342763+0000","last_change":"2024-02-17T12:18:01.790619+0000","last_active":"2024-02-17T12:18:19.342763+0000","last_peered":"2024-02-17T12:18:19.342763+0000","last_clean":"2024-02-17T12:18:19.342763+0000","last_became_active":"2024-02-17T12:18:01.790344+0000","last_became_peered":"2024-02-17T12:18:01.790344+0000","last_unstale":"2024-02-17T12:18:19.342763+0000","last_undegraded":"2024-02-17T12:18:19.342763+0000","last_fullsized":"2024-02-17T12:18:19.342763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:45.425754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331676+0000","last_change":"2024-02-17T12:18:18.331676+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331676+0000","last_undegraded":"2024-02-17T12:18:18.331676+0000","last_fullsized":"2024-02-17T12:18:18.331676+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340787+0000","last_change":"2024-02-17T12:18:02.804685+0000","last_active":"2024-02-17T12:18:19.340787+0000","last_peered":"2024-02-17T12:18:19.340787+0000","last_clean":"2024-02-17T12:18:19.340787+0000","last_became_active":"2024-02-17T12:18:02.803980+0000","last_became_peered":"2024-02-17T12:18:02.803980+0000","last_unstale":"2024-02-17T12:18:19.340787+0000","last_undegraded":"2024-02-17T12:18:19.340787+0000","last_fullsized":"2024-02-17T12:18:19.340787+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:32.327387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338423+0000","last_change":"2024-02-17T12:18:01.801344+0000","last_active":"2024-02-17T12:18:19.338423+0000","last_peered":"2024-02-17T12:18:19.338423+0000","last_clean":"2024-02-17T12:18:19.338423+0000","last_became_active":"2024-02-17T12:18:01.801092+0000","last_became_peered":"2024-02-17T12:18:01.801092+0000","last_unstale":"2024-02-17T12:18:19.338423+0000","last_undegraded":"2024-02-17T12:18:19.338423+0000","last_fullsized":"2024-02-17T12:18:19.338423+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.357844+0000","last_change":"2024-02-17T12:18:19.348869+0000","last_active":"2024-02-17T12:18:19.357844+0000","last_peered":"2024-02-17T12:18:19.357844+0000","last_clean":"2024-02-17T12:18:19.357844+0000","last_became_active":"2024-02-17T12:18:19.347760+0000","last_became_peered":"2024-02-17T12:18:19.347760+0000","last_unstale":"2024-02-17T12:18:19.357844+0000","last_undegraded":"2024-02-17T12:18:19.357844+0000","last_fullsized":"2024-02-17T12:18:19.357844+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:28:32.430718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338263+0000","last_change":"2024-02-17T12:18:02.806603+0000","last_active":"2024-02-17T12:18:19.338263+0000","last_peered":"2024-02-17T12:18:19.338263+0000","last_clean":"2024-02-17T12:18:19.338263+0000","last_became_active":"2024-02-17T12:18:02.806021+0000","last_became_peered":"2024-02-17T12:18:02.806021+0000","last_unstale":"2024-02-17T12:18:19.338263+0000","last_undegraded":"2024-02-17T12:18:19.338263+0000","last_fullsized":"2024-02-17T12:18:19.338263+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:57.248220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330817+0000","last_change":"2024-02-17T12:18:01.790249+0000","last_active":"2024-02-17T12:18:19.330817+0000","last_peered":"2024-02-17T12:18:19.330817+0000","last_clean":"2024-02-17T12:18:19.330817+0000","last_became_active":"2024-02-17T12:18:01.789970+0000","last_became_peered":"2024-02-17T12:18:01.789970+0000","last_unstale":"2024-02-17T12:18:19.330817+0000","last_undegraded":"2024-02-17T12:18:19.330817+0000","last_fullsized":"2024-02-17T12:18:19.330817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360087+0000","last_change":"2024-02-17T12:18:19.353267+0000","last_active":"2024-02-17T12:18:19.360087+0000","last_peered":"2024-02-17T12:18:19.360087+0000","last_clean":"2024-02-17T12:18:19.360087+0000","last_became_active":"2024-02-17T12:18:19.353007+0000","last_became_peered":"2024-02-17T12:18:19.353007+0000","last_unstale":"2024-02-17T12:18:19.360087+0000","last_undegraded":"2024-02-17T12:18:19.360087+0000","last_fullsized":"2024-02-17T12:18:19.360087+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:49.360736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341972+0000","last_change":"2024-02-17T12:18:02.811065+0000","last_active":"2024-02-17T12:18:19.341972+0000","last_peered":"2024-02-17T12:18:19.341972+0000","last_clean":"2024-02-17T12:18:19.341972+0000","last_became_active":"2024-02-17T12:18:02.810598+0000","last_became_peered":"2024-02-17T12:18:02.810598+0000","last_unstale":"2024-02-17T12:18:19.341972+0000","last_undegraded":"2024-02-17T12:18:19.341972+0000","last_fullsized":"2024-02-17T12:18:19.341972+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:11:46.553742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328607+0000","last_change":"2024-02-17T12:18:01.798801+0000","last_active":"2024-02-17T12:18:18.328607+0000","last_peered":"2024-02-17T12:18:18.328607+0000","last_clean":"2024-02-17T12:18:18.328607+0000","last_became_active":"2024-02-17T12:18:01.798516+0000","last_became_peered":"2024-02-17T12:18:01.798516+0000","last_unstale":"2024-02-17T12:18:18.328607+0000","last_undegraded":"2024-02-17T12:18:18.328607+0000","last_fullsized":"2024-02-17T12:18:18.328607+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:04:53.798642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335113+0000","last_change":"2024-02-17T12:18:19.335113+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335113+0000","last_undegraded":"2024-02-17T12:18:19.335113+0000","last_fullsized":"2024-02-17T12:18:19.335113+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331699+0000","last_change":"2024-02-17T12:18:18.331699+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331699+0000","last_undegraded":"2024-02-17T12:18:18.331699+0000","last_fullsized":"2024-02-17T12:18:18.331699+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342282+0000","last_change":"2024-02-17T12:18:02.802301+0000","last_active":"2024-02-17T12:18:19.342282+0000","last_peered":"2024-02-17T12:18:19.342282+0000","last_clean":"2024-02-17T12:18:19.342282+0000","last_became_active":"2024-02-17T12:18:02.801632+0000","last_became_peered":"2024-02-17T12:18:02.801632+0000","last_unstale":"2024-02-17T12:18:19.342282+0000","last_undegraded":"2024-02-17T12:18:19.342282+0000","last_fullsized":"2024-02-17T12:18:19.342282+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:34:13.159578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339326+0000","last_change":"2024-02-17T12:18:01.800510+0000","last_active":"2024-02-17T12:18:19.339326+0000","last_peered":"2024-02-17T12:18:19.339326+0000","last_clean":"2024-02-17T12:18:19.339326+0000","last_became_active":"2024-02-17T12:18:01.799483+0000","last_became_peered":"2024-02-17T12:18:01.799483+0000","last_unstale":"2024-02-17T12:18:19.339326+0000","last_undegraded":"2024-02-17T12:18:19.339326+0000","last_fullsized":"2024-02-17T12:18:19.339326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.330276+0000","last_change":"2024-02-17T12:18:19.330276+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.330276+0000","last_undegraded":"2024-02-17T12:18:19.330276+0000","last_fullsized":"2024-02-17T12:18:19.330276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.354877+0000","last_change":"2024-02-17T12:18:19.351098+0000","last_active":"2024-02-17T12:18:19.354877+0000","last_peered":"2024-02-17T12:18:19.354877+0000","last_clean":"2024-02-17T12:18:19.354877+0000","last_became_active":"2024-02-17T12:18:19.350809+0000","last_became_peered":"2024-02-17T12:18:19.350809+0000","last_unstale":"2024-02-17T12:18:19.354877+0000","last_undegraded":"2024-02-17T12:18:19.354877+0000","last_fullsized":"2024-02-17T12:18:19.354877+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:07:44.338092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346264+0000","last_change":"2024-02-17T12:18:02.811246+0000","last_active":"2024-02-17T12:18:19.346264+0000","last_peered":"2024-02-17T12:18:19.346264+0000","last_clean":"2024-02-17T12:18:19.346264+0000","last_became_active":"2024-02-17T12:18:02.810989+0000","last_became_peered":"2024-02-17T12:18:02.810989+0000","last_unstale":"2024-02-17T12:18:19.346264+0000","last_undegraded":"2024-02-17T12:18:19.346264+0000","last_fullsized":"2024-02-17T12:18:19.346264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:56:31.198120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.332999+0000","last_change":"2024-02-17T12:18:01.798316+0000","last_active":"2024-02-17T12:18:19.332999+0000","last_peered":"2024-02-17T12:18:19.332999+0000","last_clean":"2024-02-17T12:18:19.332999+0000","last_became_active":"2024-02-17T12:18:01.797041+0000","last_became_peered":"2024-02-17T12:18:01.797041+0000","last_unstale":"2024-02-17T12:18:19.332999+0000","last_undegraded":"2024-02-17T12:18:19.332999+0000","last_fullsized":"2024-02-17T12:18:19.332999+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360092+0000","last_change":"2024-02-17T12:18:19.352520+0000","last_active":"2024-02-17T12:18:19.360092+0000","last_peered":"2024-02-17T12:18:19.360092+0000","last_clean":"2024-02-17T12:18:19.360092+0000","last_became_active":"2024-02-17T12:18:19.351708+0000","last_became_peered":"2024-02-17T12:18:19.351708+0000","last_unstale":"2024-02-17T12:18:19.360092+0000","last_undegraded":"2024-02-17T12:18:19.360092+0000","last_fullsized":"2024-02-17T12:18:19.360092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:01.563171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341680+0000","last_change":"2024-02-17T12:18:02.801971+0000","last_active":"2024-02-17T12:18:19.341680+0000","last_peered":"2024-02-17T12:18:19.341680+0000","last_clean":"2024-02-17T12:18:19.341680+0000","last_became_active":"2024-02-17T12:18:02.801727+0000","last_became_peered":"2024-02-17T12:18:02.801727+0000","last_unstale":"2024-02-17T12:18:19.341680+0000","last_undegraded":"2024-02-17T12:18:19.341680+0000","last_fullsized":"2024-02-17T12:18:19.341680+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:06:15.526935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328199+0000","last_change":"2024-02-17T12:18:01.800493+0000","last_active":"2024-02-17T12:18:18.328199+0000","last_peered":"2024-02-17T12:18:18.328199+0000","last_clean":"2024-02-17T12:18:18.328199+0000","last_became_active":"2024-02-17T12:18:01.800206+0000","last_became_peered":"2024-02-17T12:18:01.800206+0000","last_unstale":"2024-02-17T12:18:18.328199+0000","last_undegraded":"2024-02-17T12:18:18.328199+0000","last_fullsized":"2024-02-17T12:18:18.328199+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:33.603620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340864+0000","last_change":"2024-02-17T12:18:19.340864+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340864+0000","last_undegraded":"2024-02-17T12:18:19.340864+0000","last_fullsized":"2024-02-17T12:18:19.340864+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.348954+0000","last_change":"2024-02-17T12:18:19.347455+0000","last_active":"2024-02-17T12:18:19.348954+0000","last_peered":"2024-02-17T12:18:19.348954+0000","last_clean":"2024-02-17T12:18:19.348954+0000","last_became_active":"2024-02-17T12:18:19.347134+0000","last_became_peered":"2024-02-17T12:18:19.347134+0000","last_unstale":"2024-02-17T12:18:19.348954+0000","last_undegraded":"2024-02-17T12:18:19.348954+0000","last_fullsized":"2024-02-17T12:18:19.348954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:59:36.003726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328936+0000","last_change":"2024-02-17T12:18:02.797952+0000","last_active":"2024-02-17T12:18:18.328936+0000","last_peered":"2024-02-17T12:18:18.328936+0000","last_clean":"2024-02-17T12:18:18.328936+0000","last_became_active":"2024-02-17T12:18:02.797675+0000","last_became_peered":"2024-02-17T12:18:02.797675+0000","last_unstale":"2024-02-17T12:18:18.328936+0000","last_undegraded":"2024-02-17T12:18:18.328936+0000","last_fullsized":"2024-02-17T12:18:18.328936+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:01.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333033+0000","last_change":"2024-02-17T12:18:01.801850+0000","last_active":"2024-02-17T12:18:18.333033+0000","last_peered":"2024-02-17T12:18:18.333033+0000","last_clean":"2024-02-17T12:18:18.333033+0000","last_became_active":"2024-02-17T12:18:01.801516+0000","last_became_peered":"2024-02-17T12:18:01.801516+0000","last_unstale":"2024-02-17T12:18:18.333033+0000","last_undegraded":"2024-02-17T12:18:18.333033+0000","last_fullsized":"2024-02-17T12:18:18.333033+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:28.630666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355114+0000","last_change":"2024-02-17T12:18:19.352769+0000","last_active":"2024-02-17T12:18:19.355114+0000","last_peered":"2024-02-17T12:18:19.355114+0000","last_clean":"2024-02-17T12:18:19.355114+0000","last_became_active":"2024-02-17T12:18:19.352519+0000","last_became_peered":"2024-02-17T12:18:19.352519+0000","last_unstale":"2024-02-17T12:18:19.355114+0000","last_undegraded":"2024-02-17T12:18:19.355114+0000","last_fullsized":"2024-02-17T12:18:19.355114+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333004+0000","last_change":"2024-02-17T12:18:02.813957+0000","last_active":"2024-02-17T12:18:18.333004+0000","last_peered":"2024-02-17T12:18:18.333004+0000","last_clean":"2024-02-17T12:18:18.333004+0000","last_became_active":"2024-02-17T12:18:02.813647+0000","last_became_peered":"2024-02-17T12:18:02.813647+0000","last_unstale":"2024-02-17T12:18:18.333004+0000","last_undegraded":"2024-02-17T12:18:18.333004+0000","last_fullsized":"2024-02-17T12:18:18.333004+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:41.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342822+0000","last_change":"2024-02-17T12:18:01.799508+0000","last_active":"2024-02-17T12:18:19.342822+0000","last_peered":"2024-02-17T12:18:19.342822+0000","last_clean":"2024-02-17T12:18:19.342822+0000","last_became_active":"2024-02-17T12:18:01.798598+0000","last_became_peered":"2024-02-17T12:18:01.798598+0000","last_unstale":"2024-02-17T12:18:19.342822+0000","last_undegraded":"2024-02-17T12:18:19.342822+0000","last_fullsized":"2024-02-17T12:18:19.342822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:45.103353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.329959+0000","last_change":"2024-02-17T12:18:19.329959+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.329959+0000","last_undegraded":"2024-02-17T12:18:19.329959+0000","last_fullsized":"2024-02-17T12:18:19.329959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.326370+0000","last_change":"2024-02-17T12:18:18.326370+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.326370+0000","last_undegraded":"2024-02-17T12:18:18.326370+0000","last_fullsized":"2024-02-17T12:18:18.326370+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344376+0000","last_change":"2024-02-17T12:18:02.787850+0000","last_active":"2024-02-17T12:18:19.344376+0000","last_peered":"2024-02-17T12:18:19.344376+0000","last_clean":"2024-02-17T12:18:19.344376+0000","last_became_active":"2024-02-17T12:18:02.787578+0000","last_became_peered":"2024-02-17T12:18:02.787578+0000","last_unstale":"2024-02-17T12:18:19.344376+0000","last_undegraded":"2024-02-17T12:18:19.344376+0000","last_fullsized":"2024-02-17T12:18:19.344376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:29.854264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332273+0000","last_change":"2024-02-17T12:18:01.805403+0000","last_active":"2024-02-17T12:18:18.332273+0000","last_peered":"2024-02-17T12:18:18.332273+0000","last_clean":"2024-02-17T12:18:18.332273+0000","last_became_active":"2024-02-17T12:18:01.805059+0000","last_became_peered":"2024-02-17T12:18:01.805059+0000","last_unstale":"2024-02-17T12:18:18.332273+0000","last_undegraded":"2024-02-17T12:18:18.332273+0000","last_fullsized":"2024-02-17T12:18:18.332273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:14.495937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355588+0000","last_change":"2024-02-17T12:18:19.349635+0000","last_active":"2024-02-17T12:18:19.355588+0000","last_peered":"2024-02-17T12:18:19.355588+0000","last_clean":"2024-02-17T12:18:19.355588+0000","last_became_active":"2024-02-17T12:18:19.349145+0000","last_became_peered":"2024-02-17T12:18:19.349145+0000","last_unstale":"2024-02-17T12:18:19.355588+0000","last_undegraded":"2024-02-17T12:18:19.355588+0000","last_fullsized":"2024-02-17T12:18:19.355588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332061+0000","last_change":"2024-02-17T12:18:02.810198+0000","last_active":"2024-02-17T12:18:18.332061+0000","last_peered":"2024-02-17T12:18:18.332061+0000","last_clean":"2024-02-17T12:18:18.332061+0000","last_became_active":"2024-02-17T12:18:02.809131+0000","last_became_peered":"2024-02-17T12:18:02.809131+0000","last_unstale":"2024-02-17T12:18:18.332061+0000","last_undegraded":"2024-02-17T12:18:18.332061+0000","last_fullsized":"2024-02-17T12:18:18.332061+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:01:23.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328597+0000","last_change":"2024-02-17T12:18:01.802710+0000","last_active":"2024-02-17T12:18:18.328597+0000","last_peered":"2024-02-17T12:18:18.328597+0000","last_clean":"2024-02-17T12:18:18.328597+0000","last_became_active":"2024-02-17T12:18:01.802365+0000","last_became_peered":"2024-02-17T12:18:01.802365+0000","last_unstale":"2024-02-17T12:18:18.328597+0000","last_undegraded":"2024-02-17T12:18:18.328597+0000","last_fullsized":"2024-02-17T12:18:18.328597+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:45.771679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.334337+0000","last_change":"2024-02-17T12:18:19.334337+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.334337+0000","last_undegraded":"2024-02-17T12:18:19.334337+0000","last_fullsized":"2024-02-17T12:18:19.334337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360350+0000","last_change":"2024-02-17T12:18:19.353417+0000","last_active":"2024-02-17T12:18:19.360350+0000","last_peered":"2024-02-17T12:18:19.360350+0000","last_clean":"2024-02-17T12:18:19.360350+0000","last_became_active":"2024-02-17T12:18:19.350515+0000","last_became_peered":"2024-02-17T12:18:19.350515+0000","last_unstale":"2024-02-17T12:18:19.360350+0000","last_undegraded":"2024-02-17T12:18:19.360350+0000","last_fullsized":"2024-02-17T12:18:19.360350+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:05:31.415587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333976+0000","last_change":"2024-02-17T12:18:02.809855+0000","last_active":"2024-02-17T12:18:19.333976+0000","last_peered":"2024-02-17T12:18:19.333976+0000","last_clean":"2024-02-17T12:18:19.333976+0000","last_became_active":"2024-02-17T12:18:02.809577+0000","last_became_peered":"2024-02-17T12:18:02.809577+0000","last_unstale":"2024-02-17T12:18:19.333976+0000","last_undegraded":"2024-02-17T12:18:19.333976+0000","last_fullsized":"2024-02-17T12:18:19.333976+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:17:49.657379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342359+0000","last_change":"2024-02-17T12:18:01.792615+0000","last_active":"2024-02-17T12:18:19.342359+0000","last_peered":"2024-02-17T12:18:19.342359+0000","last_clean":"2024-02-17T12:18:19.342359+0000","last_became_active":"2024-02-17T12:18:01.792287+0000","last_became_peered":"2024-02-17T12:18:01.792287+0000","last_unstale":"2024-02-17T12:18:19.342359+0000","last_undegraded":"2024-02-17T12:18:19.342359+0000","last_fullsized":"2024-02-17T12:18:19.342359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:56.241760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.326306+0000","last_change":"2024-02-17T12:18:18.326306+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.326306+0000","last_undegraded":"2024-02-17T12:18:18.326306+0000","last_fullsized":"2024-02-17T12:18:18.326306+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332370+0000","last_change":"2024-02-17T12:18:02.808057+0000","last_active":"2024-02-17T12:18:18.332370+0000","last_peered":"2024-02-17T12:18:18.332370+0000","last_clean":"2024-02-17T12:18:18.332370+0000","last_became_active":"2024-02-17T12:18:02.807629+0000","last_became_peered":"2024-02-17T12:18:02.807629+0000","last_unstale":"2024-02-17T12:18:18.332370+0000","last_undegraded":"2024-02-17T12:18:18.332370+0000","last_fullsized":"2024-02-17T12:18:18.332370+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:58:48.506743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346100+0000","last_change":"2024-02-17T12:18:01.797715+0000","last_active":"2024-02-17T12:18:19.346100+0000","last_peered":"2024-02-17T12:18:19.346100+0000","last_clean":"2024-02-17T12:18:19.346100+0000","last_became_active":"2024-02-17T12:18:01.797435+0000","last_became_peered":"2024-02-17T12:18:01.797435+0000","last_unstale":"2024-02-17T12:18:19.346100+0000","last_undegraded":"2024-02-17T12:18:19.346100+0000","last_fullsized":"2024-02-17T12:18:19.346100+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:49.624601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360516+0000","last_change":"2024-02-17T12:18:19.355317+0000","last_active":"2024-02-17T12:18:19.360516+0000","last_peered":"2024-02-17T12:18:19.360516+0000","last_clean":"2024-02-17T12:18:19.360516+0000","last_became_active":"2024-02-17T12:18:19.353852+0000","last_became_peered":"2024-02-17T12:18:19.353852+0000","last_unstale":"2024-02-17T12:18:19.360516+0000","last_undegraded":"2024-02-17T12:18:19.360516+0000","last_fullsized":"2024-02-17T12:18:19.360516+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:52.676828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328075+0000","last_change":"2024-02-17T12:18:02.810137+0000","last_active":"2024-02-17T12:18:18.328075+0000","last_peered":"2024-02-17T12:18:18.328075+0000","last_clean":"2024-02-17T12:18:18.328075+0000","last_became_active":"2024-02-17T12:18:02.809877+0000","last_became_peered":"2024-02-17T12:18:02.809877+0000","last_unstale":"2024-02-17T12:18:18.328075+0000","last_undegraded":"2024-02-17T12:18:18.328075+0000","last_fullsized":"2024-02-17T12:18:18.328075+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:15.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333119+0000","last_change":"2024-02-17T12:18:01.790794+0000","last_active":"2024-02-17T12:18:19.333119+0000","last_peered":"2024-02-17T12:18:19.333119+0000","last_clean":"2024-02-17T12:18:19.333119+0000","last_became_active":"2024-02-17T12:18:01.790500+0000","last_became_peered":"2024-02-17T12:18:01.790500+0000","last_unstale":"2024-02-17T12:18:19.333119+0000","last_undegraded":"2024-02-17T12:18:19.333119+0000","last_fullsized":"2024-02-17T12:18:19.333119+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.330408+0000","last_change":"2024-02-17T12:18:19.330408+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.330408+0000","last_undegraded":"2024-02-17T12:18:19.330408+0000","last_fullsized":"2024-02-17T12:18:19.330408+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360110+0000","last_change":"2024-02-17T12:18:19.352733+0000","last_active":"2024-02-17T12:18:19.360110+0000","last_peered":"2024-02-17T12:18:19.360110+0000","last_clean":"2024-02-17T12:18:19.360110+0000","last_became_active":"2024-02-17T12:18:19.352039+0000","last_became_peered":"2024-02-17T12:18:19.352039+0000","last_unstale":"2024-02-17T12:18:19.360110+0000","last_undegraded":"2024-02-17T12:18:19.360110+0000","last_fullsized":"2024-02-17T12:18:19.360110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:28:25.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332808+0000","last_change":"2024-02-17T12:18:02.808594+0000","last_active":"2024-02-17T12:18:18.332808+0000","last_peered":"2024-02-17T12:18:18.332808+0000","last_clean":"2024-02-17T12:18:18.332808+0000","last_became_active":"2024-02-17T12:18:02.808035+0000","last_became_peered":"2024-02-17T12:18:02.808035+0000","last_unstale":"2024-02-17T12:18:18.332808+0000","last_undegraded":"2024-02-17T12:18:18.332808+0000","last_fullsized":"2024-02-17T12:18:18.332808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:58.050395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332208+0000","last_change":"2024-02-17T12:18:01.789017+0000","last_active":"2024-02-17T12:18:18.332208+0000","last_peered":"2024-02-17T12:18:18.332208+0000","last_clean":"2024-02-17T12:18:18.332208+0000","last_became_active":"2024-02-17T12:18:01.788529+0000","last_became_peered":"2024-02-17T12:18:01.788529+0000","last_unstale":"2024-02-17T12:18:18.332208+0000","last_undegraded":"2024-02-17T12:18:18.332208+0000","last_fullsized":"2024-02-17T12:18:18.332208+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:31.560281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.341864+0000","last_change":"2024-02-17T12:18:19.341864+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.341864+0000","last_undegraded":"2024-02-17T12:18:19.341864+0000","last_fullsized":"2024-02-17T12:18:19.341864+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360193+0000","last_change":"2024-02-17T12:18:19.354058+0000","last_active":"2024-02-17T12:18:19.360193+0000","last_peered":"2024-02-17T12:18:19.360193+0000","last_clean":"2024-02-17T12:18:19.360193+0000","last_became_active":"2024-02-17T12:18:19.353686+0000","last_became_peered":"2024-02-17T12:18:19.353686+0000","last_unstale":"2024-02-17T12:18:19.360193+0000","last_undegraded":"2024-02-17T12:18:19.360193+0000","last_fullsized":"2024-02-17T12:18:19.360193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:44.104942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333212+0000","last_change":"2024-02-17T12:18:02.808518+0000","last_active":"2024-02-17T12:18:18.333212+0000","last_peered":"2024-02-17T12:18:18.333212+0000","last_clean":"2024-02-17T12:18:18.333212+0000","last_became_active":"2024-02-17T12:18:02.808255+0000","last_became_peered":"2024-02-17T12:18:02.808255+0000","last_unstale":"2024-02-17T12:18:18.333212+0000","last_undegraded":"2024-02-17T12:18:18.333212+0000","last_fullsized":"2024-02-17T12:18:18.333212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:58:40.908163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343746+0000","last_change":"2024-02-17T12:18:01.802794+0000","last_active":"2024-02-17T12:18:19.343746+0000","last_peered":"2024-02-17T12:18:19.343746+0000","last_clean":"2024-02-17T12:18:19.343746+0000","last_became_active":"2024-02-17T12:18:01.802366+0000","last_became_peered":"2024-02-17T12:18:01.802366+0000","last_unstale":"2024-02-17T12:18:19.343746+0000","last_undegraded":"2024-02-17T12:18:19.343746+0000","last_fullsized":"2024-02-17T12:18:19.343746+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:45:00.445775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.333710+0000","last_change":"2024-02-17T12:18:18.333710+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.333710+0000","last_undegraded":"2024-02-17T12:18:18.333710+0000","last_fullsized":"2024-02-17T12:18:18.333710+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334807+0000","last_change":"2024-02-17T12:18:02.810942+0000","last_active":"2024-02-17T12:18:19.334807+0000","last_peered":"2024-02-17T12:18:19.334807+0000","last_clean":"2024-02-17T12:18:19.334807+0000","last_became_active":"2024-02-17T12:18:02.810651+0000","last_became_peered":"2024-02-17T12:18:02.810651+0000","last_unstale":"2024-02-17T12:18:19.334807+0000","last_undegraded":"2024-02-17T12:18:19.334807+0000","last_fullsized":"2024-02-17T12:18:19.334807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338302+0000","last_change":"2024-02-17T12:18:01.797601+0000","last_active":"2024-02-17T12:18:19.338302+0000","last_peered":"2024-02-17T12:18:19.338302+0000","last_clean":"2024-02-17T12:18:19.338302+0000","last_became_active":"2024-02-17T12:18:01.796341+0000","last_became_peered":"2024-02-17T12:18:01.796341+0000","last_unstale":"2024-02-17T12:18:19.338302+0000","last_undegraded":"2024-02-17T12:18:19.338302+0000","last_fullsized":"2024-02-17T12:18:19.338302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360165+0000","last_change":"2024-02-17T12:18:19.353335+0000","last_active":"2024-02-17T12:18:19.360165+0000","last_peered":"2024-02-17T12:18:19.360165+0000","last_clean":"2024-02-17T12:18:19.360165+0000","last_became_active":"2024-02-17T12:18:19.353048+0000","last_became_peered":"2024-02-17T12:18:19.353048+0000","last_unstale":"2024-02-17T12:18:19.360165+0000","last_undegraded":"2024-02-17T12:18:19.360165+0000","last_fullsized":"2024-02-17T12:18:19.360165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:18:06.203775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344150+0000","last_change":"2024-02-17T12:18:02.803894+0000","last_active":"2024-02-17T12:18:19.344150+0000","last_peered":"2024-02-17T12:18:19.344150+0000","last_clean":"2024-02-17T12:18:19.344150+0000","last_became_active":"2024-02-17T12:18:02.803553+0000","last_became_peered":"2024-02-17T12:18:02.803553+0000","last_unstale":"2024-02-17T12:18:19.344150+0000","last_undegraded":"2024-02-17T12:18:19.344150+0000","last_fullsized":"2024-02-17T12:18:19.344150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:35:24.727572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330495+0000","last_change":"2024-02-17T12:18:01.789546+0000","last_active":"2024-02-17T12:18:19.330495+0000","last_peered":"2024-02-17T12:18:19.330495+0000","last_clean":"2024-02-17T12:18:19.330495+0000","last_became_active":"2024-02-17T12:18:01.789258+0000","last_became_peered":"2024-02-17T12:18:01.789258+0000","last_unstale":"2024-02-17T12:18:19.330495+0000","last_undegraded":"2024-02-17T12:18:19.330495+0000","last_fullsized":"2024-02-17T12:18:19.330495+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.325904+0000","last_change":"2024-02-17T12:18:18.325904+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.325904+0000","last_undegraded":"2024-02-17T12:18:18.325904+0000","last_fullsized":"2024-02-17T12:18:18.325904+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332167+0000","last_change":"2024-02-17T12:18:02.811327+0000","last_active":"2024-02-17T12:18:18.332167+0000","last_peered":"2024-02-17T12:18:18.332167+0000","last_clean":"2024-02-17T12:18:18.332167+0000","last_became_active":"2024-02-17T12:18:02.809620+0000","last_became_peered":"2024-02-17T12:18:02.809620+0000","last_unstale":"2024-02-17T12:18:18.332167+0000","last_undegraded":"2024-02-17T12:18:18.332167+0000","last_fullsized":"2024-02-17T12:18:18.332167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:40:08.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339073+0000","last_change":"2024-02-17T12:18:01.798265+0000","last_active":"2024-02-17T12:18:19.339073+0000","last_peered":"2024-02-17T12:18:19.339073+0000","last_clean":"2024-02-17T12:18:19.339073+0000","last_became_active":"2024-02-17T12:18:01.797931+0000","last_became_peered":"2024-02-17T12:18:01.797931+0000","last_unstale":"2024-02-17T12:18:19.339073+0000","last_undegraded":"2024-02-17T12:18:19.339073+0000","last_fullsized":"2024-02-17T12:18:19.339073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333949+0000","last_change":"2024-02-17T12:18:19.333949+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333949+0000","last_undegraded":"2024-02-17T12:18:19.333949+0000","last_fullsized":"2024-02-17T12:18:19.333949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343005+0000","last_change":"2024-02-17T12:18:19.339116+0000","last_active":"2024-02-17T12:18:19.343005+0000","last_peered":"2024-02-17T12:18:19.343005+0000","last_clean":"2024-02-17T12:18:19.343005+0000","last_became_active":"2024-02-17T12:18:19.338406+0000","last_became_peered":"2024-02-17T12:18:19.338406+0000","last_unstale":"2024-02-17T12:18:19.343005+0000","last_undegraded":"2024-02-17T12:18:19.343005+0000","last_fullsized":"2024-02-17T12:18:19.343005+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:11.400472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334099+0000","last_change":"2024-02-17T12:18:02.800381+0000","last_active":"2024-02-17T12:18:19.334099+0000","last_peered":"2024-02-17T12:18:19.334099+0000","last_clean":"2024-02-17T12:18:19.334099+0000","last_became_active":"2024-02-17T12:18:02.800042+0000","last_became_peered":"2024-02-17T12:18:02.800042+0000","last_unstale":"2024-02-17T12:18:19.334099+0000","last_undegraded":"2024-02-17T12:18:19.334099+0000","last_fullsized":"2024-02-17T12:18:19.334099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:27.558546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342497+0000","last_change":"2024-02-17T12:18:01.795914+0000","last_active":"2024-02-17T12:18:19.342497+0000","last_peered":"2024-02-17T12:18:19.342497+0000","last_clean":"2024-02-17T12:18:19.342497+0000","last_became_active":"2024-02-17T12:18:01.794847+0000","last_became_peered":"2024-02-17T12:18:01.794847+0000","last_unstale":"2024-02-17T12:18:19.342497+0000","last_undegraded":"2024-02-17T12:18:19.342497+0000","last_fullsized":"2024-02-17T12:18:19.342497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:31.320927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333047+0000","last_change":"2024-02-17T12:18:19.333047+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333047+0000","last_undegraded":"2024-02-17T12:18:19.333047+0000","last_fullsized":"2024-02-17T12:18:19.333047+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.357925+0000","last_change":"2024-02-17T12:18:19.352005+0000","last_active":"2024-02-17T12:18:19.357925+0000","last_peered":"2024-02-17T12:18:19.357925+0000","last_clean":"2024-02-17T12:18:19.357925+0000","last_became_active":"2024-02-17T12:18:19.351791+0000","last_became_peered":"2024-02-17T12:18:19.351791+0000","last_unstale":"2024-02-17T12:18:19.357925+0000","last_undegraded":"2024-02-17T12:18:19.357925+0000","last_fullsized":"2024-02-17T12:18:19.357925+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:19:04.346561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.337872+0000","last_change":"2024-02-17T12:18:02.807547+0000","last_active":"2024-02-17T12:18:19.337872+0000","last_peered":"2024-02-17T12:18:19.337872+0000","last_clean":"2024-02-17T12:18:19.337872+0000","last_became_active":"2024-02-17T12:18:02.807209+0000","last_became_peered":"2024-02-17T12:18:02.807209+0000","last_unstale":"2024-02-17T12:18:19.337872+0000","last_undegraded":"2024-02-17T12:18:19.337872+0000","last_fullsized":"2024-02-17T12:18:19.337872+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343944+0000","last_change":"2024-02-17T12:18:01.803848+0000","last_active":"2024-02-17T12:18:19.343944+0000","last_peered":"2024-02-17T12:18:19.343944+0000","last_clean":"2024-02-17T12:18:19.343944+0000","last_became_active":"2024-02-17T12:18:01.803552+0000","last_became_peered":"2024-02-17T12:18:01.803552+0000","last_unstale":"2024-02-17T12:18:19.343944+0000","last_undegraded":"2024-02-17T12:18:19.343944+0000","last_fullsized":"2024-02-17T12:18:19.343944+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:25:02.826927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339057+0000","last_change":"2024-02-17T12:18:19.339057+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339057+0000","last_undegraded":"2024-02-17T12:18:19.339057+0000","last_fullsized":"2024-02-17T12:18:19.339057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360064+0000","last_change":"2024-02-17T12:18:19.352308+0000","last_active":"2024-02-17T12:18:19.360064+0000","last_peered":"2024-02-17T12:18:19.360064+0000","last_clean":"2024-02-17T12:18:19.360064+0000","last_became_active":"2024-02-17T12:18:19.351363+0000","last_became_peered":"2024-02-17T12:18:19.351363+0000","last_unstale":"2024-02-17T12:18:19.360064+0000","last_undegraded":"2024-02-17T12:18:19.360064+0000","last_fullsized":"2024-02-17T12:18:19.360064+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:53:41.288869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340485+0000","last_change":"2024-02-17T12:18:02.811800+0000","last_active":"2024-02-17T12:18:19.340485+0000","last_peered":"2024-02-17T12:18:19.340485+0000","last_clean":"2024-02-17T12:18:19.340485+0000","last_became_active":"2024-02-17T12:18:02.811504+0000","last_became_peered":"2024-02-17T12:18:02.811504+0000","last_unstale":"2024-02-17T12:18:19.340485+0000","last_undegraded":"2024-02-17T12:18:19.340485+0000","last_fullsized":"2024-02-17T12:18:19.340485+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.331083+0000","last_change":"2024-02-17T12:18:01.800860+0000","last_active":"2024-02-17T12:18:19.331083+0000","last_peered":"2024-02-17T12:18:19.331083+0000","last_clean":"2024-02-17T12:18:19.331083+0000","last_became_active":"2024-02-17T12:18:01.800569+0000","last_became_peered":"2024-02-17T12:18:01.800569+0000","last_unstale":"2024-02-17T12:18:19.331083+0000","last_undegraded":"2024-02-17T12:18:19.331083+0000","last_fullsized":"2024-02-17T12:18:19.331083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331766+0000","last_change":"2024-02-17T12:18:18.331766+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331766+0000","last_undegraded":"2024-02-17T12:18:18.331766+0000","last_fullsized":"2024-02-17T12:18:18.331766+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333029+0000","last_change":"2024-02-17T12:18:02.812763+0000","last_active":"2024-02-17T12:18:19.333029+0000","last_peered":"2024-02-17T12:18:19.333029+0000","last_clean":"2024-02-17T12:18:19.333029+0000","last_became_active":"2024-02-17T12:18:02.812512+0000","last_became_peered":"2024-02-17T12:18:02.812512+0000","last_unstale":"2024-02-17T12:18:19.333029+0000","last_undegraded":"2024-02-17T12:18:19.333029+0000","last_fullsized":"2024-02-17T12:18:19.333029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345020+0000","last_change":"2024-02-17T12:18:01.805847+0000","last_active":"2024-02-17T12:18:19.345020+0000","last_peered":"2024-02-17T12:18:19.345020+0000","last_clean":"2024-02-17T12:18:19.345020+0000","last_became_active":"2024-02-17T12:18:01.805591+0000","last_became_peered":"2024-02-17T12:18:01.805591+0000","last_unstale":"2024-02-17T12:18:19.345020+0000","last_undegraded":"2024-02-17T12:18:19.345020+0000","last_fullsized":"2024-02-17T12:18:19.345020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:52:05.403651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.347869+0000","last_change":"2024-02-17T12:18:19.343966+0000","last_active":"2024-02-17T12:18:19.347869+0000","last_peered":"2024-02-17T12:18:19.347869+0000","last_clean":"2024-02-17T12:18:19.347869+0000","last_became_active":"2024-02-17T12:18:19.343701+0000","last_became_peered":"2024-02-17T12:18:19.343701+0000","last_unstale":"2024-02-17T12:18:19.347869+0000","last_undegraded":"2024-02-17T12:18:19.347869+0000","last_fullsized":"2024-02-17T12:18:19.347869+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:54:15.066782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334914+0000","last_change":"2024-02-17T12:18:02.809740+0000","last_active":"2024-02-17T12:18:19.334914+0000","last_peered":"2024-02-17T12:18:19.334914+0000","last_clean":"2024-02-17T12:18:19.334914+0000","last_became_active":"2024-02-17T12:18:02.809407+0000","last_became_peered":"2024-02-17T12:18:02.809407+0000","last_unstale":"2024-02-17T12:18:19.334914+0000","last_undegraded":"2024-02-17T12:18:19.334914+0000","last_fullsized":"2024-02-17T12:18:19.334914+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338398+0000","last_change":"2024-02-17T12:18:01.794714+0000","last_active":"2024-02-17T12:18:19.338398+0000","last_peered":"2024-02-17T12:18:19.338398+0000","last_clean":"2024-02-17T12:18:19.338398+0000","last_became_active":"2024-02-17T12:18:01.794439+0000","last_became_peered":"2024-02-17T12:18:01.794439+0000","last_unstale":"2024-02-17T12:18:19.338398+0000","last_undegraded":"2024-02-17T12:18:19.338398+0000","last_fullsized":"2024-02-17T12:18:19.338398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333665+0000","last_change":"2024-02-17T12:18:19.333665+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333665+0000","last_undegraded":"2024-02-17T12:18:19.333665+0000","last_fullsized":"2024-02-17T12:18:19.333665+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360140+0000","last_change":"2024-02-17T12:18:19.353264+0000","last_active":"2024-02-17T12:18:19.360140+0000","last_peered":"2024-02-17T12:18:19.360140+0000","last_clean":"2024-02-17T12:18:19.360140+0000","last_became_active":"2024-02-17T12:18:19.352997+0000","last_became_peered":"2024-02-17T12:18:19.352997+0000","last_unstale":"2024-02-17T12:18:19.360140+0000","last_undegraded":"2024-02-17T12:18:19.360140+0000","last_fullsized":"2024-02-17T12:18:19.360140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:43.352769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344465+0000","last_change":"2024-02-17T12:18:02.794702+0000","last_active":"2024-02-17T12:18:19.344465+0000","last_peered":"2024-02-17T12:18:19.344465+0000","last_clean":"2024-02-17T12:18:19.344465+0000","last_became_active":"2024-02-17T12:18:02.794412+0000","last_became_peered":"2024-02-17T12:18:02.794412+0000","last_unstale":"2024-02-17T12:18:19.344465+0000","last_undegraded":"2024-02-17T12:18:19.344465+0000","last_fullsized":"2024-02-17T12:18:19.344465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:05:00.914700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.347492+0000","last_change":"2024-02-17T12:18:01.800872+0000","last_active":"2024-02-17T12:18:19.347492+0000","last_peered":"2024-02-17T12:18:19.347492+0000","last_clean":"2024-02-17T12:18:19.347492+0000","last_became_active":"2024-02-17T12:18:01.800563+0000","last_became_peered":"2024-02-17T12:18:01.800563+0000","last_unstale":"2024-02-17T12:18:19.347492+0000","last_undegraded":"2024-02-17T12:18:19.347492+0000","last_fullsized":"2024-02-17T12:18:19.347492+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:28.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.331009+0000","last_change":"2024-02-17T12:18:19.331009+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.331009+0000","last_undegraded":"2024-02-17T12:18:19.331009+0000","last_fullsized":"2024-02-17T12:18:19.331009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.352419+0000","last_change":"2024-02-17T12:18:19.346074+0000","last_active":"2024-02-17T12:18:19.352419+0000","last_peered":"2024-02-17T12:18:19.352419+0000","last_clean":"2024-02-17T12:18:19.352419+0000","last_became_active":"2024-02-17T12:18:19.344987+0000","last_became_peered":"2024-02-17T12:18:19.344987+0000","last_unstale":"2024-02-17T12:18:19.352419+0000","last_undegraded":"2024-02-17T12:18:19.352419+0000","last_fullsized":"2024-02-17T12:18:19.352419+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:36:50.709873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338347+0000","last_change":"2024-02-17T12:18:02.806343+0000","last_active":"2024-02-17T12:18:19.338347+0000","last_peered":"2024-02-17T12:18:19.338347+0000","last_clean":"2024-02-17T12:18:19.338347+0000","last_became_active":"2024-02-17T12:18:02.805514+0000","last_became_peered":"2024-02-17T12:18:02.805514+0000","last_unstale":"2024-02-17T12:18:19.338347+0000","last_undegraded":"2024-02-17T12:18:19.338347+0000","last_fullsized":"2024-02-17T12:18:19.338347+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:46.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330930+0000","last_change":"2024-02-17T12:18:01.801897+0000","last_active":"2024-02-17T12:18:19.330930+0000","last_peered":"2024-02-17T12:18:19.330930+0000","last_clean":"2024-02-17T12:18:19.330930+0000","last_became_active":"2024-02-17T12:18:01.801572+0000","last_became_peered":"2024-02-17T12:18:01.801572+0000","last_unstale":"2024-02-17T12:18:19.330930+0000","last_undegraded":"2024-02-17T12:18:19.330930+0000","last_fullsized":"2024-02-17T12:18:19.330930+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340349+0000","last_change":"2024-02-17T12:18:19.340349+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340349+0000","last_undegraded":"2024-02-17T12:18:19.340349+0000","last_fullsized":"2024-02-17T12:18:19.340349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.325895+0000","last_change":"2024-02-17T12:18:18.325895+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.325895+0000","last_undegraded":"2024-02-17T12:18:18.325895+0000","last_fullsized":"2024-02-17T12:18:18.325895+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342026+0000","last_change":"2024-02-17T12:18:02.808806+0000","last_active":"2024-02-17T12:18:19.342026+0000","last_peered":"2024-02-17T12:18:19.342026+0000","last_clean":"2024-02-17T12:18:19.342026+0000","last_became_active":"2024-02-17T12:18:02.808546+0000","last_became_peered":"2024-02-17T12:18:02.808546+0000","last_unstale":"2024-02-17T12:18:19.342026+0000","last_undegraded":"2024-02-17T12:18:19.342026+0000","last_fullsized":"2024-02-17T12:18:19.342026+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:25.157077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344522+0000","last_change":"2024-02-17T12:18:01.798282+0000","last_active":"2024-02-17T12:18:19.344522+0000","last_peered":"2024-02-17T12:18:19.344522+0000","last_clean":"2024-02-17T12:18:19.344522+0000","last_became_active":"2024-02-17T12:18:01.797970+0000","last_became_peered":"2024-02-17T12:18:01.797970+0000","last_unstale":"2024-02-17T12:18:19.344522+0000","last_undegraded":"2024-02-17T12:18:19.344522+0000","last_fullsized":"2024-02-17T12:18:19.344522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:52:16.655449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339895+0000","last_change":"2024-02-17T12:18:19.339895+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339895+0000","last_undegraded":"2024-02-17T12:18:19.339895+0000","last_fullsized":"2024-02-17T12:18:19.339895+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.359996+0000","last_change":"2024-02-17T12:18:19.351990+0000","last_active":"2024-02-17T12:18:19.359996+0000","last_peered":"2024-02-17T12:18:19.359996+0000","last_clean":"2024-02-17T12:18:19.359996+0000","last_became_active":"2024-02-17T12:18:19.350808+0000","last_became_peered":"2024-02-17T12:18:19.350808+0000","last_unstale":"2024-02-17T12:18:19.359996+0000","last_undegraded":"2024-02-17T12:18:19.359996+0000","last_fullsized":"2024-02-17T12:18:19.359996+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:09.209961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332488+0000","last_change":"2024-02-17T12:18:02.808303+0000","last_active":"2024-02-17T12:18:18.332488+0000","last_peered":"2024-02-17T12:18:18.332488+0000","last_clean":"2024-02-17T12:18:18.332488+0000","last_became_active":"2024-02-17T12:18:02.807743+0000","last_became_peered":"2024-02-17T12:18:02.807743+0000","last_unstale":"2024-02-17T12:18:18.332488+0000","last_undegraded":"2024-02-17T12:18:18.332488+0000","last_fullsized":"2024-02-17T12:18:18.332488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:55.025562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328460+0000","last_change":"2024-02-17T12:18:01.802694+0000","last_active":"2024-02-17T12:18:18.328460+0000","last_peered":"2024-02-17T12:18:18.328460+0000","last_clean":"2024-02-17T12:18:18.328460+0000","last_became_active":"2024-02-17T12:18:01.802326+0000","last_became_peered":"2024-02-17T12:18:01.802326+0000","last_unstale":"2024-02-17T12:18:18.328460+0000","last_undegraded":"2024-02-17T12:18:18.328460+0000","last_fullsized":"2024-02-17T12:18:18.328460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:33:51.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331713+0000","last_change":"2024-02-17T12:18:18.331713+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331713+0000","last_undegraded":"2024-02-17T12:18:18.331713+0000","last_fullsized":"2024-02-17T12:18:18.331713+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340613+0000","last_change":"2024-02-17T12:18:02.805983+0000","last_active":"2024-02-17T12:18:19.340613+0000","last_peered":"2024-02-17T12:18:19.340613+0000","last_clean":"2024-02-17T12:18:19.340613+0000","last_became_active":"2024-02-17T12:18:02.805699+0000","last_became_peered":"2024-02-17T12:18:02.805699+0000","last_unstale":"2024-02-17T12:18:19.340613+0000","last_undegraded":"2024-02-17T12:18:19.340613+0000","last_fullsized":"2024-02-17T12:18:19.340613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:44.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341772+0000","last_change":"2024-02-17T12:18:01.801438+0000","last_active":"2024-02-17T12:18:19.341772+0000","last_peered":"2024-02-17T12:18:19.341772+0000","last_clean":"2024-02-17T12:18:19.341772+0000","last_became_active":"2024-02-17T12:18:01.801221+0000","last_became_peered":"2024-02-17T12:18:01.801221+0000","last_unstale":"2024-02-17T12:18:19.341772+0000","last_undegraded":"2024-02-17T12:18:19.341772+0000","last_fullsized":"2024-02-17T12:18:19.341772+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:09.649370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335807+0000","last_change":"2024-02-17T12:18:19.335807+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335807+0000","last_undegraded":"2024-02-17T12:18:19.335807+0000","last_fullsized":"2024-02-17T12:18:19.335807+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.353618+0000","last_change":"2024-02-17T12:18:19.350524+0000","last_active":"2024-02-17T12:18:19.353618+0000","last_peered":"2024-02-17T12:18:19.353618+0000","last_clean":"2024-02-17T12:18:19.353618+0000","last_became_active":"2024-02-17T12:18:19.350237+0000","last_became_peered":"2024-02-17T12:18:19.350237+0000","last_unstale":"2024-02-17T12:18:19.353618+0000","last_undegraded":"2024-02-17T12:18:19.353618+0000","last_fullsized":"2024-02-17T12:18:19.353618+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:28.434400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341774+0000","last_change":"2024-02-17T12:18:02.806745+0000","last_active":"2024-02-17T12:18:19.341774+0000","last_peered":"2024-02-17T12:18:19.341774+0000","last_clean":"2024-02-17T12:18:19.341774+0000","last_became_active":"2024-02-17T12:18:02.806429+0000","last_became_peered":"2024-02-17T12:18:02.806429+0000","last_unstale":"2024-02-17T12:18:19.341774+0000","last_undegraded":"2024-02-17T12:18:19.341774+0000","last_fullsized":"2024-02-17T12:18:19.341774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:58.938533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338923+0000","last_change":"2024-02-17T12:18:01.793256+0000","last_active":"2024-02-17T12:18:19.338923+0000","last_peered":"2024-02-17T12:18:19.338923+0000","last_clean":"2024-02-17T12:18:19.338923+0000","last_became_active":"2024-02-17T12:18:01.793033+0000","last_became_peered":"2024-02-17T12:18:01.793033+0000","last_unstale":"2024-02-17T12:18:19.338923+0000","last_undegraded":"2024-02-17T12:18:19.338923+0000","last_fullsized":"2024-02-17T12:18:19.338923+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:46.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332591+0000","last_change":"2024-02-17T12:18:19.332591+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332591+0000","last_undegraded":"2024-02-17T12:18:19.332591+0000","last_fullsized":"2024-02-17T12:18:19.332591+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355617+0000","last_change":"2024-02-17T12:18:19.349950+0000","last_active":"2024-02-17T12:18:19.355617+0000","last_peered":"2024-02-17T12:18:19.355617+0000","last_clean":"2024-02-17T12:18:19.355617+0000","last_became_active":"2024-02-17T12:18:19.349690+0000","last_became_peered":"2024-02-17T12:18:19.349690+0000","last_unstale":"2024-02-17T12:18:19.355617+0000","last_undegraded":"2024-02-17T12:18:19.355617+0000","last_fullsized":"2024-02-17T12:18:19.355617+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:49.360736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338823+0000","last_change":"2024-02-17T12:18:02.800813+0000","last_active":"2024-02-17T12:18:19.338823+0000","last_peered":"2024-02-17T12:18:19.338823+0000","last_clean":"2024-02-17T12:18:19.338823+0000","last_became_active":"2024-02-17T12:18:02.800551+0000","last_became_peered":"2024-02-17T12:18:02.800551+0000","last_unstale":"2024-02-17T12:18:19.338823+0000","last_undegraded":"2024-02-17T12:18:19.338823+0000","last_fullsized":"2024-02-17T12:18:19.338823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:47:58.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345656+0000","last_change":"2024-02-17T12:18:01.796062+0000","last_active":"2024-02-17T12:18:19.345656+0000","last_peered":"2024-02-17T12:18:19.345656+0000","last_clean":"2024-02-17T12:18:19.345656+0000","last_became_active":"2024-02-17T12:18:01.795616+0000","last_became_peered":"2024-02-17T12:18:01.795616+0000","last_unstale":"2024-02-17T12:18:19.345656+0000","last_undegraded":"2024-02-17T12:18:19.345656+0000","last_fullsized":"2024-02-17T12:18:19.345656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:04:59.908240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332342+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:18:18.332342+0000","last_peered":"2024-02-17T12:18:18.332342+0000","last_clean":"2024-02-17T12:18:18.332342+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:18:18.332342+0000","last_undegraded":"2024-02-17T12:18:18.332342+0000","last_fullsized":"2024-02-17T12:18:18.332342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":5},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509468,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":254820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88700000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":1.115,"15min":1.115},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88500000000000001,"5min":1.143,"15min":1.143},"last":0.76800000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88700000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.90800000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.02},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.0049999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0669999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":622592,"data_stored":262602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.378}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.439},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.66800000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":262006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.44},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.621,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":1.387,"15min":1.387},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.497,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.714,"15min":1.714},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.744,"15min":1.744},"last":0.90200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91500000000000004,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.91600000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.002,"5min":1.575,"15min":1.575},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96899999999999997,"5min":1.321,"15min":1.321},"last":0.95099999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":262040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64200000000000002,"5min":1.145,"15min":1.145},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.34000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69499999999999995,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58099999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73799999999999999,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":2.609,"15min":2.609},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.079,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.90700000000000003,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.997,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.05,"5min":1.095,"15min":1.095},"last":0.70299999999999996}]},{"osd":6,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0469999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0820000000000001,"5min":5.375,"15min":5.375},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":1.0169999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.091,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.629,"15min":1.629},"last":0.72499999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1224704,"data_stored":856015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47899999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45900000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45100000000000001,"15min":0.45700000000000002},"min":{"1min":0.312,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":1.046,"15min":1.046},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.58699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0129999999999999,"5min":1.139,"15min":1.139},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92800000000000005,"5min":1.038,"15min":1.038},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94499999999999995,"5min":1.095,"15min":1.095},"last":0.746}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0960000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90200000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.84499999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1204224,"data_stored":845348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84899999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.73099999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75700000000000001,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92400000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.79800000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90000000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.38500000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86799999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.43099999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95099999999999996,"5min":1.052,"15min":1.052},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.40899999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":614400,"data_stored":257935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86799999999999999,"5min":1.264,"15min":1.264},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.198,"15min":1.198},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.171,"15min":1.171},"last":0.65900000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.745},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93600000000000005,"5min":1.522,"15min":1.522},"last":0.69299999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89900000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70299999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88100000000000001,"5min":1.228,"15min":1.228},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.68300000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":254876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.434},{"interface":"front","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.141,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93300000000000005,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.58199999999999996}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2749999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.997,"5min":1.252,"15min":1.252},"last":0.55400000000000005}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91500000000000004,"5min":1.29,"15min":1.29},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":1.337,"15min":1.337},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:18:24.455 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:18:24.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda32e00640 1 Processor -- start 2024-02-17T12:18:24.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda32e00640 1 -- start start 2024-02-17T12:18:24.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda32e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fda2c0c25a0 0x7fda2c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda32e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda2c152c50 0x7fda2c153070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda32e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c156270 con 0x7fda2c06db50 2024-02-17T12:18:24.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda32e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c071630 con 0x7fda2c152c50 2024-02-17T12:18:24.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda32e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c156550 con 0x7fda2c0c25a0 2024-02-17T12:18:24.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda30e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda2c152c50 0x7fda2c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda2b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fda2c06db50 0x7fda2c14ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54748/0 (socket says 172.21.15.114:54748) 2024-02-17T12:18:24.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda2b400640 1 -- 172.21.15.114:0/3232015515 learned_addr learned my addr 172.21.15.114:0/3232015515 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:24.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda2be00640 1 --2- 172.21.15.114:0/3232015515 >> v2:172.21.15.116:3300/0 conn(0x7fda2c0c25a0 0x7fda2c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda30e00640 1 -- 172.21.15.114:0/3232015515 >> v2:172.21.15.116:3300/0 conn(0x7fda2c0c25a0 msgr2=0x7fda2c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:24.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda30e00640 1 --2- 172.21.15.114:0/3232015515 >> v2:172.21.15.116:3300/0 conn(0x7fda2c0c25a0 0x7fda2c06e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda30e00640 1 -- 172.21.15.114:0/3232015515 >> v1:172.21.15.114:6789/0 conn(0x7fda2c06db50 legacy=0x7fda2c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda30e00640 1 -- 172.21.15.114:0/3232015515 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c156830 con 0x7fda2c152c50 2024-02-17T12:18:24.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.617+0000 7fda2aa00640 1 -- 172.21.15.114:0/3232015515 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163937163 0 0) 0x7fda2c156270 con 0x7fda2c06db50 2024-02-17T12:18:24.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda30e00640 1 --2- 172.21.15.114:0/3232015515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 0x7fda2c153070 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0ab930 tx=0x7fda2401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61c57fd453b41d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:24.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda2aa00640 1 -- 172.21.15.114:0/3232015515 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240a57b0 con 0x7fda2c152c50 2024-02-17T12:18:24.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda2aa00640 1 -- 172.21.15.114:0/3232015515 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda240a5910 con 0x7fda2c152c50 2024-02-17T12:18:24.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda2aa00640 1 -- 172.21.15.114:0/3232015515 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240a5ca0 con 0x7fda2c152c50 2024-02-17T12:18:24.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda32e00640 1 -- 172.21.15.114:0/3232015515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 msgr2=0x7fda2c153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda32e00640 1 --2- 172.21.15.114:0/3232015515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 0x7fda2c153070 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0ab930 tx=0x7fda2401c7e0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda32e00640 1 -- 172.21.15.114:0/3232015515 shutdown_connections 2024-02-17T12:18:24.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda32e00640 1 --2- 172.21.15.114:0/3232015515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 0x7fda2c153070 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda32e00640 1 --2- 172.21.15.114:0/3232015515 >> v2:172.21.15.116:3300/0 conn(0x7fda2c0c25a0 0x7fda2c06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda32e00640 1 -- 172.21.15.114:0/3232015515 >> 172.21.15.114:0/3232015515 conn(0x7fda2c0a8490 msgr2=0x7fda2c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:24.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda32e00640 1 -- 172.21.15.114:0/3232015515 shutdown_connections 2024-02-17T12:18:24.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.621+0000 7fda32e00640 1 -- 172.21.15.114:0/3232015515 wait complete. 2024-02-17T12:18:24.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 Processor -- start 2024-02-17T12:18:24.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 -- start start 2024-02-17T12:18:24.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda2c06db50 0x7fda2c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda2c0c25a0 0x7fda2c0aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 0x7fda2c1f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c14e000 con 0x7fda2c152c50 2024-02-17T12:18:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c14f9b0 con 0x7fda2c0c25a0 2024-02-17T12:18:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c14f110 con 0x7fda2c06db50 2024-02-17T12:18:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda30e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 0x7fda2c1f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda30e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 0x7fda2c1f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35550/0 (socket says 172.21.15.114:35550) 2024-02-17T12:18:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda30e00640 1 -- 172.21.15.114:0/2709445745 learned_addr learned my addr 172.21.15.114:0/2709445745 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:24.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda2b400640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda2c0c25a0 0x7fda2c0aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda2be00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda2c06db50 0x7fda2c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda30e00640 1 -- 172.21.15.114:0/2709445745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda2c06db50 msgr2=0x7fda2c151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda30e00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda2c06db50 0x7fda2c151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda30e00640 1 -- 172.21.15.114:0/2709445745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda2c0c25a0 msgr2=0x7fda2c0aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda30e00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda2c0c25a0 0x7fda2c0aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda30e00640 1 -- 172.21.15.114:0/2709445745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24009a70 con 0x7fda2c152c50 2024-02-17T12:18:24.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda30e00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 0x7fda2c1f1370 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fda240193f0 tx=0x7fda24019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda23e00640 1 -- 172.21.15.114:0/2709445745 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240b9650 con 0x7fda2c152c50 2024-02-17T12:18:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda23e00640 1 -- 172.21.15.114:0/2709445745 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda240b97b0 con 0x7fda2c152c50 2024-02-17T12:18:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda23e00640 1 -- 172.21.15.114:0/2709445745 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240b9b40 con 0x7fda2c152c50 2024-02-17T12:18:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 -- 172.21.15.114:0/2709445745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c14f3f0 con 0x7fda2c152c50 2024-02-17T12:18:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 -- 172.21.15.114:0/2709445745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c1f0e50 con 0x7fda2c152c50 2024-02-17T12:18:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.625+0000 7fda32e00640 1 -- 172.21.15.114:0/2709445745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c1f1040 con 0x7fda2c152c50 2024-02-17T12:18:24.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.629+0000 7fda23e00640 1 -- 172.21.15.114:0/2709445745 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fda240b9ca0 con 0x7fda2c152c50 2024-02-17T12:18:24.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.629+0000 7fda23e00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda0c066e40 0x7fda0c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:24.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.629+0000 7fda23e00640 1 -- 172.21.15.114:0/2709445745 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fda2411fff0 con 0x7fda2c152c50 2024-02-17T12:18:24.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.629+0000 7fda2be00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda0c066e40 0x7fda0c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:24.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.629+0000 7fda2be00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda0c066e40 0x7fda0c069300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009af0 tx=0x7fda1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:24.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.633+0000 7fda23e00640 1 -- 172.21.15.114:0/2709445745 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fda24151cb0 con 0x7fda2c152c50 2024-02-17T12:18:24.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.785+0000 7fda32e00640 1 -- 172.21.15.114:0/2709445745 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda2c15fcf0 con 0x7fda0c066e40 2024-02-17T12:18:24.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.797+0000 7fda23e00640 1 -- 172.21.15.114:0/2709445745 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+520265 (secure 0 0 0) 0x7fda1c0119b0 con 0x7fda0c066e40 2024-02-17T12:18:24.805 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:24.811 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:18:24.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 -- 172.21.15.114:0/2709445745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda0c066e40 msgr2=0x7fda0c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda0c066e40 0x7fda0c069300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009af0 tx=0x7fda1c008040 comp rx=0 tx=0).stop 2024-02-17T12:18:24.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 -- 172.21.15.114:0/2709445745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 msgr2=0x7fda2c1f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:24.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 0x7fda2c1f1370 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fda240193f0 tx=0x7fda24019580 comp rx=0 tx=0).stop 2024-02-17T12:18:24.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 -- 172.21.15.114:0/2709445745 shutdown_connections 2024-02-17T12:18:24.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda0c066e40 0x7fda0c069300 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda2c152c50 0x7fda2c1f1370 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda2c0c25a0 0x7fda2c0aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 --2- 172.21.15.114:0/2709445745 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda2c06db50 0x7fda2c151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:24.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 -- 172.21.15.114:0/2709445745 >> 172.21.15.114:0/2709445745 conn(0x7fda2c0a8490 msgr2=0x7fda2c072960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:24.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 -- 172.21.15.114:0/2709445745 shutdown_connections 2024-02-17T12:18:24.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.801+0000 7fda32e00640 1 -- 172.21.15.114:0/2709445745 wait complete. 2024-02-17T12:18:24.825 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-02-17T12:18:23.241617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594281,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":328,"acting":328,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230472,"kb_used_data":5976,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744248,"statfs":{"total":773094113280,"available":772858109952,"internally_reserved":0,"allocated":6119424,"data_stored":3255642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1245,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.918288"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.337103+0000","last_change":"2024-02-17T12:18:19.337103+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.337103+0000","last_undegraded":"2024-02-17T12:18:19.337103+0000","last_fullsized":"2024-02-17T12:18:19.337103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333598+0000","last_change":"2024-02-17T12:18:02.804326+0000","last_active":"2024-02-17T12:18:18.333598+0000","last_peered":"2024-02-17T12:18:18.333598+0000","last_clean":"2024-02-17T12:18:18.333598+0000","last_became_active":"2024-02-17T12:18:02.804074+0000","last_became_peered":"2024-02-17T12:18:02.804074+0000","last_unstale":"2024-02-17T12:18:18.333598+0000","last_undegraded":"2024-02-17T12:18:18.333598+0000","last_fullsized":"2024-02-17T12:18:18.333598+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:47.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.341116+0000","last_change":"2024-02-17T12:18:19.341116+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.341116+0000","last_undegraded":"2024-02-17T12:18:19.341116+0000","last_fullsized":"2024-02-17T12:18:19.341116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342702+0000","last_change":"2024-02-17T12:18:02.808706+0000","last_active":"2024-02-17T12:18:19.342702+0000","last_peered":"2024-02-17T12:18:19.342702+0000","last_clean":"2024-02-17T12:18:19.342702+0000","last_became_active":"2024-02-17T12:18:02.808520+0000","last_became_peered":"2024-02-17T12:18:02.808520+0000","last_unstale":"2024-02-17T12:18:19.342702+0000","last_undegraded":"2024-02-17T12:18:19.342702+0000","last_fullsized":"2024-02-17T12:18:19.342702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:27.642044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.331952+0000","last_change":"2024-02-17T12:18:02.807196+0000","last_active":"2024-02-17T12:18:18.331952+0000","last_peered":"2024-02-17T12:18:18.331952+0000","last_clean":"2024-02-17T12:18:18.331952+0000","last_became_active":"2024-02-17T12:18:02.806894+0000","last_became_peered":"2024-02-17T12:18:02.806894+0000","last_unstale":"2024-02-17T12:18:18.331952+0000","last_undegraded":"2024-02-17T12:18:18.331952+0000","last_fullsized":"2024-02-17T12:18:18.331952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:12.749708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335776+0000","last_change":"2024-02-17T12:18:19.335776+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335776+0000","last_undegraded":"2024-02-17T12:18:19.335776+0000","last_fullsized":"2024-02-17T12:18:19.335776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.329620+0000","last_change":"2024-02-17T12:18:02.814770+0000","last_active":"2024-02-17T12:18:19.329620+0000","last_peered":"2024-02-17T12:18:19.329620+0000","last_clean":"2024-02-17T12:18:19.329620+0000","last_became_active":"2024-02-17T12:18:02.809466+0000","last_became_peered":"2024-02-17T12:18:02.809466+0000","last_unstale":"2024-02-17T12:18:19.329620+0000","last_undegraded":"2024-02-17T12:18:19.329620+0000","last_fullsized":"2024-02-17T12:18:19.329620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332409+0000","last_change":"2024-02-17T12:18:19.332409+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332409+0000","last_undegraded":"2024-02-17T12:18:19.332409+0000","last_fullsized":"2024-02-17T12:18:19.332409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332653+0000","last_change":"2024-02-17T12:18:02.802996+0000","last_active":"2024-02-17T12:18:18.332653+0000","last_peered":"2024-02-17T12:18:18.332653+0000","last_clean":"2024-02-17T12:18:18.332653+0000","last_became_active":"2024-02-17T12:18:02.802690+0000","last_became_peered":"2024-02-17T12:18:02.802690+0000","last_unstale":"2024-02-17T12:18:18.332653+0000","last_undegraded":"2024-02-17T12:18:18.332653+0000","last_fullsized":"2024-02-17T12:18:18.332653+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:59.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339125+0000","last_change":"2024-02-17T12:18:19.339125+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339125+0000","last_undegraded":"2024-02-17T12:18:19.339125+0000","last_fullsized":"2024-02-17T12:18:19.339125+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339236+0000","last_change":"2024-02-17T12:18:02.812986+0000","last_active":"2024-02-17T12:18:19.339236+0000","last_peered":"2024-02-17T12:18:19.339236+0000","last_clean":"2024-02-17T12:18:19.339236+0000","last_became_active":"2024-02-17T12:18:02.809576+0000","last_became_peered":"2024-02-17T12:18:02.809576+0000","last_unstale":"2024-02-17T12:18:19.339236+0000","last_undegraded":"2024-02-17T12:18:19.339236+0000","last_fullsized":"2024-02-17T12:18:19.339236+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328210+0000","last_change":"2024-02-17T12:18:02.799654+0000","last_active":"2024-02-17T12:18:18.328210+0000","last_peered":"2024-02-17T12:18:18.328210+0000","last_clean":"2024-02-17T12:18:18.328210+0000","last_became_active":"2024-02-17T12:18:02.799356+0000","last_became_peered":"2024-02-17T12:18:02.799356+0000","last_unstale":"2024-02-17T12:18:18.328210+0000","last_undegraded":"2024-02-17T12:18:18.328210+0000","last_fullsized":"2024-02-17T12:18:18.328210+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:29.710017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340431+0000","last_change":"2024-02-17T12:18:19.340431+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340431+0000","last_undegraded":"2024-02-17T12:18:19.340431+0000","last_fullsized":"2024-02-17T12:18:19.340431+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339634+0000","last_change":"2024-02-17T12:18:02.800189+0000","last_active":"2024-02-17T12:18:19.339634+0000","last_peered":"2024-02-17T12:18:19.339634+0000","last_clean":"2024-02-17T12:18:19.339634+0000","last_became_active":"2024-02-17T12:18:02.799866+0000","last_became_peered":"2024-02-17T12:18:02.799866+0000","last_unstale":"2024-02-17T12:18:19.339634+0000","last_undegraded":"2024-02-17T12:18:19.339634+0000","last_fullsized":"2024-02-17T12:18:19.339634+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:52.152034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328951+0000","last_change":"2024-02-17T12:18:02.794591+0000","last_active":"2024-02-17T12:18:18.328951+0000","last_peered":"2024-02-17T12:18:18.328951+0000","last_clean":"2024-02-17T12:18:18.328951+0000","last_became_active":"2024-02-17T12:18:02.794309+0000","last_became_peered":"2024-02-17T12:18:02.794309+0000","last_unstale":"2024-02-17T12:18:18.328951+0000","last_undegraded":"2024-02-17T12:18:18.328951+0000","last_fullsized":"2024-02-17T12:18:18.328951+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:18.132994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.342320+0000","last_change":"2024-02-17T12:18:19.342320+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.342320+0000","last_undegraded":"2024-02-17T12:18:19.342320+0000","last_fullsized":"2024-02-17T12:18:19.342320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344227+0000","last_change":"2024-02-17T12:18:02.802586+0000","last_active":"2024-02-17T12:18:19.344227+0000","last_peered":"2024-02-17T12:18:19.344227+0000","last_clean":"2024-02-17T12:18:19.344227+0000","last_became_active":"2024-02-17T12:18:02.802328+0000","last_became_peered":"2024-02-17T12:18:02.802328+0000","last_unstale":"2024-02-17T12:18:19.344227+0000","last_undegraded":"2024-02-17T12:18:19.344227+0000","last_fullsized":"2024-02-17T12:18:19.344227+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:30.894335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344849+0000","last_change":"2024-02-17T12:18:02.803729+0000","last_active":"2024-02-17T12:18:19.344849+0000","last_peered":"2024-02-17T12:18:19.344849+0000","last_clean":"2024-02-17T12:18:19.344849+0000","last_became_active":"2024-02-17T12:18:02.803504+0000","last_became_peered":"2024-02-17T12:18:02.803504+0000","last_unstale":"2024-02-17T12:18:19.344849+0000","last_undegraded":"2024-02-17T12:18:19.344849+0000","last_fullsized":"2024-02-17T12:18:19.344849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:50.631061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330710+0000","last_change":"2024-02-17T12:18:02.814562+0000","last_active":"2024-02-17T12:18:19.330710+0000","last_peered":"2024-02-17T12:18:19.330710+0000","last_clean":"2024-02-17T12:18:19.330710+0000","last_became_active":"2024-02-17T12:18:02.809011+0000","last_became_peered":"2024-02-17T12:18:02.809011+0000","last_unstale":"2024-02-17T12:18:19.330710+0000","last_undegraded":"2024-02-17T12:18:19.330710+0000","last_fullsized":"2024-02-17T12:18:19.330710+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335567+0000","last_change":"2024-02-17T12:18:19.335567+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335567+0000","last_undegraded":"2024-02-17T12:18:19.335567+0000","last_fullsized":"2024-02-17T12:18:19.335567+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345668+0000","last_change":"2024-02-17T12:18:02.800228+0000","last_active":"2024-02-17T12:18:19.345668+0000","last_peered":"2024-02-17T12:18:19.345668+0000","last_clean":"2024-02-17T12:18:19.345668+0000","last_became_active":"2024-02-17T12:18:02.799965+0000","last_became_peered":"2024-02-17T12:18:02.799965+0000","last_unstale":"2024-02-17T12:18:19.345668+0000","last_undegraded":"2024-02-17T12:18:19.345668+0000","last_fullsized":"2024-02-17T12:18:19.345668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:05.435817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328399+0000","last_change":"2024-02-17T12:18:02.798437+0000","last_active":"2024-02-17T12:18:18.328399+0000","last_peered":"2024-02-17T12:18:18.328399+0000","last_clean":"2024-02-17T12:18:18.328399+0000","last_became_active":"2024-02-17T12:18:02.798145+0000","last_became_peered":"2024-02-17T12:18:02.798145+0000","last_unstale":"2024-02-17T12:18:18.328399+0000","last_undegraded":"2024-02-17T12:18:18.328399+0000","last_fullsized":"2024-02-17T12:18:18.328399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:29.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332924+0000","last_change":"2024-02-17T12:18:19.332924+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332924+0000","last_undegraded":"2024-02-17T12:18:19.332924+0000","last_fullsized":"2024-02-17T12:18:19.332924+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328351+0000","last_change":"2024-02-17T12:18:02.797013+0000","last_active":"2024-02-17T12:18:18.328351+0000","last_peered":"2024-02-17T12:18:18.328351+0000","last_clean":"2024-02-17T12:18:18.328351+0000","last_became_active":"2024-02-17T12:18:02.796734+0000","last_became_peered":"2024-02-17T12:18:02.796734+0000","last_unstale":"2024-02-17T12:18:18.328351+0000","last_undegraded":"2024-02-17T12:18:18.328351+0000","last_fullsized":"2024-02-17T12:18:18.328351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:32.566741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.336921+0000","last_change":"2024-02-17T12:18:02.809976+0000","last_active":"2024-02-17T12:18:19.336921+0000","last_peered":"2024-02-17T12:18:19.336921+0000","last_clean":"2024-02-17T12:18:19.336921+0000","last_became_active":"2024-02-17T12:18:02.809645+0000","last_became_peered":"2024-02-17T12:18:02.809645+0000","last_unstale":"2024-02-17T12:18:19.336921+0000","last_undegraded":"2024-02-17T12:18:19.336921+0000","last_fullsized":"2024-02-17T12:18:19.336921+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340057+0000","last_change":"2024-02-17T12:18:19.340057+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340057+0000","last_undegraded":"2024-02-17T12:18:19.340057+0000","last_fullsized":"2024-02-17T12:18:19.340057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343660+0000","last_change":"2024-02-17T12:18:02.807700+0000","last_active":"2024-02-17T12:18:19.343660+0000","last_peered":"2024-02-17T12:18:19.343660+0000","last_clean":"2024-02-17T12:18:19.343660+0000","last_became_active":"2024-02-17T12:18:02.805575+0000","last_became_peered":"2024-02-17T12:18:02.805575+0000","last_unstale":"2024-02-17T12:18:19.343660+0000","last_undegraded":"2024-02-17T12:18:19.343660+0000","last_fullsized":"2024-02-17T12:18:19.343660+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:52:33.882315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333193+0000","last_change":"2024-02-17T12:18:19.333193+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333193+0000","last_undegraded":"2024-02-17T12:18:19.333193+0000","last_fullsized":"2024-02-17T12:18:19.333193+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333106+0000","last_change":"2024-02-17T12:18:02.809074+0000","last_active":"2024-02-17T12:18:18.333106+0000","last_peered":"2024-02-17T12:18:18.333106+0000","last_clean":"2024-02-17T12:18:18.333106+0000","last_became_active":"2024-02-17T12:18:02.808683+0000","last_became_peered":"2024-02-17T12:18:02.808683+0000","last_unstale":"2024-02-17T12:18:18.333106+0000","last_undegraded":"2024-02-17T12:18:18.333106+0000","last_fullsized":"2024-02-17T12:18:18.333106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:46:21.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333344+0000","last_change":"2024-02-17T12:18:02.803587+0000","last_active":"2024-02-17T12:18:18.333344+0000","last_peered":"2024-02-17T12:18:18.333344+0000","last_clean":"2024-02-17T12:18:18.333344+0000","last_became_active":"2024-02-17T12:18:02.803312+0000","last_became_peered":"2024-02-17T12:18:02.803312+0000","last_unstale":"2024-02-17T12:18:18.333344+0000","last_undegraded":"2024-02-17T12:18:18.333344+0000","last_fullsized":"2024-02-17T12:18:18.333344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:54:01.696616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.342713+0000","last_change":"2024-02-17T12:18:19.342713+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.342713+0000","last_undegraded":"2024-02-17T12:18:19.342713+0000","last_fullsized":"2024-02-17T12:18:19.342713+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343993+0000","last_change":"2024-02-17T12:18:02.815782+0000","last_active":"2024-02-17T12:18:19.343993+0000","last_peered":"2024-02-17T12:18:19.343993+0000","last_clean":"2024-02-17T12:18:19.343993+0000","last_became_active":"2024-02-17T12:18:02.815537+0000","last_became_peered":"2024-02-17T12:18:02.815537+0000","last_unstale":"2024-02-17T12:18:19.343993+0000","last_undegraded":"2024-02-17T12:18:19.343993+0000","last_fullsized":"2024-02-17T12:18:19.343993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:23.114440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332256+0000","last_change":"2024-02-17T12:18:02.809894+0000","last_active":"2024-02-17T12:18:18.332256+0000","last_peered":"2024-02-17T12:18:18.332256+0000","last_clean":"2024-02-17T12:18:18.332256+0000","last_became_active":"2024-02-17T12:18:02.807451+0000","last_became_peered":"2024-02-17T12:18:02.807451+0000","last_unstale":"2024-02-17T12:18:18.332256+0000","last_undegraded":"2024-02-17T12:18:18.332256+0000","last_fullsized":"2024-02-17T12:18:18.332256+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:05:50.249065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341901+0000","last_change":"2024-02-17T12:18:02.813079+0000","last_active":"2024-02-17T12:18:19.341901+0000","last_peered":"2024-02-17T12:18:19.341901+0000","last_clean":"2024-02-17T12:18:19.341901+0000","last_became_active":"2024-02-17T12:18:02.810630+0000","last_became_peered":"2024-02-17T12:18:02.810630+0000","last_unstale":"2024-02-17T12:18:19.341901+0000","last_undegraded":"2024-02-17T12:18:19.341901+0000","last_fullsized":"2024-02-17T12:18:19.341901+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:32:22.683974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332679+0000","last_change":"2024-02-17T12:18:02.807916+0000","last_active":"2024-02-17T12:18:18.332679+0000","last_peered":"2024-02-17T12:18:18.332679+0000","last_clean":"2024-02-17T12:18:18.332679+0000","last_became_active":"2024-02-17T12:18:02.806754+0000","last_became_peered":"2024-02-17T12:18:02.806754+0000","last_unstale":"2024-02-17T12:18:18.332679+0000","last_undegraded":"2024-02-17T12:18:18.332679+0000","last_fullsized":"2024-02-17T12:18:18.332679+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.985986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346146+0000","last_change":"2024-02-17T12:18:02.805691+0000","last_active":"2024-02-17T12:18:19.346146+0000","last_peered":"2024-02-17T12:18:19.346146+0000","last_clean":"2024-02-17T12:18:19.346146+0000","last_became_active":"2024-02-17T12:18:02.805396+0000","last_became_peered":"2024-02-17T12:18:02.805396+0000","last_unstale":"2024-02-17T12:18:19.346146+0000","last_undegraded":"2024-02-17T12:18:19.346146+0000","last_fullsized":"2024-02-17T12:18:19.346146+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:09:34.480729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.336674+0000","last_change":"2024-02-17T12:18:19.336674+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.336674+0000","last_undegraded":"2024-02-17T12:18:19.336674+0000","last_fullsized":"2024-02-17T12:18:19.336674+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333690+0000","last_change":"2024-02-17T12:18:02.798267+0000","last_active":"2024-02-17T12:18:18.333690+0000","last_peered":"2024-02-17T12:18:18.333690+0000","last_clean":"2024-02-17T12:18:18.333690+0000","last_became_active":"2024-02-17T12:18:02.797624+0000","last_became_peered":"2024-02-17T12:18:02.797624+0000","last_unstale":"2024-02-17T12:18:18.333690+0000","last_undegraded":"2024-02-17T12:18:18.333690+0000","last_fullsized":"2024-02-17T12:18:18.333690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:17:06.691178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.332906+0000","last_change":"2024-02-17T12:18:02.802532+0000","last_active":"2024-02-17T12:18:19.332906+0000","last_peered":"2024-02-17T12:18:19.332906+0000","last_clean":"2024-02-17T12:18:19.332906+0000","last_became_active":"2024-02-17T12:18:02.801766+0000","last_became_peered":"2024-02-17T12:18:02.801766+0000","last_unstale":"2024-02-17T12:18:19.332906+0000","last_undegraded":"2024-02-17T12:18:19.332906+0000","last_fullsized":"2024-02-17T12:18:19.332906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338177+0000","last_change":"2024-02-17T12:18:02.797999+0000","last_active":"2024-02-17T12:18:19.338177+0000","last_peered":"2024-02-17T12:18:19.338177+0000","last_clean":"2024-02-17T12:18:19.338177+0000","last_became_active":"2024-02-17T12:18:02.797710+0000","last_became_peered":"2024-02-17T12:18:02.797710+0000","last_unstale":"2024-02-17T12:18:19.338177+0000","last_undegraded":"2024-02-17T12:18:19.338177+0000","last_fullsized":"2024-02-17T12:18:19.338177+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332446+0000","last_change":"2024-02-17T12:18:19.332446+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332446+0000","last_undegraded":"2024-02-17T12:18:19.332446+0000","last_fullsized":"2024-02-17T12:18:19.332446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333297+0000","last_change":"2024-02-17T12:18:02.804711+0000","last_active":"2024-02-17T12:18:18.333297+0000","last_peered":"2024-02-17T12:18:18.333297+0000","last_clean":"2024-02-17T12:18:18.333297+0000","last_became_active":"2024-02-17T12:18:02.804459+0000","last_became_peered":"2024-02-17T12:18:02.804459+0000","last_unstale":"2024-02-17T12:18:18.333297+0000","last_undegraded":"2024-02-17T12:18:18.333297+0000","last_fullsized":"2024-02-17T12:18:18.333297+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:47.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.329892+0000","last_change":"2024-02-17T12:18:19.329892+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.329892+0000","last_undegraded":"2024-02-17T12:18:19.329892+0000","last_fullsized":"2024-02-17T12:18:19.329892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342440+0000","last_change":"2024-02-17T12:18:02.802524+0000","last_active":"2024-02-17T12:18:19.342440+0000","last_peered":"2024-02-17T12:18:19.342440+0000","last_clean":"2024-02-17T12:18:19.342440+0000","last_became_active":"2024-02-17T12:18:02.802045+0000","last_became_peered":"2024-02-17T12:18:02.802045+0000","last_unstale":"2024-02-17T12:18:19.342440+0000","last_undegraded":"2024-02-17T12:18:19.342440+0000","last_fullsized":"2024-02-17T12:18:19.342440+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:06:03.414827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335592+0000","last_change":"2024-02-17T12:18:19.335592+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335592+0000","last_undegraded":"2024-02-17T12:18:19.335592+0000","last_fullsized":"2024-02-17T12:18:19.335592+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332116+0000","last_change":"2024-02-17T12:18:02.807169+0000","last_active":"2024-02-17T12:18:18.332116+0000","last_peered":"2024-02-17T12:18:18.332116+0000","last_clean":"2024-02-17T12:18:18.332116+0000","last_became_active":"2024-02-17T12:18:02.806918+0000","last_became_peered":"2024-02-17T12:18:02.806918+0000","last_unstale":"2024-02-17T12:18:18.332116+0000","last_undegraded":"2024-02-17T12:18:18.332116+0000","last_fullsized":"2024-02-17T12:18:18.332116+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:17.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339441+0000","last_change":"2024-02-17T12:18:19.339441+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339441+0000","last_undegraded":"2024-02-17T12:18:19.339441+0000","last_fullsized":"2024-02-17T12:18:19.339441+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332550+0000","last_change":"2024-02-17T12:18:02.795014+0000","last_active":"2024-02-17T12:18:18.332550+0000","last_peered":"2024-02-17T12:18:18.332550+0000","last_clean":"2024-02-17T12:18:18.332550+0000","last_became_active":"2024-02-17T12:18:02.794759+0000","last_became_peered":"2024-02-17T12:18:02.794759+0000","last_unstale":"2024-02-17T12:18:18.332550+0000","last_undegraded":"2024-02-17T12:18:18.332550+0000","last_fullsized":"2024-02-17T12:18:18.332550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:21.971723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333734+0000","last_change":"2024-02-17T12:18:19.333734+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333734+0000","last_undegraded":"2024-02-17T12:18:19.333734+0000","last_fullsized":"2024-02-17T12:18:19.333734+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.337022+0000","last_change":"2024-02-17T12:18:02.801322+0000","last_active":"2024-02-17T12:18:19.337022+0000","last_peered":"2024-02-17T12:18:19.337022+0000","last_clean":"2024-02-17T12:18:19.337022+0000","last_became_active":"2024-02-17T12:18:02.801073+0000","last_became_peered":"2024-02-17T12:18:02.801073+0000","last_unstale":"2024-02-17T12:18:19.337022+0000","last_undegraded":"2024-02-17T12:18:19.337022+0000","last_fullsized":"2024-02-17T12:18:19.337022+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.343199+0000","last_change":"2024-02-17T12:18:19.343199+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.343199+0000","last_undegraded":"2024-02-17T12:18:19.343199+0000","last_fullsized":"2024-02-17T12:18:19.343199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.326340+0000","last_change":"2024-02-17T12:18:18.326340+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.326340+0000","last_undegraded":"2024-02-17T12:18:18.326340+0000","last_fullsized":"2024-02-17T12:18:18.326340+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338219+0000","last_change":"2024-02-17T12:18:02.811882+0000","last_active":"2024-02-17T12:18:19.338219+0000","last_peered":"2024-02-17T12:18:19.338219+0000","last_clean":"2024-02-17T12:18:19.338219+0000","last_became_active":"2024-02-17T12:18:02.811448+0000","last_became_peered":"2024-02-17T12:18:02.811448+0000","last_unstale":"2024-02-17T12:18:19.338219+0000","last_undegraded":"2024-02-17T12:18:19.338219+0000","last_fullsized":"2024-02-17T12:18:19.338219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:46.432214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340678+0000","last_change":"2024-02-17T12:18:01.796858+0000","last_active":"2024-02-17T12:18:19.340678+0000","last_peered":"2024-02-17T12:18:19.340678+0000","last_clean":"2024-02-17T12:18:19.340678+0000","last_became_active":"2024-02-17T12:18:01.796498+0000","last_became_peered":"2024-02-17T12:18:01.796498+0000","last_unstale":"2024-02-17T12:18:19.340678+0000","last_undegraded":"2024-02-17T12:18:19.340678+0000","last_fullsized":"2024-02-17T12:18:19.340678+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355683+0000","last_change":"2024-02-17T12:18:19.351335+0000","last_active":"2024-02-17T12:18:19.355683+0000","last_peered":"2024-02-17T12:18:19.355683+0000","last_clean":"2024-02-17T12:18:19.355683+0000","last_became_active":"2024-02-17T12:18:19.350932+0000","last_became_peered":"2024-02-17T12:18:19.350932+0000","last_unstale":"2024-02-17T12:18:19.355683+0000","last_undegraded":"2024-02-17T12:18:19.355683+0000","last_fullsized":"2024-02-17T12:18:19.355683+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:52.676828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344983+0000","last_change":"2024-02-17T12:18:02.808663+0000","last_active":"2024-02-17T12:18:19.344983+0000","last_peered":"2024-02-17T12:18:19.344983+0000","last_clean":"2024-02-17T12:18:19.344983+0000","last_became_active":"2024-02-17T12:18:02.808402+0000","last_became_peered":"2024-02-17T12:18:02.808402+0000","last_unstale":"2024-02-17T12:18:19.344983+0000","last_undegraded":"2024-02-17T12:18:19.344983+0000","last_fullsized":"2024-02-17T12:18:19.344983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:00.777830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342763+0000","last_change":"2024-02-17T12:18:01.790619+0000","last_active":"2024-02-17T12:18:19.342763+0000","last_peered":"2024-02-17T12:18:19.342763+0000","last_clean":"2024-02-17T12:18:19.342763+0000","last_became_active":"2024-02-17T12:18:01.790344+0000","last_became_peered":"2024-02-17T12:18:01.790344+0000","last_unstale":"2024-02-17T12:18:19.342763+0000","last_undegraded":"2024-02-17T12:18:19.342763+0000","last_fullsized":"2024-02-17T12:18:19.342763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:45.425754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331676+0000","last_change":"2024-02-17T12:18:18.331676+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331676+0000","last_undegraded":"2024-02-17T12:18:18.331676+0000","last_fullsized":"2024-02-17T12:18:18.331676+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340787+0000","last_change":"2024-02-17T12:18:02.804685+0000","last_active":"2024-02-17T12:18:19.340787+0000","last_peered":"2024-02-17T12:18:19.340787+0000","last_clean":"2024-02-17T12:18:19.340787+0000","last_became_active":"2024-02-17T12:18:02.803980+0000","last_became_peered":"2024-02-17T12:18:02.803980+0000","last_unstale":"2024-02-17T12:18:19.340787+0000","last_undegraded":"2024-02-17T12:18:19.340787+0000","last_fullsized":"2024-02-17T12:18:19.340787+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:32.327387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338423+0000","last_change":"2024-02-17T12:18:01.801344+0000","last_active":"2024-02-17T12:18:19.338423+0000","last_peered":"2024-02-17T12:18:19.338423+0000","last_clean":"2024-02-17T12:18:19.338423+0000","last_became_active":"2024-02-17T12:18:01.801092+0000","last_became_peered":"2024-02-17T12:18:01.801092+0000","last_unstale":"2024-02-17T12:18:19.338423+0000","last_undegraded":"2024-02-17T12:18:19.338423+0000","last_fullsized":"2024-02-17T12:18:19.338423+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.357844+0000","last_change":"2024-02-17T12:18:19.348869+0000","last_active":"2024-02-17T12:18:19.357844+0000","last_peered":"2024-02-17T12:18:19.357844+0000","last_clean":"2024-02-17T12:18:19.357844+0000","last_became_active":"2024-02-17T12:18:19.347760+0000","last_became_peered":"2024-02-17T12:18:19.347760+0000","last_unstale":"2024-02-17T12:18:19.357844+0000","last_undegraded":"2024-02-17T12:18:19.357844+0000","last_fullsized":"2024-02-17T12:18:19.357844+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:28:32.430718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338263+0000","last_change":"2024-02-17T12:18:02.806603+0000","last_active":"2024-02-17T12:18:19.338263+0000","last_peered":"2024-02-17T12:18:19.338263+0000","last_clean":"2024-02-17T12:18:19.338263+0000","last_became_active":"2024-02-17T12:18:02.806021+0000","last_became_peered":"2024-02-17T12:18:02.806021+0000","last_unstale":"2024-02-17T12:18:19.338263+0000","last_undegraded":"2024-02-17T12:18:19.338263+0000","last_fullsized":"2024-02-17T12:18:19.338263+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:57.248220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330817+0000","last_change":"2024-02-17T12:18:01.790249+0000","last_active":"2024-02-17T12:18:19.330817+0000","last_peered":"2024-02-17T12:18:19.330817+0000","last_clean":"2024-02-17T12:18:19.330817+0000","last_became_active":"2024-02-17T12:18:01.789970+0000","last_became_peered":"2024-02-17T12:18:01.789970+0000","last_unstale":"2024-02-17T12:18:19.330817+0000","last_undegraded":"2024-02-17T12:18:19.330817+0000","last_fullsized":"2024-02-17T12:18:19.330817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360087+0000","last_change":"2024-02-17T12:18:19.353267+0000","last_active":"2024-02-17T12:18:19.360087+0000","last_peered":"2024-02-17T12:18:19.360087+0000","last_clean":"2024-02-17T12:18:19.360087+0000","last_became_active":"2024-02-17T12:18:19.353007+0000","last_became_peered":"2024-02-17T12:18:19.353007+0000","last_unstale":"2024-02-17T12:18:19.360087+0000","last_undegraded":"2024-02-17T12:18:19.360087+0000","last_fullsized":"2024-02-17T12:18:19.360087+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:49.360736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341972+0000","last_change":"2024-02-17T12:18:02.811065+0000","last_active":"2024-02-17T12:18:19.341972+0000","last_peered":"2024-02-17T12:18:19.341972+0000","last_clean":"2024-02-17T12:18:19.341972+0000","last_became_active":"2024-02-17T12:18:02.810598+0000","last_became_peered":"2024-02-17T12:18:02.810598+0000","last_unstale":"2024-02-17T12:18:19.341972+0000","last_undegraded":"2024-02-17T12:18:19.341972+0000","last_fullsized":"2024-02-17T12:18:19.341972+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:11:46.553742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328607+0000","last_change":"2024-02-17T12:18:01.798801+0000","last_active":"2024-02-17T12:18:18.328607+0000","last_peered":"2024-02-17T12:18:18.328607+0000","last_clean":"2024-02-17T12:18:18.328607+0000","last_became_active":"2024-02-17T12:18:01.798516+0000","last_became_peered":"2024-02-17T12:18:01.798516+0000","last_unstale":"2024-02-17T12:18:18.328607+0000","last_undegraded":"2024-02-17T12:18:18.328607+0000","last_fullsized":"2024-02-17T12:18:18.328607+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:04:53.798642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335113+0000","last_change":"2024-02-17T12:18:19.335113+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335113+0000","last_undegraded":"2024-02-17T12:18:19.335113+0000","last_fullsized":"2024-02-17T12:18:19.335113+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331699+0000","last_change":"2024-02-17T12:18:18.331699+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331699+0000","last_undegraded":"2024-02-17T12:18:18.331699+0000","last_fullsized":"2024-02-17T12:18:18.331699+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342282+0000","last_change":"2024-02-17T12:18:02.802301+0000","last_active":"2024-02-17T12:18:19.342282+0000","last_peered":"2024-02-17T12:18:19.342282+0000","last_clean":"2024-02-17T12:18:19.342282+0000","last_became_active":"2024-02-17T12:18:02.801632+0000","last_became_peered":"2024-02-17T12:18:02.801632+0000","last_unstale":"2024-02-17T12:18:19.342282+0000","last_undegraded":"2024-02-17T12:18:19.342282+0000","last_fullsized":"2024-02-17T12:18:19.342282+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:34:13.159578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339326+0000","last_change":"2024-02-17T12:18:01.800510+0000","last_active":"2024-02-17T12:18:19.339326+0000","last_peered":"2024-02-17T12:18:19.339326+0000","last_clean":"2024-02-17T12:18:19.339326+0000","last_became_active":"2024-02-17T12:18:01.799483+0000","last_became_peered":"2024-02-17T12:18:01.799483+0000","last_unstale":"2024-02-17T12:18:19.339326+0000","last_undegraded":"2024-02-17T12:18:19.339326+0000","last_fullsized":"2024-02-17T12:18:19.339326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.330276+0000","last_change":"2024-02-17T12:18:19.330276+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.330276+0000","last_undegraded":"2024-02-17T12:18:19.330276+0000","last_fullsized":"2024-02-17T12:18:19.330276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.354877+0000","last_change":"2024-02-17T12:18:19.351098+0000","last_active":"2024-02-17T12:18:19.354877+0000","last_peered":"2024-02-17T12:18:19.354877+0000","last_clean":"2024-02-17T12:18:19.354877+0000","last_became_active":"2024-02-17T12:18:19.350809+0000","last_became_peered":"2024-02-17T12:18:19.350809+0000","last_unstale":"2024-02-17T12:18:19.354877+0000","last_undegraded":"2024-02-17T12:18:19.354877+0000","last_fullsized":"2024-02-17T12:18:19.354877+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:07:44.338092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346264+0000","last_change":"2024-02-17T12:18:02.811246+0000","last_active":"2024-02-17T12:18:19.346264+0000","last_peered":"2024-02-17T12:18:19.346264+0000","last_clean":"2024-02-17T12:18:19.346264+0000","last_became_active":"2024-02-17T12:18:02.810989+0000","last_became_peered":"2024-02-17T12:18:02.810989+0000","last_unstale":"2024-02-17T12:18:19.346264+0000","last_undegraded":"2024-02-17T12:18:19.346264+0000","last_fullsized":"2024-02-17T12:18:19.346264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:56:31.198120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.332999+0000","last_change":"2024-02-17T12:18:01.798316+0000","last_active":"2024-02-17T12:18:19.332999+0000","last_peered":"2024-02-17T12:18:19.332999+0000","last_clean":"2024-02-17T12:18:19.332999+0000","last_became_active":"2024-02-17T12:18:01.797041+0000","last_became_peered":"2024-02-17T12:18:01.797041+0000","last_unstale":"2024-02-17T12:18:19.332999+0000","last_undegraded":"2024-02-17T12:18:19.332999+0000","last_fullsized":"2024-02-17T12:18:19.332999+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360092+0000","last_change":"2024-02-17T12:18:19.352520+0000","last_active":"2024-02-17T12:18:19.360092+0000","last_peered":"2024-02-17T12:18:19.360092+0000","last_clean":"2024-02-17T12:18:19.360092+0000","last_became_active":"2024-02-17T12:18:19.351708+0000","last_became_peered":"2024-02-17T12:18:19.351708+0000","last_unstale":"2024-02-17T12:18:19.360092+0000","last_undegraded":"2024-02-17T12:18:19.360092+0000","last_fullsized":"2024-02-17T12:18:19.360092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:01.563171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341680+0000","last_change":"2024-02-17T12:18:02.801971+0000","last_active":"2024-02-17T12:18:19.341680+0000","last_peered":"2024-02-17T12:18:19.341680+0000","last_clean":"2024-02-17T12:18:19.341680+0000","last_became_active":"2024-02-17T12:18:02.801727+0000","last_became_peered":"2024-02-17T12:18:02.801727+0000","last_unstale":"2024-02-17T12:18:19.341680+0000","last_undegraded":"2024-02-17T12:18:19.341680+0000","last_fullsized":"2024-02-17T12:18:19.341680+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:06:15.526935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328199+0000","last_change":"2024-02-17T12:18:01.800493+0000","last_active":"2024-02-17T12:18:18.328199+0000","last_peered":"2024-02-17T12:18:18.328199+0000","last_clean":"2024-02-17T12:18:18.328199+0000","last_became_active":"2024-02-17T12:18:01.800206+0000","last_became_peered":"2024-02-17T12:18:01.800206+0000","last_unstale":"2024-02-17T12:18:18.328199+0000","last_undegraded":"2024-02-17T12:18:18.328199+0000","last_fullsized":"2024-02-17T12:18:18.328199+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:33.603620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340864+0000","last_change":"2024-02-17T12:18:19.340864+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340864+0000","last_undegraded":"2024-02-17T12:18:19.340864+0000","last_fullsized":"2024-02-17T12:18:19.340864+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.348954+0000","last_change":"2024-02-17T12:18:19.347455+0000","last_active":"2024-02-17T12:18:19.348954+0000","last_peered":"2024-02-17T12:18:19.348954+0000","last_clean":"2024-02-17T12:18:19.348954+0000","last_became_active":"2024-02-17T12:18:19.347134+0000","last_became_peered":"2024-02-17T12:18:19.347134+0000","last_unstale":"2024-02-17T12:18:19.348954+0000","last_undegraded":"2024-02-17T12:18:19.348954+0000","last_fullsized":"2024-02-17T12:18:19.348954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:59:36.003726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328936+0000","last_change":"2024-02-17T12:18:02.797952+0000","last_active":"2024-02-17T12:18:18.328936+0000","last_peered":"2024-02-17T12:18:18.328936+0000","last_clean":"2024-02-17T12:18:18.328936+0000","last_became_active":"2024-02-17T12:18:02.797675+0000","last_became_peered":"2024-02-17T12:18:02.797675+0000","last_unstale":"2024-02-17T12:18:18.328936+0000","last_undegraded":"2024-02-17T12:18:18.328936+0000","last_fullsized":"2024-02-17T12:18:18.328936+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:01.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333033+0000","last_change":"2024-02-17T12:18:01.801850+0000","last_active":"2024-02-17T12:18:18.333033+0000","last_peered":"2024-02-17T12:18:18.333033+0000","last_clean":"2024-02-17T12:18:18.333033+0000","last_became_active":"2024-02-17T12:18:01.801516+0000","last_became_peered":"2024-02-17T12:18:01.801516+0000","last_unstale":"2024-02-17T12:18:18.333033+0000","last_undegraded":"2024-02-17T12:18:18.333033+0000","last_fullsized":"2024-02-17T12:18:18.333033+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:28.630666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355114+0000","last_change":"2024-02-17T12:18:19.352769+0000","last_active":"2024-02-17T12:18:19.355114+0000","last_peered":"2024-02-17T12:18:19.355114+0000","last_clean":"2024-02-17T12:18:19.355114+0000","last_became_active":"2024-02-17T12:18:19.352519+0000","last_became_peered":"2024-02-17T12:18:19.352519+0000","last_unstale":"2024-02-17T12:18:19.355114+0000","last_undegraded":"2024-02-17T12:18:19.355114+0000","last_fullsized":"2024-02-17T12:18:19.355114+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333004+0000","last_change":"2024-02-17T12:18:02.813957+0000","last_active":"2024-02-17T12:18:18.333004+0000","last_peered":"2024-02-17T12:18:18.333004+0000","last_clean":"2024-02-17T12:18:18.333004+0000","last_became_active":"2024-02-17T12:18:02.813647+0000","last_became_peered":"2024-02-17T12:18:02.813647+0000","last_unstale":"2024-02-17T12:18:18.333004+0000","last_undegraded":"2024-02-17T12:18:18.333004+0000","last_fullsized":"2024-02-17T12:18:18.333004+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:41.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342822+0000","last_change":"2024-02-17T12:18:01.799508+0000","last_active":"2024-02-17T12:18:19.342822+0000","last_peered":"2024-02-17T12:18:19.342822+0000","last_clean":"2024-02-17T12:18:19.342822+0000","last_became_active":"2024-02-17T12:18:01.798598+0000","last_became_peered":"2024-02-17T12:18:01.798598+0000","last_unstale":"2024-02-17T12:18:19.342822+0000","last_undegraded":"2024-02-17T12:18:19.342822+0000","last_fullsized":"2024-02-17T12:18:19.342822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:45.103353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.329959+0000","last_change":"2024-02-17T12:18:19.329959+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.329959+0000","last_undegraded":"2024-02-17T12:18:19.329959+0000","last_fullsized":"2024-02-17T12:18:19.329959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.326370+0000","last_change":"2024-02-17T12:18:18.326370+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.326370+0000","last_undegraded":"2024-02-17T12:18:18.326370+0000","last_fullsized":"2024-02-17T12:18:18.326370+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344376+0000","last_change":"2024-02-17T12:18:02.787850+0000","last_active":"2024-02-17T12:18:19.344376+0000","last_peered":"2024-02-17T12:18:19.344376+0000","last_clean":"2024-02-17T12:18:19.344376+0000","last_became_active":"2024-02-17T12:18:02.787578+0000","last_became_peered":"2024-02-17T12:18:02.787578+0000","last_unstale":"2024-02-17T12:18:19.344376+0000","last_undegraded":"2024-02-17T12:18:19.344376+0000","last_fullsized":"2024-02-17T12:18:19.344376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:29.854264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332273+0000","last_change":"2024-02-17T12:18:01.805403+0000","last_active":"2024-02-17T12:18:18.332273+0000","last_peered":"2024-02-17T12:18:18.332273+0000","last_clean":"2024-02-17T12:18:18.332273+0000","last_became_active":"2024-02-17T12:18:01.805059+0000","last_became_peered":"2024-02-17T12:18:01.805059+0000","last_unstale":"2024-02-17T12:18:18.332273+0000","last_undegraded":"2024-02-17T12:18:18.332273+0000","last_fullsized":"2024-02-17T12:18:18.332273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:14.495937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355588+0000","last_change":"2024-02-17T12:18:19.349635+0000","last_active":"2024-02-17T12:18:19.355588+0000","last_peered":"2024-02-17T12:18:19.355588+0000","last_clean":"2024-02-17T12:18:19.355588+0000","last_became_active":"2024-02-17T12:18:19.349145+0000","last_became_peered":"2024-02-17T12:18:19.349145+0000","last_unstale":"2024-02-17T12:18:19.355588+0000","last_undegraded":"2024-02-17T12:18:19.355588+0000","last_fullsized":"2024-02-17T12:18:19.355588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332061+0000","last_change":"2024-02-17T12:18:02.810198+0000","last_active":"2024-02-17T12:18:18.332061+0000","last_peered":"2024-02-17T12:18:18.332061+0000","last_clean":"2024-02-17T12:18:18.332061+0000","last_became_active":"2024-02-17T12:18:02.809131+0000","last_became_peered":"2024-02-17T12:18:02.809131+0000","last_unstale":"2024-02-17T12:18:18.332061+0000","last_undegraded":"2024-02-17T12:18:18.332061+0000","last_fullsized":"2024-02-17T12:18:18.332061+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:01:23.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328597+0000","last_change":"2024-02-17T12:18:01.802710+0000","last_active":"2024-02-17T12:18:18.328597+0000","last_peered":"2024-02-17T12:18:18.328597+0000","last_clean":"2024-02-17T12:18:18.328597+0000","last_became_active":"2024-02-17T12:18:01.802365+0000","last_became_peered":"2024-02-17T12:18:01.802365+0000","last_unstale":"2024-02-17T12:18:18.328597+0000","last_undegraded":"2024-02-17T12:18:18.328597+0000","last_fullsized":"2024-02-17T12:18:18.328597+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:45.771679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.334337+0000","last_change":"2024-02-17T12:18:19.334337+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.334337+0000","last_undegraded":"2024-02-17T12:18:19.334337+0000","last_fullsized":"2024-02-17T12:18:19.334337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360350+0000","last_change":"2024-02-17T12:18:19.353417+0000","last_active":"2024-02-17T12:18:19.360350+0000","last_peered":"2024-02-17T12:18:19.360350+0000","last_clean":"2024-02-17T12:18:19.360350+0000","last_became_active":"2024-02-17T12:18:19.350515+0000","last_became_peered":"2024-02-17T12:18:19.350515+0000","last_unstale":"2024-02-17T12:18:19.360350+0000","last_undegraded":"2024-02-17T12:18:19.360350+0000","last_fullsized":"2024-02-17T12:18:19.360350+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:05:31.415587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333976+0000","last_change":"2024-02-17T12:18:02.809855+0000","last_active":"2024-02-17T12:18:19.333976+0000","last_peered":"2024-02-17T12:18:19.333976+0000","last_clean":"2024-02-17T12:18:19.333976+0000","last_became_active":"2024-02-17T12:18:02.809577+0000","last_became_peered":"2024-02-17T12:18:02.809577+0000","last_unstale":"2024-02-17T12:18:19.333976+0000","last_undegraded":"2024-02-17T12:18:19.333976+0000","last_fullsized":"2024-02-17T12:18:19.333976+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:17:49.657379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342359+0000","last_change":"2024-02-17T12:18:01.792615+0000","last_active":"2024-02-17T12:18:19.342359+0000","last_peered":"2024-02-17T12:18:19.342359+0000","last_clean":"2024-02-17T12:18:19.342359+0000","last_became_active":"2024-02-17T12:18:01.792287+0000","last_became_peered":"2024-02-17T12:18:01.792287+0000","last_unstale":"2024-02-17T12:18:19.342359+0000","last_undegraded":"2024-02-17T12:18:19.342359+0000","last_fullsized":"2024-02-17T12:18:19.342359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:56.241760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.326306+0000","last_change":"2024-02-17T12:18:18.326306+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.326306+0000","last_undegraded":"2024-02-17T12:18:18.326306+0000","last_fullsized":"2024-02-17T12:18:18.326306+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332370+0000","last_change":"2024-02-17T12:18:02.808057+0000","last_active":"2024-02-17T12:18:18.332370+0000","last_peered":"2024-02-17T12:18:18.332370+0000","last_clean":"2024-02-17T12:18:18.332370+0000","last_became_active":"2024-02-17T12:18:02.807629+0000","last_became_peered":"2024-02-17T12:18:02.807629+0000","last_unstale":"2024-02-17T12:18:18.332370+0000","last_undegraded":"2024-02-17T12:18:18.332370+0000","last_fullsized":"2024-02-17T12:18:18.332370+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:58:48.506743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346100+0000","last_change":"2024-02-17T12:18:01.797715+0000","last_active":"2024-02-17T12:18:19.346100+0000","last_peered":"2024-02-17T12:18:19.346100+0000","last_clean":"2024-02-17T12:18:19.346100+0000","last_became_active":"2024-02-17T12:18:01.797435+0000","last_became_peered":"2024-02-17T12:18:01.797435+0000","last_unstale":"2024-02-17T12:18:19.346100+0000","last_undegraded":"2024-02-17T12:18:19.346100+0000","last_fullsized":"2024-02-17T12:18:19.346100+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:49.624601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360516+0000","last_change":"2024-02-17T12:18:19.355317+0000","last_active":"2024-02-17T12:18:19.360516+0000","last_peered":"2024-02-17T12:18:19.360516+0000","last_clean":"2024-02-17T12:18:19.360516+0000","last_became_active":"2024-02-17T12:18:19.353852+0000","last_became_peered":"2024-02-17T12:18:19.353852+0000","last_unstale":"2024-02-17T12:18:19.360516+0000","last_undegraded":"2024-02-17T12:18:19.360516+0000","last_fullsized":"2024-02-17T12:18:19.360516+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:52.676828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328075+0000","last_change":"2024-02-17T12:18:02.810137+0000","last_active":"2024-02-17T12:18:18.328075+0000","last_peered":"2024-02-17T12:18:18.328075+0000","last_clean":"2024-02-17T12:18:18.328075+0000","last_became_active":"2024-02-17T12:18:02.809877+0000","last_became_peered":"2024-02-17T12:18:02.809877+0000","last_unstale":"2024-02-17T12:18:18.328075+0000","last_undegraded":"2024-02-17T12:18:18.328075+0000","last_fullsized":"2024-02-17T12:18:18.328075+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:15.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333119+0000","last_change":"2024-02-17T12:18:01.790794+0000","last_active":"2024-02-17T12:18:19.333119+0000","last_peered":"2024-02-17T12:18:19.333119+0000","last_clean":"2024-02-17T12:18:19.333119+0000","last_became_active":"2024-02-17T12:18:01.790500+0000","last_became_peered":"2024-02-17T12:18:01.790500+0000","last_unstale":"2024-02-17T12:18:19.333119+0000","last_undegraded":"2024-02-17T12:18:19.333119+0000","last_fullsized":"2024-02-17T12:18:19.333119+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.330408+0000","last_change":"2024-02-17T12:18:19.330408+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.330408+0000","last_undegraded":"2024-02-17T12:18:19.330408+0000","last_fullsized":"2024-02-17T12:18:19.330408+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360110+0000","last_change":"2024-02-17T12:18:19.352733+0000","last_active":"2024-02-17T12:18:19.360110+0000","last_peered":"2024-02-17T12:18:19.360110+0000","last_clean":"2024-02-17T12:18:19.360110+0000","last_became_active":"2024-02-17T12:18:19.352039+0000","last_became_peered":"2024-02-17T12:18:19.352039+0000","last_unstale":"2024-02-17T12:18:19.360110+0000","last_undegraded":"2024-02-17T12:18:19.360110+0000","last_fullsized":"2024-02-17T12:18:19.360110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:28:25.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332808+0000","last_change":"2024-02-17T12:18:02.808594+0000","last_active":"2024-02-17T12:18:18.332808+0000","last_peered":"2024-02-17T12:18:18.332808+0000","last_clean":"2024-02-17T12:18:18.332808+0000","last_became_active":"2024-02-17T12:18:02.808035+0000","last_became_peered":"2024-02-17T12:18:02.808035+0000","last_unstale":"2024-02-17T12:18:18.332808+0000","last_undegraded":"2024-02-17T12:18:18.332808+0000","last_fullsized":"2024-02-17T12:18:18.332808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:58.050395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332208+0000","last_change":"2024-02-17T12:18:01.789017+0000","last_active":"2024-02-17T12:18:18.332208+0000","last_peered":"2024-02-17T12:18:18.332208+0000","last_clean":"2024-02-17T12:18:18.332208+0000","last_became_active":"2024-02-17T12:18:01.788529+0000","last_became_peered":"2024-02-17T12:18:01.788529+0000","last_unstale":"2024-02-17T12:18:18.332208+0000","last_undegraded":"2024-02-17T12:18:18.332208+0000","last_fullsized":"2024-02-17T12:18:18.332208+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:31.560281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.341864+0000","last_change":"2024-02-17T12:18:19.341864+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.341864+0000","last_undegraded":"2024-02-17T12:18:19.341864+0000","last_fullsized":"2024-02-17T12:18:19.341864+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360193+0000","last_change":"2024-02-17T12:18:19.354058+0000","last_active":"2024-02-17T12:18:19.360193+0000","last_peered":"2024-02-17T12:18:19.360193+0000","last_clean":"2024-02-17T12:18:19.360193+0000","last_became_active":"2024-02-17T12:18:19.353686+0000","last_became_peered":"2024-02-17T12:18:19.353686+0000","last_unstale":"2024-02-17T12:18:19.360193+0000","last_undegraded":"2024-02-17T12:18:19.360193+0000","last_fullsized":"2024-02-17T12:18:19.360193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:44.104942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333212+0000","last_change":"2024-02-17T12:18:02.808518+0000","last_active":"2024-02-17T12:18:18.333212+0000","last_peered":"2024-02-17T12:18:18.333212+0000","last_clean":"2024-02-17T12:18:18.333212+0000","last_became_active":"2024-02-17T12:18:02.808255+0000","last_became_peered":"2024-02-17T12:18:02.808255+0000","last_unstale":"2024-02-17T12:18:18.333212+0000","last_undegraded":"2024-02-17T12:18:18.333212+0000","last_fullsized":"2024-02-17T12:18:18.333212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:58:40.908163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343746+0000","last_change":"2024-02-17T12:18:01.802794+0000","last_active":"2024-02-17T12:18:19.343746+0000","last_peered":"2024-02-17T12:18:19.343746+0000","last_clean":"2024-02-17T12:18:19.343746+0000","last_became_active":"2024-02-17T12:18:01.802366+0000","last_became_peered":"2024-02-17T12:18:01.802366+0000","last_unstale":"2024-02-17T12:18:19.343746+0000","last_undegraded":"2024-02-17T12:18:19.343746+0000","last_fullsized":"2024-02-17T12:18:19.343746+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:45:00.445775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.333710+0000","last_change":"2024-02-17T12:18:18.333710+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.333710+0000","last_undegraded":"2024-02-17T12:18:18.333710+0000","last_fullsized":"2024-02-17T12:18:18.333710+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334807+0000","last_change":"2024-02-17T12:18:02.810942+0000","last_active":"2024-02-17T12:18:19.334807+0000","last_peered":"2024-02-17T12:18:19.334807+0000","last_clean":"2024-02-17T12:18:19.334807+0000","last_became_active":"2024-02-17T12:18:02.810651+0000","last_became_peered":"2024-02-17T12:18:02.810651+0000","last_unstale":"2024-02-17T12:18:19.334807+0000","last_undegraded":"2024-02-17T12:18:19.334807+0000","last_fullsized":"2024-02-17T12:18:19.334807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338302+0000","last_change":"2024-02-17T12:18:01.797601+0000","last_active":"2024-02-17T12:18:19.338302+0000","last_peered":"2024-02-17T12:18:19.338302+0000","last_clean":"2024-02-17T12:18:19.338302+0000","last_became_active":"2024-02-17T12:18:01.796341+0000","last_became_peered":"2024-02-17T12:18:01.796341+0000","last_unstale":"2024-02-17T12:18:19.338302+0000","last_undegraded":"2024-02-17T12:18:19.338302+0000","last_fullsized":"2024-02-17T12:18:19.338302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360165+0000","last_change":"2024-02-17T12:18:19.353335+0000","last_active":"2024-02-17T12:18:19.360165+0000","last_peered":"2024-02-17T12:18:19.360165+0000","last_clean":"2024-02-17T12:18:19.360165+0000","last_became_active":"2024-02-17T12:18:19.353048+0000","last_became_peered":"2024-02-17T12:18:19.353048+0000","last_unstale":"2024-02-17T12:18:19.360165+0000","last_undegraded":"2024-02-17T12:18:19.360165+0000","last_fullsized":"2024-02-17T12:18:19.360165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:18:06.203775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344150+0000","last_change":"2024-02-17T12:18:02.803894+0000","last_active":"2024-02-17T12:18:19.344150+0000","last_peered":"2024-02-17T12:18:19.344150+0000","last_clean":"2024-02-17T12:18:19.344150+0000","last_became_active":"2024-02-17T12:18:02.803553+0000","last_became_peered":"2024-02-17T12:18:02.803553+0000","last_unstale":"2024-02-17T12:18:19.344150+0000","last_undegraded":"2024-02-17T12:18:19.344150+0000","last_fullsized":"2024-02-17T12:18:19.344150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:35:24.727572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330495+0000","last_change":"2024-02-17T12:18:01.789546+0000","last_active":"2024-02-17T12:18:19.330495+0000","last_peered":"2024-02-17T12:18:19.330495+0000","last_clean":"2024-02-17T12:18:19.330495+0000","last_became_active":"2024-02-17T12:18:01.789258+0000","last_became_peered":"2024-02-17T12:18:01.789258+0000","last_unstale":"2024-02-17T12:18:19.330495+0000","last_undegraded":"2024-02-17T12:18:19.330495+0000","last_fullsized":"2024-02-17T12:18:19.330495+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.325904+0000","last_change":"2024-02-17T12:18:18.325904+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.325904+0000","last_undegraded":"2024-02-17T12:18:18.325904+0000","last_fullsized":"2024-02-17T12:18:18.325904+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332167+0000","last_change":"2024-02-17T12:18:02.811327+0000","last_active":"2024-02-17T12:18:18.332167+0000","last_peered":"2024-02-17T12:18:18.332167+0000","last_clean":"2024-02-17T12:18:18.332167+0000","last_became_active":"2024-02-17T12:18:02.809620+0000","last_became_peered":"2024-02-17T12:18:02.809620+0000","last_unstale":"2024-02-17T12:18:18.332167+0000","last_undegraded":"2024-02-17T12:18:18.332167+0000","last_fullsized":"2024-02-17T12:18:18.332167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:40:08.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339073+0000","last_change":"2024-02-17T12:18:01.798265+0000","last_active":"2024-02-17T12:18:19.339073+0000","last_peered":"2024-02-17T12:18:19.339073+0000","last_clean":"2024-02-17T12:18:19.339073+0000","last_became_active":"2024-02-17T12:18:01.797931+0000","last_became_peered":"2024-02-17T12:18:01.797931+0000","last_unstale":"2024-02-17T12:18:19.339073+0000","last_undegraded":"2024-02-17T12:18:19.339073+0000","last_fullsized":"2024-02-17T12:18:19.339073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333949+0000","last_change":"2024-02-17T12:18:19.333949+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333949+0000","last_undegraded":"2024-02-17T12:18:19.333949+0000","last_fullsized":"2024-02-17T12:18:19.333949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343005+0000","last_change":"2024-02-17T12:18:19.339116+0000","last_active":"2024-02-17T12:18:19.343005+0000","last_peered":"2024-02-17T12:18:19.343005+0000","last_clean":"2024-02-17T12:18:19.343005+0000","last_became_active":"2024-02-17T12:18:19.338406+0000","last_became_peered":"2024-02-17T12:18:19.338406+0000","last_unstale":"2024-02-17T12:18:19.343005+0000","last_undegraded":"2024-02-17T12:18:19.343005+0000","last_fullsized":"2024-02-17T12:18:19.343005+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:11.400472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334099+0000","last_change":"2024-02-17T12:18:02.800381+0000","last_active":"2024-02-17T12:18:19.334099+0000","last_peered":"2024-02-17T12:18:19.334099+0000","last_clean":"2024-02-17T12:18:19.334099+0000","last_became_active":"2024-02-17T12:18:02.800042+0000","last_became_peered":"2024-02-17T12:18:02.800042+0000","last_unstale":"2024-02-17T12:18:19.334099+0000","last_undegraded":"2024-02-17T12:18:19.334099+0000","last_fullsized":"2024-02-17T12:18:19.334099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:27.558546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342497+0000","last_change":"2024-02-17T12:18:01.795914+0000","last_active":"2024-02-17T12:18:19.342497+0000","last_peered":"2024-02-17T12:18:19.342497+0000","last_clean":"2024-02-17T12:18:19.342497+0000","last_became_active":"2024-02-17T12:18:01.794847+0000","last_became_peered":"2024-02-17T12:18:01.794847+0000","last_unstale":"2024-02-17T12:18:19.342497+0000","last_undegraded":"2024-02-17T12:18:19.342497+0000","last_fullsized":"2024-02-17T12:18:19.342497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:31.320927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333047+0000","last_change":"2024-02-17T12:18:19.333047+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333047+0000","last_undegraded":"2024-02-17T12:18:19.333047+0000","last_fullsized":"2024-02-17T12:18:19.333047+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.357925+0000","last_change":"2024-02-17T12:18:19.352005+0000","last_active":"2024-02-17T12:18:19.357925+0000","last_peered":"2024-02-17T12:18:19.357925+0000","last_clean":"2024-02-17T12:18:19.357925+0000","last_became_active":"2024-02-17T12:18:19.351791+0000","last_became_peered":"2024-02-17T12:18:19.351791+0000","last_unstale":"2024-02-17T12:18:19.357925+0000","last_undegraded":"2024-02-17T12:18:19.357925+0000","last_fullsized":"2024-02-17T12:18:19.357925+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:19:04.346561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.337872+0000","last_change":"2024-02-17T12:18:02.807547+0000","last_active":"2024-02-17T12:18:19.337872+0000","last_peered":"2024-02-17T12:18:19.337872+0000","last_clean":"2024-02-17T12:18:19.337872+0000","last_became_active":"2024-02-17T12:18:02.807209+0000","last_became_peered":"2024-02-17T12:18:02.807209+0000","last_unstale":"2024-02-17T12:18:19.337872+0000","last_undegraded":"2024-02-17T12:18:19.337872+0000","last_fullsized":"2024-02-17T12:18:19.337872+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343944+0000","last_change":"2024-02-17T12:18:01.803848+0000","last_active":"2024-02-17T12:18:19.343944+0000","last_peered":"2024-02-17T12:18:19.343944+0000","last_clean":"2024-02-17T12:18:19.343944+0000","last_became_active":"2024-02-17T12:18:01.803552+0000","last_became_peered":"2024-02-17T12:18:01.803552+0000","last_unstale":"2024-02-17T12:18:19.343944+0000","last_undegraded":"2024-02-17T12:18:19.343944+0000","last_fullsized":"2024-02-17T12:18:19.343944+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:25:02.826927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339057+0000","last_change":"2024-02-17T12:18:19.339057+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339057+0000","last_undegraded":"2024-02-17T12:18:19.339057+0000","last_fullsized":"2024-02-17T12:18:19.339057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360064+0000","last_change":"2024-02-17T12:18:19.352308+0000","last_active":"2024-02-17T12:18:19.360064+0000","last_peered":"2024-02-17T12:18:19.360064+0000","last_clean":"2024-02-17T12:18:19.360064+0000","last_became_active":"2024-02-17T12:18:19.351363+0000","last_became_peered":"2024-02-17T12:18:19.351363+0000","last_unstale":"2024-02-17T12:18:19.360064+0000","last_undegraded":"2024-02-17T12:18:19.360064+0000","last_fullsized":"2024-02-17T12:18:19.360064+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:53:41.288869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340485+0000","last_change":"2024-02-17T12:18:02.811800+0000","last_active":"2024-02-17T12:18:19.340485+0000","last_peered":"2024-02-17T12:18:19.340485+0000","last_clean":"2024-02-17T12:18:19.340485+0000","last_became_active":"2024-02-17T12:18:02.811504+0000","last_became_peered":"2024-02-17T12:18:02.811504+0000","last_unstale":"2024-02-17T12:18:19.340485+0000","last_undegraded":"2024-02-17T12:18:19.340485+0000","last_fullsized":"2024-02-17T12:18:19.340485+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.331083+0000","last_change":"2024-02-17T12:18:01.800860+0000","last_active":"2024-02-17T12:18:19.331083+0000","last_peered":"2024-02-17T12:18:19.331083+0000","last_clean":"2024-02-17T12:18:19.331083+0000","last_became_active":"2024-02-17T12:18:01.800569+0000","last_became_peered":"2024-02-17T12:18:01.800569+0000","last_unstale":"2024-02-17T12:18:19.331083+0000","last_undegraded":"2024-02-17T12:18:19.331083+0000","last_fullsized":"2024-02-17T12:18:19.331083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331766+0000","last_change":"2024-02-17T12:18:18.331766+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331766+0000","last_undegraded":"2024-02-17T12:18:18.331766+0000","last_fullsized":"2024-02-17T12:18:18.331766+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333029+0000","last_change":"2024-02-17T12:18:02.812763+0000","last_active":"2024-02-17T12:18:19.333029+0000","last_peered":"2024-02-17T12:18:19.333029+0000","last_clean":"2024-02-17T12:18:19.333029+0000","last_became_active":"2024-02-17T12:18:02.812512+0000","last_became_peered":"2024-02-17T12:18:02.812512+0000","last_unstale":"2024-02-17T12:18:19.333029+0000","last_undegraded":"2024-02-17T12:18:19.333029+0000","last_fullsized":"2024-02-17T12:18:19.333029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345020+0000","last_change":"2024-02-17T12:18:01.805847+0000","last_active":"2024-02-17T12:18:19.345020+0000","last_peered":"2024-02-17T12:18:19.345020+0000","last_clean":"2024-02-17T12:18:19.345020+0000","last_became_active":"2024-02-17T12:18:01.805591+0000","last_became_peered":"2024-02-17T12:18:01.805591+0000","last_unstale":"2024-02-17T12:18:19.345020+0000","last_undegraded":"2024-02-17T12:18:19.345020+0000","last_fullsized":"2024-02-17T12:18:19.345020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:52:05.403651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.347869+0000","last_change":"2024-02-17T12:18:19.343966+0000","last_active":"2024-02-17T12:18:19.347869+0000","last_peered":"2024-02-17T12:18:19.347869+0000","last_clean":"2024-02-17T12:18:19.347869+0000","last_became_active":"2024-02-17T12:18:19.343701+0000","last_became_peered":"2024-02-17T12:18:19.343701+0000","last_unstale":"2024-02-17T12:18:19.347869+0000","last_undegraded":"2024-02-17T12:18:19.347869+0000","last_fullsized":"2024-02-17T12:18:19.347869+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:54:15.066782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334914+0000","last_change":"2024-02-17T12:18:02.809740+0000","last_active":"2024-02-17T12:18:19.334914+0000","last_peered":"2024-02-17T12:18:19.334914+0000","last_clean":"2024-02-17T12:18:19.334914+0000","last_became_active":"2024-02-17T12:18:02.809407+0000","last_became_peered":"2024-02-17T12:18:02.809407+0000","last_unstale":"2024-02-17T12:18:19.334914+0000","last_undegraded":"2024-02-17T12:18:19.334914+0000","last_fullsized":"2024-02-17T12:18:19.334914+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338398+0000","last_change":"2024-02-17T12:18:01.794714+0000","last_active":"2024-02-17T12:18:19.338398+0000","last_peered":"2024-02-17T12:18:19.338398+0000","last_clean":"2024-02-17T12:18:19.338398+0000","last_became_active":"2024-02-17T12:18:01.794439+0000","last_became_peered":"2024-02-17T12:18:01.794439+0000","last_unstale":"2024-02-17T12:18:19.338398+0000","last_undegraded":"2024-02-17T12:18:19.338398+0000","last_fullsized":"2024-02-17T12:18:19.338398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333665+0000","last_change":"2024-02-17T12:18:19.333665+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333665+0000","last_undegraded":"2024-02-17T12:18:19.333665+0000","last_fullsized":"2024-02-17T12:18:19.333665+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360140+0000","last_change":"2024-02-17T12:18:19.353264+0000","last_active":"2024-02-17T12:18:19.360140+0000","last_peered":"2024-02-17T12:18:19.360140+0000","last_clean":"2024-02-17T12:18:19.360140+0000","last_became_active":"2024-02-17T12:18:19.352997+0000","last_became_peered":"2024-02-17T12:18:19.352997+0000","last_unstale":"2024-02-17T12:18:19.360140+0000","last_undegraded":"2024-02-17T12:18:19.360140+0000","last_fullsized":"2024-02-17T12:18:19.360140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:43.352769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344465+0000","last_change":"2024-02-17T12:18:02.794702+0000","last_active":"2024-02-17T12:18:19.344465+0000","last_peered":"2024-02-17T12:18:19.344465+0000","last_clean":"2024-02-17T12:18:19.344465+0000","last_became_active":"2024-02-17T12:18:02.794412+0000","last_became_peered":"2024-02-17T12:18:02.794412+0000","last_unstale":"2024-02-17T12:18:19.344465+0000","last_undegraded":"2024-02-17T12:18:19.344465+0000","last_fullsized":"2024-02-17T12:18:19.344465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:05:00.914700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.347492+0000","last_change":"2024-02-17T12:18:01.800872+0000","last_active":"2024-02-17T12:18:19.347492+0000","last_peered":"2024-02-17T12:18:19.347492+0000","last_clean":"2024-02-17T12:18:19.347492+0000","last_became_active":"2024-02-17T12:18:01.800563+0000","last_became_peered":"2024-02-17T12:18:01.800563+0000","last_unstale":"2024-02-17T12:18:19.347492+0000","last_undegraded":"2024-02-17T12:18:19.347492+0000","last_fullsized":"2024-02-17T12:18:19.347492+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:28.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.331009+0000","last_change":"2024-02-17T12:18:19.331009+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.331009+0000","last_undegraded":"2024-02-17T12:18:19.331009+0000","last_fullsized":"2024-02-17T12:18:19.331009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.352419+0000","last_change":"2024-02-17T12:18:19.346074+0000","last_active":"2024-02-17T12:18:19.352419+0000","last_peered":"2024-02-17T12:18:19.352419+0000","last_clean":"2024-02-17T12:18:19.352419+0000","last_became_active":"2024-02-17T12:18:19.344987+0000","last_became_peered":"2024-02-17T12:18:19.344987+0000","last_unstale":"2024-02-17T12:18:19.352419+0000","last_undegraded":"2024-02-17T12:18:19.352419+0000","last_fullsized":"2024-02-17T12:18:19.352419+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:36:50.709873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338347+0000","last_change":"2024-02-17T12:18:02.806343+0000","last_active":"2024-02-17T12:18:19.338347+0000","last_peered":"2024-02-17T12:18:19.338347+0000","last_clean":"2024-02-17T12:18:19.338347+0000","last_became_active":"2024-02-17T12:18:02.805514+0000","last_became_peered":"2024-02-17T12:18:02.805514+0000","last_unstale":"2024-02-17T12:18:19.338347+0000","last_undegraded":"2024-02-17T12:18:19.338347+0000","last_fullsized":"2024-02-17T12:18:19.338347+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:46.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330930+0000","last_change":"2024-02-17T12:18:01.801897+0000","last_active":"2024-02-17T12:18:19.330930+0000","last_peered":"2024-02-17T12:18:19.330930+0000","last_clean":"2024-02-17T12:18:19.330930+0000","last_became_active":"2024-02-17T12:18:01.801572+0000","last_became_peered":"2024-02-17T12:18:01.801572+0000","last_unstale":"2024-02-17T12:18:19.330930+0000","last_undegraded":"2024-02-17T12:18:19.330930+0000","last_fullsized":"2024-02-17T12:18:19.330930+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340349+0000","last_change":"2024-02-17T12:18:19.340349+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340349+0000","last_undegraded":"2024-02-17T12:18:19.340349+0000","last_fullsized":"2024-02-17T12:18:19.340349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.325895+0000","last_change":"2024-02-17T12:18:18.325895+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.325895+0000","last_undegraded":"2024-02-17T12:18:18.325895+0000","last_fullsized":"2024-02-17T12:18:18.325895+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342026+0000","last_change":"2024-02-17T12:18:02.808806+0000","last_active":"2024-02-17T12:18:19.342026+0000","last_peered":"2024-02-17T12:18:19.342026+0000","last_clean":"2024-02-17T12:18:19.342026+0000","last_became_active":"2024-02-17T12:18:02.808546+0000","last_became_peered":"2024-02-17T12:18:02.808546+0000","last_unstale":"2024-02-17T12:18:19.342026+0000","last_undegraded":"2024-02-17T12:18:19.342026+0000","last_fullsized":"2024-02-17T12:18:19.342026+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:25.157077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344522+0000","last_change":"2024-02-17T12:18:01.798282+0000","last_active":"2024-02-17T12:18:19.344522+0000","last_peered":"2024-02-17T12:18:19.344522+0000","last_clean":"2024-02-17T12:18:19.344522+0000","last_became_active":"2024-02-17T12:18:01.797970+0000","last_became_peered":"2024-02-17T12:18:01.797970+0000","last_unstale":"2024-02-17T12:18:19.344522+0000","last_undegraded":"2024-02-17T12:18:19.344522+0000","last_fullsized":"2024-02-17T12:18:19.344522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:52:16.655449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339895+0000","last_change":"2024-02-17T12:18:19.339895+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339895+0000","last_undegraded":"2024-02-17T12:18:19.339895+0000","last_fullsized":"2024-02-17T12:18:19.339895+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.359996+0000","last_change":"2024-02-17T12:18:19.351990+0000","last_active":"2024-02-17T12:18:19.359996+0000","last_peered":"2024-02-17T12:18:19.359996+0000","last_clean":"2024-02-17T12:18:19.359996+0000","last_became_active":"2024-02-17T12:18:19.350808+0000","last_became_peered":"2024-02-17T12:18:19.350808+0000","last_unstale":"2024-02-17T12:18:19.359996+0000","last_undegraded":"2024-02-17T12:18:19.359996+0000","last_fullsized":"2024-02-17T12:18:19.359996+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:09.209961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332488+0000","last_change":"2024-02-17T12:18:02.808303+0000","last_active":"2024-02-17T12:18:18.332488+0000","last_peered":"2024-02-17T12:18:18.332488+0000","last_clean":"2024-02-17T12:18:18.332488+0000","last_became_active":"2024-02-17T12:18:02.807743+0000","last_became_peered":"2024-02-17T12:18:02.807743+0000","last_unstale":"2024-02-17T12:18:18.332488+0000","last_undegraded":"2024-02-17T12:18:18.332488+0000","last_fullsized":"2024-02-17T12:18:18.332488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:55.025562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328460+0000","last_change":"2024-02-17T12:18:01.802694+0000","last_active":"2024-02-17T12:18:18.328460+0000","last_peered":"2024-02-17T12:18:18.328460+0000","last_clean":"2024-02-17T12:18:18.328460+0000","last_became_active":"2024-02-17T12:18:01.802326+0000","last_became_peered":"2024-02-17T12:18:01.802326+0000","last_unstale":"2024-02-17T12:18:18.328460+0000","last_undegraded":"2024-02-17T12:18:18.328460+0000","last_fullsized":"2024-02-17T12:18:18.328460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:33:51.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331713+0000","last_change":"2024-02-17T12:18:18.331713+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331713+0000","last_undegraded":"2024-02-17T12:18:18.331713+0000","last_fullsized":"2024-02-17T12:18:18.331713+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340613+0000","last_change":"2024-02-17T12:18:02.805983+0000","last_active":"2024-02-17T12:18:19.340613+0000","last_peered":"2024-02-17T12:18:19.340613+0000","last_clean":"2024-02-17T12:18:19.340613+0000","last_became_active":"2024-02-17T12:18:02.805699+0000","last_became_peered":"2024-02-17T12:18:02.805699+0000","last_unstale":"2024-02-17T12:18:19.340613+0000","last_undegraded":"2024-02-17T12:18:19.340613+0000","last_fullsized":"2024-02-17T12:18:19.340613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:44.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341772+0000","last_change":"2024-02-17T12:18:01.801438+0000","last_active":"2024-02-17T12:18:19.341772+0000","last_peered":"2024-02-17T12:18:19.341772+0000","last_clean":"2024-02-17T12:18:19.341772+0000","last_became_active":"2024-02-17T12:18:01.801221+0000","last_became_peered":"2024-02-17T12:18:01.801221+0000","last_unstale":"2024-02-17T12:18:19.341772+0000","last_undegraded":"2024-02-17T12:18:19.341772+0000","last_fullsized":"2024-02-17T12:18:19.341772+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:09.649370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335807+0000","last_change":"2024-02-17T12:18:19.335807+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335807+0000","last_undegraded":"2024-02-17T12:18:19.335807+0000","last_fullsized":"2024-02-17T12:18:19.335807+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.353618+0000","last_change":"2024-02-17T12:18:19.350524+0000","last_active":"2024-02-17T12:18:19.353618+0000","last_peered":"2024-02-17T12:18:19.353618+0000","last_clean":"2024-02-17T12:18:19.353618+0000","last_became_active":"2024-02-17T12:18:19.350237+0000","last_became_peered":"2024-02-17T12:18:19.350237+0000","last_unstale":"2024-02-17T12:18:19.353618+0000","last_undegraded":"2024-02-17T12:18:19.353618+0000","last_fullsized":"2024-02-17T12:18:19.353618+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:28.434400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341774+0000","last_change":"2024-02-17T12:18:02.806745+0000","last_active":"2024-02-17T12:18:19.341774+0000","last_peered":"2024-02-17T12:18:19.341774+0000","last_clean":"2024-02-17T12:18:19.341774+0000","last_became_active":"2024-02-17T12:18:02.806429+0000","last_became_peered":"2024-02-17T12:18:02.806429+0000","last_unstale":"2024-02-17T12:18:19.341774+0000","last_undegraded":"2024-02-17T12:18:19.341774+0000","last_fullsized":"2024-02-17T12:18:19.341774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:58.938533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338923+0000","last_change":"2024-02-17T12:18:01.793256+0000","last_active":"2024-02-17T12:18:19.338923+0000","last_peered":"2024-02-17T12:18:19.338923+0000","last_clean":"2024-02-17T12:18:19.338923+0000","last_became_active":"2024-02-17T12:18:01.793033+0000","last_became_peered":"2024-02-17T12:18:01.793033+0000","last_unstale":"2024-02-17T12:18:19.338923+0000","last_undegraded":"2024-02-17T12:18:19.338923+0000","last_fullsized":"2024-02-17T12:18:19.338923+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:46.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332591+0000","last_change":"2024-02-17T12:18:19.332591+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332591+0000","last_undegraded":"2024-02-17T12:18:19.332591+0000","last_fullsized":"2024-02-17T12:18:19.332591+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355617+0000","last_change":"2024-02-17T12:18:19.349950+0000","last_active":"2024-02-17T12:18:19.355617+0000","last_peered":"2024-02-17T12:18:19.355617+0000","last_clean":"2024-02-17T12:18:19.355617+0000","last_became_active":"2024-02-17T12:18:19.349690+0000","last_became_peered":"2024-02-17T12:18:19.349690+0000","last_unstale":"2024-02-17T12:18:19.355617+0000","last_undegraded":"2024-02-17T12:18:19.355617+0000","last_fullsized":"2024-02-17T12:18:19.355617+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:49.360736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338823+0000","last_change":"2024-02-17T12:18:02.800813+0000","last_active":"2024-02-17T12:18:19.338823+0000","last_peered":"2024-02-17T12:18:19.338823+0000","last_clean":"2024-02-17T12:18:19.338823+0000","last_became_active":"2024-02-17T12:18:02.800551+0000","last_became_peered":"2024-02-17T12:18:02.800551+0000","last_unstale":"2024-02-17T12:18:19.338823+0000","last_undegraded":"2024-02-17T12:18:19.338823+0000","last_fullsized":"2024-02-17T12:18:19.338823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:47:58.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345656+0000","last_change":"2024-02-17T12:18:01.796062+0000","last_active":"2024-02-17T12:18:19.345656+0000","last_peered":"2024-02-17T12:18:19.345656+0000","last_clean":"2024-02-17T12:18:19.345656+0000","last_became_active":"2024-02-17T12:18:01.795616+0000","last_became_peered":"2024-02-17T12:18:01.795616+0000","last_unstale":"2024-02-17T12:18:19.345656+0000","last_undegraded":"2024-02-17T12:18:19.345656+0000","last_fullsized":"2024-02-17T12:18:19.345656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:04:59.908240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332342+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:18:18.332342+0000","last_peered":"2024-02-17T12:18:18.332342+0000","last_clean":"2024-02-17T12:18:18.332342+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:18:18.332342+0000","last_undegraded":"2024-02-17T12:18:18.332342+0000","last_fullsized":"2024-02-17T12:18:18.332342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":5},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509468,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":254820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88700000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":1.115,"15min":1.115},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88500000000000001,"5min":1.143,"15min":1.143},"last":0.76800000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88700000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.90800000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.02},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.0049999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0669999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":622592,"data_stored":262602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.378}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.439},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.66800000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":262006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.44},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.621,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":1.387,"15min":1.387},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.497,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.714,"15min":1.714},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.744,"15min":1.744},"last":0.90200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91500000000000004,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.91600000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.002,"5min":1.575,"15min":1.575},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96899999999999997,"5min":1.321,"15min":1.321},"last":0.95099999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":262040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64200000000000002,"5min":1.145,"15min":1.145},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.34000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69499999999999995,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58099999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73799999999999999,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":2.609,"15min":2.609},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.079,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.90700000000000003,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.997,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.05,"5min":1.095,"15min":1.095},"last":0.70299999999999996}]},{"osd":6,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0469999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0820000000000001,"5min":5.375,"15min":5.375},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":1.0169999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.091,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.629,"15min":1.629},"last":0.72499999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1224704,"data_stored":856015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47899999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45900000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45100000000000001,"15min":0.45700000000000002},"min":{"1min":0.312,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":1.046,"15min":1.046},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.58699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0129999999999999,"5min":1.139,"15min":1.139},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92800000000000005,"5min":1.038,"15min":1.038},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94499999999999995,"5min":1.095,"15min":1.095},"last":0.746}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0960000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90200000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.84499999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1204224,"data_stored":845348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84899999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.73099999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75700000000000001,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92400000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.79800000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90000000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.38500000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86799999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.43099999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95099999999999996,"5min":1.052,"15min":1.052},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.40899999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":614400,"data_stored":257935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86799999999999999,"5min":1.264,"15min":1.264},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.198,"15min":1.198},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.171,"15min":1.171},"last":0.65900000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.745},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93600000000000005,"5min":1.522,"15min":1.522},"last":0.69299999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89900000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70299999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88100000000000001,"5min":1.228,"15min":1.228},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.68300000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":254876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.434},{"interface":"front","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.141,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93300000000000005,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.58199999999999996}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2749999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.997,"5min":1.252,"15min":1.252},"last":0.55400000000000005}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91500000000000004,"5min":1.29,"15min":1.29},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":1.337,"15min":1.337},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:18:24.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:18:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cf4e00640 1 Processor -- start 2024-02-17T12:18:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cf4e00640 1 -- start start 2024-02-17T12:18:25.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cf4e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1cf00c46b0 0x7f1cf00728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cf4e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1cf0156850 0x7f1cf014c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cf4e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf00c1ef0 con 0x7f1cf006ed80 2024-02-17T12:18:25.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cf4e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf0153600 con 0x7f1cf00c46b0 2024-02-17T12:18:25.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cf4e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00c3190 con 0x7f1cf0156850 2024-02-17T12:18:25.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cede00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1cf00c46b0 0x7f1cf00728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cede00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1cf00c46b0 0x7f1cf00728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35562/0 (socket says 172.21.15.114:35562) 2024-02-17T12:18:25.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cede00640 1 -- 172.21.15.114:0/1391803544 learned_addr learned my addr 172.21.15.114:0/1391803544 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:25.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cee800640 1 --2- 172.21.15.114:0/1391803544 >> v2:172.21.15.116:3300/0 conn(0x7f1cf0156850 0x7f1cf014c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cede00640 1 -- 172.21.15.114:0/1391803544 >> v2:172.21.15.116:3300/0 conn(0x7f1cf0156850 msgr2=0x7f1cf014c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:25.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cede00640 1 --2- 172.21.15.114:0/1391803544 >> v2:172.21.15.116:3300/0 conn(0x7f1cf0156850 0x7f1cf014c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cede00640 1 -- 172.21.15.114:0/1391803544 >> v1:172.21.15.116:6789/0 conn(0x7f1cf006ed80 legacy=0x7f1cf0156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:24.997+0000 7f1cede00640 1 -- 172.21.15.114:0/1391803544 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf00aa190 con 0x7f1cf00c46b0 2024-02-17T12:18:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1cede00640 1 --2- 172.21.15.114:0/1391803544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf00c46b0 0x7f1cf00728c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00acc70 tx=0x7f1ce001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5018abc7470a16ed server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:25.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1ceca00640 1 -- 172.21.15.114:0/1391803544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00aa650 con 0x7f1cf00c46b0 2024-02-17T12:18:25.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1ceca00640 1 -- 172.21.15.114:0/1391803544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce00aa7b0 con 0x7f1cf00c46b0 2024-02-17T12:18:25.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1ceca00640 1 -- 172.21.15.114:0/1391803544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00aab40 con 0x7f1cf00c46b0 2024-02-17T12:18:25.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1cf4e00640 1 -- 172.21.15.114:0/1391803544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf00c46b0 msgr2=0x7f1cf00728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1cf4e00640 1 --2- 172.21.15.114:0/1391803544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf00c46b0 0x7f1cf00728c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00acc70 tx=0x7f1ce001c4f0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1cf4e00640 1 -- 172.21.15.114:0/1391803544 shutdown_connections 2024-02-17T12:18:25.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1cf4e00640 1 --2- 172.21.15.114:0/1391803544 >> v2:172.21.15.116:3300/0 conn(0x7f1cf0156850 0x7f1cf014c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1cf4e00640 1 --2- 172.21.15.114:0/1391803544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf00c46b0 0x7f1cf00728c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1cf4e00640 1 -- 172.21.15.114:0/1391803544 >> 172.21.15.114:0/1391803544 conn(0x7f1cf006bef0 msgr2=0x7f1cf006c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:25.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1cf4e00640 1 -- 172.21.15.114:0/1391803544 shutdown_connections 2024-02-17T12:18:25.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.001+0000 7f1cf4e00640 1 -- 172.21.15.114:0/1391803544 wait complete. 2024-02-17T12:18:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 Processor -- start 2024-02-17T12:18:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 -- start start 2024-02-17T12:18:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf006ed80 0x7f1cf01517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cf00c46b0 0x7f1cf0150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1cf0156850 0x7f1cf01eb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf01eb570 con 0x7f1cf006ed80 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00bc510 con 0x7f1cf00c46b0 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf01eeec0 con 0x7f1cf0156850 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf006ed80 0x7f1cf01517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf006ed80 0x7f1cf01517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35568/0 (socket says 172.21.15.114:35568) 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cede00640 1 -- 172.21.15.114:0/197164853 learned_addr learned my addr 172.21.15.114:0/197164853 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1ced400640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cf00c46b0 0x7f1cf0150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cee800640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1cf0156850 0x7f1cf01eb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cede00640 1 -- 172.21.15.114:0/197164853 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1cf0156850 msgr2=0x7f1cf01eb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cede00640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1cf0156850 0x7f1cf01eb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cede00640 1 -- 172.21.15.114:0/197164853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cf00c46b0 msgr2=0x7f1cf0150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cede00640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cf00c46b0 0x7f1cf0150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cede00640 1 -- 172.21.15.114:0/197164853 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce00094d0 con 0x7f1cf006ed80 2024-02-17T12:18:25.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1ced400640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cf00c46b0 0x7f1cf0150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cede00640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf006ed80 0x7f1cf01517d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00ac040 tx=0x7f1ce001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1ce6000640 1 -- 172.21.15.114:0/197164853 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00b3800 con 0x7f1cf006ed80 2024-02-17T12:18:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1ce6000640 1 -- 172.21.15.114:0/197164853 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce00b3980 con 0x7f1cf006ed80 2024-02-17T12:18:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1ce6000640 1 -- 172.21.15.114:0/197164853 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00b3d30 con 0x7f1cf006ed80 2024-02-17T12:18:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 -- 172.21.15.114:0/197164853 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf01ef1a0 con 0x7f1cf006ed80 2024-02-17T12:18:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 -- 172.21.15.114:0/197164853 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf01ef760 con 0x7f1cf006ed80 2024-02-17T12:18:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.005+0000 7f1cf4e00640 1 -- 172.21.15.114:0/197164853 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf0067370 con 0x7f1cf006ed80 2024-02-17T12:18:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.009+0000 7f1ce6000640 1 -- 172.21.15.114:0/197164853 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1ce00c6390 con 0x7f1cf006ed80 2024-02-17T12:18:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.009+0000 7f1ce6000640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1cd0066e40 0x7f1cd0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.009+0000 7f1ce6000640 1 -- 172.21.15.114:0/197164853 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1ce011f8d0 con 0x7f1cf006ed80 2024-02-17T12:18:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.009+0000 7f1ced400640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1cd0066e40 0x7f1cd0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.009+0000 7f1ced400640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1cd0066e40 0x7f1cd0069300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1cf006fc60 tx=0x7f1cdc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:25.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.013+0000 7f1ce6000640 1 -- 172.21.15.114:0/197164853 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1ce00ec370 con 0x7f1cf006ed80 2024-02-17T12:18:25.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.165+0000 7f1cf4e00640 1 -- 172.21.15.114:0/197164853 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1cf006ff40 con 0x7f1cd0066e40 2024-02-17T12:18:25.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.177+0000 7f1ce6000640 1 -- 172.21.15.114:0/197164853 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+520265 (secure 0 0 0) 0x7f1cf006ff40 con 0x7f1cd0066e40 2024-02-17T12:18:25.187 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:25.190 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:18:25.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 -- 172.21.15.114:0/197164853 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1cd0066e40 msgr2=0x7f1cd0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1cd0066e40 0x7f1cd0069300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1cf006fc60 tx=0x7f1cdc009040 comp rx=0 tx=0).stop 2024-02-17T12:18:25.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 -- 172.21.15.114:0/197164853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf006ed80 msgr2=0x7f1cf01517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf006ed80 0x7f1cf01517d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00ac040 tx=0x7f1ce001ad30 comp rx=0 tx=0).stop 2024-02-17T12:18:25.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 -- 172.21.15.114:0/197164853 shutdown_connections 2024-02-17T12:18:25.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1cf0156850 0x7f1cf01eb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cf00c46b0 0x7f1cf0150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1cd0066e40 0x7f1cd0069300 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 --2- 172.21.15.114:0/197164853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1cf006ed80 0x7f1cf01517d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 -- 172.21.15.114:0/197164853 >> 172.21.15.114:0/197164853 conn(0x7f1cf006bef0 msgr2=0x7f1cf015dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:25.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 -- 172.21.15.114:0/197164853 shutdown_connections 2024-02-17T12:18:25.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.185+0000 7f1cf4e00640 1 -- 172.21.15.114:0/197164853 wait complete. 2024-02-17T12:18:25.206 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-02-17T12:18:23.241617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594281,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":328,"acting":328,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230472,"kb_used_data":5976,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744248,"statfs":{"total":773094113280,"available":772858109952,"internally_reserved":0,"allocated":6119424,"data_stored":3255642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1245,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.918288"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.337103+0000","last_change":"2024-02-17T12:18:19.337103+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.337103+0000","last_undegraded":"2024-02-17T12:18:19.337103+0000","last_fullsized":"2024-02-17T12:18:19.337103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333598+0000","last_change":"2024-02-17T12:18:02.804326+0000","last_active":"2024-02-17T12:18:18.333598+0000","last_peered":"2024-02-17T12:18:18.333598+0000","last_clean":"2024-02-17T12:18:18.333598+0000","last_became_active":"2024-02-17T12:18:02.804074+0000","last_became_peered":"2024-02-17T12:18:02.804074+0000","last_unstale":"2024-02-17T12:18:18.333598+0000","last_undegraded":"2024-02-17T12:18:18.333598+0000","last_fullsized":"2024-02-17T12:18:18.333598+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:47.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.341116+0000","last_change":"2024-02-17T12:18:19.341116+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.341116+0000","last_undegraded":"2024-02-17T12:18:19.341116+0000","last_fullsized":"2024-02-17T12:18:19.341116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342702+0000","last_change":"2024-02-17T12:18:02.808706+0000","last_active":"2024-02-17T12:18:19.342702+0000","last_peered":"2024-02-17T12:18:19.342702+0000","last_clean":"2024-02-17T12:18:19.342702+0000","last_became_active":"2024-02-17T12:18:02.808520+0000","last_became_peered":"2024-02-17T12:18:02.808520+0000","last_unstale":"2024-02-17T12:18:19.342702+0000","last_undegraded":"2024-02-17T12:18:19.342702+0000","last_fullsized":"2024-02-17T12:18:19.342702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:27.642044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.331952+0000","last_change":"2024-02-17T12:18:02.807196+0000","last_active":"2024-02-17T12:18:18.331952+0000","last_peered":"2024-02-17T12:18:18.331952+0000","last_clean":"2024-02-17T12:18:18.331952+0000","last_became_active":"2024-02-17T12:18:02.806894+0000","last_became_peered":"2024-02-17T12:18:02.806894+0000","last_unstale":"2024-02-17T12:18:18.331952+0000","last_undegraded":"2024-02-17T12:18:18.331952+0000","last_fullsized":"2024-02-17T12:18:18.331952+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:12.749708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335776+0000","last_change":"2024-02-17T12:18:19.335776+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335776+0000","last_undegraded":"2024-02-17T12:18:19.335776+0000","last_fullsized":"2024-02-17T12:18:19.335776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.329620+0000","last_change":"2024-02-17T12:18:02.814770+0000","last_active":"2024-02-17T12:18:19.329620+0000","last_peered":"2024-02-17T12:18:19.329620+0000","last_clean":"2024-02-17T12:18:19.329620+0000","last_became_active":"2024-02-17T12:18:02.809466+0000","last_became_peered":"2024-02-17T12:18:02.809466+0000","last_unstale":"2024-02-17T12:18:19.329620+0000","last_undegraded":"2024-02-17T12:18:19.329620+0000","last_fullsized":"2024-02-17T12:18:19.329620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332409+0000","last_change":"2024-02-17T12:18:19.332409+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332409+0000","last_undegraded":"2024-02-17T12:18:19.332409+0000","last_fullsized":"2024-02-17T12:18:19.332409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332653+0000","last_change":"2024-02-17T12:18:02.802996+0000","last_active":"2024-02-17T12:18:18.332653+0000","last_peered":"2024-02-17T12:18:18.332653+0000","last_clean":"2024-02-17T12:18:18.332653+0000","last_became_active":"2024-02-17T12:18:02.802690+0000","last_became_peered":"2024-02-17T12:18:02.802690+0000","last_unstale":"2024-02-17T12:18:18.332653+0000","last_undegraded":"2024-02-17T12:18:18.332653+0000","last_fullsized":"2024-02-17T12:18:18.332653+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:59.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339125+0000","last_change":"2024-02-17T12:18:19.339125+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339125+0000","last_undegraded":"2024-02-17T12:18:19.339125+0000","last_fullsized":"2024-02-17T12:18:19.339125+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339236+0000","last_change":"2024-02-17T12:18:02.812986+0000","last_active":"2024-02-17T12:18:19.339236+0000","last_peered":"2024-02-17T12:18:19.339236+0000","last_clean":"2024-02-17T12:18:19.339236+0000","last_became_active":"2024-02-17T12:18:02.809576+0000","last_became_peered":"2024-02-17T12:18:02.809576+0000","last_unstale":"2024-02-17T12:18:19.339236+0000","last_undegraded":"2024-02-17T12:18:19.339236+0000","last_fullsized":"2024-02-17T12:18:19.339236+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328210+0000","last_change":"2024-02-17T12:18:02.799654+0000","last_active":"2024-02-17T12:18:18.328210+0000","last_peered":"2024-02-17T12:18:18.328210+0000","last_clean":"2024-02-17T12:18:18.328210+0000","last_became_active":"2024-02-17T12:18:02.799356+0000","last_became_peered":"2024-02-17T12:18:02.799356+0000","last_unstale":"2024-02-17T12:18:18.328210+0000","last_undegraded":"2024-02-17T12:18:18.328210+0000","last_fullsized":"2024-02-17T12:18:18.328210+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:29.710017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340431+0000","last_change":"2024-02-17T12:18:19.340431+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340431+0000","last_undegraded":"2024-02-17T12:18:19.340431+0000","last_fullsized":"2024-02-17T12:18:19.340431+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339634+0000","last_change":"2024-02-17T12:18:02.800189+0000","last_active":"2024-02-17T12:18:19.339634+0000","last_peered":"2024-02-17T12:18:19.339634+0000","last_clean":"2024-02-17T12:18:19.339634+0000","last_became_active":"2024-02-17T12:18:02.799866+0000","last_became_peered":"2024-02-17T12:18:02.799866+0000","last_unstale":"2024-02-17T12:18:19.339634+0000","last_undegraded":"2024-02-17T12:18:19.339634+0000","last_fullsized":"2024-02-17T12:18:19.339634+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:52.152034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328951+0000","last_change":"2024-02-17T12:18:02.794591+0000","last_active":"2024-02-17T12:18:18.328951+0000","last_peered":"2024-02-17T12:18:18.328951+0000","last_clean":"2024-02-17T12:18:18.328951+0000","last_became_active":"2024-02-17T12:18:02.794309+0000","last_became_peered":"2024-02-17T12:18:02.794309+0000","last_unstale":"2024-02-17T12:18:18.328951+0000","last_undegraded":"2024-02-17T12:18:18.328951+0000","last_fullsized":"2024-02-17T12:18:18.328951+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:18.132994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.342320+0000","last_change":"2024-02-17T12:18:19.342320+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.342320+0000","last_undegraded":"2024-02-17T12:18:19.342320+0000","last_fullsized":"2024-02-17T12:18:19.342320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344227+0000","last_change":"2024-02-17T12:18:02.802586+0000","last_active":"2024-02-17T12:18:19.344227+0000","last_peered":"2024-02-17T12:18:19.344227+0000","last_clean":"2024-02-17T12:18:19.344227+0000","last_became_active":"2024-02-17T12:18:02.802328+0000","last_became_peered":"2024-02-17T12:18:02.802328+0000","last_unstale":"2024-02-17T12:18:19.344227+0000","last_undegraded":"2024-02-17T12:18:19.344227+0000","last_fullsized":"2024-02-17T12:18:19.344227+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:30.894335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344849+0000","last_change":"2024-02-17T12:18:02.803729+0000","last_active":"2024-02-17T12:18:19.344849+0000","last_peered":"2024-02-17T12:18:19.344849+0000","last_clean":"2024-02-17T12:18:19.344849+0000","last_became_active":"2024-02-17T12:18:02.803504+0000","last_became_peered":"2024-02-17T12:18:02.803504+0000","last_unstale":"2024-02-17T12:18:19.344849+0000","last_undegraded":"2024-02-17T12:18:19.344849+0000","last_fullsized":"2024-02-17T12:18:19.344849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:50.631061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330710+0000","last_change":"2024-02-17T12:18:02.814562+0000","last_active":"2024-02-17T12:18:19.330710+0000","last_peered":"2024-02-17T12:18:19.330710+0000","last_clean":"2024-02-17T12:18:19.330710+0000","last_became_active":"2024-02-17T12:18:02.809011+0000","last_became_peered":"2024-02-17T12:18:02.809011+0000","last_unstale":"2024-02-17T12:18:19.330710+0000","last_undegraded":"2024-02-17T12:18:19.330710+0000","last_fullsized":"2024-02-17T12:18:19.330710+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335567+0000","last_change":"2024-02-17T12:18:19.335567+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335567+0000","last_undegraded":"2024-02-17T12:18:19.335567+0000","last_fullsized":"2024-02-17T12:18:19.335567+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345668+0000","last_change":"2024-02-17T12:18:02.800228+0000","last_active":"2024-02-17T12:18:19.345668+0000","last_peered":"2024-02-17T12:18:19.345668+0000","last_clean":"2024-02-17T12:18:19.345668+0000","last_became_active":"2024-02-17T12:18:02.799965+0000","last_became_peered":"2024-02-17T12:18:02.799965+0000","last_unstale":"2024-02-17T12:18:19.345668+0000","last_undegraded":"2024-02-17T12:18:19.345668+0000","last_fullsized":"2024-02-17T12:18:19.345668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:05.435817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328399+0000","last_change":"2024-02-17T12:18:02.798437+0000","last_active":"2024-02-17T12:18:18.328399+0000","last_peered":"2024-02-17T12:18:18.328399+0000","last_clean":"2024-02-17T12:18:18.328399+0000","last_became_active":"2024-02-17T12:18:02.798145+0000","last_became_peered":"2024-02-17T12:18:02.798145+0000","last_unstale":"2024-02-17T12:18:18.328399+0000","last_undegraded":"2024-02-17T12:18:18.328399+0000","last_fullsized":"2024-02-17T12:18:18.328399+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:29.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332924+0000","last_change":"2024-02-17T12:18:19.332924+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332924+0000","last_undegraded":"2024-02-17T12:18:19.332924+0000","last_fullsized":"2024-02-17T12:18:19.332924+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328351+0000","last_change":"2024-02-17T12:18:02.797013+0000","last_active":"2024-02-17T12:18:18.328351+0000","last_peered":"2024-02-17T12:18:18.328351+0000","last_clean":"2024-02-17T12:18:18.328351+0000","last_became_active":"2024-02-17T12:18:02.796734+0000","last_became_peered":"2024-02-17T12:18:02.796734+0000","last_unstale":"2024-02-17T12:18:18.328351+0000","last_undegraded":"2024-02-17T12:18:18.328351+0000","last_fullsized":"2024-02-17T12:18:18.328351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:32.566741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.336921+0000","last_change":"2024-02-17T12:18:02.809976+0000","last_active":"2024-02-17T12:18:19.336921+0000","last_peered":"2024-02-17T12:18:19.336921+0000","last_clean":"2024-02-17T12:18:19.336921+0000","last_became_active":"2024-02-17T12:18:02.809645+0000","last_became_peered":"2024-02-17T12:18:02.809645+0000","last_unstale":"2024-02-17T12:18:19.336921+0000","last_undegraded":"2024-02-17T12:18:19.336921+0000","last_fullsized":"2024-02-17T12:18:19.336921+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340057+0000","last_change":"2024-02-17T12:18:19.340057+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340057+0000","last_undegraded":"2024-02-17T12:18:19.340057+0000","last_fullsized":"2024-02-17T12:18:19.340057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343660+0000","last_change":"2024-02-17T12:18:02.807700+0000","last_active":"2024-02-17T12:18:19.343660+0000","last_peered":"2024-02-17T12:18:19.343660+0000","last_clean":"2024-02-17T12:18:19.343660+0000","last_became_active":"2024-02-17T12:18:02.805575+0000","last_became_peered":"2024-02-17T12:18:02.805575+0000","last_unstale":"2024-02-17T12:18:19.343660+0000","last_undegraded":"2024-02-17T12:18:19.343660+0000","last_fullsized":"2024-02-17T12:18:19.343660+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:52:33.882315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333193+0000","last_change":"2024-02-17T12:18:19.333193+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333193+0000","last_undegraded":"2024-02-17T12:18:19.333193+0000","last_fullsized":"2024-02-17T12:18:19.333193+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333106+0000","last_change":"2024-02-17T12:18:02.809074+0000","last_active":"2024-02-17T12:18:18.333106+0000","last_peered":"2024-02-17T12:18:18.333106+0000","last_clean":"2024-02-17T12:18:18.333106+0000","last_became_active":"2024-02-17T12:18:02.808683+0000","last_became_peered":"2024-02-17T12:18:02.808683+0000","last_unstale":"2024-02-17T12:18:18.333106+0000","last_undegraded":"2024-02-17T12:18:18.333106+0000","last_fullsized":"2024-02-17T12:18:18.333106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:46:21.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333344+0000","last_change":"2024-02-17T12:18:02.803587+0000","last_active":"2024-02-17T12:18:18.333344+0000","last_peered":"2024-02-17T12:18:18.333344+0000","last_clean":"2024-02-17T12:18:18.333344+0000","last_became_active":"2024-02-17T12:18:02.803312+0000","last_became_peered":"2024-02-17T12:18:02.803312+0000","last_unstale":"2024-02-17T12:18:18.333344+0000","last_undegraded":"2024-02-17T12:18:18.333344+0000","last_fullsized":"2024-02-17T12:18:18.333344+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:54:01.696616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.342713+0000","last_change":"2024-02-17T12:18:19.342713+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.342713+0000","last_undegraded":"2024-02-17T12:18:19.342713+0000","last_fullsized":"2024-02-17T12:18:19.342713+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343993+0000","last_change":"2024-02-17T12:18:02.815782+0000","last_active":"2024-02-17T12:18:19.343993+0000","last_peered":"2024-02-17T12:18:19.343993+0000","last_clean":"2024-02-17T12:18:19.343993+0000","last_became_active":"2024-02-17T12:18:02.815537+0000","last_became_peered":"2024-02-17T12:18:02.815537+0000","last_unstale":"2024-02-17T12:18:19.343993+0000","last_undegraded":"2024-02-17T12:18:19.343993+0000","last_fullsized":"2024-02-17T12:18:19.343993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:23.114440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332256+0000","last_change":"2024-02-17T12:18:02.809894+0000","last_active":"2024-02-17T12:18:18.332256+0000","last_peered":"2024-02-17T12:18:18.332256+0000","last_clean":"2024-02-17T12:18:18.332256+0000","last_became_active":"2024-02-17T12:18:02.807451+0000","last_became_peered":"2024-02-17T12:18:02.807451+0000","last_unstale":"2024-02-17T12:18:18.332256+0000","last_undegraded":"2024-02-17T12:18:18.332256+0000","last_fullsized":"2024-02-17T12:18:18.332256+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:05:50.249065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341901+0000","last_change":"2024-02-17T12:18:02.813079+0000","last_active":"2024-02-17T12:18:19.341901+0000","last_peered":"2024-02-17T12:18:19.341901+0000","last_clean":"2024-02-17T12:18:19.341901+0000","last_became_active":"2024-02-17T12:18:02.810630+0000","last_became_peered":"2024-02-17T12:18:02.810630+0000","last_unstale":"2024-02-17T12:18:19.341901+0000","last_undegraded":"2024-02-17T12:18:19.341901+0000","last_fullsized":"2024-02-17T12:18:19.341901+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:32:22.683974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332679+0000","last_change":"2024-02-17T12:18:02.807916+0000","last_active":"2024-02-17T12:18:18.332679+0000","last_peered":"2024-02-17T12:18:18.332679+0000","last_clean":"2024-02-17T12:18:18.332679+0000","last_became_active":"2024-02-17T12:18:02.806754+0000","last_became_peered":"2024-02-17T12:18:02.806754+0000","last_unstale":"2024-02-17T12:18:18.332679+0000","last_undegraded":"2024-02-17T12:18:18.332679+0000","last_fullsized":"2024-02-17T12:18:18.332679+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.985986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346146+0000","last_change":"2024-02-17T12:18:02.805691+0000","last_active":"2024-02-17T12:18:19.346146+0000","last_peered":"2024-02-17T12:18:19.346146+0000","last_clean":"2024-02-17T12:18:19.346146+0000","last_became_active":"2024-02-17T12:18:02.805396+0000","last_became_peered":"2024-02-17T12:18:02.805396+0000","last_unstale":"2024-02-17T12:18:19.346146+0000","last_undegraded":"2024-02-17T12:18:19.346146+0000","last_fullsized":"2024-02-17T12:18:19.346146+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:09:34.480729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.336674+0000","last_change":"2024-02-17T12:18:19.336674+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.336674+0000","last_undegraded":"2024-02-17T12:18:19.336674+0000","last_fullsized":"2024-02-17T12:18:19.336674+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333690+0000","last_change":"2024-02-17T12:18:02.798267+0000","last_active":"2024-02-17T12:18:18.333690+0000","last_peered":"2024-02-17T12:18:18.333690+0000","last_clean":"2024-02-17T12:18:18.333690+0000","last_became_active":"2024-02-17T12:18:02.797624+0000","last_became_peered":"2024-02-17T12:18:02.797624+0000","last_unstale":"2024-02-17T12:18:18.333690+0000","last_undegraded":"2024-02-17T12:18:18.333690+0000","last_fullsized":"2024-02-17T12:18:18.333690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:17:06.691178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.332906+0000","last_change":"2024-02-17T12:18:02.802532+0000","last_active":"2024-02-17T12:18:19.332906+0000","last_peered":"2024-02-17T12:18:19.332906+0000","last_clean":"2024-02-17T12:18:19.332906+0000","last_became_active":"2024-02-17T12:18:02.801766+0000","last_became_peered":"2024-02-17T12:18:02.801766+0000","last_unstale":"2024-02-17T12:18:19.332906+0000","last_undegraded":"2024-02-17T12:18:19.332906+0000","last_fullsized":"2024-02-17T12:18:19.332906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338177+0000","last_change":"2024-02-17T12:18:02.797999+0000","last_active":"2024-02-17T12:18:19.338177+0000","last_peered":"2024-02-17T12:18:19.338177+0000","last_clean":"2024-02-17T12:18:19.338177+0000","last_became_active":"2024-02-17T12:18:02.797710+0000","last_became_peered":"2024-02-17T12:18:02.797710+0000","last_unstale":"2024-02-17T12:18:19.338177+0000","last_undegraded":"2024-02-17T12:18:19.338177+0000","last_fullsized":"2024-02-17T12:18:19.338177+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332446+0000","last_change":"2024-02-17T12:18:19.332446+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332446+0000","last_undegraded":"2024-02-17T12:18:19.332446+0000","last_fullsized":"2024-02-17T12:18:19.332446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333297+0000","last_change":"2024-02-17T12:18:02.804711+0000","last_active":"2024-02-17T12:18:18.333297+0000","last_peered":"2024-02-17T12:18:18.333297+0000","last_clean":"2024-02-17T12:18:18.333297+0000","last_became_active":"2024-02-17T12:18:02.804459+0000","last_became_peered":"2024-02-17T12:18:02.804459+0000","last_unstale":"2024-02-17T12:18:18.333297+0000","last_undegraded":"2024-02-17T12:18:18.333297+0000","last_fullsized":"2024-02-17T12:18:18.333297+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:47.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.329892+0000","last_change":"2024-02-17T12:18:19.329892+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.329892+0000","last_undegraded":"2024-02-17T12:18:19.329892+0000","last_fullsized":"2024-02-17T12:18:19.329892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342440+0000","last_change":"2024-02-17T12:18:02.802524+0000","last_active":"2024-02-17T12:18:19.342440+0000","last_peered":"2024-02-17T12:18:19.342440+0000","last_clean":"2024-02-17T12:18:19.342440+0000","last_became_active":"2024-02-17T12:18:02.802045+0000","last_became_peered":"2024-02-17T12:18:02.802045+0000","last_unstale":"2024-02-17T12:18:19.342440+0000","last_undegraded":"2024-02-17T12:18:19.342440+0000","last_fullsized":"2024-02-17T12:18:19.342440+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:06:03.414827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335592+0000","last_change":"2024-02-17T12:18:19.335592+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335592+0000","last_undegraded":"2024-02-17T12:18:19.335592+0000","last_fullsized":"2024-02-17T12:18:19.335592+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332116+0000","last_change":"2024-02-17T12:18:02.807169+0000","last_active":"2024-02-17T12:18:18.332116+0000","last_peered":"2024-02-17T12:18:18.332116+0000","last_clean":"2024-02-17T12:18:18.332116+0000","last_became_active":"2024-02-17T12:18:02.806918+0000","last_became_peered":"2024-02-17T12:18:02.806918+0000","last_unstale":"2024-02-17T12:18:18.332116+0000","last_undegraded":"2024-02-17T12:18:18.332116+0000","last_fullsized":"2024-02-17T12:18:18.332116+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:17.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339441+0000","last_change":"2024-02-17T12:18:19.339441+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339441+0000","last_undegraded":"2024-02-17T12:18:19.339441+0000","last_fullsized":"2024-02-17T12:18:19.339441+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332550+0000","last_change":"2024-02-17T12:18:02.795014+0000","last_active":"2024-02-17T12:18:18.332550+0000","last_peered":"2024-02-17T12:18:18.332550+0000","last_clean":"2024-02-17T12:18:18.332550+0000","last_became_active":"2024-02-17T12:18:02.794759+0000","last_became_peered":"2024-02-17T12:18:02.794759+0000","last_unstale":"2024-02-17T12:18:18.332550+0000","last_undegraded":"2024-02-17T12:18:18.332550+0000","last_fullsized":"2024-02-17T12:18:18.332550+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:21.971723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333734+0000","last_change":"2024-02-17T12:18:19.333734+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333734+0000","last_undegraded":"2024-02-17T12:18:19.333734+0000","last_fullsized":"2024-02-17T12:18:19.333734+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.337022+0000","last_change":"2024-02-17T12:18:02.801322+0000","last_active":"2024-02-17T12:18:19.337022+0000","last_peered":"2024-02-17T12:18:19.337022+0000","last_clean":"2024-02-17T12:18:19.337022+0000","last_became_active":"2024-02-17T12:18:02.801073+0000","last_became_peered":"2024-02-17T12:18:02.801073+0000","last_unstale":"2024-02-17T12:18:19.337022+0000","last_undegraded":"2024-02-17T12:18:19.337022+0000","last_fullsized":"2024-02-17T12:18:19.337022+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.343199+0000","last_change":"2024-02-17T12:18:19.343199+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.343199+0000","last_undegraded":"2024-02-17T12:18:19.343199+0000","last_fullsized":"2024-02-17T12:18:19.343199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.326340+0000","last_change":"2024-02-17T12:18:18.326340+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.326340+0000","last_undegraded":"2024-02-17T12:18:18.326340+0000","last_fullsized":"2024-02-17T12:18:18.326340+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338219+0000","last_change":"2024-02-17T12:18:02.811882+0000","last_active":"2024-02-17T12:18:19.338219+0000","last_peered":"2024-02-17T12:18:19.338219+0000","last_clean":"2024-02-17T12:18:19.338219+0000","last_became_active":"2024-02-17T12:18:02.811448+0000","last_became_peered":"2024-02-17T12:18:02.811448+0000","last_unstale":"2024-02-17T12:18:19.338219+0000","last_undegraded":"2024-02-17T12:18:19.338219+0000","last_fullsized":"2024-02-17T12:18:19.338219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:46.432214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340678+0000","last_change":"2024-02-17T12:18:01.796858+0000","last_active":"2024-02-17T12:18:19.340678+0000","last_peered":"2024-02-17T12:18:19.340678+0000","last_clean":"2024-02-17T12:18:19.340678+0000","last_became_active":"2024-02-17T12:18:01.796498+0000","last_became_peered":"2024-02-17T12:18:01.796498+0000","last_unstale":"2024-02-17T12:18:19.340678+0000","last_undegraded":"2024-02-17T12:18:19.340678+0000","last_fullsized":"2024-02-17T12:18:19.340678+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355683+0000","last_change":"2024-02-17T12:18:19.351335+0000","last_active":"2024-02-17T12:18:19.355683+0000","last_peered":"2024-02-17T12:18:19.355683+0000","last_clean":"2024-02-17T12:18:19.355683+0000","last_became_active":"2024-02-17T12:18:19.350932+0000","last_became_peered":"2024-02-17T12:18:19.350932+0000","last_unstale":"2024-02-17T12:18:19.355683+0000","last_undegraded":"2024-02-17T12:18:19.355683+0000","last_fullsized":"2024-02-17T12:18:19.355683+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:52.676828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344983+0000","last_change":"2024-02-17T12:18:02.808663+0000","last_active":"2024-02-17T12:18:19.344983+0000","last_peered":"2024-02-17T12:18:19.344983+0000","last_clean":"2024-02-17T12:18:19.344983+0000","last_became_active":"2024-02-17T12:18:02.808402+0000","last_became_peered":"2024-02-17T12:18:02.808402+0000","last_unstale":"2024-02-17T12:18:19.344983+0000","last_undegraded":"2024-02-17T12:18:19.344983+0000","last_fullsized":"2024-02-17T12:18:19.344983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:00.777830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342763+0000","last_change":"2024-02-17T12:18:01.790619+0000","last_active":"2024-02-17T12:18:19.342763+0000","last_peered":"2024-02-17T12:18:19.342763+0000","last_clean":"2024-02-17T12:18:19.342763+0000","last_became_active":"2024-02-17T12:18:01.790344+0000","last_became_peered":"2024-02-17T12:18:01.790344+0000","last_unstale":"2024-02-17T12:18:19.342763+0000","last_undegraded":"2024-02-17T12:18:19.342763+0000","last_fullsized":"2024-02-17T12:18:19.342763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:45.425754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331676+0000","last_change":"2024-02-17T12:18:18.331676+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331676+0000","last_undegraded":"2024-02-17T12:18:18.331676+0000","last_fullsized":"2024-02-17T12:18:18.331676+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340787+0000","last_change":"2024-02-17T12:18:02.804685+0000","last_active":"2024-02-17T12:18:19.340787+0000","last_peered":"2024-02-17T12:18:19.340787+0000","last_clean":"2024-02-17T12:18:19.340787+0000","last_became_active":"2024-02-17T12:18:02.803980+0000","last_became_peered":"2024-02-17T12:18:02.803980+0000","last_unstale":"2024-02-17T12:18:19.340787+0000","last_undegraded":"2024-02-17T12:18:19.340787+0000","last_fullsized":"2024-02-17T12:18:19.340787+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:32.327387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338423+0000","last_change":"2024-02-17T12:18:01.801344+0000","last_active":"2024-02-17T12:18:19.338423+0000","last_peered":"2024-02-17T12:18:19.338423+0000","last_clean":"2024-02-17T12:18:19.338423+0000","last_became_active":"2024-02-17T12:18:01.801092+0000","last_became_peered":"2024-02-17T12:18:01.801092+0000","last_unstale":"2024-02-17T12:18:19.338423+0000","last_undegraded":"2024-02-17T12:18:19.338423+0000","last_fullsized":"2024-02-17T12:18:19.338423+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.357844+0000","last_change":"2024-02-17T12:18:19.348869+0000","last_active":"2024-02-17T12:18:19.357844+0000","last_peered":"2024-02-17T12:18:19.357844+0000","last_clean":"2024-02-17T12:18:19.357844+0000","last_became_active":"2024-02-17T12:18:19.347760+0000","last_became_peered":"2024-02-17T12:18:19.347760+0000","last_unstale":"2024-02-17T12:18:19.357844+0000","last_undegraded":"2024-02-17T12:18:19.357844+0000","last_fullsized":"2024-02-17T12:18:19.357844+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:28:32.430718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338263+0000","last_change":"2024-02-17T12:18:02.806603+0000","last_active":"2024-02-17T12:18:19.338263+0000","last_peered":"2024-02-17T12:18:19.338263+0000","last_clean":"2024-02-17T12:18:19.338263+0000","last_became_active":"2024-02-17T12:18:02.806021+0000","last_became_peered":"2024-02-17T12:18:02.806021+0000","last_unstale":"2024-02-17T12:18:19.338263+0000","last_undegraded":"2024-02-17T12:18:19.338263+0000","last_fullsized":"2024-02-17T12:18:19.338263+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:57.248220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330817+0000","last_change":"2024-02-17T12:18:01.790249+0000","last_active":"2024-02-17T12:18:19.330817+0000","last_peered":"2024-02-17T12:18:19.330817+0000","last_clean":"2024-02-17T12:18:19.330817+0000","last_became_active":"2024-02-17T12:18:01.789970+0000","last_became_peered":"2024-02-17T12:18:01.789970+0000","last_unstale":"2024-02-17T12:18:19.330817+0000","last_undegraded":"2024-02-17T12:18:19.330817+0000","last_fullsized":"2024-02-17T12:18:19.330817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360087+0000","last_change":"2024-02-17T12:18:19.353267+0000","last_active":"2024-02-17T12:18:19.360087+0000","last_peered":"2024-02-17T12:18:19.360087+0000","last_clean":"2024-02-17T12:18:19.360087+0000","last_became_active":"2024-02-17T12:18:19.353007+0000","last_became_peered":"2024-02-17T12:18:19.353007+0000","last_unstale":"2024-02-17T12:18:19.360087+0000","last_undegraded":"2024-02-17T12:18:19.360087+0000","last_fullsized":"2024-02-17T12:18:19.360087+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:49.360736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341972+0000","last_change":"2024-02-17T12:18:02.811065+0000","last_active":"2024-02-17T12:18:19.341972+0000","last_peered":"2024-02-17T12:18:19.341972+0000","last_clean":"2024-02-17T12:18:19.341972+0000","last_became_active":"2024-02-17T12:18:02.810598+0000","last_became_peered":"2024-02-17T12:18:02.810598+0000","last_unstale":"2024-02-17T12:18:19.341972+0000","last_undegraded":"2024-02-17T12:18:19.341972+0000","last_fullsized":"2024-02-17T12:18:19.341972+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:11:46.553742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328607+0000","last_change":"2024-02-17T12:18:01.798801+0000","last_active":"2024-02-17T12:18:18.328607+0000","last_peered":"2024-02-17T12:18:18.328607+0000","last_clean":"2024-02-17T12:18:18.328607+0000","last_became_active":"2024-02-17T12:18:01.798516+0000","last_became_peered":"2024-02-17T12:18:01.798516+0000","last_unstale":"2024-02-17T12:18:18.328607+0000","last_undegraded":"2024-02-17T12:18:18.328607+0000","last_fullsized":"2024-02-17T12:18:18.328607+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:04:53.798642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335113+0000","last_change":"2024-02-17T12:18:19.335113+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335113+0000","last_undegraded":"2024-02-17T12:18:19.335113+0000","last_fullsized":"2024-02-17T12:18:19.335113+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331699+0000","last_change":"2024-02-17T12:18:18.331699+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331699+0000","last_undegraded":"2024-02-17T12:18:18.331699+0000","last_fullsized":"2024-02-17T12:18:18.331699+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342282+0000","last_change":"2024-02-17T12:18:02.802301+0000","last_active":"2024-02-17T12:18:19.342282+0000","last_peered":"2024-02-17T12:18:19.342282+0000","last_clean":"2024-02-17T12:18:19.342282+0000","last_became_active":"2024-02-17T12:18:02.801632+0000","last_became_peered":"2024-02-17T12:18:02.801632+0000","last_unstale":"2024-02-17T12:18:19.342282+0000","last_undegraded":"2024-02-17T12:18:19.342282+0000","last_fullsized":"2024-02-17T12:18:19.342282+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:34:13.159578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339326+0000","last_change":"2024-02-17T12:18:01.800510+0000","last_active":"2024-02-17T12:18:19.339326+0000","last_peered":"2024-02-17T12:18:19.339326+0000","last_clean":"2024-02-17T12:18:19.339326+0000","last_became_active":"2024-02-17T12:18:01.799483+0000","last_became_peered":"2024-02-17T12:18:01.799483+0000","last_unstale":"2024-02-17T12:18:19.339326+0000","last_undegraded":"2024-02-17T12:18:19.339326+0000","last_fullsized":"2024-02-17T12:18:19.339326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.330276+0000","last_change":"2024-02-17T12:18:19.330276+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.330276+0000","last_undegraded":"2024-02-17T12:18:19.330276+0000","last_fullsized":"2024-02-17T12:18:19.330276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.354877+0000","last_change":"2024-02-17T12:18:19.351098+0000","last_active":"2024-02-17T12:18:19.354877+0000","last_peered":"2024-02-17T12:18:19.354877+0000","last_clean":"2024-02-17T12:18:19.354877+0000","last_became_active":"2024-02-17T12:18:19.350809+0000","last_became_peered":"2024-02-17T12:18:19.350809+0000","last_unstale":"2024-02-17T12:18:19.354877+0000","last_undegraded":"2024-02-17T12:18:19.354877+0000","last_fullsized":"2024-02-17T12:18:19.354877+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:07:44.338092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346264+0000","last_change":"2024-02-17T12:18:02.811246+0000","last_active":"2024-02-17T12:18:19.346264+0000","last_peered":"2024-02-17T12:18:19.346264+0000","last_clean":"2024-02-17T12:18:19.346264+0000","last_became_active":"2024-02-17T12:18:02.810989+0000","last_became_peered":"2024-02-17T12:18:02.810989+0000","last_unstale":"2024-02-17T12:18:19.346264+0000","last_undegraded":"2024-02-17T12:18:19.346264+0000","last_fullsized":"2024-02-17T12:18:19.346264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:56:31.198120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.332999+0000","last_change":"2024-02-17T12:18:01.798316+0000","last_active":"2024-02-17T12:18:19.332999+0000","last_peered":"2024-02-17T12:18:19.332999+0000","last_clean":"2024-02-17T12:18:19.332999+0000","last_became_active":"2024-02-17T12:18:01.797041+0000","last_became_peered":"2024-02-17T12:18:01.797041+0000","last_unstale":"2024-02-17T12:18:19.332999+0000","last_undegraded":"2024-02-17T12:18:19.332999+0000","last_fullsized":"2024-02-17T12:18:19.332999+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360092+0000","last_change":"2024-02-17T12:18:19.352520+0000","last_active":"2024-02-17T12:18:19.360092+0000","last_peered":"2024-02-17T12:18:19.360092+0000","last_clean":"2024-02-17T12:18:19.360092+0000","last_became_active":"2024-02-17T12:18:19.351708+0000","last_became_peered":"2024-02-17T12:18:19.351708+0000","last_unstale":"2024-02-17T12:18:19.360092+0000","last_undegraded":"2024-02-17T12:18:19.360092+0000","last_fullsized":"2024-02-17T12:18:19.360092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:01.563171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341680+0000","last_change":"2024-02-17T12:18:02.801971+0000","last_active":"2024-02-17T12:18:19.341680+0000","last_peered":"2024-02-17T12:18:19.341680+0000","last_clean":"2024-02-17T12:18:19.341680+0000","last_became_active":"2024-02-17T12:18:02.801727+0000","last_became_peered":"2024-02-17T12:18:02.801727+0000","last_unstale":"2024-02-17T12:18:19.341680+0000","last_undegraded":"2024-02-17T12:18:19.341680+0000","last_fullsized":"2024-02-17T12:18:19.341680+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:06:15.526935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328199+0000","last_change":"2024-02-17T12:18:01.800493+0000","last_active":"2024-02-17T12:18:18.328199+0000","last_peered":"2024-02-17T12:18:18.328199+0000","last_clean":"2024-02-17T12:18:18.328199+0000","last_became_active":"2024-02-17T12:18:01.800206+0000","last_became_peered":"2024-02-17T12:18:01.800206+0000","last_unstale":"2024-02-17T12:18:18.328199+0000","last_undegraded":"2024-02-17T12:18:18.328199+0000","last_fullsized":"2024-02-17T12:18:18.328199+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:33.603620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340864+0000","last_change":"2024-02-17T12:18:19.340864+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340864+0000","last_undegraded":"2024-02-17T12:18:19.340864+0000","last_fullsized":"2024-02-17T12:18:19.340864+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.348954+0000","last_change":"2024-02-17T12:18:19.347455+0000","last_active":"2024-02-17T12:18:19.348954+0000","last_peered":"2024-02-17T12:18:19.348954+0000","last_clean":"2024-02-17T12:18:19.348954+0000","last_became_active":"2024-02-17T12:18:19.347134+0000","last_became_peered":"2024-02-17T12:18:19.347134+0000","last_unstale":"2024-02-17T12:18:19.348954+0000","last_undegraded":"2024-02-17T12:18:19.348954+0000","last_fullsized":"2024-02-17T12:18:19.348954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:59:36.003726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328936+0000","last_change":"2024-02-17T12:18:02.797952+0000","last_active":"2024-02-17T12:18:18.328936+0000","last_peered":"2024-02-17T12:18:18.328936+0000","last_clean":"2024-02-17T12:18:18.328936+0000","last_became_active":"2024-02-17T12:18:02.797675+0000","last_became_peered":"2024-02-17T12:18:02.797675+0000","last_unstale":"2024-02-17T12:18:18.328936+0000","last_undegraded":"2024-02-17T12:18:18.328936+0000","last_fullsized":"2024-02-17T12:18:18.328936+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:01.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333033+0000","last_change":"2024-02-17T12:18:01.801850+0000","last_active":"2024-02-17T12:18:18.333033+0000","last_peered":"2024-02-17T12:18:18.333033+0000","last_clean":"2024-02-17T12:18:18.333033+0000","last_became_active":"2024-02-17T12:18:01.801516+0000","last_became_peered":"2024-02-17T12:18:01.801516+0000","last_unstale":"2024-02-17T12:18:18.333033+0000","last_undegraded":"2024-02-17T12:18:18.333033+0000","last_fullsized":"2024-02-17T12:18:18.333033+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:28.630666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355114+0000","last_change":"2024-02-17T12:18:19.352769+0000","last_active":"2024-02-17T12:18:19.355114+0000","last_peered":"2024-02-17T12:18:19.355114+0000","last_clean":"2024-02-17T12:18:19.355114+0000","last_became_active":"2024-02-17T12:18:19.352519+0000","last_became_peered":"2024-02-17T12:18:19.352519+0000","last_unstale":"2024-02-17T12:18:19.355114+0000","last_undegraded":"2024-02-17T12:18:19.355114+0000","last_fullsized":"2024-02-17T12:18:19.355114+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333004+0000","last_change":"2024-02-17T12:18:02.813957+0000","last_active":"2024-02-17T12:18:18.333004+0000","last_peered":"2024-02-17T12:18:18.333004+0000","last_clean":"2024-02-17T12:18:18.333004+0000","last_became_active":"2024-02-17T12:18:02.813647+0000","last_became_peered":"2024-02-17T12:18:02.813647+0000","last_unstale":"2024-02-17T12:18:18.333004+0000","last_undegraded":"2024-02-17T12:18:18.333004+0000","last_fullsized":"2024-02-17T12:18:18.333004+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:41.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342822+0000","last_change":"2024-02-17T12:18:01.799508+0000","last_active":"2024-02-17T12:18:19.342822+0000","last_peered":"2024-02-17T12:18:19.342822+0000","last_clean":"2024-02-17T12:18:19.342822+0000","last_became_active":"2024-02-17T12:18:01.798598+0000","last_became_peered":"2024-02-17T12:18:01.798598+0000","last_unstale":"2024-02-17T12:18:19.342822+0000","last_undegraded":"2024-02-17T12:18:19.342822+0000","last_fullsized":"2024-02-17T12:18:19.342822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:45.103353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.329959+0000","last_change":"2024-02-17T12:18:19.329959+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.329959+0000","last_undegraded":"2024-02-17T12:18:19.329959+0000","last_fullsized":"2024-02-17T12:18:19.329959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.326370+0000","last_change":"2024-02-17T12:18:18.326370+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.326370+0000","last_undegraded":"2024-02-17T12:18:18.326370+0000","last_fullsized":"2024-02-17T12:18:18.326370+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344376+0000","last_change":"2024-02-17T12:18:02.787850+0000","last_active":"2024-02-17T12:18:19.344376+0000","last_peered":"2024-02-17T12:18:19.344376+0000","last_clean":"2024-02-17T12:18:19.344376+0000","last_became_active":"2024-02-17T12:18:02.787578+0000","last_became_peered":"2024-02-17T12:18:02.787578+0000","last_unstale":"2024-02-17T12:18:19.344376+0000","last_undegraded":"2024-02-17T12:18:19.344376+0000","last_fullsized":"2024-02-17T12:18:19.344376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:29.854264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332273+0000","last_change":"2024-02-17T12:18:01.805403+0000","last_active":"2024-02-17T12:18:18.332273+0000","last_peered":"2024-02-17T12:18:18.332273+0000","last_clean":"2024-02-17T12:18:18.332273+0000","last_became_active":"2024-02-17T12:18:01.805059+0000","last_became_peered":"2024-02-17T12:18:01.805059+0000","last_unstale":"2024-02-17T12:18:18.332273+0000","last_undegraded":"2024-02-17T12:18:18.332273+0000","last_fullsized":"2024-02-17T12:18:18.332273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:14.495937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355588+0000","last_change":"2024-02-17T12:18:19.349635+0000","last_active":"2024-02-17T12:18:19.355588+0000","last_peered":"2024-02-17T12:18:19.355588+0000","last_clean":"2024-02-17T12:18:19.355588+0000","last_became_active":"2024-02-17T12:18:19.349145+0000","last_became_peered":"2024-02-17T12:18:19.349145+0000","last_unstale":"2024-02-17T12:18:19.355588+0000","last_undegraded":"2024-02-17T12:18:19.355588+0000","last_fullsized":"2024-02-17T12:18:19.355588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332061+0000","last_change":"2024-02-17T12:18:02.810198+0000","last_active":"2024-02-17T12:18:18.332061+0000","last_peered":"2024-02-17T12:18:18.332061+0000","last_clean":"2024-02-17T12:18:18.332061+0000","last_became_active":"2024-02-17T12:18:02.809131+0000","last_became_peered":"2024-02-17T12:18:02.809131+0000","last_unstale":"2024-02-17T12:18:18.332061+0000","last_undegraded":"2024-02-17T12:18:18.332061+0000","last_fullsized":"2024-02-17T12:18:18.332061+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:01:23.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328597+0000","last_change":"2024-02-17T12:18:01.802710+0000","last_active":"2024-02-17T12:18:18.328597+0000","last_peered":"2024-02-17T12:18:18.328597+0000","last_clean":"2024-02-17T12:18:18.328597+0000","last_became_active":"2024-02-17T12:18:01.802365+0000","last_became_peered":"2024-02-17T12:18:01.802365+0000","last_unstale":"2024-02-17T12:18:18.328597+0000","last_undegraded":"2024-02-17T12:18:18.328597+0000","last_fullsized":"2024-02-17T12:18:18.328597+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:45.771679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.334337+0000","last_change":"2024-02-17T12:18:19.334337+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.334337+0000","last_undegraded":"2024-02-17T12:18:19.334337+0000","last_fullsized":"2024-02-17T12:18:19.334337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360350+0000","last_change":"2024-02-17T12:18:19.353417+0000","last_active":"2024-02-17T12:18:19.360350+0000","last_peered":"2024-02-17T12:18:19.360350+0000","last_clean":"2024-02-17T12:18:19.360350+0000","last_became_active":"2024-02-17T12:18:19.350515+0000","last_became_peered":"2024-02-17T12:18:19.350515+0000","last_unstale":"2024-02-17T12:18:19.360350+0000","last_undegraded":"2024-02-17T12:18:19.360350+0000","last_fullsized":"2024-02-17T12:18:19.360350+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:05:31.415587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333976+0000","last_change":"2024-02-17T12:18:02.809855+0000","last_active":"2024-02-17T12:18:19.333976+0000","last_peered":"2024-02-17T12:18:19.333976+0000","last_clean":"2024-02-17T12:18:19.333976+0000","last_became_active":"2024-02-17T12:18:02.809577+0000","last_became_peered":"2024-02-17T12:18:02.809577+0000","last_unstale":"2024-02-17T12:18:19.333976+0000","last_undegraded":"2024-02-17T12:18:19.333976+0000","last_fullsized":"2024-02-17T12:18:19.333976+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:17:49.657379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342359+0000","last_change":"2024-02-17T12:18:01.792615+0000","last_active":"2024-02-17T12:18:19.342359+0000","last_peered":"2024-02-17T12:18:19.342359+0000","last_clean":"2024-02-17T12:18:19.342359+0000","last_became_active":"2024-02-17T12:18:01.792287+0000","last_became_peered":"2024-02-17T12:18:01.792287+0000","last_unstale":"2024-02-17T12:18:19.342359+0000","last_undegraded":"2024-02-17T12:18:19.342359+0000","last_fullsized":"2024-02-17T12:18:19.342359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:56.241760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.326306+0000","last_change":"2024-02-17T12:18:18.326306+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.326306+0000","last_undegraded":"2024-02-17T12:18:18.326306+0000","last_fullsized":"2024-02-17T12:18:18.326306+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332370+0000","last_change":"2024-02-17T12:18:02.808057+0000","last_active":"2024-02-17T12:18:18.332370+0000","last_peered":"2024-02-17T12:18:18.332370+0000","last_clean":"2024-02-17T12:18:18.332370+0000","last_became_active":"2024-02-17T12:18:02.807629+0000","last_became_peered":"2024-02-17T12:18:02.807629+0000","last_unstale":"2024-02-17T12:18:18.332370+0000","last_undegraded":"2024-02-17T12:18:18.332370+0000","last_fullsized":"2024-02-17T12:18:18.332370+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:58:48.506743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346100+0000","last_change":"2024-02-17T12:18:01.797715+0000","last_active":"2024-02-17T12:18:19.346100+0000","last_peered":"2024-02-17T12:18:19.346100+0000","last_clean":"2024-02-17T12:18:19.346100+0000","last_became_active":"2024-02-17T12:18:01.797435+0000","last_became_peered":"2024-02-17T12:18:01.797435+0000","last_unstale":"2024-02-17T12:18:19.346100+0000","last_undegraded":"2024-02-17T12:18:19.346100+0000","last_fullsized":"2024-02-17T12:18:19.346100+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:49.624601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360516+0000","last_change":"2024-02-17T12:18:19.355317+0000","last_active":"2024-02-17T12:18:19.360516+0000","last_peered":"2024-02-17T12:18:19.360516+0000","last_clean":"2024-02-17T12:18:19.360516+0000","last_became_active":"2024-02-17T12:18:19.353852+0000","last_became_peered":"2024-02-17T12:18:19.353852+0000","last_unstale":"2024-02-17T12:18:19.360516+0000","last_undegraded":"2024-02-17T12:18:19.360516+0000","last_fullsized":"2024-02-17T12:18:19.360516+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:52.676828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328075+0000","last_change":"2024-02-17T12:18:02.810137+0000","last_active":"2024-02-17T12:18:18.328075+0000","last_peered":"2024-02-17T12:18:18.328075+0000","last_clean":"2024-02-17T12:18:18.328075+0000","last_became_active":"2024-02-17T12:18:02.809877+0000","last_became_peered":"2024-02-17T12:18:02.809877+0000","last_unstale":"2024-02-17T12:18:18.328075+0000","last_undegraded":"2024-02-17T12:18:18.328075+0000","last_fullsized":"2024-02-17T12:18:18.328075+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:15.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333119+0000","last_change":"2024-02-17T12:18:01.790794+0000","last_active":"2024-02-17T12:18:19.333119+0000","last_peered":"2024-02-17T12:18:19.333119+0000","last_clean":"2024-02-17T12:18:19.333119+0000","last_became_active":"2024-02-17T12:18:01.790500+0000","last_became_peered":"2024-02-17T12:18:01.790500+0000","last_unstale":"2024-02-17T12:18:19.333119+0000","last_undegraded":"2024-02-17T12:18:19.333119+0000","last_fullsized":"2024-02-17T12:18:19.333119+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.330408+0000","last_change":"2024-02-17T12:18:19.330408+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.330408+0000","last_undegraded":"2024-02-17T12:18:19.330408+0000","last_fullsized":"2024-02-17T12:18:19.330408+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360110+0000","last_change":"2024-02-17T12:18:19.352733+0000","last_active":"2024-02-17T12:18:19.360110+0000","last_peered":"2024-02-17T12:18:19.360110+0000","last_clean":"2024-02-17T12:18:19.360110+0000","last_became_active":"2024-02-17T12:18:19.352039+0000","last_became_peered":"2024-02-17T12:18:19.352039+0000","last_unstale":"2024-02-17T12:18:19.360110+0000","last_undegraded":"2024-02-17T12:18:19.360110+0000","last_fullsized":"2024-02-17T12:18:19.360110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:28:25.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332808+0000","last_change":"2024-02-17T12:18:02.808594+0000","last_active":"2024-02-17T12:18:18.332808+0000","last_peered":"2024-02-17T12:18:18.332808+0000","last_clean":"2024-02-17T12:18:18.332808+0000","last_became_active":"2024-02-17T12:18:02.808035+0000","last_became_peered":"2024-02-17T12:18:02.808035+0000","last_unstale":"2024-02-17T12:18:18.332808+0000","last_undegraded":"2024-02-17T12:18:18.332808+0000","last_fullsized":"2024-02-17T12:18:18.332808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:58.050395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332208+0000","last_change":"2024-02-17T12:18:01.789017+0000","last_active":"2024-02-17T12:18:18.332208+0000","last_peered":"2024-02-17T12:18:18.332208+0000","last_clean":"2024-02-17T12:18:18.332208+0000","last_became_active":"2024-02-17T12:18:01.788529+0000","last_became_peered":"2024-02-17T12:18:01.788529+0000","last_unstale":"2024-02-17T12:18:18.332208+0000","last_undegraded":"2024-02-17T12:18:18.332208+0000","last_fullsized":"2024-02-17T12:18:18.332208+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:31.560281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.341864+0000","last_change":"2024-02-17T12:18:19.341864+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.341864+0000","last_undegraded":"2024-02-17T12:18:19.341864+0000","last_fullsized":"2024-02-17T12:18:19.341864+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360193+0000","last_change":"2024-02-17T12:18:19.354058+0000","last_active":"2024-02-17T12:18:19.360193+0000","last_peered":"2024-02-17T12:18:19.360193+0000","last_clean":"2024-02-17T12:18:19.360193+0000","last_became_active":"2024-02-17T12:18:19.353686+0000","last_became_peered":"2024-02-17T12:18:19.353686+0000","last_unstale":"2024-02-17T12:18:19.360193+0000","last_undegraded":"2024-02-17T12:18:19.360193+0000","last_fullsized":"2024-02-17T12:18:19.360193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:44.104942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.333212+0000","last_change":"2024-02-17T12:18:02.808518+0000","last_active":"2024-02-17T12:18:18.333212+0000","last_peered":"2024-02-17T12:18:18.333212+0000","last_clean":"2024-02-17T12:18:18.333212+0000","last_became_active":"2024-02-17T12:18:02.808255+0000","last_became_peered":"2024-02-17T12:18:02.808255+0000","last_unstale":"2024-02-17T12:18:18.333212+0000","last_undegraded":"2024-02-17T12:18:18.333212+0000","last_fullsized":"2024-02-17T12:18:18.333212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:58:40.908163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343746+0000","last_change":"2024-02-17T12:18:01.802794+0000","last_active":"2024-02-17T12:18:19.343746+0000","last_peered":"2024-02-17T12:18:19.343746+0000","last_clean":"2024-02-17T12:18:19.343746+0000","last_became_active":"2024-02-17T12:18:01.802366+0000","last_became_peered":"2024-02-17T12:18:01.802366+0000","last_unstale":"2024-02-17T12:18:19.343746+0000","last_undegraded":"2024-02-17T12:18:19.343746+0000","last_fullsized":"2024-02-17T12:18:19.343746+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:45:00.445775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.333710+0000","last_change":"2024-02-17T12:18:18.333710+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.333710+0000","last_undegraded":"2024-02-17T12:18:18.333710+0000","last_fullsized":"2024-02-17T12:18:18.333710+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334807+0000","last_change":"2024-02-17T12:18:02.810942+0000","last_active":"2024-02-17T12:18:19.334807+0000","last_peered":"2024-02-17T12:18:19.334807+0000","last_clean":"2024-02-17T12:18:19.334807+0000","last_became_active":"2024-02-17T12:18:02.810651+0000","last_became_peered":"2024-02-17T12:18:02.810651+0000","last_unstale":"2024-02-17T12:18:19.334807+0000","last_undegraded":"2024-02-17T12:18:19.334807+0000","last_fullsized":"2024-02-17T12:18:19.334807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338302+0000","last_change":"2024-02-17T12:18:01.797601+0000","last_active":"2024-02-17T12:18:19.338302+0000","last_peered":"2024-02-17T12:18:19.338302+0000","last_clean":"2024-02-17T12:18:19.338302+0000","last_became_active":"2024-02-17T12:18:01.796341+0000","last_became_peered":"2024-02-17T12:18:01.796341+0000","last_unstale":"2024-02-17T12:18:19.338302+0000","last_undegraded":"2024-02-17T12:18:19.338302+0000","last_fullsized":"2024-02-17T12:18:19.338302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360165+0000","last_change":"2024-02-17T12:18:19.353335+0000","last_active":"2024-02-17T12:18:19.360165+0000","last_peered":"2024-02-17T12:18:19.360165+0000","last_clean":"2024-02-17T12:18:19.360165+0000","last_became_active":"2024-02-17T12:18:19.353048+0000","last_became_peered":"2024-02-17T12:18:19.353048+0000","last_unstale":"2024-02-17T12:18:19.360165+0000","last_undegraded":"2024-02-17T12:18:19.360165+0000","last_fullsized":"2024-02-17T12:18:19.360165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:18:06.203775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344150+0000","last_change":"2024-02-17T12:18:02.803894+0000","last_active":"2024-02-17T12:18:19.344150+0000","last_peered":"2024-02-17T12:18:19.344150+0000","last_clean":"2024-02-17T12:18:19.344150+0000","last_became_active":"2024-02-17T12:18:02.803553+0000","last_became_peered":"2024-02-17T12:18:02.803553+0000","last_unstale":"2024-02-17T12:18:19.344150+0000","last_undegraded":"2024-02-17T12:18:19.344150+0000","last_fullsized":"2024-02-17T12:18:19.344150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:35:24.727572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330495+0000","last_change":"2024-02-17T12:18:01.789546+0000","last_active":"2024-02-17T12:18:19.330495+0000","last_peered":"2024-02-17T12:18:19.330495+0000","last_clean":"2024-02-17T12:18:19.330495+0000","last_became_active":"2024-02-17T12:18:01.789258+0000","last_became_peered":"2024-02-17T12:18:01.789258+0000","last_unstale":"2024-02-17T12:18:19.330495+0000","last_undegraded":"2024-02-17T12:18:19.330495+0000","last_fullsized":"2024-02-17T12:18:19.330495+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.325904+0000","last_change":"2024-02-17T12:18:18.325904+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.325904+0000","last_undegraded":"2024-02-17T12:18:18.325904+0000","last_fullsized":"2024-02-17T12:18:18.325904+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332167+0000","last_change":"2024-02-17T12:18:02.811327+0000","last_active":"2024-02-17T12:18:18.332167+0000","last_peered":"2024-02-17T12:18:18.332167+0000","last_clean":"2024-02-17T12:18:18.332167+0000","last_became_active":"2024-02-17T12:18:02.809620+0000","last_became_peered":"2024-02-17T12:18:02.809620+0000","last_unstale":"2024-02-17T12:18:18.332167+0000","last_undegraded":"2024-02-17T12:18:18.332167+0000","last_fullsized":"2024-02-17T12:18:18.332167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:40:08.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339073+0000","last_change":"2024-02-17T12:18:01.798265+0000","last_active":"2024-02-17T12:18:19.339073+0000","last_peered":"2024-02-17T12:18:19.339073+0000","last_clean":"2024-02-17T12:18:19.339073+0000","last_became_active":"2024-02-17T12:18:01.797931+0000","last_became_peered":"2024-02-17T12:18:01.797931+0000","last_unstale":"2024-02-17T12:18:19.339073+0000","last_undegraded":"2024-02-17T12:18:19.339073+0000","last_fullsized":"2024-02-17T12:18:19.339073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333949+0000","last_change":"2024-02-17T12:18:19.333949+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333949+0000","last_undegraded":"2024-02-17T12:18:19.333949+0000","last_fullsized":"2024-02-17T12:18:19.333949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343005+0000","last_change":"2024-02-17T12:18:19.339116+0000","last_active":"2024-02-17T12:18:19.343005+0000","last_peered":"2024-02-17T12:18:19.343005+0000","last_clean":"2024-02-17T12:18:19.343005+0000","last_became_active":"2024-02-17T12:18:19.338406+0000","last_became_peered":"2024-02-17T12:18:19.338406+0000","last_unstale":"2024-02-17T12:18:19.343005+0000","last_undegraded":"2024-02-17T12:18:19.343005+0000","last_fullsized":"2024-02-17T12:18:19.343005+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:11.400472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334099+0000","last_change":"2024-02-17T12:18:02.800381+0000","last_active":"2024-02-17T12:18:19.334099+0000","last_peered":"2024-02-17T12:18:19.334099+0000","last_clean":"2024-02-17T12:18:19.334099+0000","last_became_active":"2024-02-17T12:18:02.800042+0000","last_became_peered":"2024-02-17T12:18:02.800042+0000","last_unstale":"2024-02-17T12:18:19.334099+0000","last_undegraded":"2024-02-17T12:18:19.334099+0000","last_fullsized":"2024-02-17T12:18:19.334099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:27.558546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342497+0000","last_change":"2024-02-17T12:18:01.795914+0000","last_active":"2024-02-17T12:18:19.342497+0000","last_peered":"2024-02-17T12:18:19.342497+0000","last_clean":"2024-02-17T12:18:19.342497+0000","last_became_active":"2024-02-17T12:18:01.794847+0000","last_became_peered":"2024-02-17T12:18:01.794847+0000","last_unstale":"2024-02-17T12:18:19.342497+0000","last_undegraded":"2024-02-17T12:18:19.342497+0000","last_fullsized":"2024-02-17T12:18:19.342497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:31.320927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333047+0000","last_change":"2024-02-17T12:18:19.333047+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333047+0000","last_undegraded":"2024-02-17T12:18:19.333047+0000","last_fullsized":"2024-02-17T12:18:19.333047+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.357925+0000","last_change":"2024-02-17T12:18:19.352005+0000","last_active":"2024-02-17T12:18:19.357925+0000","last_peered":"2024-02-17T12:18:19.357925+0000","last_clean":"2024-02-17T12:18:19.357925+0000","last_became_active":"2024-02-17T12:18:19.351791+0000","last_became_peered":"2024-02-17T12:18:19.351791+0000","last_unstale":"2024-02-17T12:18:19.357925+0000","last_undegraded":"2024-02-17T12:18:19.357925+0000","last_fullsized":"2024-02-17T12:18:19.357925+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:19:04.346561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.337872+0000","last_change":"2024-02-17T12:18:02.807547+0000","last_active":"2024-02-17T12:18:19.337872+0000","last_peered":"2024-02-17T12:18:19.337872+0000","last_clean":"2024-02-17T12:18:19.337872+0000","last_became_active":"2024-02-17T12:18:02.807209+0000","last_became_peered":"2024-02-17T12:18:02.807209+0000","last_unstale":"2024-02-17T12:18:19.337872+0000","last_undegraded":"2024-02-17T12:18:19.337872+0000","last_fullsized":"2024-02-17T12:18:19.337872+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343944+0000","last_change":"2024-02-17T12:18:01.803848+0000","last_active":"2024-02-17T12:18:19.343944+0000","last_peered":"2024-02-17T12:18:19.343944+0000","last_clean":"2024-02-17T12:18:19.343944+0000","last_became_active":"2024-02-17T12:18:01.803552+0000","last_became_peered":"2024-02-17T12:18:01.803552+0000","last_unstale":"2024-02-17T12:18:19.343944+0000","last_undegraded":"2024-02-17T12:18:19.343944+0000","last_fullsized":"2024-02-17T12:18:19.343944+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:25:02.826927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339057+0000","last_change":"2024-02-17T12:18:19.339057+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339057+0000","last_undegraded":"2024-02-17T12:18:19.339057+0000","last_fullsized":"2024-02-17T12:18:19.339057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360064+0000","last_change":"2024-02-17T12:18:19.352308+0000","last_active":"2024-02-17T12:18:19.360064+0000","last_peered":"2024-02-17T12:18:19.360064+0000","last_clean":"2024-02-17T12:18:19.360064+0000","last_became_active":"2024-02-17T12:18:19.351363+0000","last_became_peered":"2024-02-17T12:18:19.351363+0000","last_unstale":"2024-02-17T12:18:19.360064+0000","last_undegraded":"2024-02-17T12:18:19.360064+0000","last_fullsized":"2024-02-17T12:18:19.360064+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:53:41.288869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340485+0000","last_change":"2024-02-17T12:18:02.811800+0000","last_active":"2024-02-17T12:18:19.340485+0000","last_peered":"2024-02-17T12:18:19.340485+0000","last_clean":"2024-02-17T12:18:19.340485+0000","last_became_active":"2024-02-17T12:18:02.811504+0000","last_became_peered":"2024-02-17T12:18:02.811504+0000","last_unstale":"2024-02-17T12:18:19.340485+0000","last_undegraded":"2024-02-17T12:18:19.340485+0000","last_fullsized":"2024-02-17T12:18:19.340485+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.331083+0000","last_change":"2024-02-17T12:18:01.800860+0000","last_active":"2024-02-17T12:18:19.331083+0000","last_peered":"2024-02-17T12:18:19.331083+0000","last_clean":"2024-02-17T12:18:19.331083+0000","last_became_active":"2024-02-17T12:18:01.800569+0000","last_became_peered":"2024-02-17T12:18:01.800569+0000","last_unstale":"2024-02-17T12:18:19.331083+0000","last_undegraded":"2024-02-17T12:18:19.331083+0000","last_fullsized":"2024-02-17T12:18:19.331083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331766+0000","last_change":"2024-02-17T12:18:18.331766+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331766+0000","last_undegraded":"2024-02-17T12:18:18.331766+0000","last_fullsized":"2024-02-17T12:18:18.331766+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333029+0000","last_change":"2024-02-17T12:18:02.812763+0000","last_active":"2024-02-17T12:18:19.333029+0000","last_peered":"2024-02-17T12:18:19.333029+0000","last_clean":"2024-02-17T12:18:19.333029+0000","last_became_active":"2024-02-17T12:18:02.812512+0000","last_became_peered":"2024-02-17T12:18:02.812512+0000","last_unstale":"2024-02-17T12:18:19.333029+0000","last_undegraded":"2024-02-17T12:18:19.333029+0000","last_fullsized":"2024-02-17T12:18:19.333029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345020+0000","last_change":"2024-02-17T12:18:01.805847+0000","last_active":"2024-02-17T12:18:19.345020+0000","last_peered":"2024-02-17T12:18:19.345020+0000","last_clean":"2024-02-17T12:18:19.345020+0000","last_became_active":"2024-02-17T12:18:01.805591+0000","last_became_peered":"2024-02-17T12:18:01.805591+0000","last_unstale":"2024-02-17T12:18:19.345020+0000","last_undegraded":"2024-02-17T12:18:19.345020+0000","last_fullsized":"2024-02-17T12:18:19.345020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:52:05.403651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.347869+0000","last_change":"2024-02-17T12:18:19.343966+0000","last_active":"2024-02-17T12:18:19.347869+0000","last_peered":"2024-02-17T12:18:19.347869+0000","last_clean":"2024-02-17T12:18:19.347869+0000","last_became_active":"2024-02-17T12:18:19.343701+0000","last_became_peered":"2024-02-17T12:18:19.343701+0000","last_unstale":"2024-02-17T12:18:19.347869+0000","last_undegraded":"2024-02-17T12:18:19.347869+0000","last_fullsized":"2024-02-17T12:18:19.347869+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:54:15.066782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334914+0000","last_change":"2024-02-17T12:18:02.809740+0000","last_active":"2024-02-17T12:18:19.334914+0000","last_peered":"2024-02-17T12:18:19.334914+0000","last_clean":"2024-02-17T12:18:19.334914+0000","last_became_active":"2024-02-17T12:18:02.809407+0000","last_became_peered":"2024-02-17T12:18:02.809407+0000","last_unstale":"2024-02-17T12:18:19.334914+0000","last_undegraded":"2024-02-17T12:18:19.334914+0000","last_fullsized":"2024-02-17T12:18:19.334914+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338398+0000","last_change":"2024-02-17T12:18:01.794714+0000","last_active":"2024-02-17T12:18:19.338398+0000","last_peered":"2024-02-17T12:18:19.338398+0000","last_clean":"2024-02-17T12:18:19.338398+0000","last_became_active":"2024-02-17T12:18:01.794439+0000","last_became_peered":"2024-02-17T12:18:01.794439+0000","last_unstale":"2024-02-17T12:18:19.338398+0000","last_undegraded":"2024-02-17T12:18:19.338398+0000","last_fullsized":"2024-02-17T12:18:19.338398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333665+0000","last_change":"2024-02-17T12:18:19.333665+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333665+0000","last_undegraded":"2024-02-17T12:18:19.333665+0000","last_fullsized":"2024-02-17T12:18:19.333665+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360140+0000","last_change":"2024-02-17T12:18:19.353264+0000","last_active":"2024-02-17T12:18:19.360140+0000","last_peered":"2024-02-17T12:18:19.360140+0000","last_clean":"2024-02-17T12:18:19.360140+0000","last_became_active":"2024-02-17T12:18:19.352997+0000","last_became_peered":"2024-02-17T12:18:19.352997+0000","last_unstale":"2024-02-17T12:18:19.360140+0000","last_undegraded":"2024-02-17T12:18:19.360140+0000","last_fullsized":"2024-02-17T12:18:19.360140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:43.352769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344465+0000","last_change":"2024-02-17T12:18:02.794702+0000","last_active":"2024-02-17T12:18:19.344465+0000","last_peered":"2024-02-17T12:18:19.344465+0000","last_clean":"2024-02-17T12:18:19.344465+0000","last_became_active":"2024-02-17T12:18:02.794412+0000","last_became_peered":"2024-02-17T12:18:02.794412+0000","last_unstale":"2024-02-17T12:18:19.344465+0000","last_undegraded":"2024-02-17T12:18:19.344465+0000","last_fullsized":"2024-02-17T12:18:19.344465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:05:00.914700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.347492+0000","last_change":"2024-02-17T12:18:01.800872+0000","last_active":"2024-02-17T12:18:19.347492+0000","last_peered":"2024-02-17T12:18:19.347492+0000","last_clean":"2024-02-17T12:18:19.347492+0000","last_became_active":"2024-02-17T12:18:01.800563+0000","last_became_peered":"2024-02-17T12:18:01.800563+0000","last_unstale":"2024-02-17T12:18:19.347492+0000","last_undegraded":"2024-02-17T12:18:19.347492+0000","last_fullsized":"2024-02-17T12:18:19.347492+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:28.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.331009+0000","last_change":"2024-02-17T12:18:19.331009+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.331009+0000","last_undegraded":"2024-02-17T12:18:19.331009+0000","last_fullsized":"2024-02-17T12:18:19.331009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.352419+0000","last_change":"2024-02-17T12:18:19.346074+0000","last_active":"2024-02-17T12:18:19.352419+0000","last_peered":"2024-02-17T12:18:19.352419+0000","last_clean":"2024-02-17T12:18:19.352419+0000","last_became_active":"2024-02-17T12:18:19.344987+0000","last_became_peered":"2024-02-17T12:18:19.344987+0000","last_unstale":"2024-02-17T12:18:19.352419+0000","last_undegraded":"2024-02-17T12:18:19.352419+0000","last_fullsized":"2024-02-17T12:18:19.352419+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:36:50.709873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338347+0000","last_change":"2024-02-17T12:18:02.806343+0000","last_active":"2024-02-17T12:18:19.338347+0000","last_peered":"2024-02-17T12:18:19.338347+0000","last_clean":"2024-02-17T12:18:19.338347+0000","last_became_active":"2024-02-17T12:18:02.805514+0000","last_became_peered":"2024-02-17T12:18:02.805514+0000","last_unstale":"2024-02-17T12:18:19.338347+0000","last_undegraded":"2024-02-17T12:18:19.338347+0000","last_fullsized":"2024-02-17T12:18:19.338347+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:46.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330930+0000","last_change":"2024-02-17T12:18:01.801897+0000","last_active":"2024-02-17T12:18:19.330930+0000","last_peered":"2024-02-17T12:18:19.330930+0000","last_clean":"2024-02-17T12:18:19.330930+0000","last_became_active":"2024-02-17T12:18:01.801572+0000","last_became_peered":"2024-02-17T12:18:01.801572+0000","last_unstale":"2024-02-17T12:18:19.330930+0000","last_undegraded":"2024-02-17T12:18:19.330930+0000","last_fullsized":"2024-02-17T12:18:19.330930+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340349+0000","last_change":"2024-02-17T12:18:19.340349+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340349+0000","last_undegraded":"2024-02-17T12:18:19.340349+0000","last_fullsized":"2024-02-17T12:18:19.340349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.325895+0000","last_change":"2024-02-17T12:18:18.325895+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.325895+0000","last_undegraded":"2024-02-17T12:18:18.325895+0000","last_fullsized":"2024-02-17T12:18:18.325895+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342026+0000","last_change":"2024-02-17T12:18:02.808806+0000","last_active":"2024-02-17T12:18:19.342026+0000","last_peered":"2024-02-17T12:18:19.342026+0000","last_clean":"2024-02-17T12:18:19.342026+0000","last_became_active":"2024-02-17T12:18:02.808546+0000","last_became_peered":"2024-02-17T12:18:02.808546+0000","last_unstale":"2024-02-17T12:18:19.342026+0000","last_undegraded":"2024-02-17T12:18:19.342026+0000","last_fullsized":"2024-02-17T12:18:19.342026+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:25.157077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344522+0000","last_change":"2024-02-17T12:18:01.798282+0000","last_active":"2024-02-17T12:18:19.344522+0000","last_peered":"2024-02-17T12:18:19.344522+0000","last_clean":"2024-02-17T12:18:19.344522+0000","last_became_active":"2024-02-17T12:18:01.797970+0000","last_became_peered":"2024-02-17T12:18:01.797970+0000","last_unstale":"2024-02-17T12:18:19.344522+0000","last_undegraded":"2024-02-17T12:18:19.344522+0000","last_fullsized":"2024-02-17T12:18:19.344522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:52:16.655449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339895+0000","last_change":"2024-02-17T12:18:19.339895+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339895+0000","last_undegraded":"2024-02-17T12:18:19.339895+0000","last_fullsized":"2024-02-17T12:18:19.339895+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.359996+0000","last_change":"2024-02-17T12:18:19.351990+0000","last_active":"2024-02-17T12:18:19.359996+0000","last_peered":"2024-02-17T12:18:19.359996+0000","last_clean":"2024-02-17T12:18:19.359996+0000","last_became_active":"2024-02-17T12:18:19.350808+0000","last_became_peered":"2024-02-17T12:18:19.350808+0000","last_unstale":"2024-02-17T12:18:19.359996+0000","last_undegraded":"2024-02-17T12:18:19.359996+0000","last_fullsized":"2024-02-17T12:18:19.359996+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:09.209961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332488+0000","last_change":"2024-02-17T12:18:02.808303+0000","last_active":"2024-02-17T12:18:18.332488+0000","last_peered":"2024-02-17T12:18:18.332488+0000","last_clean":"2024-02-17T12:18:18.332488+0000","last_became_active":"2024-02-17T12:18:02.807743+0000","last_became_peered":"2024-02-17T12:18:02.807743+0000","last_unstale":"2024-02-17T12:18:18.332488+0000","last_undegraded":"2024-02-17T12:18:18.332488+0000","last_fullsized":"2024-02-17T12:18:18.332488+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:55.025562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.328460+0000","last_change":"2024-02-17T12:18:01.802694+0000","last_active":"2024-02-17T12:18:18.328460+0000","last_peered":"2024-02-17T12:18:18.328460+0000","last_clean":"2024-02-17T12:18:18.328460+0000","last_became_active":"2024-02-17T12:18:01.802326+0000","last_became_peered":"2024-02-17T12:18:01.802326+0000","last_unstale":"2024-02-17T12:18:18.328460+0000","last_undegraded":"2024-02-17T12:18:18.328460+0000","last_fullsized":"2024-02-17T12:18:18.328460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:33:51.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:18:19.322208+0000","last_change":"2024-02-17T12:18:19.322208+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.322208+0000","last_undegraded":"2024-02-17T12:18:19.322208+0000","last_fullsized":"2024-02-17T12:18:19.322208+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-02-17T12:18:18.331713+0000","last_change":"2024-02-17T12:18:18.331713+0000","last_active":"2024-02-17T12:18:18.315883+0000","last_peered":"2024-02-17T12:18:18.315883+0000","last_clean":"2024-02-17T12:18:18.315883+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:18.331713+0000","last_undegraded":"2024-02-17T12:18:18.331713+0000","last_fullsized":"2024-02-17T12:18:18.331713+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340613+0000","last_change":"2024-02-17T12:18:02.805983+0000","last_active":"2024-02-17T12:18:19.340613+0000","last_peered":"2024-02-17T12:18:19.340613+0000","last_clean":"2024-02-17T12:18:19.340613+0000","last_became_active":"2024-02-17T12:18:02.805699+0000","last_became_peered":"2024-02-17T12:18:02.805699+0000","last_unstale":"2024-02-17T12:18:19.340613+0000","last_undegraded":"2024-02-17T12:18:19.340613+0000","last_fullsized":"2024-02-17T12:18:19.340613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:44.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341772+0000","last_change":"2024-02-17T12:18:01.801438+0000","last_active":"2024-02-17T12:18:19.341772+0000","last_peered":"2024-02-17T12:18:19.341772+0000","last_clean":"2024-02-17T12:18:19.341772+0000","last_became_active":"2024-02-17T12:18:01.801221+0000","last_became_peered":"2024-02-17T12:18:01.801221+0000","last_unstale":"2024-02-17T12:18:19.341772+0000","last_undegraded":"2024-02-17T12:18:19.341772+0000","last_fullsized":"2024-02-17T12:18:19.341772+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:09.649370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335807+0000","last_change":"2024-02-17T12:18:19.335807+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335807+0000","last_undegraded":"2024-02-17T12:18:19.335807+0000","last_fullsized":"2024-02-17T12:18:19.335807+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.353618+0000","last_change":"2024-02-17T12:18:19.350524+0000","last_active":"2024-02-17T12:18:19.353618+0000","last_peered":"2024-02-17T12:18:19.353618+0000","last_clean":"2024-02-17T12:18:19.353618+0000","last_became_active":"2024-02-17T12:18:19.350237+0000","last_became_peered":"2024-02-17T12:18:19.350237+0000","last_unstale":"2024-02-17T12:18:19.353618+0000","last_undegraded":"2024-02-17T12:18:19.353618+0000","last_fullsized":"2024-02-17T12:18:19.353618+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:28.434400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341774+0000","last_change":"2024-02-17T12:18:02.806745+0000","last_active":"2024-02-17T12:18:19.341774+0000","last_peered":"2024-02-17T12:18:19.341774+0000","last_clean":"2024-02-17T12:18:19.341774+0000","last_became_active":"2024-02-17T12:18:02.806429+0000","last_became_peered":"2024-02-17T12:18:02.806429+0000","last_unstale":"2024-02-17T12:18:19.341774+0000","last_undegraded":"2024-02-17T12:18:19.341774+0000","last_fullsized":"2024-02-17T12:18:19.341774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:58.938533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338923+0000","last_change":"2024-02-17T12:18:01.793256+0000","last_active":"2024-02-17T12:18:19.338923+0000","last_peered":"2024-02-17T12:18:19.338923+0000","last_clean":"2024-02-17T12:18:19.338923+0000","last_became_active":"2024-02-17T12:18:01.793033+0000","last_became_peered":"2024-02-17T12:18:01.793033+0000","last_unstale":"2024-02-17T12:18:19.338923+0000","last_undegraded":"2024-02-17T12:18:19.338923+0000","last_fullsized":"2024-02-17T12:18:19.338923+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:46.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332591+0000","last_change":"2024-02-17T12:18:19.332591+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332591+0000","last_undegraded":"2024-02-17T12:18:19.332591+0000","last_fullsized":"2024-02-17T12:18:19.332591+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355617+0000","last_change":"2024-02-17T12:18:19.349950+0000","last_active":"2024-02-17T12:18:19.355617+0000","last_peered":"2024-02-17T12:18:19.355617+0000","last_clean":"2024-02-17T12:18:19.355617+0000","last_became_active":"2024-02-17T12:18:19.349690+0000","last_became_peered":"2024-02-17T12:18:19.349690+0000","last_unstale":"2024-02-17T12:18:19.355617+0000","last_undegraded":"2024-02-17T12:18:19.355617+0000","last_fullsized":"2024-02-17T12:18:19.355617+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:49.360736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338823+0000","last_change":"2024-02-17T12:18:02.800813+0000","last_active":"2024-02-17T12:18:19.338823+0000","last_peered":"2024-02-17T12:18:19.338823+0000","last_clean":"2024-02-17T12:18:19.338823+0000","last_became_active":"2024-02-17T12:18:02.800551+0000","last_became_peered":"2024-02-17T12:18:02.800551+0000","last_unstale":"2024-02-17T12:18:19.338823+0000","last_undegraded":"2024-02-17T12:18:19.338823+0000","last_fullsized":"2024-02-17T12:18:19.338823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:47:58.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345656+0000","last_change":"2024-02-17T12:18:01.796062+0000","last_active":"2024-02-17T12:18:19.345656+0000","last_peered":"2024-02-17T12:18:19.345656+0000","last_clean":"2024-02-17T12:18:19.345656+0000","last_became_active":"2024-02-17T12:18:01.795616+0000","last_became_peered":"2024-02-17T12:18:01.795616+0000","last_unstale":"2024-02-17T12:18:19.345656+0000","last_undegraded":"2024-02-17T12:18:19.345656+0000","last_fullsized":"2024-02-17T12:18:19.345656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:04:59.908240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-02-17T12:18:18.332342+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:18:18.332342+0000","last_peered":"2024-02-17T12:18:18.332342+0000","last_clean":"2024-02-17T12:18:18.332342+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:18:18.332342+0000","last_undegraded":"2024-02-17T12:18:18.332342+0000","last_fullsized":"2024-02-17T12:18:18.332342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":5},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509468,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":254820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88700000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":1.115,"15min":1.115},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88500000000000001,"5min":1.143,"15min":1.143},"last":0.76800000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88700000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.90800000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.02},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.0049999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0669999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":622592,"data_stored":262602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.378}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.439},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.66800000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":262006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.44},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.621,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":1.387,"15min":1.387},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.497,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.714,"15min":1.714},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.744,"15min":1.744},"last":0.90200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91500000000000004,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.91600000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.002,"5min":1.575,"15min":1.575},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96899999999999997,"5min":1.321,"15min":1.321},"last":0.95099999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":262040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64200000000000002,"5min":1.145,"15min":1.145},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.34000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69499999999999995,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58099999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73799999999999999,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":2.609,"15min":2.609},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.079,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.90700000000000003,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.997,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.05,"5min":1.095,"15min":1.095},"last":0.70299999999999996}]},{"osd":6,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0469999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0820000000000001,"5min":5.375,"15min":5.375},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":1.0169999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.091,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.629,"15min":1.629},"last":0.72499999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1224704,"data_stored":856015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47899999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45900000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45100000000000001,"15min":0.45700000000000002},"min":{"1min":0.312,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":1.046,"15min":1.046},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.58699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0129999999999999,"5min":1.139,"15min":1.139},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92800000000000005,"5min":1.038,"15min":1.038},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94499999999999995,"5min":1.095,"15min":1.095},"last":0.746}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0960000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90200000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.84499999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1204224,"data_stored":845348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84899999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.73099999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75700000000000001,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92400000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.79800000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90000000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.38500000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86799999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.43099999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95099999999999996,"5min":1.052,"15min":1.052},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.40899999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":614400,"data_stored":257935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86799999999999999,"5min":1.264,"15min":1.264},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.198,"15min":1.198},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.171,"15min":1.171},"last":0.65900000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.745},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93600000000000005,"5min":1.522,"15min":1.522},"last":0.69299999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89900000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70299999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88100000000000001,"5min":1.228,"15min":1.228},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.68300000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":610304,"data_stored":254876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.434},{"interface":"front","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.141,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93300000000000005,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.58199999999999996}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2749999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.997,"5min":1.252,"15min":1.252},"last":0.55400000000000005}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91500000000000004,"5min":1.29,"15min":1.29},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":1.337,"15min":1.337},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:18:25.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2024-02-17T12:18:25.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.337103+0000', 'last_change': '2024-02-17T12:18:19.337103+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.337103+0000', 'last_undegraded': '2024-02-17T12:18:19.337103+0000', 'last_fullsized': '2024-02-17T12:18:19.337103+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:18:25.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2024-02-17T12:18:25.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.341116+0000', 'last_change': '2024-02-17T12:18:19.341116+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.341116+0000', 'last_undegraded': '2024-02-17T12:18:19.341116+0000', 'last_fullsized': '2024-02-17T12:18:19.341116+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:18:25.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2024-02-17T12:18:25.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2024-02-17T12:18:25.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.335776+0000', 'last_change': '2024-02-17T12:18:19.335776+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.335776+0000', 'last_undegraded': '2024-02-17T12:18:19.335776+0000', 'last_fullsized': '2024-02-17T12:18:19.335776+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:18:25.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2024-02-17T12:18:25.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.332409+0000', 'last_change': '2024-02-17T12:18:19.332409+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.332409+0000', 'last_undegraded': '2024-02-17T12:18:19.332409+0000', 'last_fullsized': '2024-02-17T12:18:19.332409+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:18:25.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2024-02-17T12:18:25.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.339125+0000', 'last_change': '2024-02-17T12:18:19.339125+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.339125+0000', 'last_undegraded': '2024-02-17T12:18:19.339125+0000', 'last_fullsized': '2024-02-17T12:18:19.339125+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:18:25.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2024-02-17T12:18:25.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2024-02-17T12:18:25.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.340431+0000', 'last_change': '2024-02-17T12:18:19.340431+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.340431+0000', 'last_undegraded': '2024-02-17T12:18:19.340431+0000', 'last_fullsized': '2024-02-17T12:18:19.340431+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:18:25.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2024-02-17T12:18:25.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2024-02-17T12:18:25.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.342320+0000', 'last_change': '2024-02-17T12:18:19.342320+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.342320+0000', 'last_undegraded': '2024-02-17T12:18:19.342320+0000', 'last_fullsized': '2024-02-17T12:18:19.342320+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:18:25.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2024-02-17T12:18:25.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2024-02-17T12:18:25.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2024-02-17T12:18:25.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.335567+0000', 'last_change': '2024-02-17T12:18:19.335567+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.335567+0000', 'last_undegraded': '2024-02-17T12:18:19.335567+0000', 'last_fullsized': '2024-02-17T12:18:19.335567+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.332924+0000', 'last_change': '2024-02-17T12:18:19.332924+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.332924+0000', 'last_undegraded': '2024-02-17T12:18:19.332924+0000', 'last_fullsized': '2024-02-17T12:18:19.332924+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.340057+0000', 'last_change': '2024-02-17T12:18:19.340057+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.340057+0000', 'last_undegraded': '2024-02-17T12:18:19.340057+0000', 'last_fullsized': '2024-02-17T12:18:19.340057+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.333193+0000', 'last_change': '2024-02-17T12:18:19.333193+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.333193+0000', 'last_undegraded': '2024-02-17T12:18:19.333193+0000', 'last_fullsized': '2024-02-17T12:18:19.333193+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T12:18:25.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.342713+0000', 'last_change': '2024-02-17T12:18:19.342713+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.342713+0000', 'last_undegraded': '2024-02-17T12:18:19.342713+0000', 'last_fullsized': '2024-02-17T12:18:19.342713+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2024-02-17T12:18:25.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2024-02-17T12:18:25.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.336674+0000', 'last_change': '2024-02-17T12:18:19.336674+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.336674+0000', 'last_undegraded': '2024-02-17T12:18:19.336674+0000', 'last_fullsized': '2024-02-17T12:18:19.336674+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:18:25.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2024-02-17T12:18:25.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2024-02-17T12:18:25.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2024-02-17T12:18:25.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.332446+0000', 'last_change': '2024-02-17T12:18:19.332446+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.332446+0000', 'last_undegraded': '2024-02-17T12:18:19.332446+0000', 'last_fullsized': '2024-02-17T12:18:19.332446+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:18:25.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2024-02-17T12:18:25.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.329892+0000', 'last_change': '2024-02-17T12:18:19.329892+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.329892+0000', 'last_undegraded': '2024-02-17T12:18:19.329892+0000', 'last_fullsized': '2024-02-17T12:18:19.329892+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.335592+0000', 'last_change': '2024-02-17T12:18:19.335592+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.335592+0000', 'last_undegraded': '2024-02-17T12:18:19.335592+0000', 'last_fullsized': '2024-02-17T12:18:19.335592+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.339441+0000', 'last_change': '2024-02-17T12:18:19.339441+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.339441+0000', 'last_undegraded': '2024-02-17T12:18:19.339441+0000', 'last_fullsized': '2024-02-17T12:18:19.339441+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.333734+0000', 'last_change': '2024-02-17T12:18:19.333734+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.333734+0000', 'last_undegraded': '2024-02-17T12:18:19.333734+0000', 'last_fullsized': '2024-02-17T12:18:19.333734+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.343199+0000', 'last_change': '2024-02-17T12:18:19.343199+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.343199+0000', 'last_undegraded': '2024-02-17T12:18:19.343199+0000', 'last_fullsized': '2024-02-17T12:18:19.343199+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:18.326340+0000', 'last_change': '2024-02-17T12:18:18.326340+0000', 'last_active': '2024-02-17T12:18:18.315883+0000', 'last_peered': '2024-02-17T12:18:18.315883+0000', 'last_clean': '2024-02-17T12:18:18.315883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:18.326340+0000', 'last_undegraded': '2024-02-17T12:18:18.326340+0000', 'last_fullsized': '2024-02-17T12:18:18.326340+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:18:25.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:18.331676+0000', 'last_change': '2024-02-17T12:18:18.331676+0000', 'last_active': '2024-02-17T12:18:18.315883+0000', 'last_peered': '2024-02-17T12:18:18.315883+0000', 'last_clean': '2024-02-17T12:18:18.315883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:18.331676+0000', 'last_undegraded': '2024-02-17T12:18:18.331676+0000', 'last_fullsized': '2024-02-17T12:18:18.331676+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2024-02-17T12:18:25.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.335113+0000', 'last_change': '2024-02-17T12:18:19.335113+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.335113+0000', 'last_undegraded': '2024-02-17T12:18:19.335113+0000', 'last_fullsized': '2024-02-17T12:18:19.335113+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T12:18:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2024-02-17T12:18:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:18.331699+0000', 'last_change': '2024-02-17T12:18:18.331699+0000', 'last_active': '2024-02-17T12:18:18.315883+0000', 'last_peered': '2024-02-17T12:18:18.315883+0000', 'last_clean': '2024-02-17T12:18:18.315883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:18.331699+0000', 'last_undegraded': '2024-02-17T12:18:18.331699+0000', 'last_fullsized': '2024-02-17T12:18:18.331699+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:18:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2024-02-17T12:18:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.330276+0000', 'last_change': '2024-02-17T12:18:19.330276+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.330276+0000', 'last_undegraded': '2024-02-17T12:18:19.330276+0000', 'last_fullsized': '2024-02-17T12:18:19.330276+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:18:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2024-02-17T12:18:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2024-02-17T12:18:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.340864+0000', 'last_change': '2024-02-17T12:18:19.340864+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.340864+0000', 'last_undegraded': '2024-02-17T12:18:19.340864+0000', 'last_fullsized': '2024-02-17T12:18:19.340864+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:18:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2024-02-17T12:18:25.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2024-02-17T12:18:25.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.329959+0000', 'last_change': '2024-02-17T12:18:19.329959+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.329959+0000', 'last_undegraded': '2024-02-17T12:18:19.329959+0000', 'last_fullsized': '2024-02-17T12:18:19.329959+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:18:25.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2024-02-17T12:18:25.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:18.326370+0000', 'last_change': '2024-02-17T12:18:18.326370+0000', 'last_active': '2024-02-17T12:18:18.315883+0000', 'last_peered': '2024-02-17T12:18:18.315883+0000', 'last_clean': '2024-02-17T12:18:18.315883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:18.326370+0000', 'last_undegraded': '2024-02-17T12:18:18.326370+0000', 'last_fullsized': '2024-02-17T12:18:18.326370+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:18:25.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2024-02-17T12:18:25.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2024-02-17T12:18:25.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.334337+0000', 'last_change': '2024-02-17T12:18:19.334337+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.334337+0000', 'last_undegraded': '2024-02-17T12:18:19.334337+0000', 'last_fullsized': '2024-02-17T12:18:19.334337+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T12:18:25.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2024-02-17T12:18:25.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2024-02-17T12:18:25.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:18.326306+0000', 'last_change': '2024-02-17T12:18:18.326306+0000', 'last_active': '2024-02-17T12:18:18.315883+0000', 'last_peered': '2024-02-17T12:18:18.315883+0000', 'last_clean': '2024-02-17T12:18:18.315883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:18.326306+0000', 'last_undegraded': '2024-02-17T12:18:18.326306+0000', 'last_fullsized': '2024-02-17T12:18:18.326306+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:18:25.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2024-02-17T12:18:25.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2024-02-17T12:18:25.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.330408+0000', 'last_change': '2024-02-17T12:18:19.330408+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.330408+0000', 'last_undegraded': '2024-02-17T12:18:19.330408+0000', 'last_fullsized': '2024-02-17T12:18:19.330408+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:18:25.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2024-02-17T12:18:25.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.341864+0000', 'last_change': '2024-02-17T12:18:19.341864+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.341864+0000', 'last_undegraded': '2024-02-17T12:18:19.341864+0000', 'last_fullsized': '2024-02-17T12:18:19.341864+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:18:25.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2024-02-17T12:18:25.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2024-02-17T12:18:25.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:18.333710+0000', 'last_change': '2024-02-17T12:18:18.333710+0000', 'last_active': '2024-02-17T12:18:18.315883+0000', 'last_peered': '2024-02-17T12:18:18.315883+0000', 'last_clean': '2024-02-17T12:18:18.315883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:18.333710+0000', 'last_undegraded': '2024-02-17T12:18:18.333710+0000', 'last_fullsized': '2024-02-17T12:18:18.333710+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:18:25.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2024-02-17T12:18:25.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2024-02-17T12:18:25.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2024-02-17T12:18:25.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:18.325904+0000', 'last_change': '2024-02-17T12:18:18.325904+0000', 'last_active': '2024-02-17T12:18:18.315883+0000', 'last_peered': '2024-02-17T12:18:18.315883+0000', 'last_clean': '2024-02-17T12:18:18.315883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:18.325904+0000', 'last_undegraded': '2024-02-17T12:18:18.325904+0000', 'last_fullsized': '2024-02-17T12:18:18.325904+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:18:25.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2024-02-17T12:18:25.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.333949+0000', 'last_change': '2024-02-17T12:18:19.333949+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.333949+0000', 'last_undegraded': '2024-02-17T12:18:19.333949+0000', 'last_fullsized': '2024-02-17T12:18:19.333949+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:18:25.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2024-02-17T12:18:25.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.333047+0000', 'last_change': '2024-02-17T12:18:19.333047+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.333047+0000', 'last_undegraded': '2024-02-17T12:18:19.333047+0000', 'last_fullsized': '2024-02-17T12:18:19.333047+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:18:25.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2024-02-17T12:18:25.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.339057+0000', 'last_change': '2024-02-17T12:18:19.339057+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.339057+0000', 'last_undegraded': '2024-02-17T12:18:19.339057+0000', 'last_fullsized': '2024-02-17T12:18:19.339057+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:18:25.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2024-02-17T12:18:25.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2024-02-17T12:18:25.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:18.331766+0000', 'last_change': '2024-02-17T12:18:18.331766+0000', 'last_active': '2024-02-17T12:18:18.315883+0000', 'last_peered': '2024-02-17T12:18:18.315883+0000', 'last_clean': '2024-02-17T12:18:18.315883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:18.331766+0000', 'last_undegraded': '2024-02-17T12:18:18.331766+0000', 'last_fullsized': '2024-02-17T12:18:18.331766+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:18:25.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2024-02-17T12:18:25.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2024-02-17T12:18:25.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.333665+0000', 'last_change': '2024-02-17T12:18:19.333665+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.333665+0000', 'last_undegraded': '2024-02-17T12:18:19.333665+0000', 'last_fullsized': '2024-02-17T12:18:19.333665+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-17T12:18:25.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2024-02-17T12:18:25.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.331009+0000', 'last_change': '2024-02-17T12:18:19.331009+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.331009+0000', 'last_undegraded': '2024-02-17T12:18:19.331009+0000', 'last_fullsized': '2024-02-17T12:18:19.331009+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.340349+0000', 'last_change': '2024-02-17T12:18:19.340349+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.340349+0000', 'last_undegraded': '2024-02-17T12:18:19.340349+0000', 'last_fullsized': '2024-02-17T12:18:19.340349+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:18.325895+0000', 'last_change': '2024-02-17T12:18:18.325895+0000', 'last_active': '2024-02-17T12:18:18.315883+0000', 'last_peered': '2024-02-17T12:18:18.315883+0000', 'last_clean': '2024-02-17T12:18:18.315883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:18.325895+0000', 'last_undegraded': '2024-02-17T12:18:18.325895+0000', 'last_fullsized': '2024-02-17T12:18:18.325895+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.339895+0000', 'last_change': '2024-02-17T12:18:19.339895+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.339895+0000', 'last_undegraded': '2024-02-17T12:18:19.339895+0000', 'last_fullsized': '2024-02-17T12:18:19.339895+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:18:19.322208+0000', 'last_change': '2024-02-17T12:18:19.322208+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.322208+0000', 'last_undegraded': '2024-02-17T12:18:19.322208+0000', 'last_fullsized': '2024-02-17T12:18:19.322208+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:18.331713+0000', 'last_change': '2024-02-17T12:18:18.331713+0000', 'last_active': '2024-02-17T12:18:18.315883+0000', 'last_peered': '2024-02-17T12:18:18.315883+0000', 'last_clean': '2024-02-17T12:18:18.315883+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:18.331713+0000', 'last_undegraded': '2024-02-17T12:18:18.331713+0000', 'last_fullsized': '2024-02-17T12:18:18.331713+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:18.315883+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:18:25.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2024-02-17T12:18:25.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.335807+0000', 'last_change': '2024-02-17T12:18:19.335807+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.335807+0000', 'last_undegraded': '2024-02-17T12:18:19.335807+0000', 'last_fullsized': '2024-02-17T12:18:19.335807+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-17T12:18:25.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2024-02-17T12:18:25.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:18:19.332591+0000', 'last_change': '2024-02-17T12:18:19.332591+0000', 'last_active': '2024-02-17T12:18:19.322208+0000', 'last_peered': '2024-02-17T12:18:19.322208+0000', 'last_clean': '2024-02-17T12:18:19.322208+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:18:19.332591+0000', 'last_undegraded': '2024-02-17T12:18:19.332591+0000', 'last_fullsized': '2024-02-17T12:18:19.332591+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'last_clean_scrub_stamp': '2024-02-17T12:18:19.322208+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-17T12:18:25.277 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-17T12:18:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.409+0000 7f86e2800640 1 Processor -- start 2024-02-17T12:18:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.409+0000 7f86e2800640 1 -- start start 2024-02-17T12:18:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.409+0000 7f86e2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86dc148760 0x7f86dc071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.409+0000 7f86e2800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86dc0c5680 0x7f86dc152470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.409+0000 7f86e2800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86dc1529b0 con 0x7f86dc155730 2024-02-17T12:18:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.409+0000 7f86e2800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86dc155030 con 0x7f86dc148760 2024-02-17T12:18:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.409+0000 7f86e2800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc155310 con 0x7f86dc0c5680 2024-02-17T12:18:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86db400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86dc148760 0x7f86dc071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86db400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86dc148760 0x7f86dc071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48324/0 (socket says 172.21.15.114:48324) 2024-02-17T12:18:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86db400640 1 -- 172.21.15.114:0/3313085292 learned_addr learned my addr 172.21.15.114:0/3313085292 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86daa00640 1 --2- 172.21.15.114:0/3313085292 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86dc0c5680 0x7f86dc152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86db400640 1 -- 172.21.15.114:0/3313085292 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86dc0c5680 msgr2=0x7f86dc152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86db400640 1 --2- 172.21.15.114:0/3313085292 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86dc0c5680 0x7f86dc152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86db400640 1 -- 172.21.15.114:0/3313085292 >> v1:172.21.15.116:6789/0 conn(0x7f86dc155730 legacy=0x7f86dc0c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86db400640 1 -- 172.21.15.114:0/3313085292 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0c5c00 con 0x7f86dc148760 2024-02-17T12:18:25.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86db400640 1 --2- 172.21.15.114:0/3313085292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc148760 0x7f86dc071dc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009e50 tx=0x7f86cc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8dade66cf50b45 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:25.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86da000640 1 -- 172.21.15.114:0/3313085292 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0a55f0 con 0x7f86dc148760 2024-02-17T12:18:25.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86da000640 1 -- 172.21.15.114:0/3313085292 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc0a5750 con 0x7f86dc148760 2024-02-17T12:18:25.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.413+0000 7f86da000640 1 -- 172.21.15.114:0/3313085292 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0a5ae0 con 0x7f86dc148760 2024-02-17T12:18:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 -- 172.21.15.114:0/3313085292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc148760 msgr2=0x7f86dc071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 --2- 172.21.15.114:0/3313085292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc148760 0x7f86dc071dc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009e50 tx=0x7f86cc01ca30 comp rx=0 tx=0).stop 2024-02-17T12:18:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 -- 172.21.15.114:0/3313085292 shutdown_connections 2024-02-17T12:18:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 --2- 172.21.15.114:0/3313085292 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86dc0c5680 0x7f86dc152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 --2- 172.21.15.114:0/3313085292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc148760 0x7f86dc071dc0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 -- 172.21.15.114:0/3313085292 >> 172.21.15.114:0/3313085292 conn(0x7f86dc0c6550 msgr2=0x7f86dc0c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 -- 172.21.15.114:0/3313085292 shutdown_connections 2024-02-17T12:18:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 -- 172.21.15.114:0/3313085292 wait complete. 2024-02-17T12:18:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 Processor -- start 2024-02-17T12:18:25.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 -- start start 2024-02-17T12:18:25.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc0c5680 0x7f86dc1ee400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86dc148760 0x7f86dc0bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86dc155730 0x7f86dc1434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc1ee940 con 0x7f86dc0c5680 2024-02-17T12:18:25.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc14c110 con 0x7f86dc155730 2024-02-17T12:18:25.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86e2800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc06dbf0 con 0x7f86dc148760 2024-02-17T12:18:25.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86db400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc0c5680 0x7f86dc1ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86db400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc0c5680 0x7f86dc1ee400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48328/0 (socket says 172.21.15.114:48328) 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86db400640 1 -- 172.21.15.114:0/2781603024 learned_addr learned my addr 172.21.15.114:0/2781603024 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86dbe00640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86dc155730 0x7f86dc1434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86db400640 1 -- 172.21.15.114:0/2781603024 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86dc148760 msgr2=0x7f86dc0bfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86db400640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86dc148760 0x7f86dc0bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86db400640 1 -- 172.21.15.114:0/2781603024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86dc155730 msgr2=0x7f86dc1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86db400640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86dc155730 0x7f86dc1434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86db400640 1 -- 172.21.15.114:0/2781603024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc009b30 con 0x7f86dc0c5680 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86dbe00640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86dc155730 0x7f86dc1434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.417+0000 7f86db400640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc0c5680 0x7f86dc1ee400 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0af040 tx=0x7f86cc0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86d3400640 1 -- 172.21.15.114:0/2781603024 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0b8880 con 0x7f86dc0c5680 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86d3400640 1 -- 172.21.15.114:0/2781603024 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc0b8a20 con 0x7f86dc0c5680 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86d3400640 1 -- 172.21.15.114:0/2781603024 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0b8dd0 con 0x7f86dc0c5680 2024-02-17T12:18:25.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86e2800640 1 -- 172.21.15.114:0/2781603024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86dc14c380 con 0x7f86dc0c5680 2024-02-17T12:18:25.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86e2800640 1 -- 172.21.15.114:0/2781603024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc06ded0 con 0x7f86dc0c5680 2024-02-17T12:18:25.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86e2800640 1 -- 172.21.15.114:0/2781603024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86dc074840 con 0x7f86dc0c5680 2024-02-17T12:18:25.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86d3400640 1 -- 172.21.15.114:0/2781603024 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f86cc0c2410 con 0x7f86dc0c5680 2024-02-17T12:18:25.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86d3400640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f86bc066e70 0x7f86bc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86d3400640 1 -- 172.21.15.114:0/2781603024 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f86cc11fe50 con 0x7f86dc0c5680 2024-02-17T12:18:25.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86daa00640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f86bc066e70 0x7f86bc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.421+0000 7f86daa00640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f86bc066e70 0x7f86bc069330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098f0 tx=0x7f86c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:25.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.425+0000 7f86d3400640 1 -- 172.21.15.114:0/2781603024 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f86cc0eca30 con 0x7f86dc0c5680 2024-02-17T12:18:25.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.633+0000 7f86e2800640 1 -- 172.21.15.114:0/2781603024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f86dc06ebb0 con 0x7f86dc0c5680 2024-02-17T12:18:25.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.633+0000 7f86d3400640 1 -- 172.21.15.114:0/2781603024 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1749 (secure 0 0 0) 0x7f86cc009510 con 0x7f86dc0c5680 2024-02-17T12:18:25.639 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:25.639 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":147,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1708172169,"num_in_osds":8,"osd_in_since":1708172160,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":158},{"state_name":"creating+peering","count":35}],"num_pgs":193,"num_pools":5,"num_objects":32,"data_bytes":594863,"bytes_used":236150784,"bytes_avail":772857962496,"bytes_total":773094113280,"inactive_pgs_ratio":0.18134714663028717,"write_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":38,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":5703},{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5709}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-02-17T12:17:11.226618+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-17T12:18:25.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 -- 172.21.15.114:0/2781603024 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f86bc066e70 msgr2=0x7f86bc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f86bc066e70 0x7f86bc069330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098f0 tx=0x7f86c8008040 comp rx=0 tx=0).stop 2024-02-17T12:18:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 -- 172.21.15.114:0/2781603024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc0c5680 msgr2=0x7f86dc1ee400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc0c5680 0x7f86dc1ee400 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0af040 tx=0x7f86cc0197d0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 -- 172.21.15.114:0/2781603024 shutdown_connections 2024-02-17T12:18:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86dc155730 0x7f86dc1434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86dc148760 0x7f86dc0bfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f86bc066e70 0x7f86bc069330 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 --2- 172.21.15.114:0/2781603024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86dc0c5680 0x7f86dc1ee400 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 -- 172.21.15.114:0/2781603024 >> 172.21.15.114:0/2781603024 conn(0x7f86dc0c6550 msgr2=0x7f86dc0c2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 -- 172.21.15.114:0/2781603024 shutdown_connections 2024-02-17T12:18:25.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.637+0000 7f86e2800640 1 -- 172.21.15.114:0/2781603024 wait complete. 2024-02-17T12:18:25.659 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-17T12:18:25.660 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:18:25.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.789+0000 7fd30fe00640 1 Processor -- start 2024-02-17T12:18:25.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.789+0000 7fd30fe00640 1 -- start start 2024-02-17T12:18:25.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd30fe00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd3080c6460 0x7fd30806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd30fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd308155dd0 con 0x7fd308152540 2024-02-17T12:18:25.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd30fe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3081588c0 con 0x7fd308154e30 2024-02-17T12:18:25.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd30fe00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd308155810 con 0x7fd3080c6460 2024-02-17T12:18:25.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd30d400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd308152540 0x7fd308158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60146/0 (socket says 172.21.15.114:60146) 2024-02-17T12:18:25.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd30d400640 1 -- 172.21.15.114:0/835709245 learned_addr learned my addr 172.21.15.114:0/835709245 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:25.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd30ca00640 1 --2- 172.21.15.114:0/835709245 >> v2:172.21.15.116:3300/0 conn(0x7fd3080c6460 0x7fd30806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd307e00640 1 -- 172.21.15.114:0/835709245 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181874268 0 0) 0x7fd308155dd0 con 0x7fd308152540 2024-02-17T12:18:25.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd307e00640 1 -- 172.21.15.114:0/835709245 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f0003530 con 0x7fd308152540 2024-02-17T12:18:25.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd307e00640 1 -- 172.21.15.114:0/835709245 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853220121 0 0) 0x7fd3081588c0 con 0x7fd308154e30 2024-02-17T12:18:25.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd307e00640 1 -- 172.21.15.114:0/835709245 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd308155dd0 con 0x7fd308154e30 2024-02-17T12:18:25.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd30ca00640 1 -- 172.21.15.114:0/835709245 >> v1:172.21.15.116:6789/0 conn(0x7fd308154e30 legacy=0x7fd3080aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd30ca00640 1 -- 172.21.15.114:0/835709245 >> v1:172.21.15.114:6789/0 conn(0x7fd308152540 legacy=0x7fd308158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd307e00640 1 -- 172.21.15.114:0/835709245 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3262849634 0 0) 0x7fd2f0003530 con 0x7fd308152540 2024-02-17T12:18:25.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.793+0000 7fd30ca00640 1 -- 172.21.15.114:0/835709245 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308155af0 con 0x7fd3080c6460 2024-02-17T12:18:25.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd30ca00640 1 --2- 172.21.15.114:0/835709245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3080c6460 0x7fd30806ff80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40097c0 tx=0x7fd2f401c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3040ac858afae3e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:25.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd307e00640 1 -- 172.21.15.114:0/835709245 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc001a00 con 0x7fd3080c6460 2024-02-17T12:18:25.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd307e00640 1 -- 172.21.15.114:0/835709245 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f40a7050 con 0x7fd3080c6460 2024-02-17T12:18:25.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd307e00640 1 -- 172.21.15.114:0/835709245 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40ab620 con 0x7fd3080c6460 2024-02-17T12:18:25.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd30fe00640 1 -- 172.21.15.114:0/835709245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3080c6460 msgr2=0x7fd30806ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd30fe00640 1 --2- 172.21.15.114:0/835709245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3080c6460 0x7fd30806ff80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40097c0 tx=0x7fd2f401c2a0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd30fe00640 1 -- 172.21.15.114:0/835709245 shutdown_connections 2024-02-17T12:18:25.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd30fe00640 1 --2- 172.21.15.114:0/835709245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3080c6460 0x7fd30806ff80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd30fe00640 1 -- 172.21.15.114:0/835709245 >> 172.21.15.114:0/835709245 conn(0x7fd3080c4f20 msgr2=0x7fd3080c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:25.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd30fe00640 1 -- 172.21.15.114:0/835709245 shutdown_connections 2024-02-17T12:18:25.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd30fe00640 1 -- 172.21.15.114:0/835709245 wait complete. 2024-02-17T12:18:25.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd30fe00640 1 Processor -- start 2024-02-17T12:18:25.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.797+0000 7fd30fe00640 1 -- start start 2024-02-17T12:18:25.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3080c6460 0x7fd30806bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd308152540 0x7fd308157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd308154e30 0x7fd3081457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3081ee230 con 0x7fd308154e30 2024-02-17T12:18:25.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308156130 con 0x7fd308152540 2024-02-17T12:18:25.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd308156410 con 0x7fd3080c6460 2024-02-17T12:18:25.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd308154e30 0x7fd3081457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd308154e30 0x7fd3081457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48332/0 (socket says 172.21.15.114:48332) 2024-02-17T12:18:25.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30de00640 1 -- 172.21.15.114:0/86663223 learned_addr learned my addr 172.21.15.114:0/86663223 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:25.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30ca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd308152540 0x7fd308157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30d400640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3080c6460 0x7fd30806bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30de00640 1 -- 172.21.15.114:0/86663223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3080c6460 msgr2=0x7fd30806bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30de00640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3080c6460 0x7fd30806bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30de00640 1 -- 172.21.15.114:0/86663223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd308152540 msgr2=0x7fd308157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30de00640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd308152540 0x7fd308157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30de00640 1 -- 172.21.15.114:0/86663223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4009420 con 0x7fd308154e30 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30de00640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd308154e30 0x7fd3081457a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd30000c3c0 tx=0x7fd30000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd305600640 1 -- 172.21.15.114:0/86663223 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3000052d0 con 0x7fd308154e30 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd305600640 1 -- 172.21.15.114:0/86663223 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd300005430 con 0x7fd308154e30 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd305600640 1 -- 172.21.15.114:0/86663223 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300003820 con 0x7fd308154e30 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30fe00640 1 -- 172.21.15.114:0/86663223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd308143200 con 0x7fd308154e30 2024-02-17T12:18:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30fe00640 1 -- 172.21.15.114:0/86663223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd308142890 con 0x7fd308154e30 2024-02-17T12:18:25.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.801+0000 7fd30fe00640 1 -- 172.21.15.114:0/86663223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3081565d0 con 0x7fd308154e30 2024-02-17T12:18:25.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.805+0000 7fd305600640 1 -- 172.21.15.114:0/86663223 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd300003980 con 0x7fd308154e30 2024-02-17T12:18:25.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.805+0000 7fd305600640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd2e8066e40 0x7fd2e8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:25.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.805+0000 7fd305600640 1 -- 172.21.15.114:0/86663223 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd3000841f0 con 0x7fd308154e30 2024-02-17T12:18:25.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.805+0000 7fd30d400640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd2e8066e40 0x7fd2e8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:25.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.805+0000 7fd30d400640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd2e8066e40 0x7fd2e8069300 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc001570 tx=0x7fd2fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:25.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.809+0000 7fd305600640 1 -- 172.21.15.114:0/86663223 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd300050dc0 con 0x7fd308154e30 2024-02-17T12:18:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.961+0000 7fd30fe00640 1 -- 172.21.15.114:0/86663223 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd308145eb0 con 0x7fd2e8066e40 2024-02-17T12:18:25.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.973+0000 7fd305600640 1 -- 172.21.15.114:0/86663223 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525055 (secure 0 0 0) 0x7fd2fc0133b0 con 0x7fd2e8066e40 2024-02-17T12:18:25.982 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:25.986 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:18:25.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 -- 172.21.15.114:0/86663223 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd2e8066e40 msgr2=0x7fd2e8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd2e8066e40 0x7fd2e8069300 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc001570 tx=0x7fd2fc009040 comp rx=0 tx=0).stop 2024-02-17T12:18:25.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 -- 172.21.15.114:0/86663223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd308154e30 msgr2=0x7fd3081457a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:25.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd308154e30 0x7fd3081457a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd30000c3c0 tx=0x7fd30000c880 comp rx=0 tx=0).stop 2024-02-17T12:18:25.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 -- 172.21.15.114:0/86663223 shutdown_connections 2024-02-17T12:18:25.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd2e8066e40 0x7fd2e8069300 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd308154e30 0x7fd3081457a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd308152540 0x7fd308157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 --2- 172.21.15.114:0/86663223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3080c6460 0x7fd30806bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:25.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 -- 172.21.15.114:0/86663223 >> 172.21.15.114:0/86663223 conn(0x7fd3080c4f20 msgr2=0x7fd3081546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:25.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 -- 172.21.15.114:0/86663223 shutdown_connections 2024-02-17T12:18:25.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:25.977+0000 7fd30fe00640 1 -- 172.21.15.114:0/86663223 wait complete. 2024-02-17T12:18:26.001 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-02-17T12:18:25.241943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594863,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":228,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":174,"ondisk_log_size":174,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230616,"kb_used_data":6108,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744104,"statfs":{"total":773094113280,"available":772857962496,"internally_reserved":0,"allocated":6254592,"data_stored":3323700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1827,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001363"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.337103+0000","last_change":"2024-02-17T12:18:19.337103+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.337103+0000","last_undegraded":"2024-02-17T12:18:19.337103+0000","last_fullsized":"2024-02-17T12:18:19.337103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816493+0000","last_change":"2024-02-17T12:18:02.804326+0000","last_active":"2024-02-17T12:18:21.816493+0000","last_peered":"2024-02-17T12:18:21.816493+0000","last_clean":"2024-02-17T12:18:21.816493+0000","last_became_active":"2024-02-17T12:18:02.804074+0000","last_became_peered":"2024-02-17T12:18:02.804074+0000","last_unstale":"2024-02-17T12:18:21.816493+0000","last_undegraded":"2024-02-17T12:18:21.816493+0000","last_fullsized":"2024-02-17T12:18:21.816493+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:47.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.341116+0000","last_change":"2024-02-17T12:18:19.341116+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.341116+0000","last_undegraded":"2024-02-17T12:18:19.341116+0000","last_fullsized":"2024-02-17T12:18:19.341116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342702+0000","last_change":"2024-02-17T12:18:02.808706+0000","last_active":"2024-02-17T12:18:19.342702+0000","last_peered":"2024-02-17T12:18:19.342702+0000","last_clean":"2024-02-17T12:18:19.342702+0000","last_became_active":"2024-02-17T12:18:02.808520+0000","last_became_peered":"2024-02-17T12:18:02.808520+0000","last_unstale":"2024-02-17T12:18:19.342702+0000","last_undegraded":"2024-02-17T12:18:19.342702+0000","last_fullsized":"2024-02-17T12:18:19.342702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:27.642044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816859+0000","last_change":"2024-02-17T12:18:20.371587+0000","last_active":"2024-02-17T12:18:21.816859+0000","last_peered":"2024-02-17T12:18:21.816859+0000","last_clean":"2024-02-17T12:18:21.816859+0000","last_became_active":"2024-02-17T12:18:20.370802+0000","last_became_peered":"2024-02-17T12:18:20.370802+0000","last_unstale":"2024-02-17T12:18:21.816859+0000","last_undegraded":"2024-02-17T12:18:21.816859+0000","last_fullsized":"2024-02-17T12:18:21.816859+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:01:37.202430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816303+0000","last_change":"2024-02-17T12:18:02.807196+0000","last_active":"2024-02-17T12:18:21.816303+0000","last_peered":"2024-02-17T12:18:21.816303+0000","last_clean":"2024-02-17T12:18:21.816303+0000","last_became_active":"2024-02-17T12:18:02.806894+0000","last_became_peered":"2024-02-17T12:18:02.806894+0000","last_unstale":"2024-02-17T12:18:21.816303+0000","last_undegraded":"2024-02-17T12:18:21.816303+0000","last_fullsized":"2024-02-17T12:18:21.816303+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:12.749708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335776+0000","last_change":"2024-02-17T12:18:19.335776+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335776+0000","last_undegraded":"2024-02-17T12:18:19.335776+0000","last_fullsized":"2024-02-17T12:18:19.335776+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.329620+0000","last_change":"2024-02-17T12:18:02.814770+0000","last_active":"2024-02-17T12:18:19.329620+0000","last_peered":"2024-02-17T12:18:19.329620+0000","last_clean":"2024-02-17T12:18:19.329620+0000","last_became_active":"2024-02-17T12:18:02.809466+0000","last_became_peered":"2024-02-17T12:18:02.809466+0000","last_unstale":"2024-02-17T12:18:19.329620+0000","last_undegraded":"2024-02-17T12:18:19.329620+0000","last_fullsized":"2024-02-17T12:18:19.329620+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332409+0000","last_change":"2024-02-17T12:18:19.332409+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332409+0000","last_undegraded":"2024-02-17T12:18:19.332409+0000","last_fullsized":"2024-02-17T12:18:19.332409+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815276+0000","last_change":"2024-02-17T12:18:02.802996+0000","last_active":"2024-02-17T12:18:21.815276+0000","last_peered":"2024-02-17T12:18:21.815276+0000","last_clean":"2024-02-17T12:18:21.815276+0000","last_became_active":"2024-02-17T12:18:02.802690+0000","last_became_peered":"2024-02-17T12:18:02.802690+0000","last_unstale":"2024-02-17T12:18:21.815276+0000","last_undegraded":"2024-02-17T12:18:21.815276+0000","last_fullsized":"2024-02-17T12:18:21.815276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:59.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339125+0000","last_change":"2024-02-17T12:18:19.339125+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339125+0000","last_undegraded":"2024-02-17T12:18:19.339125+0000","last_fullsized":"2024-02-17T12:18:19.339125+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339236+0000","last_change":"2024-02-17T12:18:02.812986+0000","last_active":"2024-02-17T12:18:19.339236+0000","last_peered":"2024-02-17T12:18:19.339236+0000","last_clean":"2024-02-17T12:18:19.339236+0000","last_became_active":"2024-02-17T12:18:02.809576+0000","last_became_peered":"2024-02-17T12:18:02.809576+0000","last_unstale":"2024-02-17T12:18:19.339236+0000","last_undegraded":"2024-02-17T12:18:19.339236+0000","last_fullsized":"2024-02-17T12:18:19.339236+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815065+0000","last_change":"2024-02-17T12:18:20.369198+0000","last_active":"2024-02-17T12:18:21.815065+0000","last_peered":"2024-02-17T12:18:21.815065+0000","last_clean":"2024-02-17T12:18:21.815065+0000","last_became_active":"2024-02-17T12:18:20.368931+0000","last_became_peered":"2024-02-17T12:18:20.368931+0000","last_unstale":"2024-02-17T12:18:21.815065+0000","last_undegraded":"2024-02-17T12:18:21.815065+0000","last_fullsized":"2024-02-17T12:18:21.815065+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:50.119462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815313+0000","last_change":"2024-02-17T12:18:02.799654+0000","last_active":"2024-02-17T12:18:21.815313+0000","last_peered":"2024-02-17T12:18:21.815313+0000","last_clean":"2024-02-17T12:18:21.815313+0000","last_became_active":"2024-02-17T12:18:02.799356+0000","last_became_peered":"2024-02-17T12:18:02.799356+0000","last_unstale":"2024-02-17T12:18:21.815313+0000","last_undegraded":"2024-02-17T12:18:21.815313+0000","last_fullsized":"2024-02-17T12:18:21.815313+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:29.710017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340431+0000","last_change":"2024-02-17T12:18:19.340431+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340431+0000","last_undegraded":"2024-02-17T12:18:19.340431+0000","last_fullsized":"2024-02-17T12:18:19.340431+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339634+0000","last_change":"2024-02-17T12:18:02.800189+0000","last_active":"2024-02-17T12:18:19.339634+0000","last_peered":"2024-02-17T12:18:19.339634+0000","last_clean":"2024-02-17T12:18:19.339634+0000","last_became_active":"2024-02-17T12:18:02.799866+0000","last_became_peered":"2024-02-17T12:18:02.799866+0000","last_unstale":"2024-02-17T12:18:19.339634+0000","last_undegraded":"2024-02-17T12:18:19.339634+0000","last_fullsized":"2024-02-17T12:18:19.339634+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:52.152034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816094+0000","last_change":"2024-02-17T12:18:20.365120+0000","last_active":"2024-02-17T12:18:21.816094+0000","last_peered":"2024-02-17T12:18:21.816094+0000","last_clean":"2024-02-17T12:18:21.816094+0000","last_became_active":"2024-02-17T12:18:20.364337+0000","last_became_peered":"2024-02-17T12:18:20.364337+0000","last_unstale":"2024-02-17T12:18:21.816094+0000","last_undegraded":"2024-02-17T12:18:21.816094+0000","last_fullsized":"2024-02-17T12:18:21.816094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:39:30.873628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817375+0000","last_change":"2024-02-17T12:18:02.794591+0000","last_active":"2024-02-17T12:18:21.817375+0000","last_peered":"2024-02-17T12:18:21.817375+0000","last_clean":"2024-02-17T12:18:21.817375+0000","last_became_active":"2024-02-17T12:18:02.794309+0000","last_became_peered":"2024-02-17T12:18:02.794309+0000","last_unstale":"2024-02-17T12:18:21.817375+0000","last_undegraded":"2024-02-17T12:18:21.817375+0000","last_fullsized":"2024-02-17T12:18:21.817375+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:18.132994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.342320+0000","last_change":"2024-02-17T12:18:19.342320+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.342320+0000","last_undegraded":"2024-02-17T12:18:19.342320+0000","last_fullsized":"2024-02-17T12:18:19.342320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344227+0000","last_change":"2024-02-17T12:18:02.802586+0000","last_active":"2024-02-17T12:18:19.344227+0000","last_peered":"2024-02-17T12:18:19.344227+0000","last_clean":"2024-02-17T12:18:19.344227+0000","last_became_active":"2024-02-17T12:18:02.802328+0000","last_became_peered":"2024-02-17T12:18:02.802328+0000","last_unstale":"2024-02-17T12:18:19.344227+0000","last_undegraded":"2024-02-17T12:18:19.344227+0000","last_fullsized":"2024-02-17T12:18:19.344227+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:30.894335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814771+0000","last_change":"2024-02-17T12:18:20.370112+0000","last_active":"2024-02-17T12:18:21.814771+0000","last_peered":"2024-02-17T12:18:21.814771+0000","last_clean":"2024-02-17T12:18:21.814771+0000","last_became_active":"2024-02-17T12:18:20.369800+0000","last_became_peered":"2024-02-17T12:18:20.369800+0000","last_unstale":"2024-02-17T12:18:21.814771+0000","last_undegraded":"2024-02-17T12:18:21.814771+0000","last_fullsized":"2024-02-17T12:18:21.814771+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:01:35.157720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344849+0000","last_change":"2024-02-17T12:18:02.803729+0000","last_active":"2024-02-17T12:18:19.344849+0000","last_peered":"2024-02-17T12:18:19.344849+0000","last_clean":"2024-02-17T12:18:19.344849+0000","last_became_active":"2024-02-17T12:18:02.803504+0000","last_became_peered":"2024-02-17T12:18:02.803504+0000","last_unstale":"2024-02-17T12:18:19.344849+0000","last_undegraded":"2024-02-17T12:18:19.344849+0000","last_fullsized":"2024-02-17T12:18:19.344849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:50.631061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817298+0000","last_change":"2024-02-17T12:18:20.369131+0000","last_active":"2024-02-17T12:18:21.817298+0000","last_peered":"2024-02-17T12:18:21.817298+0000","last_clean":"2024-02-17T12:18:21.817298+0000","last_became_active":"2024-02-17T12:18:20.368509+0000","last_became_peered":"2024-02-17T12:18:20.368509+0000","last_unstale":"2024-02-17T12:18:21.817298+0000","last_undegraded":"2024-02-17T12:18:21.817298+0000","last_fullsized":"2024-02-17T12:18:21.817298+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.029266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330710+0000","last_change":"2024-02-17T12:18:02.814562+0000","last_active":"2024-02-17T12:18:19.330710+0000","last_peered":"2024-02-17T12:18:19.330710+0000","last_clean":"2024-02-17T12:18:19.330710+0000","last_became_active":"2024-02-17T12:18:02.809011+0000","last_became_peered":"2024-02-17T12:18:02.809011+0000","last_unstale":"2024-02-17T12:18:19.330710+0000","last_undegraded":"2024-02-17T12:18:19.330710+0000","last_fullsized":"2024-02-17T12:18:19.330710+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335567+0000","last_change":"2024-02-17T12:18:19.335567+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335567+0000","last_undegraded":"2024-02-17T12:18:19.335567+0000","last_fullsized":"2024-02-17T12:18:19.335567+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345668+0000","last_change":"2024-02-17T12:18:02.800228+0000","last_active":"2024-02-17T12:18:19.345668+0000","last_peered":"2024-02-17T12:18:19.345668+0000","last_clean":"2024-02-17T12:18:19.345668+0000","last_became_active":"2024-02-17T12:18:02.799965+0000","last_became_peered":"2024-02-17T12:18:02.799965+0000","last_unstale":"2024-02-17T12:18:19.345668+0000","last_undegraded":"2024-02-17T12:18:19.345668+0000","last_fullsized":"2024-02-17T12:18:19.345668+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:05.435817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814975+0000","last_change":"2024-02-17T12:18:20.368217+0000","last_active":"2024-02-17T12:18:21.814975+0000","last_peered":"2024-02-17T12:18:21.814975+0000","last_clean":"2024-02-17T12:18:21.814975+0000","last_became_active":"2024-02-17T12:18:20.367911+0000","last_became_peered":"2024-02-17T12:18:20.367911+0000","last_unstale":"2024-02-17T12:18:21.814975+0000","last_undegraded":"2024-02-17T12:18:21.814975+0000","last_fullsized":"2024-02-17T12:18:21.814975+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:18.491479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815966+0000","last_change":"2024-02-17T12:18:02.798437+0000","last_active":"2024-02-17T12:18:21.815966+0000","last_peered":"2024-02-17T12:18:21.815966+0000","last_clean":"2024-02-17T12:18:21.815966+0000","last_became_active":"2024-02-17T12:18:02.798145+0000","last_became_peered":"2024-02-17T12:18:02.798145+0000","last_unstale":"2024-02-17T12:18:21.815966+0000","last_undegraded":"2024-02-17T12:18:21.815966+0000","last_fullsized":"2024-02-17T12:18:21.815966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:29.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332924+0000","last_change":"2024-02-17T12:18:19.332924+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332924+0000","last_undegraded":"2024-02-17T12:18:19.332924+0000","last_fullsized":"2024-02-17T12:18:19.332924+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815431+0000","last_change":"2024-02-17T12:18:02.797013+0000","last_active":"2024-02-17T12:18:21.815431+0000","last_peered":"2024-02-17T12:18:21.815431+0000","last_clean":"2024-02-17T12:18:21.815431+0000","last_became_active":"2024-02-17T12:18:02.796734+0000","last_became_peered":"2024-02-17T12:18:02.796734+0000","last_unstale":"2024-02-17T12:18:21.815431+0000","last_undegraded":"2024-02-17T12:18:21.815431+0000","last_fullsized":"2024-02-17T12:18:21.815431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:32.566741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815206+0000","last_change":"2024-02-17T12:18:20.374124+0000","last_active":"2024-02-17T12:18:21.815206+0000","last_peered":"2024-02-17T12:18:21.815206+0000","last_clean":"2024-02-17T12:18:21.815206+0000","last_became_active":"2024-02-17T12:18:20.373863+0000","last_became_peered":"2024-02-17T12:18:20.373863+0000","last_unstale":"2024-02-17T12:18:21.815206+0000","last_undegraded":"2024-02-17T12:18:21.815206+0000","last_fullsized":"2024-02-17T12:18:21.815206+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:33.055118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.336921+0000","last_change":"2024-02-17T12:18:02.809976+0000","last_active":"2024-02-17T12:18:19.336921+0000","last_peered":"2024-02-17T12:18:19.336921+0000","last_clean":"2024-02-17T12:18:19.336921+0000","last_became_active":"2024-02-17T12:18:02.809645+0000","last_became_peered":"2024-02-17T12:18:02.809645+0000","last_unstale":"2024-02-17T12:18:19.336921+0000","last_undegraded":"2024-02-17T12:18:19.336921+0000","last_fullsized":"2024-02-17T12:18:19.336921+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340057+0000","last_change":"2024-02-17T12:18:19.340057+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340057+0000","last_undegraded":"2024-02-17T12:18:19.340057+0000","last_fullsized":"2024-02-17T12:18:19.340057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343660+0000","last_change":"2024-02-17T12:18:02.807700+0000","last_active":"2024-02-17T12:18:19.343660+0000","last_peered":"2024-02-17T12:18:19.343660+0000","last_clean":"2024-02-17T12:18:19.343660+0000","last_became_active":"2024-02-17T12:18:02.805575+0000","last_became_peered":"2024-02-17T12:18:02.805575+0000","last_unstale":"2024-02-17T12:18:19.343660+0000","last_undegraded":"2024-02-17T12:18:19.343660+0000","last_fullsized":"2024-02-17T12:18:19.343660+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:52:33.882315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333193+0000","last_change":"2024-02-17T12:18:19.333193+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333193+0000","last_undegraded":"2024-02-17T12:18:19.333193+0000","last_fullsized":"2024-02-17T12:18:19.333193+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816714+0000","last_change":"2024-02-17T12:18:02.809074+0000","last_active":"2024-02-17T12:18:21.816714+0000","last_peered":"2024-02-17T12:18:21.816714+0000","last_clean":"2024-02-17T12:18:21.816714+0000","last_became_active":"2024-02-17T12:18:02.808683+0000","last_became_peered":"2024-02-17T12:18:02.808683+0000","last_unstale":"2024-02-17T12:18:21.816714+0000","last_undegraded":"2024-02-17T12:18:21.816714+0000","last_fullsized":"2024-02-17T12:18:21.816714+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:46:21.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814912+0000","last_change":"2024-02-17T12:18:20.369738+0000","last_active":"2024-02-17T12:18:21.814912+0000","last_peered":"2024-02-17T12:18:21.814912+0000","last_clean":"2024-02-17T12:18:21.814912+0000","last_became_active":"2024-02-17T12:18:20.369340+0000","last_became_peered":"2024-02-17T12:18:20.369340+0000","last_unstale":"2024-02-17T12:18:21.814912+0000","last_undegraded":"2024-02-17T12:18:21.814912+0000","last_fullsized":"2024-02-17T12:18:21.814912+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:47.262738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816168+0000","last_change":"2024-02-17T12:18:02.803587+0000","last_active":"2024-02-17T12:18:21.816168+0000","last_peered":"2024-02-17T12:18:21.816168+0000","last_clean":"2024-02-17T12:18:21.816168+0000","last_became_active":"2024-02-17T12:18:02.803312+0000","last_became_peered":"2024-02-17T12:18:02.803312+0000","last_unstale":"2024-02-17T12:18:21.816168+0000","last_undegraded":"2024-02-17T12:18:21.816168+0000","last_fullsized":"2024-02-17T12:18:21.816168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:54:01.696616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.342713+0000","last_change":"2024-02-17T12:18:19.342713+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.342713+0000","last_undegraded":"2024-02-17T12:18:19.342713+0000","last_fullsized":"2024-02-17T12:18:19.342713+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343993+0000","last_change":"2024-02-17T12:18:02.815782+0000","last_active":"2024-02-17T12:18:19.343993+0000","last_peered":"2024-02-17T12:18:19.343993+0000","last_clean":"2024-02-17T12:18:19.343993+0000","last_became_active":"2024-02-17T12:18:02.815537+0000","last_became_peered":"2024-02-17T12:18:02.815537+0000","last_unstale":"2024-02-17T12:18:19.343993+0000","last_undegraded":"2024-02-17T12:18:19.343993+0000","last_fullsized":"2024-02-17T12:18:19.343993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:23.114440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815087+0000","last_change":"2024-02-17T12:18:20.372620+0000","last_active":"2024-02-17T12:18:21.815087+0000","last_peered":"2024-02-17T12:18:21.815087+0000","last_clean":"2024-02-17T12:18:21.815087+0000","last_became_active":"2024-02-17T12:18:20.372346+0000","last_became_peered":"2024-02-17T12:18:20.372346+0000","last_unstale":"2024-02-17T12:18:21.815087+0000","last_undegraded":"2024-02-17T12:18:21.815087+0000","last_fullsized":"2024-02-17T12:18:21.815087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:09.553478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815612+0000","last_change":"2024-02-17T12:18:02.809894+0000","last_active":"2024-02-17T12:18:21.815612+0000","last_peered":"2024-02-17T12:18:21.815612+0000","last_clean":"2024-02-17T12:18:21.815612+0000","last_became_active":"2024-02-17T12:18:02.807451+0000","last_became_peered":"2024-02-17T12:18:02.807451+0000","last_unstale":"2024-02-17T12:18:21.815612+0000","last_undegraded":"2024-02-17T12:18:21.815612+0000","last_fullsized":"2024-02-17T12:18:21.815612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:05:50.249065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814867+0000","last_change":"2024-02-17T12:18:20.377354+0000","last_active":"2024-02-17T12:18:21.814867+0000","last_peered":"2024-02-17T12:18:21.814867+0000","last_clean":"2024-02-17T12:18:21.814867+0000","last_became_active":"2024-02-17T12:18:20.376892+0000","last_became_peered":"2024-02-17T12:18:20.376892+0000","last_unstale":"2024-02-17T12:18:21.814867+0000","last_undegraded":"2024-02-17T12:18:21.814867+0000","last_fullsized":"2024-02-17T12:18:21.814867+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:19.983883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341901+0000","last_change":"2024-02-17T12:18:02.813079+0000","last_active":"2024-02-17T12:18:19.341901+0000","last_peered":"2024-02-17T12:18:19.341901+0000","last_clean":"2024-02-17T12:18:19.341901+0000","last_became_active":"2024-02-17T12:18:02.810630+0000","last_became_peered":"2024-02-17T12:18:02.810630+0000","last_unstale":"2024-02-17T12:18:19.341901+0000","last_undegraded":"2024-02-17T12:18:19.341901+0000","last_fullsized":"2024-02-17T12:18:19.341901+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:32:22.683974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816477+0000","last_change":"2024-02-17T12:18:20.363343+0000","last_active":"2024-02-17T12:18:21.816477+0000","last_peered":"2024-02-17T12:18:21.816477+0000","last_clean":"2024-02-17T12:18:21.816477+0000","last_became_active":"2024-02-17T12:18:20.362636+0000","last_became_peered":"2024-02-17T12:18:20.362636+0000","last_unstale":"2024-02-17T12:18:21.816477+0000","last_undegraded":"2024-02-17T12:18:21.816477+0000","last_fullsized":"2024-02-17T12:18:21.816477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:56.995368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815109+0000","last_change":"2024-02-17T12:18:02.807916+0000","last_active":"2024-02-17T12:18:21.815109+0000","last_peered":"2024-02-17T12:18:21.815109+0000","last_clean":"2024-02-17T12:18:21.815109+0000","last_became_active":"2024-02-17T12:18:02.806754+0000","last_became_peered":"2024-02-17T12:18:02.806754+0000","last_unstale":"2024-02-17T12:18:21.815109+0000","last_undegraded":"2024-02-17T12:18:21.815109+0000","last_fullsized":"2024-02-17T12:18:21.815109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.985986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816055+0000","last_change":"2024-02-17T12:18:20.364201+0000","last_active":"2024-02-17T12:18:21.816055+0000","last_peered":"2024-02-17T12:18:21.816055+0000","last_clean":"2024-02-17T12:18:21.816055+0000","last_became_active":"2024-02-17T12:18:20.362371+0000","last_became_peered":"2024-02-17T12:18:20.362371+0000","last_unstale":"2024-02-17T12:18:21.816055+0000","last_undegraded":"2024-02-17T12:18:21.816055+0000","last_fullsized":"2024-02-17T12:18:21.816055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:26.198114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346146+0000","last_change":"2024-02-17T12:18:02.805691+0000","last_active":"2024-02-17T12:18:19.346146+0000","last_peered":"2024-02-17T12:18:19.346146+0000","last_clean":"2024-02-17T12:18:19.346146+0000","last_became_active":"2024-02-17T12:18:02.805396+0000","last_became_peered":"2024-02-17T12:18:02.805396+0000","last_unstale":"2024-02-17T12:18:19.346146+0000","last_undegraded":"2024-02-17T12:18:19.346146+0000","last_fullsized":"2024-02-17T12:18:19.346146+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:09:34.480729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.336674+0000","last_change":"2024-02-17T12:18:19.336674+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.336674+0000","last_undegraded":"2024-02-17T12:18:19.336674+0000","last_fullsized":"2024-02-17T12:18:19.336674+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816740+0000","last_change":"2024-02-17T12:18:02.798267+0000","last_active":"2024-02-17T12:18:21.816740+0000","last_peered":"2024-02-17T12:18:21.816740+0000","last_clean":"2024-02-17T12:18:21.816740+0000","last_became_active":"2024-02-17T12:18:02.797624+0000","last_became_peered":"2024-02-17T12:18:02.797624+0000","last_unstale":"2024-02-17T12:18:21.816740+0000","last_undegraded":"2024-02-17T12:18:21.816740+0000","last_fullsized":"2024-02-17T12:18:21.816740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:17:06.691178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816401+0000","last_change":"2024-02-17T12:18:20.375077+0000","last_active":"2024-02-17T12:18:21.816401+0000","last_peered":"2024-02-17T12:18:21.816401+0000","last_clean":"2024-02-17T12:18:21.816401+0000","last_became_active":"2024-02-17T12:18:20.374769+0000","last_became_peered":"2024-02-17T12:18:20.374769+0000","last_unstale":"2024-02-17T12:18:21.816401+0000","last_undegraded":"2024-02-17T12:18:21.816401+0000","last_fullsized":"2024-02-17T12:18:21.816401+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:01:46.432009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.332906+0000","last_change":"2024-02-17T12:18:02.802532+0000","last_active":"2024-02-17T12:18:19.332906+0000","last_peered":"2024-02-17T12:18:19.332906+0000","last_clean":"2024-02-17T12:18:19.332906+0000","last_became_active":"2024-02-17T12:18:02.801766+0000","last_became_peered":"2024-02-17T12:18:02.801766+0000","last_unstale":"2024-02-17T12:18:19.332906+0000","last_undegraded":"2024-02-17T12:18:19.332906+0000","last_fullsized":"2024-02-17T12:18:19.332906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817379+0000","last_change":"2024-02-17T12:18:20.364156+0000","last_active":"2024-02-17T12:18:21.817379+0000","last_peered":"2024-02-17T12:18:21.817379+0000","last_clean":"2024-02-17T12:18:21.817379+0000","last_became_active":"2024-02-17T12:18:20.363892+0000","last_became_peered":"2024-02-17T12:18:20.363892+0000","last_unstale":"2024-02-17T12:18:21.817379+0000","last_undegraded":"2024-02-17T12:18:21.817379+0000","last_fullsized":"2024-02-17T12:18:21.817379+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:03:14.299647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338177+0000","last_change":"2024-02-17T12:18:02.797999+0000","last_active":"2024-02-17T12:18:19.338177+0000","last_peered":"2024-02-17T12:18:19.338177+0000","last_clean":"2024-02-17T12:18:19.338177+0000","last_became_active":"2024-02-17T12:18:02.797710+0000","last_became_peered":"2024-02-17T12:18:02.797710+0000","last_unstale":"2024-02-17T12:18:19.338177+0000","last_undegraded":"2024-02-17T12:18:19.338177+0000","last_fullsized":"2024-02-17T12:18:19.338177+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332446+0000","last_change":"2024-02-17T12:18:19.332446+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332446+0000","last_undegraded":"2024-02-17T12:18:19.332446+0000","last_fullsized":"2024-02-17T12:18:19.332446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816345+0000","last_change":"2024-02-17T12:18:02.804711+0000","last_active":"2024-02-17T12:18:21.816345+0000","last_peered":"2024-02-17T12:18:21.816345+0000","last_clean":"2024-02-17T12:18:21.816345+0000","last_became_active":"2024-02-17T12:18:02.804459+0000","last_became_peered":"2024-02-17T12:18:02.804459+0000","last_unstale":"2024-02-17T12:18:21.816345+0000","last_undegraded":"2024-02-17T12:18:21.816345+0000","last_fullsized":"2024-02-17T12:18:21.816345+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:47.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.329892+0000","last_change":"2024-02-17T12:18:19.329892+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.329892+0000","last_undegraded":"2024-02-17T12:18:19.329892+0000","last_fullsized":"2024-02-17T12:18:19.329892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342440+0000","last_change":"2024-02-17T12:18:02.802524+0000","last_active":"2024-02-17T12:18:19.342440+0000","last_peered":"2024-02-17T12:18:19.342440+0000","last_clean":"2024-02-17T12:18:19.342440+0000","last_became_active":"2024-02-17T12:18:02.802045+0000","last_became_peered":"2024-02-17T12:18:02.802045+0000","last_unstale":"2024-02-17T12:18:19.342440+0000","last_undegraded":"2024-02-17T12:18:19.342440+0000","last_fullsized":"2024-02-17T12:18:19.342440+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:06:03.414827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335592+0000","last_change":"2024-02-17T12:18:19.335592+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335592+0000","last_undegraded":"2024-02-17T12:18:19.335592+0000","last_fullsized":"2024-02-17T12:18:19.335592+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815164+0000","last_change":"2024-02-17T12:18:02.807169+0000","last_active":"2024-02-17T12:18:21.815164+0000","last_peered":"2024-02-17T12:18:21.815164+0000","last_clean":"2024-02-17T12:18:21.815164+0000","last_became_active":"2024-02-17T12:18:02.806918+0000","last_became_peered":"2024-02-17T12:18:02.806918+0000","last_unstale":"2024-02-17T12:18:21.815164+0000","last_undegraded":"2024-02-17T12:18:21.815164+0000","last_fullsized":"2024-02-17T12:18:21.815164+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:17.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339441+0000","last_change":"2024-02-17T12:18:19.339441+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339441+0000","last_undegraded":"2024-02-17T12:18:19.339441+0000","last_fullsized":"2024-02-17T12:18:19.339441+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814709+0000","last_change":"2024-02-17T12:18:02.795014+0000","last_active":"2024-02-17T12:18:21.814709+0000","last_peered":"2024-02-17T12:18:21.814709+0000","last_clean":"2024-02-17T12:18:21.814709+0000","last_became_active":"2024-02-17T12:18:02.794759+0000","last_became_peered":"2024-02-17T12:18:02.794759+0000","last_unstale":"2024-02-17T12:18:21.814709+0000","last_undegraded":"2024-02-17T12:18:21.814709+0000","last_fullsized":"2024-02-17T12:18:21.814709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:21.971723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333734+0000","last_change":"2024-02-17T12:18:19.333734+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333734+0000","last_undegraded":"2024-02-17T12:18:19.333734+0000","last_fullsized":"2024-02-17T12:18:19.333734+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.337022+0000","last_change":"2024-02-17T12:18:02.801322+0000","last_active":"2024-02-17T12:18:19.337022+0000","last_peered":"2024-02-17T12:18:19.337022+0000","last_clean":"2024-02-17T12:18:19.337022+0000","last_became_active":"2024-02-17T12:18:02.801073+0000","last_became_peered":"2024-02-17T12:18:02.801073+0000","last_unstale":"2024-02-17T12:18:19.337022+0000","last_undegraded":"2024-02-17T12:18:19.337022+0000","last_fullsized":"2024-02-17T12:18:19.337022+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.343199+0000","last_change":"2024-02-17T12:18:19.343199+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.343199+0000","last_undegraded":"2024-02-17T12:18:19.343199+0000","last_fullsized":"2024-02-17T12:18:19.343199+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816555+0000","last_change":"2024-02-17T12:18:19.346026+0000","last_active":"2024-02-17T12:18:21.816555+0000","last_peered":"2024-02-17T12:18:21.816555+0000","last_clean":"2024-02-17T12:18:21.816555+0000","last_became_active":"2024-02-17T12:18:19.345752+0000","last_became_peered":"2024-02-17T12:18:19.345752+0000","last_unstale":"2024-02-17T12:18:21.816555+0000","last_undegraded":"2024-02-17T12:18:21.816555+0000","last_fullsized":"2024-02-17T12:18:21.816555+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:26.587389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338219+0000","last_change":"2024-02-17T12:18:02.811882+0000","last_active":"2024-02-17T12:18:19.338219+0000","last_peered":"2024-02-17T12:18:19.338219+0000","last_clean":"2024-02-17T12:18:19.338219+0000","last_became_active":"2024-02-17T12:18:02.811448+0000","last_became_peered":"2024-02-17T12:18:02.811448+0000","last_unstale":"2024-02-17T12:18:19.338219+0000","last_undegraded":"2024-02-17T12:18:19.338219+0000","last_fullsized":"2024-02-17T12:18:19.338219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:46.432214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340678+0000","last_change":"2024-02-17T12:18:01.796858+0000","last_active":"2024-02-17T12:18:19.340678+0000","last_peered":"2024-02-17T12:18:19.340678+0000","last_clean":"2024-02-17T12:18:19.340678+0000","last_became_active":"2024-02-17T12:18:01.796498+0000","last_became_peered":"2024-02-17T12:18:01.796498+0000","last_unstale":"2024-02-17T12:18:19.340678+0000","last_undegraded":"2024-02-17T12:18:19.340678+0000","last_fullsized":"2024-02-17T12:18:19.340678+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816201+0000","last_change":"2024-02-17T12:18:20.361465+0000","last_active":"2024-02-17T12:18:21.816201+0000","last_peered":"2024-02-17T12:18:21.816201+0000","last_clean":"2024-02-17T12:18:21.816201+0000","last_became_active":"2024-02-17T12:18:20.361150+0000","last_became_peered":"2024-02-17T12:18:20.361150+0000","last_unstale":"2024-02-17T12:18:21.816201+0000","last_undegraded":"2024-02-17T12:18:21.816201+0000","last_fullsized":"2024-02-17T12:18:21.816201+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:10.749526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355683+0000","last_change":"2024-02-17T12:18:19.351335+0000","last_active":"2024-02-17T12:18:19.355683+0000","last_peered":"2024-02-17T12:18:19.355683+0000","last_clean":"2024-02-17T12:18:19.355683+0000","last_became_active":"2024-02-17T12:18:19.350932+0000","last_became_peered":"2024-02-17T12:18:19.350932+0000","last_unstale":"2024-02-17T12:18:19.355683+0000","last_undegraded":"2024-02-17T12:18:19.355683+0000","last_fullsized":"2024-02-17T12:18:19.355683+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:52.676828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344983+0000","last_change":"2024-02-17T12:18:02.808663+0000","last_active":"2024-02-17T12:18:19.344983+0000","last_peered":"2024-02-17T12:18:19.344983+0000","last_clean":"2024-02-17T12:18:19.344983+0000","last_became_active":"2024-02-17T12:18:02.808402+0000","last_became_peered":"2024-02-17T12:18:02.808402+0000","last_unstale":"2024-02-17T12:18:19.344983+0000","last_undegraded":"2024-02-17T12:18:19.344983+0000","last_fullsized":"2024-02-17T12:18:19.344983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:00.777830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342763+0000","last_change":"2024-02-17T12:18:01.790619+0000","last_active":"2024-02-17T12:18:19.342763+0000","last_peered":"2024-02-17T12:18:19.342763+0000","last_clean":"2024-02-17T12:18:19.342763+0000","last_became_active":"2024-02-17T12:18:01.790344+0000","last_became_peered":"2024-02-17T12:18:01.790344+0000","last_unstale":"2024-02-17T12:18:19.342763+0000","last_undegraded":"2024-02-17T12:18:19.342763+0000","last_fullsized":"2024-02-17T12:18:19.342763+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:45.425754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816974+0000","last_change":"2024-02-17T12:18:20.367137+0000","last_active":"2024-02-17T12:18:21.816974+0000","last_peered":"2024-02-17T12:18:21.816974+0000","last_clean":"2024-02-17T12:18:21.816974+0000","last_became_active":"2024-02-17T12:18:20.366853+0000","last_became_peered":"2024-02-17T12:18:20.366853+0000","last_unstale":"2024-02-17T12:18:21.816974+0000","last_undegraded":"2024-02-17T12:18:21.816974+0000","last_fullsized":"2024-02-17T12:18:21.816974+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:36:39.750086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816903+0000","last_change":"2024-02-17T12:18:19.356247+0000","last_active":"2024-02-17T12:18:21.816903+0000","last_peered":"2024-02-17T12:18:21.816903+0000","last_clean":"2024-02-17T12:18:21.816903+0000","last_became_active":"2024-02-17T12:18:19.355973+0000","last_became_peered":"2024-02-17T12:18:19.355973+0000","last_unstale":"2024-02-17T12:18:21.816903+0000","last_undegraded":"2024-02-17T12:18:21.816903+0000","last_fullsized":"2024-02-17T12:18:21.816903+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:27.022941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340787+0000","last_change":"2024-02-17T12:18:02.804685+0000","last_active":"2024-02-17T12:18:19.340787+0000","last_peered":"2024-02-17T12:18:19.340787+0000","last_clean":"2024-02-17T12:18:19.340787+0000","last_became_active":"2024-02-17T12:18:02.803980+0000","last_became_peered":"2024-02-17T12:18:02.803980+0000","last_unstale":"2024-02-17T12:18:19.340787+0000","last_undegraded":"2024-02-17T12:18:19.340787+0000","last_fullsized":"2024-02-17T12:18:19.340787+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:32.327387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338423+0000","last_change":"2024-02-17T12:18:01.801344+0000","last_active":"2024-02-17T12:18:19.338423+0000","last_peered":"2024-02-17T12:18:19.338423+0000","last_clean":"2024-02-17T12:18:19.338423+0000","last_became_active":"2024-02-17T12:18:01.801092+0000","last_became_peered":"2024-02-17T12:18:01.801092+0000","last_unstale":"2024-02-17T12:18:19.338423+0000","last_undegraded":"2024-02-17T12:18:19.338423+0000","last_fullsized":"2024-02-17T12:18:19.338423+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816684+0000","last_change":"2024-02-17T12:18:20.368949+0000","last_active":"2024-02-17T12:18:21.816684+0000","last_peered":"2024-02-17T12:18:21.816684+0000","last_clean":"2024-02-17T12:18:21.816684+0000","last_became_active":"2024-02-17T12:18:20.368689+0000","last_became_peered":"2024-02-17T12:18:20.368689+0000","last_unstale":"2024-02-17T12:18:21.816684+0000","last_undegraded":"2024-02-17T12:18:21.816684+0000","last_fullsized":"2024-02-17T12:18:21.816684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:52.111538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.357844+0000","last_change":"2024-02-17T12:18:19.348869+0000","last_active":"2024-02-17T12:18:19.357844+0000","last_peered":"2024-02-17T12:18:19.357844+0000","last_clean":"2024-02-17T12:18:19.357844+0000","last_became_active":"2024-02-17T12:18:19.347760+0000","last_became_peered":"2024-02-17T12:18:19.347760+0000","last_unstale":"2024-02-17T12:18:19.357844+0000","last_undegraded":"2024-02-17T12:18:19.357844+0000","last_fullsized":"2024-02-17T12:18:19.357844+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:28:32.430718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338263+0000","last_change":"2024-02-17T12:18:02.806603+0000","last_active":"2024-02-17T12:18:19.338263+0000","last_peered":"2024-02-17T12:18:19.338263+0000","last_clean":"2024-02-17T12:18:19.338263+0000","last_became_active":"2024-02-17T12:18:02.806021+0000","last_became_peered":"2024-02-17T12:18:02.806021+0000","last_unstale":"2024-02-17T12:18:19.338263+0000","last_undegraded":"2024-02-17T12:18:19.338263+0000","last_fullsized":"2024-02-17T12:18:19.338263+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:57.248220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330817+0000","last_change":"2024-02-17T12:18:01.790249+0000","last_active":"2024-02-17T12:18:19.330817+0000","last_peered":"2024-02-17T12:18:19.330817+0000","last_clean":"2024-02-17T12:18:19.330817+0000","last_became_active":"2024-02-17T12:18:01.789970+0000","last_became_peered":"2024-02-17T12:18:01.789970+0000","last_unstale":"2024-02-17T12:18:19.330817+0000","last_undegraded":"2024-02-17T12:18:19.330817+0000","last_fullsized":"2024-02-17T12:18:19.330817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814692+0000","last_change":"2024-02-17T12:18:20.374117+0000","last_active":"2024-02-17T12:18:21.814692+0000","last_peered":"2024-02-17T12:18:21.814692+0000","last_clean":"2024-02-17T12:18:21.814692+0000","last_became_active":"2024-02-17T12:18:20.373680+0000","last_became_peered":"2024-02-17T12:18:20.373680+0000","last_unstale":"2024-02-17T12:18:21.814692+0000","last_undegraded":"2024-02-17T12:18:21.814692+0000","last_fullsized":"2024-02-17T12:18:21.814692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:29.917226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360087+0000","last_change":"2024-02-17T12:18:19.353267+0000","last_active":"2024-02-17T12:18:19.360087+0000","last_peered":"2024-02-17T12:18:19.360087+0000","last_clean":"2024-02-17T12:18:19.360087+0000","last_became_active":"2024-02-17T12:18:19.353007+0000","last_became_peered":"2024-02-17T12:18:19.353007+0000","last_unstale":"2024-02-17T12:18:19.360087+0000","last_undegraded":"2024-02-17T12:18:19.360087+0000","last_fullsized":"2024-02-17T12:18:19.360087+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:49.360736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341972+0000","last_change":"2024-02-17T12:18:02.811065+0000","last_active":"2024-02-17T12:18:19.341972+0000","last_peered":"2024-02-17T12:18:19.341972+0000","last_clean":"2024-02-17T12:18:19.341972+0000","last_became_active":"2024-02-17T12:18:02.810598+0000","last_became_peered":"2024-02-17T12:18:02.810598+0000","last_unstale":"2024-02-17T12:18:19.341972+0000","last_undegraded":"2024-02-17T12:18:19.341972+0000","last_fullsized":"2024-02-17T12:18:19.341972+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:11:46.553742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":23,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816473+0000","last_change":"2024-02-17T12:18:01.798801+0000","last_active":"2024-02-17T12:18:21.816473+0000","last_peered":"2024-02-17T12:18:21.816473+0000","last_clean":"2024-02-17T12:18:21.816473+0000","last_became_active":"2024-02-17T12:18:01.798516+0000","last_became_peered":"2024-02-17T12:18:01.798516+0000","last_unstale":"2024-02-17T12:18:21.816473+0000","last_undegraded":"2024-02-17T12:18:21.816473+0000","last_fullsized":"2024-02-17T12:18:21.816473+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:04:53.798642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335113+0000","last_change":"2024-02-17T12:18:19.335113+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335113+0000","last_undegraded":"2024-02-17T12:18:19.335113+0000","last_fullsized":"2024-02-17T12:18:19.335113+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814610+0000","last_change":"2024-02-17T12:18:19.351059+0000","last_active":"2024-02-17T12:18:21.814610+0000","last_peered":"2024-02-17T12:18:21.814610+0000","last_clean":"2024-02-17T12:18:21.814610+0000","last_became_active":"2024-02-17T12:18:19.350824+0000","last_became_peered":"2024-02-17T12:18:19.350824+0000","last_unstale":"2024-02-17T12:18:21.814610+0000","last_undegraded":"2024-02-17T12:18:21.814610+0000","last_fullsized":"2024-02-17T12:18:21.814610+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:17:14.886486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342282+0000","last_change":"2024-02-17T12:18:02.802301+0000","last_active":"2024-02-17T12:18:19.342282+0000","last_peered":"2024-02-17T12:18:19.342282+0000","last_clean":"2024-02-17T12:18:19.342282+0000","last_became_active":"2024-02-17T12:18:02.801632+0000","last_became_peered":"2024-02-17T12:18:02.801632+0000","last_unstale":"2024-02-17T12:18:19.342282+0000","last_undegraded":"2024-02-17T12:18:19.342282+0000","last_fullsized":"2024-02-17T12:18:19.342282+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:34:13.159578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339326+0000","last_change":"2024-02-17T12:18:01.800510+0000","last_active":"2024-02-17T12:18:19.339326+0000","last_peered":"2024-02-17T12:18:19.339326+0000","last_clean":"2024-02-17T12:18:19.339326+0000","last_became_active":"2024-02-17T12:18:01.799483+0000","last_became_peered":"2024-02-17T12:18:01.799483+0000","last_unstale":"2024-02-17T12:18:19.339326+0000","last_undegraded":"2024-02-17T12:18:19.339326+0000","last_fullsized":"2024-02-17T12:18:19.339326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.330276+0000","last_change":"2024-02-17T12:18:19.330276+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.330276+0000","last_undegraded":"2024-02-17T12:18:19.330276+0000","last_fullsized":"2024-02-17T12:18:19.330276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.354877+0000","last_change":"2024-02-17T12:18:19.351098+0000","last_active":"2024-02-17T12:18:19.354877+0000","last_peered":"2024-02-17T12:18:19.354877+0000","last_clean":"2024-02-17T12:18:19.354877+0000","last_became_active":"2024-02-17T12:18:19.350809+0000","last_became_peered":"2024-02-17T12:18:19.350809+0000","last_unstale":"2024-02-17T12:18:19.354877+0000","last_undegraded":"2024-02-17T12:18:19.354877+0000","last_fullsized":"2024-02-17T12:18:19.354877+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:07:44.338092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346264+0000","last_change":"2024-02-17T12:18:02.811246+0000","last_active":"2024-02-17T12:18:19.346264+0000","last_peered":"2024-02-17T12:18:19.346264+0000","last_clean":"2024-02-17T12:18:19.346264+0000","last_became_active":"2024-02-17T12:18:02.810989+0000","last_became_peered":"2024-02-17T12:18:02.810989+0000","last_unstale":"2024-02-17T12:18:19.346264+0000","last_undegraded":"2024-02-17T12:18:19.346264+0000","last_fullsized":"2024-02-17T12:18:19.346264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:56:31.198120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.332999+0000","last_change":"2024-02-17T12:18:01.798316+0000","last_active":"2024-02-17T12:18:19.332999+0000","last_peered":"2024-02-17T12:18:19.332999+0000","last_clean":"2024-02-17T12:18:19.332999+0000","last_became_active":"2024-02-17T12:18:01.797041+0000","last_became_peered":"2024-02-17T12:18:01.797041+0000","last_unstale":"2024-02-17T12:18:19.332999+0000","last_undegraded":"2024-02-17T12:18:19.332999+0000","last_fullsized":"2024-02-17T12:18:19.332999+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816301+0000","last_change":"2024-02-17T12:18:20.363604+0000","last_active":"2024-02-17T12:18:21.816301+0000","last_peered":"2024-02-17T12:18:21.816301+0000","last_clean":"2024-02-17T12:18:21.816301+0000","last_became_active":"2024-02-17T12:18:20.362955+0000","last_became_peered":"2024-02-17T12:18:20.362955+0000","last_unstale":"2024-02-17T12:18:21.816301+0000","last_undegraded":"2024-02-17T12:18:21.816301+0000","last_fullsized":"2024-02-17T12:18:21.816301+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:42:14.296376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360092+0000","last_change":"2024-02-17T12:18:19.352520+0000","last_active":"2024-02-17T12:18:19.360092+0000","last_peered":"2024-02-17T12:18:19.360092+0000","last_clean":"2024-02-17T12:18:19.360092+0000","last_became_active":"2024-02-17T12:18:19.351708+0000","last_became_peered":"2024-02-17T12:18:19.351708+0000","last_unstale":"2024-02-17T12:18:19.360092+0000","last_undegraded":"2024-02-17T12:18:19.360092+0000","last_fullsized":"2024-02-17T12:18:19.360092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:01.563171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341680+0000","last_change":"2024-02-17T12:18:02.801971+0000","last_active":"2024-02-17T12:18:19.341680+0000","last_peered":"2024-02-17T12:18:19.341680+0000","last_clean":"2024-02-17T12:18:19.341680+0000","last_became_active":"2024-02-17T12:18:02.801727+0000","last_became_peered":"2024-02-17T12:18:02.801727+0000","last_unstale":"2024-02-17T12:18:19.341680+0000","last_undegraded":"2024-02-17T12:18:19.341680+0000","last_fullsized":"2024-02-17T12:18:19.341680+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:06:15.526935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815739+0000","last_change":"2024-02-17T12:18:01.800493+0000","last_active":"2024-02-17T12:18:21.815739+0000","last_peered":"2024-02-17T12:18:21.815739+0000","last_clean":"2024-02-17T12:18:21.815739+0000","last_became_active":"2024-02-17T12:18:01.800206+0000","last_became_peered":"2024-02-17T12:18:01.800206+0000","last_unstale":"2024-02-17T12:18:21.815739+0000","last_undegraded":"2024-02-17T12:18:21.815739+0000","last_fullsized":"2024-02-17T12:18:21.815739+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:33.603620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340864+0000","last_change":"2024-02-17T12:18:19.340864+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340864+0000","last_undegraded":"2024-02-17T12:18:19.340864+0000","last_fullsized":"2024-02-17T12:18:19.340864+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.348954+0000","last_change":"2024-02-17T12:18:19.347455+0000","last_active":"2024-02-17T12:18:19.348954+0000","last_peered":"2024-02-17T12:18:19.348954+0000","last_clean":"2024-02-17T12:18:19.348954+0000","last_became_active":"2024-02-17T12:18:19.347134+0000","last_became_peered":"2024-02-17T12:18:19.347134+0000","last_unstale":"2024-02-17T12:18:19.348954+0000","last_undegraded":"2024-02-17T12:18:19.348954+0000","last_fullsized":"2024-02-17T12:18:19.348954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:59:36.003726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817429+0000","last_change":"2024-02-17T12:18:02.797952+0000","last_active":"2024-02-17T12:18:21.817429+0000","last_peered":"2024-02-17T12:18:21.817429+0000","last_clean":"2024-02-17T12:18:21.817429+0000","last_became_active":"2024-02-17T12:18:02.797675+0000","last_became_peered":"2024-02-17T12:18:02.797675+0000","last_unstale":"2024-02-17T12:18:21.817429+0000","last_undegraded":"2024-02-17T12:18:21.817429+0000","last_fullsized":"2024-02-17T12:18:21.817429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:01.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817208+0000","last_change":"2024-02-17T12:18:01.801850+0000","last_active":"2024-02-17T12:18:21.817208+0000","last_peered":"2024-02-17T12:18:21.817208+0000","last_clean":"2024-02-17T12:18:21.817208+0000","last_became_active":"2024-02-17T12:18:01.801516+0000","last_became_peered":"2024-02-17T12:18:01.801516+0000","last_unstale":"2024-02-17T12:18:21.817208+0000","last_undegraded":"2024-02-17T12:18:21.817208+0000","last_fullsized":"2024-02-17T12:18:21.817208+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:28.630666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815846+0000","last_change":"2024-02-17T12:18:20.364321+0000","last_active":"2024-02-17T12:18:21.815846+0000","last_peered":"2024-02-17T12:18:21.815846+0000","last_clean":"2024-02-17T12:18:21.815846+0000","last_became_active":"2024-02-17T12:18:20.363927+0000","last_became_peered":"2024-02-17T12:18:20.363927+0000","last_unstale":"2024-02-17T12:18:21.815846+0000","last_undegraded":"2024-02-17T12:18:21.815846+0000","last_fullsized":"2024-02-17T12:18:21.815846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:35.685715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355114+0000","last_change":"2024-02-17T12:18:19.352769+0000","last_active":"2024-02-17T12:18:19.355114+0000","last_peered":"2024-02-17T12:18:19.355114+0000","last_clean":"2024-02-17T12:18:19.355114+0000","last_became_active":"2024-02-17T12:18:19.352519+0000","last_became_peered":"2024-02-17T12:18:19.352519+0000","last_unstale":"2024-02-17T12:18:19.355114+0000","last_undegraded":"2024-02-17T12:18:19.355114+0000","last_fullsized":"2024-02-17T12:18:19.355114+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817050+0000","last_change":"2024-02-17T12:18:02.813957+0000","last_active":"2024-02-17T12:18:21.817050+0000","last_peered":"2024-02-17T12:18:21.817050+0000","last_clean":"2024-02-17T12:18:21.817050+0000","last_became_active":"2024-02-17T12:18:02.813647+0000","last_became_peered":"2024-02-17T12:18:02.813647+0000","last_unstale":"2024-02-17T12:18:21.817050+0000","last_undegraded":"2024-02-17T12:18:21.817050+0000","last_fullsized":"2024-02-17T12:18:21.817050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:41.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342822+0000","last_change":"2024-02-17T12:18:01.799508+0000","last_active":"2024-02-17T12:18:19.342822+0000","last_peered":"2024-02-17T12:18:19.342822+0000","last_clean":"2024-02-17T12:18:19.342822+0000","last_became_active":"2024-02-17T12:18:01.798598+0000","last_became_peered":"2024-02-17T12:18:01.798598+0000","last_unstale":"2024-02-17T12:18:19.342822+0000","last_undegraded":"2024-02-17T12:18:19.342822+0000","last_fullsized":"2024-02-17T12:18:19.342822+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:45.103353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.329959+0000","last_change":"2024-02-17T12:18:19.329959+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.329959+0000","last_undegraded":"2024-02-17T12:18:19.329959+0000","last_fullsized":"2024-02-17T12:18:19.329959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817197+0000","last_change":"2024-02-17T12:18:19.343528+0000","last_active":"2024-02-17T12:18:21.817197+0000","last_peered":"2024-02-17T12:18:21.817197+0000","last_clean":"2024-02-17T12:18:21.817197+0000","last_became_active":"2024-02-17T12:18:19.343256+0000","last_became_peered":"2024-02-17T12:18:19.343256+0000","last_unstale":"2024-02-17T12:18:21.817197+0000","last_undegraded":"2024-02-17T12:18:21.817197+0000","last_fullsized":"2024-02-17T12:18:21.817197+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:49:14.842881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344376+0000","last_change":"2024-02-17T12:18:02.787850+0000","last_active":"2024-02-17T12:18:19.344376+0000","last_peered":"2024-02-17T12:18:19.344376+0000","last_clean":"2024-02-17T12:18:19.344376+0000","last_became_active":"2024-02-17T12:18:02.787578+0000","last_became_peered":"2024-02-17T12:18:02.787578+0000","last_unstale":"2024-02-17T12:18:19.344376+0000","last_undegraded":"2024-02-17T12:18:19.344376+0000","last_fullsized":"2024-02-17T12:18:19.344376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:29.854264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816438+0000","last_change":"2024-02-17T12:18:01.805403+0000","last_active":"2024-02-17T12:18:21.816438+0000","last_peered":"2024-02-17T12:18:21.816438+0000","last_clean":"2024-02-17T12:18:21.816438+0000","last_became_active":"2024-02-17T12:18:01.805059+0000","last_became_peered":"2024-02-17T12:18:01.805059+0000","last_unstale":"2024-02-17T12:18:21.816438+0000","last_undegraded":"2024-02-17T12:18:21.816438+0000","last_fullsized":"2024-02-17T12:18:21.816438+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:14.495937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816895+0000","last_change":"2024-02-17T12:18:20.366044+0000","last_active":"2024-02-17T12:18:21.816895+0000","last_peered":"2024-02-17T12:18:21.816895+0000","last_clean":"2024-02-17T12:18:21.816895+0000","last_became_active":"2024-02-17T12:18:20.365728+0000","last_became_peered":"2024-02-17T12:18:20.365728+0000","last_unstale":"2024-02-17T12:18:21.816895+0000","last_undegraded":"2024-02-17T12:18:21.816895+0000","last_fullsized":"2024-02-17T12:18:21.816895+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:30.100473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355588+0000","last_change":"2024-02-17T12:18:19.349635+0000","last_active":"2024-02-17T12:18:19.355588+0000","last_peered":"2024-02-17T12:18:19.355588+0000","last_clean":"2024-02-17T12:18:19.355588+0000","last_became_active":"2024-02-17T12:18:19.349145+0000","last_became_peered":"2024-02-17T12:18:19.349145+0000","last_unstale":"2024-02-17T12:18:19.355588+0000","last_undegraded":"2024-02-17T12:18:19.355588+0000","last_fullsized":"2024-02-17T12:18:19.355588+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816331+0000","last_change":"2024-02-17T12:18:02.810198+0000","last_active":"2024-02-17T12:18:21.816331+0000","last_peered":"2024-02-17T12:18:21.816331+0000","last_clean":"2024-02-17T12:18:21.816331+0000","last_became_active":"2024-02-17T12:18:02.809131+0000","last_became_peered":"2024-02-17T12:18:02.809131+0000","last_unstale":"2024-02-17T12:18:21.816331+0000","last_undegraded":"2024-02-17T12:18:21.816331+0000","last_fullsized":"2024-02-17T12:18:21.816331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:01:23.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816711+0000","last_change":"2024-02-17T12:18:01.802710+0000","last_active":"2024-02-17T12:18:21.816711+0000","last_peered":"2024-02-17T12:18:21.816711+0000","last_clean":"2024-02-17T12:18:21.816711+0000","last_became_active":"2024-02-17T12:18:01.802365+0000","last_became_peered":"2024-02-17T12:18:01.802365+0000","last_unstale":"2024-02-17T12:18:21.816711+0000","last_undegraded":"2024-02-17T12:18:21.816711+0000","last_fullsized":"2024-02-17T12:18:21.816711+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:45.771679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.334337+0000","last_change":"2024-02-17T12:18:19.334337+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.334337+0000","last_undegraded":"2024-02-17T12:18:19.334337+0000","last_fullsized":"2024-02-17T12:18:19.334337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360350+0000","last_change":"2024-02-17T12:18:19.353417+0000","last_active":"2024-02-17T12:18:19.360350+0000","last_peered":"2024-02-17T12:18:19.360350+0000","last_clean":"2024-02-17T12:18:19.360350+0000","last_became_active":"2024-02-17T12:18:19.350515+0000","last_became_peered":"2024-02-17T12:18:19.350515+0000","last_unstale":"2024-02-17T12:18:19.360350+0000","last_undegraded":"2024-02-17T12:18:19.360350+0000","last_fullsized":"2024-02-17T12:18:19.360350+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:05:31.415587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333976+0000","last_change":"2024-02-17T12:18:02.809855+0000","last_active":"2024-02-17T12:18:19.333976+0000","last_peered":"2024-02-17T12:18:19.333976+0000","last_clean":"2024-02-17T12:18:19.333976+0000","last_became_active":"2024-02-17T12:18:02.809577+0000","last_became_peered":"2024-02-17T12:18:02.809577+0000","last_unstale":"2024-02-17T12:18:19.333976+0000","last_undegraded":"2024-02-17T12:18:19.333976+0000","last_fullsized":"2024-02-17T12:18:19.333976+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:17:49.657379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342359+0000","last_change":"2024-02-17T12:18:01.792615+0000","last_active":"2024-02-17T12:18:19.342359+0000","last_peered":"2024-02-17T12:18:19.342359+0000","last_clean":"2024-02-17T12:18:19.342359+0000","last_became_active":"2024-02-17T12:18:01.792287+0000","last_became_peered":"2024-02-17T12:18:01.792287+0000","last_unstale":"2024-02-17T12:18:19.342359+0000","last_undegraded":"2024-02-17T12:18:19.342359+0000","last_fullsized":"2024-02-17T12:18:19.342359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:56.241760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814588+0000","last_change":"2024-02-17T12:18:20.366313+0000","last_active":"2024-02-17T12:18:21.814588+0000","last_peered":"2024-02-17T12:18:21.814588+0000","last_clean":"2024-02-17T12:18:21.814588+0000","last_became_active":"2024-02-17T12:18:20.358125+0000","last_became_peered":"2024-02-17T12:18:20.358125+0000","last_unstale":"2024-02-17T12:18:21.814588+0000","last_undegraded":"2024-02-17T12:18:21.814588+0000","last_fullsized":"2024-02-17T12:18:21.814588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:29:25.235404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815415+0000","last_change":"2024-02-17T12:18:19.350080+0000","last_active":"2024-02-17T12:18:21.815415+0000","last_peered":"2024-02-17T12:18:21.815415+0000","last_clean":"2024-02-17T12:18:21.815415+0000","last_became_active":"2024-02-17T12:18:19.349855+0000","last_became_peered":"2024-02-17T12:18:19.349855+0000","last_unstale":"2024-02-17T12:18:21.815415+0000","last_undegraded":"2024-02-17T12:18:21.815415+0000","last_fullsized":"2024-02-17T12:18:21.815415+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:06:06.795461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815664+0000","last_change":"2024-02-17T12:18:02.808057+0000","last_active":"2024-02-17T12:18:21.815664+0000","last_peered":"2024-02-17T12:18:21.815664+0000","last_clean":"2024-02-17T12:18:21.815664+0000","last_became_active":"2024-02-17T12:18:02.807629+0000","last_became_peered":"2024-02-17T12:18:02.807629+0000","last_unstale":"2024-02-17T12:18:21.815664+0000","last_undegraded":"2024-02-17T12:18:21.815664+0000","last_fullsized":"2024-02-17T12:18:21.815664+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:58:48.506743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.346100+0000","last_change":"2024-02-17T12:18:01.797715+0000","last_active":"2024-02-17T12:18:19.346100+0000","last_peered":"2024-02-17T12:18:19.346100+0000","last_clean":"2024-02-17T12:18:19.346100+0000","last_became_active":"2024-02-17T12:18:01.797435+0000","last_became_peered":"2024-02-17T12:18:01.797435+0000","last_unstale":"2024-02-17T12:18:19.346100+0000","last_undegraded":"2024-02-17T12:18:19.346100+0000","last_fullsized":"2024-02-17T12:18:19.346100+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:49.624601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815003+0000","last_change":"2024-02-17T12:18:20.356336+0000","last_active":"2024-02-17T12:18:21.815003+0000","last_peered":"2024-02-17T12:18:21.815003+0000","last_clean":"2024-02-17T12:18:21.815003+0000","last_became_active":"2024-02-17T12:18:20.355999+0000","last_became_peered":"2024-02-17T12:18:20.355999+0000","last_unstale":"2024-02-17T12:18:21.815003+0000","last_undegraded":"2024-02-17T12:18:21.815003+0000","last_fullsized":"2024-02-17T12:18:21.815003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:54:08.533027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360516+0000","last_change":"2024-02-17T12:18:19.355317+0000","last_active":"2024-02-17T12:18:19.360516+0000","last_peered":"2024-02-17T12:18:19.360516+0000","last_clean":"2024-02-17T12:18:19.360516+0000","last_became_active":"2024-02-17T12:18:19.353852+0000","last_became_peered":"2024-02-17T12:18:19.353852+0000","last_unstale":"2024-02-17T12:18:19.360516+0000","last_undegraded":"2024-02-17T12:18:19.360516+0000","last_fullsized":"2024-02-17T12:18:19.360516+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:42:52.676828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815618+0000","last_change":"2024-02-17T12:18:02.810137+0000","last_active":"2024-02-17T12:18:21.815618+0000","last_peered":"2024-02-17T12:18:21.815618+0000","last_clean":"2024-02-17T12:18:21.815618+0000","last_became_active":"2024-02-17T12:18:02.809877+0000","last_became_peered":"2024-02-17T12:18:02.809877+0000","last_unstale":"2024-02-17T12:18:21.815618+0000","last_undegraded":"2024-02-17T12:18:21.815618+0000","last_fullsized":"2024-02-17T12:18:21.815618+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:15.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333119+0000","last_change":"2024-02-17T12:18:01.790794+0000","last_active":"2024-02-17T12:18:19.333119+0000","last_peered":"2024-02-17T12:18:19.333119+0000","last_clean":"2024-02-17T12:18:19.333119+0000","last_became_active":"2024-02-17T12:18:01.790500+0000","last_became_peered":"2024-02-17T12:18:01.790500+0000","last_unstale":"2024-02-17T12:18:19.333119+0000","last_undegraded":"2024-02-17T12:18:19.333119+0000","last_fullsized":"2024-02-17T12:18:19.333119+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.330408+0000","last_change":"2024-02-17T12:18:19.330408+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.330408+0000","last_undegraded":"2024-02-17T12:18:19.330408+0000","last_fullsized":"2024-02-17T12:18:19.330408+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360110+0000","last_change":"2024-02-17T12:18:19.352733+0000","last_active":"2024-02-17T12:18:19.360110+0000","last_peered":"2024-02-17T12:18:19.360110+0000","last_clean":"2024-02-17T12:18:19.360110+0000","last_became_active":"2024-02-17T12:18:19.352039+0000","last_became_peered":"2024-02-17T12:18:19.352039+0000","last_unstale":"2024-02-17T12:18:19.360110+0000","last_undegraded":"2024-02-17T12:18:19.360110+0000","last_fullsized":"2024-02-17T12:18:19.360110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:28:25.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815239+0000","last_change":"2024-02-17T12:18:02.808594+0000","last_active":"2024-02-17T12:18:21.815239+0000","last_peered":"2024-02-17T12:18:21.815239+0000","last_clean":"2024-02-17T12:18:21.815239+0000","last_became_active":"2024-02-17T12:18:02.808035+0000","last_became_peered":"2024-02-17T12:18:02.808035+0000","last_unstale":"2024-02-17T12:18:21.815239+0000","last_undegraded":"2024-02-17T12:18:21.815239+0000","last_fullsized":"2024-02-17T12:18:21.815239+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:58.050395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815076+0000","last_change":"2024-02-17T12:18:01.789017+0000","last_active":"2024-02-17T12:18:21.815076+0000","last_peered":"2024-02-17T12:18:21.815076+0000","last_clean":"2024-02-17T12:18:21.815076+0000","last_became_active":"2024-02-17T12:18:01.788529+0000","last_became_peered":"2024-02-17T12:18:01.788529+0000","last_unstale":"2024-02-17T12:18:21.815076+0000","last_undegraded":"2024-02-17T12:18:21.815076+0000","last_fullsized":"2024-02-17T12:18:21.815076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:31.560281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.341864+0000","last_change":"2024-02-17T12:18:19.341864+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.341864+0000","last_undegraded":"2024-02-17T12:18:19.341864+0000","last_fullsized":"2024-02-17T12:18:19.341864+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360193+0000","last_change":"2024-02-17T12:18:19.354058+0000","last_active":"2024-02-17T12:18:19.360193+0000","last_peered":"2024-02-17T12:18:19.360193+0000","last_clean":"2024-02-17T12:18:19.360193+0000","last_became_active":"2024-02-17T12:18:19.353686+0000","last_became_peered":"2024-02-17T12:18:19.353686+0000","last_unstale":"2024-02-17T12:18:19.360193+0000","last_undegraded":"2024-02-17T12:18:19.360193+0000","last_fullsized":"2024-02-17T12:18:19.360193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:44.104942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816822+0000","last_change":"2024-02-17T12:18:02.808518+0000","last_active":"2024-02-17T12:18:21.816822+0000","last_peered":"2024-02-17T12:18:21.816822+0000","last_clean":"2024-02-17T12:18:21.816822+0000","last_became_active":"2024-02-17T12:18:02.808255+0000","last_became_peered":"2024-02-17T12:18:02.808255+0000","last_unstale":"2024-02-17T12:18:21.816822+0000","last_undegraded":"2024-02-17T12:18:21.816822+0000","last_fullsized":"2024-02-17T12:18:21.816822+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:58:40.908163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343746+0000","last_change":"2024-02-17T12:18:01.802794+0000","last_active":"2024-02-17T12:18:19.343746+0000","last_peered":"2024-02-17T12:18:19.343746+0000","last_clean":"2024-02-17T12:18:19.343746+0000","last_became_active":"2024-02-17T12:18:01.802366+0000","last_became_peered":"2024-02-17T12:18:01.802366+0000","last_unstale":"2024-02-17T12:18:19.343746+0000","last_undegraded":"2024-02-17T12:18:19.343746+0000","last_fullsized":"2024-02-17T12:18:19.343746+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:45:00.445775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816018+0000","last_change":"2024-02-17T12:18:20.373572+0000","last_active":"2024-02-17T12:18:21.816018+0000","last_peered":"2024-02-17T12:18:21.816018+0000","last_clean":"2024-02-17T12:18:21.816018+0000","last_became_active":"2024-02-17T12:18:20.373216+0000","last_became_peered":"2024-02-17T12:18:20.373216+0000","last_unstale":"2024-02-17T12:18:21.816018+0000","last_undegraded":"2024-02-17T12:18:21.816018+0000","last_fullsized":"2024-02-17T12:18:21.816018+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:18.914283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815406+0000","last_change":"2024-02-17T12:18:19.348085+0000","last_active":"2024-02-17T12:18:21.815406+0000","last_peered":"2024-02-17T12:18:21.815406+0000","last_clean":"2024-02-17T12:18:21.815406+0000","last_became_active":"2024-02-17T12:18:19.347772+0000","last_became_peered":"2024-02-17T12:18:19.347772+0000","last_unstale":"2024-02-17T12:18:21.815406+0000","last_undegraded":"2024-02-17T12:18:21.815406+0000","last_fullsized":"2024-02-17T12:18:21.815406+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:03:13.293322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334807+0000","last_change":"2024-02-17T12:18:02.810942+0000","last_active":"2024-02-17T12:18:19.334807+0000","last_peered":"2024-02-17T12:18:19.334807+0000","last_clean":"2024-02-17T12:18:19.334807+0000","last_became_active":"2024-02-17T12:18:02.810651+0000","last_became_peered":"2024-02-17T12:18:02.810651+0000","last_unstale":"2024-02-17T12:18:19.334807+0000","last_undegraded":"2024-02-17T12:18:19.334807+0000","last_fullsized":"2024-02-17T12:18:19.334807+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338302+0000","last_change":"2024-02-17T12:18:01.797601+0000","last_active":"2024-02-17T12:18:19.338302+0000","last_peered":"2024-02-17T12:18:19.338302+0000","last_clean":"2024-02-17T12:18:19.338302+0000","last_became_active":"2024-02-17T12:18:01.796341+0000","last_became_peered":"2024-02-17T12:18:01.796341+0000","last_unstale":"2024-02-17T12:18:19.338302+0000","last_undegraded":"2024-02-17T12:18:19.338302+0000","last_fullsized":"2024-02-17T12:18:19.338302+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817490+0000","last_change":"2024-02-17T12:18:20.376384+0000","last_active":"2024-02-17T12:18:21.817490+0000","last_peered":"2024-02-17T12:18:21.817490+0000","last_clean":"2024-02-17T12:18:21.817490+0000","last_became_active":"2024-02-17T12:18:20.368869+0000","last_became_peered":"2024-02-17T12:18:20.368869+0000","last_unstale":"2024-02-17T12:18:21.817490+0000","last_undegraded":"2024-02-17T12:18:21.817490+0000","last_fullsized":"2024-02-17T12:18:21.817490+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:13.358875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360165+0000","last_change":"2024-02-17T12:18:19.353335+0000","last_active":"2024-02-17T12:18:19.360165+0000","last_peered":"2024-02-17T12:18:19.360165+0000","last_clean":"2024-02-17T12:18:19.360165+0000","last_became_active":"2024-02-17T12:18:19.353048+0000","last_became_peered":"2024-02-17T12:18:19.353048+0000","last_unstale":"2024-02-17T12:18:19.360165+0000","last_undegraded":"2024-02-17T12:18:19.360165+0000","last_fullsized":"2024-02-17T12:18:19.360165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:18:06.203775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344150+0000","last_change":"2024-02-17T12:18:02.803894+0000","last_active":"2024-02-17T12:18:19.344150+0000","last_peered":"2024-02-17T12:18:19.344150+0000","last_clean":"2024-02-17T12:18:19.344150+0000","last_became_active":"2024-02-17T12:18:02.803553+0000","last_became_peered":"2024-02-17T12:18:02.803553+0000","last_unstale":"2024-02-17T12:18:19.344150+0000","last_undegraded":"2024-02-17T12:18:19.344150+0000","last_fullsized":"2024-02-17T12:18:19.344150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:35:24.727572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330495+0000","last_change":"2024-02-17T12:18:01.789546+0000","last_active":"2024-02-17T12:18:19.330495+0000","last_peered":"2024-02-17T12:18:19.330495+0000","last_clean":"2024-02-17T12:18:19.330495+0000","last_became_active":"2024-02-17T12:18:01.789258+0000","last_became_peered":"2024-02-17T12:18:01.789258+0000","last_unstale":"2024-02-17T12:18:19.330495+0000","last_undegraded":"2024-02-17T12:18:19.330495+0000","last_fullsized":"2024-02-17T12:18:19.330495+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817152+0000","last_change":"2024-02-17T12:18:20.371385+0000","last_active":"2024-02-17T12:18:21.817152+0000","last_peered":"2024-02-17T12:18:21.817152+0000","last_clean":"2024-02-17T12:18:21.817152+0000","last_became_active":"2024-02-17T12:18:20.370442+0000","last_became_peered":"2024-02-17T12:18:20.370442+0000","last_unstale":"2024-02-17T12:18:21.817152+0000","last_undegraded":"2024-02-17T12:18:21.817152+0000","last_fullsized":"2024-02-17T12:18:21.817152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:08:33.483318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817199+0000","last_change":"2024-02-17T12:18:19.349251+0000","last_active":"2024-02-17T12:18:21.817199+0000","last_peered":"2024-02-17T12:18:21.817199+0000","last_clean":"2024-02-17T12:18:21.817199+0000","last_became_active":"2024-02-17T12:18:19.346293+0000","last_became_peered":"2024-02-17T12:18:19.346293+0000","last_unstale":"2024-02-17T12:18:21.817199+0000","last_undegraded":"2024-02-17T12:18:21.817199+0000","last_fullsized":"2024-02-17T12:18:21.817199+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:29.296104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816408+0000","last_change":"2024-02-17T12:18:02.811327+0000","last_active":"2024-02-17T12:18:21.816408+0000","last_peered":"2024-02-17T12:18:21.816408+0000","last_clean":"2024-02-17T12:18:21.816408+0000","last_became_active":"2024-02-17T12:18:02.809620+0000","last_became_peered":"2024-02-17T12:18:02.809620+0000","last_unstale":"2024-02-17T12:18:21.816408+0000","last_undegraded":"2024-02-17T12:18:21.816408+0000","last_fullsized":"2024-02-17T12:18:21.816408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:40:08.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.339073+0000","last_change":"2024-02-17T12:18:01.798265+0000","last_active":"2024-02-17T12:18:19.339073+0000","last_peered":"2024-02-17T12:18:19.339073+0000","last_clean":"2024-02-17T12:18:19.339073+0000","last_became_active":"2024-02-17T12:18:01.797931+0000","last_became_peered":"2024-02-17T12:18:01.797931+0000","last_unstale":"2024-02-17T12:18:19.339073+0000","last_undegraded":"2024-02-17T12:18:19.339073+0000","last_fullsized":"2024-02-17T12:18:19.339073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333949+0000","last_change":"2024-02-17T12:18:19.333949+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333949+0000","last_undegraded":"2024-02-17T12:18:19.333949+0000","last_fullsized":"2024-02-17T12:18:19.333949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343005+0000","last_change":"2024-02-17T12:18:19.339116+0000","last_active":"2024-02-17T12:18:19.343005+0000","last_peered":"2024-02-17T12:18:19.343005+0000","last_clean":"2024-02-17T12:18:19.343005+0000","last_became_active":"2024-02-17T12:18:19.338406+0000","last_became_peered":"2024-02-17T12:18:19.338406+0000","last_unstale":"2024-02-17T12:18:19.343005+0000","last_undegraded":"2024-02-17T12:18:19.343005+0000","last_fullsized":"2024-02-17T12:18:19.343005+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:11.400472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334099+0000","last_change":"2024-02-17T12:18:02.800381+0000","last_active":"2024-02-17T12:18:19.334099+0000","last_peered":"2024-02-17T12:18:19.334099+0000","last_clean":"2024-02-17T12:18:19.334099+0000","last_became_active":"2024-02-17T12:18:02.800042+0000","last_became_peered":"2024-02-17T12:18:02.800042+0000","last_unstale":"2024-02-17T12:18:19.334099+0000","last_undegraded":"2024-02-17T12:18:19.334099+0000","last_fullsized":"2024-02-17T12:18:19.334099+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:27.558546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342497+0000","last_change":"2024-02-17T12:18:01.795914+0000","last_active":"2024-02-17T12:18:19.342497+0000","last_peered":"2024-02-17T12:18:19.342497+0000","last_clean":"2024-02-17T12:18:19.342497+0000","last_became_active":"2024-02-17T12:18:01.794847+0000","last_became_peered":"2024-02-17T12:18:01.794847+0000","last_unstale":"2024-02-17T12:18:19.342497+0000","last_undegraded":"2024-02-17T12:18:19.342497+0000","last_fullsized":"2024-02-17T12:18:19.342497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:31.320927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333047+0000","last_change":"2024-02-17T12:18:19.333047+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333047+0000","last_undegraded":"2024-02-17T12:18:19.333047+0000","last_fullsized":"2024-02-17T12:18:19.333047+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.357925+0000","last_change":"2024-02-17T12:18:19.352005+0000","last_active":"2024-02-17T12:18:19.357925+0000","last_peered":"2024-02-17T12:18:19.357925+0000","last_clean":"2024-02-17T12:18:19.357925+0000","last_became_active":"2024-02-17T12:18:19.351791+0000","last_became_peered":"2024-02-17T12:18:19.351791+0000","last_unstale":"2024-02-17T12:18:19.357925+0000","last_undegraded":"2024-02-17T12:18:19.357925+0000","last_fullsized":"2024-02-17T12:18:19.357925+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:19:04.346561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.337872+0000","last_change":"2024-02-17T12:18:02.807547+0000","last_active":"2024-02-17T12:18:19.337872+0000","last_peered":"2024-02-17T12:18:19.337872+0000","last_clean":"2024-02-17T12:18:19.337872+0000","last_became_active":"2024-02-17T12:18:02.807209+0000","last_became_peered":"2024-02-17T12:18:02.807209+0000","last_unstale":"2024-02-17T12:18:19.337872+0000","last_undegraded":"2024-02-17T12:18:19.337872+0000","last_fullsized":"2024-02-17T12:18:19.337872+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.343944+0000","last_change":"2024-02-17T12:18:01.803848+0000","last_active":"2024-02-17T12:18:19.343944+0000","last_peered":"2024-02-17T12:18:19.343944+0000","last_clean":"2024-02-17T12:18:19.343944+0000","last_became_active":"2024-02-17T12:18:01.803552+0000","last_became_peered":"2024-02-17T12:18:01.803552+0000","last_unstale":"2024-02-17T12:18:19.343944+0000","last_undegraded":"2024-02-17T12:18:19.343944+0000","last_fullsized":"2024-02-17T12:18:19.343944+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:25:02.826927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339057+0000","last_change":"2024-02-17T12:18:19.339057+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339057+0000","last_undegraded":"2024-02-17T12:18:19.339057+0000","last_fullsized":"2024-02-17T12:18:19.339057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360064+0000","last_change":"2024-02-17T12:18:19.352308+0000","last_active":"2024-02-17T12:18:19.360064+0000","last_peered":"2024-02-17T12:18:19.360064+0000","last_clean":"2024-02-17T12:18:19.360064+0000","last_became_active":"2024-02-17T12:18:19.351363+0000","last_became_peered":"2024-02-17T12:18:19.351363+0000","last_unstale":"2024-02-17T12:18:19.360064+0000","last_undegraded":"2024-02-17T12:18:19.360064+0000","last_fullsized":"2024-02-17T12:18:19.360064+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:53:41.288869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340485+0000","last_change":"2024-02-17T12:18:02.811800+0000","last_active":"2024-02-17T12:18:19.340485+0000","last_peered":"2024-02-17T12:18:19.340485+0000","last_clean":"2024-02-17T12:18:19.340485+0000","last_became_active":"2024-02-17T12:18:02.811504+0000","last_became_peered":"2024-02-17T12:18:02.811504+0000","last_unstale":"2024-02-17T12:18:19.340485+0000","last_undegraded":"2024-02-17T12:18:19.340485+0000","last_fullsized":"2024-02-17T12:18:19.340485+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.331083+0000","last_change":"2024-02-17T12:18:01.800860+0000","last_active":"2024-02-17T12:18:19.331083+0000","last_peered":"2024-02-17T12:18:19.331083+0000","last_clean":"2024-02-17T12:18:19.331083+0000","last_became_active":"2024-02-17T12:18:01.800569+0000","last_became_peered":"2024-02-17T12:18:01.800569+0000","last_unstale":"2024-02-17T12:18:19.331083+0000","last_undegraded":"2024-02-17T12:18:19.331083+0000","last_fullsized":"2024-02-17T12:18:19.331083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815460+0000","last_change":"2024-02-17T12:18:20.366635+0000","last_active":"2024-02-17T12:18:21.815460+0000","last_peered":"2024-02-17T12:18:21.815460+0000","last_clean":"2024-02-17T12:18:21.815460+0000","last_became_active":"2024-02-17T12:18:20.366353+0000","last_became_peered":"2024-02-17T12:18:20.366353+0000","last_unstale":"2024-02-17T12:18:21.815460+0000","last_undegraded":"2024-02-17T12:18:21.815460+0000","last_fullsized":"2024-02-17T12:18:21.815460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:06.721140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816072+0000","last_change":"2024-02-17T12:18:19.349932+0000","last_active":"2024-02-17T12:18:21.816072+0000","last_peered":"2024-02-17T12:18:21.816072+0000","last_clean":"2024-02-17T12:18:21.816072+0000","last_became_active":"2024-02-17T12:18:19.349592+0000","last_became_peered":"2024-02-17T12:18:19.349592+0000","last_unstale":"2024-02-17T12:18:21.816072+0000","last_undegraded":"2024-02-17T12:18:21.816072+0000","last_fullsized":"2024-02-17T12:18:21.816072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:19:58.523935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.333029+0000","last_change":"2024-02-17T12:18:02.812763+0000","last_active":"2024-02-17T12:18:19.333029+0000","last_peered":"2024-02-17T12:18:19.333029+0000","last_clean":"2024-02-17T12:18:19.333029+0000","last_became_active":"2024-02-17T12:18:02.812512+0000","last_became_peered":"2024-02-17T12:18:02.812512+0000","last_unstale":"2024-02-17T12:18:19.333029+0000","last_undegraded":"2024-02-17T12:18:19.333029+0000","last_fullsized":"2024-02-17T12:18:19.333029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345020+0000","last_change":"2024-02-17T12:18:01.805847+0000","last_active":"2024-02-17T12:18:19.345020+0000","last_peered":"2024-02-17T12:18:19.345020+0000","last_clean":"2024-02-17T12:18:19.345020+0000","last_became_active":"2024-02-17T12:18:01.805591+0000","last_became_peered":"2024-02-17T12:18:01.805591+0000","last_unstale":"2024-02-17T12:18:19.345020+0000","last_undegraded":"2024-02-17T12:18:19.345020+0000","last_fullsized":"2024-02-17T12:18:19.345020+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:52:05.403651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816249+0000","last_change":"2024-02-17T12:18:20.373389+0000","last_active":"2024-02-17T12:18:21.816249+0000","last_peered":"2024-02-17T12:18:21.816249+0000","last_clean":"2024-02-17T12:18:21.816249+0000","last_became_active":"2024-02-17T12:18:20.373079+0000","last_became_peered":"2024-02-17T12:18:20.373079+0000","last_unstale":"2024-02-17T12:18:21.816249+0000","last_undegraded":"2024-02-17T12:18:21.816249+0000","last_fullsized":"2024-02-17T12:18:21.816249+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:29:46.494031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.347869+0000","last_change":"2024-02-17T12:18:19.343966+0000","last_active":"2024-02-17T12:18:19.347869+0000","last_peered":"2024-02-17T12:18:19.347869+0000","last_clean":"2024-02-17T12:18:19.347869+0000","last_became_active":"2024-02-17T12:18:19.343701+0000","last_became_peered":"2024-02-17T12:18:19.343701+0000","last_unstale":"2024-02-17T12:18:19.347869+0000","last_undegraded":"2024-02-17T12:18:19.347869+0000","last_fullsized":"2024-02-17T12:18:19.347869+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:54:15.066782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.334914+0000","last_change":"2024-02-17T12:18:02.809740+0000","last_active":"2024-02-17T12:18:19.334914+0000","last_peered":"2024-02-17T12:18:19.334914+0000","last_clean":"2024-02-17T12:18:19.334914+0000","last_became_active":"2024-02-17T12:18:02.809407+0000","last_became_peered":"2024-02-17T12:18:02.809407+0000","last_unstale":"2024-02-17T12:18:19.334914+0000","last_undegraded":"2024-02-17T12:18:19.334914+0000","last_fullsized":"2024-02-17T12:18:19.334914+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338398+0000","last_change":"2024-02-17T12:18:01.794714+0000","last_active":"2024-02-17T12:18:19.338398+0000","last_peered":"2024-02-17T12:18:19.338398+0000","last_clean":"2024-02-17T12:18:19.338398+0000","last_became_active":"2024-02-17T12:18:01.794439+0000","last_became_peered":"2024-02-17T12:18:01.794439+0000","last_unstale":"2024-02-17T12:18:19.338398+0000","last_undegraded":"2024-02-17T12:18:19.338398+0000","last_fullsized":"2024-02-17T12:18:19.338398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.333665+0000","last_change":"2024-02-17T12:18:19.333665+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.333665+0000","last_undegraded":"2024-02-17T12:18:19.333665+0000","last_fullsized":"2024-02-17T12:18:19.333665+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.360140+0000","last_change":"2024-02-17T12:18:19.353264+0000","last_active":"2024-02-17T12:18:19.360140+0000","last_peered":"2024-02-17T12:18:19.360140+0000","last_clean":"2024-02-17T12:18:19.360140+0000","last_became_active":"2024-02-17T12:18:19.352997+0000","last_became_peered":"2024-02-17T12:18:19.352997+0000","last_unstale":"2024-02-17T12:18:19.360140+0000","last_undegraded":"2024-02-17T12:18:19.360140+0000","last_fullsized":"2024-02-17T12:18:19.360140+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:43.352769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344465+0000","last_change":"2024-02-17T12:18:02.794702+0000","last_active":"2024-02-17T12:18:19.344465+0000","last_peered":"2024-02-17T12:18:19.344465+0000","last_clean":"2024-02-17T12:18:19.344465+0000","last_became_active":"2024-02-17T12:18:02.794412+0000","last_became_peered":"2024-02-17T12:18:02.794412+0000","last_unstale":"2024-02-17T12:18:19.344465+0000","last_undegraded":"2024-02-17T12:18:19.344465+0000","last_fullsized":"2024-02-17T12:18:19.344465+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:05:00.914700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.347492+0000","last_change":"2024-02-17T12:18:01.800872+0000","last_active":"2024-02-17T12:18:19.347492+0000","last_peered":"2024-02-17T12:18:19.347492+0000","last_clean":"2024-02-17T12:18:19.347492+0000","last_became_active":"2024-02-17T12:18:01.800563+0000","last_became_peered":"2024-02-17T12:18:01.800563+0000","last_unstale":"2024-02-17T12:18:19.347492+0000","last_undegraded":"2024-02-17T12:18:19.347492+0000","last_fullsized":"2024-02-17T12:18:19.347492+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:28.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.331009+0000","last_change":"2024-02-17T12:18:19.331009+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.331009+0000","last_undegraded":"2024-02-17T12:18:19.331009+0000","last_fullsized":"2024-02-17T12:18:19.331009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.352419+0000","last_change":"2024-02-17T12:18:19.346074+0000","last_active":"2024-02-17T12:18:19.352419+0000","last_peered":"2024-02-17T12:18:19.352419+0000","last_clean":"2024-02-17T12:18:19.352419+0000","last_became_active":"2024-02-17T12:18:19.344987+0000","last_became_peered":"2024-02-17T12:18:19.344987+0000","last_unstale":"2024-02-17T12:18:19.352419+0000","last_undegraded":"2024-02-17T12:18:19.352419+0000","last_fullsized":"2024-02-17T12:18:19.352419+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:36:50.709873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338347+0000","last_change":"2024-02-17T12:18:02.806343+0000","last_active":"2024-02-17T12:18:19.338347+0000","last_peered":"2024-02-17T12:18:19.338347+0000","last_clean":"2024-02-17T12:18:19.338347+0000","last_became_active":"2024-02-17T12:18:02.805514+0000","last_became_peered":"2024-02-17T12:18:02.805514+0000","last_unstale":"2024-02-17T12:18:19.338347+0000","last_undegraded":"2024-02-17T12:18:19.338347+0000","last_fullsized":"2024-02-17T12:18:19.338347+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:46.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.330930+0000","last_change":"2024-02-17T12:18:01.801897+0000","last_active":"2024-02-17T12:18:19.330930+0000","last_peered":"2024-02-17T12:18:19.330930+0000","last_clean":"2024-02-17T12:18:19.330930+0000","last_became_active":"2024-02-17T12:18:01.801572+0000","last_became_peered":"2024-02-17T12:18:01.801572+0000","last_unstale":"2024-02-17T12:18:19.330930+0000","last_undegraded":"2024-02-17T12:18:19.330930+0000","last_fullsized":"2024-02-17T12:18:19.330930+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.340349+0000","last_change":"2024-02-17T12:18:19.340349+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.340349+0000","last_undegraded":"2024-02-17T12:18:19.340349+0000","last_fullsized":"2024-02-17T12:18:19.340349+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815204+0000","last_change":"2024-02-17T12:18:19.354672+0000","last_active":"2024-02-17T12:18:21.815204+0000","last_peered":"2024-02-17T12:18:21.815204+0000","last_clean":"2024-02-17T12:18:21.815204+0000","last_became_active":"2024-02-17T12:18:19.354374+0000","last_became_peered":"2024-02-17T12:18:19.354374+0000","last_unstale":"2024-02-17T12:18:21.815204+0000","last_undegraded":"2024-02-17T12:18:21.815204+0000","last_fullsized":"2024-02-17T12:18:21.815204+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:34.495180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.342026+0000","last_change":"2024-02-17T12:18:02.808806+0000","last_active":"2024-02-17T12:18:19.342026+0000","last_peered":"2024-02-17T12:18:19.342026+0000","last_clean":"2024-02-17T12:18:19.342026+0000","last_became_active":"2024-02-17T12:18:02.808546+0000","last_became_peered":"2024-02-17T12:18:02.808546+0000","last_unstale":"2024-02-17T12:18:19.342026+0000","last_undegraded":"2024-02-17T12:18:19.342026+0000","last_fullsized":"2024-02-17T12:18:19.342026+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:25.157077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.344522+0000","last_change":"2024-02-17T12:18:01.798282+0000","last_active":"2024-02-17T12:18:19.344522+0000","last_peered":"2024-02-17T12:18:19.344522+0000","last_clean":"2024-02-17T12:18:19.344522+0000","last_became_active":"2024-02-17T12:18:01.797970+0000","last_became_peered":"2024-02-17T12:18:01.797970+0000","last_unstale":"2024-02-17T12:18:19.344522+0000","last_undegraded":"2024-02-17T12:18:19.344522+0000","last_fullsized":"2024-02-17T12:18:19.344522+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:52:16.655449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.339895+0000","last_change":"2024-02-17T12:18:19.339895+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.339895+0000","last_undegraded":"2024-02-17T12:18:19.339895+0000","last_fullsized":"2024-02-17T12:18:19.339895+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.359996+0000","last_change":"2024-02-17T12:18:19.351990+0000","last_active":"2024-02-17T12:18:19.359996+0000","last_peered":"2024-02-17T12:18:19.359996+0000","last_clean":"2024-02-17T12:18:19.359996+0000","last_became_active":"2024-02-17T12:18:19.350808+0000","last_became_peered":"2024-02-17T12:18:19.350808+0000","last_unstale":"2024-02-17T12:18:19.359996+0000","last_undegraded":"2024-02-17T12:18:19.359996+0000","last_fullsized":"2024-02-17T12:18:19.359996+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:09.209961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815702+0000","last_change":"2024-02-17T12:18:02.808303+0000","last_active":"2024-02-17T12:18:21.815702+0000","last_peered":"2024-02-17T12:18:21.815702+0000","last_clean":"2024-02-17T12:18:21.815702+0000","last_became_active":"2024-02-17T12:18:02.807743+0000","last_became_peered":"2024-02-17T12:18:02.807743+0000","last_unstale":"2024-02-17T12:18:21.815702+0000","last_undegraded":"2024-02-17T12:18:21.815702+0000","last_fullsized":"2024-02-17T12:18:21.815702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:55.025562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816311+0000","last_change":"2024-02-17T12:18:01.802694+0000","last_active":"2024-02-17T12:18:21.816311+0000","last_peered":"2024-02-17T12:18:21.816311+0000","last_clean":"2024-02-17T12:18:21.816311+0000","last_became_active":"2024-02-17T12:18:01.802326+0000","last_became_peered":"2024-02-17T12:18:01.802326+0000","last_unstale":"2024-02-17T12:18:21.816311+0000","last_undegraded":"2024-02-17T12:18:21.816311+0000","last_fullsized":"2024-02-17T12:18:21.816311+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:33:51.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815421+0000","last_change":"2024-02-17T12:18:20.372330+0000","last_active":"2024-02-17T12:18:21.815421+0000","last_peered":"2024-02-17T12:18:21.815421+0000","last_clean":"2024-02-17T12:18:21.815421+0000","last_became_active":"2024-02-17T12:18:20.370118+0000","last_became_peered":"2024-02-17T12:18:20.370118+0000","last_unstale":"2024-02-17T12:18:21.815421+0000","last_undegraded":"2024-02-17T12:18:21.815421+0000","last_fullsized":"2024-02-17T12:18:21.815421+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:47.189847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815120+0000","last_change":"2024-02-17T12:18:19.345851+0000","last_active":"2024-02-17T12:18:21.815120+0000","last_peered":"2024-02-17T12:18:21.815120+0000","last_clean":"2024-02-17T12:18:21.815120+0000","last_became_active":"2024-02-17T12:18:19.345580+0000","last_became_peered":"2024-02-17T12:18:19.345580+0000","last_unstale":"2024-02-17T12:18:21.815120+0000","last_undegraded":"2024-02-17T12:18:21.815120+0000","last_fullsized":"2024-02-17T12:18:21.815120+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:41.120435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.340613+0000","last_change":"2024-02-17T12:18:02.805983+0000","last_active":"2024-02-17T12:18:19.340613+0000","last_peered":"2024-02-17T12:18:19.340613+0000","last_clean":"2024-02-17T12:18:19.340613+0000","last_became_active":"2024-02-17T12:18:02.805699+0000","last_became_peered":"2024-02-17T12:18:02.805699+0000","last_unstale":"2024-02-17T12:18:19.340613+0000","last_undegraded":"2024-02-17T12:18:19.340613+0000","last_fullsized":"2024-02-17T12:18:19.340613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:44.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341772+0000","last_change":"2024-02-17T12:18:01.801438+0000","last_active":"2024-02-17T12:18:19.341772+0000","last_peered":"2024-02-17T12:18:19.341772+0000","last_clean":"2024-02-17T12:18:19.341772+0000","last_became_active":"2024-02-17T12:18:01.801221+0000","last_became_peered":"2024-02-17T12:18:01.801221+0000","last_unstale":"2024-02-17T12:18:19.341772+0000","last_undegraded":"2024-02-17T12:18:19.341772+0000","last_fullsized":"2024-02-17T12:18:19.341772+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:09.649370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.335807+0000","last_change":"2024-02-17T12:18:19.335807+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.335807+0000","last_undegraded":"2024-02-17T12:18:19.335807+0000","last_fullsized":"2024-02-17T12:18:19.335807+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.353618+0000","last_change":"2024-02-17T12:18:19.350524+0000","last_active":"2024-02-17T12:18:19.353618+0000","last_peered":"2024-02-17T12:18:19.353618+0000","last_clean":"2024-02-17T12:18:19.353618+0000","last_became_active":"2024-02-17T12:18:19.350237+0000","last_became_peered":"2024-02-17T12:18:19.350237+0000","last_unstale":"2024-02-17T12:18:19.353618+0000","last_undegraded":"2024-02-17T12:18:19.353618+0000","last_fullsized":"2024-02-17T12:18:19.353618+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:28.434400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.341774+0000","last_change":"2024-02-17T12:18:02.806745+0000","last_active":"2024-02-17T12:18:19.341774+0000","last_peered":"2024-02-17T12:18:19.341774+0000","last_clean":"2024-02-17T12:18:19.341774+0000","last_became_active":"2024-02-17T12:18:02.806429+0000","last_became_peered":"2024-02-17T12:18:02.806429+0000","last_unstale":"2024-02-17T12:18:19.341774+0000","last_undegraded":"2024-02-17T12:18:19.341774+0000","last_fullsized":"2024-02-17T12:18:19.341774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:58.938533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338923+0000","last_change":"2024-02-17T12:18:01.793256+0000","last_active":"2024-02-17T12:18:19.338923+0000","last_peered":"2024-02-17T12:18:19.338923+0000","last_clean":"2024-02-17T12:18:19.338923+0000","last_became_active":"2024-02-17T12:18:01.793033+0000","last_became_peered":"2024-02-17T12:18:01.793033+0000","last_unstale":"2024-02-17T12:18:19.338923+0000","last_undegraded":"2024-02-17T12:18:19.338923+0000","last_fullsized":"2024-02-17T12:18:19.338923+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:46.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-02-17T12:18:19.332591+0000","last_change":"2024-02-17T12:18:19.332591+0000","last_active":"2024-02-17T12:18:19.322208+0000","last_peered":"2024-02-17T12:18:19.322208+0000","last_clean":"2024-02-17T12:18:19.322208+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:18:19.332591+0000","last_undegraded":"2024-02-17T12:18:19.332591+0000","last_fullsized":"2024-02-17T12:18:19.332591+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.355617+0000","last_change":"2024-02-17T12:18:19.349950+0000","last_active":"2024-02-17T12:18:19.355617+0000","last_peered":"2024-02-17T12:18:19.355617+0000","last_clean":"2024-02-17T12:18:19.355617+0000","last_became_active":"2024-02-17T12:18:19.349690+0000","last_became_peered":"2024-02-17T12:18:19.349690+0000","last_unstale":"2024-02-17T12:18:19.355617+0000","last_undegraded":"2024-02-17T12:18:19.355617+0000","last_fullsized":"2024-02-17T12:18:19.355617+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:49.360736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.338823+0000","last_change":"2024-02-17T12:18:02.800813+0000","last_active":"2024-02-17T12:18:19.338823+0000","last_peered":"2024-02-17T12:18:19.338823+0000","last_clean":"2024-02-17T12:18:19.338823+0000","last_became_active":"2024-02-17T12:18:02.800551+0000","last_became_peered":"2024-02-17T12:18:02.800551+0000","last_unstale":"2024-02-17T12:18:19.338823+0000","last_undegraded":"2024-02-17T12:18:19.338823+0000","last_fullsized":"2024-02-17T12:18:19.338823+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:47:58.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-02-17T12:18:19.345656+0000","last_change":"2024-02-17T12:18:01.796062+0000","last_active":"2024-02-17T12:18:19.345656+0000","last_peered":"2024-02-17T12:18:19.345656+0000","last_clean":"2024-02-17T12:18:19.345656+0000","last_became_active":"2024-02-17T12:18:01.795616+0000","last_became_peered":"2024-02-17T12:18:01.795616+0000","last_unstale":"2024-02-17T12:18:19.345656+0000","last_undegraded":"2024-02-17T12:18:19.345656+0000","last_fullsized":"2024-02-17T12:18:19.345656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:04:59.908240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":232,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815116+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:18:21.815116+0000","last_peered":"2024-02-17T12:18:21.815116+0000","last_clean":"2024-02-17T12:18:21.815116+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:18:21.815116+0000","last_undegraded":"2024-02-17T12:18:21.815116+0000","last_fullsized":"2024-02-17T12:18:21.815116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509468,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":254820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88700000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":1.115,"15min":1.115},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88500000000000001,"5min":1.143,"15min":1.143},"last":0.76800000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88700000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.90800000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.02},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.0049999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0669999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":622592,"data_stored":262602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.59299999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.378}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.439},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.66800000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":262006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.44},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.621,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":1.387,"15min":1.387},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.497,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.714,"15min":1.714},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.744,"15min":1.744},"last":0.90200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91500000000000004,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.91600000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.002,"5min":1.575,"15min":1.575},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96899999999999997,"5min":1.321,"15min":1.321},"last":0.95099999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":262040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64200000000000002,"5min":1.145,"15min":1.145},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.34000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69499999999999995,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58099999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73799999999999999,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":2.609,"15min":2.609},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.079,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.90700000000000003,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.997,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.05,"5min":1.095,"15min":1.095},"last":0.70299999999999996}]},{"osd":6,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0469999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0820000000000001,"5min":5.375,"15min":5.375},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":1.0169999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.091,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.629,"15min":1.629},"last":0.72499999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1224704,"data_stored":856015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47899999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45900000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45100000000000001,"15min":0.45700000000000002},"min":{"1min":0.312,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":1.046,"15min":1.046},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.58699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56100000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0129999999999999,"5min":1.139,"15min":1.139},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92800000000000005,"5min":1.038,"15min":1.038},"last":0.85999999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94499999999999995,"5min":1.095,"15min":1.095},"last":0.746}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0960000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.73299999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90200000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.84499999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1249280,"data_stored":867884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84899999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.53600000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75700000000000001,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.496},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92400000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.66100000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90000000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86799999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.442}]},{"osd":6,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95099999999999996,"5min":1.052,"15min":1.052},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55900000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542175,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":279925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86799999999999999,"5min":1.264,"15min":1.264},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.198,"15min":1.198},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.171,"15min":1.171},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93600000000000005,"5min":1.522,"15min":1.522},"last":0.751}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89900000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64700000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88100000000000001,"5min":1.228,"15min":1.228},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66500000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":659456,"data_stored":278408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.315},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.499}]},{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.441}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.372},{"interface":"front","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.141,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93300000000000005,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.81000000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2749999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.997,"5min":1.252,"15min":1.252},"last":0.72499999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91500000000000004,"5min":1.29,"15min":1.29},"last":0.751},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":1.337,"15min":1.337},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:18:29.010 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:18:29.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957fe00640 1 Processor -- start 2024-02-17T12:18:29.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957fe00640 1 -- start start 2024-02-17T12:18:29.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 0x7f95800aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f958006fdc0 0x7f9580152d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9580070c60 con 0x7f95800c2620 2024-02-17T12:18:29.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957fe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9580070370 con 0x7f958006fdc0 2024-02-17T12:18:29.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9580070610 con 0x7f9580150190 2024-02-17T12:18:29.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f958006fdc0 0x7f9580152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f958006fdc0 0x7f9580152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48336/0 (socket says 172.21.15.114:48336) 2024-02-17T12:18:29.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957e000640 1 -- 172.21.15.114:0/83132277 learned_addr learned my addr 172.21.15.114:0/83132277 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:29.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957ea00640 1 --2- 172.21.15.114:0/83132277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 0x7f95800aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957e000640 1 -- 172.21.15.114:0/83132277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 msgr2=0x7f95800aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:29.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957e000640 1 --2- 172.21.15.114:0/83132277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 0x7f95800aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957e000640 1 -- 172.21.15.114:0/83132277 >> v1:172.21.15.114:6789/0 conn(0x7f95800c2620 legacy=0x7f95801532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957d600640 1 -- 172.21.15.114:0/83132277 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258074086 0 0) 0x7f9580070c60 con 0x7f95800c2620 2024-02-17T12:18:29.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957e000640 1 -- 172.21.15.114:0/83132277 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95800708f0 con 0x7f958006fdc0 2024-02-17T12:18:29.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.153+0000 7f957ea00640 1 --2- 172.21.15.114:0/83132277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 0x7f95800aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:29.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957e000640 1 --2- 172.21.15.114:0/83132277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 0x7f9580152d80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9568009870 tx=0x7f956801cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a16e04c5f65b0ae server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957d600640 1 -- 172.21.15.114:0/83132277 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680ac640 con 0x7f958006fdc0 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957d600640 1 -- 172.21.15.114:0/83132277 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95680ac7a0 con 0x7f958006fdc0 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957d600640 1 -- 172.21.15.114:0/83132277 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95680acb30 con 0x7f958006fdc0 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957fe00640 1 -- 172.21.15.114:0/83132277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 msgr2=0x7f9580152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957fe00640 1 --2- 172.21.15.114:0/83132277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 0x7f9580152d80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9568009870 tx=0x7f956801cf30 comp rx=0 tx=0).stop 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957fe00640 1 -- 172.21.15.114:0/83132277 shutdown_connections 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957fe00640 1 --2- 172.21.15.114:0/83132277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 0x7f9580152d80 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957fe00640 1 --2- 172.21.15.114:0/83132277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 0x7f95800aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957fe00640 1 -- 172.21.15.114:0/83132277 >> 172.21.15.114:0/83132277 conn(0x7f958006ed70 msgr2=0x7f958006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957fe00640 1 -- 172.21.15.114:0/83132277 shutdown_connections 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.157+0000 7f957fe00640 1 -- 172.21.15.114:0/83132277 wait complete. 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 Processor -- start 2024-02-17T12:18:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 -- start start 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 0x7f95800a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95800c2620 0x7f9580148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 0x7f958014a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9580150eb0 con 0x7f958006fdc0 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9580151190 con 0x7f95800c2620 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95801497e0 con 0x7f9580150190 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 0x7f95800a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 0x7f95800a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48350/0 (socket says 172.21.15.114:48350) 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957ea00640 1 -- 172.21.15.114:0/792243750 learned_addr learned my addr 172.21.15.114:0/792243750 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957e000640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95800c2620 0x7f9580148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957f400640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 0x7f958014a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957ea00640 1 -- 172.21.15.114:0/792243750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 msgr2=0x7f958014a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957ea00640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 0x7f958014a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957ea00640 1 -- 172.21.15.114:0/792243750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95800c2620 msgr2=0x7f9580148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957ea00640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95800c2620 0x7f9580148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957ea00640 1 -- 172.21.15.114:0/792243750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680094d0 con 0x7f958006fdc0 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957e000640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95800c2620 0x7f9580148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957f400640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 0x7f958014a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957ea00640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 0x7f95800a9c90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f957000ce30 tx=0x7f957000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f9576a00640 1 -- 172.21.15.114:0/792243750 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000f890 con 0x7f958006fdc0 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f9576a00640 1 -- 172.21.15.114:0/792243750 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957000f9f0 con 0x7f958006fdc0 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 -- 172.21.15.114:0/792243750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95800c6f80 con 0x7f958006fdc0 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f9576a00640 1 -- 172.21.15.114:0/792243750 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000fd80 con 0x7f958006fdc0 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 -- 172.21.15.114:0/792243750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95800ab240 con 0x7f958006fdc0 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.161+0000 7f957fe00640 1 -- 172.21.15.114:0/792243750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9580068180 con 0x7f958006fdc0 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.165+0000 7f9576a00640 1 -- 172.21.15.114:0/792243750 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f957000b040 con 0x7f958006fdc0 2024-02-17T12:18:29.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.165+0000 7f9576a00640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f955c066e70 0x7f955c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.165+0000 7f9576a00640 1 -- 172.21.15.114:0/792243750 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f95700857f0 con 0x7f958006fdc0 2024-02-17T12:18:29.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.165+0000 7f957e000640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f955c066e70 0x7f955c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.165+0000 7f957e000640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f955c066e70 0x7f955c069330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f95680ae000 tx=0x7f9568008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:29.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.169+0000 7f9576a00640 1 -- 172.21.15.114:0/792243750 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9570052310 con 0x7f958006fdc0 2024-02-17T12:18:29.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.321+0000 7f957fe00640 1 -- 172.21.15.114:0/792243750 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9580150c00 con 0x7f955c066e70 2024-02-17T12:18:29.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.333+0000 7f9576a00640 1 -- 172.21.15.114:0/792243750 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527946 (secure 0 0 0) 0x7f9580150c00 con 0x7f955c066e70 2024-02-17T12:18:29.343 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:29.347 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 -- 172.21.15.114:0/792243750 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f955c066e70 msgr2=0x7f955c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f955c066e70 0x7f955c069330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f95680ae000 tx=0x7f9568008040 comp rx=0 tx=0).stop 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 -- 172.21.15.114:0/792243750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 msgr2=0x7f95800a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 0x7f95800a9c90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f957000ce30 tx=0x7f957000a650 comp rx=0 tx=0).stop 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 -- 172.21.15.114:0/792243750 shutdown_connections 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9580150190 0x7f958014a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95800c2620 0x7f9580148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f955c066e70 0x7f955c069330 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 --2- 172.21.15.114:0/792243750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f958006fdc0 0x7f95800a9c90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 -- 172.21.15.114:0/792243750 >> 172.21.15.114:0/792243750 conn(0x7f958006ed70 msgr2=0x7f958014f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 -- 172.21.15.114:0/792243750 shutdown_connections 2024-02-17T12:18:29.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.341+0000 7f957fe00640 1 -- 172.21.15.114:0/792243750 wait complete. 2024-02-17T12:18:29.363 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-02-17T12:18:29.243252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596691,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":376,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239096,"kb_used_data":6280,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735624,"statfs":{"total":773094113280,"available":772849278976,"internally_reserved":0,"allocated":6430720,"data_stored":3407302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.904354"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815095+0000","last_change":"2024-02-17T12:18:20.360957+0000","last_active":"2024-02-17T12:18:21.815095+0000","last_peered":"2024-02-17T12:18:21.815095+0000","last_clean":"2024-02-17T12:18:21.815095+0000","last_became_active":"2024-02-17T12:18:20.360592+0000","last_became_peered":"2024-02-17T12:18:20.360592+0000","last_unstale":"2024-02-17T12:18:21.815095+0000","last_undegraded":"2024-02-17T12:18:21.815095+0000","last_fullsized":"2024-02-17T12:18:21.815095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:35:38.593261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816493+0000","last_change":"2024-02-17T12:18:02.804326+0000","last_active":"2024-02-17T12:18:21.816493+0000","last_peered":"2024-02-17T12:18:21.816493+0000","last_clean":"2024-02-17T12:18:21.816493+0000","last_became_active":"2024-02-17T12:18:02.804074+0000","last_became_peered":"2024-02-17T12:18:02.804074+0000","last_unstale":"2024-02-17T12:18:21.816493+0000","last_undegraded":"2024-02-17T12:18:21.816493+0000","last_fullsized":"2024-02-17T12:18:21.816493+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:47.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362985+0000","last_change":"2024-02-17T12:18:20.365056+0000","last_active":"2024-02-17T12:18:21.362985+0000","last_peered":"2024-02-17T12:18:21.362985+0000","last_clean":"2024-02-17T12:18:21.362985+0000","last_became_active":"2024-02-17T12:18:20.357175+0000","last_became_peered":"2024-02-17T12:18:20.357175+0000","last_unstale":"2024-02-17T12:18:21.362985+0000","last_undegraded":"2024-02-17T12:18:21.362985+0000","last_fullsized":"2024-02-17T12:18:21.362985+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:04.839743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815092+0000","last_change":"2024-02-17T12:18:02.808706+0000","last_active":"2024-02-17T12:18:21.815092+0000","last_peered":"2024-02-17T12:18:21.815092+0000","last_clean":"2024-02-17T12:18:21.815092+0000","last_became_active":"2024-02-17T12:18:02.808520+0000","last_became_peered":"2024-02-17T12:18:02.808520+0000","last_unstale":"2024-02-17T12:18:21.815092+0000","last_undegraded":"2024-02-17T12:18:21.815092+0000","last_fullsized":"2024-02-17T12:18:21.815092+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:27.642044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816859+0000","last_change":"2024-02-17T12:18:20.371587+0000","last_active":"2024-02-17T12:18:21.816859+0000","last_peered":"2024-02-17T12:18:21.816859+0000","last_clean":"2024-02-17T12:18:21.816859+0000","last_became_active":"2024-02-17T12:18:20.370802+0000","last_became_peered":"2024-02-17T12:18:20.370802+0000","last_unstale":"2024-02-17T12:18:21.816859+0000","last_undegraded":"2024-02-17T12:18:21.816859+0000","last_fullsized":"2024-02-17T12:18:21.816859+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:01:37.202430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816303+0000","last_change":"2024-02-17T12:18:02.807196+0000","last_active":"2024-02-17T12:18:21.816303+0000","last_peered":"2024-02-17T12:18:21.816303+0000","last_clean":"2024-02-17T12:18:21.816303+0000","last_became_active":"2024-02-17T12:18:02.806894+0000","last_became_peered":"2024-02-17T12:18:02.806894+0000","last_unstale":"2024-02-17T12:18:21.816303+0000","last_undegraded":"2024-02-17T12:18:21.816303+0000","last_fullsized":"2024-02-17T12:18:21.816303+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:12.749708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.367227+0000","last_change":"2024-02-17T12:18:20.378453+0000","last_active":"2024-02-17T12:18:21.367227+0000","last_peered":"2024-02-17T12:18:21.367227+0000","last_clean":"2024-02-17T12:18:21.367227+0000","last_became_active":"2024-02-17T12:18:20.378107+0000","last_became_peered":"2024-02-17T12:18:20.378107+0000","last_unstale":"2024-02-17T12:18:21.367227+0000","last_undegraded":"2024-02-17T12:18:21.367227+0000","last_fullsized":"2024-02-17T12:18:21.367227+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:16.491254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366098+0000","last_change":"2024-02-17T12:18:02.814770+0000","last_active":"2024-02-17T12:18:21.366098+0000","last_peered":"2024-02-17T12:18:21.366098+0000","last_clean":"2024-02-17T12:18:21.366098+0000","last_became_active":"2024-02-17T12:18:02.809466+0000","last_became_peered":"2024-02-17T12:18:02.809466+0000","last_unstale":"2024-02-17T12:18:21.366098+0000","last_undegraded":"2024-02-17T12:18:21.366098+0000","last_fullsized":"2024-02-17T12:18:21.366098+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364703+0000","last_change":"2024-02-17T12:18:20.359879+0000","last_active":"2024-02-17T12:18:21.364703+0000","last_peered":"2024-02-17T12:18:21.364703+0000","last_clean":"2024-02-17T12:18:21.364703+0000","last_became_active":"2024-02-17T12:18:20.358556+0000","last_became_peered":"2024-02-17T12:18:20.358556+0000","last_unstale":"2024-02-17T12:18:21.364703+0000","last_undegraded":"2024-02-17T12:18:21.364703+0000","last_fullsized":"2024-02-17T12:18:21.364703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:16.491254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815276+0000","last_change":"2024-02-17T12:18:02.802996+0000","last_active":"2024-02-17T12:18:21.815276+0000","last_peered":"2024-02-17T12:18:21.815276+0000","last_clean":"2024-02-17T12:18:21.815276+0000","last_became_active":"2024-02-17T12:18:02.802690+0000","last_became_peered":"2024-02-17T12:18:02.802690+0000","last_unstale":"2024-02-17T12:18:21.815276+0000","last_undegraded":"2024-02-17T12:18:21.815276+0000","last_fullsized":"2024-02-17T12:18:21.815276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:59.666905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364468+0000","last_change":"2024-02-17T12:18:20.363497+0000","last_active":"2024-02-17T12:18:21.364468+0000","last_peered":"2024-02-17T12:18:21.364468+0000","last_clean":"2024-02-17T12:18:21.364468+0000","last_became_active":"2024-02-17T12:18:20.363158+0000","last_became_peered":"2024-02-17T12:18:20.363158+0000","last_unstale":"2024-02-17T12:18:21.364468+0000","last_undegraded":"2024-02-17T12:18:21.364468+0000","last_fullsized":"2024-02-17T12:18:21.364468+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:21.612457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815723+0000","last_change":"2024-02-17T12:18:02.812986+0000","last_active":"2024-02-17T12:18:21.815723+0000","last_peered":"2024-02-17T12:18:21.815723+0000","last_clean":"2024-02-17T12:18:21.815723+0000","last_became_active":"2024-02-17T12:18:02.809576+0000","last_became_peered":"2024-02-17T12:18:02.809576+0000","last_unstale":"2024-02-17T12:18:21.815723+0000","last_undegraded":"2024-02-17T12:18:21.815723+0000","last_fullsized":"2024-02-17T12:18:21.815723+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815065+0000","last_change":"2024-02-17T12:18:20.369198+0000","last_active":"2024-02-17T12:18:21.815065+0000","last_peered":"2024-02-17T12:18:21.815065+0000","last_clean":"2024-02-17T12:18:21.815065+0000","last_became_active":"2024-02-17T12:18:20.368931+0000","last_became_peered":"2024-02-17T12:18:20.368931+0000","last_unstale":"2024-02-17T12:18:21.815065+0000","last_undegraded":"2024-02-17T12:18:21.815065+0000","last_fullsized":"2024-02-17T12:18:21.815065+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:50.119462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815313+0000","last_change":"2024-02-17T12:18:02.799654+0000","last_active":"2024-02-17T12:18:21.815313+0000","last_peered":"2024-02-17T12:18:21.815313+0000","last_clean":"2024-02-17T12:18:21.815313+0000","last_became_active":"2024-02-17T12:18:02.799356+0000","last_became_peered":"2024-02-17T12:18:02.799356+0000","last_unstale":"2024-02-17T12:18:21.815313+0000","last_undegraded":"2024-02-17T12:18:21.815313+0000","last_fullsized":"2024-02-17T12:18:21.815313+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:29.710017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366521+0000","last_change":"2024-02-17T12:18:20.360162+0000","last_active":"2024-02-17T12:18:21.366521+0000","last_peered":"2024-02-17T12:18:21.366521+0000","last_clean":"2024-02-17T12:18:21.366521+0000","last_became_active":"2024-02-17T12:18:20.359330+0000","last_became_peered":"2024-02-17T12:18:20.359330+0000","last_unstale":"2024-02-17T12:18:21.366521+0000","last_undegraded":"2024-02-17T12:18:21.366521+0000","last_fullsized":"2024-02-17T12:18:21.366521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:15.630296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815852+0000","last_change":"2024-02-17T12:18:02.800189+0000","last_active":"2024-02-17T12:18:21.815852+0000","last_peered":"2024-02-17T12:18:21.815852+0000","last_clean":"2024-02-17T12:18:21.815852+0000","last_became_active":"2024-02-17T12:18:02.799866+0000","last_became_peered":"2024-02-17T12:18:02.799866+0000","last_unstale":"2024-02-17T12:18:21.815852+0000","last_undegraded":"2024-02-17T12:18:21.815852+0000","last_fullsized":"2024-02-17T12:18:21.815852+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:47:52.152034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816094+0000","last_change":"2024-02-17T12:18:20.365120+0000","last_active":"2024-02-17T12:18:21.816094+0000","last_peered":"2024-02-17T12:18:21.816094+0000","last_clean":"2024-02-17T12:18:21.816094+0000","last_became_active":"2024-02-17T12:18:20.364337+0000","last_became_peered":"2024-02-17T12:18:20.364337+0000","last_unstale":"2024-02-17T12:18:21.816094+0000","last_undegraded":"2024-02-17T12:18:21.816094+0000","last_fullsized":"2024-02-17T12:18:21.816094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:39:30.873628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817375+0000","last_change":"2024-02-17T12:18:02.794591+0000","last_active":"2024-02-17T12:18:21.817375+0000","last_peered":"2024-02-17T12:18:21.817375+0000","last_clean":"2024-02-17T12:18:21.817375+0000","last_became_active":"2024-02-17T12:18:02.794309+0000","last_became_peered":"2024-02-17T12:18:02.794309+0000","last_unstale":"2024-02-17T12:18:21.817375+0000","last_undegraded":"2024-02-17T12:18:21.817375+0000","last_fullsized":"2024-02-17T12:18:21.817375+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:18.132994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362710+0000","last_change":"2024-02-17T12:18:20.356863+0000","last_active":"2024-02-17T12:18:21.362710+0000","last_peered":"2024-02-17T12:18:21.362710+0000","last_clean":"2024-02-17T12:18:21.362710+0000","last_became_active":"2024-02-17T12:18:20.356593+0000","last_became_peered":"2024-02-17T12:18:20.356593+0000","last_unstale":"2024-02-17T12:18:21.362710+0000","last_undegraded":"2024-02-17T12:18:21.362710+0000","last_fullsized":"2024-02-17T12:18:21.362710+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:31.993635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.363208+0000","last_change":"2024-02-17T12:18:02.802586+0000","last_active":"2024-02-17T12:18:21.363208+0000","last_peered":"2024-02-17T12:18:21.363208+0000","last_clean":"2024-02-17T12:18:21.363208+0000","last_became_active":"2024-02-17T12:18:02.802328+0000","last_became_peered":"2024-02-17T12:18:02.802328+0000","last_unstale":"2024-02-17T12:18:21.363208+0000","last_undegraded":"2024-02-17T12:18:21.363208+0000","last_fullsized":"2024-02-17T12:18:21.363208+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:30.894335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814771+0000","last_change":"2024-02-17T12:18:20.370112+0000","last_active":"2024-02-17T12:18:21.814771+0000","last_peered":"2024-02-17T12:18:21.814771+0000","last_clean":"2024-02-17T12:18:21.814771+0000","last_became_active":"2024-02-17T12:18:20.369800+0000","last_became_peered":"2024-02-17T12:18:20.369800+0000","last_unstale":"2024-02-17T12:18:21.814771+0000","last_undegraded":"2024-02-17T12:18:21.814771+0000","last_fullsized":"2024-02-17T12:18:21.814771+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:01:35.157720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.363015+0000","last_change":"2024-02-17T12:18:02.803729+0000","last_active":"2024-02-17T12:18:21.363015+0000","last_peered":"2024-02-17T12:18:21.363015+0000","last_clean":"2024-02-17T12:18:21.363015+0000","last_became_active":"2024-02-17T12:18:02.803504+0000","last_became_peered":"2024-02-17T12:18:02.803504+0000","last_unstale":"2024-02-17T12:18:21.363015+0000","last_undegraded":"2024-02-17T12:18:21.363015+0000","last_fullsized":"2024-02-17T12:18:21.363015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:50.631061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817298+0000","last_change":"2024-02-17T12:18:20.369131+0000","last_active":"2024-02-17T12:18:21.817298+0000","last_peered":"2024-02-17T12:18:21.817298+0000","last_clean":"2024-02-17T12:18:21.817298+0000","last_became_active":"2024-02-17T12:18:20.368509+0000","last_became_peered":"2024-02-17T12:18:20.368509+0000","last_unstale":"2024-02-17T12:18:21.817298+0000","last_undegraded":"2024-02-17T12:18:21.817298+0000","last_fullsized":"2024-02-17T12:18:21.817298+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:28.029266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365695+0000","last_change":"2024-02-17T12:18:02.814562+0000","last_active":"2024-02-17T12:18:21.365695+0000","last_peered":"2024-02-17T12:18:21.365695+0000","last_clean":"2024-02-17T12:18:21.365695+0000","last_became_active":"2024-02-17T12:18:02.809011+0000","last_became_peered":"2024-02-17T12:18:02.809011+0000","last_unstale":"2024-02-17T12:18:21.365695+0000","last_undegraded":"2024-02-17T12:18:21.365695+0000","last_fullsized":"2024-02-17T12:18:21.365695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816251+0000","last_change":"2024-02-17T12:18:20.370553+0000","last_active":"2024-02-17T12:18:21.816251+0000","last_peered":"2024-02-17T12:18:21.816251+0000","last_clean":"2024-02-17T12:18:21.816251+0000","last_became_active":"2024-02-17T12:18:20.370250+0000","last_became_peered":"2024-02-17T12:18:20.370250+0000","last_unstale":"2024-02-17T12:18:21.816251+0000","last_undegraded":"2024-02-17T12:18:21.816251+0000","last_fullsized":"2024-02-17T12:18:21.816251+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:32:40.236695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366694+0000","last_change":"2024-02-17T12:18:02.800228+0000","last_active":"2024-02-17T12:18:21.366694+0000","last_peered":"2024-02-17T12:18:21.366694+0000","last_clean":"2024-02-17T12:18:21.366694+0000","last_became_active":"2024-02-17T12:18:02.799965+0000","last_became_peered":"2024-02-17T12:18:02.799965+0000","last_unstale":"2024-02-17T12:18:21.366694+0000","last_undegraded":"2024-02-17T12:18:21.366694+0000","last_fullsized":"2024-02-17T12:18:21.366694+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:05.435817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814975+0000","last_change":"2024-02-17T12:18:20.368217+0000","last_active":"2024-02-17T12:18:21.814975+0000","last_peered":"2024-02-17T12:18:21.814975+0000","last_clean":"2024-02-17T12:18:21.814975+0000","last_became_active":"2024-02-17T12:18:20.367911+0000","last_became_peered":"2024-02-17T12:18:20.367911+0000","last_unstale":"2024-02-17T12:18:21.814975+0000","last_undegraded":"2024-02-17T12:18:21.814975+0000","last_fullsized":"2024-02-17T12:18:21.814975+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:18.491479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815966+0000","last_change":"2024-02-17T12:18:02.798437+0000","last_active":"2024-02-17T12:18:21.815966+0000","last_peered":"2024-02-17T12:18:21.815966+0000","last_clean":"2024-02-17T12:18:21.815966+0000","last_became_active":"2024-02-17T12:18:02.798145+0000","last_became_peered":"2024-02-17T12:18:02.798145+0000","last_unstale":"2024-02-17T12:18:21.815966+0000","last_undegraded":"2024-02-17T12:18:21.815966+0000","last_fullsized":"2024-02-17T12:18:21.815966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:29.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815978+0000","last_change":"2024-02-17T12:18:20.366271+0000","last_active":"2024-02-17T12:18:21.815978+0000","last_peered":"2024-02-17T12:18:21.815978+0000","last_clean":"2024-02-17T12:18:21.815978+0000","last_became_active":"2024-02-17T12:18:20.365944+0000","last_became_peered":"2024-02-17T12:18:20.365944+0000","last_unstale":"2024-02-17T12:18:21.815978+0000","last_undegraded":"2024-02-17T12:18:21.815978+0000","last_fullsized":"2024-02-17T12:18:21.815978+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:52:51.435036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815431+0000","last_change":"2024-02-17T12:18:02.797013+0000","last_active":"2024-02-17T12:18:21.815431+0000","last_peered":"2024-02-17T12:18:21.815431+0000","last_clean":"2024-02-17T12:18:21.815431+0000","last_became_active":"2024-02-17T12:18:02.796734+0000","last_became_peered":"2024-02-17T12:18:02.796734+0000","last_unstale":"2024-02-17T12:18:21.815431+0000","last_undegraded":"2024-02-17T12:18:21.815431+0000","last_fullsized":"2024-02-17T12:18:21.815431+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:32.566741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815206+0000","last_change":"2024-02-17T12:18:20.374124+0000","last_active":"2024-02-17T12:18:21.815206+0000","last_peered":"2024-02-17T12:18:21.815206+0000","last_clean":"2024-02-17T12:18:21.815206+0000","last_became_active":"2024-02-17T12:18:20.373863+0000","last_became_peered":"2024-02-17T12:18:20.373863+0000","last_unstale":"2024-02-17T12:18:21.815206+0000","last_undegraded":"2024-02-17T12:18:21.815206+0000","last_fullsized":"2024-02-17T12:18:21.815206+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:33.055118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814295+0000","last_change":"2024-02-17T12:18:02.809976+0000","last_active":"2024-02-17T12:18:21.814295+0000","last_peered":"2024-02-17T12:18:21.814295+0000","last_clean":"2024-02-17T12:18:21.814295+0000","last_became_active":"2024-02-17T12:18:02.809645+0000","last_became_peered":"2024-02-17T12:18:02.809645+0000","last_unstale":"2024-02-17T12:18:21.814295+0000","last_undegraded":"2024-02-17T12:18:21.814295+0000","last_fullsized":"2024-02-17T12:18:21.814295+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:12.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365918+0000","last_change":"2024-02-17T12:18:20.365791+0000","last_active":"2024-02-17T12:18:21.365918+0000","last_peered":"2024-02-17T12:18:21.365918+0000","last_clean":"2024-02-17T12:18:21.365918+0000","last_became_active":"2024-02-17T12:18:20.361691+0000","last_became_peered":"2024-02-17T12:18:20.361691+0000","last_unstale":"2024-02-17T12:18:21.365918+0000","last_undegraded":"2024-02-17T12:18:21.365918+0000","last_fullsized":"2024-02-17T12:18:21.365918+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:52.657290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816654+0000","last_change":"2024-02-17T12:18:02.807700+0000","last_active":"2024-02-17T12:18:21.816654+0000","last_peered":"2024-02-17T12:18:21.816654+0000","last_clean":"2024-02-17T12:18:21.816654+0000","last_became_active":"2024-02-17T12:18:02.805575+0000","last_became_peered":"2024-02-17T12:18:02.805575+0000","last_unstale":"2024-02-17T12:18:21.816654+0000","last_undegraded":"2024-02-17T12:18:21.816654+0000","last_fullsized":"2024-02-17T12:18:21.816654+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:52:33.882315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815605+0000","last_change":"2024-02-17T12:18:20.359235+0000","last_active":"2024-02-17T12:18:21.815605+0000","last_peered":"2024-02-17T12:18:21.815605+0000","last_clean":"2024-02-17T12:18:21.815605+0000","last_became_active":"2024-02-17T12:18:20.358956+0000","last_became_peered":"2024-02-17T12:18:20.358956+0000","last_unstale":"2024-02-17T12:18:21.815605+0000","last_undegraded":"2024-02-17T12:18:21.815605+0000","last_fullsized":"2024-02-17T12:18:21.815605+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:35:42.280293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816714+0000","last_change":"2024-02-17T12:18:02.809074+0000","last_active":"2024-02-17T12:18:21.816714+0000","last_peered":"2024-02-17T12:18:21.816714+0000","last_clean":"2024-02-17T12:18:21.816714+0000","last_became_active":"2024-02-17T12:18:02.808683+0000","last_became_peered":"2024-02-17T12:18:02.808683+0000","last_unstale":"2024-02-17T12:18:21.816714+0000","last_undegraded":"2024-02-17T12:18:21.816714+0000","last_fullsized":"2024-02-17T12:18:21.816714+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:46:21.120434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814912+0000","last_change":"2024-02-17T12:18:20.369738+0000","last_active":"2024-02-17T12:18:21.814912+0000","last_peered":"2024-02-17T12:18:21.814912+0000","last_clean":"2024-02-17T12:18:21.814912+0000","last_became_active":"2024-02-17T12:18:20.369340+0000","last_became_peered":"2024-02-17T12:18:20.369340+0000","last_unstale":"2024-02-17T12:18:21.814912+0000","last_undegraded":"2024-02-17T12:18:21.814912+0000","last_fullsized":"2024-02-17T12:18:21.814912+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:43:47.262738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816168+0000","last_change":"2024-02-17T12:18:02.803587+0000","last_active":"2024-02-17T12:18:21.816168+0000","last_peered":"2024-02-17T12:18:21.816168+0000","last_clean":"2024-02-17T12:18:21.816168+0000","last_became_active":"2024-02-17T12:18:02.803312+0000","last_became_peered":"2024-02-17T12:18:02.803312+0000","last_unstale":"2024-02-17T12:18:21.816168+0000","last_undegraded":"2024-02-17T12:18:21.816168+0000","last_fullsized":"2024-02-17T12:18:21.816168+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:54:01.696616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.363161+0000","last_change":"2024-02-17T12:18:20.351424+0000","last_active":"2024-02-17T12:18:21.363161+0000","last_peered":"2024-02-17T12:18:21.363161+0000","last_clean":"2024-02-17T12:18:21.363161+0000","last_became_active":"2024-02-17T12:18:20.351189+0000","last_became_peered":"2024-02-17T12:18:20.351189+0000","last_unstale":"2024-02-17T12:18:21.363161+0000","last_undegraded":"2024-02-17T12:18:21.363161+0000","last_fullsized":"2024-02-17T12:18:21.363161+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:14.800941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814821+0000","last_change":"2024-02-17T12:18:02.815782+0000","last_active":"2024-02-17T12:18:21.814821+0000","last_peered":"2024-02-17T12:18:21.814821+0000","last_clean":"2024-02-17T12:18:21.814821+0000","last_became_active":"2024-02-17T12:18:02.815537+0000","last_became_peered":"2024-02-17T12:18:02.815537+0000","last_unstale":"2024-02-17T12:18:21.814821+0000","last_undegraded":"2024-02-17T12:18:21.814821+0000","last_fullsized":"2024-02-17T12:18:21.814821+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:23.114440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815087+0000","last_change":"2024-02-17T12:18:20.372620+0000","last_active":"2024-02-17T12:18:21.815087+0000","last_peered":"2024-02-17T12:18:21.815087+0000","last_clean":"2024-02-17T12:18:21.815087+0000","last_became_active":"2024-02-17T12:18:20.372346+0000","last_became_peered":"2024-02-17T12:18:20.372346+0000","last_unstale":"2024-02-17T12:18:21.815087+0000","last_undegraded":"2024-02-17T12:18:21.815087+0000","last_fullsized":"2024-02-17T12:18:21.815087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:09.553478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815612+0000","last_change":"2024-02-17T12:18:02.809894+0000","last_active":"2024-02-17T12:18:21.815612+0000","last_peered":"2024-02-17T12:18:21.815612+0000","last_clean":"2024-02-17T12:18:21.815612+0000","last_became_active":"2024-02-17T12:18:02.807451+0000","last_became_peered":"2024-02-17T12:18:02.807451+0000","last_unstale":"2024-02-17T12:18:21.815612+0000","last_undegraded":"2024-02-17T12:18:21.815612+0000","last_fullsized":"2024-02-17T12:18:21.815612+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:05:50.249065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814867+0000","last_change":"2024-02-17T12:18:20.377354+0000","last_active":"2024-02-17T12:18:21.814867+0000","last_peered":"2024-02-17T12:18:21.814867+0000","last_clean":"2024-02-17T12:18:21.814867+0000","last_became_active":"2024-02-17T12:18:20.376892+0000","last_became_peered":"2024-02-17T12:18:20.376892+0000","last_unstale":"2024-02-17T12:18:21.814867+0000","last_undegraded":"2024-02-17T12:18:21.814867+0000","last_fullsized":"2024-02-17T12:18:21.814867+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:21:19.983883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815174+0000","last_change":"2024-02-17T12:18:02.813079+0000","last_active":"2024-02-17T12:18:21.815174+0000","last_peered":"2024-02-17T12:18:21.815174+0000","last_clean":"2024-02-17T12:18:21.815174+0000","last_became_active":"2024-02-17T12:18:02.810630+0000","last_became_peered":"2024-02-17T12:18:02.810630+0000","last_unstale":"2024-02-17T12:18:21.815174+0000","last_undegraded":"2024-02-17T12:18:21.815174+0000","last_fullsized":"2024-02-17T12:18:21.815174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:32:22.683974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816477+0000","last_change":"2024-02-17T12:18:20.363343+0000","last_active":"2024-02-17T12:18:21.816477+0000","last_peered":"2024-02-17T12:18:21.816477+0000","last_clean":"2024-02-17T12:18:21.816477+0000","last_became_active":"2024-02-17T12:18:20.362636+0000","last_became_peered":"2024-02-17T12:18:20.362636+0000","last_unstale":"2024-02-17T12:18:21.816477+0000","last_undegraded":"2024-02-17T12:18:21.816477+0000","last_fullsized":"2024-02-17T12:18:21.816477+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:24:56.995368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815109+0000","last_change":"2024-02-17T12:18:02.807916+0000","last_active":"2024-02-17T12:18:21.815109+0000","last_peered":"2024-02-17T12:18:21.815109+0000","last_clean":"2024-02-17T12:18:21.815109+0000","last_became_active":"2024-02-17T12:18:02.806754+0000","last_became_peered":"2024-02-17T12:18:02.806754+0000","last_unstale":"2024-02-17T12:18:21.815109+0000","last_undegraded":"2024-02-17T12:18:21.815109+0000","last_fullsized":"2024-02-17T12:18:21.815109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.985986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816055+0000","last_change":"2024-02-17T12:18:20.364201+0000","last_active":"2024-02-17T12:18:21.816055+0000","last_peered":"2024-02-17T12:18:21.816055+0000","last_clean":"2024-02-17T12:18:21.816055+0000","last_became_active":"2024-02-17T12:18:20.362371+0000","last_became_peered":"2024-02-17T12:18:20.362371+0000","last_unstale":"2024-02-17T12:18:21.816055+0000","last_undegraded":"2024-02-17T12:18:21.816055+0000","last_fullsized":"2024-02-17T12:18:21.816055+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:26.198114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364703+0000","last_change":"2024-02-17T12:18:02.805691+0000","last_active":"2024-02-17T12:18:21.364703+0000","last_peered":"2024-02-17T12:18:21.364703+0000","last_clean":"2024-02-17T12:18:21.364703+0000","last_became_active":"2024-02-17T12:18:02.805396+0000","last_became_peered":"2024-02-17T12:18:02.805396+0000","last_unstale":"2024-02-17T12:18:21.364703+0000","last_undegraded":"2024-02-17T12:18:21.364703+0000","last_fullsized":"2024-02-17T12:18:21.364703+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:09:34.480729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815233+0000","last_change":"2024-02-17T12:18:20.365285+0000","last_active":"2024-02-17T12:18:21.815233+0000","last_peered":"2024-02-17T12:18:21.815233+0000","last_clean":"2024-02-17T12:18:21.815233+0000","last_became_active":"2024-02-17T12:18:20.364962+0000","last_became_peered":"2024-02-17T12:18:20.364962+0000","last_unstale":"2024-02-17T12:18:21.815233+0000","last_undegraded":"2024-02-17T12:18:21.815233+0000","last_fullsized":"2024-02-17T12:18:21.815233+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:54:46.394637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816740+0000","last_change":"2024-02-17T12:18:02.798267+0000","last_active":"2024-02-17T12:18:21.816740+0000","last_peered":"2024-02-17T12:18:21.816740+0000","last_clean":"2024-02-17T12:18:21.816740+0000","last_became_active":"2024-02-17T12:18:02.797624+0000","last_became_peered":"2024-02-17T12:18:02.797624+0000","last_unstale":"2024-02-17T12:18:21.816740+0000","last_undegraded":"2024-02-17T12:18:21.816740+0000","last_fullsized":"2024-02-17T12:18:21.816740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:17:06.691178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816401+0000","last_change":"2024-02-17T12:18:20.375077+0000","last_active":"2024-02-17T12:18:21.816401+0000","last_peered":"2024-02-17T12:18:21.816401+0000","last_clean":"2024-02-17T12:18:21.816401+0000","last_became_active":"2024-02-17T12:18:20.374769+0000","last_became_peered":"2024-02-17T12:18:20.374769+0000","last_unstale":"2024-02-17T12:18:21.816401+0000","last_undegraded":"2024-02-17T12:18:21.816401+0000","last_fullsized":"2024-02-17T12:18:21.816401+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:01:46.432009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366056+0000","last_change":"2024-02-17T12:18:02.802532+0000","last_active":"2024-02-17T12:18:21.366056+0000","last_peered":"2024-02-17T12:18:21.366056+0000","last_clean":"2024-02-17T12:18:21.366056+0000","last_became_active":"2024-02-17T12:18:02.801766+0000","last_became_peered":"2024-02-17T12:18:02.801766+0000","last_unstale":"2024-02-17T12:18:21.366056+0000","last_undegraded":"2024-02-17T12:18:21.366056+0000","last_fullsized":"2024-02-17T12:18:21.366056+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817379+0000","last_change":"2024-02-17T12:18:20.364156+0000","last_active":"2024-02-17T12:18:21.817379+0000","last_peered":"2024-02-17T12:18:21.817379+0000","last_clean":"2024-02-17T12:18:21.817379+0000","last_became_active":"2024-02-17T12:18:20.363892+0000","last_became_peered":"2024-02-17T12:18:20.363892+0000","last_unstale":"2024-02-17T12:18:21.817379+0000","last_undegraded":"2024-02-17T12:18:21.817379+0000","last_fullsized":"2024-02-17T12:18:21.817379+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:03:14.299647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816957+0000","last_change":"2024-02-17T12:18:02.797999+0000","last_active":"2024-02-17T12:18:21.816957+0000","last_peered":"2024-02-17T12:18:21.816957+0000","last_clean":"2024-02-17T12:18:21.816957+0000","last_became_active":"2024-02-17T12:18:02.797710+0000","last_became_peered":"2024-02-17T12:18:02.797710+0000","last_unstale":"2024-02-17T12:18:21.816957+0000","last_undegraded":"2024-02-17T12:18:21.816957+0000","last_fullsized":"2024-02-17T12:18:21.816957+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365790+0000","last_change":"2024-02-17T12:18:20.377760+0000","last_active":"2024-02-17T12:18:21.365790+0000","last_peered":"2024-02-17T12:18:21.365790+0000","last_clean":"2024-02-17T12:18:21.365790+0000","last_became_active":"2024-02-17T12:18:20.377471+0000","last_became_peered":"2024-02-17T12:18:20.377471+0000","last_unstale":"2024-02-17T12:18:21.365790+0000","last_undegraded":"2024-02-17T12:18:21.365790+0000","last_fullsized":"2024-02-17T12:18:21.365790+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:32:40.236695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816345+0000","last_change":"2024-02-17T12:18:02.804711+0000","last_active":"2024-02-17T12:18:21.816345+0000","last_peered":"2024-02-17T12:18:21.816345+0000","last_clean":"2024-02-17T12:18:21.816345+0000","last_became_active":"2024-02-17T12:18:02.804459+0000","last_became_peered":"2024-02-17T12:18:02.804459+0000","last_unstale":"2024-02-17T12:18:21.816345+0000","last_undegraded":"2024-02-17T12:18:21.816345+0000","last_fullsized":"2024-02-17T12:18:21.816345+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:25:47.628631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364761+0000","last_change":"2024-02-17T12:18:20.361915+0000","last_active":"2024-02-17T12:18:21.364761+0000","last_peered":"2024-02-17T12:18:21.364761+0000","last_clean":"2024-02-17T12:18:21.364761+0000","last_became_active":"2024-02-17T12:18:20.361574+0000","last_became_peered":"2024-02-17T12:18:20.361574+0000","last_unstale":"2024-02-17T12:18:21.364761+0000","last_undegraded":"2024-02-17T12:18:21.364761+0000","last_fullsized":"2024-02-17T12:18:21.364761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:40.667161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815796+0000","last_change":"2024-02-17T12:18:02.802524+0000","last_active":"2024-02-17T12:18:21.815796+0000","last_peered":"2024-02-17T12:18:21.815796+0000","last_clean":"2024-02-17T12:18:21.815796+0000","last_became_active":"2024-02-17T12:18:02.802045+0000","last_became_peered":"2024-02-17T12:18:02.802045+0000","last_unstale":"2024-02-17T12:18:21.815796+0000","last_undegraded":"2024-02-17T12:18:21.815796+0000","last_fullsized":"2024-02-17T12:18:21.815796+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:06:03.414827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364854+0000","last_change":"2024-02-17T12:18:20.365044+0000","last_active":"2024-02-17T12:18:21.364854+0000","last_peered":"2024-02-17T12:18:21.364854+0000","last_clean":"2024-02-17T12:18:21.364854+0000","last_became_active":"2024-02-17T12:18:20.361765+0000","last_became_peered":"2024-02-17T12:18:20.361765+0000","last_unstale":"2024-02-17T12:18:21.364854+0000","last_undegraded":"2024-02-17T12:18:21.364854+0000","last_fullsized":"2024-02-17T12:18:21.364854+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:16:15.471423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815164+0000","last_change":"2024-02-17T12:18:02.807169+0000","last_active":"2024-02-17T12:18:21.815164+0000","last_peered":"2024-02-17T12:18:21.815164+0000","last_clean":"2024-02-17T12:18:21.815164+0000","last_became_active":"2024-02-17T12:18:02.806918+0000","last_became_peered":"2024-02-17T12:18:02.806918+0000","last_unstale":"2024-02-17T12:18:21.815164+0000","last_undegraded":"2024-02-17T12:18:21.815164+0000","last_fullsized":"2024-02-17T12:18:21.815164+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:17.948784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815830+0000","last_change":"2024-02-17T12:18:20.360716+0000","last_active":"2024-02-17T12:18:21.815830+0000","last_peered":"2024-02-17T12:18:21.815830+0000","last_clean":"2024-02-17T12:18:21.815830+0000","last_became_active":"2024-02-17T12:18:20.360436+0000","last_became_peered":"2024-02-17T12:18:20.360436+0000","last_unstale":"2024-02-17T12:18:21.815830+0000","last_undegraded":"2024-02-17T12:18:21.815830+0000","last_fullsized":"2024-02-17T12:18:21.815830+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:09.352701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814709+0000","last_change":"2024-02-17T12:18:02.795014+0000","last_active":"2024-02-17T12:18:21.814709+0000","last_peered":"2024-02-17T12:18:21.814709+0000","last_clean":"2024-02-17T12:18:21.814709+0000","last_became_active":"2024-02-17T12:18:02.794759+0000","last_became_peered":"2024-02-17T12:18:02.794759+0000","last_unstale":"2024-02-17T12:18:21.814709+0000","last_undegraded":"2024-02-17T12:18:21.814709+0000","last_fullsized":"2024-02-17T12:18:21.814709+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:21.971723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364962+0000","last_change":"2024-02-17T12:18:20.377675+0000","last_active":"2024-02-17T12:18:21.364962+0000","last_peered":"2024-02-17T12:18:21.364962+0000","last_clean":"2024-02-17T12:18:21.364962+0000","last_became_active":"2024-02-17T12:18:20.377376+0000","last_became_peered":"2024-02-17T12:18:20.377376+0000","last_unstale":"2024-02-17T12:18:21.364962+0000","last_undegraded":"2024-02-17T12:18:21.364962+0000","last_fullsized":"2024-02-17T12:18:21.364962+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:06:20.967548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814396+0000","last_change":"2024-02-17T12:18:02.801322+0000","last_active":"2024-02-17T12:18:21.814396+0000","last_peered":"2024-02-17T12:18:21.814396+0000","last_clean":"2024-02-17T12:18:21.814396+0000","last_became_active":"2024-02-17T12:18:02.801073+0000","last_became_peered":"2024-02-17T12:18:02.801073+0000","last_unstale":"2024-02-17T12:18:21.814396+0000","last_undegraded":"2024-02-17T12:18:21.814396+0000","last_fullsized":"2024-02-17T12:18:21.814396+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366429+0000","last_change":"2024-02-17T12:18:20.357557+0000","last_active":"2024-02-17T12:18:21.366429+0000","last_peered":"2024-02-17T12:18:21.366429+0000","last_clean":"2024-02-17T12:18:21.366429+0000","last_became_active":"2024-02-17T12:18:20.357289+0000","last_became_peered":"2024-02-17T12:18:20.357289+0000","last_unstale":"2024-02-17T12:18:21.366429+0000","last_undegraded":"2024-02-17T12:18:21.366429+0000","last_fullsized":"2024-02-17T12:18:21.366429+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:09.704754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816555+0000","last_change":"2024-02-17T12:18:19.346026+0000","last_active":"2024-02-17T12:18:21.816555+0000","last_peered":"2024-02-17T12:18:21.816555+0000","last_clean":"2024-02-17T12:18:21.816555+0000","last_became_active":"2024-02-17T12:18:19.345752+0000","last_became_peered":"2024-02-17T12:18:19.345752+0000","last_unstale":"2024-02-17T12:18:21.816555+0000","last_undegraded":"2024-02-17T12:18:21.816555+0000","last_fullsized":"2024-02-17T12:18:21.816555+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:26.587389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817304+0000","last_change":"2024-02-17T12:18:02.811882+0000","last_active":"2024-02-17T12:18:21.817304+0000","last_peered":"2024-02-17T12:18:21.817304+0000","last_clean":"2024-02-17T12:18:21.817304+0000","last_became_active":"2024-02-17T12:18:02.811448+0000","last_became_peered":"2024-02-17T12:18:02.811448+0000","last_unstale":"2024-02-17T12:18:21.817304+0000","last_undegraded":"2024-02-17T12:18:21.817304+0000","last_fullsized":"2024-02-17T12:18:21.817304+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:46.432214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":26,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817523+0000","last_change":"2024-02-17T12:18:01.796858+0000","last_active":"2024-02-17T12:18:21.817523+0000","last_peered":"2024-02-17T12:18:21.817523+0000","last_clean":"2024-02-17T12:18:21.817523+0000","last_became_active":"2024-02-17T12:18:01.796498+0000","last_became_peered":"2024-02-17T12:18:01.796498+0000","last_unstale":"2024-02-17T12:18:21.817523+0000","last_undegraded":"2024-02-17T12:18:21.817523+0000","last_fullsized":"2024-02-17T12:18:21.817523+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816201+0000","last_change":"2024-02-17T12:18:20.361465+0000","last_active":"2024-02-17T12:18:21.816201+0000","last_peered":"2024-02-17T12:18:21.816201+0000","last_clean":"2024-02-17T12:18:21.816201+0000","last_became_active":"2024-02-17T12:18:20.361150+0000","last_became_peered":"2024-02-17T12:18:20.361150+0000","last_unstale":"2024-02-17T12:18:21.816201+0000","last_undegraded":"2024-02-17T12:18:21.816201+0000","last_fullsized":"2024-02-17T12:18:21.816201+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:10.749526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366669+0000","last_change":"2024-02-17T12:18:19.351335+0000","last_active":"2024-02-17T12:18:21.366669+0000","last_peered":"2024-02-17T12:18:21.366669+0000","last_clean":"2024-02-17T12:18:21.366669+0000","last_became_active":"2024-02-17T12:18:19.350932+0000","last_became_peered":"2024-02-17T12:18:19.350932+0000","last_unstale":"2024-02-17T12:18:21.366669+0000","last_undegraded":"2024-02-17T12:18:21.366669+0000","last_fullsized":"2024-02-17T12:18:21.366669+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:30.987310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364154+0000","last_change":"2024-02-17T12:18:02.808663+0000","last_active":"2024-02-17T12:18:21.364154+0000","last_peered":"2024-02-17T12:18:21.364154+0000","last_clean":"2024-02-17T12:18:21.364154+0000","last_became_active":"2024-02-17T12:18:02.808402+0000","last_became_peered":"2024-02-17T12:18:02.808402+0000","last_unstale":"2024-02-17T12:18:21.364154+0000","last_undegraded":"2024-02-17T12:18:21.364154+0000","last_fullsized":"2024-02-17T12:18:21.364154+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:00.777830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":23,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816916+0000","last_change":"2024-02-17T12:18:01.790619+0000","last_active":"2024-02-17T12:18:21.816916+0000","last_peered":"2024-02-17T12:18:21.816916+0000","last_clean":"2024-02-17T12:18:21.816916+0000","last_became_active":"2024-02-17T12:18:01.790344+0000","last_became_peered":"2024-02-17T12:18:01.790344+0000","last_unstale":"2024-02-17T12:18:21.816916+0000","last_undegraded":"2024-02-17T12:18:21.816916+0000","last_fullsized":"2024-02-17T12:18:21.816916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:13:45.425754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816974+0000","last_change":"2024-02-17T12:18:20.367137+0000","last_active":"2024-02-17T12:18:21.816974+0000","last_peered":"2024-02-17T12:18:21.816974+0000","last_clean":"2024-02-17T12:18:21.816974+0000","last_became_active":"2024-02-17T12:18:20.366853+0000","last_became_peered":"2024-02-17T12:18:20.366853+0000","last_unstale":"2024-02-17T12:18:21.816974+0000","last_undegraded":"2024-02-17T12:18:21.816974+0000","last_fullsized":"2024-02-17T12:18:21.816974+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:36:39.750086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816903+0000","last_change":"2024-02-17T12:18:19.356247+0000","last_active":"2024-02-17T12:18:21.816903+0000","last_peered":"2024-02-17T12:18:21.816903+0000","last_clean":"2024-02-17T12:18:21.816903+0000","last_became_active":"2024-02-17T12:18:19.355973+0000","last_became_peered":"2024-02-17T12:18:19.355973+0000","last_unstale":"2024-02-17T12:18:21.816903+0000","last_undegraded":"2024-02-17T12:18:21.816903+0000","last_fullsized":"2024-02-17T12:18:21.816903+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:59:27.022941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816884+0000","last_change":"2024-02-17T12:18:02.804685+0000","last_active":"2024-02-17T12:18:21.816884+0000","last_peered":"2024-02-17T12:18:21.816884+0000","last_clean":"2024-02-17T12:18:21.816884+0000","last_became_active":"2024-02-17T12:18:02.803980+0000","last_became_peered":"2024-02-17T12:18:02.803980+0000","last_unstale":"2024-02-17T12:18:21.816884+0000","last_undegraded":"2024-02-17T12:18:21.816884+0000","last_fullsized":"2024-02-17T12:18:21.816884+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:32.327387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":24,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817165+0000","last_change":"2024-02-17T12:18:01.801344+0000","last_active":"2024-02-17T12:18:21.817165+0000","last_peered":"2024-02-17T12:18:21.817165+0000","last_clean":"2024-02-17T12:18:21.817165+0000","last_became_active":"2024-02-17T12:18:01.801092+0000","last_became_peered":"2024-02-17T12:18:01.801092+0000","last_unstale":"2024-02-17T12:18:21.817165+0000","last_undegraded":"2024-02-17T12:18:21.817165+0000","last_fullsized":"2024-02-17T12:18:21.817165+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816684+0000","last_change":"2024-02-17T12:18:20.368949+0000","last_active":"2024-02-17T12:18:21.816684+0000","last_peered":"2024-02-17T12:18:21.816684+0000","last_clean":"2024-02-17T12:18:21.816684+0000","last_became_active":"2024-02-17T12:18:20.368689+0000","last_became_peered":"2024-02-17T12:18:20.368689+0000","last_unstale":"2024-02-17T12:18:21.816684+0000","last_undegraded":"2024-02-17T12:18:21.816684+0000","last_fullsized":"2024-02-17T12:18:21.816684+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:52.111538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817182+0000","last_change":"2024-02-17T12:18:19.348869+0000","last_active":"2024-02-17T12:18:21.817182+0000","last_peered":"2024-02-17T12:18:21.817182+0000","last_clean":"2024-02-17T12:18:21.817182+0000","last_became_active":"2024-02-17T12:18:19.347760+0000","last_became_peered":"2024-02-17T12:18:19.347760+0000","last_unstale":"2024-02-17T12:18:21.817182+0000","last_undegraded":"2024-02-17T12:18:21.817182+0000","last_fullsized":"2024-02-17T12:18:21.817182+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:16:14.465098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817055+0000","last_change":"2024-02-17T12:18:02.806603+0000","last_active":"2024-02-17T12:18:21.817055+0000","last_peered":"2024-02-17T12:18:21.817055+0000","last_clean":"2024-02-17T12:18:21.817055+0000","last_became_active":"2024-02-17T12:18:02.806021+0000","last_became_peered":"2024-02-17T12:18:02.806021+0000","last_unstale":"2024-02-17T12:18:21.817055+0000","last_undegraded":"2024-02-17T12:18:21.817055+0000","last_fullsized":"2024-02-17T12:18:21.817055+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:57.248220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":24,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365806+0000","last_change":"2024-02-17T12:18:01.790249+0000","last_active":"2024-02-17T12:18:21.365806+0000","last_peered":"2024-02-17T12:18:21.365806+0000","last_clean":"2024-02-17T12:18:21.365806+0000","last_became_active":"2024-02-17T12:18:01.789970+0000","last_became_peered":"2024-02-17T12:18:01.789970+0000","last_unstale":"2024-02-17T12:18:21.365806+0000","last_undegraded":"2024-02-17T12:18:21.365806+0000","last_fullsized":"2024-02-17T12:18:21.365806+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:34:48.938442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814692+0000","last_change":"2024-02-17T12:18:20.374117+0000","last_active":"2024-02-17T12:18:21.814692+0000","last_peered":"2024-02-17T12:18:21.814692+0000","last_clean":"2024-02-17T12:18:21.814692+0000","last_became_active":"2024-02-17T12:18:20.373680+0000","last_became_peered":"2024-02-17T12:18:20.373680+0000","last_unstale":"2024-02-17T12:18:21.814692+0000","last_undegraded":"2024-02-17T12:18:21.814692+0000","last_fullsized":"2024-02-17T12:18:21.814692+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:29.917226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362178+0000","last_change":"2024-02-17T12:18:19.353267+0000","last_active":"2024-02-17T12:18:21.362178+0000","last_peered":"2024-02-17T12:18:21.362178+0000","last_clean":"2024-02-17T12:18:21.362178+0000","last_became_active":"2024-02-17T12:18:19.353007+0000","last_became_peered":"2024-02-17T12:18:19.353007+0000","last_unstale":"2024-02-17T12:18:21.362178+0000","last_undegraded":"2024-02-17T12:18:21.362178+0000","last_fullsized":"2024-02-17T12:18:21.362178+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:53:41.288869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815260+0000","last_change":"2024-02-17T12:18:02.811065+0000","last_active":"2024-02-17T12:18:21.815260+0000","last_peered":"2024-02-17T12:18:21.815260+0000","last_clean":"2024-02-17T12:18:21.815260+0000","last_became_active":"2024-02-17T12:18:02.810598+0000","last_became_peered":"2024-02-17T12:18:02.810598+0000","last_unstale":"2024-02-17T12:18:21.815260+0000","last_undegraded":"2024-02-17T12:18:21.815260+0000","last_fullsized":"2024-02-17T12:18:21.815260+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:11:46.553742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":23,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816473+0000","last_change":"2024-02-17T12:18:01.798801+0000","last_active":"2024-02-17T12:18:21.816473+0000","last_peered":"2024-02-17T12:18:21.816473+0000","last_clean":"2024-02-17T12:18:21.816473+0000","last_became_active":"2024-02-17T12:18:01.798516+0000","last_became_peered":"2024-02-17T12:18:01.798516+0000","last_unstale":"2024-02-17T12:18:21.816473+0000","last_undegraded":"2024-02-17T12:18:21.816473+0000","last_fullsized":"2024-02-17T12:18:21.816473+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:04:53.798642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814875+0000","last_change":"2024-02-17T12:18:20.366859+0000","last_active":"2024-02-17T12:18:21.814875+0000","last_peered":"2024-02-17T12:18:21.814875+0000","last_clean":"2024-02-17T12:18:21.814875+0000","last_became_active":"2024-02-17T12:18:20.366587+0000","last_became_peered":"2024-02-17T12:18:20.366587+0000","last_unstale":"2024-02-17T12:18:21.814875+0000","last_undegraded":"2024-02-17T12:18:21.814875+0000","last_fullsized":"2024-02-17T12:18:21.814875+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:06:20.967548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814610+0000","last_change":"2024-02-17T12:18:19.351059+0000","last_active":"2024-02-17T12:18:21.814610+0000","last_peered":"2024-02-17T12:18:21.814610+0000","last_clean":"2024-02-17T12:18:21.814610+0000","last_became_active":"2024-02-17T12:18:19.350824+0000","last_became_peered":"2024-02-17T12:18:19.350824+0000","last_unstale":"2024-02-17T12:18:21.814610+0000","last_undegraded":"2024-02-17T12:18:21.814610+0000","last_fullsized":"2024-02-17T12:18:21.814610+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:17:14.886486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814862+0000","last_change":"2024-02-17T12:18:02.802301+0000","last_active":"2024-02-17T12:18:21.814862+0000","last_peered":"2024-02-17T12:18:21.814862+0000","last_clean":"2024-02-17T12:18:21.814862+0000","last_became_active":"2024-02-17T12:18:02.801632+0000","last_became_peered":"2024-02-17T12:18:02.801632+0000","last_unstale":"2024-02-17T12:18:21.814862+0000","last_undegraded":"2024-02-17T12:18:21.814862+0000","last_fullsized":"2024-02-17T12:18:21.814862+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:34:13.159578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":23,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815813+0000","last_change":"2024-02-17T12:18:01.800510+0000","last_active":"2024-02-17T12:18:21.815813+0000","last_peered":"2024-02-17T12:18:21.815813+0000","last_clean":"2024-02-17T12:18:21.815813+0000","last_became_active":"2024-02-17T12:18:01.799483+0000","last_became_peered":"2024-02-17T12:18:01.799483+0000","last_unstale":"2024-02-17T12:18:21.815813+0000","last_undegraded":"2024-02-17T12:18:21.815813+0000","last_fullsized":"2024-02-17T12:18:21.815813+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365124+0000","last_change":"2024-02-17T12:18:20.359431+0000","last_active":"2024-02-17T12:18:21.365124+0000","last_peered":"2024-02-17T12:18:21.365124+0000","last_clean":"2024-02-17T12:18:21.365124+0000","last_became_active":"2024-02-17T12:18:20.358183+0000","last_became_peered":"2024-02-17T12:18:20.358183+0000","last_unstale":"2024-02-17T12:18:21.365124+0000","last_undegraded":"2024-02-17T12:18:21.365124+0000","last_fullsized":"2024-02-17T12:18:21.365124+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:35:42.280293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814687+0000","last_change":"2024-02-17T12:18:19.351098+0000","last_active":"2024-02-17T12:18:21.814687+0000","last_peered":"2024-02-17T12:18:21.814687+0000","last_clean":"2024-02-17T12:18:21.814687+0000","last_became_active":"2024-02-17T12:18:19.350809+0000","last_became_peered":"2024-02-17T12:18:19.350809+0000","last_unstale":"2024-02-17T12:18:21.814687+0000","last_undegraded":"2024-02-17T12:18:21.814687+0000","last_fullsized":"2024-02-17T12:18:21.814687+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:35:32.754645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364946+0000","last_change":"2024-02-17T12:18:02.811246+0000","last_active":"2024-02-17T12:18:21.364946+0000","last_peered":"2024-02-17T12:18:21.364946+0000","last_clean":"2024-02-17T12:18:21.364946+0000","last_became_active":"2024-02-17T12:18:02.810989+0000","last_became_peered":"2024-02-17T12:18:02.810989+0000","last_unstale":"2024-02-17T12:18:21.364946+0000","last_undegraded":"2024-02-17T12:18:21.364946+0000","last_fullsized":"2024-02-17T12:18:21.364946+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:56:31.198120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365016+0000","last_change":"2024-02-17T12:18:01.798316+0000","last_active":"2024-02-17T12:18:21.365016+0000","last_peered":"2024-02-17T12:18:21.365016+0000","last_clean":"2024-02-17T12:18:21.365016+0000","last_became_active":"2024-02-17T12:18:01.797041+0000","last_became_peered":"2024-02-17T12:18:01.797041+0000","last_unstale":"2024-02-17T12:18:21.365016+0000","last_undegraded":"2024-02-17T12:18:21.365016+0000","last_fullsized":"2024-02-17T12:18:21.365016+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816301+0000","last_change":"2024-02-17T12:18:20.363604+0000","last_active":"2024-02-17T12:18:21.816301+0000","last_peered":"2024-02-17T12:18:21.816301+0000","last_clean":"2024-02-17T12:18:21.816301+0000","last_became_active":"2024-02-17T12:18:20.362955+0000","last_became_peered":"2024-02-17T12:18:20.362955+0000","last_unstale":"2024-02-17T12:18:21.816301+0000","last_undegraded":"2024-02-17T12:18:21.816301+0000","last_fullsized":"2024-02-17T12:18:21.816301+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:42:14.296376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366645+0000","last_change":"2024-02-17T12:18:19.352520+0000","last_active":"2024-02-17T12:18:21.366645+0000","last_peered":"2024-02-17T12:18:21.366645+0000","last_clean":"2024-02-17T12:18:21.366645+0000","last_became_active":"2024-02-17T12:18:19.351708+0000","last_became_peered":"2024-02-17T12:18:19.351708+0000","last_unstale":"2024-02-17T12:18:21.366645+0000","last_undegraded":"2024-02-17T12:18:21.366645+0000","last_fullsized":"2024-02-17T12:18:21.366645+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:27:03.833418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815575+0000","last_change":"2024-02-17T12:18:02.801971+0000","last_active":"2024-02-17T12:18:21.815575+0000","last_peered":"2024-02-17T12:18:21.815575+0000","last_clean":"2024-02-17T12:18:21.815575+0000","last_became_active":"2024-02-17T12:18:02.801727+0000","last_became_peered":"2024-02-17T12:18:02.801727+0000","last_unstale":"2024-02-17T12:18:21.815575+0000","last_undegraded":"2024-02-17T12:18:21.815575+0000","last_fullsized":"2024-02-17T12:18:21.815575+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:06:15.526935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815739+0000","last_change":"2024-02-17T12:18:01.800493+0000","last_active":"2024-02-17T12:18:21.815739+0000","last_peered":"2024-02-17T12:18:21.815739+0000","last_clean":"2024-02-17T12:18:21.815739+0000","last_became_active":"2024-02-17T12:18:01.800206+0000","last_became_peered":"2024-02-17T12:18:01.800206+0000","last_unstale":"2024-02-17T12:18:21.815739+0000","last_undegraded":"2024-02-17T12:18:21.815739+0000","last_fullsized":"2024-02-17T12:18:21.815739+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:33.603620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366552+0000","last_change":"2024-02-17T12:18:20.378440+0000","last_active":"2024-02-17T12:18:21.366552+0000","last_peered":"2024-02-17T12:18:21.366552+0000","last_clean":"2024-02-17T12:18:21.366552+0000","last_became_active":"2024-02-17T12:18:20.378115+0000","last_became_peered":"2024-02-17T12:18:20.378115+0000","last_unstale":"2024-02-17T12:18:21.366552+0000","last_undegraded":"2024-02-17T12:18:21.366552+0000","last_fullsized":"2024-02-17T12:18:21.366552+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:06:33.079656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815320+0000","last_change":"2024-02-17T12:18:19.347455+0000","last_active":"2024-02-17T12:18:21.815320+0000","last_peered":"2024-02-17T12:18:21.815320+0000","last_clean":"2024-02-17T12:18:21.815320+0000","last_became_active":"2024-02-17T12:18:19.347134+0000","last_became_peered":"2024-02-17T12:18:19.347134+0000","last_unstale":"2024-02-17T12:18:21.815320+0000","last_undegraded":"2024-02-17T12:18:21.815320+0000","last_fullsized":"2024-02-17T12:18:21.815320+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:17:58.452927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817429+0000","last_change":"2024-02-17T12:18:02.797952+0000","last_active":"2024-02-17T12:18:21.817429+0000","last_peered":"2024-02-17T12:18:21.817429+0000","last_clean":"2024-02-17T12:18:21.817429+0000","last_became_active":"2024-02-17T12:18:02.797675+0000","last_became_peered":"2024-02-17T12:18:02.797675+0000","last_unstale":"2024-02-17T12:18:21.817429+0000","last_undegraded":"2024-02-17T12:18:21.817429+0000","last_fullsized":"2024-02-17T12:18:21.817429+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:01.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817208+0000","last_change":"2024-02-17T12:18:01.801850+0000","last_active":"2024-02-17T12:18:21.817208+0000","last_peered":"2024-02-17T12:18:21.817208+0000","last_clean":"2024-02-17T12:18:21.817208+0000","last_became_active":"2024-02-17T12:18:01.801516+0000","last_became_peered":"2024-02-17T12:18:01.801516+0000","last_unstale":"2024-02-17T12:18:21.817208+0000","last_undegraded":"2024-02-17T12:18:21.817208+0000","last_fullsized":"2024-02-17T12:18:21.817208+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:28.630666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815846+0000","last_change":"2024-02-17T12:18:20.364321+0000","last_active":"2024-02-17T12:18:21.815846+0000","last_peered":"2024-02-17T12:18:21.815846+0000","last_clean":"2024-02-17T12:18:21.815846+0000","last_became_active":"2024-02-17T12:18:20.363927+0000","last_became_peered":"2024-02-17T12:18:20.363927+0000","last_unstale":"2024-02-17T12:18:21.815846+0000","last_undegraded":"2024-02-17T12:18:21.815846+0000","last_fullsized":"2024-02-17T12:18:21.815846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:17:35.685715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362848+0000","last_change":"2024-02-17T12:18:19.352769+0000","last_active":"2024-02-17T12:18:21.362848+0000","last_peered":"2024-02-17T12:18:21.362848+0000","last_clean":"2024-02-17T12:18:21.362848+0000","last_became_active":"2024-02-17T12:18:19.352519+0000","last_became_peered":"2024-02-17T12:18:19.352519+0000","last_unstale":"2024-02-17T12:18:21.362848+0000","last_undegraded":"2024-02-17T12:18:21.362848+0000","last_fullsized":"2024-02-17T12:18:21.362848+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:28:25.102363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817050+0000","last_change":"2024-02-17T12:18:02.813957+0000","last_active":"2024-02-17T12:18:21.817050+0000","last_peered":"2024-02-17T12:18:21.817050+0000","last_clean":"2024-02-17T12:18:21.817050+0000","last_became_active":"2024-02-17T12:18:02.813647+0000","last_became_peered":"2024-02-17T12:18:02.813647+0000","last_unstale":"2024-02-17T12:18:21.817050+0000","last_undegraded":"2024-02-17T12:18:21.817050+0000","last_fullsized":"2024-02-17T12:18:21.817050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:41.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816376+0000","last_change":"2024-02-17T12:18:01.799508+0000","last_active":"2024-02-17T12:18:21.816376+0000","last_peered":"2024-02-17T12:18:21.816376+0000","last_clean":"2024-02-17T12:18:21.816376+0000","last_became_active":"2024-02-17T12:18:01.798598+0000","last_became_peered":"2024-02-17T12:18:01.798598+0000","last_unstale":"2024-02-17T12:18:21.816376+0000","last_undegraded":"2024-02-17T12:18:21.816376+0000","last_fullsized":"2024-02-17T12:18:21.816376+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:45.103353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365953+0000","last_change":"2024-02-17T12:18:20.358572+0000","last_active":"2024-02-17T12:18:21.365953+0000","last_peered":"2024-02-17T12:18:21.365953+0000","last_clean":"2024-02-17T12:18:21.365953+0000","last_became_active":"2024-02-17T12:18:20.357644+0000","last_became_peered":"2024-02-17T12:18:20.357644+0000","last_unstale":"2024-02-17T12:18:21.365953+0000","last_undegraded":"2024-02-17T12:18:21.365953+0000","last_fullsized":"2024-02-17T12:18:21.365953+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:45.194765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817197+0000","last_change":"2024-02-17T12:18:19.343528+0000","last_active":"2024-02-17T12:18:21.817197+0000","last_peered":"2024-02-17T12:18:21.817197+0000","last_clean":"2024-02-17T12:18:21.817197+0000","last_became_active":"2024-02-17T12:18:19.343256+0000","last_became_peered":"2024-02-17T12:18:19.343256+0000","last_unstale":"2024-02-17T12:18:21.817197+0000","last_undegraded":"2024-02-17T12:18:21.817197+0000","last_fullsized":"2024-02-17T12:18:21.817197+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:49:14.842881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362953+0000","last_change":"2024-02-17T12:18:02.787850+0000","last_active":"2024-02-17T12:18:21.362953+0000","last_peered":"2024-02-17T12:18:21.362953+0000","last_clean":"2024-02-17T12:18:21.362953+0000","last_became_active":"2024-02-17T12:18:02.787578+0000","last_became_peered":"2024-02-17T12:18:02.787578+0000","last_unstale":"2024-02-17T12:18:21.362953+0000","last_undegraded":"2024-02-17T12:18:21.362953+0000","last_fullsized":"2024-02-17T12:18:21.362953+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:29.854264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":25,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816438+0000","last_change":"2024-02-17T12:18:01.805403+0000","last_active":"2024-02-17T12:18:21.816438+0000","last_peered":"2024-02-17T12:18:21.816438+0000","last_clean":"2024-02-17T12:18:21.816438+0000","last_became_active":"2024-02-17T12:18:01.805059+0000","last_became_peered":"2024-02-17T12:18:01.805059+0000","last_unstale":"2024-02-17T12:18:21.816438+0000","last_undegraded":"2024-02-17T12:18:21.816438+0000","last_fullsized":"2024-02-17T12:18:21.816438+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:14.495937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816895+0000","last_change":"2024-02-17T12:18:20.366044+0000","last_active":"2024-02-17T12:18:21.816895+0000","last_peered":"2024-02-17T12:18:21.816895+0000","last_clean":"2024-02-17T12:18:21.816895+0000","last_became_active":"2024-02-17T12:18:20.365728+0000","last_became_peered":"2024-02-17T12:18:20.365728+0000","last_unstale":"2024-02-17T12:18:21.816895+0000","last_undegraded":"2024-02-17T12:18:21.816895+0000","last_fullsized":"2024-02-17T12:18:21.816895+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:30.100473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.367081+0000","last_change":"2024-02-17T12:18:19.349635+0000","last_active":"2024-02-17T12:18:21.367081+0000","last_peered":"2024-02-17T12:18:21.367081+0000","last_clean":"2024-02-17T12:18:21.367081+0000","last_became_active":"2024-02-17T12:18:19.349145+0000","last_became_peered":"2024-02-17T12:18:19.349145+0000","last_unstale":"2024-02-17T12:18:21.367081+0000","last_undegraded":"2024-02-17T12:18:21.367081+0000","last_fullsized":"2024-02-17T12:18:21.367081+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:20.789007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816331+0000","last_change":"2024-02-17T12:18:02.810198+0000","last_active":"2024-02-17T12:18:21.816331+0000","last_peered":"2024-02-17T12:18:21.816331+0000","last_clean":"2024-02-17T12:18:21.816331+0000","last_became_active":"2024-02-17T12:18:02.809131+0000","last_became_peered":"2024-02-17T12:18:02.809131+0000","last_unstale":"2024-02-17T12:18:21.816331+0000","last_undegraded":"2024-02-17T12:18:21.816331+0000","last_fullsized":"2024-02-17T12:18:21.816331+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:01:23.089637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'8","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816711+0000","last_change":"2024-02-17T12:18:01.802710+0000","last_active":"2024-02-17T12:18:21.816711+0000","last_peered":"2024-02-17T12:18:21.816711+0000","last_clean":"2024-02-17T12:18:21.816711+0000","last_became_active":"2024-02-17T12:18:01.802365+0000","last_became_peered":"2024-02-17T12:18:01.802365+0000","last_unstale":"2024-02-17T12:18:21.816711+0000","last_undegraded":"2024-02-17T12:18:21.816711+0000","last_fullsized":"2024-02-17T12:18:21.816711+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:56:45.771679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814505+0000","last_change":"2024-02-17T12:18:20.367453+0000","last_active":"2024-02-17T12:18:21.814505+0000","last_peered":"2024-02-17T12:18:21.814505+0000","last_clean":"2024-02-17T12:18:21.814505+0000","last_became_active":"2024-02-17T12:18:20.366032+0000","last_became_peered":"2024-02-17T12:18:20.366032+0000","last_unstale":"2024-02-17T12:18:21.814505+0000","last_undegraded":"2024-02-17T12:18:21.814505+0000","last_fullsized":"2024-02-17T12:18:21.814505+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:40.667161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364944+0000","last_change":"2024-02-17T12:18:19.353417+0000","last_active":"2024-02-17T12:18:21.364944+0000","last_peered":"2024-02-17T12:18:21.364944+0000","last_clean":"2024-02-17T12:18:21.364944+0000","last_became_active":"2024-02-17T12:18:19.350515+0000","last_became_peered":"2024-02-17T12:18:19.350515+0000","last_unstale":"2024-02-17T12:18:21.364944+0000","last_undegraded":"2024-02-17T12:18:21.364944+0000","last_fullsized":"2024-02-17T12:18:21.364944+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:28:32.430718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365389+0000","last_change":"2024-02-17T12:18:02.809855+0000","last_active":"2024-02-17T12:18:21.365389+0000","last_peered":"2024-02-17T12:18:21.365389+0000","last_clean":"2024-02-17T12:18:21.365389+0000","last_became_active":"2024-02-17T12:18:02.809577+0000","last_became_peered":"2024-02-17T12:18:02.809577+0000","last_unstale":"2024-02-17T12:18:21.365389+0000","last_undegraded":"2024-02-17T12:18:21.365389+0000","last_fullsized":"2024-02-17T12:18:21.365389+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:17:49.657379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":24,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815683+0000","last_change":"2024-02-17T12:18:01.792615+0000","last_active":"2024-02-17T12:18:21.815683+0000","last_peered":"2024-02-17T12:18:21.815683+0000","last_clean":"2024-02-17T12:18:21.815683+0000","last_became_active":"2024-02-17T12:18:01.792287+0000","last_became_peered":"2024-02-17T12:18:01.792287+0000","last_unstale":"2024-02-17T12:18:21.815683+0000","last_undegraded":"2024-02-17T12:18:21.815683+0000","last_fullsized":"2024-02-17T12:18:21.815683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:09:56.241760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814588+0000","last_change":"2024-02-17T12:18:20.366313+0000","last_active":"2024-02-17T12:18:21.814588+0000","last_peered":"2024-02-17T12:18:21.814588+0000","last_clean":"2024-02-17T12:18:21.814588+0000","last_became_active":"2024-02-17T12:18:20.358125+0000","last_became_peered":"2024-02-17T12:18:20.358125+0000","last_unstale":"2024-02-17T12:18:21.814588+0000","last_undegraded":"2024-02-17T12:18:21.814588+0000","last_fullsized":"2024-02-17T12:18:21.814588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:29:25.235404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815415+0000","last_change":"2024-02-17T12:18:19.350080+0000","last_active":"2024-02-17T12:18:21.815415+0000","last_peered":"2024-02-17T12:18:21.815415+0000","last_clean":"2024-02-17T12:18:21.815415+0000","last_became_active":"2024-02-17T12:18:19.349855+0000","last_became_peered":"2024-02-17T12:18:19.349855+0000","last_unstale":"2024-02-17T12:18:21.815415+0000","last_undegraded":"2024-02-17T12:18:21.815415+0000","last_fullsized":"2024-02-17T12:18:21.815415+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:06:06.795461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815664+0000","last_change":"2024-02-17T12:18:02.808057+0000","last_active":"2024-02-17T12:18:21.815664+0000","last_peered":"2024-02-17T12:18:21.815664+0000","last_clean":"2024-02-17T12:18:21.815664+0000","last_became_active":"2024-02-17T12:18:02.807629+0000","last_became_peered":"2024-02-17T12:18:02.807629+0000","last_unstale":"2024-02-17T12:18:21.815664+0000","last_undegraded":"2024-02-17T12:18:21.815664+0000","last_fullsized":"2024-02-17T12:18:21.815664+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:58:48.506743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366982+0000","last_change":"2024-02-17T12:18:01.797715+0000","last_active":"2024-02-17T12:18:21.366982+0000","last_peered":"2024-02-17T12:18:21.366982+0000","last_clean":"2024-02-17T12:18:21.366982+0000","last_became_active":"2024-02-17T12:18:01.797435+0000","last_became_peered":"2024-02-17T12:18:01.797435+0000","last_unstale":"2024-02-17T12:18:21.366982+0000","last_undegraded":"2024-02-17T12:18:21.366982+0000","last_fullsized":"2024-02-17T12:18:21.366982+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:18:49.624601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815003+0000","last_change":"2024-02-17T12:18:20.356336+0000","last_active":"2024-02-17T12:18:21.815003+0000","last_peered":"2024-02-17T12:18:21.815003+0000","last_clean":"2024-02-17T12:18:21.815003+0000","last_became_active":"2024-02-17T12:18:20.355999+0000","last_became_peered":"2024-02-17T12:18:20.355999+0000","last_unstale":"2024-02-17T12:18:21.815003+0000","last_undegraded":"2024-02-17T12:18:21.815003+0000","last_fullsized":"2024-02-17T12:18:21.815003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:54:08.533027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362524+0000","last_change":"2024-02-17T12:18:19.355317+0000","last_active":"2024-02-17T12:18:21.362524+0000","last_peered":"2024-02-17T12:18:21.362524+0000","last_clean":"2024-02-17T12:18:21.362524+0000","last_became_active":"2024-02-17T12:18:19.353852+0000","last_became_peered":"2024-02-17T12:18:19.353852+0000","last_unstale":"2024-02-17T12:18:21.362524+0000","last_undegraded":"2024-02-17T12:18:21.362524+0000","last_fullsized":"2024-02-17T12:18:21.362524+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:44:01.563171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815618+0000","last_change":"2024-02-17T12:18:02.810137+0000","last_active":"2024-02-17T12:18:21.815618+0000","last_peered":"2024-02-17T12:18:21.815618+0000","last_clean":"2024-02-17T12:18:21.815618+0000","last_became_active":"2024-02-17T12:18:02.809877+0000","last_became_peered":"2024-02-17T12:18:02.809877+0000","last_unstale":"2024-02-17T12:18:21.815618+0000","last_undegraded":"2024-02-17T12:18:21.815618+0000","last_fullsized":"2024-02-17T12:18:21.815618+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:35:15.502397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365052+0000","last_change":"2024-02-17T12:18:01.790794+0000","last_active":"2024-02-17T12:18:21.365052+0000","last_peered":"2024-02-17T12:18:21.365052+0000","last_clean":"2024-02-17T12:18:21.365052+0000","last_became_active":"2024-02-17T12:18:01.790500+0000","last_became_peered":"2024-02-17T12:18:01.790500+0000","last_unstale":"2024-02-17T12:18:21.365052+0000","last_undegraded":"2024-02-17T12:18:21.365052+0000","last_fullsized":"2024-02-17T12:18:21.365052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:31:33.694022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365395+0000","last_change":"2024-02-17T12:18:20.367806+0000","last_active":"2024-02-17T12:18:21.365395+0000","last_peered":"2024-02-17T12:18:21.365395+0000","last_clean":"2024-02-17T12:18:21.365395+0000","last_became_active":"2024-02-17T12:18:20.367510+0000","last_became_peered":"2024-02-17T12:18:20.367510+0000","last_unstale":"2024-02-17T12:18:21.365395+0000","last_undegraded":"2024-02-17T12:18:21.365395+0000","last_fullsized":"2024-02-17T12:18:21.365395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:52:51.435036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366680+0000","last_change":"2024-02-17T12:18:19.352733+0000","last_active":"2024-02-17T12:18:21.366680+0000","last_peered":"2024-02-17T12:18:21.366680+0000","last_clean":"2024-02-17T12:18:21.366680+0000","last_became_active":"2024-02-17T12:18:19.352039+0000","last_became_peered":"2024-02-17T12:18:19.352039+0000","last_unstale":"2024-02-17T12:18:21.366680+0000","last_undegraded":"2024-02-17T12:18:21.366680+0000","last_fullsized":"2024-02-17T12:18:21.366680+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:14:02.978610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815239+0000","last_change":"2024-02-17T12:18:02.808594+0000","last_active":"2024-02-17T12:18:21.815239+0000","last_peered":"2024-02-17T12:18:21.815239+0000","last_clean":"2024-02-17T12:18:21.815239+0000","last_became_active":"2024-02-17T12:18:02.808035+0000","last_became_peered":"2024-02-17T12:18:02.808035+0000","last_unstale":"2024-02-17T12:18:21.815239+0000","last_undegraded":"2024-02-17T12:18:21.815239+0000","last_fullsized":"2024-02-17T12:18:21.815239+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:58.050395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":30,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815076+0000","last_change":"2024-02-17T12:18:01.789017+0000","last_active":"2024-02-17T12:18:21.815076+0000","last_peered":"2024-02-17T12:18:21.815076+0000","last_clean":"2024-02-17T12:18:21.815076+0000","last_became_active":"2024-02-17T12:18:01.788529+0000","last_became_peered":"2024-02-17T12:18:01.788529+0000","last_unstale":"2024-02-17T12:18:21.815076+0000","last_undegraded":"2024-02-17T12:18:21.815076+0000","last_fullsized":"2024-02-17T12:18:21.815076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:31.560281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362769+0000","last_change":"2024-02-17T12:18:20.355229+0000","last_active":"2024-02-17T12:18:21.362769+0000","last_peered":"2024-02-17T12:18:21.362769+0000","last_clean":"2024-02-17T12:18:21.362769+0000","last_became_active":"2024-02-17T12:18:20.354959+0000","last_became_peered":"2024-02-17T12:18:20.354959+0000","last_unstale":"2024-02-17T12:18:21.362769+0000","last_undegraded":"2024-02-17T12:18:21.362769+0000","last_fullsized":"2024-02-17T12:18:21.362769+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:21.795332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366093+0000","last_change":"2024-02-17T12:18:19.354058+0000","last_active":"2024-02-17T12:18:21.366093+0000","last_peered":"2024-02-17T12:18:21.366093+0000","last_clean":"2024-02-17T12:18:21.366093+0000","last_became_active":"2024-02-17T12:18:19.353686+0000","last_became_peered":"2024-02-17T12:18:19.353686+0000","last_unstale":"2024-02-17T12:18:21.366093+0000","last_undegraded":"2024-02-17T12:18:21.366093+0000","last_fullsized":"2024-02-17T12:18:21.366093+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:13.794616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816822+0000","last_change":"2024-02-17T12:18:02.808518+0000","last_active":"2024-02-17T12:18:21.816822+0000","last_peered":"2024-02-17T12:18:21.816822+0000","last_clean":"2024-02-17T12:18:21.816822+0000","last_became_active":"2024-02-17T12:18:02.808255+0000","last_became_peered":"2024-02-17T12:18:02.808255+0000","last_unstale":"2024-02-17T12:18:21.816822+0000","last_undegraded":"2024-02-17T12:18:21.816822+0000","last_fullsized":"2024-02-17T12:18:21.816822+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:58:40.908163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":23,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816722+0000","last_change":"2024-02-17T12:18:01.802794+0000","last_active":"2024-02-17T12:18:21.816722+0000","last_peered":"2024-02-17T12:18:21.816722+0000","last_clean":"2024-02-17T12:18:21.816722+0000","last_became_active":"2024-02-17T12:18:01.802366+0000","last_became_peered":"2024-02-17T12:18:01.802366+0000","last_unstale":"2024-02-17T12:18:21.816722+0000","last_undegraded":"2024-02-17T12:18:21.816722+0000","last_fullsized":"2024-02-17T12:18:21.816722+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:45:00.445775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816018+0000","last_change":"2024-02-17T12:18:20.373572+0000","last_active":"2024-02-17T12:18:21.816018+0000","last_peered":"2024-02-17T12:18:21.816018+0000","last_clean":"2024-02-17T12:18:21.816018+0000","last_became_active":"2024-02-17T12:18:20.373216+0000","last_became_peered":"2024-02-17T12:18:20.373216+0000","last_unstale":"2024-02-17T12:18:21.816018+0000","last_undegraded":"2024-02-17T12:18:21.816018+0000","last_fullsized":"2024-02-17T12:18:21.816018+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:43:18.914283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815406+0000","last_change":"2024-02-17T12:18:19.348085+0000","last_active":"2024-02-17T12:18:21.815406+0000","last_peered":"2024-02-17T12:18:21.815406+0000","last_clean":"2024-02-17T12:18:21.815406+0000","last_became_active":"2024-02-17T12:18:19.347772+0000","last_became_peered":"2024-02-17T12:18:19.347772+0000","last_unstale":"2024-02-17T12:18:21.815406+0000","last_undegraded":"2024-02-17T12:18:21.815406+0000","last_fullsized":"2024-02-17T12:18:21.815406+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:03:13.293322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366277+0000","last_change":"2024-02-17T12:18:02.810942+0000","last_active":"2024-02-17T12:18:21.366277+0000","last_peered":"2024-02-17T12:18:21.366277+0000","last_clean":"2024-02-17T12:18:21.366277+0000","last_became_active":"2024-02-17T12:18:02.810651+0000","last_became_peered":"2024-02-17T12:18:02.810651+0000","last_unstale":"2024-02-17T12:18:21.366277+0000","last_undegraded":"2024-02-17T12:18:21.366277+0000","last_fullsized":"2024-02-17T12:18:21.366277+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:47.287022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":24,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817355+0000","last_change":"2024-02-17T12:18:01.797601+0000","last_active":"2024-02-17T12:18:21.817355+0000","last_peered":"2024-02-17T12:18:21.817355+0000","last_clean":"2024-02-17T12:18:21.817355+0000","last_became_active":"2024-02-17T12:18:01.796341+0000","last_became_peered":"2024-02-17T12:18:01.796341+0000","last_unstale":"2024-02-17T12:18:21.817355+0000","last_undegraded":"2024-02-17T12:18:21.817355+0000","last_fullsized":"2024-02-17T12:18:21.817355+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817490+0000","last_change":"2024-02-17T12:18:20.376384+0000","last_active":"2024-02-17T12:18:21.817490+0000","last_peered":"2024-02-17T12:18:21.817490+0000","last_clean":"2024-02-17T12:18:21.817490+0000","last_became_active":"2024-02-17T12:18:20.368869+0000","last_became_peered":"2024-02-17T12:18:20.368869+0000","last_unstale":"2024-02-17T12:18:21.817490+0000","last_undegraded":"2024-02-17T12:18:21.817490+0000","last_fullsized":"2024-02-17T12:18:21.817490+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:13.358875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366893+0000","last_change":"2024-02-17T12:18:19.353335+0000","last_active":"2024-02-17T12:18:21.366893+0000","last_peered":"2024-02-17T12:18:21.366893+0000","last_clean":"2024-02-17T12:18:21.366893+0000","last_became_active":"2024-02-17T12:18:19.353048+0000","last_became_peered":"2024-02-17T12:18:19.353048+0000","last_unstale":"2024-02-17T12:18:21.366893+0000","last_undegraded":"2024-02-17T12:18:21.366893+0000","last_fullsized":"2024-02-17T12:18:21.366893+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:40:29.083738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814901+0000","last_change":"2024-02-17T12:18:02.803894+0000","last_active":"2024-02-17T12:18:21.814901+0000","last_peered":"2024-02-17T12:18:21.814901+0000","last_clean":"2024-02-17T12:18:21.814901+0000","last_became_active":"2024-02-17T12:18:02.803553+0000","last_became_peered":"2024-02-17T12:18:02.803553+0000","last_unstale":"2024-02-17T12:18:21.814901+0000","last_undegraded":"2024-02-17T12:18:21.814901+0000","last_fullsized":"2024-02-17T12:18:21.814901+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:35:24.727572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":23,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366030+0000","last_change":"2024-02-17T12:18:01.789546+0000","last_active":"2024-02-17T12:18:21.366030+0000","last_peered":"2024-02-17T12:18:21.366030+0000","last_clean":"2024-02-17T12:18:21.366030+0000","last_became_active":"2024-02-17T12:18:01.789258+0000","last_became_peered":"2024-02-17T12:18:01.789258+0000","last_unstale":"2024-02-17T12:18:21.366030+0000","last_undegraded":"2024-02-17T12:18:21.366030+0000","last_fullsized":"2024-02-17T12:18:21.366030+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817152+0000","last_change":"2024-02-17T12:18:20.371385+0000","last_active":"2024-02-17T12:18:21.817152+0000","last_peered":"2024-02-17T12:18:21.817152+0000","last_clean":"2024-02-17T12:18:21.817152+0000","last_became_active":"2024-02-17T12:18:20.370442+0000","last_became_peered":"2024-02-17T12:18:20.370442+0000","last_unstale":"2024-02-17T12:18:21.817152+0000","last_undegraded":"2024-02-17T12:18:21.817152+0000","last_fullsized":"2024-02-17T12:18:21.817152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:08:33.483318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817199+0000","last_change":"2024-02-17T12:18:19.349251+0000","last_active":"2024-02-17T12:18:21.817199+0000","last_peered":"2024-02-17T12:18:21.817199+0000","last_clean":"2024-02-17T12:18:21.817199+0000","last_became_active":"2024-02-17T12:18:19.346293+0000","last_became_peered":"2024-02-17T12:18:19.346293+0000","last_unstale":"2024-02-17T12:18:21.817199+0000","last_undegraded":"2024-02-17T12:18:21.817199+0000","last_fullsized":"2024-02-17T12:18:21.817199+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:11:29.296104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816408+0000","last_change":"2024-02-17T12:18:02.811327+0000","last_active":"2024-02-17T12:18:21.816408+0000","last_peered":"2024-02-17T12:18:21.816408+0000","last_clean":"2024-02-17T12:18:21.816408+0000","last_became_active":"2024-02-17T12:18:02.809620+0000","last_became_peered":"2024-02-17T12:18:02.809620+0000","last_unstale":"2024-02-17T12:18:21.816408+0000","last_undegraded":"2024-02-17T12:18:21.816408+0000","last_fullsized":"2024-02-17T12:18:21.816408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:40:08.098289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816942+0000","last_change":"2024-02-17T12:18:01.798265+0000","last_active":"2024-02-17T12:18:21.816942+0000","last_peered":"2024-02-17T12:18:21.816942+0000","last_clean":"2024-02-17T12:18:21.816942+0000","last_became_active":"2024-02-17T12:18:01.797931+0000","last_became_peered":"2024-02-17T12:18:01.797931+0000","last_unstale":"2024-02-17T12:18:21.816942+0000","last_undegraded":"2024-02-17T12:18:21.816942+0000","last_fullsized":"2024-02-17T12:18:21.816942+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:29.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815743+0000","last_change":"2024-02-17T12:18:20.378200+0000","last_active":"2024-02-17T12:18:21.815743+0000","last_peered":"2024-02-17T12:18:21.815743+0000","last_clean":"2024-02-17T12:18:21.815743+0000","last_became_active":"2024-02-17T12:18:20.378015+0000","last_became_peered":"2024-02-17T12:18:20.378015+0000","last_unstale":"2024-02-17T12:18:21.815743+0000","last_undegraded":"2024-02-17T12:18:21.815743+0000","last_fullsized":"2024-02-17T12:18:21.815743+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:23:40.238581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364820+0000","last_change":"2024-02-17T12:18:19.339116+0000","last_active":"2024-02-17T12:18:21.364820+0000","last_peered":"2024-02-17T12:18:21.364820+0000","last_clean":"2024-02-17T12:18:21.364820+0000","last_became_active":"2024-02-17T12:18:19.338406+0000","last_became_peered":"2024-02-17T12:18:19.338406+0000","last_unstale":"2024-02-17T12:18:21.364820+0000","last_undegraded":"2024-02-17T12:18:21.364820+0000","last_fullsized":"2024-02-17T12:18:21.364820+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:54:15.066782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365292+0000","last_change":"2024-02-17T12:18:02.800381+0000","last_active":"2024-02-17T12:18:21.365292+0000","last_peered":"2024-02-17T12:18:21.365292+0000","last_clean":"2024-02-17T12:18:21.365292+0000","last_became_active":"2024-02-17T12:18:02.800042+0000","last_became_peered":"2024-02-17T12:18:02.800042+0000","last_unstale":"2024-02-17T12:18:21.365292+0000","last_undegraded":"2024-02-17T12:18:21.365292+0000","last_fullsized":"2024-02-17T12:18:21.365292+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:55:27.558546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":24,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815941+0000","last_change":"2024-02-17T12:18:01.795914+0000","last_active":"2024-02-17T12:18:21.815941+0000","last_peered":"2024-02-17T12:18:21.815941+0000","last_clean":"2024-02-17T12:18:21.815941+0000","last_became_active":"2024-02-17T12:18:01.794847+0000","last_became_peered":"2024-02-17T12:18:01.794847+0000","last_unstale":"2024-02-17T12:18:21.815941+0000","last_undegraded":"2024-02-17T12:18:21.815941+0000","last_fullsized":"2024-02-17T12:18:21.815941+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:31.320927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814871+0000","last_change":"2024-02-17T12:18:20.361768+0000","last_active":"2024-02-17T12:18:21.814871+0000","last_peered":"2024-02-17T12:18:21.814871+0000","last_clean":"2024-02-17T12:18:21.814871+0000","last_became_active":"2024-02-17T12:18:20.361216+0000","last_became_peered":"2024-02-17T12:18:20.361216+0000","last_unstale":"2024-02-17T12:18:21.814871+0000","last_undegraded":"2024-02-17T12:18:21.814871+0000","last_fullsized":"2024-02-17T12:18:21.814871+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:21:52.737603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814352+0000","last_change":"2024-02-17T12:18:19.352005+0000","last_active":"2024-02-17T12:18:21.814352+0000","last_peered":"2024-02-17T12:18:21.814352+0000","last_clean":"2024-02-17T12:18:21.814352+0000","last_became_active":"2024-02-17T12:18:19.351791+0000","last_became_peered":"2024-02-17T12:18:19.351791+0000","last_unstale":"2024-02-17T12:18:21.814352+0000","last_undegraded":"2024-02-17T12:18:21.814352+0000","last_fullsized":"2024-02-17T12:18:21.814352+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:33:43.909509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816640+0000","last_change":"2024-02-17T12:18:02.807547+0000","last_active":"2024-02-17T12:18:21.816640+0000","last_peered":"2024-02-17T12:18:21.816640+0000","last_clean":"2024-02-17T12:18:21.816640+0000","last_became_active":"2024-02-17T12:18:02.807209+0000","last_became_peered":"2024-02-17T12:18:02.807209+0000","last_unstale":"2024-02-17T12:18:21.816640+0000","last_undegraded":"2024-02-17T12:18:21.816640+0000","last_fullsized":"2024-02-17T12:18:21.816640+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:55:04.242611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362589+0000","last_change":"2024-02-17T12:18:01.803848+0000","last_active":"2024-02-17T12:18:21.362589+0000","last_peered":"2024-02-17T12:18:21.362589+0000","last_clean":"2024-02-17T12:18:21.362589+0000","last_became_active":"2024-02-17T12:18:01.803552+0000","last_became_peered":"2024-02-17T12:18:01.803552+0000","last_unstale":"2024-02-17T12:18:21.362589+0000","last_undegraded":"2024-02-17T12:18:21.362589+0000","last_fullsized":"2024-02-17T12:18:21.362589+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:25:02.826927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.814581+0000","last_change":"2024-02-17T12:18:20.366943+0000","last_active":"2024-02-17T12:18:21.814581+0000","last_peered":"2024-02-17T12:18:21.814581+0000","last_clean":"2024-02-17T12:18:21.814581+0000","last_became_active":"2024-02-17T12:18:20.366647+0000","last_became_peered":"2024-02-17T12:18:20.366647+0000","last_unstale":"2024-02-17T12:18:21.814581+0000","last_undegraded":"2024-02-17T12:18:21.814581+0000","last_fullsized":"2024-02-17T12:18:21.814581+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:14:49.225611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366856+0000","last_change":"2024-02-17T12:18:19.352308+0000","last_active":"2024-02-17T12:18:21.366856+0000","last_peered":"2024-02-17T12:18:21.366856+0000","last_clean":"2024-02-17T12:18:21.366856+0000","last_became_active":"2024-02-17T12:18:19.351363+0000","last_became_peered":"2024-02-17T12:18:19.351363+0000","last_unstale":"2024-02-17T12:18:21.366856+0000","last_undegraded":"2024-02-17T12:18:21.366856+0000","last_fullsized":"2024-02-17T12:18:21.366856+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:11:02.656210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815021+0000","last_change":"2024-02-17T12:18:02.811800+0000","last_active":"2024-02-17T12:18:21.815021+0000","last_peered":"2024-02-17T12:18:21.815021+0000","last_clean":"2024-02-17T12:18:21.815021+0000","last_became_active":"2024-02-17T12:18:02.811504+0000","last_became_peered":"2024-02-17T12:18:02.811504+0000","last_unstale":"2024-02-17T12:18:21.815021+0000","last_undegraded":"2024-02-17T12:18:21.815021+0000","last_fullsized":"2024-02-17T12:18:21.815021+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:04.683979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364416+0000","last_change":"2024-02-17T12:18:01.800860+0000","last_active":"2024-02-17T12:18:21.364416+0000","last_peered":"2024-02-17T12:18:21.364416+0000","last_clean":"2024-02-17T12:18:21.364416+0000","last_became_active":"2024-02-17T12:18:01.800569+0000","last_became_peered":"2024-02-17T12:18:01.800569+0000","last_unstale":"2024-02-17T12:18:21.364416+0000","last_undegraded":"2024-02-17T12:18:21.364416+0000","last_fullsized":"2024-02-17T12:18:21.364416+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:51:04.429357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815460+0000","last_change":"2024-02-17T12:18:20.366635+0000","last_active":"2024-02-17T12:18:21.815460+0000","last_peered":"2024-02-17T12:18:21.815460+0000","last_clean":"2024-02-17T12:18:21.815460+0000","last_became_active":"2024-02-17T12:18:20.366353+0000","last_became_peered":"2024-02-17T12:18:20.366353+0000","last_unstale":"2024-02-17T12:18:21.815460+0000","last_undegraded":"2024-02-17T12:18:21.815460+0000","last_fullsized":"2024-02-17T12:18:21.815460+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:06.721140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816072+0000","last_change":"2024-02-17T12:18:19.349932+0000","last_active":"2024-02-17T12:18:21.816072+0000","last_peered":"2024-02-17T12:18:21.816072+0000","last_clean":"2024-02-17T12:18:21.816072+0000","last_became_active":"2024-02-17T12:18:19.349592+0000","last_became_peered":"2024-02-17T12:18:19.349592+0000","last_unstale":"2024-02-17T12:18:21.816072+0000","last_undegraded":"2024-02-17T12:18:21.816072+0000","last_fullsized":"2024-02-17T12:18:21.816072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:19:58.523935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366228+0000","last_change":"2024-02-17T12:18:02.812763+0000","last_active":"2024-02-17T12:18:21.366228+0000","last_peered":"2024-02-17T12:18:21.366228+0000","last_clean":"2024-02-17T12:18:21.366228+0000","last_became_active":"2024-02-17T12:18:02.812512+0000","last_became_peered":"2024-02-17T12:18:02.812512+0000","last_unstale":"2024-02-17T12:18:21.366228+0000","last_undegraded":"2024-02-17T12:18:21.366228+0000","last_fullsized":"2024-02-17T12:18:21.366228+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:21.038634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":24,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364171+0000","last_change":"2024-02-17T12:18:01.805847+0000","last_active":"2024-02-17T12:18:21.364171+0000","last_peered":"2024-02-17T12:18:21.364171+0000","last_clean":"2024-02-17T12:18:21.364171+0000","last_became_active":"2024-02-17T12:18:01.805591+0000","last_became_peered":"2024-02-17T12:18:01.805591+0000","last_unstale":"2024-02-17T12:18:21.364171+0000","last_undegraded":"2024-02-17T12:18:21.364171+0000","last_fullsized":"2024-02-17T12:18:21.364171+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:52:05.403651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816249+0000","last_change":"2024-02-17T12:18:20.373389+0000","last_active":"2024-02-17T12:18:21.816249+0000","last_peered":"2024-02-17T12:18:21.816249+0000","last_clean":"2024-02-17T12:18:21.816249+0000","last_became_active":"2024-02-17T12:18:20.373079+0000","last_became_peered":"2024-02-17T12:18:20.373079+0000","last_unstale":"2024-02-17T12:18:21.816249+0000","last_undegraded":"2024-02-17T12:18:21.816249+0000","last_fullsized":"2024-02-17T12:18:21.816249+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:29:46.494031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816046+0000","last_change":"2024-02-17T12:18:19.343966+0000","last_active":"2024-02-17T12:18:21.816046+0000","last_peered":"2024-02-17T12:18:21.816046+0000","last_clean":"2024-02-17T12:18:21.816046+0000","last_became_active":"2024-02-17T12:18:19.343701+0000","last_became_peered":"2024-02-17T12:18:19.343701+0000","last_unstale":"2024-02-17T12:18:21.816046+0000","last_undegraded":"2024-02-17T12:18:21.816046+0000","last_fullsized":"2024-02-17T12:18:21.816046+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:20.606132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366379+0000","last_change":"2024-02-17T12:18:02.809740+0000","last_active":"2024-02-17T12:18:21.366379+0000","last_peered":"2024-02-17T12:18:21.366379+0000","last_clean":"2024-02-17T12:18:21.366379+0000","last_became_active":"2024-02-17T12:18:02.809407+0000","last_became_peered":"2024-02-17T12:18:02.809407+0000","last_unstale":"2024-02-17T12:18:21.366379+0000","last_undegraded":"2024-02-17T12:18:21.366379+0000","last_fullsized":"2024-02-17T12:18:21.366379+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:37:14.440914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":23,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817409+0000","last_change":"2024-02-17T12:18:01.794714+0000","last_active":"2024-02-17T12:18:21.817409+0000","last_peered":"2024-02-17T12:18:21.817409+0000","last_clean":"2024-02-17T12:18:21.817409+0000","last_became_active":"2024-02-17T12:18:01.794439+0000","last_became_peered":"2024-02-17T12:18:01.794439+0000","last_unstale":"2024-02-17T12:18:21.817409+0000","last_undegraded":"2024-02-17T12:18:21.817409+0000","last_fullsized":"2024-02-17T12:18:21.817409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:42.483871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817337+0000","last_change":"2024-02-17T12:18:20.370562+0000","last_active":"2024-02-17T12:18:21.817337+0000","last_peered":"2024-02-17T12:18:21.817337+0000","last_clean":"2024-02-17T12:18:21.817337+0000","last_became_active":"2024-02-17T12:18:20.370223+0000","last_became_peered":"2024-02-17T12:18:20.370223+0000","last_unstale":"2024-02-17T12:18:21.817337+0000","last_undegraded":"2024-02-17T12:18:21.817337+0000","last_fullsized":"2024-02-17T12:18:21.817337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:25:45.194765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366962+0000","last_change":"2024-02-17T12:18:19.353264+0000","last_active":"2024-02-17T12:18:21.366962+0000","last_peered":"2024-02-17T12:18:21.366962+0000","last_clean":"2024-02-17T12:18:21.366962+0000","last_became_active":"2024-02-17T12:18:19.352997+0000","last_became_peered":"2024-02-17T12:18:19.352997+0000","last_unstale":"2024-02-17T12:18:21.366962+0000","last_undegraded":"2024-02-17T12:18:21.366962+0000","last_fullsized":"2024-02-17T12:18:21.366962+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:44:37.585030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.363051+0000","last_change":"2024-02-17T12:18:02.794702+0000","last_active":"2024-02-17T12:18:21.363051+0000","last_peered":"2024-02-17T12:18:21.363051+0000","last_clean":"2024-02-17T12:18:21.363051+0000","last_became_active":"2024-02-17T12:18:02.794412+0000","last_became_peered":"2024-02-17T12:18:02.794412+0000","last_unstale":"2024-02-17T12:18:21.363051+0000","last_undegraded":"2024-02-17T12:18:21.363051+0000","last_fullsized":"2024-02-17T12:18:21.363051+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:05:00.914700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366721+0000","last_change":"2024-02-17T12:18:01.800872+0000","last_active":"2024-02-17T12:18:21.366721+0000","last_peered":"2024-02-17T12:18:21.366721+0000","last_clean":"2024-02-17T12:18:21.366721+0000","last_became_active":"2024-02-17T12:18:01.800563+0000","last_became_peered":"2024-02-17T12:18:01.800563+0000","last_unstale":"2024-02-17T12:18:21.366721+0000","last_undegraded":"2024-02-17T12:18:21.366721+0000","last_fullsized":"2024-02-17T12:18:21.366721+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:53:28.847804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366088+0000","last_change":"2024-02-17T12:18:20.360921+0000","last_active":"2024-02-17T12:18:21.366088+0000","last_peered":"2024-02-17T12:18:21.366088+0000","last_clean":"2024-02-17T12:18:21.366088+0000","last_became_active":"2024-02-17T12:18:20.358723+0000","last_became_peered":"2024-02-17T12:18:20.358723+0000","last_unstale":"2024-02-17T12:18:21.366088+0000","last_undegraded":"2024-02-17T12:18:21.366088+0000","last_fullsized":"2024-02-17T12:18:21.366088+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:12:04.106463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"54'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366062+0000","last_change":"2024-02-17T12:18:19.346074+0000","last_active":"2024-02-17T12:18:21.366062+0000","last_peered":"2024-02-17T12:18:21.366062+0000","last_clean":"2024-02-17T12:18:21.366062+0000","last_became_active":"2024-02-17T12:18:19.344987+0000","last_became_peered":"2024-02-17T12:18:19.344987+0000","last_unstale":"2024-02-17T12:18:21.366062+0000","last_undegraded":"2024-02-17T12:18:21.366062+0000","last_fullsized":"2024-02-17T12:18:21.366062+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:19:04.346561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.817091+0000","last_change":"2024-02-17T12:18:02.806343+0000","last_active":"2024-02-17T12:18:21.817091+0000","last_peered":"2024-02-17T12:18:21.817091+0000","last_clean":"2024-02-17T12:18:21.817091+0000","last_became_active":"2024-02-17T12:18:02.805514+0000","last_became_peered":"2024-02-17T12:18:02.805514+0000","last_unstale":"2024-02-17T12:18:21.817091+0000","last_undegraded":"2024-02-17T12:18:21.817091+0000","last_fullsized":"2024-02-17T12:18:21.817091+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:10:46.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365924+0000","last_change":"2024-02-17T12:18:01.801897+0000","last_active":"2024-02-17T12:18:21.365924+0000","last_peered":"2024-02-17T12:18:21.365924+0000","last_clean":"2024-02-17T12:18:21.365924+0000","last_became_active":"2024-02-17T12:18:01.801572+0000","last_became_peered":"2024-02-17T12:18:01.801572+0000","last_unstale":"2024-02-17T12:18:21.365924+0000","last_undegraded":"2024-02-17T12:18:21.365924+0000","last_fullsized":"2024-02-17T12:18:21.365924+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:15:10.881544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362216+0000","last_change":"2024-02-17T12:18:20.355987+0000","last_active":"2024-02-17T12:18:21.362216+0000","last_peered":"2024-02-17T12:18:21.362216+0000","last_clean":"2024-02-17T12:18:21.362216+0000","last_became_active":"2024-02-17T12:18:20.355688+0000","last_became_peered":"2024-02-17T12:18:20.355688+0000","last_unstale":"2024-02-17T12:18:21.362216+0000","last_undegraded":"2024-02-17T12:18:21.362216+0000","last_fullsized":"2024-02-17T12:18:21.362216+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:22.236700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815204+0000","last_change":"2024-02-17T12:18:19.354672+0000","last_active":"2024-02-17T12:18:21.815204+0000","last_peered":"2024-02-17T12:18:21.815204+0000","last_clean":"2024-02-17T12:18:21.815204+0000","last_became_active":"2024-02-17T12:18:19.354374+0000","last_became_peered":"2024-02-17T12:18:19.354374+0000","last_unstale":"2024-02-17T12:18:21.815204+0000","last_undegraded":"2024-02-17T12:18:21.815204+0000","last_fullsized":"2024-02-17T12:18:21.815204+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:55:34.495180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815343+0000","last_change":"2024-02-17T12:18:02.808806+0000","last_active":"2024-02-17T12:18:21.815343+0000","last_peered":"2024-02-17T12:18:21.815343+0000","last_clean":"2024-02-17T12:18:21.815343+0000","last_became_active":"2024-02-17T12:18:02.808546+0000","last_became_peered":"2024-02-17T12:18:02.808546+0000","last_unstale":"2024-02-17T12:18:21.815343+0000","last_undegraded":"2024-02-17T12:18:21.815343+0000","last_fullsized":"2024-02-17T12:18:21.815343+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:25.157077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362620+0000","last_change":"2024-02-17T12:18:01.798282+0000","last_active":"2024-02-17T12:18:21.362620+0000","last_peered":"2024-02-17T12:18:21.362620+0000","last_clean":"2024-02-17T12:18:21.362620+0000","last_became_active":"2024-02-17T12:18:01.797970+0000","last_became_peered":"2024-02-17T12:18:01.797970+0000","last_unstale":"2024-02-17T12:18:21.362620+0000","last_undegraded":"2024-02-17T12:18:21.362620+0000","last_fullsized":"2024-02-17T12:18:21.362620+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:52:16.655449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365380+0000","last_change":"2024-02-17T12:18:20.357981+0000","last_active":"2024-02-17T12:18:21.365380+0000","last_peered":"2024-02-17T12:18:21.365380+0000","last_clean":"2024-02-17T12:18:21.365380+0000","last_became_active":"2024-02-17T12:18:20.357718+0000","last_became_peered":"2024-02-17T12:18:20.357718+0000","last_unstale":"2024-02-17T12:18:21.365380+0000","last_undegraded":"2024-02-17T12:18:21.365380+0000","last_fullsized":"2024-02-17T12:18:21.365380+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:12:18.810697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.364448+0000","last_change":"2024-02-17T12:18:19.351990+0000","last_active":"2024-02-17T12:18:21.364448+0000","last_peered":"2024-02-17T12:18:21.364448+0000","last_clean":"2024-02-17T12:18:21.364448+0000","last_became_active":"2024-02-17T12:18:19.350808+0000","last_became_peered":"2024-02-17T12:18:19.350808+0000","last_unstale":"2024-02-17T12:18:21.364448+0000","last_undegraded":"2024-02-17T12:18:21.364448+0000","last_fullsized":"2024-02-17T12:18:21.364448+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:08:21.230375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815702+0000","last_change":"2024-02-17T12:18:02.808303+0000","last_active":"2024-02-17T12:18:21.815702+0000","last_peered":"2024-02-17T12:18:21.815702+0000","last_clean":"2024-02-17T12:18:21.815702+0000","last_became_active":"2024-02-17T12:18:02.807743+0000","last_became_peered":"2024-02-17T12:18:02.807743+0000","last_unstale":"2024-02-17T12:18:21.815702+0000","last_undegraded":"2024-02-17T12:18:21.815702+0000","last_fullsized":"2024-02-17T12:18:21.815702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:55.025562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.816311+0000","last_change":"2024-02-17T12:18:01.802694+0000","last_active":"2024-02-17T12:18:21.816311+0000","last_peered":"2024-02-17T12:18:21.816311+0000","last_clean":"2024-02-17T12:18:21.816311+0000","last_became_active":"2024-02-17T12:18:01.802326+0000","last_became_peered":"2024-02-17T12:18:01.802326+0000","last_unstale":"2024-02-17T12:18:21.816311+0000","last_undegraded":"2024-02-17T12:18:21.816311+0000","last_fullsized":"2024-02-17T12:18:21.816311+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:33:51.999285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815421+0000","last_change":"2024-02-17T12:18:20.372330+0000","last_active":"2024-02-17T12:18:21.815421+0000","last_peered":"2024-02-17T12:18:21.815421+0000","last_clean":"2024-02-17T12:18:21.815421+0000","last_became_active":"2024-02-17T12:18:20.370118+0000","last_became_peered":"2024-02-17T12:18:20.370118+0000","last_unstale":"2024-02-17T12:18:21.815421+0000","last_undegraded":"2024-02-17T12:18:21.815421+0000","last_fullsized":"2024-02-17T12:18:21.815421+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:19:47.189847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815120+0000","last_change":"2024-02-17T12:18:19.345851+0000","last_active":"2024-02-17T12:18:21.815120+0000","last_peered":"2024-02-17T12:18:21.815120+0000","last_clean":"2024-02-17T12:18:21.815120+0000","last_became_active":"2024-02-17T12:18:19.345580+0000","last_became_peered":"2024-02-17T12:18:19.345580+0000","last_unstale":"2024-02-17T12:18:21.815120+0000","last_undegraded":"2024-02-17T12:18:21.815120+0000","last_fullsized":"2024-02-17T12:18:21.815120+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:18:41.120435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362203+0000","last_change":"2024-02-17T12:18:02.805983+0000","last_active":"2024-02-17T12:18:21.362203+0000","last_peered":"2024-02-17T12:18:21.362203+0000","last_clean":"2024-02-17T12:18:21.362203+0000","last_became_active":"2024-02-17T12:18:02.805699+0000","last_became_peered":"2024-02-17T12:18:02.805699+0000","last_unstale":"2024-02-17T12:18:21.362203+0000","last_undegraded":"2024-02-17T12:18:21.362203+0000","last_fullsized":"2024-02-17T12:18:21.362203+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:44.576792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362334+0000","last_change":"2024-02-17T12:18:01.801438+0000","last_active":"2024-02-17T12:18:21.362334+0000","last_peered":"2024-02-17T12:18:21.362334+0000","last_clean":"2024-02-17T12:18:21.362334+0000","last_became_active":"2024-02-17T12:18:01.801221+0000","last_became_peered":"2024-02-17T12:18:01.801221+0000","last_unstale":"2024-02-17T12:18:21.362334+0000","last_undegraded":"2024-02-17T12:18:21.362334+0000","last_fullsized":"2024-02-17T12:18:21.362334+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:19:09.649370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366318+0000","last_change":"2024-02-17T12:18:20.358685+0000","last_active":"2024-02-17T12:18:21.366318+0000","last_peered":"2024-02-17T12:18:21.366318+0000","last_clean":"2024-02-17T12:18:21.366318+0000","last_became_active":"2024-02-17T12:18:20.358405+0000","last_became_peered":"2024-02-17T12:18:20.358405+0000","last_unstale":"2024-02-17T12:18:21.366318+0000","last_undegraded":"2024-02-17T12:18:21.366318+0000","last_fullsized":"2024-02-17T12:18:21.366318+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:40:49.832368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.362338+0000","last_change":"2024-02-17T12:18:19.350524+0000","last_active":"2024-02-17T12:18:21.362338+0000","last_peered":"2024-02-17T12:18:21.362338+0000","last_clean":"2024-02-17T12:18:21.362338+0000","last_became_active":"2024-02-17T12:18:19.350237+0000","last_became_peered":"2024-02-17T12:18:19.350237+0000","last_unstale":"2024-02-17T12:18:21.362338+0000","last_undegraded":"2024-02-17T12:18:21.362338+0000","last_fullsized":"2024-02-17T12:18:21.362338+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:09.209961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815629+0000","last_change":"2024-02-17T12:18:02.806745+0000","last_active":"2024-02-17T12:18:21.815629+0000","last_peered":"2024-02-17T12:18:21.815629+0000","last_clean":"2024-02-17T12:18:21.815629+0000","last_became_active":"2024-02-17T12:18:02.806429+0000","last_became_peered":"2024-02-17T12:18:02.806429+0000","last_unstale":"2024-02-17T12:18:21.815629+0000","last_undegraded":"2024-02-17T12:18:21.815629+0000","last_fullsized":"2024-02-17T12:18:21.815629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:57:58.938533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815948+0000","last_change":"2024-02-17T12:18:01.793256+0000","last_active":"2024-02-17T12:18:21.815948+0000","last_peered":"2024-02-17T12:18:21.815948+0000","last_clean":"2024-02-17T12:18:21.815948+0000","last_became_active":"2024-02-17T12:18:01.793033+0000","last_became_peered":"2024-02-17T12:18:01.793033+0000","last_unstale":"2024-02-17T12:18:21.815948+0000","last_undegraded":"2024-02-17T12:18:21.815948+0000","last_fullsized":"2024-02-17T12:18:21.815948+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:26:46.280562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815013+0000","last_change":"2024-02-17T12:18:20.361609+0000","last_active":"2024-02-17T12:18:21.815013+0000","last_peered":"2024-02-17T12:18:21.815013+0000","last_clean":"2024-02-17T12:18:21.815013+0000","last_became_active":"2024-02-17T12:18:20.361262+0000","last_became_peered":"2024-02-17T12:18:20.361262+0000","last_unstale":"2024-02-17T12:18:21.815013+0000","last_undegraded":"2024-02-17T12:18:21.815013+0000","last_fullsized":"2024-02-17T12:18:21.815013+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:19.322208+0000","last_clean_scrub_stamp":"2024-02-17T12:18:19.322208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:31.392670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.366441+0000","last_change":"2024-02-17T12:18:19.349950+0000","last_active":"2024-02-17T12:18:21.366441+0000","last_peered":"2024-02-17T12:18:21.366441+0000","last_clean":"2024-02-17T12:18:21.366441+0000","last_became_active":"2024-02-17T12:18:19.349690+0000","last_became_peered":"2024-02-17T12:18:19.349690+0000","last_unstale":"2024-02-17T12:18:21.366441+0000","last_undegraded":"2024-02-17T12:18:21.366441+0000","last_fullsized":"2024-02-17T12:18:21.366441+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:18.315883+0000","last_clean_scrub_stamp":"2024-02-17T12:18:18.315883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:48.873784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815888+0000","last_change":"2024-02-17T12:18:02.800813+0000","last_active":"2024-02-17T12:18:21.815888+0000","last_peered":"2024-02-17T12:18:21.815888+0000","last_clean":"2024-02-17T12:18:21.815888+0000","last_became_active":"2024-02-17T12:18:02.800551+0000","last_became_peered":"2024-02-17T12:18:02.800551+0000","last_unstale":"2024-02-17T12:18:21.815888+0000","last_undegraded":"2024-02-17T12:18:21.815888+0000","last_fullsized":"2024-02-17T12:18:21.815888+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:01.769487+0000","last_clean_scrub_stamp":"2024-02-17T12:18:01.769487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:47:58.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.365830+0000","last_change":"2024-02-17T12:18:01.796062+0000","last_active":"2024-02-17T12:18:21.365830+0000","last_peered":"2024-02-17T12:18:21.365830+0000","last_clean":"2024-02-17T12:18:21.365830+0000","last_became_active":"2024-02-17T12:18:01.795616+0000","last_became_peered":"2024-02-17T12:18:01.795616+0000","last_unstale":"2024-02-17T12:18:21.365830+0000","last_undegraded":"2024-02-17T12:18:21.365830+0000","last_fullsized":"2024-02-17T12:18:21.365830+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:18:00.763027+0000","last_clean_scrub_stamp":"2024-02-17T12:18:00.763027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:04:59.908240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":232,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-02-17T12:18:21.815116+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:18:21.815116+0000","last_peered":"2024-02-17T12:18:21.815116+0000","last_clean":"2024-02-17T12:18:21.815116+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:18:21.815116+0000","last_undegraded":"2024-02-17T12:18:21.815116+0000","last_fullsized":"2024-02-17T12:18:21.815116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":276832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88700000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":1.115,"15min":1.115},"last":0.87},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88500000000000001,"5min":1.143,"15min":1.143},"last":0.79600000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88700000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.84799999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.98799999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.0209999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.05},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.96799999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.077},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.085}]}]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":651264,"data_stored":277482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.69699999999999995}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.59099999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.61599999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.71599999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":276908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.44},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.621,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":1.387,"15min":1.387},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.497,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.714,"15min":1.714},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.744,"15min":1.744},"last":0.90200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91500000000000004,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.91600000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.002,"5min":1.575,"15min":1.575},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96899999999999997,"5min":1.321,"15min":1.321},"last":0.95099999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":663552,"data_stored":279058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64200000000000002,"5min":1.145,"15min":1.145},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.34000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69499999999999995,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58099999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.435},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73799999999999999,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.496}]},{"osd":3,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":2.609,"15min":2.609},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.079,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.86699999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.90700000000000003,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.997,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.05,"5min":1.095,"15min":1.095},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0469999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0820000000000001,"5min":5.375,"15min":5.375},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":1.0169999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.091,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.629,"15min":1.629},"last":0.73399999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":870805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47899999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39500000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45100000000000001,"15min":0.45700000000000002},"min":{"1min":0.312,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":1.046,"15min":1.046},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.32200000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.58699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.57099999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0129999999999999,"5min":1.139,"15min":1.139},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92800000000000005,"5min":1.038,"15min":1.038},"last":0.80300000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94499999999999995,"5min":1.095,"15min":1.095},"last":0.72799999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0960000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90200000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.67000000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1249280,"data_stored":867884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84899999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.53600000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75700000000000001,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.496},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92400000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.66100000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90000000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86799999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.442}]},{"osd":6,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95099999999999996,"5min":1.052,"15min":1.052},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55900000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542175,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":655360,"data_stored":279925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86799999999999999,"5min":1.264,"15min":1.264},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.198,"15min":1.198},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.171,"15min":1.171},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93600000000000005,"5min":1.522,"15min":1.522},"last":0.751}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89900000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.59299999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64700000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88100000000000001,"5min":1.228,"15min":1.228},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66500000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":659456,"data_stored":278408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.315},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.499}]},{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.441}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.372},{"interface":"front","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.141,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93300000000000005,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.81000000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2749999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.997,"5min":1.252,"15min":1.252},"last":0.72499999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91500000000000004,"5min":1.29,"15min":1.29},"last":0.751},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":1.337,"15min":1.337},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:18:29.371 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T12:18:29.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-02-17T12:18:29.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.541+0000 7f6f66000640 1 Processor -- start 2024-02-17T12:18:29.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.541+0000 7f6f66000640 1 -- start start 2024-02-17T12:18:29.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f66000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6f600c2580 0x7f6f600aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f66000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f600a9420 con 0x7f6f6014f110 2024-02-17T12:18:29.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f66000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f60152850 con 0x7f6f600c1eb0 2024-02-17T12:18:29.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f66000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6014f4f0 con 0x7f6f600c2580 2024-02-17T12:18:29.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5f400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6f6014f110 0x7f6f600c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60160/0 (socket says 172.21.15.114:60160) 2024-02-17T12:18:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5f400640 1 -- 172.21.15.114:0/3328843258 learned_addr learned my addr 172.21.15.114:0/3328843258 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:29.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5ea00640 1 --2- 172.21.15.114:0/3328843258 >> v2:172.21.15.116:3300/0 conn(0x7f6f600c2580 0x7f6f600aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5e000640 1 -- 172.21.15.114:0/3328843258 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204964784 0 0) 0x7f6f600a9420 con 0x7f6f6014f110 2024-02-17T12:18:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5e000640 1 -- 172.21.15.114:0/3328843258 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f44005740 con 0x7f6f6014f110 2024-02-17T12:18:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5e000640 1 -- 172.21.15.114:0/3328843258 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584659054 0 0) 0x7f6f60152850 con 0x7f6f600c1eb0 2024-02-17T12:18:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5e000640 1 -- 172.21.15.114:0/3328843258 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f600a9420 con 0x7f6f600c1eb0 2024-02-17T12:18:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5ea00640 1 -- 172.21.15.114:0/3328843258 >> v1:172.21.15.116:6789/0 conn(0x7f6f600c1eb0 legacy=0x7f6f6015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5e000640 1 -- 172.21.15.114:0/3328843258 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3894874856 0 0) 0x7f6f44005740 con 0x7f6f6014f110 2024-02-17T12:18:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5ea00640 1 -- 172.21.15.114:0/3328843258 >> v1:172.21.15.114:6789/0 conn(0x7f6f6014f110 legacy=0x7f6f600c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.545+0000 7f6f5ea00640 1 -- 172.21.15.114:0/3328843258 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f600a9670 con 0x7f6f600c2580 2024-02-17T12:18:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f5ea00640 1 --2- 172.21.15.114:0/3328843258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f600c2580 0x7f6f600aa150 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0097c0 tx=0x7f6f4c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0c8f62cd013a712 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f5e000640 1 -- 172.21.15.114:0/3328843258 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50001680 con 0x7f6f600c2580 2024-02-17T12:18:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f5e000640 1 -- 172.21.15.114:0/3328843258 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c0a7050 con 0x7f6f600c2580 2024-02-17T12:18:29.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f5e000640 1 -- 172.21.15.114:0/3328843258 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0ab620 con 0x7f6f600c2580 2024-02-17T12:18:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 -- 172.21.15.114:0/3328843258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f600c2580 msgr2=0x7f6f600aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 --2- 172.21.15.114:0/3328843258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f600c2580 0x7f6f600aa150 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0097c0 tx=0x7f6f4c01c330 comp rx=0 tx=0).stop 2024-02-17T12:18:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 -- 172.21.15.114:0/3328843258 shutdown_connections 2024-02-17T12:18:29.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 --2- 172.21.15.114:0/3328843258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f600c2580 0x7f6f600aa150 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 -- 172.21.15.114:0/3328843258 >> 172.21.15.114:0/3328843258 conn(0x7f6f600a8490 msgr2=0x7f6f600a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 -- 172.21.15.114:0/3328843258 shutdown_connections 2024-02-17T12:18:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 -- 172.21.15.114:0/3328843258 wait complete. 2024-02-17T12:18:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 Processor -- start 2024-02-17T12:18:29.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 -- start start 2024-02-17T12:18:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f600c1eb0 0x7f6f60152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f600c2580 0x7f6f60141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.549+0000 7f6f66000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f6014f110 0x7f6f601ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f66000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60142e90 con 0x7f6f600c1eb0 2024-02-17T12:18:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f66000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f601edb50 con 0x7f6f600c2580 2024-02-17T12:18:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f66000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f601ede30 con 0x7f6f6014f110 2024-02-17T12:18:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f600c1eb0 0x7f6f60152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f600c1eb0 0x7f6f60152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48358/0 (socket says 172.21.15.114:48358) 2024-02-17T12:18:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5f400640 1 -- 172.21.15.114:0/4218135028 learned_addr learned my addr 172.21.15.114:0/4218135028 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:29.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5ea00640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f600c2580 0x7f6f60141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5fe00640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f6014f110 0x7f6f601ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5f400640 1 -- 172.21.15.114:0/4218135028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f6014f110 msgr2=0x7f6f601ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5f400640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f6014f110 0x7f6f601ed0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5f400640 1 -- 172.21.15.114:0/4218135028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f600c2580 msgr2=0x7f6f60141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5f400640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f600c2580 0x7f6f60141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5f400640 1 -- 172.21.15.114:0/4218135028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c009420 con 0x7f6f600c1eb0 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5ea00640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f600c2580 0x7f6f60141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5fe00640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f6014f110 0x7f6f601ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f5f400640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f600c1eb0 0x7f6f60152db0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c700 tx=0x7f6f5000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f57400640 1 -- 172.21.15.114:0/4218135028 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50005ae0 con 0x7f6f600c1eb0 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f57400640 1 -- 172.21.15.114:0/4218135028 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50005c40 con 0x7f6f600c1eb0 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f66000640 1 -- 172.21.15.114:0/4218135028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f601430e0 con 0x7f6f600c1eb0 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f57400640 1 -- 172.21.15.114:0/4218135028 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50007070 con 0x7f6f600c1eb0 2024-02-17T12:18:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f66000640 1 -- 172.21.15.114:0/4218135028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f60145950 con 0x7f6f600c1eb0 2024-02-17T12:18:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f66000640 1 -- 172.21.15.114:0/4218135028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f60143600 con 0x7f6f600c1eb0 2024-02-17T12:18:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f57400640 1 -- 172.21.15.114:0/4218135028 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6f500071d0 con 0x7f6f600c1eb0 2024-02-17T12:18:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.553+0000 7f6f57400640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f40066e40 0x7f6f40069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.557+0000 7f6f57400640 1 -- 172.21.15.114:0/4218135028 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6f50084430 con 0x7f6f600c1eb0 2024-02-17T12:18:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.557+0000 7f6f5ea00640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f40066e40 0x7f6f40069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.557+0000 7f6f5ea00640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f40066e40 0x7f6f40069300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0ad000 tx=0x7f6f4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:29.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.561+0000 7f6f57400640 1 -- 172.21.15.114:0/4218135028 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f50050f60 con 0x7f6f600c1eb0 2024-02-17T12:18:29.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.765+0000 7f6f66000640 1 -- 172.21.15.114:0/4218135028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f6f60074840 con 0x7f6f600c1eb0 2024-02-17T12:18:29.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f57400640 1 -- 172.21.15.114:0/4218135028 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v14) v1 ==== 185+0+142 (secure 0 0 0) 0x7f6f50054620 con 0x7f6f600c1eb0 2024-02-17T12:18:29.771 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-02-17T12:18:29.771 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlffPTGhAA6uMply4Nxw6KXsGwVHriZg== 2024-02-17T12:18:29.771 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-02-17T12:18:29.771 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-02-17T12:18:29.771 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-02-17T12:18:29.772 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.1 2024-02-17T12:18:29.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 -- 172.21.15.114:0/4218135028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f40066e40 msgr2=0x7f6f40069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f40066e40 0x7f6f40069300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0ad000 tx=0x7f6f4c008040 comp rx=0 tx=0).stop 2024-02-17T12:18:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 -- 172.21.15.114:0/4218135028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f600c1eb0 msgr2=0x7f6f60152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f600c1eb0 0x7f6f60152db0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c700 tx=0x7f6f5000cbc0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 -- 172.21.15.114:0/4218135028 shutdown_connections 2024-02-17T12:18:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6f6014f110 0x7f6f601ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f600c2580 0x7f6f60141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6f40066e40 0x7f6f40069300 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 --2- 172.21.15.114:0/4218135028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f600c1eb0 0x7f6f60152db0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 -- 172.21.15.114:0/4218135028 >> 172.21.15.114:0/4218135028 conn(0x7f6f600a8490 msgr2=0x7f6f60071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 -- 172.21.15.114:0/4218135028 shutdown_connections 2024-02-17T12:18:29.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.769+0000 7f6f66000640 1 -- 172.21.15.114:0/4218135028 wait complete. 2024-02-17T12:18:29.792 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:18:29.792 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:29.801 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:18:29.801 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:29.850 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:29.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f2661800640 1 Processor -- start 2024-02-17T12:18:29.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f2661800640 1 -- start start 2024-02-17T12:18:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f2661800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f265c14f110 0x7f265c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f2661800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f265c0c2580 0x7f265c0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f2661800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f265c0c1eb0 0x7f265c155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f2661800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265c14f4f0 con 0x7f265c0c2580 2024-02-17T12:18:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f2661800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265c0aae80 con 0x7f265c0c1eb0 2024-02-17T12:18:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f2661800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0a9420 con 0x7f265c14f110 2024-02-17T12:18:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f265a000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f265c0c2580 0x7f265c0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f265a000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f265c0c2580 0x7f265c0aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48364/0 (socket says 172.21.15.114:48364) 2024-02-17T12:18:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f265a000640 1 -- 172.21.15.114:0/1322014086 learned_addr learned my addr 172.21.15.114:0/1322014086 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f265b400640 1 --2- 172.21.15.114:0/1322014086 >> v2:172.21.15.116:3300/0 conn(0x7f265c0c1eb0 0x7f265c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f265aa00640 1 --2- 172.21.15.114:0/1322014086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f265c14f110 0x7f265c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f265a000640 1 -- 172.21.15.114:0/1322014086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f265c14f110 msgr2=0x7f265c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f265a000640 1 --2- 172.21.15.114:0/1322014086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f265c14f110 0x7f265c0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f265a000640 1 -- 172.21.15.114:0/1322014086 >> v2:172.21.15.116:3300/0 conn(0x7f265c0c1eb0 msgr2=0x7f265c155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f265a000640 1 --2- 172.21.15.114:0/1322014086 >> v2:172.21.15.116:3300/0 conn(0x7f265c0c1eb0 0x7f265c155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.981+0000 7f265a000640 1 -- 172.21.15.114:0/1322014086 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c152850 con 0x7f265c0c2580 2024-02-17T12:18:29.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f265a000640 1 --2- 172.21.15.114:0/1322014086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 0x7f265c0aa150 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f265c0c1090 tx=0x7f264801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef62fb51d93b6364 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:29.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2659600640 1 -- 172.21.15.114:0/1322014086 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26480ab620 con 0x7f265c0c2580 2024-02-17T12:18:29.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2659600640 1 -- 172.21.15.114:0/1322014086 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26480ab780 con 0x7f265c0c2580 2024-02-17T12:18:29.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2659600640 1 -- 172.21.15.114:0/1322014086 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26480abb10 con 0x7f265c0c2580 2024-02-17T12:18:29.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2661800640 1 -- 172.21.15.114:0/1322014086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 msgr2=0x7f265c0aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2661800640 1 --2- 172.21.15.114:0/1322014086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 0x7f265c0aa150 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f265c0c1090 tx=0x7f264801c460 comp rx=0 tx=0).stop 2024-02-17T12:18:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2661800640 1 -- 172.21.15.114:0/1322014086 shutdown_connections 2024-02-17T12:18:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2661800640 1 --2- 172.21.15.114:0/1322014086 >> v2:172.21.15.116:3300/0 conn(0x7f265c0c1eb0 0x7f265c155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2661800640 1 --2- 172.21.15.114:0/1322014086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 0x7f265c0aa150 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2661800640 1 --2- 172.21.15.114:0/1322014086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f265c14f110 0x7f265c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2661800640 1 -- 172.21.15.114:0/1322014086 >> 172.21.15.114:0/1322014086 conn(0x7f265c0a8490 msgr2=0x7f265c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2661800640 1 -- 172.21.15.114:0/1322014086 shutdown_connections 2024-02-17T12:18:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.985+0000 7f2661800640 1 -- 172.21.15.114:0/1322014086 wait complete. 2024-02-17T12:18:29.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2661800640 1 Processor -- start 2024-02-17T12:18:29.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2661800640 1 -- start start 2024-02-17T12:18:29.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2661800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f265c0c1eb0 0x7f265c1f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2661800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 0x7f265c0c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2661800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f265c14f110 0x7f265c15a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2661800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1f16a0 con 0x7f265c0c2580 2024-02-17T12:18:29.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2661800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c144380 con 0x7f265c0c1eb0 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2661800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c143d80 con 0x7f265c14f110 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 0x7f265c0c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 0x7f265c0c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48370/0 (socket says 172.21.15.114:48370) 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265a000640 1 -- 172.21.15.114:0/1284097442 learned_addr learned my addr 172.21.15.114:0/1284097442 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265aa00640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f265c0c1eb0 0x7f265c1f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265b400640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f265c14f110 0x7f265c15a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265a000640 1 -- 172.21.15.114:0/1284097442 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f265c14f110 msgr2=0x7f265c15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265a000640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f265c14f110 0x7f265c15a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265a000640 1 -- 172.21.15.114:0/1284097442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f265c0c1eb0 msgr2=0x7f265c1f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265a000640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f265c0c1eb0 0x7f265c1f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:29.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265a000640 1 -- 172.21.15.114:0/1284097442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480094d0 con 0x7f265c0c2580 2024-02-17T12:18:29.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f265a000640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 0x7f265c0c5d90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f264801ab10 tx=0x7f264801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:29.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2652a00640 1 -- 172.21.15.114:0/1284097442 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26480be3f0 con 0x7f265c0c2580 2024-02-17T12:18:29.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2652a00640 1 -- 172.21.15.114:0/1284097442 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26480be550 con 0x7f265c0c2580 2024-02-17T12:18:29.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2661800640 1 -- 172.21.15.114:0/1284097442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c144060 con 0x7f265c0c2580 2024-02-17T12:18:29.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2652a00640 1 -- 172.21.15.114:0/1284097442 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26480be900 con 0x7f265c0c2580 2024-02-17T12:18:29.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.989+0000 7f2661800640 1 -- 172.21.15.114:0/1284097442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c1f1330 con 0x7f265c0c2580 2024-02-17T12:18:29.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.993+0000 7f2661800640 1 -- 172.21.15.114:0/1284097442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265c1f1850 con 0x7f265c0c2580 2024-02-17T12:18:29.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.993+0000 7f2652a00640 1 -- 172.21.15.114:0/1284097442 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f26480c7440 con 0x7f265c0c2580 2024-02-17T12:18:29.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.993+0000 7f2652a00640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f263c066e40 0x7f263c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:29.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.993+0000 7f2652a00640 1 -- 172.21.15.114:0/1284097442 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f264811f600 con 0x7f265c0c2580 2024-02-17T12:18:29.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.993+0000 7f265aa00640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f263c066e40 0x7f263c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:29.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.993+0000 7f265aa00640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f263c066e40 0x7f263c069300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f264c003b90 tx=0x7f264c0098d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:30.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:29.997+0000 7f2652a00640 1 -- 172.21.15.114:0/1284097442 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f265c1f1850 con 0x7f265c0c2580 2024-02-17T12:18:30.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.153+0000 7f2661800640 1 -- 172.21.15.114:0/1284097442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f265c1f1850 con 0x7f265c0c2580 2024-02-17T12:18:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.153+0000 7f2652a00640 1 -- 172.21.15.114:0/1284097442 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20458 (secure 0 0 0) 0x7f265c1f1850 con 0x7f265c0c2580 2024-02-17T12:18:30.158 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:30.159 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:21.358057+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 -- 172.21.15.114:0/1284097442 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f263c066e40 msgr2=0x7f263c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f263c066e40 0x7f263c069300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f264c003b90 tx=0x7f264c0098d0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 -- 172.21.15.114:0/1284097442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 msgr2=0x7f265c0c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 0x7f265c0c5d90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f264801ab10 tx=0x7f264801aca0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 -- 172.21.15.114:0/1284097442 shutdown_connections 2024-02-17T12:18:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f265c14f110 0x7f265c15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f263c066e40 0x7f263c069300 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f265c0c2580 0x7f265c0c5d90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 --2- 172.21.15.114:0/1284097442 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f265c0c1eb0 0x7f265c1f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 -- 172.21.15.114:0/1284097442 >> 172.21.15.114:0/1284097442 conn(0x7f265c0a8490 msgr2=0x7f265c06dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 -- 172.21.15.114:0/1284097442 shutdown_connections 2024-02-17T12:18:30.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.157+0000 7f2661800640 1 -- 172.21.15.114:0/1284097442 wait complete. 2024-02-17T12:18:30.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:17:59.900395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:18:01.152214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:18:17.610636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:18:18.703971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:18:30.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:18:30.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f1942000640 1 Processor -- start 2024-02-17T12:18:30.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f1942000640 1 -- start start 2024-02-17T12:18:30.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f1942000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 0x7f193c06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f1942000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f193c0c6460 0x7f193c158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f1942000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c155dd0 con 0x7f193c154e30 2024-02-17T12:18:30.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f1942000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c1588c0 con 0x7f193c0c6460 2024-02-17T12:18:30.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f1942000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c155810 con 0x7f193c152540 2024-02-17T12:18:30.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f193aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f193c0c6460 0x7f193c158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f193be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f193c154e30 0x7f193c0aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60162/0 (socket says 172.21.15.114:60162) 2024-02-17T12:18:30.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f193be00640 1 -- 172.21.15.114:0/1033253066 learned_addr learned my addr 172.21.15.114:0/1033253066 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:30.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f193aa00640 1 -- 172.21.15.114:0/1033253066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 msgr2=0x7f193c06ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:30.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f193b400640 1 --2- 172.21.15.114:0/1033253066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 0x7f193c06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f193aa00640 1 --2- 172.21.15.114:0/1033253066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 0x7f193c06ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f193aa00640 1 -- 172.21.15.114:0/1033253066 >> v1:172.21.15.114:6789/0 conn(0x7f193c154e30 legacy=0x7f193c0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f193a000640 1 -- 172.21.15.114:0/1033253066 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430721094 0 0) 0x7f193c155dd0 con 0x7f193c154e30 2024-02-17T12:18:30.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f193aa00640 1 -- 172.21.15.114:0/1033253066 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c155af0 con 0x7f193c0c6460 2024-02-17T12:18:30.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.317+0000 7f193b400640 1 --2- 172.21.15.114:0/1033253066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 0x7f193c06ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:30.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f193aa00640 1 --2- 172.21.15.114:0/1033253066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 0x7f193c158d50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f19280097c0 tx=0x7f192801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c214daabc5f04fa4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:30.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f193a000640 1 -- 172.21.15.114:0/1033253066 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19280ab600 con 0x7f193c0c6460 2024-02-17T12:18:30.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f193a000640 1 -- 172.21.15.114:0/1033253066 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19280a7050 con 0x7f193c0c6460 2024-02-17T12:18:30.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f193a000640 1 -- 172.21.15.114:0/1033253066 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19280ab980 con 0x7f193c0c6460 2024-02-17T12:18:30.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f1942000640 1 -- 172.21.15.114:0/1033253066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 msgr2=0x7f193c158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f1942000640 1 --2- 172.21.15.114:0/1033253066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 0x7f193c158d50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f19280097c0 tx=0x7f192801c380 comp rx=0 tx=0).stop 2024-02-17T12:18:30.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f1942000640 1 -- 172.21.15.114:0/1033253066 shutdown_connections 2024-02-17T12:18:30.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f1942000640 1 --2- 172.21.15.114:0/1033253066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 0x7f193c158d50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f1942000640 1 --2- 172.21.15.114:0/1033253066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 0x7f193c06ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f1942000640 1 -- 172.21.15.114:0/1033253066 >> 172.21.15.114:0/1033253066 conn(0x7f193c0c4f20 msgr2=0x7f193c0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:30.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f1942000640 1 -- 172.21.15.114:0/1033253066 shutdown_connections 2024-02-17T12:18:30.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f1942000640 1 -- 172.21.15.114:0/1033253066 wait complete. 2024-02-17T12:18:30.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.321+0000 7f1942000640 1 Processor -- start 2024-02-17T12:18:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1942000640 1 -- start start 2024-02-17T12:18:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1942000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 0x7f193c14a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1942000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 0x7f193c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1942000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f193c154e30 0x7f193c06bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1942000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c157570 con 0x7f193c0c6460 2024-02-17T12:18:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1942000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c1407e0 con 0x7f193c154e30 2024-02-17T12:18:30.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1942000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c158200 con 0x7f193c152540 2024-02-17T12:18:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 0x7f193c14a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 0x7f193c14a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48396/0 (socket says 172.21.15.114:48396) 2024-02-17T12:18:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193b400640 1 -- 172.21.15.114:0/3565130832 learned_addr learned my addr 172.21.15.114:0/3565130832 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193be00640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f193c154e30 0x7f193c06bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193aa00640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 0x7f193c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193b400640 1 -- 172.21.15.114:0/3565130832 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 msgr2=0x7f193c06d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193b400640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 0x7f193c06d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193b400640 1 -- 172.21.15.114:0/3565130832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f193c154e30 msgr2=0x7f193c06bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193b400640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f193c154e30 0x7f193c06bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193b400640 1 -- 172.21.15.114:0/3565130832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1928009420 con 0x7f193c0c6460 2024-02-17T12:18:30.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193be00640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f193c154e30 0x7f193c06bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193aa00640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 0x7f193c06d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f193b400640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 0x7f193c14a1d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f192c00cf60 tx=0x7f192c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1933400640 1 -- 172.21.15.114:0/3565130832 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c00d840 con 0x7f193c0c6460 2024-02-17T12:18:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1933400640 1 -- 172.21.15.114:0/3565130832 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c00d9a0 con 0x7f193c0c6460 2024-02-17T12:18:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1933400640 1 -- 172.21.15.114:0/3565130832 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c00dd30 con 0x7f193c0c6460 2024-02-17T12:18:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1942000640 1 -- 172.21.15.114:0/3565130832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c1ee400 con 0x7f193c0c6460 2024-02-17T12:18:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1942000640 1 -- 172.21.15.114:0/3565130832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c1ee120 con 0x7f193c0c6460 2024-02-17T12:18:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.325+0000 7f1942000640 1 -- 172.21.15.114:0/3565130832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c157ae0 con 0x7f193c0c6460 2024-02-17T12:18:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.329+0000 7f1933400640 1 -- 172.21.15.114:0/3565130832 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f192c015440 con 0x7f193c0c6460 2024-02-17T12:18:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.329+0000 7f1933400640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f191c066e70 0x7f191c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.329+0000 7f1933400640 1 -- 172.21.15.114:0/3565130832 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f192c085750 con 0x7f193c0c6460 2024-02-17T12:18:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.329+0000 7f193aa00640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f191c066e70 0x7f191c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.329+0000 7f193aa00640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f191c066e70 0x7f191c069330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f19280ad000 tx=0x7f1928008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.333+0000 7f1933400640 1 -- 172.21.15.114:0/3565130832 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f193c157ae0 con 0x7f193c0c6460 2024-02-17T12:18:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.485+0000 7f1942000640 1 -- 172.21.15.114:0/3565130832 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f193c157ae0 con 0x7f193c0c6460 2024-02-17T12:18:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1933400640 1 -- 172.21.15.114:0/3565130832 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f192c01a020 con 0x7f193c0c6460 2024-02-17T12:18:30.491 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:18:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 -- 172.21.15.114:0/3565130832 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f191c066e70 msgr2=0x7f191c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f191c066e70 0x7f191c069330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f19280ad000 tx=0x7f1928008040 comp rx=0 tx=0).stop 2024-02-17T12:18:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 -- 172.21.15.114:0/3565130832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 msgr2=0x7f193c14a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 0x7f193c14a1d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f192c00cf60 tx=0x7f192c00cf90 comp rx=0 tx=0).stop 2024-02-17T12:18:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 -- 172.21.15.114:0/3565130832 shutdown_connections 2024-02-17T12:18:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f193c154e30 0x7f193c06bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f193c152540 0x7f193c06d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f191c066e70 0x7f191c069330 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 --2- 172.21.15.114:0/3565130832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f193c0c6460 0x7f193c14a1d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 -- 172.21.15.114:0/3565130832 >> 172.21.15.114:0/3565130832 conn(0x7f193c0c4f20 msgr2=0x7f193c153510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:30.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 -- 172.21.15.114:0/3565130832 shutdown_connections 2024-02-17T12:18:30.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.489+0000 7f1942000640 1 -- 172.21.15.114:0/3565130832 wait complete. 2024-02-17T12:18:30.511 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:18:30.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.645+0000 7f9233000640 1 Processor -- start 2024-02-17T12:18:30.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.645+0000 7f9233000640 1 -- start start 2024-02-17T12:18:30.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9233000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f922c06ae70 0x7f922c152390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9233000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f922c0c20e0 0x7f922c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9233000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922c0c0d00 con 0x7f922c14f150 2024-02-17T12:18:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9233000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c0c1880 con 0x7f922c06ae70 2024-02-17T12:18:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9233000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c0c0f50 con 0x7f922c0c20e0 2024-02-17T12:18:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9231c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f922c06ae70 0x7f922c152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9231c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f922c06ae70 0x7f922c152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48402/0 (socket says 172.21.15.114:48402) 2024-02-17T12:18:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9231c00640 1 -- 172.21.15.114:0/32040195 learned_addr learned my addr 172.21.15.114:0/32040195 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9231200640 1 --2- 172.21.15.114:0/32040195 >> v2:172.21.15.116:3300/0 conn(0x7f922c0c20e0 0x7f922c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9231c00640 1 -- 172.21.15.114:0/32040195 >> v2:172.21.15.116:3300/0 conn(0x7f922c0c20e0 msgr2=0x7f922c14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9231c00640 1 --2- 172.21.15.114:0/32040195 >> v2:172.21.15.116:3300/0 conn(0x7f922c0c20e0 0x7f922c14ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9231c00640 1 -- 172.21.15.114:0/32040195 >> v1:172.21.15.116:6789/0 conn(0x7f922c14f150 legacy=0x7f922c152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9231c00640 1 -- 172.21.15.114:0/32040195 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c0c1230 con 0x7f922c06ae70 2024-02-17T12:18:30.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.649+0000 7f9231c00640 1 --2- 172.21.15.114:0/32040195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c06ae70 0x7f922c152390 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f922c0c2ba0 tx=0x7f922001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71905fa7b4e5709 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f922be00640 1 -- 172.21.15.114:0/32040195 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92200a5780 con 0x7f922c06ae70 2024-02-17T12:18:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f922be00640 1 -- 172.21.15.114:0/32040195 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92200a58e0 con 0x7f922c06ae70 2024-02-17T12:18:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f922be00640 1 -- 172.21.15.114:0/32040195 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92200a5c70 con 0x7f922c06ae70 2024-02-17T12:18:30.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 -- 172.21.15.114:0/32040195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c06ae70 msgr2=0x7f922c152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 --2- 172.21.15.114:0/32040195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c06ae70 0x7f922c152390 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f922c0c2ba0 tx=0x7f922001c8a0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 -- 172.21.15.114:0/32040195 shutdown_connections 2024-02-17T12:18:30.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 --2- 172.21.15.114:0/32040195 >> v2:172.21.15.116:3300/0 conn(0x7f922c0c20e0 0x7f922c14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 --2- 172.21.15.114:0/32040195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c06ae70 0x7f922c152390 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 -- 172.21.15.114:0/32040195 >> 172.21.15.114:0/32040195 conn(0x7f922c0c6300 msgr2=0x7f922c0c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:30.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 -- 172.21.15.114:0/32040195 shutdown_connections 2024-02-17T12:18:30.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 -- 172.21.15.114:0/32040195 wait complete. 2024-02-17T12:18:30.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 Processor -- start 2024-02-17T12:18:30.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 -- start start 2024-02-17T12:18:30.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c06ae70 0x7f922c0ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f922c0c20e0 0x7f922c13ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c14f150 0x7f922c15e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c1ede70 con 0x7f922c14f150 2024-02-17T12:18:30.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0aa540 con 0x7f922c06ae70 2024-02-17T12:18:30.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9233000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c1ed230 con 0x7f922c0c20e0 2024-02-17T12:18:30.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9232600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c14f150 0x7f922c15e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9232600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c14f150 0x7f922c15e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48410/0 (socket says 172.21.15.114:48410) 2024-02-17T12:18:30.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9232600640 1 -- 172.21.15.114:0/2336763037 learned_addr learned my addr 172.21.15.114:0/2336763037 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:30.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9231c00640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c06ae70 0x7f922c0ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9231200640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f922c0c20e0 0x7f922c13ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9232600640 1 -- 172.21.15.114:0/2336763037 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f922c0c20e0 msgr2=0x7f922c13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9232600640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f922c0c20e0 0x7f922c13ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9232600640 1 -- 172.21.15.114:0/2336763037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c06ae70 msgr2=0x7f922c0ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9232600640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c06ae70 0x7f922c0ac080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.653+0000 7f9232600640 1 -- 172.21.15.114:0/2336763037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220009b30 con 0x7f922c14f150 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9232600640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c14f150 0x7f922c15e1d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f922400c430 tx=0x7f922400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9229600640 1 -- 172.21.15.114:0/2336763037 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224005220 con 0x7f922c14f150 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9229600640 1 -- 172.21.15.114:0/2336763037 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9224005380 con 0x7f922c14f150 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9229600640 1 -- 172.21.15.114:0/2336763037 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224007270 con 0x7f922c14f150 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9233000640 1 -- 172.21.15.114:0/2336763037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c1ed4d0 con 0x7f922c14f150 2024-02-17T12:18:30.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9233000640 1 -- 172.21.15.114:0/2336763037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c1eda90 con 0x7f922c14f150 2024-02-17T12:18:30.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9233000640 1 -- 172.21.15.114:0/2336763037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c1edfb0 con 0x7f922c14f150 2024-02-17T12:18:30.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9229600640 1 -- 172.21.15.114:0/2336763037 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f92240073d0 con 0x7f922c14f150 2024-02-17T12:18:30.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9229600640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f920c066e40 0x7f920c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9229600640 1 -- 172.21.15.114:0/2336763037 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9224084220 con 0x7f922c14f150 2024-02-17T12:18:30.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.657+0000 7f9231c00640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f920c066e40 0x7f920c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.661+0000 7f9231c00640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f920c066e40 0x7f920c069300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f92200ae000 tx=0x7f92200a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:30.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.661+0000 7f9229600640 1 -- 172.21.15.114:0/2336763037 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f922c1edfb0 con 0x7f922c14f150 2024-02-17T12:18:30.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.813+0000 7f9233000640 1 -- 172.21.15.114:0/2336763037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f922c1edfb0 con 0x7f922c14f150 2024-02-17T12:18:30.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.813+0000 7f9229600640 1 -- 172.21.15.114:0/2336763037 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f922c1edfb0 con 0x7f922c14f150 2024-02-17T12:18:30.819 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:18:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 -- 172.21.15.114:0/2336763037 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f920c066e40 msgr2=0x7f920c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f920c066e40 0x7f920c069300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f92200ae000 tx=0x7f92200a7070 comp rx=0 tx=0).stop 2024-02-17T12:18:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 -- 172.21.15.114:0/2336763037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c14f150 msgr2=0x7f922c15e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c14f150 0x7f922c15e1d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f922400c430 tx=0x7f922400c8f0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 -- 172.21.15.114:0/2336763037 shutdown_connections 2024-02-17T12:18:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f920c066e40 0x7f920c069300 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f922c14f150 0x7f922c15e1d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f922c0c20e0 0x7f922c13ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 --2- 172.21.15.114:0/2336763037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c06ae70 0x7f922c0ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 -- 172.21.15.114:0/2336763037 >> 172.21.15.114:0/2336763037 conn(0x7f922c0c6300 msgr2=0x7f922c14e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 -- 172.21.15.114:0/2336763037 shutdown_connections 2024-02-17T12:18:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.817+0000 7f9233000640 1 -- 172.21.15.114:0/2336763037 wait complete. 2024-02-17T12:18:30.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:18:30.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.973+0000 7f746c600640 1 Processor -- start 2024-02-17T12:18:30.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.973+0000 7f746c600640 1 -- start start 2024-02-17T12:18:30.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.973+0000 7f746c600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f74640c25a0 0x7f746406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.973+0000 7f746c600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152c50 0x7f74641530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f746c600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7464156270 con 0x7f746406db50 2024-02-17T12:18:30.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f746c600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7464071630 con 0x7f74640c25a0 2024-02-17T12:18:30.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f746c600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7464156550 con 0x7f7464152c50 2024-02-17T12:18:30.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7469200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f746406db50 0x7f746414ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60176/0 (socket says 172.21.15.114:60176) 2024-02-17T12:18:30.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7469200640 1 -- 172.21.15.114:0/1772208483 learned_addr learned my addr 172.21.15.114:0/1772208483 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7469c00640 1 --2- 172.21.15.114:0/1772208483 >> v2:172.21.15.116:3300/0 conn(0x7f74640c25a0 0x7f746406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555088240 0 0) 0x7f7464156270 con 0x7f746406db50 2024-02-17T12:18:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f746a600640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152c50 0x7f74641530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f744c003530 con 0x7f746406db50 2024-02-17T12:18:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1939541864 0 0) 0x7f744c003530 con 0x7f746406db50 2024-02-17T12:18:30.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152c50 msgr2=0x7f74641530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152c50 0x7f74641530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 >> v2:172.21.15.116:3300/0 conn(0x7f74640c25a0 msgr2=0x7f746406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 --2- 172.21.15.114:0/1772208483 >> v2:172.21.15.116:3300/0 conn(0x7f74640c25a0 0x7f746406e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464156830 con 0x7f746406db50 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f74500016a0 con 0x7f746406db50 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 >> v1:172.21.15.114:6789/0 conn(0x7f746406db50 legacy=0x7f746414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f744c003980 0x7f744c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152c50 0x7f744c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f744c004d10 0x7f744c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7464156550 con 0x7f744c004d10 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c00b9e0 con 0x7f744c003980 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c00bba0 con 0x7f7464152c50 2024-02-17T12:18:30.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f746a600640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f744c004d10 0x7f744c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7469c00640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f744c003980 0x7f744c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7469200640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152c50 0x7f744c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f746a600640 1 -- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152c50 msgr2=0x7f744c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:30.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f746a600640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152c50 0x7f744c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f746a600640 1 -- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f744c003980 msgr2=0x7f744c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:30.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f746a600640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f744c003980 0x7f744c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f746a600640 1 -- 172.21.15.114:0/1772208483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c003530 con 0x7f744c004d10 2024-02-17T12:18:30.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.977+0000 7f7469200640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152c50 0x7f744c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:30.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f746a600640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f744c004d10 0x7f744c005190 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f745c009fc0 tx=0x7f745c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5da5277496aa4b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:30.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0a5b60 con 0x7f744c004d10 2024-02-17T12:18:30.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c00f040 con 0x7f744c004d10 2024-02-17T12:18:30.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f7463e00640 1 -- 172.21.15.114:0/1772208483 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0ad440 con 0x7f744c004d10 2024-02-17T12:18:30.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f746c600640 1 -- 172.21.15.114:0/1772208483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f744c004d10 msgr2=0x7f744c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f746c600640 1 --2- 172.21.15.114:0/1772208483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f744c004d10 0x7f744c005190 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f745c009fc0 tx=0x7f745c01cc50 comp rx=0 tx=0).stop 2024-02-17T12:18:30.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f746a600640 1 -- 172.21.15.114:0/1772208483 reap_dead start 2024-02-17T12:18:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f746c600640 1 -- 172.21.15.114:0/1772208483 shutdown_connections 2024-02-17T12:18:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f746c600640 1 -- 172.21.15.114:0/1772208483 >> 172.21.15.114:0/1772208483 conn(0x7f74640a8490 msgr2=0x7f74640a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f746c600640 1 -- 172.21.15.114:0/1772208483 shutdown_connections 2024-02-17T12:18:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f746c600640 1 -- 172.21.15.114:0/1772208483 wait complete. 2024-02-17T12:18:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f746c600640 1 Processor -- start 2024-02-17T12:18:30.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.981+0000 7f746c600640 1 -- start start 2024-02-17T12:18:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f746c600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f744c004d10 0x7f74641eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f746c600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746413d470 0x7f7464141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f746c600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152070 0x7f7464152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f746c600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74641ef340 con 0x7f746413d470 2024-02-17T12:18:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f746c600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746413cf90 con 0x7f744c004d10 2024-02-17T12:18:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f746c600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746413eea0 con 0x7f7464152070 2024-02-17T12:18:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7469200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746413d470 0x7f7464141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7469200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746413d470 0x7f7464141640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48426/0 (socket says 172.21.15.114:48426) 2024-02-17T12:18:30.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7469200640 1 -- 172.21.15.114:0/2754739251 learned_addr learned my addr 172.21.15.114:0/2754739251 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7469c00640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f744c004d10 0x7f74641eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f746a600640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152070 0x7f7464152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7469200640 1 -- 172.21.15.114:0/2754739251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152070 msgr2=0x7f7464152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7469200640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152070 0x7f7464152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7469200640 1 -- 172.21.15.114:0/2754739251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f744c004d10 msgr2=0x7f74641eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7469200640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f744c004d10 0x7f74641eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7469200640 1 -- 172.21.15.114:0/2754739251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464152a60 con 0x7f746413d470 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7469200640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746413d470 0x7f7464141640 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7450001130 tx=0x7f745000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7461600640 1 -- 172.21.15.114:0/2754739251 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745000ee10 con 0x7f746413d470 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7461600640 1 -- 172.21.15.114:0/2754739251 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745000c840 con 0x7f746413d470 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7461600640 1 -- 172.21.15.114:0/2754739251 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745000cbd0 con 0x7f746413d470 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f746c600640 1 -- 172.21.15.114:0/2754739251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7464144820 con 0x7f746413d470 2024-02-17T12:18:30.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f746c600640 1 -- 172.21.15.114:0/2754739251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746413cc20 con 0x7f746413d470 2024-02-17T12:18:30.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f746c600640 1 -- 172.21.15.114:0/2754739251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746413cde0 con 0x7f746413d470 2024-02-17T12:18:30.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.985+0000 7f7461600640 1 -- 172.21.15.114:0/2754739251 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f745000cd30 con 0x7f746413d470 2024-02-17T12:18:30.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.989+0000 7f7461600640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7444066e70 0x7f7444069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:30.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.989+0000 7f7461600640 1 -- 172.21.15.114:0/2754739251 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7450084b30 con 0x7f746413d470 2024-02-17T12:18:30.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.989+0000 7f7469c00640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7444066e70 0x7f7444069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:30.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.989+0000 7f7469c00640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7444066e70 0x7f7444069330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f746413f940 tx=0x7f7458009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:30.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:30.993+0000 7f7461600640 1 -- 172.21.15.114:0/2754739251 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7450051630 con 0x7f746413d470 2024-02-17T12:18:31.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 -- 172.21.15.114:0/2754739251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f746413ca80 con 0x7f746413d470 2024-02-17T12:18:31.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f7461600640 1 -- 172.21.15.114:0/2754739251 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f746413ca80 con 0x7f746413d470 2024-02-17T12:18:31.148 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:18:31.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 -- 172.21.15.114:0/2754739251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7444066e70 msgr2=0x7f7444069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7444066e70 0x7f7444069330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f746413f940 tx=0x7f7458009190 comp rx=0 tx=0).stop 2024-02-17T12:18:31.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 -- 172.21.15.114:0/2754739251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746413d470 msgr2=0x7f7464141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746413d470 0x7f7464141640 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7450001130 tx=0x7f745000ebc0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 -- 172.21.15.114:0/2754739251 shutdown_connections 2024-02-17T12:18:31.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7464152070 0x7f7464152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7444066e70 0x7f7444069330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f746413d470 0x7f7464141640 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 --2- 172.21.15.114:0/2754739251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f744c004d10 0x7f74641eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 -- 172.21.15.114:0/2754739251 >> 172.21.15.114:0/2754739251 conn(0x7f74640a8490 msgr2=0x7f74640721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:31.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 -- 172.21.15.114:0/2754739251 shutdown_connections 2024-02-17T12:18:31.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.145+0000 7f746c600640 1 -- 172.21.15.114:0/2754739251 wait complete. 2024-02-17T12:18:31.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:18:31.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b7800640 1 Processor -- start 2024-02-17T12:18:31.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b7800640 1 -- start start 2024-02-17T12:18:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b7800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f00b0152540 0x7f00b006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b7800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 0x7f00b00aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b7800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b0155dd0 con 0x7f00b00c6460 2024-02-17T12:18:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b7800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b01588c0 con 0x7f00b0152540 2024-02-17T12:18:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b7800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0155810 con 0x7f00b0154e30 2024-02-17T12:18:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00afe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f00b00c6460 0x7f00b0158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60190/0 (socket says 172.21.15.114:60190) 2024-02-17T12:18:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00afe00640 1 -- 172.21.15.114:0/1351104976 learned_addr learned my addr 172.21.15.114:0/1351104976 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b5800640 1 --2- 172.21.15.114:0/1351104976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 0x7f00b00aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b4e00640 1 --2- 172.21.15.114:0/1351104976 >> v2:172.21.15.116:3300/0 conn(0x7f00b0152540 0x7f00b006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00af400640 1 -- 172.21.15.114:0/1351104976 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150712914 0 0) 0x7f00b0155dd0 con 0x7f00b00c6460 2024-02-17T12:18:31.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00af400640 1 -- 172.21.15.114:0/1351104976 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0098003530 con 0x7f00b00c6460 2024-02-17T12:18:31.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b5800640 1 -- 172.21.15.114:0/1351104976 >> v2:172.21.15.116:3300/0 conn(0x7f00b0152540 msgr2=0x7f00b006ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:31.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b5800640 1 --2- 172.21.15.114:0/1351104976 >> v2:172.21.15.116:3300/0 conn(0x7f00b0152540 0x7f00b006ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b5800640 1 -- 172.21.15.114:0/1351104976 >> v1:172.21.15.114:6789/0 conn(0x7f00b00c6460 legacy=0x7f00b0158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.305+0000 7f00b5800640 1 -- 172.21.15.114:0/1351104976 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0155af0 con 0x7f00b0154e30 2024-02-17T12:18:31.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00b5800640 1 --2- 172.21.15.114:0/1351104976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 0x7f00b00aa160 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009d90 tx=0x7f00a801c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e96e30fc5cef2011 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:31.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00af400640 1 -- 172.21.15.114:0/1351104976 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80a5820 con 0x7f00b0154e30 2024-02-17T12:18:31.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00af400640 1 -- 172.21.15.114:0/1351104976 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a80a5980 con 0x7f00b0154e30 2024-02-17T12:18:31.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00af400640 1 -- 172.21.15.114:0/1351104976 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80a5d10 con 0x7f00b0154e30 2024-02-17T12:18:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00b7800640 1 -- 172.21.15.114:0/1351104976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 msgr2=0x7f00b00aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00b7800640 1 --2- 172.21.15.114:0/1351104976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 0x7f00b00aa160 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009d90 tx=0x7f00a801c850 comp rx=0 tx=0).stop 2024-02-17T12:18:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00b7800640 1 -- 172.21.15.114:0/1351104976 shutdown_connections 2024-02-17T12:18:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00b7800640 1 --2- 172.21.15.114:0/1351104976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 0x7f00b00aa160 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00b7800640 1 --2- 172.21.15.114:0/1351104976 >> v2:172.21.15.116:3300/0 conn(0x7f00b0152540 0x7f00b006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00b7800640 1 -- 172.21.15.114:0/1351104976 >> 172.21.15.114:0/1351104976 conn(0x7f00b00c4f20 msgr2=0x7f00b00c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:31.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00b7800640 1 -- 172.21.15.114:0/1351104976 shutdown_connections 2024-02-17T12:18:31.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.309+0000 7f00b7800640 1 -- 172.21.15.114:0/1351104976 wait complete. 2024-02-17T12:18:31.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b7800640 1 Processor -- start 2024-02-17T12:18:31.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b7800640 1 -- start start 2024-02-17T12:18:31.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b7800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b00c6460 0x7f00b01ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b7800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0152540 0x7f00b0146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b7800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 0x7f00b0149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b7800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b014c770 con 0x7f00b00c6460 2024-02-17T12:18:31.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b7800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01f1300 con 0x7f00b0152540 2024-02-17T12:18:31.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b7800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01f1020 con 0x7f00b0154e30 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b00c6460 0x7f00b01ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b00c6460 0x7f00b01ee6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48430/0 (socket says 172.21.15.114:48430) 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b4e00640 1 -- 172.21.15.114:0/2954320757 learned_addr learned my addr 172.21.15.114:0/2954320757 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b5800640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 0x7f00b0149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00afe00640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0152540 0x7f00b0146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b4e00640 1 -- 172.21.15.114:0/2954320757 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 msgr2=0x7f00b0149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b4e00640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 0x7f00b0149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b4e00640 1 -- 172.21.15.114:0/2954320757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0152540 msgr2=0x7f00b0146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b4e00640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0152540 0x7f00b0146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b4e00640 1 -- 172.21.15.114:0/2954320757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a8009a70 con 0x7f00b00c6460 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b4e00640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b00c6460 0x7f00b01ee6a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e930 tx=0x7f00a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00acc00640 1 -- 172.21.15.114:0/2954320757 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4009690 con 0x7f00b00c6460 2024-02-17T12:18:31.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00acc00640 1 -- 172.21.15.114:0/2954320757 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a400ca00 con 0x7f00b00c6460 2024-02-17T12:18:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b7800640 1 -- 172.21.15.114:0/2954320757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b01edbc0 con 0x7f00b00c6460 2024-02-17T12:18:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00acc00640 1 -- 172.21.15.114:0/2954320757 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a400cd70 con 0x7f00b00c6460 2024-02-17T12:18:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.313+0000 7f00b7800640 1 -- 172.21.15.114:0/2954320757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b01ee180 con 0x7f00b00c6460 2024-02-17T12:18:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.317+0000 7f00b7800640 1 -- 172.21.15.114:0/2954320757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b0074840 con 0x7f00b00c6460 2024-02-17T12:18:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.317+0000 7f00acc00640 1 -- 172.21.15.114:0/2954320757 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f00a4013470 con 0x7f00b00c6460 2024-02-17T12:18:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.317+0000 7f00acc00640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0090066e40 0x7f0090069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.317+0000 7f00acc00640 1 -- 172.21.15.114:0/2954320757 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f00a40853d0 con 0x7f00b00c6460 2024-02-17T12:18:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.317+0000 7f00afe00640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0090066e40 0x7f0090069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.317+0000 7f00afe00640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0090066e40 0x7f0090069300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f00b01f20e0 tx=0x7f009c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.321+0000 7f00acc00640 1 -- 172.21.15.114:0/2954320757 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f00a4051f30 con 0x7f00b00c6460 2024-02-17T12:18:31.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.473+0000 7f00b7800640 1 -- 172.21.15.114:0/2954320757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00b00aa240 con 0x7f00b00c6460 2024-02-17T12:18:31.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.473+0000 7f00acc00640 1 -- 172.21.15.114:0/2954320757 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f00a40555f0 con 0x7f00b00c6460 2024-02-17T12:18:31.478 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:18:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 -- 172.21.15.114:0/2954320757 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0090066e40 msgr2=0x7f0090069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0090066e40 0x7f0090069300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f00b01f20e0 tx=0x7f009c009040 comp rx=0 tx=0).stop 2024-02-17T12:18:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 -- 172.21.15.114:0/2954320757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b00c6460 msgr2=0x7f00b01ee6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b00c6460 0x7f00b01ee6a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e930 tx=0x7f00a400edf0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 -- 172.21.15.114:0/2954320757 shutdown_connections 2024-02-17T12:18:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00b0154e30 0x7f00b0149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0152540 0x7f00b0146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0090066e40 0x7f0090069300 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 --2- 172.21.15.114:0/2954320757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00b00c6460 0x7f00b01ee6a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 -- 172.21.15.114:0/2954320757 >> 172.21.15.114:0/2954320757 conn(0x7f00b00c4f20 msgr2=0x7f00b0153db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 -- 172.21.15.114:0/2954320757 shutdown_connections 2024-02-17T12:18:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.477+0000 7f00b7800640 1 -- 172.21.15.114:0/2954320757 wait complete. 2024-02-17T12:18:31.499 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:18:31.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9edc00640 1 Processor -- start 2024-02-17T12:18:31.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9edc00640 1 -- start start 2024-02-17T12:18:31.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9edc00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb9e80c25a0 0x7fb9e806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9edc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e806db50 0x7fb9e814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9edc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9e8150490 0x7fb9e8152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9edc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e8071630 con 0x7fb9e8150490 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9edc00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e8156270 con 0x7fb9e80c25a0 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9edc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8156550 con 0x7fb9e806db50 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9e7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9e8150490 0x7fb9e8152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9e7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9e8150490 0x7fb9e8152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48436/0 (socket says 172.21.15.114:48436) 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9e7400640 1 -- 172.21.15.114:0/2544866313 learned_addr learned my addr 172.21.15.114:0/2544866313 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9e6a00640 1 --2- 172.21.15.114:0/2544866313 >> v2:172.21.15.116:3300/0 conn(0x7fb9e80c25a0 0x7fb9e806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.633+0000 7fb9e6000640 1 --2- 172.21.15.114:0/2544866313 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e806db50 0x7fb9e814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9e7400640 1 -- 172.21.15.114:0/2544866313 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e806db50 msgr2=0x7fb9e814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9e7400640 1 --2- 172.21.15.114:0/2544866313 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e806db50 0x7fb9e814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9e7400640 1 -- 172.21.15.114:0/2544866313 >> v2:172.21.15.116:3300/0 conn(0x7fb9e80c25a0 msgr2=0x7fb9e806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9e7400640 1 --2- 172.21.15.114:0/2544866313 >> v2:172.21.15.116:3300/0 conn(0x7fb9e80c25a0 0x7fb9e806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9e7400640 1 -- 172.21.15.114:0/2544866313 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e8156830 con 0x7fb9e8150490 2024-02-17T12:18:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9e6a00640 1 --2- 172.21.15.114:0/2544866313 >> v2:172.21.15.116:3300/0 conn(0x7fb9e80c25a0 0x7fb9e806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:31.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9e7400640 1 --2- 172.21.15.114:0/2544866313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e8150490 0x7fb9e8152c50 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80ab930 tx=0x7fb9e001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e66ea01b380747b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9e5600640 1 -- 172.21.15.114:0/2544866313 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e81539a0 con 0x7fb9e8150490 2024-02-17T12:18:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9e5600640 1 -- 172.21.15.114:0/2544866313 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e00a5640 con 0x7fb9e8150490 2024-02-17T12:18:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9e5600640 1 -- 172.21.15.114:0/2544866313 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00a59d0 con 0x7fb9e8150490 2024-02-17T12:18:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9edc00640 1 -- 172.21.15.114:0/2544866313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e8150490 msgr2=0x7fb9e8152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9edc00640 1 --2- 172.21.15.114:0/2544866313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e8150490 0x7fb9e8152c50 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80ab930 tx=0x7fb9e001c8a0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9edc00640 1 -- 172.21.15.114:0/2544866313 shutdown_connections 2024-02-17T12:18:31.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9edc00640 1 --2- 172.21.15.114:0/2544866313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e8150490 0x7fb9e8152c50 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9edc00640 1 --2- 172.21.15.114:0/2544866313 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e806db50 0x7fb9e814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9edc00640 1 --2- 172.21.15.114:0/2544866313 >> v2:172.21.15.116:3300/0 conn(0x7fb9e80c25a0 0x7fb9e806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9edc00640 1 -- 172.21.15.114:0/2544866313 >> 172.21.15.114:0/2544866313 conn(0x7fb9e80a8490 msgr2=0x7fb9e80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:31.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9edc00640 1 -- 172.21.15.114:0/2544866313 shutdown_connections 2024-02-17T12:18:31.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.637+0000 7fb9edc00640 1 -- 172.21.15.114:0/2544866313 wait complete. 2024-02-17T12:18:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9edc00640 1 Processor -- start 2024-02-17T12:18:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9edc00640 1 -- start start 2024-02-17T12:18:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9edc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e806db50 0x7fb9e813c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9edc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e80c25a0 0x7fb9e813cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9edc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e8150490 0x7fb9e80c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9edc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8148490 con 0x7fb9e806db50 2024-02-17T12:18:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9edc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e81509c0 con 0x7fb9e80c25a0 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9edc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8148730 con 0x7fb9e8150490 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e806db50 0x7fb9e813c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e806db50 0x7fb9e813c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48438/0 (socket says 172.21.15.114:48438) 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e6a00640 1 -- 172.21.15.114:0/1860667098 learned_addr learned my addr 172.21.15.114:0/1860667098 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e7400640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e8150490 0x7fb9e80c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e6000640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e80c25a0 0x7fb9e813cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e6a00640 1 -- 172.21.15.114:0/1860667098 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e8150490 msgr2=0x7fb9e80c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e6a00640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e8150490 0x7fb9e80c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e6a00640 1 -- 172.21.15.114:0/1860667098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e80c25a0 msgr2=0x7fb9e813cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e6a00640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e80c25a0 0x7fb9e813cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e6a00640 1 -- 172.21.15.114:0/1860667098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0009b30 con 0x7fb9e806db50 2024-02-17T12:18:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9e6a00640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e806db50 0x7fb9e813c6c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e810 tx=0x7fb9d800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9dea00640 1 -- 172.21.15.114:0/1860667098 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800c8d0 con 0x7fb9e806db50 2024-02-17T12:18:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9dea00640 1 -- 172.21.15.114:0/1860667098 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800ca30 con 0x7fb9e806db50 2024-02-17T12:18:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9edc00640 1 -- 172.21.15.114:0/1860667098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e80c5a20 con 0x7fb9e806db50 2024-02-17T12:18:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9dea00640 1 -- 172.21.15.114:0/1860667098 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800cdc0 con 0x7fb9e806db50 2024-02-17T12:18:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.641+0000 7fb9edc00640 1 -- 172.21.15.114:0/1860667098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e80c5fe0 con 0x7fb9e806db50 2024-02-17T12:18:31.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.645+0000 7fb9edc00640 1 -- 172.21.15.114:0/1860667098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e8074840 con 0x7fb9e806db50 2024-02-17T12:18:31.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.645+0000 7fb9dea00640 1 -- 172.21.15.114:0/1860667098 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb9d8013410 con 0x7fb9e806db50 2024-02-17T12:18:31.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.645+0000 7fb9dea00640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c8066e40 0x7fb9c8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.645+0000 7fb9dea00640 1 -- 172.21.15.114:0/1860667098 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb9d8084b80 con 0x7fb9e806db50 2024-02-17T12:18:31.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.645+0000 7fb9e6000640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c8066e40 0x7fb9c8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.645+0000 7fb9e6000640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c8066e40 0x7fb9c8069300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8142ee0 tx=0x7fb9d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.649+0000 7fb9dea00640 1 -- 172.21.15.114:0/1860667098 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb9d8051600 con 0x7fb9e806db50 2024-02-17T12:18:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 -- 172.21.15.114:0/1860667098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb9e814f750 con 0x7fb9e806db50 2024-02-17T12:18:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9dea00640 1 -- 172.21.15.114:0/1860667098 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb9d8009480 con 0x7fb9e806db50 2024-02-17T12:18:31.808 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:18:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 -- 172.21.15.114:0/1860667098 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c8066e40 msgr2=0x7fb9c8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c8066e40 0x7fb9c8069300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8142ee0 tx=0x7fb9d4008040 comp rx=0 tx=0).stop 2024-02-17T12:18:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 -- 172.21.15.114:0/1860667098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e806db50 msgr2=0x7fb9e813c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e806db50 0x7fb9e813c6c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e810 tx=0x7fb9d800ecd0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 -- 172.21.15.114:0/1860667098 shutdown_connections 2024-02-17T12:18:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e8150490 0x7fb9e80c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e80c25a0 0x7fb9e813cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c8066e40 0x7fb9c8069300 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 --2- 172.21.15.114:0/1860667098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e806db50 0x7fb9e813c6c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 -- 172.21.15.114:0/1860667098 >> 172.21.15.114:0/1860667098 conn(0x7fb9e80a8490 msgr2=0x7fb9e8072720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 -- 172.21.15.114:0/1860667098 shutdown_connections 2024-02-17T12:18:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.805+0000 7fb9edc00640 1 -- 172.21.15.114:0/1860667098 wait complete. 2024-02-17T12:18:31.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:18:31.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.961+0000 7f530fe00640 1 Processor -- start 2024-02-17T12:18:31.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.961+0000 7f530fe00640 1 -- start start 2024-02-17T12:18:31.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.961+0000 7f530fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f530814f110 0x7f53080c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.961+0000 7f530fe00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f53080c1eb0 0x7f530815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.961+0000 7f530fe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53080a9420 con 0x7f53080c2580 2024-02-17T12:18:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.961+0000 7f530fe00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530814f4f0 con 0x7f53080c1eb0 2024-02-17T12:18:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.961+0000 7f530fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53080aae80 con 0x7f530814f110 2024-02-17T12:18:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530de00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f53080c1eb0 0x7f530815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530de00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f53080c1eb0 0x7f530815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:50642/0 (socket says 172.21.15.114:50642) 2024-02-17T12:18:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530ca00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f53080c2580 0x7f53080aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:41582/0 (socket says 172.21.15.114:41582) 2024-02-17T12:18:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530d400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f530814f110 0x7f53080c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530de00640 1 -- 172.21.15.114:0/3229071961 learned_addr learned my addr 172.21.15.114:0/3229071961 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:31.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530de00640 1 -- 172.21.15.114:0/3229071961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f530814f110 msgr2=0x7f53080c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:31.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530de00640 1 --2- 172.21.15.114:0/3229071961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f530814f110 0x7f53080c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530de00640 1 -- 172.21.15.114:0/3229071961 >> v1:172.21.15.116:6789/0 conn(0x7f53080c2580 legacy=0x7f53080aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530de00640 1 -- 172.21.15.114:0/3229071961 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5308152850 con 0x7f53080c1eb0 2024-02-17T12:18:31.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530d400640 1 --2- 172.21.15.114:0/3229071961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f530814f110 0x7f53080c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:31.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f530de00640 1 --2- 172.21.15.114:0/3229071961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53080c1eb0 0x7f530815c390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5300009e50 tx=0x7f530001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab929ac79d979159 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:31.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f5307e00640 1 -- 172.21.15.114:0/3229071961 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53000a5830 con 0x7f53080c1eb0 2024-02-17T12:18:31.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f5307e00640 1 -- 172.21.15.114:0/3229071961 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53000a5990 con 0x7f53080c1eb0 2024-02-17T12:18:31.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.965+0000 7f5307e00640 1 -- 172.21.15.114:0/3229071961 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53000a5d20 con 0x7f53080c1eb0 2024-02-17T12:18:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 -- 172.21.15.114:0/3229071961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53080c1eb0 msgr2=0x7f530815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 --2- 172.21.15.114:0/3229071961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53080c1eb0 0x7f530815c390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5300009e50 tx=0x7f530001c970 comp rx=0 tx=0).stop 2024-02-17T12:18:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 -- 172.21.15.114:0/3229071961 shutdown_connections 2024-02-17T12:18:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 --2- 172.21.15.114:0/3229071961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53080c1eb0 0x7f530815c390 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 --2- 172.21.15.114:0/3229071961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f530814f110 0x7f53080c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 -- 172.21.15.114:0/3229071961 >> 172.21.15.114:0/3229071961 conn(0x7f53080a8490 msgr2=0x7f53080a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 -- 172.21.15.114:0/3229071961 shutdown_connections 2024-02-17T12:18:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 -- 172.21.15.114:0/3229071961 wait complete. 2024-02-17T12:18:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 Processor -- start 2024-02-17T12:18:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 -- start start 2024-02-17T12:18:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53080c1eb0 0x7f530813fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53080c2580 0x7f5308139d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f530814f110 0x7f530813a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530814e6f0 con 0x7f530814f110 2024-02-17T12:18:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53081f0df0 con 0x7f53080c2580 2024-02-17T12:18:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53081f1040 con 0x7f53080c1eb0 2024-02-17T12:18:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f530814f110 0x7f530813a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f530814f110 0x7f530813a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48450/0 (socket says 172.21.15.114:48450) 2024-02-17T12:18:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530de00640 1 -- 172.21.15.114:0/891396641 learned_addr learned my addr 172.21.15.114:0/891396641 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530d400640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53080c1eb0 0x7f530813fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530ca00640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53080c2580 0x7f5308139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530de00640 1 -- 172.21.15.114:0/891396641 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53080c1eb0 msgr2=0x7f530813fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530de00640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53080c1eb0 0x7f530813fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530de00640 1 -- 172.21.15.114:0/891396641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53080c2580 msgr2=0x7f5308139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530de00640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53080c2580 0x7f5308139d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.969+0000 7f530de00640 1 -- 172.21.15.114:0/891396641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc009420 con 0x7f530814f110 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f530de00640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f530814f110 0x7f530813a2c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f530001a5a0 tx=0x7f5300019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f5305600640 1 -- 172.21.15.114:0/891396641 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53000b8670 con 0x7f530814f110 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f5305600640 1 -- 172.21.15.114:0/891396641 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53000b87d0 con 0x7f530814f110 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f530fe00640 1 -- 172.21.15.114:0/891396641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5300009b30 con 0x7f530814f110 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f5305600640 1 -- 172.21.15.114:0/891396641 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53000b8b40 con 0x7f530814f110 2024-02-17T12:18:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f530fe00640 1 -- 172.21.15.114:0/891396641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53081f1600 con 0x7f530814f110 2024-02-17T12:18:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f530fe00640 1 -- 172.21.15.114:0/891396641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53081ed880 con 0x7f530814f110 2024-02-17T12:18:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f5305600640 1 -- 172.21.15.114:0/891396641 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f53000b8ca0 con 0x7f530814f110 2024-02-17T12:18:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f5305600640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52e8066e40 0x7f52e8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f5305600640 1 -- 172.21.15.114:0/891396641 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f53001201d0 con 0x7f530814f110 2024-02-17T12:18:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.973+0000 7f530d400640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52e8066e40 0x7f52e8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.977+0000 7f530d400640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52e8066e40 0x7f52e8069300 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009cf0 tx=0x7f52fc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:31.977+0000 7f5305600640 1 -- 172.21.15.114:0/891396641 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53000ece20 con 0x7f530814f110 2024-02-17T12:18:32.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.145+0000 7f530fe00640 1 -- 172.21.15.114:0/891396641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5308074840 con 0x7f530814f110 2024-02-17T12:18:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.145+0000 7f5305600640 1 -- 172.21.15.114:0/891396641 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f53000f04e0 con 0x7f530814f110 2024-02-17T12:18:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:18:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 -- 172.21.15.114:0/891396641 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52e8066e40 msgr2=0x7f52e8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52e8066e40 0x7f52e8069300 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009cf0 tx=0x7f52fc009190 comp rx=0 tx=0).stop 2024-02-17T12:18:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 -- 172.21.15.114:0/891396641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f530814f110 msgr2=0x7f530813a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f530814f110 0x7f530813a2c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f530001a5a0 tx=0x7f5300019710 comp rx=0 tx=0).stop 2024-02-17T12:18:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 -- 172.21.15.114:0/891396641 shutdown_connections 2024-02-17T12:18:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f52e8066e40 0x7f52e8069300 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f530814f110 0x7f530813a2c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53080c2580 0x7f5308139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 --2- 172.21.15.114:0/891396641 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f53080c1eb0 0x7f530813fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 -- 172.21.15.114:0/891396641 >> 172.21.15.114:0/891396641 conn(0x7f53080a8490 msgr2=0x7f53080a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 -- 172.21.15.114:0/891396641 shutdown_connections 2024-02-17T12:18:32.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.149+0000 7f530fe00640 1 -- 172.21.15.114:0/891396641 wait complete. 2024-02-17T12:18:32.173 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-17T12:18:32.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:32.174 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-17T12:18:32.202 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:18:32.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:32.203 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-17T12:18:32.259 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:18:32.259 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:32.316 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3897 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-02-17T12:18:32.316 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:18:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd38000640 1 Processor -- start 2024-02-17T12:18:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd38000640 1 -- start start 2024-02-17T12:18:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd38000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 0x7fbd300c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd38000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd300c2580 0x7fbd300aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd38000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbd300c1eb0 0x7fbd30155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd38000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3014f4f0 con 0x7fbd300c2580 2024-02-17T12:18:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd38000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd300aae80 con 0x7fbd300c1eb0 2024-02-17T12:18:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd38000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300a9420 con 0x7fbd3014f110 2024-02-17T12:18:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd34c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd300c2580 0x7fbd300aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd34c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd300c2580 0x7fbd300aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48452/0 (socket says 172.21.15.114:48452) 2024-02-17T12:18:32.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd34c00640 1 -- 172.21.15.114:0/4246486792 learned_addr learned my addr 172.21.15.114:0/4246486792 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd36000640 1 --2- 172.21.15.114:0/4246486792 >> v2:172.21.15.116:3300/0 conn(0x7fbd300c1eb0 0x7fbd30155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd35600640 1 --2- 172.21.15.114:0/4246486792 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 0x7fbd300c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd34c00640 1 -- 172.21.15.114:0/4246486792 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 msgr2=0x7fbd300c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd34c00640 1 --2- 172.21.15.114:0/4246486792 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 0x7fbd300c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd34c00640 1 -- 172.21.15.114:0/4246486792 >> v2:172.21.15.116:3300/0 conn(0x7fbd300c1eb0 msgr2=0x7fbd30155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd34c00640 1 --2- 172.21.15.114:0/4246486792 >> v2:172.21.15.116:3300/0 conn(0x7fbd300c1eb0 0x7fbd30155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd34c00640 1 -- 172.21.15.114:0/4246486792 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30152850 con 0x7fbd300c2580 2024-02-17T12:18:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd36000640 1 --2- 172.21.15.114:0/4246486792 >> v2:172.21.15.116:3300/0 conn(0x7fbd300c1eb0 0x7fbd30155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.449+0000 7fbd35600640 1 --2- 172.21.15.114:0/4246486792 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 0x7fbd300c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd34c00640 1 --2- 172.21.15.114:0/4246486792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c2580 0x7fbd300aa150 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbd300c1090 tx=0x7fbd1c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7480c7559378a40 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd2fe00640 1 -- 172.21.15.114:0/4246486792 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0ab620 con 0x7fbd300c2580 2024-02-17T12:18:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd2fe00640 1 -- 172.21.15.114:0/4246486792 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c0ab780 con 0x7fbd300c2580 2024-02-17T12:18:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd2fe00640 1 -- 172.21.15.114:0/4246486792 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0abb10 con 0x7fbd300c2580 2024-02-17T12:18:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 -- 172.21.15.114:0/4246486792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c2580 msgr2=0x7fbd300aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 --2- 172.21.15.114:0/4246486792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c2580 0x7fbd300aa150 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbd300c1090 tx=0x7fbd1c01c460 comp rx=0 tx=0).stop 2024-02-17T12:18:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 -- 172.21.15.114:0/4246486792 shutdown_connections 2024-02-17T12:18:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 --2- 172.21.15.114:0/4246486792 >> v2:172.21.15.116:3300/0 conn(0x7fbd300c1eb0 0x7fbd30155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 --2- 172.21.15.114:0/4246486792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c2580 0x7fbd300aa150 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 --2- 172.21.15.114:0/4246486792 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 0x7fbd300c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 -- 172.21.15.114:0/4246486792 >> 172.21.15.114:0/4246486792 conn(0x7fbd300a8490 msgr2=0x7fbd300a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 -- 172.21.15.114:0/4246486792 shutdown_connections 2024-02-17T12:18:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 -- 172.21.15.114:0/4246486792 wait complete. 2024-02-17T12:18:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 Processor -- start 2024-02-17T12:18:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.453+0000 7fbd38000640 1 -- start start 2024-02-17T12:18:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd38000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c1eb0 0x7fbd3014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd38000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd300c2580 0x7fbd301e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd38000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 0x7fbd301f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd38000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301eaec0 con 0x7fbd300c1eb0 2024-02-17T12:18:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd38000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3014e890 con 0x7fbd300c2580 2024-02-17T12:18:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd38000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301549c0 con 0x7fbd3014f110 2024-02-17T12:18:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd35600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c1eb0 0x7fbd3014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd35600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c1eb0 0x7fbd3014e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48464/0 (socket says 172.21.15.114:48464) 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd35600640 1 -- 172.21.15.114:0/1237869481 learned_addr learned my addr 172.21.15.114:0/1237869481 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd34c00640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd300c2580 0x7fbd301e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd36000640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 0x7fbd301f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd35600640 1 -- 172.21.15.114:0/1237869481 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 msgr2=0x7fbd301f0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd35600640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 0x7fbd301f0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd35600640 1 -- 172.21.15.114:0/1237869481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd300c2580 msgr2=0x7fbd301e38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd35600640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd300c2580 0x7fbd301e38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd35600640 1 -- 172.21.15.114:0/1237869481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0094d0 con 0x7fbd300c1eb0 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd35600640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c1eb0 0x7fbd3014e350 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400c7c0 tx=0x7fbd2400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd2d600640 1 -- 172.21.15.114:0/1237869481 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24007a30 con 0x7fbd300c1eb0 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd2d600640 1 -- 172.21.15.114:0/1237869481 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24007b90 con 0x7fbd300c1eb0 2024-02-17T12:18:32.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd2d600640 1 -- 172.21.15.114:0/1237869481 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400ce70 con 0x7fbd300c1eb0 2024-02-17T12:18:32.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd38000640 1 -- 172.21.15.114:0/1237869481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd30154120 con 0x7fbd300c1eb0 2024-02-17T12:18:32.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd38000640 1 -- 172.21.15.114:0/1237869481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd301546e0 con 0x7fbd300c1eb0 2024-02-17T12:18:32.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd38000640 1 -- 172.21.15.114:0/1237869481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd30074840 con 0x7fbd300c1eb0 2024-02-17T12:18:32.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.457+0000 7fbd2d600640 1 -- 172.21.15.114:0/1237869481 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbd240113f0 con 0x7fbd300c1eb0 2024-02-17T12:18:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.461+0000 7fbd2d600640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd10066e70 0x7fbd10069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.461+0000 7fbd2d600640 1 -- 172.21.15.114:0/1237869481 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbd24085340 con 0x7fbd300c1eb0 2024-02-17T12:18:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.461+0000 7fbd34c00640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd10066e70 0x7fbd10069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.461+0000 7fbd34c00640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd10066e70 0x7fbd10069330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0af000 tx=0x7fbd1c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:32.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.465+0000 7fbd2d600640 1 -- 172.21.15.114:0/1237869481 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbd24051ce0 con 0x7fbd300c1eb0 2024-02-17T12:18:32.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.649+0000 7fbd38000640 1 -- 172.21.15.114:0/1237869481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbd300c1380 con 0x7fbd300c1eb0 2024-02-17T12:18:32.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd2d600640 1 -- 172.21.15.114:0/1237869481 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+149 (secure 0 0 0) 0x7fbd240553a0 con 0x7fbd300c1eb0 2024-02-17T12:18:32.655 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:18:32.655 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-02-17T12:18:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 -- 172.21.15.114:0/1237869481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd10066e70 msgr2=0x7fbd10069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd10066e70 0x7fbd10069330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0af000 tx=0x7fbd1c0a7000 comp rx=0 tx=0).stop 2024-02-17T12:18:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 -- 172.21.15.114:0/1237869481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c1eb0 msgr2=0x7fbd3014e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c1eb0 0x7fbd3014e350 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400c7c0 tx=0x7fbd2400cc80 comp rx=0 tx=0).stop 2024-02-17T12:18:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 -- 172.21.15.114:0/1237869481 shutdown_connections 2024-02-17T12:18:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd3014f110 0x7fbd301f0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd300c2580 0x7fbd301e38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd10066e70 0x7fbd10069330 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 --2- 172.21.15.114:0/1237869481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd300c1eb0 0x7fbd3014e350 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 -- 172.21.15.114:0/1237869481 >> 172.21.15.114:0/1237869481 conn(0x7fbd300a8490 msgr2=0x7fbd300724d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 -- 172.21.15.114:0/1237869481 shutdown_connections 2024-02-17T12:18:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:32.653+0000 7fbd38000640 1 -- 172.21.15.114:0/1237869481 wait complete. 2024-02-17T12:18:32.676 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-02-17T12:18:32.676 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:18:32.676 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-17T12:18:32.676 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-17T12:18:32.676 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T12:18:32.677 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-02-17T12:18:32.677 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:18:32.677 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:18:32.677 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:18:32.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:32.677 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-17T12:18:32.686 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:18:32.686 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:32.687 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42203sec preferred_lft 42203sec 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 02:42:58:59:74:79 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:32.688 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:18:32.689 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:32.689 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:18:32.689 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:32.689 INFO:teuthology.orchestra.run.smithi116.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:18:32.689 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T12:18:32.689 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:18:32.689 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:32.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:32.690 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:18:32.752 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-17T12:18:32.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:32.755 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-17T12:18:32.808 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-17T12:18:32.809 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:18:32.809 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:18:32.809 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:18:32.809 INFO:teuthology.orchestra.run.smithi116.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:18:32.809 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:18:32.809 INFO:teuthology.orchestra.run.smithi116.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:32.809 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:32.809 INFO:teuthology.orchestra.run.smithi116.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:32.809 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:18:32.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:32.810 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:18:32.810 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:18:32.810 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:18:32.810 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:18:32.810 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:18:32.810 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:18:32.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:32.903 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-17T12:18:32.912 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-17T12:18:32.912 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:18:32.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:32.913 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-02-17T12:18:32.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:18:32.974 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-17T12:18:33.026 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:18:33.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:18:33.026 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:18:33.077 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:18:33.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:33.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:18:33.167 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:18:33.167 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-02-17T12:18:33.167 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:18:33.182 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:18:33.182 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-02-17T12:18:33.182 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:18:33.182 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:18:33.182 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:18:33.191 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:18:33.191 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-02-17T12:18:33.191 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:18:33.191 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:18:33.191 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:18:33.191 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:18:33.192 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:18:33.192 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:18:33.196 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:18:33.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:33.196 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:18:33.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:33.217 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:18:33.278 INFO:teuthology.orchestra.run.smithi116.stdout:client5441 2024-02-17T12:18:33.278 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:18:33.279 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:33.330 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2024-02-17T12:18:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40b5800640 1 Processor -- start 2024-02-17T12:18:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40b5800640 1 -- start start 2024-02-17T12:18:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40b5800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 0x7f40b00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40b5800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f40b00c1eb0 0x7f40b015c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40b5800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b00a9420 con 0x7f40b00c2580 2024-02-17T12:18:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40b5800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b014f4f0 con 0x7f40b00c1eb0 2024-02-17T12:18:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40b5800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00aae80 con 0x7f40b014f110 2024-02-17T12:18:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40ae000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f40b00c2580 0x7f40b00aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60204/0 (socket says 172.21.15.114:60204) 2024-02-17T12:18:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40ae000640 1 -- 172.21.15.114:0/2515180736 learned_addr learned my addr 172.21.15.114:0/2515180736 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:33.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40af400640 1 --2- 172.21.15.114:0/2515180736 >> v2:172.21.15.116:3300/0 conn(0x7f40b00c1eb0 0x7f40b015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.469+0000 7f40aea00640 1 --2- 172.21.15.114:0/2515180736 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 0x7f40b00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40ad600640 1 -- 172.21.15.114:0/2515180736 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541840529 0 0) 0x7f40b00a9420 con 0x7f40b00c2580 2024-02-17T12:18:33.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40ad600640 1 -- 172.21.15.114:0/2515180736 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4094003530 con 0x7f40b00c2580 2024-02-17T12:18:33.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40aea00640 1 -- 172.21.15.114:0/2515180736 >> v2:172.21.15.116:3300/0 conn(0x7f40b00c1eb0 msgr2=0x7f40b015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:33.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40aea00640 1 --2- 172.21.15.114:0/2515180736 >> v2:172.21.15.116:3300/0 conn(0x7f40b00c1eb0 0x7f40b015c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40aea00640 1 -- 172.21.15.114:0/2515180736 >> v1:172.21.15.114:6789/0 conn(0x7f40b00c2580 legacy=0x7f40b00aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:33.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40aea00640 1 -- 172.21.15.114:0/2515180736 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b0152850 con 0x7f40b014f110 2024-02-17T12:18:33.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40af400640 1 --2- 172.21.15.114:0/2515180736 >> v2:172.21.15.116:3300/0 conn(0x7f40b00c1eb0 0x7f40b015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:33.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40aea00640 1 --2- 172.21.15.114:0/2515180736 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 0x7f40b00c65a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f40a00097c0 tx=0x7f40a001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d8990742eb12831 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:33.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40ad600640 1 -- 172.21.15.114:0/2515180736 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a00ac640 con 0x7f40b014f110 2024-02-17T12:18:33.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40ad600640 1 -- 172.21.15.114:0/2515180736 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a00ac7a0 con 0x7f40b014f110 2024-02-17T12:18:33.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40ad600640 1 -- 172.21.15.114:0/2515180736 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a00acb30 con 0x7f40b014f110 2024-02-17T12:18:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40b5800640 1 -- 172.21.15.114:0/2515180736 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 msgr2=0x7f40b00c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40b5800640 1 --2- 172.21.15.114:0/2515180736 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 0x7f40b00c65a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f40a00097c0 tx=0x7f40a001c3e0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40b5800640 1 -- 172.21.15.114:0/2515180736 shutdown_connections 2024-02-17T12:18:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40b5800640 1 --2- 172.21.15.114:0/2515180736 >> v2:172.21.15.116:3300/0 conn(0x7f40b00c1eb0 0x7f40b015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.473+0000 7f40b5800640 1 --2- 172.21.15.114:0/2515180736 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 0x7f40b00c65a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 -- 172.21.15.114:0/2515180736 >> 172.21.15.114:0/2515180736 conn(0x7f40b00a8490 msgr2=0x7f40b00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 -- 172.21.15.114:0/2515180736 shutdown_connections 2024-02-17T12:18:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 -- 172.21.15.114:0/2515180736 wait complete. 2024-02-17T12:18:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 Processor -- start 2024-02-17T12:18:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 -- start start 2024-02-17T12:18:33.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b00c1eb0 0x7f40b0141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40b00c2580 0x7f40b0154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 0x7f40b014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b0155380 con 0x7f40b00c2580 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b0142270 con 0x7f40b00c1eb0 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b01f15b0 con 0x7f40b014f110 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40ae000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40b00c2580 0x7f40b0154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40ae000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40b00c2580 0x7f40b0154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48478/0 (socket says 172.21.15.114:48478) 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40ae000640 1 -- 172.21.15.114:0/1530564874 learned_addr learned my addr 172.21.15.114:0/1530564874 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40aea00640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b00c1eb0 0x7f40b0141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40af400640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 0x7f40b014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40ae000640 1 -- 172.21.15.114:0/1530564874 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 msgr2=0x7f40b014d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40ae000640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 0x7f40b014d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40ae000640 1 -- 172.21.15.114:0/1530564874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b00c1eb0 msgr2=0x7f40b0141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40ae000640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b00c1eb0 0x7f40b0141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40ae000640 1 -- 172.21.15.114:0/1530564874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a8009a70 con 0x7f40b00c2580 2024-02-17T12:18:33.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40ae000640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40b00c2580 0x7f40b0154870 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f409c00c420 tx=0x7f409c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:33.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40a6a00640 1 -- 172.21.15.114:0/1530564874 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c005cf0 con 0x7f40b00c2580 2024-02-17T12:18:33.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40a6a00640 1 -- 172.21.15.114:0/1530564874 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c005e70 con 0x7f40b00c2580 2024-02-17T12:18:33.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 -- 172.21.15.114:0/1530564874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a0009420 con 0x7f40b00c2580 2024-02-17T12:18:33.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40a6a00640 1 -- 172.21.15.114:0/1530564874 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c0072f0 con 0x7f40b00c2580 2024-02-17T12:18:33.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.477+0000 7f40b5800640 1 -- 172.21.15.114:0/1530564874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b01f1b70 con 0x7f40b00c2580 2024-02-17T12:18:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.481+0000 7f40b5800640 1 -- 172.21.15.114:0/1530564874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b0074840 con 0x7f40b00c2580 2024-02-17T12:18:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.481+0000 7f40a6a00640 1 -- 172.21.15.114:0/1530564874 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f409c007450 con 0x7f40b00c2580 2024-02-17T12:18:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.481+0000 7f40a6a00640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4090066e40 0x7f4090069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.481+0000 7f40a6a00640 1 -- 172.21.15.114:0/1530564874 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f409c084340 con 0x7f40b00c2580 2024-02-17T12:18:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.481+0000 7f40aea00640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4090066e40 0x7f4090069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.481+0000 7f40aea00640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4090066e40 0x7f4090069300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f40a00ae000 tx=0x7f40a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:33.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.485+0000 7f40a6a00640 1 -- 172.21.15.114:0/1530564874 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f409c050f30 con 0x7f40b00c2580 2024-02-17T12:18:33.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.693+0000 7f40b5800640 1 -- 172.21.15.114:0/1530564874 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f40b0155ea0 con 0x7f40b00c2580 2024-02-17T12:18:33.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40a6a00640 1 -- 172.21.15.114:0/1530564874 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v15) v1 ==== 291+0+0 (secure 0 0 0) 0x7f409c0545f0 con 0x7f40b00c2580 2024-02-17T12:18:33.700 INFO:teuthology.orchestra.run.smithi114.stderr:added key for client.testuser 2024-02-17T12:18:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 -- 172.21.15.114:0/1530564874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4090066e40 msgr2=0x7f4090069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4090066e40 0x7f4090069300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f40a00ae000 tx=0x7f40a0008040 comp rx=0 tx=0).stop 2024-02-17T12:18:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 -- 172.21.15.114:0/1530564874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40b00c2580 msgr2=0x7f40b0154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40b00c2580 0x7f40b0154870 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f409c00c420 tx=0x7f409c00c820 comp rx=0 tx=0).stop 2024-02-17T12:18:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 -- 172.21.15.114:0/1530564874 shutdown_connections 2024-02-17T12:18:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40b014f110 0x7f40b014d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4090066e40 0x7f4090069300 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40b00c2580 0x7f40b0154870 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 --2- 172.21.15.114:0/1530564874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b00c1eb0 0x7f40b0141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 -- 172.21.15.114:0/1530564874 >> 172.21.15.114:0/1530564874 conn(0x7f40b00a8490 msgr2=0x7f40b014c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:33.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 -- 172.21.15.114:0/1530564874 shutdown_connections 2024-02-17T12:18:33.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.697+0000 7f40b5800640 1 -- 172.21.15.114:0/1530564874 wait complete. 2024-02-17T12:18:33.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2024-02-17T12:18:33.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.853+0000 7f84eec00640 1 Processor -- start 2024-02-17T12:18:33.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.853+0000 7f84eec00640 1 -- start start 2024-02-17T12:18:33.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84eec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e814e9b0 0x7f84e80ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84eec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84e806ef50 0x7f84e81512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84eec00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f84e81517e0 0x7f84e806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84eec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e814ed90 con 0x7f84e806ef50 2024-02-17T12:18:33.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84eec00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e80aa150 con 0x7f84e81517e0 2024-02-17T12:18:33.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84eec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80c1e90 con 0x7f84e814e9b0 2024-02-17T12:18:33.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84e7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84e806ef50 0x7f84e81512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84e7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84e806ef50 0x7f84e81512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48492/0 (socket says 172.21.15.114:48492) 2024-02-17T12:18:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84e7400640 1 -- 172.21.15.114:0/1323031937 learned_addr learned my addr 172.21.15.114:0/1323031937 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84ecc00640 1 --2- 172.21.15.114:0/1323031937 >> v2:172.21.15.116:3300/0 conn(0x7f84e81517e0 0x7f84e806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84e7e00640 1 --2- 172.21.15.114:0/1323031937 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e814e9b0 0x7f84e80ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84e7400640 1 -- 172.21.15.114:0/1323031937 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e814e9b0 msgr2=0x7f84e80ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84e7400640 1 --2- 172.21.15.114:0/1323031937 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e814e9b0 0x7f84e80ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84e7400640 1 -- 172.21.15.114:0/1323031937 >> v2:172.21.15.116:3300/0 conn(0x7f84e81517e0 msgr2=0x7f84e806dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84e7400640 1 --2- 172.21.15.114:0/1323031937 >> v2:172.21.15.116:3300/0 conn(0x7f84e81517e0 0x7f84e806dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84e7400640 1 -- 172.21.15.114:0/1323031937 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e8152000 con 0x7f84e806ef50 2024-02-17T12:18:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.857+0000 7f84e7e00640 1 --2- 172.21.15.114:0/1323031937 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e814e9b0 0x7f84e80ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:33.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84e7400640 1 --2- 172.21.15.114:0/1323031937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e806ef50 0x7f84e81512a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f84e80c2150 tx=0x7f84d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bd472d7024ecae server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:33.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84e6a00640 1 -- 172.21.15.114:0/1323031937 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40ab680 con 0x7f84e806ef50 2024-02-17T12:18:33.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84e6a00640 1 -- 172.21.15.114:0/1323031937 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d40ab7e0 con 0x7f84e806ef50 2024-02-17T12:18:33.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84e6a00640 1 -- 172.21.15.114:0/1323031937 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40abb70 con 0x7f84e806ef50 2024-02-17T12:18:33.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 -- 172.21.15.114:0/1323031937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e806ef50 msgr2=0x7f84e81512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:33.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 --2- 172.21.15.114:0/1323031937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e806ef50 0x7f84e81512a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f84e80c2150 tx=0x7f84d401c520 comp rx=0 tx=0).stop 2024-02-17T12:18:33.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 -- 172.21.15.114:0/1323031937 shutdown_connections 2024-02-17T12:18:33.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 --2- 172.21.15.114:0/1323031937 >> v2:172.21.15.116:3300/0 conn(0x7f84e81517e0 0x7f84e806dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 --2- 172.21.15.114:0/1323031937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e806ef50 0x7f84e81512a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 --2- 172.21.15.114:0/1323031937 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e814e9b0 0x7f84e80ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 -- 172.21.15.114:0/1323031937 >> 172.21.15.114:0/1323031937 conn(0x7f84e80a8490 msgr2=0x7f84e80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:33.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 -- 172.21.15.114:0/1323031937 shutdown_connections 2024-02-17T12:18:33.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 -- 172.21.15.114:0/1323031937 wait complete. 2024-02-17T12:18:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 Processor -- start 2024-02-17T12:18:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 -- start start 2024-02-17T12:18:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84e806ef50 0x7f84e814a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e814e9b0 0x7f84e814a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e81517e0 0x7f84e814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e81423e0 con 0x7f84e814e9b0 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e81511e0 con 0x7f84e806ef50 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84eec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8142170 con 0x7f84e81517e0 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84e7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e814e9b0 0x7f84e814a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84e7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e814e9b0 0x7f84e814a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48500/0 (socket says 172.21.15.114:48500) 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84e7400640 1 -- 172.21.15.114:0/3216011318 learned_addr learned my addr 172.21.15.114:0/3216011318 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84e7e00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84e806ef50 0x7f84e814a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.861+0000 7f84ecc00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e81517e0 0x7f84e814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84e7400640 1 -- 172.21.15.114:0/3216011318 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e81517e0 msgr2=0x7f84e814f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84e7400640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e81517e0 0x7f84e814f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84e7400640 1 -- 172.21.15.114:0/3216011318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84e806ef50 msgr2=0x7f84e814a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84e7400640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84e806ef50 0x7f84e814a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84e7400640 1 -- 172.21.15.114:0/3216011318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d40094d0 con 0x7f84e814e9b0 2024-02-17T12:18:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84e7e00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84e806ef50 0x7f84e814a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84e7400640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e814e9b0 0x7f84e814a550 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f84d401ca00 tx=0x7f84d401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84dfe00640 1 -- 172.21.15.114:0/3216011318 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40b4800 con 0x7f84e814e9b0 2024-02-17T12:18:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84dfe00640 1 -- 172.21.15.114:0/3216011318 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d40b4980 con 0x7f84e814e9b0 2024-02-17T12:18:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84eec00640 1 -- 172.21.15.114:0/3216011318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e81509c0 con 0x7f84e814e9b0 2024-02-17T12:18:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84dfe00640 1 -- 172.21.15.114:0/3216011318 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40b4d30 con 0x7f84e814e9b0 2024-02-17T12:18:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84eec00640 1 -- 172.21.15.114:0/3216011318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e80c3700 con 0x7f84e814e9b0 2024-02-17T12:18:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84eec00640 1 -- 172.21.15.114:0/3216011318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e8074840 con 0x7f84e814e9b0 2024-02-17T12:18:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84dfe00640 1 -- 172.21.15.114:0/3216011318 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f84d40c7390 con 0x7f84e814e9b0 2024-02-17T12:18:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84dfe00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84c8066e40 0x7f84c8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84dfe00640 1 -- 172.21.15.114:0/3216011318 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f84d411f9f0 con 0x7f84e814e9b0 2024-02-17T12:18:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.865+0000 7f84e7e00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84c8066e40 0x7f84c8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.869+0000 7f84e7e00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84c8066e40 0x7f84c8069300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f84d8006b20 tx=0x7f84d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:33.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:33.869+0000 7f84dfe00640 1 -- 172.21.15.114:0/3216011318 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f84d40ec640 con 0x7f84e814e9b0 2024-02-17T12:18:34.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 -- 172.21.15.114:0/3216011318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f84e814d2f0 con 0x7f84e814e9b0 2024-02-17T12:18:34.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84dfe00640 1 -- 172.21.15.114:0/3216011318 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v15) v1 ==== 85+0+245 (secure 0 0 0) 0x7f84d40efd00 con 0x7f84e814e9b0 2024-02-17T12:18:34.084 INFO:teuthology.orchestra.run.smithi114.stdout:[client.testuser] 2024-02-17T12:18:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAZpNBlBjd9KRAAIBSuvSKH31txYdkcjazvHg== 2024-02-17T12:18:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow rw fsname=cephfs" 2024-02-17T12:18:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2024-02-17T12:18:34.084 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2024-02-17T12:18:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 -- 172.21.15.114:0/3216011318 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84c8066e40 msgr2=0x7f84c8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84c8066e40 0x7f84c8069300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f84d8006b20 tx=0x7f84d8008040 comp rx=0 tx=0).stop 2024-02-17T12:18:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 -- 172.21.15.114:0/3216011318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e814e9b0 msgr2=0x7f84e814a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e814e9b0 0x7f84e814a550 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f84d401ca00 tx=0x7f84d401ad60 comp rx=0 tx=0).stop 2024-02-17T12:18:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 -- 172.21.15.114:0/3216011318 shutdown_connections 2024-02-17T12:18:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f84e81517e0 0x7f84e814f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84c8066e40 0x7f84c8069300 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e814e9b0 0x7f84e814a550 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 --2- 172.21.15.114:0/3216011318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84e806ef50 0x7f84e814a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 -- 172.21.15.114:0/3216011318 >> 172.21.15.114:0/3216011318 conn(0x7f84e80a8490 msgr2=0x7f84e8142c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:34.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 -- 172.21.15.114:0/3216011318 shutdown_connections 2024-02-17T12:18:34.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.081+0000 7f84eec00640 1 -- 172.21.15.114:0/3216011318 wait complete. 2024-02-17T12:18:34.104 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-02-17T12:18:34.112 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.Tt9hlw19Ki 2024-02-17T12:18:34.112 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:18:34.112 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/tmp/tmp.Tt9hlw19Ki 2024-02-17T12:18:34.162 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:18:34.162 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:34.210 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:18:34.210 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:34.258 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:34.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.433+0000 7f79ba800640 1 Processor -- start 2024-02-17T12:18:34.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.433+0000 7f79ba800640 1 -- start start 2024-02-17T12:18:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.433+0000 7f79ba800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f79b40c2580 0x7f79b40aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.433+0000 7f79ba800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b40a9420 con 0x7f79b40c1eb0 2024-02-17T12:18:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.433+0000 7f79ba800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b4152850 con 0x7f79b414f110 2024-02-17T12:18:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.433+0000 7f79ba800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b414f4f0 con 0x7f79b40c2580 2024-02-17T12:18:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.433+0000 7f79b3e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f79b40c1eb0 0x7f79b415c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60218/0 (socket says 172.21.15.114:60218) 2024-02-17T12:18:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.433+0000 7f79b3e00640 1 -- 172.21.15.114:0/1439707870 learned_addr learned my addr 172.21.15.114:0/1439707870 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:34.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.433+0000 7f79b2a00640 1 --2- 172.21.15.114:0/1439707870 >> v2:172.21.15.116:3300/0 conn(0x7f79b40c2580 0x7f79b40aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2000640 1 -- 172.21.15.114:0/1439707870 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450268352 0 0) 0x7f79b40a9420 con 0x7f79b40c1eb0 2024-02-17T12:18:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2000640 1 -- 172.21.15.114:0/1439707870 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7998005740 con 0x7f79b40c1eb0 2024-02-17T12:18:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2000640 1 -- 172.21.15.114:0/1439707870 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884025200 0 0) 0x7f79b4152850 con 0x7f79b414f110 2024-02-17T12:18:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2000640 1 -- 172.21.15.114:0/1439707870 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79b40a9420 con 0x7f79b414f110 2024-02-17T12:18:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2a00640 1 -- 172.21.15.114:0/1439707870 >> v1:172.21.15.116:6789/0 conn(0x7f79b414f110 legacy=0x7f79b40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2a00640 1 -- 172.21.15.114:0/1439707870 >> v1:172.21.15.114:6789/0 conn(0x7f79b40c1eb0 legacy=0x7f79b415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2a00640 1 -- 172.21.15.114:0/1439707870 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40a9670 con 0x7f79b40c2580 2024-02-17T12:18:34.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2a00640 1 --2- 172.21.15.114:0/1439707870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79b40c2580 0x7f79b40aa150 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f79a00097c0 tx=0x7f79a001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49bc851a489c19bf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:34.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2000640 1 -- 172.21.15.114:0/1439707870 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00ab600 con 0x7f79b40c2580 2024-02-17T12:18:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2000640 1 -- 172.21.15.114:0/1439707870 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a00a7050 con 0x7f79b40c2580 2024-02-17T12:18:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79b2000640 1 -- 172.21.15.114:0/1439707870 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00ab960 con 0x7f79b40c2580 2024-02-17T12:18:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79ba800640 1 -- 172.21.15.114:0/1439707870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79b40c2580 msgr2=0x7f79b40aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79ba800640 1 --2- 172.21.15.114:0/1439707870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79b40c2580 0x7f79b40aa150 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f79a00097c0 tx=0x7f79a001c410 comp rx=0 tx=0).stop 2024-02-17T12:18:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79ba800640 1 -- 172.21.15.114:0/1439707870 shutdown_connections 2024-02-17T12:18:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79ba800640 1 --2- 172.21.15.114:0/1439707870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79b40c2580 0x7f79b40aa150 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79ba800640 1 -- 172.21.15.114:0/1439707870 >> 172.21.15.114:0/1439707870 conn(0x7f79b40a8490 msgr2=0x7f79b40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.437+0000 7f79ba800640 1 -- 172.21.15.114:0/1439707870 shutdown_connections 2024-02-17T12:18:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 -- 172.21.15.114:0/1439707870 wait complete. 2024-02-17T12:18:34.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 Processor -- start 2024-02-17T12:18:34.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 -- start start 2024-02-17T12:18:34.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79b40c1eb0 0x7f79b41f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79b40c2580 0x7f79b41f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f79b414f110 0x7f79b4155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4154c50 con 0x7f79b40c1eb0 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4154ef0 con 0x7f79b40c2580 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b41f1b20 con 0x7f79b414f110 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79b40c1eb0 0x7f79b41f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79b40c1eb0 0x7f79b41f0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48506/0 (socket says 172.21.15.114:48506) 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b3400640 1 -- 172.21.15.114:0/3693712367 learned_addr learned my addr 172.21.15.114:0/3693712367 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b3e00640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f79b414f110 0x7f79b4155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b2a00640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79b40c2580 0x7f79b41f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b3400640 1 -- 172.21.15.114:0/3693712367 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f79b414f110 msgr2=0x7f79b4155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b3400640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f79b414f110 0x7f79b4155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b3400640 1 -- 172.21.15.114:0/3693712367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79b40c2580 msgr2=0x7f79b41f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b3400640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79b40c2580 0x7f79b41f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b3400640 1 -- 172.21.15.114:0/3693712367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a0009420 con 0x7f79b40c1eb0 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79b3400640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79b40c1eb0 0x7f79b41f0fd0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c430 tx=0x7f79a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ab400640 1 -- 172.21.15.114:0/3693712367 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a40052d0 con 0x7f79b40c1eb0 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ab400640 1 -- 172.21.15.114:0/3693712367 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a4005450 con 0x7f79b40c1eb0 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ab400640 1 -- 172.21.15.114:0/3693712367 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4003840 con 0x7f79b40c1eb0 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 -- 172.21.15.114:0/3693712367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b40c3750 con 0x7f79b40c1eb0 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.441+0000 7f79ba800640 1 -- 172.21.15.114:0/3693712367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b41431f0 con 0x7f79b40c1eb0 2024-02-17T12:18:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.445+0000 7f79ba800640 1 -- 172.21.15.114:0/3693712367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b4153b80 con 0x7f79b40c1eb0 2024-02-17T12:18:34.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.445+0000 7f79ab400640 1 -- 172.21.15.114:0/3693712367 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f79a40039a0 con 0x7f79b40c1eb0 2024-02-17T12:18:34.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.445+0000 7f79ab400640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7994066e40 0x7f7994069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:34.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.445+0000 7f79ab400640 1 -- 172.21.15.114:0/3693712367 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f79a4084320 con 0x7f79b40c1eb0 2024-02-17T12:18:34.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.445+0000 7f79b2a00640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7994066e40 0x7f7994069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:34.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.445+0000 7f79b2a00640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7994066e40 0x7f7994069300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f79a00ad000 tx=0x7f79a00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.449+0000 7f79ab400640 1 -- 172.21.15.114:0/3693712367 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f79b4153b80 con 0x7f79b40c1eb0 2024-02-17T12:18:34.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.601+0000 7f79ba800640 1 -- 172.21.15.114:0/3693712367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79b4153b80 con 0x7f79b40c1eb0 2024-02-17T12:18:34.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ab400640 1 -- 172.21.15.114:0/3693712367 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20458 (secure 0 0 0) 0x7f79b4153b80 con 0x7f79b40c1eb0 2024-02-17T12:18:34.607 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:34.608 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:21.358057+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 -- 172.21.15.114:0/3693712367 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7994066e40 msgr2=0x7f7994069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7994066e40 0x7f7994069300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f79a00ad000 tx=0x7f79a00a6000 comp rx=0 tx=0).stop 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 -- 172.21.15.114:0/3693712367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79b40c1eb0 msgr2=0x7f79b41f0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79b40c1eb0 0x7f79b41f0fd0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c430 tx=0x7f79a400c8f0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 -- 172.21.15.114:0/3693712367 shutdown_connections 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f79b414f110 0x7f79b4155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79b40c2580 0x7f79b41f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7994066e40 0x7f7994069300 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 --2- 172.21.15.114:0/3693712367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79b40c1eb0 0x7f79b41f0fd0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 -- 172.21.15.114:0/3693712367 >> 172.21.15.114:0/3693712367 conn(0x7f79b40a8490 msgr2=0x7f79b4144e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 -- 172.21.15.114:0/3693712367 shutdown_connections 2024-02-17T12:18:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.605+0000 7f79ba800640 1 -- 172.21.15.114:0/3693712367 wait complete. 2024-02-17T12:18:34.629 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:17:59.900395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:18:01.152214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:18:17.610636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:18:18.703971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:18:34.629 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:18:34.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de4800640 1 Processor -- start 2024-02-17T12:18:34.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de4800640 1 -- start start 2024-02-17T12:18:34.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de4800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 0x7f3ddc0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:34.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de4800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc0a9420 con 0x7f3ddc0c2580 2024-02-17T12:18:34.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de4800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc152850 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de4800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc14f4f0 con 0x7f3ddc14f110 2024-02-17T12:18:34.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de1400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3ddc0c2580 0x7f3ddc0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60224/0 (socket says 172.21.15.114:60224) 2024-02-17T12:18:34.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de1400640 1 -- 172.21.15.114:0/4119660218 learned_addr learned my addr 172.21.15.114:0/4119660218 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:34.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de1e00640 1 --2- 172.21.15.114:0/4119660218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 0x7f3ddc0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:34.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de0a00640 1 -- 172.21.15.114:0/4119660218 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878339721 0 0) 0x7f3ddc0a9420 con 0x7f3ddc0c2580 2024-02-17T12:18:34.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de1e00640 1 -- 172.21.15.114:0/4119660218 >> v1:172.21.15.116:6789/0 conn(0x7f3ddc0c1eb0 legacy=0x7f3ddc15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de1e00640 1 -- 172.21.15.114:0/4119660218 >> v1:172.21.15.114:6789/0 conn(0x7f3ddc0c2580 legacy=0x7f3ddc0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.765+0000 7f3de1e00640 1 -- 172.21.15.114:0/4119660218 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc0a9670 con 0x7f3ddc14f110 2024-02-17T12:18:34.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de1e00640 1 --2- 172.21.15.114:0/4119660218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 0x7f3ddc0c65a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009770 tx=0x7f3dd001c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f56fc7db292535 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:34.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de0a00640 1 -- 172.21.15.114:0/4119660218 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00ab400 con 0x7f3ddc14f110 2024-02-17T12:18:34.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de0a00640 1 -- 172.21.15.114:0/4119660218 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd00a7050 con 0x7f3ddc14f110 2024-02-17T12:18:34.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de0a00640 1 -- 172.21.15.114:0/4119660218 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00ab780 con 0x7f3ddc14f110 2024-02-17T12:18:34.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de4800640 1 -- 172.21.15.114:0/4119660218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 msgr2=0x7f3ddc0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de4800640 1 --2- 172.21.15.114:0/4119660218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 0x7f3ddc0c65a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009770 tx=0x7f3dd001c280 comp rx=0 tx=0).stop 2024-02-17T12:18:34.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de4800640 1 -- 172.21.15.114:0/4119660218 shutdown_connections 2024-02-17T12:18:34.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de4800640 1 --2- 172.21.15.114:0/4119660218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 0x7f3ddc0c65a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de4800640 1 -- 172.21.15.114:0/4119660218 >> 172.21.15.114:0/4119660218 conn(0x7f3ddc0a8490 msgr2=0x7f3ddc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:34.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de4800640 1 -- 172.21.15.114:0/4119660218 shutdown_connections 2024-02-17T12:18:34.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.769+0000 7f3de4800640 1 -- 172.21.15.114:0/4119660218 wait complete. 2024-02-17T12:18:34.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 Processor -- start 2024-02-17T12:18:34.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 -- start start 2024-02-17T12:18:34.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ddc0c1eb0 0x7f3ddc151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:34.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ddc0c2580 0x7f3ddc144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:34.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 0x7f3ddc144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:34.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1547c0 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1edbf0 con 0x7f3ddc0c2580 2024-02-17T12:18:34.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1451c0 con 0x7f3ddc14f110 2024-02-17T12:18:34.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ddc0c1eb0 0x7f3ddc151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:34.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ddc0c1eb0 0x7f3ddc151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48510/0 (socket says 172.21.15.114:48510) 2024-02-17T12:18:34.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de1e00640 1 -- 172.21.15.114:0/2242600607 learned_addr learned my addr 172.21.15.114:0/2242600607 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de1400640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ddc0c2580 0x7f3ddc144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de2800640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 0x7f3ddc144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de1e00640 1 -- 172.21.15.114:0/2242600607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 msgr2=0x7f3ddc144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de1e00640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 0x7f3ddc144c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de1e00640 1 -- 172.21.15.114:0/2242600607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ddc0c2580 msgr2=0x7f3ddc144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de1e00640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ddc0c2580 0x7f3ddc144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de1e00640 1 -- 172.21.15.114:0/2242600607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd0009420 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de2800640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 0x7f3ddc144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de1e00640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ddc0c1eb0 0x7f3ddc151540 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00ae040 tx=0x7f3dd001aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3dd6000640 1 -- 172.21.15.114:0/2242600607 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00abe60 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3dd6000640 1 -- 172.21.15.114:0/2242600607 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd00b7450 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3dd6000640 1 -- 172.21.15.114:0/2242600607 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00b7820 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 -- 172.21.15.114:0/2242600607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc148e30 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 -- 172.21.15.114:0/2242600607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc154200 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.773+0000 7f3de4800640 1 -- 172.21.15.114:0/2242600607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc074840 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.777+0000 7f3dd6000640 1 -- 172.21.15.114:0/2242600607 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3dd00b7980 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.777+0000 7f3dd6000640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3dc0066e40 0x7f3dc0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:34.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.777+0000 7f3dd6000640 1 -- 172.21.15.114:0/2242600607 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3dd011f460 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.777+0000 7f3de1400640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3dc0066e40 0x7f3dc0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:34.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.777+0000 7f3de1400640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3dc0066e40 0x7f3dc0069300 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0c6100 tx=0x7f3dcc007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:34.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.781+0000 7f3dd6000640 1 -- 172.21.15.114:0/2242600607 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3dd00ebee0 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.937+0000 7f3de4800640 1 -- 172.21.15.114:0/2242600607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ddc15d890 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.937+0000 7f3dd6000640 1 -- 172.21.15.114:0/2242600607 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3dd00ef5a0 con 0x7f3ddc0c1eb0 2024-02-17T12:18:34.942 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:18:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 -- 172.21.15.114:0/2242600607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3dc0066e40 msgr2=0x7f3dc0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3dc0066e40 0x7f3dc0069300 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0c6100 tx=0x7f3dcc007240 comp rx=0 tx=0).stop 2024-02-17T12:18:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 -- 172.21.15.114:0/2242600607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ddc0c1eb0 msgr2=0x7f3ddc151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ddc0c1eb0 0x7f3ddc151540 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00ae040 tx=0x7f3dd001aac0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 -- 172.21.15.114:0/2242600607 shutdown_connections 2024-02-17T12:18:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ddc14f110 0x7f3ddc144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ddc0c2580 0x7f3ddc144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3dc0066e40 0x7f3dc0069300 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 --2- 172.21.15.114:0/2242600607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ddc0c1eb0 0x7f3ddc151540 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 -- 172.21.15.114:0/2242600607 >> 172.21.15.114:0/2242600607 conn(0x7f3ddc0a8490 msgr2=0x7f3ddc14ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 -- 172.21.15.114:0/2242600607 shutdown_connections 2024-02-17T12:18:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:34.941+0000 7f3de4800640 1 -- 172.21.15.114:0/2242600607 wait complete. 2024-02-17T12:18:34.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:18:35.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab07400640 1 Processor -- start 2024-02-17T12:18:35.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab07400640 1 -- start start 2024-02-17T12:18:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab07400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab0014f110 0x7fab000c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab07400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fab000c2580 0x7fab000aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab07400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab000a9420 con 0x7fab000c1eb0 2024-02-17T12:18:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab07400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0014f4f0 con 0x7fab0014f110 2024-02-17T12:18:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab07400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000aae80 con 0x7fab000c2580 2024-02-17T12:18:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab04a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab0014f110 0x7fab000c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab05400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fab000c1eb0 0x7fab00155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60234/0 (socket says 172.21.15.114:60234) 2024-02-17T12:18:35.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab04a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fab0014f110 0x7fab000c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48518/0 (socket says 172.21.15.114:48518) 2024-02-17T12:18:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7fab04a00640 1 -- 172.21.15.114:0/2923769990 learned_addr learned my addr 172.21.15.114:0/2923769990 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.097+0000 7faaffe00640 1 --2- 172.21.15.114:0/2923769990 >> v2:172.21.15.116:3300/0 conn(0x7fab000c2580 0x7fab000aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab04a00640 1 -- 172.21.15.114:0/2923769990 >> v2:172.21.15.116:3300/0 conn(0x7fab000c2580 msgr2=0x7fab000aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab04a00640 1 --2- 172.21.15.114:0/2923769990 >> v2:172.21.15.116:3300/0 conn(0x7fab000c2580 0x7fab000aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab04a00640 1 -- 172.21.15.114:0/2923769990 >> v1:172.21.15.114:6789/0 conn(0x7fab000c1eb0 legacy=0x7fab00155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab04a00640 1 -- 172.21.15.114:0/2923769990 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab00152850 con 0x7fab0014f110 2024-02-17T12:18:35.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab04a00640 1 --2- 172.21.15.114:0/2923769990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 0x7fab000c65a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fab0006f0d0 tx=0x7faaf001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e5e97e82f3930f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:35.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7faaff400640 1 -- 172.21.15.114:0/2923769990 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00ab660 con 0x7fab0014f110 2024-02-17T12:18:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7faaff400640 1 -- 172.21.15.114:0/2923769990 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf00ab7c0 con 0x7fab0014f110 2024-02-17T12:18:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7faaff400640 1 -- 172.21.15.114:0/2923769990 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00abb50 con 0x7fab0014f110 2024-02-17T12:18:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab07400640 1 -- 172.21.15.114:0/2923769990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 msgr2=0x7fab000c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab07400640 1 --2- 172.21.15.114:0/2923769990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 0x7fab000c65a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fab0006f0d0 tx=0x7faaf001c460 comp rx=0 tx=0).stop 2024-02-17T12:18:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab07400640 1 -- 172.21.15.114:0/2923769990 shutdown_connections 2024-02-17T12:18:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab07400640 1 --2- 172.21.15.114:0/2923769990 >> v2:172.21.15.116:3300/0 conn(0x7fab000c2580 0x7fab000aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab07400640 1 --2- 172.21.15.114:0/2923769990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 0x7fab000c65a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab07400640 1 -- 172.21.15.114:0/2923769990 >> 172.21.15.114:0/2923769990 conn(0x7fab000a8490 msgr2=0x7fab000a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab07400640 1 -- 172.21.15.114:0/2923769990 shutdown_connections 2024-02-17T12:18:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.101+0000 7fab07400640 1 -- 172.21.15.114:0/2923769990 wait complete. 2024-02-17T12:18:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab07400640 1 Processor -- start 2024-02-17T12:18:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab07400640 1 -- start start 2024-02-17T12:18:35.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab07400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab000c1eb0 0x7fab00154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab07400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab000c2580 0x7fab00150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab07400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 0x7fab00144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab07400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab001537e0 con 0x7fab0014f110 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab07400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00151850 con 0x7fab000c1eb0 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab07400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab000c6110 con 0x7fab000c2580 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab05400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 0x7fab00144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab05400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 0x7fab00144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48524/0 (socket says 172.21.15.114:48524) 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab05400640 1 -- 172.21.15.114:0/1732822673 learned_addr learned my addr 172.21.15.114:0/1732822673 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab04a00640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab000c1eb0 0x7fab00154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7faaffe00640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab000c2580 0x7fab00150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab05400640 1 -- 172.21.15.114:0/1732822673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab000c2580 msgr2=0x7fab00150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab05400640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab000c2580 0x7fab00150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab05400640 1 -- 172.21.15.114:0/1732822673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab000c1eb0 msgr2=0x7fab00154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab05400640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab000c1eb0 0x7fab00154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab05400640 1 -- 172.21.15.114:0/1732822673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf00094d0 con 0x7fab0014f110 2024-02-17T12:18:35.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab05400640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 0x7fab00144740 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7faaf800c7d0 tx=0x7faaf800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7faafcc00640 1 -- 172.21.15.114:0/1732822673 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800ce80 con 0x7fab0014f110 2024-02-17T12:18:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7faafcc00640 1 -- 172.21.15.114:0/1732822673 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf800a5e0 con 0x7fab0014f110 2024-02-17T12:18:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab07400640 1 -- 172.21.15.114:0/1732822673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab000c5be0 con 0x7fab0014f110 2024-02-17T12:18:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7faafcc00640 1 -- 172.21.15.114:0/1732822673 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800a950 con 0x7fab0014f110 2024-02-17T12:18:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.105+0000 7fab07400640 1 -- 172.21.15.114:0/1732822673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab000c5e30 con 0x7fab0014f110 2024-02-17T12:18:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.109+0000 7fab07400640 1 -- 172.21.15.114:0/1732822673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0006bb70 con 0x7fab0014f110 2024-02-17T12:18:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.109+0000 7faafcc00640 1 -- 172.21.15.114:0/1732822673 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7faaf800aab0 con 0x7fab0014f110 2024-02-17T12:18:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.109+0000 7faafcc00640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faae0066e70 0x7faae0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.109+0000 7faafcc00640 1 -- 172.21.15.114:0/1732822673 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faaf8084350 con 0x7fab0014f110 2024-02-17T12:18:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.109+0000 7fab04a00640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faae0066e70 0x7faae0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.109+0000 7fab04a00640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faae0066e70 0x7faae0069330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faaf00af000 tx=0x7faaf00b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:35.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.113+0000 7faafcc00640 1 -- 172.21.15.114:0/1732822673 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faaf8050f20 con 0x7fab0014f110 2024-02-17T12:18:35.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.265+0000 7fab07400640 1 -- 172.21.15.114:0/1732822673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab00152d60 con 0x7fab0014f110 2024-02-17T12:18:35.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.265+0000 7faafcc00640 1 -- 172.21.15.114:0/1732822673 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7faaf80545e0 con 0x7fab0014f110 2024-02-17T12:18:35.270 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:18:35.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 -- 172.21.15.114:0/1732822673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faae0066e70 msgr2=0x7faae0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faae0066e70 0x7faae0069330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faaf00af000 tx=0x7faaf00b6040 comp rx=0 tx=0).stop 2024-02-17T12:18:35.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 -- 172.21.15.114:0/1732822673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 msgr2=0x7fab00144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 0x7fab00144740 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7faaf800c7d0 tx=0x7faaf800cc90 comp rx=0 tx=0).stop 2024-02-17T12:18:35.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 -- 172.21.15.114:0/1732822673 shutdown_connections 2024-02-17T12:18:35.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7faae0066e70 0x7faae0069330 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0014f110 0x7fab00144740 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab000c2580 0x7fab00150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 --2- 172.21.15.114:0/1732822673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab000c1eb0 0x7fab00154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 -- 172.21.15.114:0/1732822673 >> 172.21.15.114:0/1732822673 conn(0x7fab000a8490 msgr2=0x7fab000a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:35.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 -- 172.21.15.114:0/1732822673 shutdown_connections 2024-02-17T12:18:35.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.269+0000 7fab07400640 1 -- 172.21.15.114:0/1732822673 wait complete. 2024-02-17T12:18:35.291 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:18:35.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb163000640 1 Processor -- start 2024-02-17T12:18:35.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb163000640 1 -- start start 2024-02-17T12:18:35.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb163000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb15c14f110 0x7fb15c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb163000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c0c1eb0 0x7fb15c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb163000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15c0a9420 con 0x7fb15c0c2580 2024-02-17T12:18:35.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb163000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb15c14f4f0 con 0x7fb15c14f110 2024-02-17T12:18:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb163000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c0aae80 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb15b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb15c0c2580 0x7fb15c0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53396/0 (socket says 172.21.15.114:53396) 2024-02-17T12:18:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb15b400640 1 -- 172.21.15.114:0/1838185752 learned_addr learned my addr 172.21.15.114:0/1838185752 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb161000640 1 --2- 172.21.15.114:0/1838185752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c0c1eb0 0x7fb15c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb15be00640 1 --2- 172.21.15.114:0/1838185752 >> v2:172.21.15.116:3300/0 conn(0x7fb15c14f110 0x7fb15c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb15aa00640 1 -- 172.21.15.114:0/1838185752 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549445104 0 0) 0x7fb15c0a9420 con 0x7fb15c0c2580 2024-02-17T12:18:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb15aa00640 1 -- 172.21.15.114:0/1838185752 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb140005740 con 0x7fb15c0c2580 2024-02-17T12:18:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb15be00640 1 -- 172.21.15.114:0/1838185752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c0c1eb0 msgr2=0x7fb15c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb15be00640 1 --2- 172.21.15.114:0/1838185752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c0c1eb0 0x7fb15c15c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb15be00640 1 -- 172.21.15.114:0/1838185752 >> v1:172.21.15.114:6789/0 conn(0x7fb15c0c2580 legacy=0x7fb15c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb15be00640 1 -- 172.21.15.114:0/1838185752 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c152850 con 0x7fb15c14f110 2024-02-17T12:18:35.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.429+0000 7fb161000640 1 --2- 172.21.15.114:0/1838185752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c0c1eb0 0x7fb15c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb15be00640 1 --2- 172.21.15.114:0/1838185752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb15c14f110 0x7fb15c0c65a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0097c0 tx=0x7fb14c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ed7cffb3a09d50 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb15aa00640 1 -- 172.21.15.114:0/1838185752 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0ab600 con 0x7fb15c14f110 2024-02-17T12:18:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb15aa00640 1 -- 172.21.15.114:0/1838185752 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c0a7050 con 0x7fb15c14f110 2024-02-17T12:18:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb15aa00640 1 -- 172.21.15.114:0/1838185752 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0ab980 con 0x7fb15c14f110 2024-02-17T12:18:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb163000640 1 -- 172.21.15.114:0/1838185752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb15c14f110 msgr2=0x7fb15c0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb163000640 1 --2- 172.21.15.114:0/1838185752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb15c14f110 0x7fb15c0c65a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0097c0 tx=0x7fb14c01c3e0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb163000640 1 -- 172.21.15.114:0/1838185752 shutdown_connections 2024-02-17T12:18:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb163000640 1 --2- 172.21.15.114:0/1838185752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c0c1eb0 0x7fb15c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb163000640 1 --2- 172.21.15.114:0/1838185752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb15c14f110 0x7fb15c0c65a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb163000640 1 -- 172.21.15.114:0/1838185752 >> 172.21.15.114:0/1838185752 conn(0x7fb15c0a8490 msgr2=0x7fb15c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb163000640 1 -- 172.21.15.114:0/1838185752 shutdown_connections 2024-02-17T12:18:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.433+0000 7fb163000640 1 -- 172.21.15.114:0/1838185752 wait complete. 2024-02-17T12:18:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 Processor -- start 2024-02-17T12:18:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 -- start start 2024-02-17T12:18:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb15c0c1eb0 0x7fb15c141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb15c0c2580 0x7fb15c0c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c14f110 0x7fb15c0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c1f0d60 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c1ee970 con 0x7fb15c0c2580 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c0c6110 con 0x7fb15c14f110 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb15c0c1eb0 0x7fb15c141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb15c0c1eb0 0x7fb15c141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56112/0 (socket says 172.21.15.114:56112) 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15be00640 1 -- 172.21.15.114:0/2324910683 learned_addr learned my addr 172.21.15.114:0/2324910683 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15b400640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb15c0c2580 0x7fb15c0c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb161000640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c14f110 0x7fb15c0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15be00640 1 -- 172.21.15.114:0/2324910683 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c14f110 msgr2=0x7fb15c0c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15be00640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c14f110 0x7fb15c0c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15be00640 1 -- 172.21.15.114:0/2324910683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb15c0c2580 msgr2=0x7fb15c0c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15be00640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb15c0c2580 0x7fb15c0c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15be00640 1 -- 172.21.15.114:0/2324910683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154009a70 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15b400640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb15c0c2580 0x7fb15c0c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb15be00640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb15c0c1eb0 0x7fb15c141a50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb14c01a010 tx=0x7fb14c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb153e00640 1 -- 172.21.15.114:0/2324910683 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0abe80 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb153e00640 1 -- 172.21.15.114:0/2324910683 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c0b4430 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb153e00640 1 -- 172.21.15.114:0/2324910683 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0b47c0 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 -- 172.21.15.114:0/2324910683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c009420 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 -- 172.21.15.114:0/2324910683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15c0c5b50 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.437+0000 7fb163000640 1 -- 172.21.15.114:0/2324910683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15c0c4260 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.441+0000 7fb153e00640 1 -- 172.21.15.114:0/2324910683 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb14c0b2040 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.441+0000 7fb153e00640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb13c066e40 0x7fb13c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.441+0000 7fb153e00640 1 -- 172.21.15.114:0/2324910683 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb14c11ebd0 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.441+0000 7fb15b400640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb13c066e40 0x7fb13c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.441+0000 7fb15b400640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb13c066e40 0x7fb13c069300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb148005890 tx=0x7fb148009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.445+0000 7fb153e00640 1 -- 172.21.15.114:0/2324910683 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb14c0eb650 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.597+0000 7fb163000640 1 -- 172.21.15.114:0/2324910683 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb15c074840 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.597+0000 7fb153e00640 1 -- 172.21.15.114:0/2324910683 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb14c0eed10 con 0x7fb15c0c1eb0 2024-02-17T12:18:35.602 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:18:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 -- 172.21.15.114:0/2324910683 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb13c066e40 msgr2=0x7fb13c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb13c066e40 0x7fb13c069300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb148005890 tx=0x7fb148009040 comp rx=0 tx=0).stop 2024-02-17T12:18:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 -- 172.21.15.114:0/2324910683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb15c0c1eb0 msgr2=0x7fb15c141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb15c0c1eb0 0x7fb15c141a50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb14c01a010 tx=0x7fb14c019180 comp rx=0 tx=0).stop 2024-02-17T12:18:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 -- 172.21.15.114:0/2324910683 shutdown_connections 2024-02-17T12:18:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb15c14f110 0x7fb15c0c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb15c0c2580 0x7fb15c0c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb13c066e40 0x7fb13c069300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 --2- 172.21.15.114:0/2324910683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb15c0c1eb0 0x7fb15c141a50 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 -- 172.21.15.114:0/2324910683 >> 172.21.15.114:0/2324910683 conn(0x7fb15c0a8490 msgr2=0x7fb15c0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 -- 172.21.15.114:0/2324910683 shutdown_connections 2024-02-17T12:18:35.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.601+0000 7fb163000640 1 -- 172.21.15.114:0/2324910683 wait complete. 2024-02-17T12:18:35.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:18:35.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa49ca00640 1 Processor -- start 2024-02-17T12:18:35.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa49ca00640 1 -- start start 2024-02-17T12:18:35.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa49ca00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa4980c2580 0x7fa4980aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa49ca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4980c1eb0 0x7fa49815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa49ca00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4980a9420 con 0x7fa49814f110 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa49ca00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49814f4f0 con 0x7fa4980c2580 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa49ca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980aae80 con 0x7fa4980c1eb0 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa495e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa49814f110 0x7fa4980c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53402/0 (socket says 172.21.15.114:53402) 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa495e00640 1 -- 172.21.15.114:0/322167991 learned_addr learned my addr 172.21.15.114:0/322167991 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa495400640 1 --2- 172.21.15.114:0/322167991 >> v2:172.21.15.116:3300/0 conn(0x7fa4980c2580 0x7fa4980aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa496800640 1 --2- 172.21.15.114:0/322167991 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4980c1eb0 0x7fa49815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa494a00640 1 -- 172.21.15.114:0/322167991 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989014644 0 0) 0x7fa4980a9420 con 0x7fa49814f110 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa495400640 1 -- 172.21.15.114:0/322167991 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4980c1eb0 msgr2=0x7fa49815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa495400640 1 --2- 172.21.15.114:0/322167991 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4980c1eb0 0x7fa49815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa495400640 1 -- 172.21.15.114:0/322167991 >> v1:172.21.15.114:6789/0 conn(0x7fa49814f110 legacy=0x7fa4980c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.757+0000 7fa495400640 1 -- 172.21.15.114:0/322167991 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498152850 con 0x7fa4980c2580 2024-02-17T12:18:35.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa495400640 1 --2- 172.21.15.114:0/322167991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4980c2580 0x7fa4980aa150 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4840097c0 tx=0x7fa48401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=451181406c34ab97 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:35.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa494a00640 1 -- 172.21.15.114:0/322167991 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840ac640 con 0x7fa4980c2580 2024-02-17T12:18:35.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa494a00640 1 -- 172.21.15.114:0/322167991 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4840ac7a0 con 0x7fa4980c2580 2024-02-17T12:18:35.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa494a00640 1 -- 172.21.15.114:0/322167991 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840acb30 con 0x7fa4980c2580 2024-02-17T12:18:35.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa49ca00640 1 -- 172.21.15.114:0/322167991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4980c2580 msgr2=0x7fa4980aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa49ca00640 1 --2- 172.21.15.114:0/322167991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4980c2580 0x7fa4980aa150 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4840097c0 tx=0x7fa48401c3e0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa49ca00640 1 -- 172.21.15.114:0/322167991 shutdown_connections 2024-02-17T12:18:35.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa49ca00640 1 --2- 172.21.15.114:0/322167991 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4980c1eb0 0x7fa49815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa49ca00640 1 --2- 172.21.15.114:0/322167991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4980c2580 0x7fa4980aa150 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa49ca00640 1 -- 172.21.15.114:0/322167991 >> 172.21.15.114:0/322167991 conn(0x7fa4980a8490 msgr2=0x7fa4980a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:35.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa49ca00640 1 -- 172.21.15.114:0/322167991 shutdown_connections 2024-02-17T12:18:35.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.761+0000 7fa49ca00640 1 -- 172.21.15.114:0/322167991 wait complete. 2024-02-17T12:18:35.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa49ca00640 1 Processor -- start 2024-02-17T12:18:35.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa49ca00640 1 -- start start 2024-02-17T12:18:35.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa49ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4980c1eb0 0x7fa4980c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa49ca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4980c2580 0x7fa49813c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa49ca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa49814f110 0x7fa4981eb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa49ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980c3f60 con 0x7fa4980c1eb0 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa49ca00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4980c4240 con 0x7fa49814f110 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa49ca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49813c540 con 0x7fa4980c2580 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa495e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4980c1eb0 0x7fa4980c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa495e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4980c1eb0 0x7fa4980c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56114/0 (socket says 172.21.15.114:56114) 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa495e00640 1 -- 172.21.15.114:0/181308491 learned_addr learned my addr 172.21.15.114:0/181308491 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa495400640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4980c2580 0x7fa49813c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa496800640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa49814f110 0x7fa4981eb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa495e00640 1 -- 172.21.15.114:0/181308491 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4980c2580 msgr2=0x7fa49813c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa495e00640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4980c2580 0x7fa49813c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa495e00640 1 -- 172.21.15.114:0/181308491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa49814f110 msgr2=0x7fa4981eb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa495e00640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa49814f110 0x7fa4981eb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa495e00640 1 -- 172.21.15.114:0/181308491 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa484009420 con 0x7fa4980c1eb0 2024-02-17T12:18:35.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa496800640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa49814f110 0x7fa4981eb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:35.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa495e00640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4980c1eb0 0x7fa4980c46d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa4880011f0 tx=0x7fa48800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:35.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa48e000640 1 -- 172.21.15.114:0/181308491 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4880074e0 con 0x7fa4980c1eb0 2024-02-17T12:18:35.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa48e000640 1 -- 172.21.15.114:0/181308491 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa488007640 con 0x7fa4980c1eb0 2024-02-17T12:18:35.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa48e000640 1 -- 172.21.15.114:0/181308491 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488004a10 con 0x7fa4980c1eb0 2024-02-17T12:18:35.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa49ca00640 1 -- 172.21.15.114:0/181308491 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49814e200 con 0x7fa4980c1eb0 2024-02-17T12:18:35.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.765+0000 7fa49ca00640 1 -- 172.21.15.114:0/181308491 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49814e7c0 con 0x7fa4980c1eb0 2024-02-17T12:18:35.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.769+0000 7fa49ca00640 1 -- 172.21.15.114:0/181308491 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa498074840 con 0x7fa4980c1eb0 2024-02-17T12:18:35.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.769+0000 7fa48e000640 1 -- 172.21.15.114:0/181308491 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa488004b70 con 0x7fa4980c1eb0 2024-02-17T12:18:35.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.769+0000 7fa48e000640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa478066e40 0x7fa478069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:35.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.769+0000 7fa48e000640 1 -- 172.21.15.114:0/181308491 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa4880842a0 con 0x7fa4980c1eb0 2024-02-17T12:18:35.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.769+0000 7fa495400640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa478066e40 0x7fa478069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:35.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.769+0000 7fa495400640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa478066e40 0x7fa478069300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ae000 tx=0x7fa484008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:35.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.773+0000 7fa48e000640 1 -- 172.21.15.114:0/181308491 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa488050e10 con 0x7fa4980c1eb0 2024-02-17T12:18:35.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.925+0000 7fa49ca00640 1 -- 172.21.15.114:0/181308491 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa498155da0 con 0x7fa4980c1eb0 2024-02-17T12:18:35.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa48e000640 1 -- 172.21.15.114:0/181308491 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa4880544d0 con 0x7fa4980c1eb0 2024-02-17T12:18:35.931 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 -- 172.21.15.114:0/181308491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa478066e40 msgr2=0x7fa478069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa478066e40 0x7fa478069300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ae000 tx=0x7fa484008040 comp rx=0 tx=0).stop 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 -- 172.21.15.114:0/181308491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4980c1eb0 msgr2=0x7fa4980c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4980c1eb0 0x7fa4980c46d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa4880011f0 tx=0x7fa48800c9b0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 -- 172.21.15.114:0/181308491 shutdown_connections 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa49814f110 0x7fa4981eb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4980c2580 0x7fa49813c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa478066e40 0x7fa478069300 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 --2- 172.21.15.114:0/181308491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4980c1eb0 0x7fa4980c46d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 -- 172.21.15.114:0/181308491 >> 172.21.15.114:0/181308491 conn(0x7fa4980a8490 msgr2=0x7fa49813fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 -- 172.21.15.114:0/181308491 shutdown_connections 2024-02-17T12:18:35.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:35.929+0000 7fa49ca00640 1 -- 172.21.15.114:0/181308491 wait complete. 2024-02-17T12:18:35.952 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:18:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.085+0000 7fbb5e400640 1 Processor -- start 2024-02-17T12:18:36.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.085+0000 7fbb5e400640 1 -- start start 2024-02-17T12:18:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb5e400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbb580c2580 0x7fbb580aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb5e400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb580c1eb0 0x7fbb5815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb5e400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580a9420 con 0x7fbb5814f110 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb5e400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5814f4f0 con 0x7fbb580c1eb0 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb5e400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb580aae80 con 0x7fbb580c2580 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb57e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb580c1eb0 0x7fbb5815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb57e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb580c1eb0 0x7fbb5815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56128/0 (socket says 172.21.15.114:56128) 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb57e00640 1 -- 172.21.15.114:0/2904566188 learned_addr learned my addr 172.21.15.114:0/2904566188 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb56a00640 1 --2- 172.21.15.114:0/2904566188 >> v2:172.21.15.116:3300/0 conn(0x7fbb580c2580 0x7fbb580aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb57e00640 1 -- 172.21.15.114:0/2904566188 >> v2:172.21.15.116:3300/0 conn(0x7fbb580c2580 msgr2=0x7fbb580aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb57e00640 1 --2- 172.21.15.114:0/2904566188 >> v2:172.21.15.116:3300/0 conn(0x7fbb580c2580 0x7fbb580aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb57e00640 1 -- 172.21.15.114:0/2904566188 >> v1:172.21.15.116:6789/0 conn(0x7fbb5814f110 legacy=0x7fbb580c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb57e00640 1 -- 172.21.15.114:0/2904566188 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58152850 con 0x7fbb580c1eb0 2024-02-17T12:18:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.089+0000 7fbb57e00640 1 --2- 172.21.15.114:0/2904566188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb580c1eb0 0x7fbb5815c390 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbb5806f0d0 tx=0x7fbb5001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7c5d6bffc2fcbe server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:36.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb56000640 1 -- 172.21.15.114:0/2904566188 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb500a57f0 con 0x7fbb580c1eb0 2024-02-17T12:18:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb56000640 1 -- 172.21.15.114:0/2904566188 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb500a5950 con 0x7fbb580c1eb0 2024-02-17T12:18:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb56000640 1 -- 172.21.15.114:0/2904566188 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb500a5ce0 con 0x7fbb580c1eb0 2024-02-17T12:18:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 -- 172.21.15.114:0/2904566188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb580c1eb0 msgr2=0x7fbb5815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 --2- 172.21.15.114:0/2904566188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb580c1eb0 0x7fbb5815c390 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbb5806f0d0 tx=0x7fbb5001c930 comp rx=0 tx=0).stop 2024-02-17T12:18:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 -- 172.21.15.114:0/2904566188 shutdown_connections 2024-02-17T12:18:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 --2- 172.21.15.114:0/2904566188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb580c1eb0 0x7fbb5815c390 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 --2- 172.21.15.114:0/2904566188 >> v2:172.21.15.116:3300/0 conn(0x7fbb580c2580 0x7fbb580aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 -- 172.21.15.114:0/2904566188 >> 172.21.15.114:0/2904566188 conn(0x7fbb580a8490 msgr2=0x7fbb580a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 -- 172.21.15.114:0/2904566188 shutdown_connections 2024-02-17T12:18:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 -- 172.21.15.114:0/2904566188 wait complete. 2024-02-17T12:18:36.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 Processor -- start 2024-02-17T12:18:36.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 -- start start 2024-02-17T12:18:36.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb580c1eb0 0x7fbb581ee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb580c2580 0x7fbb58148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5814f110 0x7fbb5814feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580c4640 con 0x7fbb5814f110 2024-02-17T12:18:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581eea00 con 0x7fbb580c2580 2024-02-17T12:18:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb5e400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580c48e0 con 0x7fbb580c1eb0 2024-02-17T12:18:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5814f110 0x7fbb5814feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5814f110 0x7fbb5814feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56144/0 (socket says 172.21.15.114:56144) 2024-02-17T12:18:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb57e00640 1 -- 172.21.15.114:0/2391409439 learned_addr learned my addr 172.21.15.114:0/2391409439 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb56a00640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb580c2580 0x7fbb58148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.093+0000 7fbb57400640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb580c1eb0 0x7fbb581ee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb57e00640 1 -- 172.21.15.114:0/2391409439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb580c1eb0 msgr2=0x7fbb581ee4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb57e00640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb580c1eb0 0x7fbb581ee4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb57e00640 1 -- 172.21.15.114:0/2391409439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb580c2580 msgr2=0x7fbb58148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb57e00640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb580c2580 0x7fbb58148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb57e00640 1 -- 172.21.15.114:0/2391409439 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50009b30 con 0x7fbb5814f110 2024-02-17T12:18:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb57e00640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5814f110 0x7fbb5814feb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbb500af040 tx=0x7fbb500196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb4f400640 1 -- 172.21.15.114:0/2391409439 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb500b6640 con 0x7fbb5814f110 2024-02-17T12:18:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb4f400640 1 -- 172.21.15.114:0/2391409439 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb500b67c0 con 0x7fbb5814f110 2024-02-17T12:18:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb4f400640 1 -- 172.21.15.114:0/2391409439 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb500b6b70 con 0x7fbb5814f110 2024-02-17T12:18:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb5e400640 1 -- 172.21.15.114:0/2391409439 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb581455a0 con 0x7fbb5814f110 2024-02-17T12:18:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb5e400640 1 -- 172.21.15.114:0/2391409439 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb58143f50 con 0x7fbb5814f110 2024-02-17T12:18:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb5e400640 1 -- 172.21.15.114:0/2391409439 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb58074840 con 0x7fbb5814f110 2024-02-17T12:18:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.097+0000 7fbb4f400640 1 -- 172.21.15.114:0/2391409439 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbb500b6cd0 con 0x7fbb5814f110 2024-02-17T12:18:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.101+0000 7fbb4f400640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb38066e40 0x7fbb38069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.101+0000 7fbb4f400640 1 -- 172.21.15.114:0/2391409439 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbb50120140 con 0x7fbb5814f110 2024-02-17T12:18:36.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.101+0000 7fbb57400640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb38066e40 0x7fbb38069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.101+0000 7fbb57400640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb38066e40 0x7fbb38069300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbb48001810 tx=0x7fbb48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:36.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.105+0000 7fbb4f400640 1 -- 172.21.15.114:0/2391409439 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb500ecc70 con 0x7fbb5814f110 2024-02-17T12:18:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 -- 172.21.15.114:0/2391409439 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fbb580c4a20 con 0x7fbb5814f110 2024-02-17T12:18:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb4f400640 1 -- 172.21.15.114:0/2391409439 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7fbb500f0330 con 0x7fbb5814f110 2024-02-17T12:18:36.260 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:18:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 -- 172.21.15.114:0/2391409439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb38066e40 msgr2=0x7fbb38069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb38066e40 0x7fbb38069300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbb48001810 tx=0x7fbb48009040 comp rx=0 tx=0).stop 2024-02-17T12:18:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 -- 172.21.15.114:0/2391409439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5814f110 msgr2=0x7fbb5814feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5814f110 0x7fbb5814feb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbb500af040 tx=0x7fbb500196d0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 -- 172.21.15.114:0/2391409439 shutdown_connections 2024-02-17T12:18:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb38066e40 0x7fbb38069300 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb5814f110 0x7fbb5814feb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb580c2580 0x7fbb58148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 --2- 172.21.15.114:0/2391409439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb580c1eb0 0x7fbb581ee4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 -- 172.21.15.114:0/2391409439 >> 172.21.15.114:0/2391409439 conn(0x7fbb580a8490 msgr2=0x7fbb580bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 -- 172.21.15.114:0/2391409439 shutdown_connections 2024-02-17T12:18:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.257+0000 7fbb5e400640 1 -- 172.21.15.114:0/2391409439 wait complete. 2024-02-17T12:18:36.281 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:18:36.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.417+0000 7ffa35800640 1 Processor -- start 2024-02-17T12:18:36.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa35800640 1 -- start start 2024-02-17T12:18:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa35800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa300c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa35800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa3006ef60 0x7ffa30158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa35800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3006e890 con 0x7ffa300c0640 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa35800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300c2670 con 0x7ffa3006ef60 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa35800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30158370 con 0x7ffa30152510 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa2e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa3006ef60 0x7ffa30158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa2e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa3006ef60 0x7ffa30158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56152/0 (socket says 172.21.15.114:56152) 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa2e000640 1 -- 172.21.15.114:0/4247162552 learned_addr learned my addr 172.21.15.114:0/4247162552 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa2ea00640 1 --2- 172.21.15.114:0/4247162552 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa300c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa2e000640 1 -- 172.21.15.114:0/4247162552 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 msgr2=0x7ffa300c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa2e000640 1 --2- 172.21.15.114:0/4247162552 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa300c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa2e000640 1 -- 172.21.15.114:0/4247162552 >> v1:172.21.15.114:6789/0 conn(0x7ffa300c0640 legacy=0x7ffa300c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa2e000640 1 -- 172.21.15.114:0/4247162552 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3006e5b0 con 0x7ffa3006ef60 2024-02-17T12:18:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.421+0000 7ffa2ea00640 1 --2- 172.21.15.114:0/4247162552 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa300c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa2e000640 1 --2- 172.21.15.114:0/4247162552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3006ef60 0x7ffa30158800 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009870 tx=0x7ffa1c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d67c3ca1931a50a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa2d600640 1 -- 172.21.15.114:0/4247162552 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0a6040 con 0x7ffa3006ef60 2024-02-17T12:18:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa2d600640 1 -- 172.21.15.114:0/4247162552 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c0aa600 con 0x7ffa3006ef60 2024-02-17T12:18:36.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa2d600640 1 -- 172.21.15.114:0/4247162552 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0aa990 con 0x7ffa3006ef60 2024-02-17T12:18:36.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa35800640 1 -- 172.21.15.114:0/4247162552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3006ef60 msgr2=0x7ffa30158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa35800640 1 --2- 172.21.15.114:0/4247162552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3006ef60 0x7ffa30158800 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009870 tx=0x7ffa1c01c4a0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa35800640 1 -- 172.21.15.114:0/4247162552 shutdown_connections 2024-02-17T12:18:36.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa35800640 1 --2- 172.21.15.114:0/4247162552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3006ef60 0x7ffa30158800 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa35800640 1 --2- 172.21.15.114:0/4247162552 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa300c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa35800640 1 -- 172.21.15.114:0/4247162552 >> 172.21.15.114:0/4247162552 conn(0x7ffa300a8490 msgr2=0x7ffa300a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa35800640 1 -- 172.21.15.114:0/4247162552 shutdown_connections 2024-02-17T12:18:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa35800640 1 -- 172.21.15.114:0/4247162552 wait complete. 2024-02-17T12:18:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa35800640 1 Processor -- start 2024-02-17T12:18:36.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.425+0000 7ffa35800640 1 -- start start 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa35800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa3006ef60 0x7ffa3013d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa35800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa300c0640 0x7ffa30071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa35800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa30152510 0x7ffa30153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa35800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3013aa60 con 0x7ffa30152510 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa35800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30146500 con 0x7ffa3006ef60 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa35800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30072a20 con 0x7ffa300c0640 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa30152510 0x7ffa30153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa30152510 0x7ffa30153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56160/0 (socket says 172.21.15.114:56160) 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2f400640 1 -- 172.21.15.114:0/2688270706 learned_addr learned my addr 172.21.15.114:0/2688270706 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2ea00640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa3006ef60 0x7ffa3013d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2e000640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa300c0640 0x7ffa30071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2f400640 1 -- 172.21.15.114:0/2688270706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa300c0640 msgr2=0x7ffa30071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2f400640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa300c0640 0x7ffa30071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2f400640 1 -- 172.21.15.114:0/2688270706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa3006ef60 msgr2=0x7ffa3013d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2f400640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa3006ef60 0x7ffa3013d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2f400640 1 -- 172.21.15.114:0/2688270706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c0094d0 con 0x7ffa30152510 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa2f400640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa30152510 0x7ffa30153e10 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800c7d0 tx=0x7ffa2800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa26a00640 1 -- 172.21.15.114:0/2688270706 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28003b80 con 0x7ffa30152510 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa26a00640 1 -- 172.21.15.114:0/2688270706 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa28003ce0 con 0x7ffa30152510 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa35800640 1 -- 172.21.15.114:0/2688270706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa300721c0 con 0x7ffa30152510 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa26a00640 1 -- 172.21.15.114:0/2688270706 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800aa30 con 0x7ffa30152510 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa35800640 1 -- 172.21.15.114:0/2688270706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa30072740 con 0x7ffa30152510 2024-02-17T12:18:36.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa35800640 1 -- 172.21.15.114:0/2688270706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa30074840 con 0x7ffa30152510 2024-02-17T12:18:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.429+0000 7ffa26a00640 1 -- 172.21.15.114:0/2688270706 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ffa2800ab90 con 0x7ffa30152510 2024-02-17T12:18:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.433+0000 7ffa26a00640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e40 0x7ffa10069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.433+0000 7ffa26a00640 1 -- 172.21.15.114:0/2688270706 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffa28084a20 con 0x7ffa30152510 2024-02-17T12:18:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.433+0000 7ffa2ea00640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e40 0x7ffa10069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.433+0000 7ffa2ea00640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e40 0x7ffa10069300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009950 tx=0x7ffa20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:36.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.437+0000 7ffa26a00640 1 -- 172.21.15.114:0/2688270706 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa280515f0 con 0x7ffa30152510 2024-02-17T12:18:36.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.597+0000 7ffa35800640 1 -- 172.21.15.114:0/2688270706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffa30146640 con 0x7ffa30152510 2024-02-17T12:18:36.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa26a00640 1 -- 172.21.15.114:0/2688270706 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffa28054cb0 con 0x7ffa30152510 2024-02-17T12:18:36.603 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:18:36.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 -- 172.21.15.114:0/2688270706 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e40 msgr2=0x7ffa10069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e40 0x7ffa10069300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009950 tx=0x7ffa20008040 comp rx=0 tx=0).stop 2024-02-17T12:18:36.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 -- 172.21.15.114:0/2688270706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa30152510 msgr2=0x7ffa30153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa30152510 0x7ffa30153e10 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800c7d0 tx=0x7ffa2800cc90 comp rx=0 tx=0).stop 2024-02-17T12:18:36.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 -- 172.21.15.114:0/2688270706 shutdown_connections 2024-02-17T12:18:36.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e40 0x7ffa10069300 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa30152510 0x7ffa30153e10 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa300c0640 0x7ffa30071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 --2- 172.21.15.114:0/2688270706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa3006ef60 0x7ffa3013d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 -- 172.21.15.114:0/2688270706 >> 172.21.15.114:0/2688270706 conn(0x7ffa300a8490 msgr2=0x7ffa3006da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:36.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 -- 172.21.15.114:0/2688270706 shutdown_connections 2024-02-17T12:18:36.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.601+0000 7ffa35800640 1 -- 172.21.15.114:0/2688270706 wait complete. 2024-02-17T12:18:36.624 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-17T12:18:36.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:36.625 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-17T12:18:36.651 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:18:36.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:36.651 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-17T12:18:36.703 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:18:36.703 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:36.754 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354568k,nr_inodes=4088642,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2004 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-17T12:18:36.754 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:18:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.929+0000 7fbc56600640 1 Processor -- start 2024-02-17T12:18:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.929+0000 7fbc56600640 1 -- start start 2024-02-17T12:18:36.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc56600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc5014f110 0x7fbc500c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc56600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc500c2580 0x7fbc500aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc56600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc500a9420 con 0x7fbc500c1eb0 2024-02-17T12:18:36.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc56600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5014f4f0 con 0x7fbc500c2580 2024-02-17T12:18:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc56600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500aae80 con 0x7fbc5014f110 2024-02-17T12:18:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc46a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc500c2580 0x7fbc500aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc4fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbc500c1eb0 0x7fbc50155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53416/0 (socket says 172.21.15.114:53416) 2024-02-17T12:18:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc4fe00640 1 -- 172.21.15.114:0/3323069205 learned_addr learned my addr 172.21.15.114:0/3323069205 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc4f400640 1 --2- 172.21.15.114:0/3323069205 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc5014f110 0x7fbc500c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc46a00640 1 -- 172.21.15.114:0/3323069205 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc5014f110 msgr2=0x7fbc500c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc4ea00640 1 -- 172.21.15.114:0/3323069205 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181304640 0 0) 0x7fbc500a9420 con 0x7fbc500c1eb0 2024-02-17T12:18:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc46a00640 1 --2- 172.21.15.114:0/3323069205 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc5014f110 0x7fbc500c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc46a00640 1 -- 172.21.15.114:0/3323069205 >> v1:172.21.15.114:6789/0 conn(0x7fbc500c1eb0 legacy=0x7fbc50155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc46a00640 1 -- 172.21.15.114:0/3323069205 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50152850 con 0x7fbc500c2580 2024-02-17T12:18:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc4f400640 1 --2- 172.21.15.114:0/3323069205 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc5014f110 0x7fbc500c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:36.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc46a00640 1 --2- 172.21.15.114:0/3323069205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 0x7fbc500aa150 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fbc380097c0 tx=0x7fbc3801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6b4808bae031f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:36.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.933+0000 7fbc4ea00640 1 -- 172.21.15.114:0/3323069205 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380ac640 con 0x7fbc500c2580 2024-02-17T12:18:36.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc4ea00640 1 -- 172.21.15.114:0/3323069205 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380ac7a0 con 0x7fbc500c2580 2024-02-17T12:18:36.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc4ea00640 1 -- 172.21.15.114:0/3323069205 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380acb30 con 0x7fbc500c2580 2024-02-17T12:18:36.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 -- 172.21.15.114:0/3323069205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 msgr2=0x7fbc500aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 --2- 172.21.15.114:0/3323069205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 0x7fbc500aa150 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fbc380097c0 tx=0x7fbc3801c3e0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 -- 172.21.15.114:0/3323069205 shutdown_connections 2024-02-17T12:18:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 --2- 172.21.15.114:0/3323069205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 0x7fbc500aa150 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 --2- 172.21.15.114:0/3323069205 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc5014f110 0x7fbc500c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 -- 172.21.15.114:0/3323069205 >> 172.21.15.114:0/3323069205 conn(0x7fbc500a8490 msgr2=0x7fbc500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 -- 172.21.15.114:0/3323069205 shutdown_connections 2024-02-17T12:18:36.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 -- 172.21.15.114:0/3323069205 wait complete. 2024-02-17T12:18:36.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 Processor -- start 2024-02-17T12:18:36.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 -- start start 2024-02-17T12:18:36.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc500c1eb0 0x7fbc501ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 0x7fbc500bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc5014f110 0x7fbc501f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50151000 con 0x7fbc500c2580 2024-02-17T12:18:36.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc501f10d0 con 0x7fbc500c1eb0 2024-02-17T12:18:36.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc56600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50148cd0 con 0x7fbc5014f110 2024-02-17T12:18:36.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc46a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 0x7fbc500bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc46a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 0x7fbc500bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56178/0 (socket says 172.21.15.114:56178) 2024-02-17T12:18:36.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc46a00640 1 -- 172.21.15.114:0/2166294272 learned_addr learned my addr 172.21.15.114:0/2166294272 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:36.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc46a00640 1 -- 172.21.15.114:0/2166294272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc5014f110 msgr2=0x7fbc501f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc46a00640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc5014f110 0x7fbc501f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc46a00640 1 -- 172.21.15.114:0/2166294272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc500c1eb0 msgr2=0x7fbc501ed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:36.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc46a00640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc500c1eb0 0x7fbc501ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:36.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc46a00640 1 -- 172.21.15.114:0/2166294272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38009420 con 0x7fbc500c2580 2024-02-17T12:18:36.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.937+0000 7fbc46a00640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 0x7fbc500bfa00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbc380af040 tx=0x7fbc38019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:36.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc47e00640 1 -- 172.21.15.114:0/2166294272 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380b5820 con 0x7fbc500c2580 2024-02-17T12:18:36.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc47e00640 1 -- 172.21.15.114:0/2166294272 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380b5980 con 0x7fbc500c2580 2024-02-17T12:18:36.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc56600640 1 -- 172.21.15.114:0/2166294272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc50151620 con 0x7fbc500c2580 2024-02-17T12:18:36.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc47e00640 1 -- 172.21.15.114:0/2166294272 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380b5d30 con 0x7fbc500c2580 2024-02-17T12:18:36.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc56600640 1 -- 172.21.15.114:0/2166294272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc500bff40 con 0x7fbc500c2580 2024-02-17T12:18:36.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc56600640 1 -- 172.21.15.114:0/2166294272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5006bb70 con 0x7fbc500c2580 2024-02-17T12:18:36.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc47e00640 1 -- 172.21.15.114:0/2166294272 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbc380b3040 con 0x7fbc500c2580 2024-02-17T12:18:36.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc47e00640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc2c066e40 0x7fbc2c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:36.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc47e00640 1 -- 172.21.15.114:0/2166294272 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbc3811f3b0 con 0x7fbc500c2580 2024-02-17T12:18:36.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc4f400640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc2c066e40 0x7fbc2c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:36.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.941+0000 7fbc4f400640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc2c066e40 0x7fbc2c069300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc40008e00 tx=0x7fbc40008330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:36.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:36.945+0000 7fbc47e00640 1 -- 172.21.15.114:0/2166294272 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbc380ebe30 con 0x7fbc500c2580 2024-02-17T12:18:37.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 -- 172.21.15.114:0/2166294272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbc50151ad0 con 0x7fbc500c2580 2024-02-17T12:18:37.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc47e00640 1 -- 172.21.15.114:0/2166294272 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+149 (secure 0 0 0) 0x7fbc380ef4f0 con 0x7fbc500c2580 2024-02-17T12:18:37.139 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:18:37.140 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-02-17T12:18:37.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 -- 172.21.15.114:0/2166294272 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc2c066e40 msgr2=0x7fbc2c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:37.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc2c066e40 0x7fbc2c069300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc40008e00 tx=0x7fbc40008330 comp rx=0 tx=0).stop 2024-02-17T12:18:37.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 -- 172.21.15.114:0/2166294272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 msgr2=0x7fbc500bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:37.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 0x7fbc500bfa00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbc380af040 tx=0x7fbc38019180 comp rx=0 tx=0).stop 2024-02-17T12:18:37.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 -- 172.21.15.114:0/2166294272 shutdown_connections 2024-02-17T12:18:37.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc5014f110 0x7fbc501f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:37.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc2c066e40 0x7fbc2c069300 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:37.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc500c2580 0x7fbc500bfa00 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:37.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 --2- 172.21.15.114:0/2166294272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc500c1eb0 0x7fbc501ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:37.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 -- 172.21.15.114:0/2166294272 >> 172.21.15.114:0/2166294272 conn(0x7fbc500a8490 msgr2=0x7fbc500a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:37.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 -- 172.21.15.114:0/2166294272 shutdown_connections 2024-02-17T12:18:37.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:37.137+0000 7fbc56600640 1 -- 172.21.15.114:0/2166294272 wait complete. 2024-02-17T12:18:37.161 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-02-17T12:18:37.161 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:18:37.161 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-02-17T12:18:37.161 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-02-17T12:18:37.161 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:18:37.161 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-02-17T12:18:37.161 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:18:37.161 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.Tt9hlw19Ki 2024-02-17T12:18:37.161 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-02-17T12:18:37.170 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.t0LXOvNNwu 2024-02-17T12:18:37.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /tmp/tmp.Tt9hlw19Ki /tmp/tmp.t0LXOvNNwu 2024-02-17T12:18:37.233 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.t0LXOvNNwu 2024-02-17T12:18:37.351 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.t0LXOvNNwu is 245B 2024-02-17T12:18:37.366 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.t0LXOvNNwu 2024-02-17T12:18:37.373 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAZpNBlBjd9KRAAIBSuvSKH31txYdkcjazvHg== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2024-02-17T12:18:37.374 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:18:37.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:37.374 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-02-17T12:18:37.426 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:18:37.427 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42369sec preferred_lft 42369sec 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:a0:c1:dc:19 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:18:37.428 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:18:37.429 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:18:37.429 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:37.429 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:18:37.429 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:37.429 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:18:37.429 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:18:37.429 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:18:37.429 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:18:37.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:37.430 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:18:37.487 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-02-17T12:18:37.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:37.492 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-02-17T12:18:37.544 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-02-17T12:18:37.544 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:18:37.544 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:18:37.544 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:18:37.544 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:18:37.544 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:18:37.544 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:37.545 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:37.545 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:18:37.545 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:18:37.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:37.545 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:18:37.545 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:18:37.545 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:18:37.545 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:18:37.545 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:18:37.546 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:18:37.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:37.634 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-02-17T12:18:37.642 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T12:18:37.642 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:18:37.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:37.643 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-02-17T12:18:37.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:18:37.705 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T12:18:37.755 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:18:37.755 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:18:37.755 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:18:37.805 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:18:37.805 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/tmp/tmp.Tt9hlw19Ki of=/dev/stdout 2024-02-17T12:18:37.854 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:18:37.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:37.854 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAZpNBlBjd9KRAAIBSuvSKH31txYdkcjazvHg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:18:37.947 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQAZpNBlBjd9KRAAIBSuvSKH31txYdkcjazvHg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:18:37.947 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-02-17T12:18:37.947 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:18:37.947 INFO:teuthology.orchestra.run.smithi114.stdout:keyring.get_secret failed 2024-02-17T12:18:37.962 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQAZpNBlBjd9KRAAIBSuvSKH31txYdkcjazvHg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:18:37.963 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-02-17T12:18:37.963 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:18:37.963 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:18:37.963 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:18:37.963 INFO:teuthology.orchestra.run.smithi114.stdout:keyring.get_secret failed 2024-02-17T12:18:37.969 INFO:teuthology.orchestra.run.smithi114.stderr:mount error 13 = Permission denied 2024-02-17T12:18:37.970 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQAZpNBlBjd9KRAAIBSuvSKH31txYdkcjazvHg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:18:37.970 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-02-17T12:18:37.970 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:18:37.971 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:18:37.971 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:18:37.971 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:18:37.971 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:18:37.971 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:18:37.974 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-17T12:18:37.974 INFO:tasks.cephfs.kernel_mount:mount command failed 2024-02-17T12:18:37.974 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-17T12:18:37.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:18:38.121 DEBUG:teuthology.orchestra.run.smithi116:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:18:38.193 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-17T12:18:38.193 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:18:38.193 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:38.202 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354568k,nr_inodes=4088642,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2004 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-17T12:18:38.202 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:18:38.202 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:38.211 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:18:38.212 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:38.266 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:38.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dd1a00640 1 Processor -- start 2024-02-17T12:18:38.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dd1a00640 1 -- start start 2024-02-17T12:18:38.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dd1a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1dcc0c1eb0 0x7f1dcc15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dd1a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0a9420 con 0x7f1dcc0c2580 2024-02-17T12:18:38.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dd1a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc152850 con 0x7f1dcc14f110 2024-02-17T12:18:38.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dd1a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc14f4f0 con 0x7f1dcc0c1eb0 2024-02-17T12:18:38.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dca000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1dcc0c2580 0x7f1dcc0aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53428/0 (socket says 172.21.15.114:53428) 2024-02-17T12:18:38.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dca000640 1 -- 172.21.15.114:0/2971154158 learned_addr learned my addr 172.21.15.114:0/2971154158 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:38.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dcb400640 1 --2- 172.21.15.114:0/2971154158 >> v2:172.21.15.116:3300/0 conn(0x7f1dcc0c1eb0 0x7f1dcc15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053494249 0 0) 0x7f1dcc0a9420 con 0x7f1dcc0c2580 2024-02-17T12:18:38.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db0003530 con 0x7f1dcc0c2580 2024-02-17T12:18:38.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1004683534 0 0) 0x7f1db0003530 con 0x7f1dcc0c2580 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 >> v2:172.21.15.116:3300/0 conn(0x7f1dcc0c1eb0 msgr2=0x7f1dcc15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 --2- 172.21.15.114:0/2971154158 >> v2:172.21.15.116:3300/0 conn(0x7f1dcc0c1eb0 0x7f1dcc15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 >> v1:172.21.15.116:6789/0 conn(0x7f1dcc14f110 legacy=0x7f1dcc0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0a9670 con 0x7f1dcc0c2580 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f1db8001680 con 0x7f1dcc0c2580 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 >> v1:172.21.15.114:6789/0 conn(0x7f1dcc0c2580 legacy=0x7f1dcc0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1db0003980 0x7f1db0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1db00047d0 0x7f1db0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1db000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc14f4f0 con 0x7f1db0005190 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db000c130 con 0x7f1db0003980 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.397+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db000e500 con 0x7f1db00047d0 2024-02-17T12:18:38.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dcb400640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1db000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dcaa00640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1db0003980 0x7f1db0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dca000640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1db00047d0 0x7f1db0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dcb400640 1 -- 172.21.15.114:0/2971154158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1db00047d0 msgr2=0x7f1db0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dcb400640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1db00047d0 0x7f1db0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dcb400640 1 -- 172.21.15.114:0/2971154158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1db0003980 msgr2=0x7f1db0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dcb400640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1db0003980 0x7f1db0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dcb400640 1 -- 172.21.15.114:0/2971154158 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0003530 con 0x7f1db0005190 2024-02-17T12:18:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dcaa00640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1db0003980 0x7f1db0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dcb400640 1 -- 172.21.15.114:0/2971154158 reap_dead start 2024-02-17T12:18:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dcb400640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1db000b990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009fc0 tx=0x7f1dc401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f235c23f85f5f96 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40a5bc0 con 0x7f1db0005190 2024-02-17T12:18:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc400f040 con 0x7f1db0005190 2024-02-17T12:18:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.401+0000 7f1dc9600640 1 -- 172.21.15.114:0/2971154158 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40039a0 con 0x7f1db0005190 2024-02-17T12:18:38.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 -- 172.21.15.114:0/2971154158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 msgr2=0x7f1db000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1db000b990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009fc0 tx=0x7f1dc401ccc0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 -- 172.21.15.114:0/2971154158 shutdown_connections 2024-02-17T12:18:38.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 --2- 172.21.15.114:0/2971154158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1db000b990 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 -- 172.21.15.114:0/2971154158 >> 172.21.15.114:0/2971154158 conn(0x7f1dcc0a8490 msgr2=0x7f1dcc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:38.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 -- 172.21.15.114:0/2971154158 shutdown_connections 2024-02-17T12:18:38.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 -- 172.21.15.114:0/2971154158 wait complete. 2024-02-17T12:18:38.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 Processor -- start 2024-02-17T12:18:38.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 -- start start 2024-02-17T12:18:38.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1dcc13f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1dcc14c100 0x7f1dcc1ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dcc14e2f0 0x7f1dcc151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1ea880 con 0x7f1db0005190 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0c5f40 con 0x7f1dcc14e2f0 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc14bbe0 con 0x7f1dcc14c100 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1dcc13f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1dcc13f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56192/0 (socket says 172.21.15.114:56192) 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcaa00640 1 -- 172.21.15.114:0/3821315717 learned_addr learned my addr 172.21.15.114:0/3821315717 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcb400640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dcc14e2f0 0x7f1dcc151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dca000640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1dcc14c100 0x7f1dcc1ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcaa00640 1 -- 172.21.15.114:0/3821315717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1dcc14c100 msgr2=0x7f1dcc1ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcaa00640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1dcc14c100 0x7f1dcc1ea340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcaa00640 1 -- 172.21.15.114:0/3821315717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dcc14e2f0 msgr2=0x7f1dcc151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcaa00640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dcc14e2f0 0x7f1dcc151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcaa00640 1 -- 172.21.15.114:0/3821315717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0c59c0 con 0x7f1db0005190 2024-02-17T12:18:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcb400640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dcc14e2f0 0x7f1dcc151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dcaa00640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1dcc13f810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00e480 tx=0x7f1dbc00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3821315717 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0052e0 con 0x7f1db0005190 2024-02-17T12:18:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3821315717 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc005440 con 0x7f1db0005190 2024-02-17T12:18:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dd1a00640 1 -- 172.21.15.114:0/3821315717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc0c5c60 con 0x7f1db0005190 2024-02-17T12:18:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.405+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3821315717 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc003820 con 0x7f1db0005190 2024-02-17T12:18:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.409+0000 7f1dd1a00640 1 -- 172.21.15.114:0/3821315717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc151560 con 0x7f1db0005190 2024-02-17T12:18:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.409+0000 7f1dd1a00640 1 -- 172.21.15.114:0/3821315717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc074840 con 0x7f1db0005190 2024-02-17T12:18:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.409+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3821315717 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1dbc003980 con 0x7f1db0005190 2024-02-17T12:18:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.409+0000 7f1dc2a00640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1dac066e70 0x7f1dac069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.409+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3821315717 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1dbc084b90 con 0x7f1db0005190 2024-02-17T12:18:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.409+0000 7f1dca000640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1dac066e70 0x7f1dac069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.409+0000 7f1dca000640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1dac066e70 0x7f1dac069330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc142a20 tx=0x7f1db8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:38.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.413+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3821315717 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1dbc051610 con 0x7f1db0005190 2024-02-17T12:18:38.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.569+0000 7f1dd1a00640 1 -- 172.21.15.114:0/3821315717 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dcc150c80 con 0x7f1db0005190 2024-02-17T12:18:38.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3821315717 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20458 (secure 0 0 0) 0x7f1dbc054cd0 con 0x7f1db0005190 2024-02-17T12:18:38.575 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:38.575 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:21.358057+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 -- 172.21.15.114:0/3821315717 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1dac066e70 msgr2=0x7f1dac069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1dac066e70 0x7f1dac069330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc142a20 tx=0x7f1db8009040 comp rx=0 tx=0).stop 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 -- 172.21.15.114:0/3821315717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 msgr2=0x7f1dcc13f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1dcc13f810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00e480 tx=0x7f1dbc00e940 comp rx=0 tx=0).stop 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 -- 172.21.15.114:0/3821315717 shutdown_connections 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dcc14e2f0 0x7f1dcc151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1dcc14c100 0x7f1dcc1ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1dac066e70 0x7f1dac069330 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 --2- 172.21.15.114:0/3821315717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1db0005190 0x7f1dcc13f810 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 -- 172.21.15.114:0/3821315717 >> 172.21.15.114:0/3821315717 conn(0x7f1dcc0a8490 msgr2=0x7f1dcc0c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 -- 172.21.15.114:0/3821315717 shutdown_connections 2024-02-17T12:18:38.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.573+0000 7f1dd1a00640 1 -- 172.21.15.114:0/3821315717 wait complete. 2024-02-17T12:18:38.597 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:17:59.900395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:18:01.152214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:18:17.610636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:18:18.703971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:18:38.597 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:18:38.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50fb400640 1 Processor -- start 2024-02-17T12:18:38.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50fb400640 1 -- start start 2024-02-17T12:18:38.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50fb400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f4152510 0x7f50f40c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50fb400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f406e890 con 0x7f50f406ef60 2024-02-17T12:18:38.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50fb400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f4158370 con 0x7f50f40c0640 2024-02-17T12:18:38.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50fb400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40c2670 con 0x7f50f4152510 2024-02-17T12:18:38.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f50f406ef60 0x7f50f4158800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53430/0 (socket says 172.21.15.114:53430) 2024-02-17T12:18:38.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3e00640 1 -- 172.21.15.114:0/3163079167 learned_addr learned my addr 172.21.15.114:0/3163079167 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f8a00640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f4152510 0x7f50f40c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807371524 0 0) 0x7f50f406e890 con 0x7f50f406ef60 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d8003530 con 0x7f50f406ef60 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495765609 0 0) 0x7f50f4158370 con 0x7f50f40c0640 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f406e890 con 0x7f50f40c0640 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386644931 0 0) 0x7f50d8003530 con 0x7f50f406ef60 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f4152510 msgr2=0x7f50f40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f4152510 0x7f50f40c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 >> v1:172.21.15.116:6789/0 conn(0x7f50f40c0640 legacy=0x7f50f415f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f406e5b0 con 0x7f50f406ef60 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f50e0001680 con 0x7f50f406ef60 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 >> v1:172.21.15.114:6789/0 conn(0x7f50f406ef60 legacy=0x7f50f4158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50d8003b40 0x7f50d8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50d80047d0 0x7f50d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d8005190 0x7f50d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d800c060 con 0x7f50d8005190 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d800c1a0 con 0x7f50d80047d0 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d800c360 con 0x7f50d8003b40 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f8a00640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f4152510 0x7f50f40c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f9400640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d8005190 0x7f50d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f3e00640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50d80047d0 0x7f50d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.733+0000 7f50f8a00640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50d8003b40 0x7f50d8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f9400640 1 -- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50d8003b40 msgr2=0x7f50d8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f9400640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50d8003b40 0x7f50d8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f9400640 1 -- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50d80047d0 msgr2=0x7f50d8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f9400640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50d80047d0 0x7f50d8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f9400640 1 -- 172.21.15.114:0/3163079167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d8003530 con 0x7f50d8005190 2024-02-17T12:18:38.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f8a00640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50d8003b40 0x7f50d8003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:38.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f9400640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d8005190 0x7f50d800b990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f50ec001fd0 tx=0x7f50ec01f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c31de0f8b37c3c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:38.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec0a8c90 con 0x7f50d8005190 2024-02-17T12:18:38.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec0a8e10 con 0x7f50d8005190 2024-02-17T12:18:38.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f3400640 1 -- 172.21.15.114:0/3163079167 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec003bc0 con 0x7f50d8005190 2024-02-17T12:18:38.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50fb400640 1 -- 172.21.15.114:0/3163079167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d8005190 msgr2=0x7f50d800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50fb400640 1 --2- 172.21.15.114:0/3163079167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50d8005190 0x7f50d800b990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f50ec001fd0 tx=0x7f50ec01f070 comp rx=0 tx=0).stop 2024-02-17T12:18:38.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50f9400640 1 -- 172.21.15.114:0/3163079167 reap_dead start 2024-02-17T12:18:38.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50fb400640 1 -- 172.21.15.114:0/3163079167 shutdown_connections 2024-02-17T12:18:38.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50fb400640 1 -- 172.21.15.114:0/3163079167 >> 172.21.15.114:0/3163079167 conn(0x7f50f40a8490 msgr2=0x7f50f40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:38.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50fb400640 1 -- 172.21.15.114:0/3163079167 shutdown_connections 2024-02-17T12:18:38.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.737+0000 7f50fb400640 1 -- 172.21.15.114:0/3163079167 wait complete. 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50fb400640 1 Processor -- start 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50fb400640 1 -- start start 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50fb400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50f41507a0 0x7f50f4151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50fb400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f4143bf0 0x7f50f4144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50fb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f41ea680 0x7f50f41eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50fb400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40729c0 con 0x7f50f41ea680 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50fb400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4144590 con 0x7f50f41507a0 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50fb400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f414d390 con 0x7f50f4143bf0 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f41ea680 0x7f50f41eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f41ea680 0x7f50f41eab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56212/0 (socket says 172.21.15.114:56212) 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f9400640 1 -- 172.21.15.114:0/3812540419 learned_addr learned my addr 172.21.15.114:0/3812540419 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:38.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f8a00640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50f41507a0 0x7f50f4151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f3e00640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f4143bf0 0x7f50f4144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f9400640 1 -- 172.21.15.114:0/3812540419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f4143bf0 msgr2=0x7f50f4144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f9400640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f4143bf0 0x7f50f4144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f9400640 1 -- 172.21.15.114:0/3812540419 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50f41507a0 msgr2=0x7f50f4151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f9400640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50f41507a0 0x7f50f4151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f9400640 1 -- 172.21.15.114:0/3812540419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f414d670 con 0x7f50f41ea680 2024-02-17T12:18:38.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f9400640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f41ea680 0x7f50f41eab00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f50ec01f910 tx=0x7f50d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:38.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f0c00640 1 -- 172.21.15.114:0/3812540419 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec003df0 con 0x7f50f41ea680 2024-02-17T12:18:38.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f0c00640 1 -- 172.21.15.114:0/3812540419 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec0a8a90 con 0x7f50f41ea680 2024-02-17T12:18:38.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50f0c00640 1 -- 172.21.15.114:0/3812540419 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec006b60 con 0x7f50f41ea680 2024-02-17T12:18:38.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50fb400640 1 -- 172.21.15.114:0/3812540419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f414dbb0 con 0x7f50f41ea680 2024-02-17T12:18:38.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.741+0000 7f50fb400640 1 -- 172.21.15.114:0/3812540419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f414e170 con 0x7f50f41ea680 2024-02-17T12:18:38.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.745+0000 7f50fb400640 1 -- 172.21.15.114:0/3812540419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f414e360 con 0x7f50f41ea680 2024-02-17T12:18:38.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.745+0000 7f50f0c00640 1 -- 172.21.15.114:0/3812540419 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f50ec006cc0 con 0x7f50f41ea680 2024-02-17T12:18:38.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.745+0000 7f50f0c00640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e70 0x7f50d4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:38.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.745+0000 7f50f0c00640 1 -- 172.21.15.114:0/3812540419 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f50ec120c70 con 0x7f50f41ea680 2024-02-17T12:18:38.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.745+0000 7f50f8a00640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e70 0x7f50d4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:38.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.745+0000 7f50f8a00640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e70 0x7f50d4069330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f50f40bfd30 tx=0x7f50e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:38.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.749+0000 7f50f0c00640 1 -- 172.21.15.114:0/3812540419 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f50ec0ed720 con 0x7f50f41ea680 2024-02-17T12:18:38.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.905+0000 7f50fb400640 1 -- 172.21.15.114:0/3812540419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50f414e360 con 0x7f50f41ea680 2024-02-17T12:18:38.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.905+0000 7f50f0c00640 1 -- 172.21.15.114:0/3812540419 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50ec0011d0 con 0x7f50f41ea680 2024-02-17T12:18:38.909 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:18:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 -- 172.21.15.114:0/3812540419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e70 msgr2=0x7f50d4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e70 0x7f50d4069330 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f50f40bfd30 tx=0x7f50e4008040 comp rx=0 tx=0).stop 2024-02-17T12:18:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 -- 172.21.15.114:0/3812540419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f41ea680 msgr2=0x7f50f41eab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f41ea680 0x7f50f41eab00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f50ec01f910 tx=0x7f50d8005800 comp rx=0 tx=0).stop 2024-02-17T12:18:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 -- 172.21.15.114:0/3812540419 shutdown_connections 2024-02-17T12:18:38.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e70 0x7f50d4069330 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f41ea680 0x7f50f41eab00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f4143bf0 0x7f50f4144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 --2- 172.21.15.114:0/3812540419 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50f41507a0 0x7f50f4151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 -- 172.21.15.114:0/3812540419 >> 172.21.15.114:0/3812540419 conn(0x7f50f40a8490 msgr2=0x7f50f40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 -- 172.21.15.114:0/3812540419 shutdown_connections 2024-02-17T12:18:38.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:38.909+0000 7f50fb400640 1 -- 172.21.15.114:0/3812540419 wait complete. 2024-02-17T12:18:38.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:18:39.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d9d800640 1 Processor -- start 2024-02-17T12:18:39.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d9d800640 1 -- start start 2024-02-17T12:18:39.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d9d800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3d9814f110 0x7f3d980c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d9d800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 0x7f3d9815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d9d800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d980a9420 con 0x7f3d980c2580 2024-02-17T12:18:39.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d9d800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9814f4f0 con 0x7f3d9814f110 2024-02-17T12:18:39.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d9d800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980aae80 con 0x7f3d980c1eb0 2024-02-17T12:18:39.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d96000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3d980c2580 0x7f3d980aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53442/0 (socket says 172.21.15.114:53442) 2024-02-17T12:18:39.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d96000640 1 -- 172.21.15.114:0/3126048609 learned_addr learned my addr 172.21.15.114:0/3126048609 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:39.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d96a00640 1 --2- 172.21.15.114:0/3126048609 >> v2:172.21.15.116:3300/0 conn(0x7f3d9814f110 0x7f3d980c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d97400640 1 --2- 172.21.15.114:0/3126048609 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 0x7f3d9815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d95600640 1 -- 172.21.15.114:0/3126048609 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083226383 0 0) 0x7f3d980a9420 con 0x7f3d980c2580 2024-02-17T12:18:39.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d95600640 1 -- 172.21.15.114:0/3126048609 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d7c003530 con 0x7f3d980c2580 2024-02-17T12:18:39.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d95600640 1 -- 172.21.15.114:0/3126048609 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3681552787 0 0) 0x7f3d7c003530 con 0x7f3d980c2580 2024-02-17T12:18:39.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d96a00640 1 -- 172.21.15.114:0/3126048609 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 msgr2=0x7f3d9815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:39.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d96a00640 1 --2- 172.21.15.114:0/3126048609 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 0x7f3d9815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d96a00640 1 -- 172.21.15.114:0/3126048609 >> v1:172.21.15.114:6789/0 conn(0x7f3d980c2580 legacy=0x7f3d980aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.065+0000 7f3d96a00640 1 -- 172.21.15.114:0/3126048609 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d98152850 con 0x7f3d9814f110 2024-02-17T12:18:39.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d96a00640 1 --2- 172.21.15.114:0/3126048609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d9814f110 0x7f3d980c65a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009d90 tx=0x7f3d8801c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=167c8056b5a9f6de server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:39.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d95600640 1 -- 172.21.15.114:0/3126048609 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80001680 con 0x7f3d9814f110 2024-02-17T12:18:39.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d95600640 1 -- 172.21.15.114:0/3126048609 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d880a55d0 con 0x7f3d9814f110 2024-02-17T12:18:39.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d95600640 1 -- 172.21.15.114:0/3126048609 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880a5960 con 0x7f3d9814f110 2024-02-17T12:18:39.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d9d800640 1 -- 172.21.15.114:0/3126048609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d9814f110 msgr2=0x7f3d980c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d9d800640 1 --2- 172.21.15.114:0/3126048609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d9814f110 0x7f3d980c65a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009d90 tx=0x7f3d8801c7d0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d9d800640 1 -- 172.21.15.114:0/3126048609 shutdown_connections 2024-02-17T12:18:39.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d9d800640 1 --2- 172.21.15.114:0/3126048609 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 0x7f3d9815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d9d800640 1 --2- 172.21.15.114:0/3126048609 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d9814f110 0x7f3d980c65a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d9d800640 1 -- 172.21.15.114:0/3126048609 >> 172.21.15.114:0/3126048609 conn(0x7f3d980a8490 msgr2=0x7f3d980a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:39.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.069+0000 7f3d9d800640 1 -- 172.21.15.114:0/3126048609 shutdown_connections 2024-02-17T12:18:39.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 -- 172.21.15.114:0/3126048609 wait complete. 2024-02-17T12:18:39.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 Processor -- start 2024-02-17T12:18:39.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 -- start start 2024-02-17T12:18:39.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 0x7f3d9806e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d980c2580 0x7f3d981f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d9814f110 0x7f3d98149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980c5510 con 0x7f3d9814f110 2024-02-17T12:18:39.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981f11b0 con 0x7f3d980c2580 2024-02-17T12:18:39.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981f1b80 con 0x7f3d980c1eb0 2024-02-17T12:18:39.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d97400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d9814f110 0x7f3d98149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d97400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d9814f110 0x7f3d98149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56214/0 (socket says 172.21.15.114:56214) 2024-02-17T12:18:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d97400640 1 -- 172.21.15.114:0/143238487 learned_addr learned my addr 172.21.15.114:0/143238487 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d96000640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d980c2580 0x7f3d981f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d96a00640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 0x7f3d9806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d97400640 1 -- 172.21.15.114:0/143238487 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 msgr2=0x7f3d9806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d97400640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 0x7f3d9806e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d97400640 1 -- 172.21.15.114:0/143238487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d980c2580 msgr2=0x7f3d981f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d97400640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d980c2580 0x7f3d981f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d97400640 1 -- 172.21.15.114:0/143238487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88009a70 con 0x7f3d9814f110 2024-02-17T12:18:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d96a00640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 0x7f3d9806e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:39.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d96000640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d980c2580 0x7f3d981f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:39.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d97400640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d9814f110 0x7f3d98149fb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000e7f0 tx=0x7f3d9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:39.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d8ea00640 1 -- 172.21.15.114:0/143238487 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d900094d0 con 0x7f3d9814f110 2024-02-17T12:18:39.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 -- 172.21.15.114:0/143238487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d98151540 con 0x7f3d9814f110 2024-02-17T12:18:39.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d8ea00640 1 -- 172.21.15.114:0/143238487 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9000eea0 con 0x7f3d9814f110 2024-02-17T12:18:39.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d8ea00640 1 -- 172.21.15.114:0/143238487 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000cb60 con 0x7f3d9814f110 2024-02-17T12:18:39.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.073+0000 7f3d9d800640 1 -- 172.21.15.114:0/143238487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d981f0e40 con 0x7f3d9814f110 2024-02-17T12:18:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.077+0000 7f3d9d800640 1 -- 172.21.15.114:0/143238487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d98151a60 con 0x7f3d9814f110 2024-02-17T12:18:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.077+0000 7f3d8ea00640 1 -- 172.21.15.114:0/143238487 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3d9000ccc0 con 0x7f3d9814f110 2024-02-17T12:18:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.077+0000 7f3d8ea00640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d74066e70 0x7f3d74069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.077+0000 7f3d8ea00640 1 -- 172.21.15.114:0/143238487 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3d90084ec0 con 0x7f3d9814f110 2024-02-17T12:18:39.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.077+0000 7f3d96a00640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d74066e70 0x7f3d74069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.077+0000 7f3d96a00640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d74066e70 0x7f3d74069330 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3d880af000 tx=0x7f3d880a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:39.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.081+0000 7f3d8ea00640 1 -- 172.21.15.114:0/143238487 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3d98151a60 con 0x7f3d9814f110 2024-02-17T12:18:39.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 -- 172.21.15.114:0/143238487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d98151a60 con 0x7f3d9814f110 2024-02-17T12:18:39.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d8ea00640 1 -- 172.21.15.114:0/143238487 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d98151a60 con 0x7f3d9814f110 2024-02-17T12:18:39.241 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:18:39.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 -- 172.21.15.114:0/143238487 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d74066e70 msgr2=0x7f3d74069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d74066e70 0x7f3d74069330 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3d880af000 tx=0x7f3d880a7070 comp rx=0 tx=0).stop 2024-02-17T12:18:39.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 -- 172.21.15.114:0/143238487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d9814f110 msgr2=0x7f3d98149fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d9814f110 0x7f3d98149fb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000e7f0 tx=0x7f3d9000ecb0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 -- 172.21.15.114:0/143238487 shutdown_connections 2024-02-17T12:18:39.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d74066e70 0x7f3d74069330 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d9814f110 0x7f3d98149fb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d980c2580 0x7f3d981f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 --2- 172.21.15.114:0/143238487 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d980c1eb0 0x7f3d9806e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 -- 172.21.15.114:0/143238487 >> 172.21.15.114:0/143238487 conn(0x7f3d980a8490 msgr2=0x7f3d9814dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:39.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 -- 172.21.15.114:0/143238487 shutdown_connections 2024-02-17T12:18:39.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.237+0000 7f3d9d800640 1 -- 172.21.15.114:0/143238487 wait complete. 2024-02-17T12:18:39.262 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:18:39.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.401+0000 7fabe5400640 1 Processor -- start 2024-02-17T12:18:39.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.401+0000 7fabe5400640 1 -- start start 2024-02-17T12:18:39.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.401+0000 7fabe5400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fabe014f110 0x7fabe00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.401+0000 7fabe5400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 0x7fabe015c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.401+0000 7fabe5400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe00a9420 con 0x7fabe00c2580 2024-02-17T12:18:39.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.401+0000 7fabe5400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe014f4f0 con 0x7fabe014f110 2024-02-17T12:18:39.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.401+0000 7fabe5400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00aae80 con 0x7fabe00c1eb0 2024-02-17T12:18:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabdf200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 0x7fabe015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabde800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fabe014f110 0x7fabe00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabdde00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fabe00c2580 0x7fabe00aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:43472/0 (socket says 172.21.15.114:43472) 2024-02-17T12:18:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabdf200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 0x7fabe015c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:33220/0 (socket says 172.21.15.114:33220) 2024-02-17T12:18:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabdde00640 1 -- 172.21.15.114:0/3141051613 learned_addr learned my addr 172.21.15.114:0/3141051613 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabde800640 1 -- 172.21.15.114:0/3141051613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 msgr2=0x7fabe015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabde800640 1 --2- 172.21.15.114:0/3141051613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 0x7fabe015c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabde800640 1 -- 172.21.15.114:0/3141051613 >> v1:172.21.15.116:6789/0 conn(0x7fabe00c2580 legacy=0x7fabe00aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabde800640 1 -- 172.21.15.114:0/3141051613 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe0152850 con 0x7fabe014f110 2024-02-17T12:18:39.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabdd400640 1 -- 172.21.15.114:0/3141051613 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101801027 0 0) 0x7fabe00a9420 con 0x7fabe00c2580 2024-02-17T12:18:39.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabde800640 1 --2- 172.21.15.114:0/3141051613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe014f110 0x7fabe00c65a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009d90 tx=0x7fabd001c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b1e4a9836eeab96 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:39.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabdd400640 1 -- 172.21.15.114:0/3141051613 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00a5970 con 0x7fabe014f110 2024-02-17T12:18:39.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabdd400640 1 -- 172.21.15.114:0/3141051613 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00a5ad0 con 0x7fabe014f110 2024-02-17T12:18:39.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.405+0000 7fabdd400640 1 -- 172.21.15.114:0/3141051613 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00a5e60 con 0x7fabe014f110 2024-02-17T12:18:39.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 -- 172.21.15.114:0/3141051613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe014f110 msgr2=0x7fabe00c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 --2- 172.21.15.114:0/3141051613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe014f110 0x7fabe00c65a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009d90 tx=0x7fabd001c8b0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 -- 172.21.15.114:0/3141051613 shutdown_connections 2024-02-17T12:18:39.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 --2- 172.21.15.114:0/3141051613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 0x7fabe015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 --2- 172.21.15.114:0/3141051613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe014f110 0x7fabe00c65a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 -- 172.21.15.114:0/3141051613 >> 172.21.15.114:0/3141051613 conn(0x7fabe00a8490 msgr2=0x7fabe00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:39.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 -- 172.21.15.114:0/3141051613 shutdown_connections 2024-02-17T12:18:39.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 -- 172.21.15.114:0/3141051613 wait complete. 2024-02-17T12:18:39.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 Processor -- start 2024-02-17T12:18:39.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 -- start start 2024-02-17T12:18:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 0x7fabe0151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe00c2580 0x7fabe0148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe014f110 0x7fabe01488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe0145f50 con 0x7fabe00c2580 2024-02-17T12:18:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe0146230 con 0x7fabe014f110 2024-02-17T12:18:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabe5400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe0146510 con 0x7fabe00c1eb0 2024-02-17T12:18:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabdde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe00c2580 0x7fabe0148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabde800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 0x7fabe0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabdde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe00c2580 0x7fabe0148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56222/0 (socket says 172.21.15.114:56222) 2024-02-17T12:18:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabdde00640 1 -- 172.21.15.114:0/2206005245 learned_addr learned my addr 172.21.15.114:0/2206005245 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:39.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabdf200640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe014f110 0x7fabe01488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabdde00640 1 -- 172.21.15.114:0/2206005245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 msgr2=0x7fabe0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabdde00640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 0x7fabe0151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabdde00640 1 -- 172.21.15.114:0/2206005245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe014f110 msgr2=0x7fabe01488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabdde00640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe014f110 0x7fabe01488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabdde00640 1 -- 172.21.15.114:0/2206005245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd0009a70 con 0x7fabe00c2580 2024-02-17T12:18:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.409+0000 7fabdde00640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe00c2580 0x7fabe0148370 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fabcc00c4b0 tx=0x7fabcc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabd6a00640 1 -- 172.21.15.114:0/2206005245 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc0074e0 con 0x7fabe00c2580 2024-02-17T12:18:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabd6a00640 1 -- 172.21.15.114:0/2206005245 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc007660 con 0x7fabe00c2580 2024-02-17T12:18:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabd6a00640 1 -- 172.21.15.114:0/2206005245 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabcc004a30 con 0x7fabe00c2580 2024-02-17T12:18:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabe5400640 1 -- 172.21.15.114:0/2206005245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe01467f0 con 0x7fabe00c2580 2024-02-17T12:18:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabe5400640 1 -- 172.21.15.114:0/2206005245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe0146ad0 con 0x7fabe00c2580 2024-02-17T12:18:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabe5400640 1 -- 172.21.15.114:0/2206005245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe00711e0 con 0x7fabe00c2580 2024-02-17T12:18:39.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabd6a00640 1 -- 172.21.15.114:0/2206005245 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fabcc004b90 con 0x7fabe00c2580 2024-02-17T12:18:39.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabd6a00640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fabc0066e70 0x7fabc0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabd6a00640 1 -- 172.21.15.114:0/2206005245 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fabcc083ea0 con 0x7fabe00c2580 2024-02-17T12:18:39.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabde800640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fabc0066e70 0x7fabc0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.413+0000 7fabde800640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fabc0066e70 0x7fabc0069330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fabd00af000 tx=0x7fabd00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:39.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.417+0000 7fabd6a00640 1 -- 172.21.15.114:0/2206005245 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fabcc050a90 con 0x7fabe00c2580 2024-02-17T12:18:39.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.569+0000 7fabe5400640 1 -- 172.21.15.114:0/2206005245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabe0074840 con 0x7fabe00c2580 2024-02-17T12:18:39.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.569+0000 7fabd6a00640 1 -- 172.21.15.114:0/2206005245 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabcc018020 con 0x7fabe00c2580 2024-02-17T12:18:39.573 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:18:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 -- 172.21.15.114:0/2206005245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fabc0066e70 msgr2=0x7fabc0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fabc0066e70 0x7fabc0069330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fabd00af000 tx=0x7fabd00a7070 comp rx=0 tx=0).stop 2024-02-17T12:18:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 -- 172.21.15.114:0/2206005245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe00c2580 msgr2=0x7fabe0148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe00c2580 0x7fabe0148370 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fabcc00c4b0 tx=0x7fabcc00c970 comp rx=0 tx=0).stop 2024-02-17T12:18:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 -- 172.21.15.114:0/2206005245 shutdown_connections 2024-02-17T12:18:39.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe014f110 0x7fabe01488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fabc0066e70 0x7fabc0069330 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabe00c2580 0x7fabe0148370 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 --2- 172.21.15.114:0/2206005245 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fabe00c1eb0 0x7fabe0151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 -- 172.21.15.114:0/2206005245 >> 172.21.15.114:0/2206005245 conn(0x7fabe00a8490 msgr2=0x7fabe00bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 -- 172.21.15.114:0/2206005245 shutdown_connections 2024-02-17T12:18:39.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.573+0000 7fabe5400640 1 -- 172.21.15.114:0/2206005245 wait complete. 2024-02-17T12:18:39.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:18:39.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bffc00640 1 Processor -- start 2024-02-17T12:18:39.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bffc00640 1 -- start start 2024-02-17T12:18:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bffc00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7bf80c2580 0x7f7bf80aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bffc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 0x7f7bf815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bffc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf80a9420 con 0x7f7bf814f110 2024-02-17T12:18:39.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bffc00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf814f4f0 con 0x7f7bf80c2580 2024-02-17T12:18:39.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bffc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80aae80 con 0x7f7bf80c1eb0 2024-02-17T12:18:39.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bfd200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7bf814f110 0x7f7bf80c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53456/0 (socket says 172.21.15.114:53456) 2024-02-17T12:18:39.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bfd200640 1 -- 172.21.15.114:0/2689013909 learned_addr learned my addr 172.21.15.114:0/2689013909 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:39.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bfdc00640 1 --2- 172.21.15.114:0/2689013909 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 0x7f7bf815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bf7e00640 1 --2- 172.21.15.114:0/2689013909 >> v2:172.21.15.116:3300/0 conn(0x7f7bf80c2580 0x7f7bf80aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bf7400640 1 -- 172.21.15.114:0/2689013909 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390422859 0 0) 0x7f7bf80a9420 con 0x7f7bf814f110 2024-02-17T12:18:39.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bf7400640 1 -- 172.21.15.114:0/2689013909 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bdc003530 con 0x7f7bf814f110 2024-02-17T12:18:39.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bfdc00640 1 -- 172.21.15.114:0/2689013909 >> v2:172.21.15.116:3300/0 conn(0x7f7bf80c2580 msgr2=0x7f7bf80aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:39.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bfdc00640 1 --2- 172.21.15.114:0/2689013909 >> v2:172.21.15.116:3300/0 conn(0x7f7bf80c2580 0x7f7bf80aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bfdc00640 1 -- 172.21.15.114:0/2689013909 >> v1:172.21.15.114:6789/0 conn(0x7f7bf814f110 legacy=0x7f7bf80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.729+0000 7f7bfdc00640 1 -- 172.21.15.114:0/2689013909 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8152850 con 0x7f7bf80c1eb0 2024-02-17T12:18:39.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.733+0000 7f7bfdc00640 1 --2- 172.21.15.114:0/2689013909 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 0x7f7bf815c390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00097c0 tx=0x7f7bf001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=913949c74b52caad server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:39.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.733+0000 7f7bf7400640 1 -- 172.21.15.114:0/2689013909 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00ac640 con 0x7f7bf80c1eb0 2024-02-17T12:18:39.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.733+0000 7f7bf7400640 1 -- 172.21.15.114:0/2689013909 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf00ac7a0 con 0x7f7bf80c1eb0 2024-02-17T12:18:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.733+0000 7f7bf7400640 1 -- 172.21.15.114:0/2689013909 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00acb30 con 0x7f7bf80c1eb0 2024-02-17T12:18:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.733+0000 7f7bffc00640 1 -- 172.21.15.114:0/2689013909 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 msgr2=0x7f7bf815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.733+0000 7f7bffc00640 1 --2- 172.21.15.114:0/2689013909 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 0x7f7bf815c390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00097c0 tx=0x7f7bf001c3e0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.733+0000 7f7bffc00640 1 -- 172.21.15.114:0/2689013909 shutdown_connections 2024-02-17T12:18:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.733+0000 7f7bffc00640 1 --2- 172.21.15.114:0/2689013909 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 0x7f7bf815c390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.733+0000 7f7bffc00640 1 --2- 172.21.15.114:0/2689013909 >> v2:172.21.15.116:3300/0 conn(0x7f7bf80c2580 0x7f7bf80aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.733+0000 7f7bffc00640 1 -- 172.21.15.114:0/2689013909 >> 172.21.15.114:0/2689013909 conn(0x7f7bf80a8490 msgr2=0x7f7bf80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 -- 172.21.15.114:0/2689013909 shutdown_connections 2024-02-17T12:18:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 -- 172.21.15.114:0/2689013909 wait complete. 2024-02-17T12:18:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 Processor -- start 2024-02-17T12:18:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 -- start start 2024-02-17T12:18:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 0x7f7bf81534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf80c2580 0x7f7bf814dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf814f110 0x7f7bf81eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf81f1e30 con 0x7f7bf80c2580 2024-02-17T12:18:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80c5eb0 con 0x7f7bf814f110 2024-02-17T12:18:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80c55c0 con 0x7f7bf80c1eb0 2024-02-17T12:18:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf80c2580 0x7f7bf814dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf80c2580 0x7f7bf814dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56226/0 (socket says 172.21.15.114:56226) 2024-02-17T12:18:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf7e00640 1 -- 172.21.15.114:0/1257695523 learned_addr learned my addr 172.21.15.114:0/1257695523 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bfd200640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 0x7f7bf81534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bfdc00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf814f110 0x7f7bf81eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf7e00640 1 -- 172.21.15.114:0/1257695523 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 msgr2=0x7f7bf81534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf7e00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 0x7f7bf81534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf7e00640 1 -- 172.21.15.114:0/1257695523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf814f110 msgr2=0x7f7bf81eda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf7e00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf814f110 0x7f7bf81eda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf7e00640 1 -- 172.21.15.114:0/1257695523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0009420 con 0x7f7bf80c2580 2024-02-17T12:18:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bfd200640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 0x7f7bf81534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bfdc00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf814f110 0x7f7bf81eda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf7e00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf80c2580 0x7f7bf814dbf0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7be000e900 tx=0x7f7be000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf4c00640 1 -- 172.21.15.114:0/1257695523 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0009690 con 0x7f7bf80c2580 2024-02-17T12:18:39.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf4c00640 1 -- 172.21.15.114:0/1257695523 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be000ca00 con 0x7f7bf80c2580 2024-02-17T12:18:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bf4c00640 1 -- 172.21.15.114:0/1257695523 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be000cdb0 con 0x7f7bf80c2580 2024-02-17T12:18:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 -- 172.21.15.114:0/1257695523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf80c5860 con 0x7f7bf80c2580 2024-02-17T12:18:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.737+0000 7f7bffc00640 1 -- 172.21.15.114:0/1257695523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf814e130 con 0x7f7bf80c2580 2024-02-17T12:18:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.741+0000 7f7bffc00640 1 -- 172.21.15.114:0/1257695523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf8074840 con 0x7f7bf80c2580 2024-02-17T12:18:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.741+0000 7f7bf4c00640 1 -- 172.21.15.114:0/1257695523 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f7be0013470 con 0x7f7bf80c2580 2024-02-17T12:18:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.741+0000 7f7bf4c00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7bd4066e40 0x7f7bd4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:39.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.741+0000 7f7bf4c00640 1 -- 172.21.15.114:0/1257695523 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7be0085370 con 0x7f7bf80c2580 2024-02-17T12:18:39.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.741+0000 7f7bfd200640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7bd4066e40 0x7f7bd4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:39.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.741+0000 7f7bfd200640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7bd4066e40 0x7f7bd4069300 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7be8005c10 tx=0x7f7be8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:39.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.745+0000 7f7bf4c00640 1 -- 172.21.15.114:0/1257695523 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7be0051df0 con 0x7f7bf80c2580 2024-02-17T12:18:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 -- 172.21.15.114:0/1257695523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7bf814c4d0 con 0x7f7bf80c2580 2024-02-17T12:18:39.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bf4c00640 1 -- 172.21.15.114:0/1257695523 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7be00554b0 con 0x7f7bf80c2580 2024-02-17T12:18:39.903 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:18:39.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 -- 172.21.15.114:0/1257695523 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7bd4066e40 msgr2=0x7f7bd4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7bd4066e40 0x7f7bd4069300 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7be8005c10 tx=0x7f7be8009040 comp rx=0 tx=0).stop 2024-02-17T12:18:39.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 -- 172.21.15.114:0/1257695523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf80c2580 msgr2=0x7f7bf814dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:39.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf80c2580 0x7f7bf814dbf0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7be000e900 tx=0x7f7be000edc0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 -- 172.21.15.114:0/1257695523 shutdown_connections 2024-02-17T12:18:39.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bf814f110 0x7f7bf81eda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7bd4066e40 0x7f7bd4069300 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf80c2580 0x7f7bf814dbf0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 --2- 172.21.15.114:0/1257695523 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7bf80c1eb0 0x7f7bf81534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 -- 172.21.15.114:0/1257695523 >> 172.21.15.114:0/1257695523 conn(0x7f7bf80a8490 msgr2=0x7f7bf80c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 -- 172.21.15.114:0/1257695523 shutdown_connections 2024-02-17T12:18:39.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:39.901+0000 7f7bffc00640 1 -- 172.21.15.114:0/1257695523 wait complete. 2024-02-17T12:18:39.925 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:18:40.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.057+0000 7f66d2a00640 1 Processor -- start 2024-02-17T12:18:40.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66d2a00640 1 -- start start 2024-02-17T12:18:40.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66d2a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f66cc0c25a0 0x7f66cc06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66d2a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66cc06db50 0x7f66cc14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66d2a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66cc156270 con 0x7f66cc150490 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66d2a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66cc071630 con 0x7f66cc06db50 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66d2a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66cc156550 con 0x7f66cc0c25a0 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66cb400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66cc06db50 0x7f66cc14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66cb400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66cc06db50 0x7f66cc14ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56234/0 (socket says 172.21.15.114:56234) 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66cb400640 1 -- 172.21.15.114:0/3166198061 learned_addr learned my addr 172.21.15.114:0/3166198061 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66cbe00640 1 --2- 172.21.15.114:0/3166198061 >> v2:172.21.15.116:3300/0 conn(0x7f66cc0c25a0 0x7f66cc06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66cb400640 1 -- 172.21.15.114:0/3166198061 >> v2:172.21.15.116:3300/0 conn(0x7f66cc0c25a0 msgr2=0x7f66cc06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66cb400640 1 --2- 172.21.15.114:0/3166198061 >> v2:172.21.15.116:3300/0 conn(0x7f66cc0c25a0 0x7f66cc06e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66cb400640 1 -- 172.21.15.114:0/3166198061 >> v1:172.21.15.116:6789/0 conn(0x7f66cc150490 legacy=0x7f66cc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66cb400640 1 -- 172.21.15.114:0/3166198061 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc156830 con 0x7f66cc06db50 2024-02-17T12:18:40.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.061+0000 7f66cbe00640 1 --2- 172.21.15.114:0/3166198061 >> v2:172.21.15.116:3300/0 conn(0x7f66cc0c25a0 0x7f66cc06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:40.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66cb400640 1 --2- 172.21.15.114:0/3166198061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 0x7f66cc14ff50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0ab930 tx=0x7f66b801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc215907f249617 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:40.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66caa00640 1 -- 172.21.15.114:0/3166198061 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b80a4ea0 con 0x7f66cc06db50 2024-02-17T12:18:40.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66caa00640 1 -- 172.21.15.114:0/3166198061 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b80a7050 con 0x7f66cc06db50 2024-02-17T12:18:40.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66caa00640 1 -- 172.21.15.114:0/3166198061 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b80ab820 con 0x7f66cc06db50 2024-02-17T12:18:40.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66d2a00640 1 -- 172.21.15.114:0/3166198061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 msgr2=0x7f66cc14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66d2a00640 1 --2- 172.21.15.114:0/3166198061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 0x7f66cc14ff50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0ab930 tx=0x7f66b801c400 comp rx=0 tx=0).stop 2024-02-17T12:18:40.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66d2a00640 1 -- 172.21.15.114:0/3166198061 shutdown_connections 2024-02-17T12:18:40.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66d2a00640 1 --2- 172.21.15.114:0/3166198061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 0x7f66cc14ff50 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66d2a00640 1 --2- 172.21.15.114:0/3166198061 >> v2:172.21.15.116:3300/0 conn(0x7f66cc0c25a0 0x7f66cc06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66d2a00640 1 -- 172.21.15.114:0/3166198061 >> 172.21.15.114:0/3166198061 conn(0x7f66cc0a8490 msgr2=0x7f66cc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:40.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66d2a00640 1 -- 172.21.15.114:0/3166198061 shutdown_connections 2024-02-17T12:18:40.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66d2a00640 1 -- 172.21.15.114:0/3166198061 wait complete. 2024-02-17T12:18:40.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66d2a00640 1 Processor -- start 2024-02-17T12:18:40.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.065+0000 7f66d2a00640 1 -- start start 2024-02-17T12:18:40.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 0x7f66cc1447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d2a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f66cc0c25a0 0x7f66cc1f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d2a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66cc150490 0x7f66cc1f1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d2a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc14eb60 con 0x7f66cc06db50 2024-02-17T12:18:40.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d2a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc155c70 con 0x7f66cc150490 2024-02-17T12:18:40.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d2a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc14e5f0 con 0x7f66cc0c25a0 2024-02-17T12:18:40.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 0x7f66cc1447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 0x7f66cc1447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56248/0 (socket says 172.21.15.114:56248) 2024-02-17T12:18:40.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66cbe00640 1 -- 172.21.15.114:0/2083814819 learned_addr learned my addr 172.21.15.114:0/2083814819 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:40.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66cb400640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f66cc0c25a0 0x7f66cc1f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d0a00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66cc150490 0x7f66cc1f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66cbe00640 1 -- 172.21.15.114:0/2083814819 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f66cc0c25a0 msgr2=0x7f66cc1f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66cbe00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f66cc0c25a0 0x7f66cc1f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66cbe00640 1 -- 172.21.15.114:0/2083814819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66cc150490 msgr2=0x7f66cc1f1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66cbe00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66cc150490 0x7f66cc1f1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66cbe00640 1 -- 172.21.15.114:0/2083814819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b80094d0 con 0x7f66cc06db50 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d0a00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66cc150490 0x7f66cc1f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66cbe00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 0x7f66cc1447d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00e840 tx=0x7f66bc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66c3e00640 1 -- 172.21.15.114:0/2083814819 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00c8d0 con 0x7f66cc06db50 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66c3e00640 1 -- 172.21.15.114:0/2083814819 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc00ca30 con 0x7f66cc06db50 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66c3e00640 1 -- 172.21.15.114:0/2083814819 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00cdc0 con 0x7f66cc06db50 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d2a00640 1 -- 172.21.15.114:0/2083814819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc14d9e0 con 0x7f66cc06db50 2024-02-17T12:18:40.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d2a00640 1 -- 172.21.15.114:0/2083814819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc14e280 con 0x7f66cc06db50 2024-02-17T12:18:40.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66d2a00640 1 -- 172.21.15.114:0/2083814819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66cc074840 con 0x7f66cc06db50 2024-02-17T12:18:40.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.069+0000 7f66c3e00640 1 -- 172.21.15.114:0/2083814819 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f66bc013410 con 0x7f66cc06db50 2024-02-17T12:18:40.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.073+0000 7f66c3e00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66ac066e40 0x7f66ac069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.073+0000 7f66c3e00640 1 -- 172.21.15.114:0/2083814819 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f66bc084a60 con 0x7f66cc06db50 2024-02-17T12:18:40.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.073+0000 7f66cb400640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66ac066e40 0x7f66ac069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.073+0000 7f66cb400640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66ac066e40 0x7f66ac069300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f66b80ad000 tx=0x7f66b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:40.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.077+0000 7f66c3e00640 1 -- 172.21.15.114:0/2083814819 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f66bc051630 con 0x7f66cc06db50 2024-02-17T12:18:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.229+0000 7f66d2a00640 1 -- 172.21.15.114:0/2083814819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f66cc06b020 con 0x7f66cc06db50 2024-02-17T12:18:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.229+0000 7f66c3e00640 1 -- 172.21.15.114:0/2083814819 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f66bc009480 con 0x7f66cc06db50 2024-02-17T12:18:40.234 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:18:40.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 -- 172.21.15.114:0/2083814819 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66ac066e40 msgr2=0x7f66ac069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66ac066e40 0x7f66ac069300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f66b80ad000 tx=0x7f66b8008040 comp rx=0 tx=0).stop 2024-02-17T12:18:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 -- 172.21.15.114:0/2083814819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 msgr2=0x7f66cc1447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 0x7f66cc1447d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00e840 tx=0x7f66bc00ed00 comp rx=0 tx=0).stop 2024-02-17T12:18:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 -- 172.21.15.114:0/2083814819 shutdown_connections 2024-02-17T12:18:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f66cc150490 0x7f66cc1f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f66cc0c25a0 0x7f66cc1f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f66ac066e40 0x7f66ac069300 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 --2- 172.21.15.114:0/2083814819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66cc06db50 0x7f66cc1447d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 -- 172.21.15.114:0/2083814819 >> 172.21.15.114:0/2083814819 conn(0x7f66cc0a8490 msgr2=0x7f66cc0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 -- 172.21.15.114:0/2083814819 shutdown_connections 2024-02-17T12:18:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.233+0000 7f66d2a00640 1 -- 172.21.15.114:0/2083814819 wait complete. 2024-02-17T12:18:40.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:18:40.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.385+0000 7fbc45200640 1 Processor -- start 2024-02-17T12:18:40.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc45200640 1 -- start start 2024-02-17T12:18:40.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc45200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbc40070b60 0x7fbc40156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc45200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc40072d50 0x7fbc400c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc45200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc40153250 con 0x7fbc4013be90 2024-02-17T12:18:40.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc45200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc40156730 con 0x7fbc40072d50 2024-02-17T12:18:40.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc45200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4006e780 con 0x7fbc40070b60 2024-02-17T12:18:40.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc3fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc40072d50 0x7fbc400c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc3fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbc40072d50 0x7fbc400c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56258/0 (socket says 172.21.15.114:56258) 2024-02-17T12:18:40.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc3fe00640 1 -- 172.21.15.114:0/2173300822 learned_addr learned my addr 172.21.15.114:0/2173300822 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:40.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc3ea00640 1 --2- 172.21.15.114:0/2173300822 >> v2:172.21.15.116:3300/0 conn(0x7fbc40070b60 0x7fbc40156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc3fe00640 1 -- 172.21.15.114:0/2173300822 >> v2:172.21.15.116:3300/0 conn(0x7fbc40070b60 msgr2=0x7fbc40156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:40.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/2173300822 >> v2:172.21.15.116:3300/0 conn(0x7fbc40070b60 0x7fbc40156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc3fe00640 1 -- 172.21.15.114:0/2173300822 >> v1:172.21.15.116:6789/0 conn(0x7fbc4013be90 legacy=0x7fbc40152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:40.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.389+0000 7fbc3fe00640 1 -- 172.21.15.114:0/2173300822 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4006ea60 con 0x7fbc40072d50 2024-02-17T12:18:40.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/2173300822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc40072d50 0x7fbc400c3090 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbc4006c710 tx=0x7fbc3801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1658e918f4fb84cd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:40.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc3e000640 1 -- 172.21.15.114:0/2173300822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380a5790 con 0x7fbc40072d50 2024-02-17T12:18:40.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc3e000640 1 -- 172.21.15.114:0/2173300822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380a58f0 con 0x7fbc40072d50 2024-02-17T12:18:40.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc3e000640 1 -- 172.21.15.114:0/2173300822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380a5c80 con 0x7fbc40072d50 2024-02-17T12:18:40.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 -- 172.21.15.114:0/2173300822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc40072d50 msgr2=0x7fbc400c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 --2- 172.21.15.114:0/2173300822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc40072d50 0x7fbc400c3090 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbc4006c710 tx=0x7fbc3801c8f0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 -- 172.21.15.114:0/2173300822 shutdown_connections 2024-02-17T12:18:40.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 --2- 172.21.15.114:0/2173300822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc40072d50 0x7fbc400c3090 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 --2- 172.21.15.114:0/2173300822 >> v2:172.21.15.116:3300/0 conn(0x7fbc40070b60 0x7fbc40156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 -- 172.21.15.114:0/2173300822 >> 172.21.15.114:0/2173300822 conn(0x7fbc400a8660 msgr2=0x7fbc400a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:40.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 -- 172.21.15.114:0/2173300822 shutdown_connections 2024-02-17T12:18:40.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 -- 172.21.15.114:0/2173300822 wait complete. 2024-02-17T12:18:40.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 Processor -- start 2024-02-17T12:18:40.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 -- start start 2024-02-17T12:18:40.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc40070b60 0x7fbc40150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc40072d50 0x7fbc401389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4013be90 0x7fbc40138f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400bcb70 con 0x7fbc4013be90 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40151ec0 con 0x7fbc40072d50 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.393+0000 7fbc45200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc401ee450 con 0x7fbc40070b60 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4013be90 0x7fbc40138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4013be90 0x7fbc40138f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56274/0 (socket says 172.21.15.114:56274) 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3fe00640 1 -- 172.21.15.114:0/3317439835 learned_addr learned my addr 172.21.15.114:0/3317439835 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3ea00640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc40072d50 0x7fbc401389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3f400640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc40070b60 0x7fbc40150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3fe00640 1 -- 172.21.15.114:0/3317439835 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc40070b60 msgr2=0x7fbc40150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc40070b60 0x7fbc40150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3fe00640 1 -- 172.21.15.114:0/3317439835 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc40072d50 msgr2=0x7fbc401389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc40072d50 0x7fbc401389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3fe00640 1 -- 172.21.15.114:0/3317439835 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38009b30 con 0x7fbc4013be90 2024-02-17T12:18:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc3fe00640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4013be90 0x7fbc40138f30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbc380af040 tx=0x7fbc38019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc37400640 1 -- 172.21.15.114:0/3317439835 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380b8670 con 0x7fbc4013be90 2024-02-17T12:18:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc37400640 1 -- 172.21.15.114:0/3317439835 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380b87d0 con 0x7fbc4013be90 2024-02-17T12:18:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc45200640 1 -- 172.21.15.114:0/3317439835 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc400bb250 con 0x7fbc4013be90 2024-02-17T12:18:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc37400640 1 -- 172.21.15.114:0/3317439835 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380b8b60 con 0x7fbc4013be90 2024-02-17T12:18:40.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc45200640 1 -- 172.21.15.114:0/3317439835 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc400bb810 con 0x7fbc4013be90 2024-02-17T12:18:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc45200640 1 -- 172.21.15.114:0/3317439835 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4004eef0 con 0x7fbc4013be90 2024-02-17T12:18:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc37400640 1 -- 172.21.15.114:0/3317439835 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbc380b8cc0 con 0x7fbc4013be90 2024-02-17T12:18:40.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.397+0000 7fbc37400640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc20066e70 0x7fbc20069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.401+0000 7fbc37400640 1 -- 172.21.15.114:0/3317439835 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbc38120170 con 0x7fbc4013be90 2024-02-17T12:18:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.401+0000 7fbc3f400640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc20066e70 0x7fbc20069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.401+0000 7fbc3f400640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc20066e70 0x7fbc20069330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbc40072620 tx=0x7fbc30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:40.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.401+0000 7fbc37400640 1 -- 172.21.15.114:0/3317439835 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbc380ecd10 con 0x7fbc4013be90 2024-02-17T12:18:40.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.569+0000 7fbc45200640 1 -- 172.21.15.114:0/3317439835 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc4006f060 con 0x7fbc4013be90 2024-02-17T12:18:40.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.569+0000 7fbc37400640 1 -- 172.21.15.114:0/3317439835 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbc380f03d0 con 0x7fbc4013be90 2024-02-17T12:18:40.573 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:18:40.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 -- 172.21.15.114:0/3317439835 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc20066e70 msgr2=0x7fbc20069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc20066e70 0x7fbc20069330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbc40072620 tx=0x7fbc30008040 comp rx=0 tx=0).stop 2024-02-17T12:18:40.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 -- 172.21.15.114:0/3317439835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4013be90 msgr2=0x7fbc40138f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4013be90 0x7fbc40138f30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbc380af040 tx=0x7fbc38019690 comp rx=0 tx=0).stop 2024-02-17T12:18:40.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 -- 172.21.15.114:0/3317439835 shutdown_connections 2024-02-17T12:18:40.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbc20066e70 0x7fbc20069330 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc4013be90 0x7fbc40138f30 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbc40072d50 0x7fbc401389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 --2- 172.21.15.114:0/3317439835 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbc40070b60 0x7fbc40150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 -- 172.21.15.114:0/3317439835 >> 172.21.15.114:0/3317439835 conn(0x7fbc400a8660 msgr2=0x7fbc400c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:40.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 -- 172.21.15.114:0/3317439835 shutdown_connections 2024-02-17T12:18:40.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.573+0000 7fbc45200640 1 -- 172.21.15.114:0/3317439835 wait complete. 2024-02-17T12:18:40.594 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-17T12:18:40.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:40.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-17T12:18:40.623 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:18:40.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:18:40.624 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-17T12:18:40.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.805+0000 7f403f400640 1 Processor -- start 2024-02-17T12:18:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.805+0000 7f403f400640 1 -- start start 2024-02-17T12:18:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f403f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f40380c25a0 0x7f403806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f403f400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4038156270 con 0x7f403806db50 2024-02-17T12:18:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f403f400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4038156550 con 0x7f4038152c50 2024-02-17T12:18:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f403f400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4038071630 con 0x7f40380c25a0 2024-02-17T12:18:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f403ca00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f40380c25a0 0x7f403806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f4037e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f403806db50 0x7f403814ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53462/0 (socket says 172.21.15.114:53462) 2024-02-17T12:18:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f4037e00640 1 -- 172.21.15.114:0/3810685773 learned_addr learned my addr 172.21.15.114:0/3810685773 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f403ca00640 1 -- 172.21.15.114:0/3810685773 >> v1:172.21.15.116:6789/0 conn(0x7f4038152c50 legacy=0x7f4038153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f403ca00640 1 -- 172.21.15.114:0/3810685773 >> v1:172.21.15.114:6789/0 conn(0x7f403806db50 legacy=0x7f403814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f403ca00640 1 -- 172.21.15.114:0/3810685773 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4038156830 con 0x7f40380c25a0 2024-02-17T12:18:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.809+0000 7f4037400640 1 -- 172.21.15.114:0/3810685773 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997486211 0 0) 0x7f4038156270 con 0x7f403806db50 2024-02-17T12:18:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403ca00640 1 --2- 172.21.15.114:0/3810685773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c25a0 0x7f403806e980 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4028009d90 tx=0x7f402801c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f80408c3c1af014 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f4037400640 1 -- 172.21.15.114:0/3810685773 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280a57c0 con 0x7f40380c25a0 2024-02-17T12:18:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f4037400640 1 -- 172.21.15.114:0/3810685773 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280a5920 con 0x7f40380c25a0 2024-02-17T12:18:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f4037400640 1 -- 172.21.15.114:0/3810685773 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280a5cb0 con 0x7f40380c25a0 2024-02-17T12:18:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 -- 172.21.15.114:0/3810685773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c25a0 msgr2=0x7f403806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 --2- 172.21.15.114:0/3810685773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c25a0 0x7f403806e980 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4028009d90 tx=0x7f402801c7e0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 -- 172.21.15.114:0/3810685773 shutdown_connections 2024-02-17T12:18:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 --2- 172.21.15.114:0/3810685773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40380c25a0 0x7f403806e980 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 -- 172.21.15.114:0/3810685773 >> 172.21.15.114:0/3810685773 conn(0x7f40380a8490 msgr2=0x7f40380a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 -- 172.21.15.114:0/3810685773 shutdown_connections 2024-02-17T12:18:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 -- 172.21.15.114:0/3810685773 wait complete. 2024-02-17T12:18:40.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 Processor -- start 2024-02-17T12:18:40.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 -- start start 2024-02-17T12:18:40.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806db50 0x7f40381f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40380c25a0 0x7f40381ed340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4038152c50 0x7f403814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40381f0ea0 con 0x7f403806db50 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40381f08b0 con 0x7f4038152c50 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403f400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40381f1800 con 0x7f40380c25a0 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.813+0000 7f403ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806db50 0x7f40381f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806db50 0x7f40381f12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56288/0 (socket says 172.21.15.114:56288) 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403ca00640 1 -- 172.21.15.114:0/2152760010 learned_addr learned my addr 172.21.15.114:0/2152760010 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f4037e00640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40380c25a0 0x7f40381ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403d400640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4038152c50 0x7f403814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403ca00640 1 -- 172.21.15.114:0/2152760010 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40380c25a0 msgr2=0x7f40381ed340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403ca00640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40380c25a0 0x7f40381ed340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403ca00640 1 -- 172.21.15.114:0/2152760010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4038152c50 msgr2=0x7f403814eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403ca00640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4038152c50 0x7f403814eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403ca00640 1 -- 172.21.15.114:0/2152760010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4028009a70 con 0x7f403806db50 2024-02-17T12:18:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403ca00640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806db50 0x7f40381f12c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f40280b0040 tx=0x7f4028019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f4034c00640 1 -- 172.21.15.114:0/2152760010 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280ad850 con 0x7f403806db50 2024-02-17T12:18:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f4034c00640 1 -- 172.21.15.114:0/2152760010 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280ad9b0 con 0x7f403806db50 2024-02-17T12:18:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403f400640 1 -- 172.21.15.114:0/2152760010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40380ab040 con 0x7f403806db50 2024-02-17T12:18:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f4034c00640 1 -- 172.21.15.114:0/2152760010 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280add60 con 0x7f403806db50 2024-02-17T12:18:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403f400640 1 -- 172.21.15.114:0/2152760010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40381f0ac0 con 0x7f403806db50 2024-02-17T12:18:40.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f403f400640 1 -- 172.21.15.114:0/2152760010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4038074840 con 0x7f403806db50 2024-02-17T12:18:40.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f4034c00640 1 -- 172.21.15.114:0/2152760010 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f40280b4050 con 0x7f403806db50 2024-02-17T12:18:40.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f4034c00640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4014066e40 0x7f4014069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:40.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.817+0000 7f4034c00640 1 -- 172.21.15.114:0/2152760010 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f402811fd60 con 0x7f403806db50 2024-02-17T12:18:40.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.821+0000 7f4037e00640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4014066e40 0x7f4014069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:40.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.821+0000 7f4037e00640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4014066e40 0x7f4014069300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f403814fb70 tx=0x7f4020007b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:40.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:40.821+0000 7f4034c00640 1 -- 172.21.15.114:0/2152760010 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f40280ec7e0 con 0x7f403806db50 2024-02-17T12:18:41.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 -- 172.21.15.114:0/2152760010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4038145280 con 0x7f403806db50 2024-02-17T12:18:41.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f4034c00640 1 -- 172.21.15.114:0/2152760010 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6188 (secure 0 0 0) 0x7f40280c7090 con 0x7f403806db50 2024-02-17T12:18:41.012 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:41.012 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:02.157066+0000","modified":"2024-02-17T12:18:05.178755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/105000653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":105000653},{"type":"v1","addr":"172.21.15.114:6837","nonce":105000653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:19.704588+0000","modified":"2024-02-17T12:18:22.751088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1690237872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1690237872},{"type":"v1","addr":"172.21.15.114:6836","nonce":1690237872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-02-17T12:18:41.013 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 38 2024-02-17T12:18:41.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 -- 172.21.15.114:0/2152760010 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4014066e40 msgr2=0x7f4014069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4014066e40 0x7f4014069300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f403814fb70 tx=0x7f4020007b80 comp rx=0 tx=0).stop 2024-02-17T12:18:41.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 -- 172.21.15.114:0/2152760010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806db50 msgr2=0x7f40381f12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806db50 0x7f40381f12c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f40280b0040 tx=0x7f4028019580 comp rx=0 tx=0).stop 2024-02-17T12:18:41.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 -- 172.21.15.114:0/2152760010 shutdown_connections 2024-02-17T12:18:41.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4038152c50 0x7f403814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40380c25a0 0x7f40381ed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4014066e40 0x7f4014069300 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 --2- 172.21.15.114:0/2152760010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f403806db50 0x7f40381f12c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 -- 172.21.15.114:0/2152760010 >> 172.21.15.114:0/2152760010 conn(0x7f40380a8490 msgr2=0x7f403806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:41.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 -- 172.21.15.114:0/2152760010 shutdown_connections 2024-02-17T12:18:41.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.009+0000 7f403f400640 1 -- 172.21.15.114:0/2152760010 wait complete. 2024-02-17T12:18:41.033 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:41.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.161+0000 7f25aac00640 1 Processor -- start 2024-02-17T12:18:41.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.161+0000 7f25aac00640 1 -- start start 2024-02-17T12:18:41.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25aac00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f25a414e9b0 0x7f25a40ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25aac00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25a41519b0 0x7f25a406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25aac00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a40aa150 con 0x7f25a406ef50 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25aac00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a414ed90 con 0x7f25a41519b0 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25aac00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a40c1e90 con 0x7f25a414e9b0 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25a8c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25a41519b0 0x7f25a406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25a3400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f25a406ef50 0x7f25a41512a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53474/0 (socket says 172.21.15.114:53474) 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25a3400640 1 -- 172.21.15.114:0/1729718651 learned_addr learned my addr 172.21.15.114:0/1729718651 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25a3e00640 1 --2- 172.21.15.114:0/1729718651 >> v2:172.21.15.116:3300/0 conn(0x7f25a414e9b0 0x7f25a40ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25a8c00640 1 -- 172.21.15.114:0/1729718651 >> v2:172.21.15.116:3300/0 conn(0x7f25a414e9b0 msgr2=0x7f25a40ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25a8c00640 1 --2- 172.21.15.114:0/1729718651 >> v2:172.21.15.116:3300/0 conn(0x7f25a414e9b0 0x7f25a40ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25a8c00640 1 -- 172.21.15.114:0/1729718651 >> v1:172.21.15.114:6789/0 conn(0x7f25a406ef50 legacy=0x7f25a41512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25a8c00640 1 -- 172.21.15.114:0/1729718651 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4152000 con 0x7f25a41519b0 2024-02-17T12:18:41.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.165+0000 7f25a2a00640 1 -- 172.21.15.114:0/1729718651 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148106915 0 0) 0x7f25a40aa150 con 0x7f25a406ef50 2024-02-17T12:18:41.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25a8c00640 1 --2- 172.21.15.114:0/1729718651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 0x7f25a406dc20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f25a40c2410 tx=0x7f259c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a85180105c33935 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:41.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25a2a00640 1 -- 172.21.15.114:0/1729718651 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0ab620 con 0x7f25a41519b0 2024-02-17T12:18:41.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25a2a00640 1 -- 172.21.15.114:0/1729718651 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c0ab780 con 0x7f25a41519b0 2024-02-17T12:18:41.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25a2a00640 1 -- 172.21.15.114:0/1729718651 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0abb10 con 0x7f25a41519b0 2024-02-17T12:18:41.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 -- 172.21.15.114:0/1729718651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 msgr2=0x7f25a406dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 --2- 172.21.15.114:0/1729718651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 0x7f25a406dc20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f25a40c2410 tx=0x7f259c01c480 comp rx=0 tx=0).stop 2024-02-17T12:18:41.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 -- 172.21.15.114:0/1729718651 shutdown_connections 2024-02-17T12:18:41.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 --2- 172.21.15.114:0/1729718651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 0x7f25a406dc20 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 --2- 172.21.15.114:0/1729718651 >> v2:172.21.15.116:3300/0 conn(0x7f25a414e9b0 0x7f25a40ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 -- 172.21.15.114:0/1729718651 >> 172.21.15.114:0/1729718651 conn(0x7f25a40a8490 msgr2=0x7f25a40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:41.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 -- 172.21.15.114:0/1729718651 shutdown_connections 2024-02-17T12:18:41.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 -- 172.21.15.114:0/1729718651 wait complete. 2024-02-17T12:18:41.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 Processor -- start 2024-02-17T12:18:41.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 -- start start 2024-02-17T12:18:41.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25a406ef50 0x7f25a4149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a414e9b0 0x7f25a4071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 0x7f25a4071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a41ed980 con 0x7f25a41519b0 2024-02-17T12:18:41.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a41edeb0 con 0x7f25a414e9b0 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25aac00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a414a860 con 0x7f25a406ef50 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25a8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 0x7f25a4071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25a8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 0x7f25a4071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56306/0 (socket says 172.21.15.114:56306) 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25a8c00640 1 -- 172.21.15.114:0/706086763 learned_addr learned my addr 172.21.15.114:0/706086763 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25a3e00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25a406ef50 0x7f25a4149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.169+0000 7f25a3400640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a414e9b0 0x7f25a4071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25a8c00640 1 -- 172.21.15.114:0/706086763 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25a406ef50 msgr2=0x7f25a4149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25a8c00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25a406ef50 0x7f25a4149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25a8c00640 1 -- 172.21.15.114:0/706086763 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a414e9b0 msgr2=0x7f25a4071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25a8c00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a414e9b0 0x7f25a4071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25a8c00640 1 -- 172.21.15.114:0/706086763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c009420 con 0x7f25a41519b0 2024-02-17T12:18:41.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25a3e00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25a406ef50 0x7f25a4149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:41.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25a3400640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a414e9b0 0x7f25a4071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:41.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25a8c00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 0x7f25a4071580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f259c01a0b0 tx=0x7f259c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:41.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f259be00640 1 -- 172.21.15.114:0/706086763 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0abdc0 con 0x7f25a41519b0 2024-02-17T12:18:41.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f259be00640 1 -- 172.21.15.114:0/706086763 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c0bf410 con 0x7f25a41519b0 2024-02-17T12:18:41.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f259be00640 1 -- 172.21.15.114:0/706086763 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0bf7c0 con 0x7f25a41519b0 2024-02-17T12:18:41.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25aac00640 1 -- 172.21.15.114:0/706086763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a414ab00 con 0x7f25a41519b0 2024-02-17T12:18:41.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25aac00640 1 -- 172.21.15.114:0/706086763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a414a4c0 con 0x7f25a41519b0 2024-02-17T12:18:41.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f25aac00640 1 -- 172.21.15.114:0/706086763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a4070d60 con 0x7f25a41519b0 2024-02-17T12:18:41.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f259be00640 1 -- 172.21.15.114:0/706086763 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f259c0b5400 con 0x7f25a41519b0 2024-02-17T12:18:41.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.173+0000 7f259be00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2580066e70 0x7f2580069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.177+0000 7f259be00640 1 -- 172.21.15.114:0/706086763 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f259c11f560 con 0x7f25a41519b0 2024-02-17T12:18:41.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.177+0000 7f25a3e00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2580066e70 0x7f2580069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.177+0000 7f25a3e00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2580066e70 0x7f2580069330 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2594003fd0 tx=0x7f25940039e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:41.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.181+0000 7f259be00640 1 -- 172.21.15.114:0/706086763 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f25a4070d60 con 0x7f25a41519b0 2024-02-17T12:18:41.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.337+0000 7f25aac00640 1 -- 172.21.15.114:0/706086763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25a4070d60 con 0x7f25a41519b0 2024-02-17T12:18:41.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.337+0000 7f259be00640 1 -- 172.21.15.114:0/706086763 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20458 (secure 0 0 0) 0x7f25a4070d60 con 0x7f25a41519b0 2024-02-17T12:18:41.342 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:41.342 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:21.358057+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 -- 172.21.15.114:0/706086763 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2580066e70 msgr2=0x7f2580069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2580066e70 0x7f2580069330 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2594003fd0 tx=0x7f25940039e0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 -- 172.21.15.114:0/706086763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 msgr2=0x7f25a4071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 0x7f25a4071580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f259c01a0b0 tx=0x7f259c01acc0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 -- 172.21.15.114:0/706086763 shutdown_connections 2024-02-17T12:18:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2580066e70 0x7f2580069330 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25a41519b0 0x7f25a4071580 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25a414e9b0 0x7f25a4071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 --2- 172.21.15.114:0/706086763 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25a406ef50 0x7f25a4149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 -- 172.21.15.114:0/706086763 >> 172.21.15.114:0/706086763 conn(0x7f25a40a8490 msgr2=0x7f25a4147ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 -- 172.21.15.114:0/706086763 shutdown_connections 2024-02-17T12:18:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.341+0000 7f25aac00640 1 -- 172.21.15.114:0/706086763 wait complete. 2024-02-17T12:18:41.363 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:17:59.900395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:18:01.152214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:18:17.610636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:18:18.703971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:18:41.364 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:18:41.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.497+0000 7f296ec00640 1 Processor -- start 2024-02-17T12:18:41.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f296ec00640 1 -- start start 2024-02-17T12:18:41.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f296ec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f29680c46b0 0x7f29680728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f296ec00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2968156850 0x7f296814c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f296ec00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29680c1ef0 con 0x7f296806ed80 2024-02-17T12:18:41.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f296ec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2968153600 con 0x7f29680c46b0 2024-02-17T12:18:41.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f296ec00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29680c3190 con 0x7f2968156850 2024-02-17T12:18:41.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f2967e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f29680c46b0 0x7f29680728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f2967e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f29680c46b0 0x7f29680728c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56318/0 (socket says 172.21.15.114:56318) 2024-02-17T12:18:41.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f2967e00640 1 -- 172.21.15.114:0/340000243 learned_addr learned my addr 172.21.15.114:0/340000243 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:41.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f2967e00640 1 -- 172.21.15.114:0/340000243 >> v2:172.21.15.116:3300/0 conn(0x7f2968156850 msgr2=0x7f296814c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:41.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f2967e00640 1 --2- 172.21.15.114:0/340000243 >> v2:172.21.15.116:3300/0 conn(0x7f2968156850 0x7f296814c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f2967e00640 1 -- 172.21.15.114:0/340000243 >> v1:172.21.15.114:6789/0 conn(0x7f296806ed80 legacy=0x7f2968156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.501+0000 7f2967e00640 1 -- 172.21.15.114:0/340000243 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680aa190 con 0x7f29680c46b0 2024-02-17T12:18:41.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f2967e00640 1 --2- 172.21.15.114:0/340000243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 0x7f29680728c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f29680acc70 tx=0x7f295801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bce55e4ff9a578d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:41.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f2966a00640 1 -- 172.21.15.114:0/340000243 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29580a5880 con 0x7f29680c46b0 2024-02-17T12:18:41.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f2966a00640 1 -- 172.21.15.114:0/340000243 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29580a59e0 con 0x7f29680c46b0 2024-02-17T12:18:41.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f2966a00640 1 -- 172.21.15.114:0/340000243 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29580a5d70 con 0x7f29680c46b0 2024-02-17T12:18:41.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 -- 172.21.15.114:0/340000243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 msgr2=0x7f29680728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 --2- 172.21.15.114:0/340000243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 0x7f29680728c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f29680acc70 tx=0x7f295801c9c0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 -- 172.21.15.114:0/340000243 shutdown_connections 2024-02-17T12:18:41.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 --2- 172.21.15.114:0/340000243 >> v2:172.21.15.116:3300/0 conn(0x7f2968156850 0x7f296814c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 --2- 172.21.15.114:0/340000243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 0x7f29680728c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 -- 172.21.15.114:0/340000243 >> 172.21.15.114:0/340000243 conn(0x7f296806bef0 msgr2=0x7f296806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:41.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 -- 172.21.15.114:0/340000243 shutdown_connections 2024-02-17T12:18:41.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 -- 172.21.15.114:0/340000243 wait complete. 2024-02-17T12:18:41.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 Processor -- start 2024-02-17T12:18:41.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 -- start start 2024-02-17T12:18:41.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f296806ed80 0x7f2968150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 0x7f2968151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2968156850 0x7f296813d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296814fd00 con 0x7f29680c46b0 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29681ee740 con 0x7f296806ed80 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.505+0000 7f296ec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2968153fe0 con 0x7f2968156850 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f2967400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 0x7f2968151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f2967400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 0x7f2968151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56322/0 (socket says 172.21.15.114:56322) 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f2967400640 1 -- 172.21.15.114:0/1341689074 learned_addr learned my addr 172.21.15.114:0/1341689074 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f2967400640 1 -- 172.21.15.114:0/1341689074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2968156850 msgr2=0x7f296813d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f2967400640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2968156850 0x7f296813d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f2967400640 1 -- 172.21.15.114:0/1341689074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f296806ed80 msgr2=0x7f2968150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f2967400640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f296806ed80 0x7f2968150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f2967400640 1 -- 172.21.15.114:0/1341689074 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2958009b30 con 0x7f29680c46b0 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f2967400640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 0x7f2968151340 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f295400c450 tx=0x7f295400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f295fe00640 1 -- 172.21.15.114:0/1341689074 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29540052d0 con 0x7f29680c46b0 2024-02-17T12:18:41.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f295fe00640 1 -- 172.21.15.114:0/1341689074 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2954005430 con 0x7f29680c46b0 2024-02-17T12:18:41.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f295fe00640 1 -- 172.21.15.114:0/1341689074 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954007260 con 0x7f29680c46b0 2024-02-17T12:18:41.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f296ec00640 1 -- 172.21.15.114:0/1341689074 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2968151880 con 0x7f29680c46b0 2024-02-17T12:18:41.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f296ec00640 1 -- 172.21.15.114:0/1341689074 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29681561a0 con 0x7f29680c46b0 2024-02-17T12:18:41.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f296ec00640 1 -- 172.21.15.114:0/1341689074 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2968067370 con 0x7f29680c46b0 2024-02-17T12:18:41.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f295fe00640 1 -- 172.21.15.114:0/1341689074 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f29540073c0 con 0x7f29680c46b0 2024-02-17T12:18:41.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f295fe00640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2948066e40 0x7f2948069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.509+0000 7f295fe00640 1 -- 172.21.15.114:0/1341689074 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2954084600 con 0x7f29680c46b0 2024-02-17T12:18:41.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.513+0000 7f2967e00640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2948066e40 0x7f2948069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.513+0000 7f2967e00640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2948066e40 0x7f2948069300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f29580ae000 tx=0x7f2958004ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:41.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.517+0000 7f295fe00640 1 -- 172.21.15.114:0/1341689074 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2954051120 con 0x7f29680c46b0 2024-02-17T12:18:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 -- 172.21.15.114:0/1341689074 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2968153a00 con 0x7f29680c46b0 2024-02-17T12:18:41.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f295fe00640 1 -- 172.21.15.114:0/1341689074 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2968153a00 con 0x7f29680c46b0 2024-02-17T12:18:41.680 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:18:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 -- 172.21.15.114:0/1341689074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2948066e40 msgr2=0x7f2948069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2948066e40 0x7f2948069300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f29580ae000 tx=0x7f2958004ac0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 -- 172.21.15.114:0/1341689074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 msgr2=0x7f2968151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 0x7f2968151340 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f295400c450 tx=0x7f295400c910 comp rx=0 tx=0).stop 2024-02-17T12:18:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 -- 172.21.15.114:0/1341689074 shutdown_connections 2024-02-17T12:18:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2968156850 0x7f296813d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2948066e40 0x7f2948069300 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29680c46b0 0x7f2968151340 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 --2- 172.21.15.114:0/1341689074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f296806ed80 0x7f2968150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 -- 172.21.15.114:0/1341689074 >> 172.21.15.114:0/1341689074 conn(0x7f296806bef0 msgr2=0x7f296815dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:41.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 -- 172.21.15.114:0/1341689074 shutdown_connections 2024-02-17T12:18:41.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.677+0000 7f296ec00640 1 -- 172.21.15.114:0/1341689074 wait complete. 2024-02-17T12:18:41.702 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:18:41.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.837+0000 7f2f8d400640 1 Processor -- start 2024-02-17T12:18:41.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.837+0000 7f2f8d400640 1 -- start start 2024-02-17T12:18:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f8d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f8814f110 0x7f2f880c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f8d400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f880a9420 con 0x7f2f880c1eb0 2024-02-17T12:18:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f8d400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f88152850 con 0x7f2f880c2580 2024-02-17T12:18:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f8d400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8814f4f0 con 0x7f2f8814f110 2024-02-17T12:18:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f86800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f8814f110 0x7f2f880c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f87200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2f880c1eb0 0x7f2f8815c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53496/0 (socket says 172.21.15.114:53496) 2024-02-17T12:18:41.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f87200640 1 -- 172.21.15.114:0/1613874583 learned_addr learned my addr 172.21.15.114:0/1613874583 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f86800640 1 -- 172.21.15.114:0/1613874583 >> v1:172.21.15.116:6789/0 conn(0x7f2f880c2580 legacy=0x7f2f880aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f86800640 1 -- 172.21.15.114:0/1613874583 >> v1:172.21.15.114:6789/0 conn(0x7f2f880c1eb0 legacy=0x7f2f8815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f86800640 1 -- 172.21.15.114:0/1613874583 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f880a9670 con 0x7f2f8814f110 2024-02-17T12:18:41.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f85400640 1 -- 172.21.15.114:0/1613874583 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079336848 0 0) 0x7f2f88152850 con 0x7f2f880c2580 2024-02-17T12:18:41.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.841+0000 7f2f86800640 1 --2- 172.21.15.114:0/1613874583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8814f110 0x7f2f880c65a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009d90 tx=0x7f2f7801c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cb279fc203c00a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:41.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f85400640 1 -- 172.21.15.114:0/1613874583 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780a57d0 con 0x7f2f8814f110 2024-02-17T12:18:41.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f85400640 1 -- 172.21.15.114:0/1613874583 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f780a5930 con 0x7f2f8814f110 2024-02-17T12:18:41.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f85400640 1 -- 172.21.15.114:0/1613874583 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780a5cc0 con 0x7f2f8814f110 2024-02-17T12:18:41.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 -- 172.21.15.114:0/1613874583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8814f110 msgr2=0x7f2f880c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 --2- 172.21.15.114:0/1613874583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8814f110 0x7f2f880c65a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009d90 tx=0x7f2f7801c770 comp rx=0 tx=0).stop 2024-02-17T12:18:41.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 -- 172.21.15.114:0/1613874583 shutdown_connections 2024-02-17T12:18:41.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 --2- 172.21.15.114:0/1613874583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8814f110 0x7f2f880c65a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 -- 172.21.15.114:0/1613874583 >> 172.21.15.114:0/1613874583 conn(0x7f2f880a8490 msgr2=0x7f2f880a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:41.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 -- 172.21.15.114:0/1613874583 shutdown_connections 2024-02-17T12:18:41.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 -- 172.21.15.114:0/1613874583 wait complete. 2024-02-17T12:18:41.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 Processor -- start 2024-02-17T12:18:41.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 -- start start 2024-02-17T12:18:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f880c1eb0 0x7f2f8814bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f880c2580 0x7f2f881ee380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8814f110 0x7f2f880bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f881ee8c0 con 0x7f2f880c1eb0 2024-02-17T12:18:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88150c80 con 0x7f2f8814f110 2024-02-17T12:18:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f8d400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f88150f60 con 0x7f2f880c2580 2024-02-17T12:18:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f86800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f880c1eb0 0x7f2f8814bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f86800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f880c1eb0 0x7f2f8814bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56344/0 (socket says 172.21.15.114:56344) 2024-02-17T12:18:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f86800640 1 -- 172.21.15.114:0/3252330866 learned_addr learned my addr 172.21.15.114:0/3252330866 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:41.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f87200640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8814f110 0x7f2f880bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f85e00640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f880c2580 0x7f2f881ee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f86800640 1 -- 172.21.15.114:0/3252330866 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f880c2580 msgr2=0x7f2f881ee380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f86800640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f880c2580 0x7f2f881ee380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f86800640 1 -- 172.21.15.114:0/3252330866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8814f110 msgr2=0x7f2f880bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f86800640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8814f110 0x7f2f880bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f86800640 1 -- 172.21.15.114:0/3252330866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f78009a70 con 0x7f2f880c1eb0 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.845+0000 7f2f85e00640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f880c2580 0x7f2f881ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f86800640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f880c1eb0 0x7f2f8814bd70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2f78019380 tx=0x7f2f78019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f7ea00640 1 -- 172.21.15.114:0/3252330866 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780adc80 con 0x7f2f880c1eb0 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f7ea00640 1 -- 172.21.15.114:0/3252330866 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f780adde0 con 0x7f2f880c1eb0 2024-02-17T12:18:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f7ea00640 1 -- 172.21.15.114:0/3252330866 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780b7630 con 0x7f2f880c1eb0 2024-02-17T12:18:41.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f8d400640 1 -- 172.21.15.114:0/3252330866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f88151240 con 0x7f2f880c1eb0 2024-02-17T12:18:41.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f8d400640 1 -- 172.21.15.114:0/3252330866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f881ede60 con 0x7f2f880c1eb0 2024-02-17T12:18:41.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f8d400640 1 -- 172.21.15.114:0/3252330866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f881ed9e0 con 0x7f2f880c1eb0 2024-02-17T12:18:41.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f7ea00640 1 -- 172.21.15.114:0/3252330866 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2f780b4050 con 0x7f2f880c1eb0 2024-02-17T12:18:41.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f7ea00640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f64066e40 0x7f2f64069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:41.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f7ea00640 1 -- 172.21.15.114:0/3252330866 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2f78120150 con 0x7f2f880c1eb0 2024-02-17T12:18:41.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.849+0000 7f2f85e00640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f64066e40 0x7f2f64069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:41.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.853+0000 7f2f85e00640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f64066e40 0x7f2f64069300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2f88149280 tx=0x7f2f70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:41.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:41.853+0000 7f2f7ea00640 1 -- 172.21.15.114:0/3252330866 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2f881ed9e0 con 0x7f2f880c1eb0 2024-02-17T12:18:42.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 -- 172.21.15.114:0/3252330866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f881ed9e0 con 0x7f2f880c1eb0 2024-02-17T12:18:42.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f7ea00640 1 -- 172.21.15.114:0/3252330866 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f881ed9e0 con 0x7f2f880c1eb0 2024-02-17T12:18:42.012 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:18:42.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 -- 172.21.15.114:0/3252330866 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f64066e40 msgr2=0x7f2f64069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f64066e40 0x7f2f64069300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2f88149280 tx=0x7f2f70009040 comp rx=0 tx=0).stop 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 -- 172.21.15.114:0/3252330866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f880c1eb0 msgr2=0x7f2f8814bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f880c1eb0 0x7f2f8814bd70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2f78019380 tx=0x7f2f78019510 comp rx=0 tx=0).stop 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 -- 172.21.15.114:0/3252330866 shutdown_connections 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f8814f110 0x7f2f880bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2f880c2580 0x7f2f881ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2f64066e40 0x7f2f64069300 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 --2- 172.21.15.114:0/3252330866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f880c1eb0 0x7f2f8814bd70 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 -- 172.21.15.114:0/3252330866 >> 172.21.15.114:0/3252330866 conn(0x7f2f880a8490 msgr2=0x7f2f880a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 -- 172.21.15.114:0/3252330866 shutdown_connections 2024-02-17T12:18:42.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.009+0000 7f2f8d400640 1 -- 172.21.15.114:0/3252330866 wait complete. 2024-02-17T12:18:42.033 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:18:42.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.165+0000 7f0d69400640 1 Processor -- start 2024-02-17T12:18:42.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.165+0000 7f0d69400640 1 -- start start 2024-02-17T12:18:42.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d69400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d640afd40 0x7f0d640c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d69400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0d640bdbc0 0x7f0d6406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d69400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d64154d90 con 0x7f0d640c83f0 2024-02-17T12:18:42.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d69400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d641526f0 con 0x7f0d640bdbc0 2024-02-17T12:18:42.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d69400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d64155a10 con 0x7f0d640afd40 2024-02-17T12:18:42.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d63400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0d640bdbc0 0x7f0d6406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d68a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0d640c83f0 0x7f0d6406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53508/0 (socket says 172.21.15.114:53508) 2024-02-17T12:18:42.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d68a00640 1 -- 172.21.15.114:0/3865137545 learned_addr learned my addr 172.21.15.114:0/3865137545 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:42.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d63e00640 1 --2- 172.21.15.114:0/3865137545 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d640afd40 0x7f0d640c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d62a00640 1 -- 172.21.15.114:0/3865137545 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810022652 0 0) 0x7f0d64154d90 con 0x7f0d640c83f0 2024-02-17T12:18:42.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d62a00640 1 -- 172.21.15.114:0/3865137545 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d48003530 con 0x7f0d640c83f0 2024-02-17T12:18:42.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d63400640 1 -- 172.21.15.114:0/3865137545 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d640afd40 msgr2=0x7f0d640c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:42.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d63400640 1 --2- 172.21.15.114:0/3865137545 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d640afd40 0x7f0d640c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d63400640 1 -- 172.21.15.114:0/3865137545 >> v1:172.21.15.114:6789/0 conn(0x7f0d640c83f0 legacy=0x7f0d6406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d63400640 1 -- 172.21.15.114:0/3865137545 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d64155070 con 0x7f0d640bdbc0 2024-02-17T12:18:42.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d63400640 1 --2- 172.21.15.114:0/3865137545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 0x7f0d6406c100 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0097c0 tx=0x7f0d4c01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355db8aae2979c78 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:42.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d62a00640 1 -- 172.21.15.114:0/3865137545 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c004230 con 0x7f0d640bdbc0 2024-02-17T12:18:42.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d62a00640 1 -- 172.21.15.114:0/3865137545 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0a7050 con 0x7f0d640bdbc0 2024-02-17T12:18:42.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.169+0000 7f0d62a00640 1 -- 172.21.15.114:0/3865137545 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c003620 con 0x7f0d640bdbc0 2024-02-17T12:18:42.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 -- 172.21.15.114:0/3865137545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 msgr2=0x7f0d6406c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 --2- 172.21.15.114:0/3865137545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 0x7f0d6406c100 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0097c0 tx=0x7f0d4c01c350 comp rx=0 tx=0).stop 2024-02-17T12:18:42.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 -- 172.21.15.114:0/3865137545 shutdown_connections 2024-02-17T12:18:42.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 --2- 172.21.15.114:0/3865137545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 0x7f0d6406c100 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 --2- 172.21.15.114:0/3865137545 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d640afd40 0x7f0d640c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 -- 172.21.15.114:0/3865137545 >> 172.21.15.114:0/3865137545 conn(0x7f0d640ca4f0 msgr2=0x7f0d640ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:42.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 -- 172.21.15.114:0/3865137545 shutdown_connections 2024-02-17T12:18:42.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 -- 172.21.15.114:0/3865137545 wait complete. 2024-02-17T12:18:42.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 Processor -- start 2024-02-17T12:18:42.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 -- start start 2024-02-17T12:18:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d640afd40 0x7f0d6414e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 0x7f0d641512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d640c83f0 0x7f0d64148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640bd7b0 con 0x7f0d640bdbc0 2024-02-17T12:18:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6414b090 con 0x7f0d640c83f0 2024-02-17T12:18:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d69400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6414b370 con 0x7f0d640afd40 2024-02-17T12:18:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d63400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 0x7f0d641512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d63400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 0x7f0d641512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56352/0 (socket says 172.21.15.114:56352) 2024-02-17T12:18:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d63400640 1 -- 172.21.15.114:0/1564672671 learned_addr learned my addr 172.21.15.114:0/1564672671 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:42.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d63e00640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d640afd40 0x7f0d6414e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d68a00640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d640c83f0 0x7f0d64148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d63400640 1 -- 172.21.15.114:0/1564672671 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d640afd40 msgr2=0x7f0d6414e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d63400640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d640afd40 0x7f0d6414e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d63400640 1 -- 172.21.15.114:0/1564672671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d640c83f0 msgr2=0x7f0d64148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d63400640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d640c83f0 0x7f0d64148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.173+0000 7f0d63400640 1 -- 172.21.15.114:0/1564672671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c009420 con 0x7f0d640bdbc0 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d63400640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 0x7f0d641512d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c019f80 tx=0x7f0d4c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d5be00640 1 -- 172.21.15.114:0/1564672671 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c003bf0 con 0x7f0d640bdbc0 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d5be00640 1 -- 172.21.15.114:0/1564672671 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c003d70 con 0x7f0d640bdbc0 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d69400640 1 -- 172.21.15.114:0/1564672671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6414cdd0 con 0x7f0d640bdbc0 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d5be00640 1 -- 172.21.15.114:0/1564672671 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0ab680 con 0x7f0d640bdbc0 2024-02-17T12:18:42.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d69400640 1 -- 172.21.15.114:0/1564672671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6414dd30 con 0x7f0d640bdbc0 2024-02-17T12:18:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d69400640 1 -- 172.21.15.114:0/1564672671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6414b530 con 0x7f0d640bdbc0 2024-02-17T12:18:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d5be00640 1 -- 172.21.15.114:0/1564672671 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0d4c0b2040 con 0x7f0d640bdbc0 2024-02-17T12:18:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d5be00640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0d40066e40 0x7f0d40069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d5be00640 1 -- 172.21.15.114:0/1564672671 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0d4c11ed20 con 0x7f0d640bdbc0 2024-02-17T12:18:42.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d63e00640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0d40066e40 0x7f0d40069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.177+0000 7f0d63e00640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0d40066e40 0x7f0d40069300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d54003fd0 tx=0x7f0d540039a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:42.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.181+0000 7f0d5be00640 1 -- 172.21.15.114:0/1564672671 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0d4c0eb7a0 con 0x7f0d640bdbc0 2024-02-17T12:18:42.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.333+0000 7f0d69400640 1 -- 172.21.15.114:0/1564672671 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d6404eef0 con 0x7f0d640bdbc0 2024-02-17T12:18:42.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.333+0000 7f0d5be00640 1 -- 172.21.15.114:0/1564672671 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d4c0b9020 con 0x7f0d640bdbc0 2024-02-17T12:18:42.339 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:18:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 -- 172.21.15.114:0/1564672671 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0d40066e40 msgr2=0x7f0d40069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0d40066e40 0x7f0d40069300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d54003fd0 tx=0x7f0d540039a0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 -- 172.21.15.114:0/1564672671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 msgr2=0x7f0d641512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 0x7f0d641512d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c019f80 tx=0x7f0d4c0190f0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 -- 172.21.15.114:0/1564672671 shutdown_connections 2024-02-17T12:18:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d640c83f0 0x7f0d64148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0d40066e40 0x7f0d40069300 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d640bdbc0 0x7f0d641512d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 --2- 172.21.15.114:0/1564672671 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d640afd40 0x7f0d6414e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 -- 172.21.15.114:0/1564672671 >> 172.21.15.114:0/1564672671 conn(0x7f0d640ca4f0 msgr2=0x7f0d64154160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:42.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 -- 172.21.15.114:0/1564672671 shutdown_connections 2024-02-17T12:18:42.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.337+0000 7f0d69400640 1 -- 172.21.15.114:0/1564672671 wait complete. 2024-02-17T12:18:42.360 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:18:42.413 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:18:42.417 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:18:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2679c00640 1 Processor -- start 2024-02-17T12:18:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2679c00640 1 -- start start 2024-02-17T12:18:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2679c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26740c25a0 0x7f267406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2679c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2674152c50 0x7f26741530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2679c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2674156270 con 0x7f267406db50 2024-02-17T12:18:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2679c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2674071630 con 0x7f2674152c50 2024-02-17T12:18:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2679c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2674156550 con 0x7f26740c25a0 2024-02-17T12:18:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2672000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f267406db50 0x7f267414ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53510/0 (socket says 172.21.15.114:53510) 2024-02-17T12:18:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2672000640 1 -- 172.21.15.114:0/1844922540 learned_addr learned my addr 172.21.15.114:0/1844922540 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2673400640 1 --2- 172.21.15.114:0/1844922540 >> v2:172.21.15.116:3300/0 conn(0x7f2674152c50 0x7f26741530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2672a00640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26740c25a0 0x7f267406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990203674 0 0) 0x7f2674156270 con 0x7f267406db50 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2658003530 con 0x7f267406db50 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3195899924 0 0) 0x7f2658003530 con 0x7f267406db50 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26740c25a0 msgr2=0x7f267406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26740c25a0 0x7f267406e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 >> v2:172.21.15.116:3300/0 conn(0x7f2674152c50 msgr2=0x7f26741530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 --2- 172.21.15.114:0/1844922540 >> v2:172.21.15.116:3300/0 conn(0x7f2674152c50 0x7f26741530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674156830 con 0x7f267406db50 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f2660001680 con 0x7f267406db50 2024-02-17T12:18:42.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 >> v1:172.21.15.114:6789/0 conn(0x7f267406db50 legacy=0x7f267414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658003980 0x7f2658003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26740c25a0 0x7f26580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2658004d10 0x7f2658005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2674156550 con 0x7f2658003980 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265800b9e0 con 0x7f2658004d10 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265800bba0 con 0x7f26740c25a0 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2672a00640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658003980 0x7f2658003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2672000640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26740c25a0 0x7f26580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2673400640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2658004d10 0x7f2658005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2672a00640 1 -- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26740c25a0 msgr2=0x7f26580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2672a00640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26740c25a0 0x7f26580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2672a00640 1 -- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2658004d10 msgr2=0x7f2658005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2672a00640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2658004d10 0x7f2658005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2672a00640 1 -- 172.21.15.114:0/1844922540 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2658003530 con 0x7f2658003980 2024-02-17T12:18:42.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.497+0000 7f2673400640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2658004d10 0x7f2658005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2672a00640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658003980 0x7f2658003da0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2664009ae0 tx=0x7f266401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2035926ab9a4302 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26640a55f0 con 0x7f2658003980 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26640a5750 con 0x7f2658003980 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2671600640 1 -- 172.21.15.114:0/1844922540 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26640a5b00 con 0x7f2658003980 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2679c00640 1 -- 172.21.15.114:0/1844922540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658003980 msgr2=0x7f2658003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2679c00640 1 --2- 172.21.15.114:0/1844922540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658003980 0x7f2658003da0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2664009ae0 tx=0x7f266401ca40 comp rx=0 tx=0).stop 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2673400640 1 -- 172.21.15.114:0/1844922540 reap_dead start 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2679c00640 1 -- 172.21.15.114:0/1844922540 shutdown_connections 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2679c00640 1 -- 172.21.15.114:0/1844922540 >> 172.21.15.114:0/1844922540 conn(0x7f26740a8490 msgr2=0x7f26740a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2679c00640 1 -- 172.21.15.114:0/1844922540 shutdown_connections 2024-02-17T12:18:42.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.501+0000 7f2679c00640 1 -- 172.21.15.114:0/1844922540 wait complete. 2024-02-17T12:18:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2679c00640 1 Processor -- start 2024-02-17T12:18:42.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2679c00640 1 -- start start 2024-02-17T12:18:42.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2679c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2658003980 0x7f26741552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2679c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267414cbe0 0x7f26741f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2679c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26741f5bd0 0x7f26741f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2679c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267414d3f0 con 0x7f26741f5bd0 2024-02-17T12:18:42.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2679c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267414d110 con 0x7f267414cbe0 2024-02-17T12:18:42.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2679c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26741f50f0 con 0x7f2658003980 2024-02-17T12:18:42.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2673400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26741f5bd0 0x7f26741f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2673400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26741f5bd0 0x7f26741f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56370/0 (socket says 172.21.15.114:56370) 2024-02-17T12:18:42.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2673400640 1 -- 172.21.15.114:0/1563254597 learned_addr learned my addr 172.21.15.114:0/1563254597 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:42.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2672a00640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2658003980 0x7f26741552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2672000640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267414cbe0 0x7f26741f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2673400640 1 -- 172.21.15.114:0/1563254597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2658003980 msgr2=0x7f26741552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2673400640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2658003980 0x7f26741552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2673400640 1 -- 172.21.15.114:0/1563254597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267414cbe0 msgr2=0x7f26741f19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2673400640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267414cbe0 0x7f26741f19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2673400640 1 -- 172.21.15.114:0/1563254597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26741f53d0 con 0x7f26741f5bd0 2024-02-17T12:18:42.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2673400640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26741f5bd0 0x7f26741f1f10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f267406c880 tx=0x7f266c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f266aa00640 1 -- 172.21.15.114:0/1563254597 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00e050 con 0x7f26741f5bd0 2024-02-17T12:18:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f266aa00640 1 -- 172.21.15.114:0/1563254597 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c00f040 con 0x7f26741f5bd0 2024-02-17T12:18:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f266aa00640 1 -- 172.21.15.114:0/1563254597 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0039a0 con 0x7f26741f5bd0 2024-02-17T12:18:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2679c00640 1 -- 172.21.15.114:0/1563254597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26741f56b0 con 0x7f26741f5bd0 2024-02-17T12:18:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.505+0000 7f2679c00640 1 -- 172.21.15.114:0/1563254597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2674155810 con 0x7f26741f5bd0 2024-02-17T12:18:42.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.509+0000 7f2679c00640 1 -- 172.21.15.114:0/1563254597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267406bba0 con 0x7f26741f5bd0 2024-02-17T12:18:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.509+0000 7f266aa00640 1 -- 172.21.15.114:0/1563254597 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f266c015440 con 0x7f26741f5bd0 2024-02-17T12:18:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.509+0000 7f266aa00640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2654066e70 0x7f2654069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.509+0000 7f266aa00640 1 -- 172.21.15.114:0/1563254597 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f266c085280 con 0x7f26741f5bd0 2024-02-17T12:18:42.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.509+0000 7f2672a00640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2654066e70 0x7f2654069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.509+0000 7f2672a00640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2654066e70 0x7f2654069330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f26640af000 tx=0x7f26640046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:42.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.513+0000 7f266aa00640 1 -- 172.21.15.114:0/1563254597 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f266c051d00 con 0x7f26741f5bd0 2024-02-17T12:18:42.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.665+0000 7f2679c00640 1 -- 172.21.15.114:0/1563254597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2674074840 con 0x7f26741f5bd0 2024-02-17T12:18:42.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f266aa00640 1 -- 172.21.15.114:0/1563254597 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f266c0553c0 con 0x7f26741f5bd0 2024-02-17T12:18:42.671 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:18:42.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 -- 172.21.15.114:0/1563254597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2654066e70 msgr2=0x7f2654069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2654066e70 0x7f2654069330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f26640af000 tx=0x7f26640046d0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 -- 172.21.15.114:0/1563254597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26741f5bd0 msgr2=0x7f26741f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26741f5bd0 0x7f26741f1f10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f267406c880 tx=0x7f266c010590 comp rx=0 tx=0).stop 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 -- 172.21.15.114:0/1563254597 shutdown_connections 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2654066e70 0x7f2654069330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26741f5bd0 0x7f26741f1f10 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267414cbe0 0x7f26741f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 --2- 172.21.15.114:0/1563254597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2658003980 0x7f26741552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 -- 172.21.15.114:0/1563254597 >> 172.21.15.114:0/1563254597 conn(0x7f26740a8490 msgr2=0x7f2674150df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 -- 172.21.15.114:0/1563254597 shutdown_connections 2024-02-17T12:18:42.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.669+0000 7f2679c00640 1 -- 172.21.15.114:0/1563254597 wait complete. 2024-02-17T12:18:42.691 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:18:42.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.869+0000 7f5df2800640 1 Processor -- start 2024-02-17T12:18:42.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.869+0000 7f5df2800640 1 -- start start 2024-02-17T12:18:42.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5df2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5dec14f110 0x7f5dec0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5df2800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5dec0c2580 0x7f5dec0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5df2800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec0a9420 con 0x7f5dec0c1eb0 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5df2800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec14f4f0 con 0x7f5dec14f110 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5df2800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec0aae80 con 0x7f5dec0c2580 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5deb400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5dec14f110 0x7f5dec0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5deb400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5dec14f110 0x7f5dec0c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56386/0 (socket says 172.21.15.114:56386) 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5deb400640 1 -- 172.21.15.114:0/1724563743 learned_addr learned my addr 172.21.15.114:0/1724563743 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5deaa00640 1 --2- 172.21.15.114:0/1724563743 >> v2:172.21.15.116:3300/0 conn(0x7f5dec0c2580 0x7f5dec0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5deb400640 1 -- 172.21.15.114:0/1724563743 >> v2:172.21.15.116:3300/0 conn(0x7f5dec0c2580 msgr2=0x7f5dec0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5deb400640 1 --2- 172.21.15.114:0/1724563743 >> v2:172.21.15.116:3300/0 conn(0x7f5dec0c2580 0x7f5dec0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5deb400640 1 -- 172.21.15.114:0/1724563743 >> v1:172.21.15.116:6789/0 conn(0x7f5dec0c1eb0 legacy=0x7f5dec155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5deb400640 1 -- 172.21.15.114:0/1724563743 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec152850 con 0x7f5dec14f110 2024-02-17T12:18:42.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.873+0000 7f5deb400640 1 --2- 172.21.15.114:0/1724563743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec14f110 0x7f5dec0c65a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f5dec06f0d0 tx=0x7f5ddc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae1cc1990b6cb91 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:42.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5dea000640 1 -- 172.21.15.114:0/1724563743 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0ab660 con 0x7f5dec14f110 2024-02-17T12:18:42.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5dea000640 1 -- 172.21.15.114:0/1724563743 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc0ab7c0 con 0x7f5dec14f110 2024-02-17T12:18:42.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5dea000640 1 -- 172.21.15.114:0/1724563743 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0abb50 con 0x7f5dec14f110 2024-02-17T12:18:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 -- 172.21.15.114:0/1724563743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec14f110 msgr2=0x7f5dec0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 --2- 172.21.15.114:0/1724563743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec14f110 0x7f5dec0c65a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f5dec06f0d0 tx=0x7f5ddc01c460 comp rx=0 tx=0).stop 2024-02-17T12:18:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 -- 172.21.15.114:0/1724563743 shutdown_connections 2024-02-17T12:18:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 --2- 172.21.15.114:0/1724563743 >> v2:172.21.15.116:3300/0 conn(0x7f5dec0c2580 0x7f5dec0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 --2- 172.21.15.114:0/1724563743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec14f110 0x7f5dec0c65a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 -- 172.21.15.114:0/1724563743 >> 172.21.15.114:0/1724563743 conn(0x7f5dec0a8490 msgr2=0x7f5dec0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 -- 172.21.15.114:0/1724563743 shutdown_connections 2024-02-17T12:18:42.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 -- 172.21.15.114:0/1724563743 wait complete. 2024-02-17T12:18:42.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 Processor -- start 2024-02-17T12:18:42.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 -- start start 2024-02-17T12:18:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5dec0c1eb0 0x7f5dec0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec0c2580 0x7f5dec140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5dec14f110 0x7f5dec141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec145a50 con 0x7f5dec0c2580 2024-02-17T12:18:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec14aa70 con 0x7f5dec0c1eb0 2024-02-17T12:18:42.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5df2800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec14ad50 con 0x7f5dec14f110 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5deaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec0c2580 0x7f5dec140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5deaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec0c2580 0x7f5dec140ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56398/0 (socket says 172.21.15.114:56398) 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5deaa00640 1 -- 172.21.15.114:0/352567067 learned_addr learned my addr 172.21.15.114:0/352567067 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5deb400640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5dec0c1eb0 0x7f5dec0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.877+0000 7f5debe00640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5dec14f110 0x7f5dec141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5deaa00640 1 -- 172.21.15.114:0/352567067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5dec14f110 msgr2=0x7f5dec141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5deaa00640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5dec14f110 0x7f5dec141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5deaa00640 1 -- 172.21.15.114:0/352567067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5dec0c1eb0 msgr2=0x7f5dec0bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5deaa00640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5dec0c1eb0 0x7f5dec0bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5deaa00640 1 -- 172.21.15.114:0/352567067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0094d0 con 0x7f5dec0c2580 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5deaa00640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec0c2580 0x7f5dec140ac0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800d7d0 tx=0x7f5dd800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:42.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5de3400640 1 -- 172.21.15.114:0/352567067 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800b6c0 con 0x7f5dec0c2580 2024-02-17T12:18:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5de3400640 1 -- 172.21.15.114:0/352567067 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd800b820 con 0x7f5dec0c2580 2024-02-17T12:18:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5de3400640 1 -- 172.21.15.114:0/352567067 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800bbd0 con 0x7f5dec0c2580 2024-02-17T12:18:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5df2800640 1 -- 172.21.15.114:0/352567067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec14b030 con 0x7f5dec0c2580 2024-02-17T12:18:42.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5df2800640 1 -- 172.21.15.114:0/352567067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec0c4000 con 0x7f5dec0c2580 2024-02-17T12:18:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5df2800640 1 -- 172.21.15.114:0/352567067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec0c41c0 con 0x7f5dec0c2580 2024-02-17T12:18:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5de3400640 1 -- 172.21.15.114:0/352567067 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f5dd800bd30 con 0x7f5dec0c2580 2024-02-17T12:18:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5de3400640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5dcc066e40 0x7f5dcc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5de3400640 1 -- 172.21.15.114:0/352567067 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5dd80851e0 con 0x7f5dec0c2580 2024-02-17T12:18:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.881+0000 7f5deb400640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5dcc066e40 0x7f5dcc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:42.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.885+0000 7f5deb400640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5dcc066e40 0x7f5dcc069300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0af000 tx=0x7f5ddc0b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:42.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:42.885+0000 7f5de3400640 1 -- 172.21.15.114:0/352567067 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5dd8051d10 con 0x7f5dec0c2580 2024-02-17T12:18:43.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.040+0000 7f5df2800640 1 -- 172.21.15.114:0/352567067 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f5dec074840 con 0x7f5dec0c2580 2024-02-17T12:18:43.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.040+0000 7f5de3400640 1 -- 172.21.15.114:0/352567067 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f5dd80553d0 con 0x7f5dec0c2580 2024-02-17T12:18:43.045 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:18:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 -- 172.21.15.114:0/352567067 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5dcc066e40 msgr2=0x7f5dcc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5dcc066e40 0x7f5dcc069300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0af000 tx=0x7f5ddc0b6040 comp rx=0 tx=0).stop 2024-02-17T12:18:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 -- 172.21.15.114:0/352567067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec0c2580 msgr2=0x7f5dec140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec0c2580 0x7f5dec140ac0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800d7d0 tx=0x7f5dd800dc90 comp rx=0 tx=0).stop 2024-02-17T12:18:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 -- 172.21.15.114:0/352567067 shutdown_connections 2024-02-17T12:18:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5dec14f110 0x7f5dec141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5dcc066e40 0x7f5dcc069300 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dec0c2580 0x7f5dec140ac0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 --2- 172.21.15.114:0/352567067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5dec0c1eb0 0x7f5dec0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 -- 172.21.15.114:0/352567067 >> 172.21.15.114:0/352567067 conn(0x7f5dec0a8490 msgr2=0x7f5dec0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 -- 172.21.15.114:0/352567067 shutdown_connections 2024-02-17T12:18:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.044+0000 7f5df2800640 1 -- 172.21.15.114:0/352567067 wait complete. 2024-02-17T12:18:43.066 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:43.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29ec00640 1 Processor -- start 2024-02-17T12:18:43.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29ec00640 1 -- start start 2024-02-17T12:18:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29ec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff298150300 0x7ff298156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29ec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff298152d30 0x7ff2981531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29ec00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff298157270 con 0x7ff2980714c0 2024-02-17T12:18:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29ec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980c6900 con 0x7ff298152d30 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29ec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c3580 con 0x7ff298150300 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29cc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff298152d30 0x7ff2981531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff297400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff2980714c0 0x7ff2980aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53526/0 (socket says 172.21.15.114:53526) 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff297400640 1 -- 172.21.15.114:0/2532142659 learned_addr learned my addr 172.21.15.114:0/2532142659 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29cc00640 1 --2- 172.21.15.114:0/2532142659 >> v2:172.21.15.114:3300/0 conn(0x7ff298152d30 0x7ff2981531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56408/0 (socket says 172.21.15.114:56408) 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff297e00640 1 --2- 172.21.15.114:0/2532142659 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff298150300 0x7ff298156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29cc00640 1 -- 172.21.15.114:0/2532142659 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff298150300 msgr2=0x7ff298156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29cc00640 1 --2- 172.21.15.114:0/2532142659 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff298150300 0x7ff298156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29cc00640 1 -- 172.21.15.114:0/2532142659 >> v1:172.21.15.114:6789/0 conn(0x7ff2980714c0 legacy=0x7ff2980aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff29cc00640 1 -- 172.21.15.114:0/2532142659 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980c2fc0 con 0x7ff298152d30 2024-02-17T12:18:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.196+0000 7ff296a00640 1 -- 172.21.15.114:0/2532142659 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395819761 0 0) 0x7ff298157270 con 0x7ff2980714c0 2024-02-17T12:18:43.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff29cc00640 1 --2- 172.21.15.114:0/2532142659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff298152d30 0x7ff2981531c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff2900097c0 tx=0x7ff29001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7ef4653dc35838 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:43.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff296a00640 1 -- 172.21.15.114:0/2532142659 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900a4ea0 con 0x7ff298152d30 2024-02-17T12:18:43.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff296a00640 1 -- 172.21.15.114:0/2532142659 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2900a7050 con 0x7ff298152d30 2024-02-17T12:18:43.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff296a00640 1 -- 172.21.15.114:0/2532142659 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900ab820 con 0x7ff298152d30 2024-02-17T12:18:43.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff29ec00640 1 -- 172.21.15.114:0/2532142659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff298152d30 msgr2=0x7ff2981531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff29ec00640 1 --2- 172.21.15.114:0/2532142659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff298152d30 0x7ff2981531c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff2900097c0 tx=0x7ff29001c410 comp rx=0 tx=0).stop 2024-02-17T12:18:43.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff29ec00640 1 -- 172.21.15.114:0/2532142659 shutdown_connections 2024-02-17T12:18:43.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff29ec00640 1 --2- 172.21.15.114:0/2532142659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff298152d30 0x7ff2981531c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff29ec00640 1 --2- 172.21.15.114:0/2532142659 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff298150300 0x7ff298156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff29ec00640 1 -- 172.21.15.114:0/2532142659 >> 172.21.15.114:0/2532142659 conn(0x7ff2980c4f20 msgr2=0x7ff2980c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:43.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff29ec00640 1 -- 172.21.15.114:0/2532142659 shutdown_connections 2024-02-17T12:18:43.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.200+0000 7ff29ec00640 1 -- 172.21.15.114:0/2532142659 wait complete. 2024-02-17T12:18:43.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 Processor -- start 2024-02-17T12:18:43.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 -- start start 2024-02-17T12:18:43.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2980714c0 0x7ff298156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff298150300 0x7ff2981ee930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff298152d30 0x7ff29814b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29814b260 con 0x7ff2980714c0 2024-02-17T12:18:43.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981eee70 con 0x7ff298150300 2024-02-17T12:18:43.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981570f0 con 0x7ff298152d30 2024-02-17T12:18:43.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2980714c0 0x7ff298156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2980714c0 0x7ff298156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56418/0 (socket says 172.21.15.114:56418) 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297e00640 1 -- 172.21.15.114:0/876701394 learned_addr learned my addr 172.21.15.114:0/876701394 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297400640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff298150300 0x7ff2981ee930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297e00640 1 -- 172.21.15.114:0/876701394 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff298152d30 msgr2=0x7ff29814b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297e00640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff298152d30 0x7ff29814b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297e00640 1 -- 172.21.15.114:0/876701394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff298150300 msgr2=0x7ff2981ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297e00640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff298150300 0x7ff2981ee930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297e00640 1 -- 172.21.15.114:0/876701394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290009420 con 0x7ff2980714c0 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297400640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff298150300 0x7ff2981ee930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff297e00640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2980714c0 0x7ff298156b10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff288007ef0 tx=0x7ff28800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff28fe00640 1 -- 172.21.15.114:0/876701394 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288014620 con 0x7ff2980714c0 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff28fe00640 1 -- 172.21.15.114:0/876701394 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff288014780 con 0x7ff2980714c0 2024-02-17T12:18:43.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 -- 172.21.15.114:0/876701394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29814d5b0 con 0x7ff2980714c0 2024-02-17T12:18:43.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff28fe00640 1 -- 172.21.15.114:0/876701394 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288014b30 con 0x7ff2980714c0 2024-02-17T12:18:43.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 -- 172.21.15.114:0/876701394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff298152070 con 0x7ff2980714c0 2024-02-17T12:18:43.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.204+0000 7ff29ec00640 1 -- 172.21.15.114:0/876701394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29814b400 con 0x7ff2980714c0 2024-02-17T12:18:43.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.208+0000 7ff28fe00640 1 -- 172.21.15.114:0/876701394 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff288014c90 con 0x7ff2980714c0 2024-02-17T12:18:43.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.208+0000 7ff28fe00640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff278066e70 0x7ff278069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.208+0000 7ff28fe00640 1 -- 172.21.15.114:0/876701394 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff288085820 con 0x7ff2980714c0 2024-02-17T12:18:43.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.208+0000 7ff297400640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff278066e70 0x7ff278069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.208+0000 7ff297400640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff278066e70 0x7ff278069330 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff284007fd0 tx=0x7ff284009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:43.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.212+0000 7ff28fe00640 1 -- 172.21.15.114:0/876701394 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff288052210 con 0x7ff2980714c0 2024-02-17T12:18:43.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.400+0000 7ff29ec00640 1 -- 172.21.15.114:0/876701394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff298074840 con 0x7ff2980714c0 2024-02-17T12:18:43.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.400+0000 7ff28fe00640 1 -- 172.21.15.114:0/876701394 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6188 (secure 0 0 0) 0x7ff2880558d0 con 0x7ff2980714c0 2024-02-17T12:18:43.407 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:43.408 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:02.157066+0000","modified":"2024-02-17T12:18:05.178755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/105000653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":105000653},{"type":"v1","addr":"172.21.15.114:6837","nonce":105000653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:19.704588+0000","modified":"2024-02-17T12:18:22.751088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1690237872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1690237872},{"type":"v1","addr":"172.21.15.114:6836","nonce":1690237872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-02-17T12:18:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 38 2024-02-17T12:18:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 -- 172.21.15.114:0/876701394 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff278066e70 msgr2=0x7ff278069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff278066e70 0x7ff278069330 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff284007fd0 tx=0x7ff284009040 comp rx=0 tx=0).stop 2024-02-17T12:18:43.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 -- 172.21.15.114:0/876701394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2980714c0 msgr2=0x7ff298156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2980714c0 0x7ff298156b10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff288007ef0 tx=0x7ff28800e4b0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 -- 172.21.15.114:0/876701394 shutdown_connections 2024-02-17T12:18:43.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff298152d30 0x7ff29814b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff298150300 0x7ff2981ee930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff278066e70 0x7ff278069330 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 --2- 172.21.15.114:0/876701394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2980714c0 0x7ff298156b10 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 -- 172.21.15.114:0/876701394 >> 172.21.15.114:0/876701394 conn(0x7ff2980c4f20 msgr2=0x7ff2980c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:43.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 -- 172.21.15.114:0/876701394 shutdown_connections 2024-02-17T12:18:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.404+0000 7ff29ec00640 1 -- 172.21.15.114:0/876701394 wait complete. 2024-02-17T12:18:43.427 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd73000640 1 Processor -- start 2024-02-17T12:18:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd73000640 1 -- start start 2024-02-17T12:18:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd73000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 0x7fdd6c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd73000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c156270 con 0x7fdd6c0c25a0 2024-02-17T12:18:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd73000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c156550 con 0x7fdd6c150490 2024-02-17T12:18:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd73000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c06f090 con 0x7fdd6c06db50 2024-02-17T12:18:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd6be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdd6c0c25a0 0x7fdd6c06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53528/0 (socket says 172.21.15.114:53528) 2024-02-17T12:18:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd6be00640 1 -- 172.21.15.114:0/1230214234 learned_addr learned my addr 172.21.15.114:0/1230214234 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd6b400640 1 --2- 172.21.15.114:0/1230214234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 0x7fdd6c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd6aa00640 1 -- 172.21.15.114:0/1230214234 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116054448 0 0) 0x7fdd6c156270 con 0x7fdd6c0c25a0 2024-02-17T12:18:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd6aa00640 1 -- 172.21.15.114:0/1230214234 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd50003530 con 0x7fdd6c0c25a0 2024-02-17T12:18:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd6aa00640 1 -- 172.21.15.114:0/1230214234 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206554935 0 0) 0x7fdd6c156550 con 0x7fdd6c150490 2024-02-17T12:18:43.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd6aa00640 1 -- 172.21.15.114:0/1230214234 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd6c156270 con 0x7fdd6c150490 2024-02-17T12:18:43.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd6b400640 1 -- 172.21.15.114:0/1230214234 >> v1:172.21.15.116:6789/0 conn(0x7fdd6c150490 legacy=0x7fdd6c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd6b400640 1 -- 172.21.15.114:0/1230214234 >> v1:172.21.15.114:6789/0 conn(0x7fdd6c0c25a0 legacy=0x7fdd6c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.560+0000 7fdd6b400640 1 -- 172.21.15.114:0/1230214234 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c156830 con 0x7fdd6c06db50 2024-02-17T12:18:43.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd6b400640 1 --2- 172.21.15.114:0/1230214234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 0x7fdd6c14ff50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd580097f0 tx=0x7fdd5801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b653368749015ee server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:43.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd6aa00640 1 -- 172.21.15.114:0/1230214234 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd580ab600 con 0x7fdd6c06db50 2024-02-17T12:18:43.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd6aa00640 1 -- 172.21.15.114:0/1230214234 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd580a7050 con 0x7fdd6c06db50 2024-02-17T12:18:43.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd6aa00640 1 -- 172.21.15.114:0/1230214234 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd580ab980 con 0x7fdd6c06db50 2024-02-17T12:18:43.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd73000640 1 -- 172.21.15.114:0/1230214234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 msgr2=0x7fdd6c14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd73000640 1 --2- 172.21.15.114:0/1230214234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 0x7fdd6c14ff50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd580097f0 tx=0x7fdd5801c3c0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd73000640 1 -- 172.21.15.114:0/1230214234 shutdown_connections 2024-02-17T12:18:43.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd73000640 1 --2- 172.21.15.114:0/1230214234 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 0x7fdd6c14ff50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd73000640 1 -- 172.21.15.114:0/1230214234 >> 172.21.15.114:0/1230214234 conn(0x7fdd6c0a8490 msgr2=0x7fdd6c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:43.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd73000640 1 -- 172.21.15.114:0/1230214234 shutdown_connections 2024-02-17T12:18:43.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.564+0000 7fdd73000640 1 -- 172.21.15.114:0/1230214234 wait complete. 2024-02-17T12:18:43.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 Processor -- start 2024-02-17T12:18:43.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 -- start start 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 0x7fdd6c1ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd6c0c25a0 0x7fdd6c14d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6c150490 0x7fdd6c138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c1eb8f0 con 0x7fdd6c150490 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0c5950 con 0x7fdd6c0c25a0 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c145940 con 0x7fdd6c06db50 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd71000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6c150490 0x7fdd6c138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd71000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6c150490 0x7fdd6c138680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56432/0 (socket says 172.21.15.114:56432) 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd71000640 1 -- 172.21.15.114:0/2350276500 learned_addr learned my addr 172.21.15.114:0/2350276500 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd6b400640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd6c0c25a0 0x7fdd6c14d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd6be00640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 0x7fdd6c1ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd71000640 1 -- 172.21.15.114:0/2350276500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 msgr2=0x7fdd6c1ebd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd71000640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 0x7fdd6c1ebd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd71000640 1 -- 172.21.15.114:0/2350276500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd6c0c25a0 msgr2=0x7fdd6c14d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd71000640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd6c0c25a0 0x7fdd6c14d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd71000640 1 -- 172.21.15.114:0/2350276500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58009420 con 0x7fdd6c150490 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd6b400640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd6c0c25a0 0x7fdd6c14d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd71000640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6c150490 0x7fdd6c138680 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400c730 tx=0x7fdd6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd63e00640 1 -- 172.21.15.114:0/2350276500 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd64003b80 con 0x7fdd6c150490 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd63e00640 1 -- 172.21.15.114:0/2350276500 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd64003ce0 con 0x7fdd6c150490 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd63e00640 1 -- 172.21.15.114:0/2350276500 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6400aa90 con 0x7fdd6c150490 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 -- 172.21.15.114:0/2350276500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6c1eb250 con 0x7fdd6c150490 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 -- 172.21.15.114:0/2350276500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c141710 con 0x7fdd6c150490 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.568+0000 7fdd73000640 1 -- 172.21.15.114:0/2350276500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6c1eba30 con 0x7fdd6c150490 2024-02-17T12:18:43.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.572+0000 7fdd63e00640 1 -- 172.21.15.114:0/2350276500 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fdd6400abf0 con 0x7fdd6c150490 2024-02-17T12:18:43.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.572+0000 7fdd63e00640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdd4c066e40 0x7fdd4c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.572+0000 7fdd63e00640 1 -- 172.21.15.114:0/2350276500 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdd64084bf0 con 0x7fdd6c150490 2024-02-17T12:18:43.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.572+0000 7fdd6be00640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdd4c066e40 0x7fdd4c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.572+0000 7fdd6be00640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdd4c066e40 0x7fdd4c069300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0011f0 tx=0x7fdd5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:43.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.576+0000 7fdd63e00640 1 -- 172.21.15.114:0/2350276500 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd6c1eba30 con 0x7fdd6c150490 2024-02-17T12:18:43.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.732+0000 7fdd73000640 1 -- 172.21.15.114:0/2350276500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd6c1eba30 con 0x7fdd6c150490 2024-02-17T12:18:43.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.732+0000 7fdd63e00640 1 -- 172.21.15.114:0/2350276500 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20458 (secure 0 0 0) 0x7fdd6c1eba30 con 0x7fdd6c150490 2024-02-17T12:18:43.738 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:43.738 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:21.358057+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 -- 172.21.15.114:0/2350276500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdd4c066e40 msgr2=0x7fdd4c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdd4c066e40 0x7fdd4c069300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0011f0 tx=0x7fdd5c009040 comp rx=0 tx=0).stop 2024-02-17T12:18:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 -- 172.21.15.114:0/2350276500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6c150490 msgr2=0x7fdd6c138680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6c150490 0x7fdd6c138680 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400c730 tx=0x7fdd6400cbf0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 -- 172.21.15.114:0/2350276500 shutdown_connections 2024-02-17T12:18:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdd4c066e40 0x7fdd4c069300 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6c150490 0x7fdd6c138680 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd6c0c25a0 0x7fdd6c14d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 --2- 172.21.15.114:0/2350276500 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdd6c06db50 0x7fdd6c1ebd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 -- 172.21.15.114:0/2350276500 >> 172.21.15.114:0/2350276500 conn(0x7fdd6c0a8490 msgr2=0x7fdd6c0c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:43.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 -- 172.21.15.114:0/2350276500 shutdown_connections 2024-02-17T12:18:43.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.736+0000 7fdd73000640 1 -- 172.21.15.114:0/2350276500 wait complete. 2024-02-17T12:18:43.759 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-17T12:18:43.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad1e200640 1 Processor -- start 2024-02-17T12:18:43.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad1e200640 1 -- start start 2024-02-17T12:18:43.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad1e200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad1806fdc0 0x7fad18152d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad1e200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fad180c2620 0x7fad181532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad1e200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad18070c60 con 0x7fad18150190 2024-02-17T12:18:43.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad1e200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad18070370 con 0x7fad1806fdc0 2024-02-17T12:18:43.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad1e200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad18070610 con 0x7fad180c2620 2024-02-17T12:18:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad17e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad1806fdc0 0x7fad18152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad17e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad1806fdc0 0x7fad18152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56436/0 (socket says 172.21.15.114:56436) 2024-02-17T12:18:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad17e00640 1 -- 172.21.15.114:0/1680514768 learned_addr learned my addr 172.21.15.114:0/1680514768 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad1d800640 1 --2- 172.21.15.114:0/1680514768 >> v2:172.21.15.116:3300/0 conn(0x7fad180c2620 0x7fad181532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad17e00640 1 -- 172.21.15.114:0/1680514768 >> v2:172.21.15.116:3300/0 conn(0x7fad180c2620 msgr2=0x7fad181532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad17e00640 1 --2- 172.21.15.114:0/1680514768 >> v2:172.21.15.116:3300/0 conn(0x7fad180c2620 0x7fad181532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad17e00640 1 -- 172.21.15.114:0/1680514768 >> v1:172.21.15.116:6789/0 conn(0x7fad18150190 legacy=0x7fad180aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.892+0000 7fad17e00640 1 -- 172.21.15.114:0/1680514768 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad180708f0 con 0x7fad1806fdc0 2024-02-17T12:18:43.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad17e00640 1 --2- 172.21.15.114:0/1680514768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad1806fdc0 0x7fad18152d80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fad180a7f00 tx=0x7fad0401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd3dcd17f4161e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:43.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad17400640 1 -- 172.21.15.114:0/1680514768 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040ab600 con 0x7fad1806fdc0 2024-02-17T12:18:43.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad17400640 1 -- 172.21.15.114:0/1680514768 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad040a7050 con 0x7fad1806fdc0 2024-02-17T12:18:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad17400640 1 -- 172.21.15.114:0/1680514768 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040ab980 con 0x7fad1806fdc0 2024-02-17T12:18:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad1e200640 1 -- 172.21.15.114:0/1680514768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad1806fdc0 msgr2=0x7fad18152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad1e200640 1 --2- 172.21.15.114:0/1680514768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad1806fdc0 0x7fad18152d80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fad180a7f00 tx=0x7fad0401c490 comp rx=0 tx=0).stop 2024-02-17T12:18:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad1e200640 1 -- 172.21.15.114:0/1680514768 shutdown_connections 2024-02-17T12:18:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad1e200640 1 --2- 172.21.15.114:0/1680514768 >> v2:172.21.15.116:3300/0 conn(0x7fad180c2620 0x7fad181532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad1e200640 1 --2- 172.21.15.114:0/1680514768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad1806fdc0 0x7fad18152d80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad1e200640 1 -- 172.21.15.114:0/1680514768 >> 172.21.15.114:0/1680514768 conn(0x7fad1806ed70 msgr2=0x7fad1806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad1e200640 1 -- 172.21.15.114:0/1680514768 shutdown_connections 2024-02-17T12:18:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad1e200640 1 -- 172.21.15.114:0/1680514768 wait complete. 2024-02-17T12:18:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad1e200640 1 Processor -- start 2024-02-17T12:18:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.896+0000 7fad1e200640 1 -- start start 2024-02-17T12:18:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1e200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad1806fdc0 0x7fad18149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad180c2620 0x7fad180a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1e200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18150190 0x7fad180a8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad180a9140 con 0x7fad180c2620 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1e200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad181520e0 con 0x7fad18150190 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1e200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad181ee010 con 0x7fad1806fdc0 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad180c2620 0x7fad180a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad180c2620 0x7fad180a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56440/0 (socket says 172.21.15.114:56440) 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad17e00640 1 -- 172.21.15.114:0/2993746150 learned_addr learned my addr 172.21.15.114:0/2993746150 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1d800640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18150190 0x7fad180a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1ce00640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad1806fdc0 0x7fad18149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad17e00640 1 -- 172.21.15.114:0/2993746150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad1806fdc0 msgr2=0x7fad18149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad17e00640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad1806fdc0 0x7fad18149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad17e00640 1 -- 172.21.15.114:0/2993746150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18150190 msgr2=0x7fad180a8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad17e00640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18150190 0x7fad180a8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad17e00640 1 -- 172.21.15.114:0/2993746150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040094d0 con 0x7fad180c2620 2024-02-17T12:18:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad17e00640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad180c2620 0x7fad180a7fc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fad040190a0 tx=0x7fad04019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad14c00640 1 -- 172.21.15.114:0/2993746150 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040b37d0 con 0x7fad180c2620 2024-02-17T12:18:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad14c00640 1 -- 172.21.15.114:0/2993746150 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad040b3930 con 0x7fad180c2620 2024-02-17T12:18:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad14c00640 1 -- 172.21.15.114:0/2993746150 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad040b3ca0 con 0x7fad180c2620 2024-02-17T12:18:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1e200640 1 -- 172.21.15.114:0/2993746150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1814a100 con 0x7fad180c2620 2024-02-17T12:18:43.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1e200640 1 -- 172.21.15.114:0/2993746150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad181522f0 con 0x7fad180c2620 2024-02-17T12:18:43.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad1e200640 1 -- 172.21.15.114:0/2993746150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad18068180 con 0x7fad180c2620 2024-02-17T12:18:43.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.900+0000 7fad14c00640 1 -- 172.21.15.114:0/2993746150 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fad040b2070 con 0x7fad180c2620 2024-02-17T12:18:43.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.904+0000 7fad14c00640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf8066e70 0x7facf8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:43.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.904+0000 7fad14c00640 1 -- 172.21.15.114:0/2993746150 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fad0411ef20 con 0x7fad180c2620 2024-02-17T12:18:43.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.904+0000 7fad1ce00640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf8066e70 0x7facf8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:43.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.904+0000 7fad1ce00640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf8066e70 0x7facf8069330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fad0c007fd0 tx=0x7fad0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:43.908+0000 7fad14c00640 1 -- 172.21.15.114:0/2993746150 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fad040eba50 con 0x7fad180c2620 2024-02-17T12:18:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.092+0000 7fad1e200640 1 -- 172.21.15.114:0/2993746150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad181524e0 con 0x7fad180c2620 2024-02-17T12:18:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.092+0000 7fad14c00640 1 -- 172.21.15.114:0/2993746150 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6188 (secure 0 0 0) 0x7fad181524e0 con 0x7fad180c2620 2024-02-17T12:18:44.098 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:44.098 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:02.157066+0000","modified":"2024-02-17T12:18:05.178755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/105000653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":105000653},{"type":"v1","addr":"172.21.15.114:6837","nonce":105000653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:19.704588+0000","modified":"2024-02-17T12:18:22.751088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1690237872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1690237872},{"type":"v1","addr":"172.21.15.114:6836","nonce":1690237872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-02-17T12:18:44.098 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 38 2024-02-17T12:18:44.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 -- 172.21.15.114:0/2993746150 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf8066e70 msgr2=0x7facf8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf8066e70 0x7facf8069330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fad0c007fd0 tx=0x7fad0c009040 comp rx=0 tx=0).stop 2024-02-17T12:18:44.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 -- 172.21.15.114:0/2993746150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad180c2620 msgr2=0x7fad180a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad180c2620 0x7fad180a7fc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fad040190a0 tx=0x7fad04019230 comp rx=0 tx=0).stop 2024-02-17T12:18:44.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 -- 172.21.15.114:0/2993746150 shutdown_connections 2024-02-17T12:18:44.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad18150190 0x7fad180a8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7facf8066e70 0x7facf8069330 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad180c2620 0x7fad180a7fc0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 --2- 172.21.15.114:0/2993746150 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad1806fdc0 0x7fad18149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 -- 172.21.15.114:0/2993746150 >> 172.21.15.114:0/2993746150 conn(0x7fad1806ed70 msgr2=0x7fad1814b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:44.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 -- 172.21.15.114:0/2993746150 shutdown_connections 2024-02-17T12:18:44.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.096+0000 7fad1e200640 1 -- 172.21.15.114:0/2993746150 wait complete. 2024-02-17T12:18:44.118 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:44.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb2f000640 1 Processor -- start 2024-02-17T12:18:44.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb2f000640 1 -- start start 2024-02-17T12:18:44.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb2f000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb2814f110 0x7fcb280c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb2f000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcb280c1eb0 0x7fcb2815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb2f000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280a9420 con 0x7fcb280c2580 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb2f000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2814f4f0 con 0x7fcb2814f110 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb2f000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb280aae80 con 0x7fcb280c1eb0 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb27e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb2814f110 0x7fcb280c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb27e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb2814f110 0x7fcb280c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56446/0 (socket says 172.21.15.114:56446) 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb27400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcb280c2580 0x7fcb280aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53534/0 (socket says 172.21.15.114:53534) 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.248+0000 7fcb27e00640 1 -- 172.21.15.114:0/1269006519 learned_addr learned my addr 172.21.15.114:0/1269006519 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb2d000640 1 --2- 172.21.15.114:0/1269006519 >> v2:172.21.15.116:3300/0 conn(0x7fcb280c1eb0 0x7fcb2815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb27e00640 1 -- 172.21.15.114:0/1269006519 >> v2:172.21.15.116:3300/0 conn(0x7fcb280c1eb0 msgr2=0x7fcb2815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb27e00640 1 --2- 172.21.15.114:0/1269006519 >> v2:172.21.15.116:3300/0 conn(0x7fcb280c1eb0 0x7fcb2815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb27e00640 1 -- 172.21.15.114:0/1269006519 >> v1:172.21.15.114:6789/0 conn(0x7fcb280c2580 legacy=0x7fcb280aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb27e00640 1 -- 172.21.15.114:0/1269006519 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28152850 con 0x7fcb2814f110 2024-02-17T12:18:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb26a00640 1 -- 172.21.15.114:0/1269006519 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129492790 0 0) 0x7fcb280a9420 con 0x7fcb280c2580 2024-02-17T12:18:44.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb2d000640 1 --2- 172.21.15.114:0/1269006519 >> v2:172.21.15.116:3300/0 conn(0x7fcb280c1eb0 0x7fcb2815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:44.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb27e00640 1 --2- 172.21.15.114:0/1269006519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb2814f110 0x7fcb280c65a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcb2806ceb0 tx=0x7fcb1801eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129cd703235d049c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb26a00640 1 -- 172.21.15.114:0/1269006519 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180a7b00 con 0x7fcb2814f110 2024-02-17T12:18:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb26a00640 1 -- 172.21.15.114:0/1269006519 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb180a7c60 con 0x7fcb2814f110 2024-02-17T12:18:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb26a00640 1 -- 172.21.15.114:0/1269006519 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180af440 con 0x7fcb2814f110 2024-02-17T12:18:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb2f000640 1 -- 172.21.15.114:0/1269006519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb2814f110 msgr2=0x7fcb280c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.252+0000 7fcb2f000640 1 --2- 172.21.15.114:0/1269006519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb2814f110 0x7fcb280c65a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcb2806ceb0 tx=0x7fcb1801eb30 comp rx=0 tx=0).stop 2024-02-17T12:18:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 -- 172.21.15.114:0/1269006519 shutdown_connections 2024-02-17T12:18:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 --2- 172.21.15.114:0/1269006519 >> v2:172.21.15.116:3300/0 conn(0x7fcb280c1eb0 0x7fcb2815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 --2- 172.21.15.114:0/1269006519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb2814f110 0x7fcb280c65a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 -- 172.21.15.114:0/1269006519 >> 172.21.15.114:0/1269006519 conn(0x7fcb280a8490 msgr2=0x7fcb280a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 -- 172.21.15.114:0/1269006519 shutdown_connections 2024-02-17T12:18:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 -- 172.21.15.114:0/1269006519 wait complete. 2024-02-17T12:18:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 Processor -- start 2024-02-17T12:18:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 -- start start 2024-02-17T12:18:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb280c1eb0 0x7fcb281f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb280c2580 0x7fcb281542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcb2814f110 0x7fcb28154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28153bd0 con 0x7fcb280c1eb0 2024-02-17T12:18:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28149a70 con 0x7fcb280c2580 2024-02-17T12:18:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28149460 con 0x7fcb2814f110 2024-02-17T12:18:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb27e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb280c1eb0 0x7fcb281f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb27e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb280c1eb0 0x7fcb281f0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56462/0 (socket says 172.21.15.114:56462) 2024-02-17T12:18:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb27e00640 1 -- 172.21.15.114:0/2459688925 learned_addr learned my addr 172.21.15.114:0/2459688925 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb27e00640 1 -- 172.21.15.114:0/2459688925 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcb2814f110 msgr2=0x7fcb28154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb27e00640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcb2814f110 0x7fcb28154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb27e00640 1 -- 172.21.15.114:0/2459688925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb280c2580 msgr2=0x7fcb281542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb27e00640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb280c2580 0x7fcb281542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb27e00640 1 -- 172.21.15.114:0/2459688925 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1800b770 con 0x7fcb280c1eb0 2024-02-17T12:18:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb27e00640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb280c1eb0 0x7fcb281f0db0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800b2c0 tx=0x7fcb1801b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb1fe00640 1 -- 172.21.15.114:0/2459688925 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180a7b00 con 0x7fcb280c1eb0 2024-02-17T12:18:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb1fe00640 1 -- 172.21.15.114:0/2459688925 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb180ba440 con 0x7fcb280c1eb0 2024-02-17T12:18:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 -- 172.21.15.114:0/2459688925 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb281f16e0 con 0x7fcb280c1eb0 2024-02-17T12:18:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb1fe00640 1 -- 172.21.15.114:0/2459688925 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180ba7d0 con 0x7fcb280c1eb0 2024-02-17T12:18:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.256+0000 7fcb2f000640 1 -- 172.21.15.114:0/2459688925 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb281f19c0 con 0x7fcb280c1eb0 2024-02-17T12:18:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.260+0000 7fcb2f000640 1 -- 172.21.15.114:0/2459688925 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb28074840 con 0x7fcb280c1eb0 2024-02-17T12:18:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.260+0000 7fcb1fe00640 1 -- 172.21.15.114:0/2459688925 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fcb180b93e0 con 0x7fcb280c1eb0 2024-02-17T12:18:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.260+0000 7fcb1fe00640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb08066e40 0x7fcb08069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.260+0000 7fcb1fe00640 1 -- 172.21.15.114:0/2459688925 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcb1811f8b0 con 0x7fcb280c1eb0 2024-02-17T12:18:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.260+0000 7fcb27400640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb08066e40 0x7fcb08069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.260+0000 7fcb27400640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb08066e40 0x7fcb08069300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcb140011f0 tx=0x7fcb14007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:44.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.264+0000 7fcb1fe00640 1 -- 172.21.15.114:0/2459688925 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcb180ec3d0 con 0x7fcb280c1eb0 2024-02-17T12:18:44.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 -- 172.21.15.114:0/2459688925 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb280c1380 con 0x7fcb280c1eb0 2024-02-17T12:18:44.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb1fe00640 1 -- 172.21.15.114:0/2459688925 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6188 (secure 0 0 0) 0x7fcb180b4090 con 0x7fcb280c1eb0 2024-02-17T12:18:44.460 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:44.461 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:02.157066+0000","modified":"2024-02-17T12:18:05.178755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/105000653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":105000653},{"type":"v1","addr":"172.21.15.114:6837","nonce":105000653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:19.704588+0000","modified":"2024-02-17T12:18:22.751088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1690237872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1690237872},{"type":"v1","addr":"172.21.15.114:6836","nonce":1690237872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 38 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 -- 172.21.15.114:0/2459688925 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb08066e40 msgr2=0x7fcb08069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb08066e40 0x7fcb08069300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcb140011f0 tx=0x7fcb14007930 comp rx=0 tx=0).stop 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 -- 172.21.15.114:0/2459688925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb280c1eb0 msgr2=0x7fcb281f0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb280c1eb0 0x7fcb281f0db0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800b2c0 tx=0x7fcb1801b8d0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 -- 172.21.15.114:0/2459688925 shutdown_connections 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcb2814f110 0x7fcb28154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcb280c2580 0x7fcb281542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcb08066e40 0x7fcb08069300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 --2- 172.21.15.114:0/2459688925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb280c1eb0 0x7fcb281f0db0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 -- 172.21.15.114:0/2459688925 >> 172.21.15.114:0/2459688925 conn(0x7fcb280a8490 msgr2=0x7fcb280bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 -- 172.21.15.114:0/2459688925 shutdown_connections 2024-02-17T12:18:44.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.456+0000 7fcb2f000640 1 -- 172.21.15.114:0/2459688925 wait complete. 2024-02-17T12:18:44.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:44.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7ba400640 1 Processor -- start 2024-02-17T12:18:44.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7ba400640 1 -- start start 2024-02-17T12:18:44.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7ba400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe7b40c25a0 0x7fe7b406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7ba400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe7b406db50 0x7fe7b414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7ba400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b4156270 con 0x7fe7b4150490 2024-02-17T12:18:44.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7ba400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b4071630 con 0x7fe7b406db50 2024-02-17T12:18:44.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7ba400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b4156550 con 0x7fe7b40c25a0 2024-02-17T12:18:44.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7b2a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe7b406db50 0x7fe7b414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7b2a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe7b406db50 0x7fe7b414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56466/0 (socket says 172.21.15.114:56466) 2024-02-17T12:18:44.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7b2a00640 1 -- 172.21.15.114:0/1793042723 learned_addr learned my addr 172.21.15.114:0/1793042723 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:44.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7b3400640 1 --2- 172.21.15.114:0/1793042723 >> v2:172.21.15.116:3300/0 conn(0x7fe7b40c25a0 0x7fe7b406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7b2a00640 1 -- 172.21.15.114:0/1793042723 >> v2:172.21.15.116:3300/0 conn(0x7fe7b40c25a0 msgr2=0x7fe7b406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:44.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7b2a00640 1 --2- 172.21.15.114:0/1793042723 >> v2:172.21.15.116:3300/0 conn(0x7fe7b40c25a0 0x7fe7b406e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7b2a00640 1 -- 172.21.15.114:0/1793042723 >> v1:172.21.15.116:6789/0 conn(0x7fe7b4150490 legacy=0x7fe7b4152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.612+0000 7fe7b2a00640 1 -- 172.21.15.114:0/1793042723 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b4156830 con 0x7fe7b406db50 2024-02-17T12:18:44.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7b2a00640 1 --2- 172.21.15.114:0/1793042723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b406db50 0x7fe7b414ff50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ab930 tx=0x7fe7a401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f94031afe88adc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:44.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7b2000640 1 -- 172.21.15.114:0/1793042723 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40a4ea0 con 0x7fe7b406db50 2024-02-17T12:18:44.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7b2000640 1 -- 172.21.15.114:0/1793042723 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a40a7050 con 0x7fe7b406db50 2024-02-17T12:18:44.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7b2000640 1 -- 172.21.15.114:0/1793042723 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40ab820 con 0x7fe7b406db50 2024-02-17T12:18:44.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7ba400640 1 -- 172.21.15.114:0/1793042723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b406db50 msgr2=0x7fe7b414ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7ba400640 1 --2- 172.21.15.114:0/1793042723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b406db50 0x7fe7b414ff50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ab930 tx=0x7fe7a401c400 comp rx=0 tx=0).stop 2024-02-17T12:18:44.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7ba400640 1 -- 172.21.15.114:0/1793042723 shutdown_connections 2024-02-17T12:18:44.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7ba400640 1 --2- 172.21.15.114:0/1793042723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b406db50 0x7fe7b414ff50 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7ba400640 1 --2- 172.21.15.114:0/1793042723 >> v2:172.21.15.116:3300/0 conn(0x7fe7b40c25a0 0x7fe7b406e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7ba400640 1 -- 172.21.15.114:0/1793042723 >> 172.21.15.114:0/1793042723 conn(0x7fe7b40a8490 msgr2=0x7fe7b40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:44.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7ba400640 1 -- 172.21.15.114:0/1793042723 shutdown_connections 2024-02-17T12:18:44.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.616+0000 7fe7ba400640 1 -- 172.21.15.114:0/1793042723 wait complete. 2024-02-17T12:18:44.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 Processor -- start 2024-02-17T12:18:44.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 -- start start 2024-02-17T12:18:44.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b406db50 0x7fe7b413c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b40c25a0 0x7fe7b4141720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b4150490 0x7fe7b413afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b4144ec0 con 0x7fe7b40c25a0 2024-02-17T12:18:44.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b413e360 con 0x7fe7b406db50 2024-02-17T12:18:44.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b413e900 con 0x7fe7b4150490 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b40c25a0 0x7fe7b4141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b40c25a0 0x7fe7b4141720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56470/0 (socket says 172.21.15.114:56470) 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b2a00640 1 -- 172.21.15.114:0/2384171086 learned_addr learned my addr 172.21.15.114:0/2384171086 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b3400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b406db50 0x7fe7b413c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b3e00640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b4150490 0x7fe7b413afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b2a00640 1 -- 172.21.15.114:0/2384171086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b4150490 msgr2=0x7fe7b413afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b2a00640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b4150490 0x7fe7b413afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b2a00640 1 -- 172.21.15.114:0/2384171086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b406db50 msgr2=0x7fe7b413c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b2a00640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b406db50 0x7fe7b413c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b2a00640 1 -- 172.21.15.114:0/2384171086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a40094d0 con 0x7fe7b40c25a0 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b3400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b406db50 0x7fe7b413c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b3e00640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b4150490 0x7fe7b413afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:44.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7b2a00640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b40c25a0 0x7fe7b4141720 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4019010 tx=0x7fe7a40191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:44.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ab400640 1 -- 172.21.15.114:0/2384171086 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40a4ea0 con 0x7fe7b40c25a0 2024-02-17T12:18:44.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ab400640 1 -- 172.21.15.114:0/2384171086 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a40b4440 con 0x7fe7b40c25a0 2024-02-17T12:18:44.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 -- 172.21.15.114:0/2384171086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b4144be0 con 0x7fe7b40c25a0 2024-02-17T12:18:44.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ab400640 1 -- 172.21.15.114:0/2384171086 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40b47d0 con 0x7fe7b40c25a0 2024-02-17T12:18:44.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 -- 172.21.15.114:0/2384171086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b4141c60 con 0x7fe7b40c25a0 2024-02-17T12:18:44.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.620+0000 7fe7ba400640 1 -- 172.21.15.114:0/2384171086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b41eda90 con 0x7fe7b40c25a0 2024-02-17T12:18:44.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.624+0000 7fe7ab400640 1 -- 172.21.15.114:0/2384171086 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe7a40b2070 con 0x7fe7b40c25a0 2024-02-17T12:18:44.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.624+0000 7fe7ab400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe790066e40 0x7fe790069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.624+0000 7fe7ab400640 1 -- 172.21.15.114:0/2384171086 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe7a411eca0 con 0x7fe7b40c25a0 2024-02-17T12:18:44.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.624+0000 7fe7b3400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe790066e40 0x7fe790069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.624+0000 7fe7b3400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe790066e40 0x7fe790069300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe79c007a70 tx=0x7fe79c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:44.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.628+0000 7fe7ab400640 1 -- 172.21.15.114:0/2384171086 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe7a40eb690 con 0x7fe7b40c25a0 2024-02-17T12:18:44.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.784+0000 7fe7ba400640 1 -- 172.21.15.114:0/2384171086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7b413ea40 con 0x7fe7b40c25a0 2024-02-17T12:18:44.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ab400640 1 -- 172.21.15.114:0/2384171086 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20458 (secure 0 0 0) 0x7fe7a40b0090 con 0x7fe7b40c25a0 2024-02-17T12:18:44.792 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:44.792 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":54,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:21.358057+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:17:59.900395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-02-17T12:18:01.152214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 -- 172.21.15.114:0/2384171086 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe790066e40 msgr2=0x7fe790069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe790066e40 0x7fe790069300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe79c007a70 tx=0x7fe79c008040 comp rx=0 tx=0).stop 2024-02-17T12:18:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 -- 172.21.15.114:0/2384171086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b40c25a0 msgr2=0x7fe7b4141720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b40c25a0 0x7fe7b4141720 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4019010 tx=0x7fe7a40191a0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 -- 172.21.15.114:0/2384171086 shutdown_connections 2024-02-17T12:18:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b4150490 0x7fe7b413afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe790066e40 0x7fe790069300 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7b40c25a0 0x7fe7b4141720 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 --2- 172.21.15.114:0/2384171086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b406db50 0x7fe7b413c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 -- 172.21.15.114:0/2384171086 >> 172.21.15.114:0/2384171086 conn(0x7fe7b40a8490 msgr2=0x7fe7b4142550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:44.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 -- 172.21.15.114:0/2384171086 shutdown_connections 2024-02-17T12:18:44.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.788+0000 7fe7ba400640 1 -- 172.21.15.114:0/2384171086 wait complete. 2024-02-17T12:18:44.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-17T12:18:44.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd247200640 1 Processor -- start 2024-02-17T12:18:44.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd247200640 1 -- start start 2024-02-17T12:18:44.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd247200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2480aa060 0x7fd2480aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd247200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd24806fdc0 0x7fd2481583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd247200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2480c5ee0 con 0x7fd248158900 2024-02-17T12:18:44.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd247200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2480c2390 con 0x7fd24806fdc0 2024-02-17T12:18:44.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd247200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2480706e0 con 0x7fd2480aa060 2024-02-17T12:18:44.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd246800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd248158900 0x7fd248154e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53542/0 (socket says 172.21.15.114:53542) 2024-02-17T12:18:44.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd246800640 1 -- 172.21.15.114:0/4199414865 learned_addr learned my addr 172.21.15.114:0/4199414865 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:44.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd245400640 1 --2- 172.21.15.114:0/4199414865 >> v2:172.21.15.116:3300/0 conn(0x7fd24806fdc0 0x7fd2481583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd245e00640 1 --2- 172.21.15.114:0/4199414865 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2480aa060 0x7fd2480aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd244a00640 1 -- 172.21.15.114:0/4199414865 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795309786 0 0) 0x7fd2480c5ee0 con 0x7fd248158900 2024-02-17T12:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd244a00640 1 -- 172.21.15.114:0/4199414865 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c003530 con 0x7fd248158900 2024-02-17T12:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd245400640 1 -- 172.21.15.114:0/4199414865 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2480aa060 msgr2=0x7fd2480aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd245400640 1 --2- 172.21.15.114:0/4199414865 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2480aa060 0x7fd2480aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd244a00640 1 -- 172.21.15.114:0/4199414865 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 662417503 0 0) 0x7fd22c003530 con 0x7fd248158900 2024-02-17T12:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd245400640 1 -- 172.21.15.114:0/4199414865 >> v1:172.21.15.114:6789/0 conn(0x7fd248158900 legacy=0x7fd248154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd245400640 1 -- 172.21.15.114:0/4199414865 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248158db0 con 0x7fd24806fdc0 2024-02-17T12:18:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.944+0000 7fd245e00640 1 --2- 172.21.15.114:0/4199414865 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2480aa060 0x7fd2480aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:44.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd245400640 1 --2- 172.21.15.114:0/4199414865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd24806fdc0 0x7fd2481583c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd2300097c0 tx=0x7fd23001c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cda325a5ed703768 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd244a00640 1 -- 172.21.15.114:0/4199414865 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248155d50 con 0x7fd24806fdc0 2024-02-17T12:18:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd244a00640 1 -- 172.21.15.114:0/4199414865 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2300a7050 con 0x7fd24806fdc0 2024-02-17T12:18:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd244a00640 1 -- 172.21.15.114:0/4199414865 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230004450 con 0x7fd24806fdc0 2024-02-17T12:18:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd247200640 1 -- 172.21.15.114:0/4199414865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd24806fdc0 msgr2=0x7fd2481583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd247200640 1 --2- 172.21.15.114:0/4199414865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd24806fdc0 0x7fd2481583c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd2300097c0 tx=0x7fd23001c350 comp rx=0 tx=0).stop 2024-02-17T12:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd247200640 1 -- 172.21.15.114:0/4199414865 shutdown_connections 2024-02-17T12:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd247200640 1 --2- 172.21.15.114:0/4199414865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd24806fdc0 0x7fd2481583c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd247200640 1 --2- 172.21.15.114:0/4199414865 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2480aa060 0x7fd2480aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd247200640 1 -- 172.21.15.114:0/4199414865 >> 172.21.15.114:0/4199414865 conn(0x7fd24806ed70 msgr2=0x7fd24806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd247200640 1 -- 172.21.15.114:0/4199414865 shutdown_connections 2024-02-17T12:18:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.948+0000 7fd247200640 1 -- 172.21.15.114:0/4199414865 wait complete. 2024-02-17T12:18:44.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd247200640 1 Processor -- start 2024-02-17T12:18:44.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd247200640 1 -- start start 2024-02-17T12:18:44.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd247200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd24806fdc0 0x7fd248153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd247200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2480aa060 0x7fd24815c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd247200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd248158900 0x7fd2480c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd247200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24815c9c0 con 0x7fd24806fdc0 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd247200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd248160530 con 0x7fd2480aa060 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd247200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd248160250 con 0x7fd248158900 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd24806fdc0 0x7fd248153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd24806fdc0 0x7fd248153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56478/0 (socket says 172.21.15.114:56478) 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245e00640 1 -- 172.21.15.114:0/2263650467 learned_addr learned my addr 172.21.15.114:0/2263650467 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245400640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2480aa060 0x7fd24815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd246800640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd248158900 0x7fd2480c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245e00640 1 -- 172.21.15.114:0/2263650467 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd248158900 msgr2=0x7fd2480c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245e00640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd248158900 0x7fd2480c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245e00640 1 -- 172.21.15.114:0/2263650467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2480aa060 msgr2=0x7fd24815c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:44.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245e00640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2480aa060 0x7fd24815c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:44.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245e00640 1 -- 172.21.15.114:0/2263650467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd238009a70 con 0x7fd24806fdc0 2024-02-17T12:18:44.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd246800640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd248158900 0x7fd2480c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:44.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245400640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2480aa060 0x7fd24815c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:44.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd245e00640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd24806fdc0 0x7fd248153820 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd23800efc0 tx=0x7fd23800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:44.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd23e000640 1 -- 172.21.15.114:0/2263650467 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238014680 con 0x7fd24806fdc0 2024-02-17T12:18:44.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd23e000640 1 -- 172.21.15.114:0/2263650467 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800f040 con 0x7fd24806fdc0 2024-02-17T12:18:44.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd23e000640 1 -- 172.21.15.114:0/2263650467 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238014a00 con 0x7fd24806fdc0 2024-02-17T12:18:44.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd247200640 1 -- 172.21.15.114:0/2263650467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd230009420 con 0x7fd24806fdc0 2024-02-17T12:18:44.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.952+0000 7fd247200640 1 -- 172.21.15.114:0/2263650467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd248153020 con 0x7fd24806fdc0 2024-02-17T12:18:44.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.956+0000 7fd247200640 1 -- 172.21.15.114:0/2263650467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd248068180 con 0x7fd24806fdc0 2024-02-17T12:18:44.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.956+0000 7fd23e000640 1 -- 172.21.15.114:0/2263650467 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd238014b60 con 0x7fd24806fdc0 2024-02-17T12:18:44.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.956+0000 7fd23e000640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd224066e70 0x7fd224069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:44.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.956+0000 7fd23e000640 1 -- 172.21.15.114:0/2263650467 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd238085d80 con 0x7fd24806fdc0 2024-02-17T12:18:44.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.956+0000 7fd245400640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd224066e70 0x7fd224069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:44.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.956+0000 7fd245400640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd224066e70 0x7fd224069330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd2300ad000 tx=0x7fd2300a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:44.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:44.960+0000 7fd23e000640 1 -- 172.21.15.114:0/2263650467 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd2380528a0 con 0x7fd24806fdc0 2024-02-17T12:18:45.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.148+0000 7fd247200640 1 -- 172.21.15.114:0/2263650467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd24804eef0 con 0x7fd24806fdc0 2024-02-17T12:18:45.151 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-02-17T12:18:45.148+0000 7f5091a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-17T12:18:45.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.148+0000 7fd23e000640 1 -- 172.21.15.114:0/2263650467 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd238055f60 con 0x7fd24806fdc0 2024-02-17T12:18:45.154 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-17T12:18:45.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 -- 172.21.15.114:0/2263650467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd224066e70 msgr2=0x7fd224069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:45.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd224066e70 0x7fd224069330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd2300ad000 tx=0x7fd2300a6000 comp rx=0 tx=0).stop 2024-02-17T12:18:45.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 -- 172.21.15.114:0/2263650467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd24806fdc0 msgr2=0x7fd248153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:45.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd24806fdc0 0x7fd248153820 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd23800efc0 tx=0x7fd23800c490 comp rx=0 tx=0).stop 2024-02-17T12:18:45.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 -- 172.21.15.114:0/2263650467 shutdown_connections 2024-02-17T12:18:45.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd248158900 0x7fd2480c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:45.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2480aa060 0x7fd24815c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:45.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd224066e70 0x7fd224069330 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:45.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 --2- 172.21.15.114:0/2263650467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd24806fdc0 0x7fd248153820 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:45.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 -- 172.21.15.114:0/2263650467 >> 172.21.15.114:0/2263650467 conn(0x7fd24806ed70 msgr2=0x7fd2480a9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:45.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 -- 172.21.15.114:0/2263650467 shutdown_connections 2024-02-17T12:18:45.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.152+0000 7fd247200640 1 -- 172.21.15.114:0/2263650467 wait complete. 2024-02-17T12:18:45.166 INFO:tasks.ceph.mds.a.smithi114.stderr: -3161> 2024-02-17T12:18:08.761+0000 7f1ca4a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:18:45.184 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-17T12:18:45.220 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-02-17T12:18:45.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0899800640 1 Processor -- start 2024-02-17T12:18:45.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0899800640 1 -- start start 2024-02-17T12:18:45.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0899800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0894150300 0x7f0894156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:45.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0899800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f08940714c0 0x7f08940aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:45.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0899800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0894157270 con 0x7f08940aa6a0 2024-02-17T12:18:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0899800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08940c6900 con 0x7f0894150300 2024-02-17T12:18:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0899800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08940c3580 con 0x7f08940714c0 2024-02-17T12:18:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0892a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0894150300 0x7f0894156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0893400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f08940aa6a0 0x7f0894152d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43142/0 (socket says 172.21.15.114:43142) 2024-02-17T12:18:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0893400640 1 -- 172.21.15.114:0/531610029 learned_addr learned my addr 172.21.15.114:0/531610029 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:45.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0892000640 1 --2- 172.21.15.114:0/531610029 >> v2:172.21.15.116:3300/0 conn(0x7f08940714c0 0x7f08940aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0891600640 1 -- 172.21.15.114:0/531610029 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395583875 0 0) 0x7f0894157270 con 0x7f08940aa6a0 2024-02-17T12:18:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0891600640 1 -- 172.21.15.114:0/531610029 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0878003530 con 0x7f08940aa6a0 2024-02-17T12:18:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0892a00640 1 -- 172.21.15.114:0/531610029 >> v2:172.21.15.116:3300/0 conn(0x7f08940714c0 msgr2=0x7f08940aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0892a00640 1 --2- 172.21.15.114:0/531610029 >> v2:172.21.15.116:3300/0 conn(0x7f08940714c0 0x7f08940aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0892a00640 1 -- 172.21.15.114:0/531610029 >> v1:172.21.15.114:6789/0 conn(0x7f08940aa6a0 legacy=0x7f0894152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:45.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.320+0000 7f0892a00640 1 -- 172.21.15.114:0/531610029 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940c2fc0 con 0x7f0894150300 2024-02-17T12:18:45.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0892a00640 1 --2- 172.21.15.114:0/531610029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 0x7f0894156d30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f089406dff0 tx=0x7f088401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a77508c94cdd72 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:45.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0891600640 1 -- 172.21.15.114:0/531610029 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08840a5850 con 0x7f0894150300 2024-02-17T12:18:45.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0891600640 1 -- 172.21.15.114:0/531610029 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08840a59b0 con 0x7f0894150300 2024-02-17T12:18:45.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0891600640 1 -- 172.21.15.114:0/531610029 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08840a5d40 con 0x7f0894150300 2024-02-17T12:18:45.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0899800640 1 -- 172.21.15.114:0/531610029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 msgr2=0x7f0894156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:45.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0899800640 1 --2- 172.21.15.114:0/531610029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 0x7f0894156d30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f089406dff0 tx=0x7f088401c8a0 comp rx=0 tx=0).stop 2024-02-17T12:18:45.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0899800640 1 -- 172.21.15.114:0/531610029 shutdown_connections 2024-02-17T12:18:45.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0899800640 1 --2- 172.21.15.114:0/531610029 >> v2:172.21.15.116:3300/0 conn(0x7f08940714c0 0x7f08940aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:45.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0899800640 1 --2- 172.21.15.114:0/531610029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 0x7f0894156d30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:45.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0899800640 1 -- 172.21.15.114:0/531610029 >> 172.21.15.114:0/531610029 conn(0x7f08940c4f20 msgr2=0x7f08940c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0899800640 1 -- 172.21.15.114:0/531610029 shutdown_connections 2024-02-17T12:18:45.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.324+0000 7f0899800640 1 -- 172.21.15.114:0/531610029 wait complete. 2024-02-17T12:18:45.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 Processor -- start 2024-02-17T12:18:45.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 -- start start 2024-02-17T12:18:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08940714c0 0x7f08941ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08940aa6a0 0x7f08940c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 0x7f08941f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0894155930 con 0x7f0894150300 2024-02-17T12:18:45.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0894155d60 con 0x7f08940aa6a0 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08941f08c0 con 0x7f08940714c0 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0893400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 0x7f08941f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0893400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 0x7f08941f0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48078/0 (socket says 172.21.15.114:48078) 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0893400640 1 -- 172.21.15.114:0/4247379040 learned_addr learned my addr 172.21.15.114:0/4247379040 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0892a00640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08940714c0 0x7f08941ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0892000640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08940aa6a0 0x7f08940c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0893400640 1 -- 172.21.15.114:0/4247379040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08940714c0 msgr2=0x7f08941ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0893400640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08940714c0 0x7f08941ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0893400640 1 -- 172.21.15.114:0/4247379040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08940aa6a0 msgr2=0x7f08940c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0893400640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08940aa6a0 0x7f08940c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0893400640 1 -- 172.21.15.114:0/4247379040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884009a70 con 0x7f0894150300 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0893400640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 0x7f08941f0d50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f088c00c450 tx=0x7f088c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f088aa00640 1 -- 172.21.15.114:0/4247379040 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c005cf0 con 0x7f0894150300 2024-02-17T12:18:45.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f088aa00640 1 -- 172.21.15.114:0/4247379040 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c005e50 con 0x7f0894150300 2024-02-17T12:18:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 -- 172.21.15.114:0/4247379040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0894155370 con 0x7f0894150300 2024-02-17T12:18:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f088aa00640 1 -- 172.21.15.114:0/4247379040 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c0072b0 con 0x7f0894150300 2024-02-17T12:18:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 -- 172.21.15.114:0/4247379040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08940c8510 con 0x7f0894150300 2024-02-17T12:18:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.328+0000 7f0899800640 1 -- 172.21.15.114:0/4247379040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08941f0690 con 0x7f0894150300 2024-02-17T12:18:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.332+0000 7f088aa00640 1 -- 172.21.15.114:0/4247379040 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f088c007410 con 0x7f0894150300 2024-02-17T12:18:45.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.332+0000 7f088aa00640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0870066e70 0x7f0870069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:45.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.332+0000 7f088aa00640 1 -- 172.21.15.114:0/4247379040 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f088c084240 con 0x7f0894150300 2024-02-17T12:18:45.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.332+0000 7f0892a00640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0870066e70 0x7f0870069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:45.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.332+0000 7f0892a00640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0870066e70 0x7f0870069330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f08840af000 tx=0x7f08840a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:45.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.336+0000 7f088aa00640 1 -- 172.21.15.114:0/4247379040 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f08941f0690 con 0x7f0894150300 2024-02-17T12:18:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:45.524+0000 7f0899800640 1 -- 172.21.15.114:0/4247379040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f08941f0a30 con 0x7f0894150300 2024-02-17T12:18:46.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f088aa00640 1 -- 172.21.15.114:0/4247379040 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7f088c0547a0 con 0x7f0894150300 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 -- 172.21.15.114:0/4247379040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0870066e70 msgr2=0x7f0870069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0870066e70 0x7f0870069330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f08840af000 tx=0x7f08840a7070 comp rx=0 tx=0).stop 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 -- 172.21.15.114:0/4247379040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 msgr2=0x7f08941f0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 0x7f08941f0d50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f088c00c450 tx=0x7f088c00c910 comp rx=0 tx=0).stop 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 -- 172.21.15.114:0/4247379040 shutdown_connections 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0870066e70 0x7f0870069330 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0894150300 0x7f08941f0d50 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f08940aa6a0 0x7f08940c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 --2- 172.21.15.114:0/4247379040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08940714c0 0x7f08941ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 -- 172.21.15.114:0/4247379040 >> 172.21.15.114:0/4247379040 conn(0x7f08940c4f20 msgr2=0x7f089406bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 -- 172.21.15.114:0/4247379040 shutdown_connections 2024-02-17T12:18:46.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.156+0000 7f0899800640 1 -- 172.21.15.114:0/4247379040 wait complete. 2024-02-17T12:18:46.181 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-17T12:18:46.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4018200640 1 Processor -- start 2024-02-17T12:18:46.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4018200640 1 -- start start 2024-02-17T12:18:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4018200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f401006e860 0x7f4010154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4018200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4010153640 con 0x7f40100c38e0 2024-02-17T12:18:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4018200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4010153b70 con 0x7f40100a6590 2024-02-17T12:18:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4018200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40100c3cc0 con 0x7f401006e860 2024-02-17T12:18:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4015800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f40100c38e0 0x7f40100a6ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43156/0 (socket says 172.21.15.114:43156) 2024-02-17T12:18:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4015800640 1 -- 172.21.15.114:0/4185949702 learned_addr learned my addr 172.21.15.114:0/4185949702 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4016200640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f401006e860 0x7f4010154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910351920 0 0) 0x7f4010153640 con 0x7f40100c38e0 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff8003530 con 0x7f40100c38e0 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2832101223 0 0) 0x7f3ff8003530 con 0x7f40100c38e0 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f401006e860 msgr2=0x7f4010154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f401006e860 0x7f4010154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 >> v1:172.21.15.116:6789/0 conn(0x7f40100a6590 legacy=0x7f40101543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40100a7590 con 0x7f40100c38e0 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f4004001680 con 0x7f40100c38e0 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 >> v1:172.21.15.114:6789/0 conn(0x7f40100c38e0 legacy=0x7f40100a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 0x7f3ff8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f401006e860 0x7f3ff80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ff8004d10 0x7f3ff8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff800bb20 con 0x7f3ff80039b0 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff800bc60 con 0x7f3ff8004d10 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff800bdf0 con 0x7f401006e860 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4015800640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 0x7f3ff8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4016200640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ff8004d10 0x7f3ff8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4014e00640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f401006e860 0x7f3ff80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4015800640 1 -- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f401006e860 msgr2=0x7f3ff80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4015800640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f401006e860 0x7f3ff80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4015800640 1 -- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ff8004d10 msgr2=0x7f3ff8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4015800640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3ff8004d10 0x7f3ff8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:46.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.356+0000 7f4015800640 1 -- 172.21.15.114:0/4185949702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8003530 con 0x7f3ff80039b0 2024-02-17T12:18:46.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f4015800640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 0x7f3ff8003d90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f400400c240 tx=0x7f400401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c7ec39e1adab84 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:46.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004005ae0 con 0x7f3ff80039b0 2024-02-17T12:18:46.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004005c60 con 0x7f3ff80039b0 2024-02-17T12:18:46.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f400fe00640 1 -- 172.21.15.114:0/4185949702 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004007070 con 0x7f3ff80039b0 2024-02-17T12:18:46.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f4018200640 1 -- 172.21.15.114:0/4185949702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 msgr2=0x7f3ff8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:46.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f4018200640 1 --2- 172.21.15.114:0/4185949702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 0x7f3ff8003d90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f400400c240 tx=0x7f400401cc60 comp rx=0 tx=0).stop 2024-02-17T12:18:46.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f4016200640 1 -- 172.21.15.114:0/4185949702 reap_dead start 2024-02-17T12:18:46.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f4018200640 1 -- 172.21.15.114:0/4185949702 shutdown_connections 2024-02-17T12:18:46.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f4018200640 1 -- 172.21.15.114:0/4185949702 >> 172.21.15.114:0/4185949702 conn(0x7f401006b210 msgr2=0x7f401006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:46.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f4018200640 1 -- 172.21.15.114:0/4185949702 shutdown_connections 2024-02-17T12:18:46.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.360+0000 7f4018200640 1 -- 172.21.15.114:0/4185949702 wait complete. 2024-02-17T12:18:46.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4018200640 1 Processor -- start 2024-02-17T12:18:46.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4018200640 1 -- start start 2024-02-17T12:18:46.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4018200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 0x7f40100c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4018200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40101ed100 0x7f40100c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4018200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40100abe30 0x7f401014b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4018200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40100aa9f0 con 0x7f3ff80039b0 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4018200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40100c6ce0 con 0x7f40101ed100 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4018200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40100c6fa0 con 0x7f40100abe30 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4015800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 0x7f40100c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4015800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 0x7f40100c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48088/0 (socket says 172.21.15.114:48088) 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4015800640 1 -- 172.21.15.114:0/2538815665 learned_addr learned my addr 172.21.15.114:0/2538815665 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4016200640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40100abe30 0x7f401014b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4014e00640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40101ed100 0x7f40100c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4015800640 1 -- 172.21.15.114:0/2538815665 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40100abe30 msgr2=0x7f401014b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4015800640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40100abe30 0x7f401014b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:46.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4015800640 1 -- 172.21.15.114:0/2538815665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40101ed100 msgr2=0x7f40100c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:46.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4015800640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40101ed100 0x7f40100c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:46.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4015800640 1 -- 172.21.15.114:0/2538815665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40100c7280 con 0x7f3ff80039b0 2024-02-17T12:18:46.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4015800640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 0x7f40100c6300 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4004001ec0 tx=0x7f3ff8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:46.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f400d600640 1 -- 172.21.15.114:0/2538815665 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040b4070 con 0x7f3ff80039b0 2024-02-17T12:18:46.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f400d600640 1 -- 172.21.15.114:0/2538815665 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004005dd0 con 0x7f3ff80039b0 2024-02-17T12:18:46.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f400d600640 1 -- 172.21.15.114:0/2538815665 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004001640 con 0x7f3ff80039b0 2024-02-17T12:18:46.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4018200640 1 -- 172.21.15.114:0/2538815665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40100aac90 con 0x7f3ff80039b0 2024-02-17T12:18:46.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.364+0000 7f4018200640 1 -- 172.21.15.114:0/2538815665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40100c6840 con 0x7f3ff80039b0 2024-02-17T12:18:46.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.368+0000 7f4018200640 1 -- 172.21.15.114:0/2538815665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4010074840 con 0x7f3ff80039b0 2024-02-17T12:18:46.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.368+0000 7f400d600640 1 -- 172.21.15.114:0/2538815665 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4004007090 con 0x7f3ff80039b0 2024-02-17T12:18:46.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.368+0000 7f400d600640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3ff0066e40 0x7f3ff0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:46.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.368+0000 7f400d600640 1 -- 172.21.15.114:0/2538815665 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f400411e670 con 0x7f3ff80039b0 2024-02-17T12:18:46.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.368+0000 7f4014e00640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3ff0066e40 0x7f3ff0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:46.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.368+0000 7f4014e00640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3ff0066e40 0x7f3ff0069300 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f40101ed4e0 tx=0x7f3ffc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:46.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.372+0000 7f400d600640 1 -- 172.21.15.114:0/2538815665 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f40040eb150 con 0x7f3ff80039b0 2024-02-17T12:18:46.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:46.528+0000 7f4018200640 1 -- 172.21.15.114:0/2538815665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f40100ab140 con 0x7f3ff80039b0 2024-02-17T12:18:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.156+0000 7f400d600640 1 -- 172.21.15.114:0/2538815665 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f40040ee810 con 0x7f3ff80039b0 2024-02-17T12:18:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-02-17T12:18:47.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 -- 172.21.15.114:0/2538815665 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3ff0066e40 msgr2=0x7f3ff0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:47.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3ff0066e40 0x7f3ff0069300 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f40101ed4e0 tx=0x7f3ffc009040 comp rx=0 tx=0).stop 2024-02-17T12:18:47.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 -- 172.21.15.114:0/2538815665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 msgr2=0x7f40100c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:47.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 0x7f40100c6300 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4004001ec0 tx=0x7f3ff8005800 comp rx=0 tx=0).stop 2024-02-17T12:18:47.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 -- 172.21.15.114:0/2538815665 shutdown_connections 2024-02-17T12:18:47.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f40100abe30 0x7f401014b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:47.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40101ed100 0x7f40100c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:47.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3ff0066e40 0x7f3ff0069300 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:47.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 --2- 172.21.15.114:0/2538815665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ff80039b0 0x7f40100c6300 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:47.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 -- 172.21.15.114:0/2538815665 >> 172.21.15.114:0/2538815665 conn(0x7f401006b210 msgr2=0x7f401014f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:47.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 -- 172.21.15.114:0/2538815665 shutdown_connections 2024-02-17T12:18:47.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.160+0000 7f4018200640 1 -- 172.21.15.114:0/2538815665 wait complete. 2024-02-17T12:18:47.187 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-17T12:18:47.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.328+0000 7f4bea400640 1 Processor -- start 2024-02-17T12:18:47.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.328+0000 7f4bea400640 1 -- start start 2024-02-17T12:18:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4bea400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4be4155b80 0x7f4be40c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4bea400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4be406c030 0x7f4be40c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4bea400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be40c6320 con 0x7f4be40c7d70 2024-02-17T12:18:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4bea400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be40c3c50 con 0x7f4be406c030 2024-02-17T12:18:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4bea400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be4158fb0 con 0x7f4be4155b80 2024-02-17T12:18:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4be3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4be406c030 0x7f4be40c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4be3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4be406c030 0x7f4be40c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48098/0 (socket says 172.21.15.114:48098) 2024-02-17T12:18:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4be3e00640 1 -- 172.21.15.114:0/1669934049 learned_addr learned my addr 172.21.15.114:0/1669934049 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4be9000640 1 --2- 172.21.15.114:0/1669934049 >> v2:172.21.15.116:3300/0 conn(0x7f4be4155b80 0x7f4be40c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4be3e00640 1 -- 172.21.15.114:0/1669934049 >> v2:172.21.15.116:3300/0 conn(0x7f4be4155b80 msgr2=0x7f4be40c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4be3e00640 1 --2- 172.21.15.114:0/1669934049 >> v2:172.21.15.116:3300/0 conn(0x7f4be4155b80 0x7f4be40c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4be3e00640 1 -- 172.21.15.114:0/1669934049 >> v1:172.21.15.116:6789/0 conn(0x7f4be40c7d70 legacy=0x7f4be40c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.332+0000 7f4be3e00640 1 -- 172.21.15.114:0/1669934049 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be40c65c0 con 0x7f4be406c030 2024-02-17T12:18:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4be3e00640 1 --2- 172.21.15.114:0/1669934049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be406c030 0x7f4be40c4ca0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4be40aa840 tx=0x7f4bcc01cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cc1af45cccac54 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4be3400640 1 -- 172.21.15.114:0/1669934049 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0aa670 con 0x7f4be406c030 2024-02-17T12:18:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4be3400640 1 -- 172.21.15.114:0/1669934049 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc0aa7d0 con 0x7f4be406c030 2024-02-17T12:18:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4be3400640 1 -- 172.21.15.114:0/1669934049 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0aab60 con 0x7f4be406c030 2024-02-17T12:18:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 -- 172.21.15.114:0/1669934049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be406c030 msgr2=0x7f4be40c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 --2- 172.21.15.114:0/1669934049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be406c030 0x7f4be40c4ca0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4be40aa840 tx=0x7f4bcc01cf50 comp rx=0 tx=0).stop 2024-02-17T12:18:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 -- 172.21.15.114:0/1669934049 shutdown_connections 2024-02-17T12:18:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 --2- 172.21.15.114:0/1669934049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be406c030 0x7f4be40c4ca0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 --2- 172.21.15.114:0/1669934049 >> v2:172.21.15.116:3300/0 conn(0x7f4be4155b80 0x7f4be40c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 -- 172.21.15.114:0/1669934049 >> 172.21.15.114:0/1669934049 conn(0x7f4be4067120 msgr2=0x7f4be40aa050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 -- 172.21.15.114:0/1669934049 shutdown_connections 2024-02-17T12:18:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 -- 172.21.15.114:0/1669934049 wait complete. 2024-02-17T12:18:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 Processor -- start 2024-02-17T12:18:47.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 -- start start 2024-02-17T12:18:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4be406c030 0x7f4be415b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be40c7d70 0x7f4be415ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be4155b80 0x7f4be41f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be415b5d0 con 0x7f4be40c7d70 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be415a2d0 con 0x7f4be406c030 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.336+0000 7f4bea400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be415a5b0 con 0x7f4be4155b80 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be40c7d70 0x7f4be415ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be40c7d70 0x7f4be415ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48102/0 (socket says 172.21.15.114:48102) 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be3e00640 1 -- 172.21.15.114:0/3447719439 learned_addr learned my addr 172.21.15.114:0/3447719439 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be9000640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4be406c030 0x7f4be415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be9a00640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be4155b80 0x7f4be41f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be3e00640 1 -- 172.21.15.114:0/3447719439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be4155b80 msgr2=0x7f4be41f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be3e00640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be4155b80 0x7f4be41f0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be3e00640 1 -- 172.21.15.114:0/3447719439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4be406c030 msgr2=0x7f4be415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:47.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be3e00640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4be406c030 0x7f4be415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:47.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be3e00640 1 -- 172.21.15.114:0/3447719439 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0094d0 con 0x7f4be40c7d70 2024-02-17T12:18:47.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be9000640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4be406c030 0x7f4be415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:47.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be3e00640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be40c7d70 0x7f4be415ca40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc019100 tx=0x7f4bcc01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:47.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be0c00640 1 -- 172.21.15.114:0/3447719439 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0b3800 con 0x7f4be40c7d70 2024-02-17T12:18:47.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be0c00640 1 -- 172.21.15.114:0/3447719439 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc0b3980 con 0x7f4be40c7d70 2024-02-17T12:18:47.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4bea400640 1 -- 172.21.15.114:0/3447719439 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be415a890 con 0x7f4be40c7d70 2024-02-17T12:18:47.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be0c00640 1 -- 172.21.15.114:0/3447719439 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0b3d30 con 0x7f4be40c7d70 2024-02-17T12:18:47.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4bea400640 1 -- 172.21.15.114:0/3447719439 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be40ad7c0 con 0x7f4be40c7d70 2024-02-17T12:18:47.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4bea400640 1 -- 172.21.15.114:0/3447719439 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be415ad40 con 0x7f4be40c7d70 2024-02-17T12:18:47.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be0c00640 1 -- 172.21.15.114:0/3447719439 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4bcc0b2380 con 0x7f4be40c7d70 2024-02-17T12:18:47.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.340+0000 7f4be0c00640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc0066e40 0x7f4bc0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.344+0000 7f4be0c00640 1 -- 172.21.15.114:0/3447719439 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f4bcc11f4d0 con 0x7f4be40c7d70 2024-02-17T12:18:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.344+0000 7f4be9000640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc0066e40 0x7f4bc0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.344+0000 7f4be9000640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc0066e40 0x7f4bc0069300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b9f0 tx=0x7f4bd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:47.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.348+0000 7f4be0c00640 1 -- 172.21.15.114:0/3447719439 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4bcc0ec020 con 0x7f4be40c7d70 2024-02-17T12:18:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:47.504+0000 7f4bea400640 1 -- 172.21.15.114:0/3447719439 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4be404efd0 con 0x7f4be40c7d70 2024-02-17T12:18:48.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.160+0000 7f4be0c00640 1 -- 172.21.15.114:0/3447719439 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4bcc0ef6e0 con 0x7f4be40c7d70 2024-02-17T12:18:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-02-17T12:18:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 -- 172.21.15.114:0/3447719439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc0066e40 msgr2=0x7f4bc0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc0066e40 0x7f4bc0069300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b9f0 tx=0x7f4bd4008040 comp rx=0 tx=0).stop 2024-02-17T12:18:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 -- 172.21.15.114:0/3447719439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be40c7d70 msgr2=0x7f4be415ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be40c7d70 0x7f4be415ca40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc019100 tx=0x7f4bcc01ad30 comp rx=0 tx=0).stop 2024-02-17T12:18:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 -- 172.21.15.114:0/3447719439 shutdown_connections 2024-02-17T12:18:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4be4155b80 0x7f4be41f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4bc0066e40 0x7f4bc0069300 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4be40c7d70 0x7f4be415ca40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 --2- 172.21.15.114:0/3447719439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4be406c030 0x7f4be415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 -- 172.21.15.114:0/3447719439 >> 172.21.15.114:0/3447719439 conn(0x7f4be4067120 msgr2=0x7f4be4153d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:48.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 -- 172.21.15.114:0/3447719439 shutdown_connections 2024-02-17T12:18:48.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.168+0000 7f4bea400640 1 -- 172.21.15.114:0/3447719439 wait complete. 2024-02-17T12:18:48.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:48.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd179400640 1 Processor -- start 2024-02-17T12:18:48.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd179400640 1 -- start start 2024-02-17T12:18:48.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd179400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd1740c2580 0x7fd1740aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd179400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd1740c1eb0 0x7fd17415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd179400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1740a9420 con 0x7fd17414f110 2024-02-17T12:18:48.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd179400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17414f4f0 con 0x7fd1740c1eb0 2024-02-17T12:18:48.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd179400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1740aae80 con 0x7fd1740c2580 2024-02-17T12:18:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd173200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd1740c1eb0 0x7fd17415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd173200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd1740c1eb0 0x7fd17415c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48108/0 (socket says 172.21.15.114:48108) 2024-02-17T12:18:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd173200640 1 -- 172.21.15.114:0/816077162 learned_addr learned my addr 172.21.15.114:0/816077162 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd171e00640 1 --2- 172.21.15.114:0/816077162 >> v2:172.21.15.116:3300/0 conn(0x7fd1740c2580 0x7fd1740aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd173200640 1 -- 172.21.15.114:0/816077162 >> v2:172.21.15.116:3300/0 conn(0x7fd1740c2580 msgr2=0x7fd1740aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:48.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd173200640 1 --2- 172.21.15.114:0/816077162 >> v2:172.21.15.116:3300/0 conn(0x7fd1740c2580 0x7fd1740aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd173200640 1 -- 172.21.15.114:0/816077162 >> v1:172.21.15.116:6789/0 conn(0x7fd17414f110 legacy=0x7fd1740c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.324+0000 7fd173200640 1 -- 172.21.15.114:0/816077162 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174152850 con 0x7fd1740c1eb0 2024-02-17T12:18:48.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd173200640 1 --2- 172.21.15.114:0/816077162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c1eb0 0x7fd17415c390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd17406f0d0 tx=0x7fd16c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec633a771b9d9002 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd171400640 1 -- 172.21.15.114:0/816077162 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c0ab660 con 0x7fd1740c1eb0 2024-02-17T12:18:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd171400640 1 -- 172.21.15.114:0/816077162 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c0ab7c0 con 0x7fd1740c1eb0 2024-02-17T12:18:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd171400640 1 -- 172.21.15.114:0/816077162 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c0abb50 con 0x7fd1740c1eb0 2024-02-17T12:18:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd179400640 1 -- 172.21.15.114:0/816077162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c1eb0 msgr2=0x7fd17415c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd179400640 1 --2- 172.21.15.114:0/816077162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c1eb0 0x7fd17415c390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd17406f0d0 tx=0x7fd16c01c460 comp rx=0 tx=0).stop 2024-02-17T12:18:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd179400640 1 -- 172.21.15.114:0/816077162 shutdown_connections 2024-02-17T12:18:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd179400640 1 --2- 172.21.15.114:0/816077162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c1eb0 0x7fd17415c390 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd179400640 1 --2- 172.21.15.114:0/816077162 >> v2:172.21.15.116:3300/0 conn(0x7fd1740c2580 0x7fd1740aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd179400640 1 -- 172.21.15.114:0/816077162 >> 172.21.15.114:0/816077162 conn(0x7fd1740a8490 msgr2=0x7fd1740a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd179400640 1 -- 172.21.15.114:0/816077162 shutdown_connections 2024-02-17T12:18:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.328+0000 7fd179400640 1 -- 172.21.15.114:0/816077162 wait complete. 2024-02-17T12:18:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd179400640 1 Processor -- start 2024-02-17T12:18:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd179400640 1 -- start start 2024-02-17T12:18:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd179400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1740c1eb0 0x7fd1740c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd179400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c2580 0x7fd1741ec510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd179400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd17414f110 0x7fd1741eca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd179400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1741eb110 con 0x7fd1740c2580 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd179400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1741ecf90 con 0x7fd17414f110 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd179400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd174150620 con 0x7fd1740c1eb0 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd171e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c2580 0x7fd1741ec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd171e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c2580 0x7fd1741ec510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48120/0 (socket says 172.21.15.114:48120) 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd171e00640 1 -- 172.21.15.114:0/2996569476 learned_addr learned my addr 172.21.15.114:0/2996569476 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd172800640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1740c1eb0 0x7fd1740c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd173200640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd17414f110 0x7fd1741eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd171e00640 1 -- 172.21.15.114:0/2996569476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1740c1eb0 msgr2=0x7fd1740c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd171e00640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1740c1eb0 0x7fd1740c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd171e00640 1 -- 172.21.15.114:0/2996569476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd17414f110 msgr2=0x7fd1741eca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd171e00640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd17414f110 0x7fd1741eca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd171e00640 1 -- 172.21.15.114:0/2996569476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c0094d0 con 0x7fd1740c2580 2024-02-17T12:18:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd171e00640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c2580 0x7fd1741ec510 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00e930 tx=0x7fd15c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd16aa00640 1 -- 172.21.15.114:0/2996569476 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c009690 con 0x7fd1740c2580 2024-02-17T12:18:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd16aa00640 1 -- 172.21.15.114:0/2996569476 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c00ca00 con 0x7fd1740c2580 2024-02-17T12:18:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd179400640 1 -- 172.21.15.114:0/2996569476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd174150db0 con 0x7fd1740c2580 2024-02-17T12:18:48.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd16aa00640 1 -- 172.21.15.114:0/2996569476 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c00cdb0 con 0x7fd1740c2580 2024-02-17T12:18:48.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.332+0000 7fd179400640 1 -- 172.21.15.114:0/2996569476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd174151370 con 0x7fd1740c2580 2024-02-17T12:18:48.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.336+0000 7fd179400640 1 -- 172.21.15.114:0/2996569476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1740c57b0 con 0x7fd1740c2580 2024-02-17T12:18:48.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.336+0000 7fd16aa00640 1 -- 172.21.15.114:0/2996569476 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd15c013470 con 0x7fd1740c2580 2024-02-17T12:18:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.336+0000 7fd16aa00640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd150066e40 0x7fd150069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.336+0000 7fd16aa00640 1 -- 172.21.15.114:0/2996569476 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fd15c084ca0 con 0x7fd1740c2580 2024-02-17T12:18:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.336+0000 7fd172800640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd150066e40 0x7fd150069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.336+0000 7fd172800640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd150066e40 0x7fd150069300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd174141990 tx=0x7fd164009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:48.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.340+0000 7fd16aa00640 1 -- 172.21.15.114:0/2996569476 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd15c051b90 con 0x7fd1740c2580 2024-02-17T12:18:48.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.504+0000 7fd179400640 1 -- 172.21.15.114:0/2996569476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd174074840 con 0x7fd1740c2580 2024-02-17T12:18:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.504+0000 7fd16aa00640 1 -- 172.21.15.114:0/2996569476 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16813 (secure 0 0 0) 0x7fd15c017090 con 0x7fd1740c2580 2024-02-17T12:18:48.510 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:48.510 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:48.160335+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/105000653":"2024-02-18T12:18:45.150507+0000","172.21.15.114:6835/105000653":"2024-02-18T12:18:45.150507+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 -- 172.21.15.114:0/2996569476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd150066e40 msgr2=0x7fd150069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd150066e40 0x7fd150069300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd174141990 tx=0x7fd164009040 comp rx=0 tx=0).stop 2024-02-17T12:18:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 -- 172.21.15.114:0/2996569476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c2580 msgr2=0x7fd1741ec510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c2580 0x7fd1741ec510 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00e930 tx=0x7fd15c00edf0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 -- 172.21.15.114:0/2996569476 shutdown_connections 2024-02-17T12:18:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd17414f110 0x7fd1741eca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd150066e40 0x7fd150069300 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1740c2580 0x7fd1741ec510 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 --2- 172.21.15.114:0/2996569476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd1740c1eb0 0x7fd1740c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 -- 172.21.15.114:0/2996569476 >> 172.21.15.114:0/2996569476 conn(0x7fd1740a8490 msgr2=0x7fd1740a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 -- 172.21.15.114:0/2996569476 shutdown_connections 2024-02-17T12:18:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.508+0000 7fd179400640 1 -- 172.21.15.114:0/2996569476 wait complete. 2024-02-17T12:18:48.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:18:17.610636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:18:18.703971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:18:48.532 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:18:48.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.672+0000 7f9b61000640 1 Processor -- start 2024-02-17T12:18:48.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.672+0000 7f9b61000640 1 -- start start 2024-02-17T12:18:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.672+0000 7f9b61000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9b5c14ef00 0x7f9b5c0c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.672+0000 7f9b61000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9b5c06db30 0x7f9b5c0c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.672+0000 7f9b61000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c0a9500 con 0x7f9b5c06e1b0 2024-02-17T12:18:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.672+0000 7f9b61000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c154e20 con 0x7f9b5c14ef00 2024-02-17T12:18:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.672+0000 7f9b61000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c06ece0 con 0x7f9b5c06db30 2024-02-17T12:18:48.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.676+0000 7f9b59e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9b5c14ef00 0x7f9b5c0c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.676+0000 7f9b5a800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9b5c06db30 0x7f9b5c0c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.676+0000 7f9b59e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9b5c14ef00 0x7f9b5c0c2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48132/0 (socket says 172.21.15.114:48132) 2024-02-17T12:18:48.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.676+0000 7f9b59e00640 1 -- 172.21.15.114:0/3658892698 learned_addr learned my addr 172.21.15.114:0/3658892698 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:48.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.676+0000 7f9b5a800640 1 -- 172.21.15.114:0/3658892698 >> v2:172.21.15.114:3300/0 conn(0x7f9b5c14ef00 msgr2=0x7f9b5c0c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:48.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.676+0000 7f9b5a800640 1 --2- 172.21.15.114:0/3658892698 >> v2:172.21.15.114:3300/0 conn(0x7f9b5c14ef00 0x7f9b5c0c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.676+0000 7f9b5a800640 1 -- 172.21.15.114:0/3658892698 >> v1:172.21.15.116:6789/0 conn(0x7f9b5c06e1b0 legacy=0x7f9b5c155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.676+0000 7f9b5a800640 1 -- 172.21.15.114:0/3658892698 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c06efc0 con 0x7f9b5c06db30 2024-02-17T12:18:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.676+0000 7f9b5a800640 1 --2- 172.21.15.114:0/3658892698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c06db30 0x7f9b5c0c3280 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0c64e0 tx=0x7f9b5401c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4d6424e49dfcad1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b58a00640 1 -- 172.21.15.114:0/3658892698 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b540a58d0 con 0x7f9b5c06db30 2024-02-17T12:18:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b58a00640 1 -- 172.21.15.114:0/3658892698 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b540a5a30 con 0x7f9b5c06db30 2024-02-17T12:18:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b58a00640 1 -- 172.21.15.114:0/3658892698 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b540a5dc0 con 0x7f9b5c06db30 2024-02-17T12:18:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 -- 172.21.15.114:0/3658892698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c06db30 msgr2=0x7f9b5c0c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 --2- 172.21.15.114:0/3658892698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c06db30 0x7f9b5c0c3280 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0c64e0 tx=0x7f9b5401c810 comp rx=0 tx=0).stop 2024-02-17T12:18:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 -- 172.21.15.114:0/3658892698 shutdown_connections 2024-02-17T12:18:48.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 --2- 172.21.15.114:0/3658892698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c06db30 0x7f9b5c0c3280 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 --2- 172.21.15.114:0/3658892698 >> v2:172.21.15.114:3300/0 conn(0x7f9b5c14ef00 0x7f9b5c0c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 -- 172.21.15.114:0/3658892698 >> 172.21.15.114:0/3658892698 conn(0x7f9b5c0a8660 msgr2=0x7f9b5c0a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:48.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 -- 172.21.15.114:0/3658892698 shutdown_connections 2024-02-17T12:18:48.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 -- 172.21.15.114:0/3658892698 wait complete. 2024-02-17T12:18:48.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 Processor -- start 2024-02-17T12:18:48.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 -- start start 2024-02-17T12:18:48.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b5c06db30 0x7f9b5c14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c06e1b0 0x7f9b5c0c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b5c14ef00 0x7f9b5c148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0712e0 con 0x7f9b5c06db30 2024-02-17T12:18:48.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0729d0 con 0x7f9b5c06e1b0 2024-02-17T12:18:48.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b61000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c14ad70 con 0x7f9b5c14ef00 2024-02-17T12:18:48.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b59e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b5c06db30 0x7f9b5c14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b59e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b5c06db30 0x7f9b5c14cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48142/0 (socket says 172.21.15.114:48142) 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.680+0000 7f9b59e00640 1 -- 172.21.15.114:0/2086597590 learned_addr learned my addr 172.21.15.114:0/2086597590 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b59400640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c06e1b0 0x7f9b5c0c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b5a800640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b5c14ef00 0x7f9b5c148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b59e00640 1 -- 172.21.15.114:0/2086597590 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b5c14ef00 msgr2=0x7f9b5c148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b59e00640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b5c14ef00 0x7f9b5c148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b59e00640 1 -- 172.21.15.114:0/2086597590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c06e1b0 msgr2=0x7f9b5c0c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b59e00640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c06e1b0 0x7f9b5c0c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b59e00640 1 -- 172.21.15.114:0/2086597590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009a70 con 0x7f9b5c06db30 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b59400640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c06e1b0 0x7f9b5c0c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b59e00640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b5c06db30 0x7f9b5c14cba0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00e890 tx=0x7f9b4c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b52000640 1 -- 172.21.15.114:0/2086597590 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c009620 con 0x7f9b5c06db30 2024-02-17T12:18:48.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b52000640 1 -- 172.21.15.114:0/2086597590 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c00c940 con 0x7f9b5c06db30 2024-02-17T12:18:48.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b52000640 1 -- 172.21.15.114:0/2086597590 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00ccf0 con 0x7f9b5c06db30 2024-02-17T12:18:48.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b61000640 1 -- 172.21.15.114:0/2086597590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c14b050 con 0x7f9b5c06db30 2024-02-17T12:18:48.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b61000640 1 -- 172.21.15.114:0/2086597590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c14d0e0 con 0x7f9b5c06db30 2024-02-17T12:18:48.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b61000640 1 -- 172.21.15.114:0/2086597590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c074840 con 0x7f9b5c06db30 2024-02-17T12:18:48.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b52000640 1 -- 172.21.15.114:0/2086597590 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9b4c013470 con 0x7f9b5c06db30 2024-02-17T12:18:48.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b52000640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b3c066e40 0x7f9b3c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:48.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b52000640 1 -- 172.21.15.114:0/2086597590 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9b4c084c00 con 0x7f9b5c06db30 2024-02-17T12:18:48.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.684+0000 7f9b59400640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b3c066e40 0x7f9b3c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:48.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.688+0000 7f9b59400640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b3c066e40 0x7f9b3c069300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c15ea70 tx=0x7f9b48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:48.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.688+0000 7f9b52000640 1 -- 172.21.15.114:0/2086597590 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9b4c08b080 con 0x7f9b5c06db30 2024-02-17T12:18:48.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b61000640 1 -- 172.21.15.114:0/2086597590 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b5c0c7050 con 0x7f9b5c06db30 2024-02-17T12:18:48.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b52000640 1 -- 172.21.15.114:0/2086597590 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b4c0170a0 con 0x7f9b5c06db30 2024-02-17T12:18:48.849 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:18:48.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b61000640 1 -- 172.21.15.114:0/2086597590 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b3c066e40 msgr2=0x7f9b3c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b61000640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b3c066e40 0x7f9b3c069300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c15ea70 tx=0x7f9b48009040 comp rx=0 tx=0).stop 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b61000640 1 -- 172.21.15.114:0/2086597590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b5c06db30 msgr2=0x7f9b5c14cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b61000640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b5c06db30 0x7f9b5c14cba0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00e890 tx=0x7f9b4c00ed50 comp rx=0 tx=0).stop 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b61000640 1 -- 172.21.15.114:0/2086597590 shutdown_connections 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b61000640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b5c14ef00 0x7f9b5c148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b61000640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b5c06e1b0 0x7f9b5c0c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b61000640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9b3c066e40 0x7f9b3c069300 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.844+0000 7f9b61000640 1 --2- 172.21.15.114:0/2086597590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b5c06db30 0x7f9b5c14cba0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.848+0000 7f9b61000640 1 -- 172.21.15.114:0/2086597590 >> 172.21.15.114:0/2086597590 conn(0x7f9b5c0a8660 msgr2=0x7f9b5c14dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.848+0000 7f9b61000640 1 -- 172.21.15.114:0/2086597590 shutdown_connections 2024-02-17T12:18:48.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:48.848+0000 7f9b61000640 1 -- 172.21.15.114:0/2086597590 wait complete. 2024-02-17T12:18:48.869 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:18:49.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.004+0000 7ff04ea00640 1 Processor -- start 2024-02-17T12:18:49.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.004+0000 7ff04ea00640 1 -- start start 2024-02-17T12:18:49.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff04ea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff04806db50 0x7ff04814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff04ea00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff048150490 0x7ff048152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff04ea00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff048156270 con 0x7ff0480c25a0 2024-02-17T12:18:49.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff04ea00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04806f090 con 0x7ff04806db50 2024-02-17T12:18:49.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff04ea00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff048071630 con 0x7ff048150490 2024-02-17T12:18:49.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff047e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff0480c25a0 0x7ff04806e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43164/0 (socket says 172.21.15.114:43164) 2024-02-17T12:18:49.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff047e00640 1 -- 172.21.15.114:0/971871455 learned_addr learned my addr 172.21.15.114:0/971871455 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:49.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff03fe00640 1 --2- 172.21.15.114:0/971871455 >> v2:172.21.15.114:3300/0 conn(0x7ff04806db50 0x7ff04814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff04ca00640 1 --2- 172.21.15.114:0/971871455 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff048150490 0x7ff048152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff047400640 1 -- 172.21.15.114:0/971871455 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120111282 0 0) 0x7ff048156270 con 0x7ff0480c25a0 2024-02-17T12:18:49.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff047400640 1 -- 172.21.15.114:0/971871455 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff02c003530 con 0x7ff0480c25a0 2024-02-17T12:18:49.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff03fe00640 1 -- 172.21.15.114:0/971871455 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff048150490 msgr2=0x7ff048152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:49.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff03fe00640 1 --2- 172.21.15.114:0/971871455 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff048150490 0x7ff048152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff03fe00640 1 -- 172.21.15.114:0/971871455 >> v1:172.21.15.114:6789/0 conn(0x7ff0480c25a0 legacy=0x7ff04806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff03fe00640 1 -- 172.21.15.114:0/971871455 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048156550 con 0x7ff04806db50 2024-02-17T12:18:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.008+0000 7ff03fe00640 1 --2- 172.21.15.114:0/971871455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff04806db50 0x7ff04814ff50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff0300097c0 tx=0x7ff03001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5535128eca027a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff047400640 1 -- 172.21.15.114:0/971871455 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0481539a0 con 0x7ff04806db50 2024-02-17T12:18:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff047400640 1 -- 172.21.15.114:0/971871455 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0300a7050 con 0x7ff04806db50 2024-02-17T12:18:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff047400640 1 -- 172.21.15.114:0/971871455 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300ab820 con 0x7ff04806db50 2024-02-17T12:18:49.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 -- 172.21.15.114:0/971871455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff04806db50 msgr2=0x7ff04814ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 --2- 172.21.15.114:0/971871455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff04806db50 0x7ff04814ff50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff0300097c0 tx=0x7ff03001c350 comp rx=0 tx=0).stop 2024-02-17T12:18:49.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 -- 172.21.15.114:0/971871455 shutdown_connections 2024-02-17T12:18:49.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 --2- 172.21.15.114:0/971871455 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff048150490 0x7ff048152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 --2- 172.21.15.114:0/971871455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff04806db50 0x7ff04814ff50 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 -- 172.21.15.114:0/971871455 >> 172.21.15.114:0/971871455 conn(0x7ff0480a8490 msgr2=0x7ff0480a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:49.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 -- 172.21.15.114:0/971871455 shutdown_connections 2024-02-17T12:18:49.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 -- 172.21.15.114:0/971871455 wait complete. 2024-02-17T12:18:49.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 Processor -- start 2024-02-17T12:18:49.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 -- start start 2024-02-17T12:18:49.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff04806db50 0x7ff0481473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0480c25a0 0x7ff0481ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048150490 0x7ff04814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04814d9e0 con 0x7ff0480c25a0 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0481479a0 con 0x7ff048150490 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff04ea00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff048147c80 con 0x7ff04806db50 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff03fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0480c25a0 0x7ff0481ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff03fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0480c25a0 0x7ff0481ed080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48160/0 (socket says 172.21.15.114:48160) 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff047e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff04806db50 0x7ff0481473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.012+0000 7ff03fe00640 1 -- 172.21.15.114:0/2907260803 learned_addr learned my addr 172.21.15.114:0/2907260803 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff04ca00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048150490 0x7ff04814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff03fe00640 1 -- 172.21.15.114:0/2907260803 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff04806db50 msgr2=0x7ff0481473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff03fe00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff04806db50 0x7ff0481473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff03fe00640 1 -- 172.21.15.114:0/2907260803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048150490 msgr2=0x7ff04814f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff03fe00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048150490 0x7ff04814f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff03fe00640 1 -- 172.21.15.114:0/2907260803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff030009420 con 0x7ff0480c25a0 2024-02-17T12:18:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff04ca00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048150490 0x7ff04814f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff03fe00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0480c25a0 0x7ff0481ed080 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff0300ae040 tx=0x7ff0300190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff044c00640 1 -- 172.21.15.114:0/2907260803 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300b4430 con 0x7ff0480c25a0 2024-02-17T12:18:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff044c00640 1 -- 172.21.15.114:0/2907260803 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0300b4590 con 0x7ff0480c25a0 2024-02-17T12:18:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff044c00640 1 -- 172.21.15.114:0/2907260803 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300b4940 con 0x7ff0480c25a0 2024-02-17T12:18:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff04ea00640 1 -- 172.21.15.114:0/2907260803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff048147f60 con 0x7ff0480c25a0 2024-02-17T12:18:49.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff04ea00640 1 -- 172.21.15.114:0/2907260803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04814f970 con 0x7ff0480c25a0 2024-02-17T12:18:49.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff04ea00640 1 -- 172.21.15.114:0/2907260803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff048074840 con 0x7ff0480c25a0 2024-02-17T12:18:49.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.016+0000 7ff044c00640 1 -- 172.21.15.114:0/2907260803 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff0300b2040 con 0x7ff0480c25a0 2024-02-17T12:18:49.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.020+0000 7ff044c00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff024066e40 0x7ff024069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.020+0000 7ff044c00640 1 -- 172.21.15.114:0/2907260803 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff03011e8c0 con 0x7ff0480c25a0 2024-02-17T12:18:49.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.020+0000 7ff047e00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff024066e40 0x7ff024069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.020+0000 7ff047e00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff024066e40 0x7ff024069300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff038007fd0 tx=0x7ff038000bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:49.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.024+0000 7ff044c00640 1 -- 172.21.15.114:0/2907260803 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff0300eb640 con 0x7ff0480c25a0 2024-02-17T12:18:49.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 -- 172.21.15.114:0/2907260803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff04814de00 con 0x7ff0480c25a0 2024-02-17T12:18:49.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff044c00640 1 -- 172.21.15.114:0/2907260803 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff0300eed00 con 0x7ff0480c25a0 2024-02-17T12:18:49.184 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:18:49.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 -- 172.21.15.114:0/2907260803 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff024066e40 msgr2=0x7ff024069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff024066e40 0x7ff024069300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff038007fd0 tx=0x7ff038000bd0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 -- 172.21.15.114:0/2907260803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0480c25a0 msgr2=0x7ff0481ed080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0480c25a0 0x7ff0481ed080 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff0300ae040 tx=0x7ff0300190f0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 -- 172.21.15.114:0/2907260803 shutdown_connections 2024-02-17T12:18:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff048150490 0x7ff04814f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff024066e40 0x7ff024069300 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0480c25a0 0x7ff0481ed080 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 --2- 172.21.15.114:0/2907260803 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff04806db50 0x7ff0481473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 -- 172.21.15.114:0/2907260803 >> 172.21.15.114:0/2907260803 conn(0x7ff0480a8490 msgr2=0x7ff0480c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 -- 172.21.15.114:0/2907260803 shutdown_connections 2024-02-17T12:18:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.180+0000 7ff04ea00640 1 -- 172.21.15.114:0/2907260803 wait complete. 2024-02-17T12:18:49.205 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:18:49.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff9800640 1 Processor -- start 2024-02-17T12:18:49.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff9800640 1 -- start start 2024-02-17T12:18:49.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff9800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff40c1eb0 0x7fbff415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff9800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff40a9420 con 0x7fbff414f110 2024-02-17T12:18:49.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff9800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff4152850 con 0x7fbff40c2580 2024-02-17T12:18:49.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff9800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff414f4f0 con 0x7fbff40c1eb0 2024-02-17T12:18:49.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff2a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbff414f110 0x7fbff40c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43178/0 (socket says 172.21.15.114:43178) 2024-02-17T12:18:49.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff2a00640 1 -- 172.21.15.114:0/2503647158 learned_addr learned my addr 172.21.15.114:0/2503647158 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff3400640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff40c1eb0 0x7fbff415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915938622 0 0) 0x7fbff40a9420 con 0x7fbff414f110 2024-02-17T12:18:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd8003530 con 0x7fbff414f110 2024-02-17T12:18:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507824433 0 0) 0x7fbff4152850 con 0x7fbff40c2580 2024-02-17T12:18:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff40a9420 con 0x7fbff40c2580 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4004396080 0 0) 0x7fbfd8003530 con 0x7fbff414f110 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff40c1eb0 msgr2=0x7fbff415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff40c1eb0 0x7fbff415d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 >> v1:172.21.15.116:6789/0 conn(0x7fbff40c2580 legacy=0x7fbff40aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff40a9670 con 0x7fbff414f110 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fbfe4001a00 con 0x7fbff414f110 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 >> v1:172.21.15.114:6789/0 conn(0x7fbff414f110 legacy=0x7fbff40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfd8003b40 0x7fbfd8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff40c1eb0 0x7fbfd80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd8004d10 0x7fbfd8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff414f4f0 con 0x7fbfd8004d10 2024-02-17T12:18:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd800bb20 con 0x7fbfd8003b40 2024-02-17T12:18:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd800bcb0 con 0x7fbff40c1eb0 2024-02-17T12:18:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff3400640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd8004d10 0x7fbfd8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff2000640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff40c1eb0 0x7fbfd80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff2a00640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfd8003b40 0x7fbfd8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff3400640 1 -- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff40c1eb0 msgr2=0x7fbfd80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff3400640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff40c1eb0 0x7fbfd80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff3400640 1 -- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfd8003b40 msgr2=0x7fbfd8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff3400640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfd8003b40 0x7fbfd8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.340+0000 7fbff3400640 1 -- 172.21.15.114:0/2503647158 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8003530 con 0x7fbfd8004d10 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff3400640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd8004d10 0x7fbfd8005190 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009ae0 tx=0x7fbfec01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bba17a0ddec231 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0a5620 con 0x7fbfd8004d10 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0a5780 con 0x7fbfd8004d10 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff1600640 1 -- 172.21.15.114:0/2503647158 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0a5af0 con 0x7fbfd8004d10 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff9800640 1 -- 172.21.15.114:0/2503647158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd8004d10 msgr2=0x7fbfd8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff9800640 1 --2- 172.21.15.114:0/2503647158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd8004d10 0x7fbfd8005190 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009ae0 tx=0x7fbfec01ca30 comp rx=0 tx=0).stop 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff3400640 1 -- 172.21.15.114:0/2503647158 reap_dead start 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff9800640 1 -- 172.21.15.114:0/2503647158 shutdown_connections 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff9800640 1 -- 172.21.15.114:0/2503647158 >> 172.21.15.114:0/2503647158 conn(0x7fbff40a8490 msgr2=0x7fbff40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff9800640 1 -- 172.21.15.114:0/2503647158 shutdown_connections 2024-02-17T12:18:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.344+0000 7fbff9800640 1 -- 172.21.15.114:0/2503647158 wait complete. 2024-02-17T12:18:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff9800640 1 Processor -- start 2024-02-17T12:18:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff9800640 1 -- start start 2024-02-17T12:18:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff9800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbff414bf30 0x7fbff4152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff9800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff41ed710 0x7fbff41edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbff4155370 0x7fbff4155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff9800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff41494d0 con 0x7fbff4155370 2024-02-17T12:18:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff9800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff41ee650 con 0x7fbff414bf30 2024-02-17T12:18:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff9800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff4144b00 con 0x7fbff41ed710 2024-02-17T12:18:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbff4155370 0x7fbff4155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbff4155370 0x7fbff4155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48188/0 (socket says 172.21.15.114:48188) 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff3400640 1 -- 172.21.15.114:0/4234963646 learned_addr learned my addr 172.21.15.114:0/4234963646 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff2000640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff41ed710 0x7fbff41edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff2a00640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbff414bf30 0x7fbff4152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff3400640 1 -- 172.21.15.114:0/4234963646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff41ed710 msgr2=0x7fbff41edb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff3400640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff41ed710 0x7fbff41edb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff3400640 1 -- 172.21.15.114:0/4234963646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbff414bf30 msgr2=0x7fbff4152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff3400640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbff414bf30 0x7fbff4152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff3400640 1 -- 172.21.15.114:0/4234963646 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff40c3f60 con 0x7fbff4155370 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff3400640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbff4155370 0x7fbff4155800 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0b0040 tx=0x7fbfd8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbfeaa00640 1 -- 172.21.15.114:0/4234963646 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0a5620 con 0x7fbff4155370 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbfeaa00640 1 -- 172.21.15.114:0/4234963646 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0ad640 con 0x7fbff4155370 2024-02-17T12:18:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff9800640 1 -- 172.21.15.114:0/4234963646 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff414a110 con 0x7fbff4155370 2024-02-17T12:18:49.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbfeaa00640 1 -- 172.21.15.114:0/4234963646 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0ad9f0 con 0x7fbff4155370 2024-02-17T12:18:49.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.348+0000 7fbff9800640 1 -- 172.21.15.114:0/4234963646 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff41ee0b0 con 0x7fbff4155370 2024-02-17T12:18:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.352+0000 7fbff9800640 1 -- 172.21.15.114:0/4234963646 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff4149960 con 0x7fbff4155370 2024-02-17T12:18:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.352+0000 7fbfeaa00640 1 -- 172.21.15.114:0/4234963646 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbfec0b4040 con 0x7fbff4155370 2024-02-17T12:18:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.352+0000 7fbfeaa00640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbfd0066d80 0x7fbfd0069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.352+0000 7fbfeaa00640 1 -- 172.21.15.114:0/4234963646 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fbfdc001d30 con 0x7fbff4155370 2024-02-17T12:18:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.352+0000 7fbff2a00640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbfd0066d80 0x7fbfd0069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.352+0000 7fbff2a00640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbfd0066d80 0x7fbfd0069240 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4002240 tx=0x7fbfe4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:49.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.356+0000 7fbfeaa00640 1 -- 172.21.15.114:0/4234963646 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbff4149960 con 0x7fbff4155370 2024-02-17T12:18:49.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 -- 172.21.15.114:0/4234963646 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fbff4149960 con 0x7fbff4155370 2024-02-17T12:18:49.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbfeaa00640 1 -- 172.21.15.114:0/4234963646 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7fbff4149960 con 0x7fbff4155370 2024-02-17T12:18:49.516 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:18:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 -- 172.21.15.114:0/4234963646 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbfd0066d80 msgr2=0x7fbfd0069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbfd0066d80 0x7fbfd0069240 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4002240 tx=0x7fbfe4009040 comp rx=0 tx=0).stop 2024-02-17T12:18:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 -- 172.21.15.114:0/4234963646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbff4155370 msgr2=0x7fbff4155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbff4155370 0x7fbff4155800 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0b0040 tx=0x7fbfd8005800 comp rx=0 tx=0).stop 2024-02-17T12:18:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 -- 172.21.15.114:0/4234963646 shutdown_connections 2024-02-17T12:18:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbfd0066d80 0x7fbfd0069240 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbff4155370 0x7fbff4155800 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbff41ed710 0x7fbff41edb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 --2- 172.21.15.114:0/4234963646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbff414bf30 0x7fbff4152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 -- 172.21.15.114:0/4234963646 >> 172.21.15.114:0/4234963646 conn(0x7fbff40a8490 msgr2=0x7fbff4071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 -- 172.21.15.114:0/4234963646 shutdown_connections 2024-02-17T12:18:49.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.512+0000 7fbff9800640 1 -- 172.21.15.114:0/4234963646 wait complete. 2024-02-17T12:18:49.537 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:49.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.668+0000 7f1dcae00640 1 Processor -- start 2024-02-17T12:18:49.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.668+0000 7f1dcae00640 1 -- start start 2024-02-17T12:18:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.668+0000 7f1dcae00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1dc414f110 0x7f1dc40c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.668+0000 7f1dcae00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1dc40c2580 0x7f1dc40aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.668+0000 7f1dcae00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc40a9420 con 0x7f1dc40c1eb0 2024-02-17T12:18:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.668+0000 7f1dcae00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc414f4f0 con 0x7f1dc40c2580 2024-02-17T12:18:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.668+0000 7f1dcae00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc40aae80 con 0x7f1dc414f110 2024-02-17T12:18:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc8e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1dc40c1eb0 0x7f1dc4155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43192/0 (socket says 172.21.15.114:43192) 2024-02-17T12:18:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc8e00640 1 -- 172.21.15.114:0/3839825422 learned_addr learned my addr 172.21.15.114:0/3839825422 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc3400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1dc40c2580 0x7f1dc40aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc3e00640 1 --2- 172.21.15.114:0/3839825422 >> v2:172.21.15.116:3300/0 conn(0x7f1dc414f110 0x7f1dc40c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc3400640 1 -- 172.21.15.114:0/3839825422 >> v2:172.21.15.116:3300/0 conn(0x7f1dc414f110 msgr2=0x7f1dc40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc3400640 1 --2- 172.21.15.114:0/3839825422 >> v2:172.21.15.116:3300/0 conn(0x7f1dc414f110 0x7f1dc40c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc3400640 1 -- 172.21.15.114:0/3839825422 >> v1:172.21.15.114:6789/0 conn(0x7f1dc40c1eb0 legacy=0x7f1dc4155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc3400640 1 -- 172.21.15.114:0/3839825422 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4152850 con 0x7f1dc40c2580 2024-02-17T12:18:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3839825422 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194794142 0 0) 0x7f1dc40a9420 con 0x7f1dc40c1eb0 2024-02-17T12:18:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc3400640 1 --2- 172.21.15.114:0/3839825422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 0x7f1dc40aa150 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1dc406dc70 tx=0x7f1db001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f821502a45aabc71 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3839825422 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00ac620 con 0x7f1dc40c2580 2024-02-17T12:18:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3839825422 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db00ac780 con 0x7f1dc40c2580 2024-02-17T12:18:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.672+0000 7f1dc2a00640 1 -- 172.21.15.114:0/3839825422 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00acb10 con 0x7f1dc40c2580 2024-02-17T12:18:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 -- 172.21.15.114:0/3839825422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 msgr2=0x7f1dc40aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 --2- 172.21.15.114:0/3839825422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 0x7f1dc40aa150 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1dc406dc70 tx=0x7f1db001c3c0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 -- 172.21.15.114:0/3839825422 shutdown_connections 2024-02-17T12:18:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 --2- 172.21.15.114:0/3839825422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 0x7f1dc40aa150 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 --2- 172.21.15.114:0/3839825422 >> v2:172.21.15.116:3300/0 conn(0x7f1dc414f110 0x7f1dc40c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 -- 172.21.15.114:0/3839825422 >> 172.21.15.114:0/3839825422 conn(0x7f1dc40a8490 msgr2=0x7f1dc40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 -- 172.21.15.114:0/3839825422 shutdown_connections 2024-02-17T12:18:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 -- 172.21.15.114:0/3839825422 wait complete. 2024-02-17T12:18:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 Processor -- start 2024-02-17T12:18:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 -- start start 2024-02-17T12:18:49.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dc40c1eb0 0x7f1dc4150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 0x7f1dc4143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1dc414f110 0x7f1dc4144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc41448a0 con 0x7f1dc40c2580 2024-02-17T12:18:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4145310 con 0x7f1dc40c1eb0 2024-02-17T12:18:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dcae00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc406efd0 con 0x7f1dc414f110 2024-02-17T12:18:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dc3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 0x7f1dc4143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dc3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 0x7f1dc4143e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48208/0 (socket says 172.21.15.114:48208) 2024-02-17T12:18:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dc3400640 1 -- 172.21.15.114:0/2353052731 learned_addr learned my addr 172.21.15.114:0/2353052731 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dc3400640 1 -- 172.21.15.114:0/2353052731 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1dc414f110 msgr2=0x7f1dc4144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dc3400640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1dc414f110 0x7f1dc4144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dc3e00640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dc40c1eb0 0x7f1dc4150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dc3400640 1 -- 172.21.15.114:0/2353052731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dc40c1eb0 msgr2=0x7f1dc4150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dc3400640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dc40c1eb0 0x7f1dc4150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.676+0000 7f1dc3400640 1 -- 172.21.15.114:0/2353052731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0009420 con 0x7f1dc40c2580 2024-02-17T12:18:49.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dc3400640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 0x7f1dc4143e20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1db00af040 tx=0x7f1db0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:49.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dbbe00640 1 -- 172.21.15.114:0/2353052731 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00b5410 con 0x7f1dc40c2580 2024-02-17T12:18:49.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dbbe00640 1 -- 172.21.15.114:0/2353052731 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db00b5590 con 0x7f1dc40c2580 2024-02-17T12:18:49.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dbbe00640 1 -- 172.21.15.114:0/2353052731 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00b5940 con 0x7f1dc40c2580 2024-02-17T12:18:49.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dcae00640 1 -- 172.21.15.114:0/2353052731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc4144bc0 con 0x7f1dc40c2580 2024-02-17T12:18:49.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dcae00640 1 -- 172.21.15.114:0/2353052731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc41454c0 con 0x7f1dc40c2580 2024-02-17T12:18:49.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dcae00640 1 -- 172.21.15.114:0/2353052731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc4151930 con 0x7f1dc40c2580 2024-02-17T12:18:49.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dbbe00640 1 -- 172.21.15.114:0/2353052731 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1db00b3040 con 0x7f1dc40c2580 2024-02-17T12:18:49.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dbbe00640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1da4066e40 0x7f1da4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:49.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dbbe00640 1 -- 172.21.15.114:0/2353052731 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1db011ec20 con 0x7f1dc40c2580 2024-02-17T12:18:49.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.680+0000 7f1dc3e00640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1da4066e40 0x7f1da4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:49.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.684+0000 7f1dc3e00640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1da4066e40 0x7f1da4069300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009990 tx=0x7f1db4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:49.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.684+0000 7f1dbbe00640 1 -- 172.21.15.114:0/2353052731 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1db00eb910 con 0x7f1dc40c2580 2024-02-17T12:18:49.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.872+0000 7f1dcae00640 1 -- 172.21.15.114:0/2353052731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dc4074840 con 0x7f1dc40c2580 2024-02-17T12:18:49.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.872+0000 7f1dbbe00640 1 -- 172.21.15.114:0/2353052731 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f1db00eefd0 con 0x7f1dc40c2580 2024-02-17T12:18:49.878 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:49.878 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6333,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3719530640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3719530640},{"type":"v1","addr":"172.21.15.114:6837","nonce":3719530640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:19.704588+0000","modified":"2024-02-17T12:18:22.751088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1690237872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1690237872},{"type":"v1","addr":"172.21.15.114:6836","nonce":1690237872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-02-17T12:18:49.880 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 40 2024-02-17T12:18:49.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 -- 172.21.15.114:0/2353052731 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1da4066e40 msgr2=0x7f1da4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1da4066e40 0x7f1da4069300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009990 tx=0x7f1db4008040 comp rx=0 tx=0).stop 2024-02-17T12:18:49.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 -- 172.21.15.114:0/2353052731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 msgr2=0x7f1dc4143e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:49.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 0x7f1dc4143e20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1db00af040 tx=0x7f1db0019160 comp rx=0 tx=0).stop 2024-02-17T12:18:49.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 -- 172.21.15.114:0/2353052731 shutdown_connections 2024-02-17T12:18:49.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1dc414f110 0x7f1dc4144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1da4066e40 0x7f1da4069300 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1dc40c2580 0x7f1dc4143e20 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 --2- 172.21.15.114:0/2353052731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dc40c1eb0 0x7f1dc4150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 -- 172.21.15.114:0/2353052731 >> 172.21.15.114:0/2353052731 conn(0x7f1dc40a8490 msgr2=0x7f1dc406b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 -- 172.21.15.114:0/2353052731 shutdown_connections 2024-02-17T12:18:49.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:49.876+0000 7f1dcae00640 1 -- 172.21.15.114:0/2353052731 wait complete. 2024-02-17T12:18:49.898 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:50.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.028+0000 7fd9b4600640 1 Processor -- start 2024-02-17T12:18:50.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.028+0000 7fd9b4600640 1 -- start start 2024-02-17T12:18:50.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b4600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd9ac0c6460 0x7fd9ac06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b4600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd9ac154e30 0x7fd9ac0aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b4600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ac155dd0 con 0x7fd9ac152540 2024-02-17T12:18:50.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b4600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac1588c0 con 0x7fd9ac0c6460 2024-02-17T12:18:50.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b4600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac155810 con 0x7fd9ac154e30 2024-02-17T12:18:50.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b1200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd9ac0c6460 0x7fd9ac06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b1200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd9ac0c6460 0x7fd9ac06ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48224/0 (socket says 172.21.15.114:48224) 2024-02-17T12:18:50.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b1200640 1 -- 172.21.15.114:0/2832901226 learned_addr learned my addr 172.21.15.114:0/2832901226 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:50.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b2600640 1 --2- 172.21.15.114:0/2832901226 >> v2:172.21.15.116:3300/0 conn(0x7fd9ac154e30 0x7fd9ac0aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b1200640 1 -- 172.21.15.114:0/2832901226 >> v2:172.21.15.116:3300/0 conn(0x7fd9ac154e30 msgr2=0x7fd9ac0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:50.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b1200640 1 --2- 172.21.15.114:0/2832901226 >> v2:172.21.15.116:3300/0 conn(0x7fd9ac154e30 0x7fd9ac0aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b1200640 1 -- 172.21.15.114:0/2832901226 >> v1:172.21.15.116:6789/0 conn(0x7fd9ac152540 legacy=0x7fd9ac158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b1200640 1 -- 172.21.15.114:0/2832901226 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac155af0 con 0x7fd9ac0c6460 2024-02-17T12:18:50.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.032+0000 7fd9b2600640 1 --2- 172.21.15.114:0/2832901226 >> v2:172.21.15.116:3300/0 conn(0x7fd9ac154e30 0x7fd9ac0aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:50.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b1200640 1 --2- 172.21.15.114:0/2832901226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0c6460 0x7fd9ac06ff80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac06f000 tx=0x7fd99801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345c536a6162a43 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:50.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9abe00640 1 -- 172.21.15.114:0/2832901226 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980ac640 con 0x7fd9ac0c6460 2024-02-17T12:18:50.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9abe00640 1 -- 172.21.15.114:0/2832901226 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9980ac7a0 con 0x7fd9ac0c6460 2024-02-17T12:18:50.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9abe00640 1 -- 172.21.15.114:0/2832901226 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980acb30 con 0x7fd9ac0c6460 2024-02-17T12:18:50.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 -- 172.21.15.114:0/2832901226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0c6460 msgr2=0x7fd9ac06ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 --2- 172.21.15.114:0/2832901226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0c6460 0x7fd9ac06ff80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac06f000 tx=0x7fd99801c400 comp rx=0 tx=0).stop 2024-02-17T12:18:50.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 -- 172.21.15.114:0/2832901226 shutdown_connections 2024-02-17T12:18:50.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 --2- 172.21.15.114:0/2832901226 >> v2:172.21.15.116:3300/0 conn(0x7fd9ac154e30 0x7fd9ac0aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 --2- 172.21.15.114:0/2832901226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac0c6460 0x7fd9ac06ff80 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 -- 172.21.15.114:0/2832901226 >> 172.21.15.114:0/2832901226 conn(0x7fd9ac0c4f20 msgr2=0x7fd9ac0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:50.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 -- 172.21.15.114:0/2832901226 shutdown_connections 2024-02-17T12:18:50.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 -- 172.21.15.114:0/2832901226 wait complete. 2024-02-17T12:18:50.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 Processor -- start 2024-02-17T12:18:50.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 -- start start 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9ac0c6460 0x7fd9ac06d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac152540 0x7fd9ac0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9ac154e30 0x7fd9ac06bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac150700 con 0x7fd9ac152540 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac150ca0 con 0x7fd9ac154e30 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.036+0000 7fd9b4600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac151c70 con 0x7fd9ac0c6460 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac152540 0x7fd9ac0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac152540 0x7fd9ac0c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48234/0 (socket says 172.21.15.114:48234) 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b1200640 1 -- 172.21.15.114:0/1102285016 learned_addr learned my addr 172.21.15.114:0/1102285016 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b1c00640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9ac0c6460 0x7fd9ac06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b2600640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9ac154e30 0x7fd9ac06bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b1200640 1 -- 172.21.15.114:0/1102285016 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9ac0c6460 msgr2=0x7fd9ac06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b1200640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9ac0c6460 0x7fd9ac06d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b1200640 1 -- 172.21.15.114:0/1102285016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9ac154e30 msgr2=0x7fd9ac06bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b1200640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9ac154e30 0x7fd9ac06bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b1200640 1 -- 172.21.15.114:0/1102285016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9980094d0 con 0x7fd9ac152540 2024-02-17T12:18:50.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b1200640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac152540 0x7fd9ac0c8590 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd998019010 tx=0x7fd9980191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:50.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9a9600640 1 -- 172.21.15.114:0/1102285016 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980b5640 con 0x7fd9ac152540 2024-02-17T12:18:50.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9a9600640 1 -- 172.21.15.114:0/1102285016 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9980b57a0 con 0x7fd9ac152540 2024-02-17T12:18:50.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9a9600640 1 -- 172.21.15.114:0/1102285016 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980b5b50 con 0x7fd9ac152540 2024-02-17T12:18:50.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b4600640 1 -- 172.21.15.114:0/1102285016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac151f50 con 0x7fd9ac152540 2024-02-17T12:18:50.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b4600640 1 -- 172.21.15.114:0/1102285016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac0c8ad0 con 0x7fd9ac152540 2024-02-17T12:18:50.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9b4600640 1 -- 172.21.15.114:0/1102285016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac1520e0 con 0x7fd9ac152540 2024-02-17T12:18:50.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9a9600640 1 -- 172.21.15.114:0/1102285016 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd9980b3070 con 0x7fd9ac152540 2024-02-17T12:18:50.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9a9600640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd98c066e70 0x7fd98c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.040+0000 7fd9a9600640 1 -- 172.21.15.114:0/1102285016 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fd99811eb80 con 0x7fd9ac152540 2024-02-17T12:18:50.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.044+0000 7fd9b1c00640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd98c066e70 0x7fd98c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.044+0000 7fd9b1c00640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd98c066e70 0x7fd98c069330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0001650 tx=0x7fd9a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:50.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.044+0000 7fd9a9600640 1 -- 172.21.15.114:0/1102285016 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd9980eb9a0 con 0x7fd9ac152540 2024-02-17T12:18:50.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.204+0000 7fd9b4600640 1 -- 172.21.15.114:0/1102285016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9ac0aa1a0 con 0x7fd9ac152540 2024-02-17T12:18:50.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9a9600640 1 -- 172.21.15.114:0/1102285016 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16813 (secure 0 0 0) 0x7fd9980b9090 con 0x7fd9ac152540 2024-02-17T12:18:50.211 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:50.211 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:48.160335+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/105000653":"2024-02-18T12:18:45.150507+0000","172.21.15.114:6835/105000653":"2024-02-18T12:18:45.150507+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 -- 172.21.15.114:0/1102285016 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd98c066e70 msgr2=0x7fd98c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd98c066e70 0x7fd98c069330 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0001650 tx=0x7fd9a0009040 comp rx=0 tx=0).stop 2024-02-17T12:18:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 -- 172.21.15.114:0/1102285016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac152540 msgr2=0x7fd9ac0c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac152540 0x7fd9ac0c8590 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd998019010 tx=0x7fd9980191a0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 -- 172.21.15.114:0/1102285016 shutdown_connections 2024-02-17T12:18:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9ac154e30 0x7fd9ac06bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd98c066e70 0x7fd98c069330 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9ac152540 0x7fd9ac0c8590 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 --2- 172.21.15.114:0/1102285016 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9ac0c6460 0x7fd9ac06d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 -- 172.21.15.114:0/1102285016 >> 172.21.15.114:0/1102285016 conn(0x7fd9ac0c4f20 msgr2=0x7fd9ac158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:50.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 -- 172.21.15.114:0/1102285016 shutdown_connections 2024-02-17T12:18:50.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.208+0000 7fd9b4600640 1 -- 172.21.15.114:0/1102285016 wait complete. 2024-02-17T12:18:50.233 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-02-17T12:18:50.233 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:50.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb25fa00640 1 Processor -- start 2024-02-17T12:18:50.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb25fa00640 1 -- start start 2024-02-17T12:18:50.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb25fa00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2580714c0 0x7fb258156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb25fa00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258152d30 0x7fb2581531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb25fa00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb258157270 con 0x7fb258150300 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb25fa00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2580c6900 con 0x7fb2580714c0 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb25fa00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2580c3580 con 0x7fb258152d30 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb25d000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb258150300 0x7fb2580aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43202/0 (socket says 172.21.15.114:43202) 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb25d000640 1 -- 172.21.15.114:0/1479684499 learned_addr learned my addr 172.21.15.114:0/1479684499 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb24fe00640 1 --2- 172.21.15.114:0/1479684499 >> v2:172.21.15.116:3300/0 conn(0x7fb2580714c0 0x7fb258156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.364+0000 7fb25da00640 1 --2- 172.21.15.114:0/1479684499 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258152d30 0x7fb2581531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.368+0000 7fb257e00640 1 -- 172.21.15.114:0/1479684499 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997213782 0 0) 0x7fb258157270 con 0x7fb258150300 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.368+0000 7fb257e00640 1 -- 172.21.15.114:0/1479684499 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb23c003530 con 0x7fb258150300 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.368+0000 7fb24fe00640 1 -- 172.21.15.114:0/1479684499 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258152d30 msgr2=0x7fb2581531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.368+0000 7fb24fe00640 1 --2- 172.21.15.114:0/1479684499 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258152d30 0x7fb2581531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.368+0000 7fb24fe00640 1 -- 172.21.15.114:0/1479684499 >> v1:172.21.15.114:6789/0 conn(0x7fb258150300 legacy=0x7fb2580aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.368+0000 7fb24fe00640 1 -- 172.21.15.114:0/1479684499 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580c2fc0 con 0x7fb2580714c0 2024-02-17T12:18:50.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.368+0000 7fb24fe00640 1 --2- 172.21.15.114:0/1479684499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580714c0 0x7fb258156d30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb2400097c0 tx=0x7fb24001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f23ad1181e03838a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:50.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.368+0000 7fb257e00640 1 -- 172.21.15.114:0/1479684499 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400a4ea0 con 0x7fb2580714c0 2024-02-17T12:18:50.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.368+0000 7fb257e00640 1 -- 172.21.15.114:0/1479684499 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2400a7050 con 0x7fb2580714c0 2024-02-17T12:18:50.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.368+0000 7fb257e00640 1 -- 172.21.15.114:0/1479684499 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400ab800 con 0x7fb2580714c0 2024-02-17T12:18:50.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 -- 172.21.15.114:0/1479684499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580714c0 msgr2=0x7fb258156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 --2- 172.21.15.114:0/1479684499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580714c0 0x7fb258156d30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb2400097c0 tx=0x7fb24001c410 comp rx=0 tx=0).stop 2024-02-17T12:18:50.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 -- 172.21.15.114:0/1479684499 shutdown_connections 2024-02-17T12:18:50.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 --2- 172.21.15.114:0/1479684499 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258152d30 0x7fb2581531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 --2- 172.21.15.114:0/1479684499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580714c0 0x7fb258156d30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 -- 172.21.15.114:0/1479684499 >> 172.21.15.114:0/1479684499 conn(0x7fb2580c4f20 msgr2=0x7fb2580c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:50.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 -- 172.21.15.114:0/1479684499 shutdown_connections 2024-02-17T12:18:50.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 -- 172.21.15.114:0/1479684499 wait complete. 2024-02-17T12:18:50.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 Processor -- start 2024-02-17T12:18:50.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 -- start start 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580714c0 0x7fb258154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258150300 0x7fb2581f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb258152d30 0x7fb25813f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581ee410 con 0x7fb258152d30 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581f1f90 con 0x7fb2580714c0 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25fa00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581edb00 con 0x7fb258150300 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb258152d30 0x7fb25813f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb24fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258150300 0x7fb2581f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb25d000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580714c0 0x7fb258154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb24fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258150300 0x7fb2581f1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:42714/0 (socket says 172.21.15.114:42714) 2024-02-17T12:18:50.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb24fe00640 1 -- 172.21.15.114:0/745338654 learned_addr learned my addr 172.21.15.114:0/745338654 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:50.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb24fe00640 1 -- 172.21.15.114:0/745338654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580714c0 msgr2=0x7fb258154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb24fe00640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580714c0 0x7fb258154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb24fe00640 1 -- 172.21.15.114:0/745338654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb258152d30 msgr2=0x7fb25813f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb24fe00640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb258152d30 0x7fb25813f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb24fe00640 1 -- 172.21.15.114:0/745338654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb240009420 con 0x7fb258150300 2024-02-17T12:18:50.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.372+0000 7fb24fe00640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258150300 0x7fb2581f1a50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb24001a040 tx=0x7fb2400191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:50.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb255600640 1 -- 172.21.15.114:0/745338654 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400b8070 con 0x7fb258150300 2024-02-17T12:18:50.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb255600640 1 -- 172.21.15.114:0/745338654 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb240006e20 con 0x7fb258150300 2024-02-17T12:18:50.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb255600640 1 -- 172.21.15.114:0/745338654 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240003a30 con 0x7fb258150300 2024-02-17T12:18:50.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb25fa00640 1 -- 172.21.15.114:0/745338654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb258154740 con 0x7fb258150300 2024-02-17T12:18:50.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb25fa00640 1 -- 172.21.15.114:0/745338654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2581ee0a0 con 0x7fb258150300 2024-02-17T12:18:50.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb25fa00640 1 -- 172.21.15.114:0/745338654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb258074840 con 0x7fb258150300 2024-02-17T12:18:50.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb255600640 1 -- 172.21.15.114:0/745338654 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb2400b2040 con 0x7fb258150300 2024-02-17T12:18:50.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb255600640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb234066e40 0x7fb234069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb255600640 1 -- 172.21.15.114:0/745338654 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fb24011e990 con 0x7fb258150300 2024-02-17T12:18:50.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb25d000640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb234066e40 0x7fb234069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.376+0000 7fb25d000640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb234066e40 0x7fb234069300 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb248007fd0 tx=0x7fb248009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:50.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.380+0000 7fb255600640 1 -- 172.21.15.114:0/745338654 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb2400eb840 con 0x7fb258150300 2024-02-17T12:18:50.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 -- 172.21.15.114:0/745338654 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2580a7ed0 con 0x7fb258150300 2024-02-17T12:18:50.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb255600640 1 -- 172.21.15.114:0/745338654 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4951 (secure 0 0 0) 0x7fb2400eef00 con 0x7fb258150300 2024-02-17T12:18:50.575 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:50.575 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6333,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3719530640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3719530640},{"type":"v1","addr":"172.21.15.114:6837","nonce":3719530640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:19.704588+0000","modified":"2024-02-17T12:18:22.751088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1690237872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1690237872},{"type":"v1","addr":"172.21.15.114:6836","nonce":1690237872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-02-17T12:18:50.576 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 40 2024-02-17T12:18:50.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 -- 172.21.15.114:0/745338654 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb234066e40 msgr2=0x7fb234069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb234066e40 0x7fb234069300 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb248007fd0 tx=0x7fb248009040 comp rx=0 tx=0).stop 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 -- 172.21.15.114:0/745338654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258150300 msgr2=0x7fb2581f1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258150300 0x7fb2581f1a50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb24001a040 tx=0x7fb2400191b0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 -- 172.21.15.114:0/745338654 shutdown_connections 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb234066e40 0x7fb234069300 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb258152d30 0x7fb25813f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb258150300 0x7fb2581f1a50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 --2- 172.21.15.114:0/745338654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580714c0 0x7fb258154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 -- 172.21.15.114:0/745338654 >> 172.21.15.114:0/745338654 conn(0x7fb2580c4f20 msgr2=0x7fb2580c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 -- 172.21.15.114:0/745338654 shutdown_connections 2024-02-17T12:18:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.572+0000 7fb25fa00640 1 -- 172.21.15.114:0/745338654 wait complete. 2024-02-17T12:18:50.597 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:50.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2da800640 1 Processor -- start 2024-02-17T12:18:50.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2da800640 1 -- start start 2024-02-17T12:18:50.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2da800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff2d406fdc0 0x7ff2d40aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2da800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff2d4158ad0 0x7ff2d415f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2da800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d40c5ee0 con 0x7ff2d40aa060 2024-02-17T12:18:50.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2da800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d40c2390 con 0x7ff2d406fdc0 2024-02-17T12:18:50.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2da800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d40706e0 con 0x7ff2d4158ad0 2024-02-17T12:18:50.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2d8a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff2d406fdc0 0x7ff2d40aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2d9400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff2d40aa060 0x7ff2d41583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43214/0 (socket says 172.21.15.114:43214) 2024-02-17T12:18:50.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2d9400640 1 -- 172.21.15.114:0/2682288394 learned_addr learned my addr 172.21.15.114:0/2682288394 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:50.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2d9e00640 1 --2- 172.21.15.114:0/2682288394 >> v2:172.21.15.116:3300/0 conn(0x7ff2d4158ad0 0x7ff2d415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2d8a00640 1 -- 172.21.15.114:0/2682288394 >> v2:172.21.15.116:3300/0 conn(0x7ff2d4158ad0 msgr2=0x7ff2d415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2d8a00640 1 --2- 172.21.15.114:0/2682288394 >> v2:172.21.15.116:3300/0 conn(0x7ff2d4158ad0 0x7ff2d415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2d8a00640 1 -- 172.21.15.114:0/2682288394 >> v1:172.21.15.114:6789/0 conn(0x7ff2d40aa060 legacy=0x7ff2d41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2d8a00640 1 -- 172.21.15.114:0/2682288394 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40c2570 con 0x7ff2d406fdc0 2024-02-17T12:18:50.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.728+0000 7ff2d3e00640 1 -- 172.21.15.114:0/2682288394 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415478625 0 0) 0x7ff2d40c5ee0 con 0x7ff2d40aa060 2024-02-17T12:18:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2d8a00640 1 --2- 172.21.15.114:0/2682288394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 0x7ff2d40aa440 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40a7fc0 tx=0x7ff2c001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cf6e39bd5de3d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2d3e00640 1 -- 172.21.15.114:0/2682288394 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00ab600 con 0x7ff2d406fdc0 2024-02-17T12:18:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2d3e00640 1 -- 172.21.15.114:0/2682288394 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c00a7050 con 0x7ff2d406fdc0 2024-02-17T12:18:50.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2d3e00640 1 -- 172.21.15.114:0/2682288394 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00ab980 con 0x7ff2d406fdc0 2024-02-17T12:18:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2da800640 1 -- 172.21.15.114:0/2682288394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 msgr2=0x7ff2d40aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2da800640 1 --2- 172.21.15.114:0/2682288394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 0x7ff2d40aa440 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40a7fc0 tx=0x7ff2c001c330 comp rx=0 tx=0).stop 2024-02-17T12:18:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2da800640 1 -- 172.21.15.114:0/2682288394 shutdown_connections 2024-02-17T12:18:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2da800640 1 --2- 172.21.15.114:0/2682288394 >> v2:172.21.15.116:3300/0 conn(0x7ff2d4158ad0 0x7ff2d415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2da800640 1 --2- 172.21.15.114:0/2682288394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 0x7ff2d40aa440 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2da800640 1 -- 172.21.15.114:0/2682288394 >> 172.21.15.114:0/2682288394 conn(0x7ff2d406ed70 msgr2=0x7ff2d406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2da800640 1 -- 172.21.15.114:0/2682288394 shutdown_connections 2024-02-17T12:18:50.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2da800640 1 -- 172.21.15.114:0/2682288394 wait complete. 2024-02-17T12:18:50.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.732+0000 7ff2da800640 1 Processor -- start 2024-02-17T12:18:50.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2da800640 1 -- start start 2024-02-17T12:18:50.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2da800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 0x7ff2d414f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2da800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff2d40aa060 0x7ff2d4154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2da800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2d4158ad0 0x7ff2d41ee780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2da800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4154330 con 0x7ff2d406fdc0 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2da800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4153720 con 0x7ff2d4158ad0 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2da800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4153a00 con 0x7ff2d40aa060 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 0x7ff2d414f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 0x7ff2d414f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48248/0 (socket says 172.21.15.114:48248) 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d9400640 1 -- 172.21.15.114:0/3642010766 learned_addr learned my addr 172.21.15.114:0/3642010766 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d9e00640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2d4158ad0 0x7ff2d41ee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d8a00640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff2d40aa060 0x7ff2d4154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d9400640 1 -- 172.21.15.114:0/3642010766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff2d40aa060 msgr2=0x7ff2d4154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d9400640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff2d40aa060 0x7ff2d4154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d9400640 1 -- 172.21.15.114:0/3642010766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2d4158ad0 msgr2=0x7ff2d41ee780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d9400640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2d4158ad0 0x7ff2d41ee780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d9400640 1 -- 172.21.15.114:0/3642010766 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c0009420 con 0x7ff2d406fdc0 2024-02-17T12:18:50.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d8a00640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff2d40aa060 0x7ff2d4154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:50.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d9400640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 0x7ff2d414f6b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c7c0 tx=0x7ff2c800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:50.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d1600640 1 -- 172.21.15.114:0/3642010766 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800a640 con 0x7ff2d406fdc0 2024-02-17T12:18:50.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d1600640 1 -- 172.21.15.114:0/3642010766 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c800a7c0 con 0x7ff2d406fdc0 2024-02-17T12:18:50.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2da800640 1 -- 172.21.15.114:0/3642010766 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d4070cf0 con 0x7ff2d406fdc0 2024-02-17T12:18:50.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2d1600640 1 -- 172.21.15.114:0/3642010766 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800ab70 con 0x7ff2d406fdc0 2024-02-17T12:18:50.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2da800640 1 -- 172.21.15.114:0/3642010766 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d4153fc0 con 0x7ff2d406fdc0 2024-02-17T12:18:50.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.736+0000 7ff2da800640 1 -- 172.21.15.114:0/3642010766 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4068180 con 0x7ff2d406fdc0 2024-02-17T12:18:50.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.740+0000 7ff2d1600640 1 -- 172.21.15.114:0/3642010766 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff2c800acd0 con 0x7ff2d406fdc0 2024-02-17T12:18:50.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.740+0000 7ff2d1600640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff2b4066e70 0x7ff2b4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:50.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.740+0000 7ff2d1600640 1 -- 172.21.15.114:0/3642010766 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff2c8084280 con 0x7ff2d406fdc0 2024-02-17T12:18:50.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.740+0000 7ff2d8a00640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff2b4066e70 0x7ff2b4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:50.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.740+0000 7ff2d8a00640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff2b4066e70 0x7ff2b4069330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00ad000 tx=0x7ff2c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:50.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.744+0000 7ff2d1600640 1 -- 172.21.15.114:0/3642010766 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2c80510b0 con 0x7ff2d406fdc0 2024-02-17T12:18:50.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.928+0000 7ff2da800640 1 -- 172.21.15.114:0/3642010766 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2d4070b50 con 0x7ff2d406fdc0 2024-02-17T12:18:50.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2d1600640 1 -- 172.21.15.114:0/3642010766 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4951 (secure 0 0 0) 0x7ff2d4070b50 con 0x7ff2d406fdc0 2024-02-17T12:18:50.935 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:50.935 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6333,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3719530640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3719530640},{"type":"v1","addr":"172.21.15.114:6837","nonce":3719530640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:18:19.704588+0000","modified":"2024-02-17T12:18:22.751088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1690237872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1690237872},{"type":"v1","addr":"172.21.15.114:6836","nonce":1690237872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-02-17T12:18:50.935 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 40 2024-02-17T12:18:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 -- 172.21.15.114:0/3642010766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff2b4066e70 msgr2=0x7ff2b4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff2b4066e70 0x7ff2b4069330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00ad000 tx=0x7ff2c0008040 comp rx=0 tx=0).stop 2024-02-17T12:18:50.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 -- 172.21.15.114:0/3642010766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 msgr2=0x7ff2d414f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:50.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 0x7ff2d414f6b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c7c0 tx=0x7ff2c800cc80 comp rx=0 tx=0).stop 2024-02-17T12:18:50.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 -- 172.21.15.114:0/3642010766 shutdown_connections 2024-02-17T12:18:50.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2d4158ad0 0x7ff2d41ee780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff2d40aa060 0x7ff2d4154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff2b4066e70 0x7ff2b4069330 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 --2- 172.21.15.114:0/3642010766 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2d406fdc0 0x7ff2d414f6b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:50.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 -- 172.21.15.114:0/3642010766 >> 172.21.15.114:0/3642010766 conn(0x7ff2d406ed70 msgr2=0x7ff2d40aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:50.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 -- 172.21.15.114:0/3642010766 shutdown_connections 2024-02-17T12:18:50.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:50.932+0000 7ff2da800640 1 -- 172.21.15.114:0/3642010766 wait complete. 2024-02-17T12:18:50.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:51.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.084+0000 7ffac3e00640 1 Processor -- start 2024-02-17T12:18:51.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.084+0000 7ffac3e00640 1 -- start start 2024-02-17T12:18:51.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffac3e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ffabc0c2580 0x7ffabc0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffac3e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc0a9420 con 0x7ffabc14f110 2024-02-17T12:18:51.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffac3e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc152850 con 0x7ffabc0c1eb0 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffac3e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc14f4f0 con 0x7ffabc0c2580 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffac1400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffabc14f110 0x7ffabc0c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43224/0 (socket says 172.21.15.114:43224) 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffac1400640 1 -- 172.21.15.114:0/1858154759 learned_addr learned my addr 172.21.15.114:0/1858154759 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffac0a00640 1 --2- 172.21.15.114:0/1858154759 >> v2:172.21.15.116:3300/0 conn(0x7ffabc0c2580 0x7ffabc0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffabbe00640 1 -- 172.21.15.114:0/1858154759 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737036102 0 0) 0x7ffabc0a9420 con 0x7ffabc14f110 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffabbe00640 1 -- 172.21.15.114:0/1858154759 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa4003530 con 0x7ffabc14f110 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffabbe00640 1 -- 172.21.15.114:0/1858154759 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11478295 0 0) 0x7ffabc152850 con 0x7ffabc0c1eb0 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffabbe00640 1 -- 172.21.15.114:0/1858154759 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffabc0a9420 con 0x7ffabc0c1eb0 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffac0a00640 1 -- 172.21.15.114:0/1858154759 >> v1:172.21.15.116:6789/0 conn(0x7ffabc0c1eb0 legacy=0x7ffabc15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffac0a00640 1 -- 172.21.15.114:0/1858154759 >> v1:172.21.15.114:6789/0 conn(0x7ffabc14f110 legacy=0x7ffabc0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.088+0000 7ffac0a00640 1 -- 172.21.15.114:0/1858154759 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc0a9670 con 0x7ffabc0c2580 2024-02-17T12:18:51.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac0a00640 1 --2- 172.21.15.114:0/1858154759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffabc0c2580 0x7ffabc0aa150 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80097c0 tx=0x7ffaa801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29af21b3aadf4671 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:51.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffabbe00640 1 -- 172.21.15.114:0/1858154759 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80ab600 con 0x7ffabc0c2580 2024-02-17T12:18:51.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffabbe00640 1 -- 172.21.15.114:0/1858154759 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa80a7050 con 0x7ffabc0c2580 2024-02-17T12:18:51.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffabbe00640 1 -- 172.21.15.114:0/1858154759 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80ab980 con 0x7ffabc0c2580 2024-02-17T12:18:51.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 -- 172.21.15.114:0/1858154759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffabc0c2580 msgr2=0x7ffabc0aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 --2- 172.21.15.114:0/1858154759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffabc0c2580 0x7ffabc0aa150 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80097c0 tx=0x7ffaa801c410 comp rx=0 tx=0).stop 2024-02-17T12:18:51.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 -- 172.21.15.114:0/1858154759 shutdown_connections 2024-02-17T12:18:51.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 --2- 172.21.15.114:0/1858154759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffabc0c2580 0x7ffabc0aa150 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 -- 172.21.15.114:0/1858154759 >> 172.21.15.114:0/1858154759 conn(0x7ffabc0a8490 msgr2=0x7ffabc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:51.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 -- 172.21.15.114:0/1858154759 shutdown_connections 2024-02-17T12:18:51.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 -- 172.21.15.114:0/1858154759 wait complete. 2024-02-17T12:18:51.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 Processor -- start 2024-02-17T12:18:51.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 -- start start 2024-02-17T12:18:51.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffabc0c1eb0 0x7ffabc151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffabc0c2580 0x7ffabc1ec140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffabc14f110 0x7ffabc1ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc142300 con 0x7ffabc0c2580 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc141e10 con 0x7ffabc0c1eb0 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.092+0000 7ffac3e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc142020 con 0x7ffabc14f110 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffabc0c2580 0x7ffabc1ec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffabc0c2580 0x7ffabc1ec140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48250/0 (socket says 172.21.15.114:48250) 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac0a00640 1 -- 172.21.15.114:0/109029418 learned_addr learned my addr 172.21.15.114:0/109029418 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac1e00640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffabc14f110 0x7ffabc1ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac1400640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffabc0c1eb0 0x7ffabc151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac0a00640 1 -- 172.21.15.114:0/109029418 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffabc14f110 msgr2=0x7ffabc1ec680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac0a00640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffabc14f110 0x7ffabc1ec680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac0a00640 1 -- 172.21.15.114:0/109029418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffabc0c1eb0 msgr2=0x7ffabc151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac0a00640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffabc0c1eb0 0x7ffabc151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac0a00640 1 -- 172.21.15.114:0/109029418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa8009420 con 0x7ffabc0c2580 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac1400640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffabc0c1eb0 0x7ffabc151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac0a00640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffabc0c2580 0x7ffabc1ec140 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80ae040 tx=0x7ffaa80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:51.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffab9600640 1 -- 172.21.15.114:0/109029418 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80b4430 con 0x7ffabc0c2580 2024-02-17T12:18:51.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffab9600640 1 -- 172.21.15.114:0/109029418 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa80a4e90 con 0x7ffabc0c2580 2024-02-17T12:18:51.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac3e00640 1 -- 172.21.15.114:0/109029418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc1efc40 con 0x7ffabc0c2580 2024-02-17T12:18:51.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffab9600640 1 -- 172.21.15.114:0/109029418 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80b47f0 con 0x7ffabc0c2580 2024-02-17T12:18:51.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac3e00640 1 -- 172.21.15.114:0/109029418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc1424d0 con 0x7ffabc0c2580 2024-02-17T12:18:51.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffac3e00640 1 -- 172.21.15.114:0/109029418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc074840 con 0x7ffabc0c2580 2024-02-17T12:18:51.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffab9600640 1 -- 172.21.15.114:0/109029418 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ffaa80b2040 con 0x7ffabc0c2580 2024-02-17T12:18:51.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.096+0000 7ffab9600640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa9c066e40 0x7ffa9c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.100+0000 7ffab9600640 1 -- 172.21.15.114:0/109029418 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ffaa811e750 con 0x7ffabc0c2580 2024-02-17T12:18:51.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.100+0000 7ffac1400640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa9c066e40 0x7ffa9c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.100+0000 7ffac1400640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa9c066e40 0x7ffa9c069300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffab0000f70 tx=0x7ffab0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:51.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.100+0000 7ffab9600640 1 -- 172.21.15.114:0/109029418 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffaa80eb4d0 con 0x7ffabc0c2580 2024-02-17T12:18:51.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.256+0000 7ffac3e00640 1 -- 172.21.15.114:0/109029418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffabc0c1380 con 0x7ffabc0c2580 2024-02-17T12:18:51.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffab9600640 1 -- 172.21.15.114:0/109029418 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16813 (secure 0 0 0) 0x7ffaa80eeb90 con 0x7ffabc0c2580 2024-02-17T12:18:51.263 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:51.264 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:48.160335+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:18:17.610636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:18:18.703971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/105000653":"2024-02-18T12:18:45.150507+0000","172.21.15.114:6835/105000653":"2024-02-18T12:18:45.150507+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:51.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 -- 172.21.15.114:0/109029418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa9c066e40 msgr2=0x7ffa9c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa9c066e40 0x7ffa9c069300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffab0000f70 tx=0x7ffab0009040 comp rx=0 tx=0).stop 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 -- 172.21.15.114:0/109029418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffabc0c2580 msgr2=0x7ffabc1ec140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffabc0c2580 0x7ffabc1ec140 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80ae040 tx=0x7ffaa80191b0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 -- 172.21.15.114:0/109029418 shutdown_connections 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffabc14f110 0x7ffabc1ec680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa9c066e40 0x7ffa9c069300 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffabc0c2580 0x7ffabc1ec140 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 --2- 172.21.15.114:0/109029418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffabc0c1eb0 0x7ffabc151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 -- 172.21.15.114:0/109029418 >> 172.21.15.114:0/109029418 conn(0x7ffabc0a8490 msgr2=0x7ffabc0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 -- 172.21.15.114:0/109029418 shutdown_connections 2024-02-17T12:18:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.260+0000 7ffac3e00640 1 -- 172.21.15.114:0/109029418 wait complete. 2024-02-17T12:18:51.285 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-02-17T12:18:51.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.416+0000 7f9029000640 1 Processor -- start 2024-02-17T12:18:51.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.416+0000 7f9029000640 1 -- start start 2024-02-17T12:18:51.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9029000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9024152c50 0x7f9024153070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9029000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024156270 con 0x7f90240c25a0 2024-02-17T12:18:51.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9029000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024156550 con 0x7f902406db50 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9029000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902406f090 con 0x7f9024152c50 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9021e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f90240c25a0 0x7f902406e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43232/0 (socket says 172.21.15.114:43232) 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9021e00640 1 -- 172.21.15.114:0/1461283622 learned_addr learned my addr 172.21.15.114:0/1461283622 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9022800640 1 --2- 172.21.15.114:0/1461283622 >> v2:172.21.15.116:3300/0 conn(0x7f9024152c50 0x7f9024153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33799319 0 0) 0x7f9024156270 con 0x7f90240c25a0 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9008003530 con 0x7f90240c25a0 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320506685 0 0) 0x7f9008003530 con 0x7f90240c25a0 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 >> v2:172.21.15.116:3300/0 conn(0x7f9024152c50 msgr2=0x7f9024153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 --2- 172.21.15.114:0/1461283622 >> v2:172.21.15.116:3300/0 conn(0x7f9024152c50 0x7f9024153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 >> v1:172.21.15.116:6789/0 conn(0x7f902406db50 legacy=0x7f902414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024156830 con 0x7f90240c25a0 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f9014001680 con 0x7f90240c25a0 2024-02-17T12:18:51.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 >> v1:172.21.15.114:6789/0 conn(0x7f90240c25a0 legacy=0x7f902406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9008003980 0x7f9008003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90080047d0 0x7f9008004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9008005190 0x7f900800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902406f090 con 0x7f90080047d0 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900800c0e0 con 0x7f9008005190 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900800c2a0 con 0x7f9008003980 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9021400640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90080047d0 0x7f9008004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9021e00640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9008003980 0x7f9008003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9022800640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9008005190 0x7f900800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9021400640 1 -- 172.21.15.114:0/1461283622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9008003980 msgr2=0x7f9008003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9021400640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9008003980 0x7f9008003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9021400640 1 -- 172.21.15.114:0/1461283622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9008005190 msgr2=0x7f900800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:51.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9021400640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9008005190 0x7f900800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9021400640 1 -- 172.21.15.114:0/1461283622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9008003530 con 0x7f90080047d0 2024-02-17T12:18:51.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.420+0000 7f9022800640 1 -- 172.21.15.114:0/1461283622 reap_dead start 2024-02-17T12:18:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9021400640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90080047d0 0x7f9008004c50 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9010001860 tx=0x7f901001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd29155953d05b4e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100ab600 con 0x7f90080047d0 2024-02-17T12:18:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90100a7050 con 0x7f90080047d0 2024-02-17T12:18:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9020a00640 1 -- 172.21.15.114:0/1461283622 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100ab9e0 con 0x7f90080047d0 2024-02-17T12:18:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9029000640 1 -- 172.21.15.114:0/1461283622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90080047d0 msgr2=0x7f9008004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9029000640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90080047d0 0x7f9008004c50 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9010001860 tx=0x7f901001c4e0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9029000640 1 -- 172.21.15.114:0/1461283622 shutdown_connections 2024-02-17T12:18:51.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9029000640 1 --2- 172.21.15.114:0/1461283622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90080047d0 0x7f9008004c50 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9029000640 1 -- 172.21.15.114:0/1461283622 >> 172.21.15.114:0/1461283622 conn(0x7f90240a8490 msgr2=0x7f90240a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:51.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9029000640 1 -- 172.21.15.114:0/1461283622 shutdown_connections 2024-02-17T12:18:51.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9029000640 1 -- 172.21.15.114:0/1461283622 wait complete. 2024-02-17T12:18:51.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.424+0000 7f9029000640 1 Processor -- start 2024-02-17T12:18:51.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9029000640 1 -- start start 2024-02-17T12:18:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9029000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90080047d0 0x7f9024148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9029000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90240c35c0 0x7f9024142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9029000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90240c4900 0x7f90241430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9029000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90241ee1b0 con 0x7f90240c35c0 2024-02-17T12:18:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9029000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90241ed530 con 0x7f90240c4900 2024-02-17T12:18:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9029000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90241ed810 con 0x7f90080047d0 2024-02-17T12:18:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9021400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90240c35c0 0x7f9024142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9021400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90240c35c0 0x7f9024142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48272/0 (socket says 172.21.15.114:48272) 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9021400640 1 -- 172.21.15.114:0/995534607 learned_addr learned my addr 172.21.15.114:0/995534607 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9022800640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90240c4900 0x7f90241430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9021e00640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90080047d0 0x7f9024148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9021400640 1 -- 172.21.15.114:0/995534607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90080047d0 msgr2=0x7f9024148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9021400640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90080047d0 0x7f9024148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9021400640 1 -- 172.21.15.114:0/995534607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90240c4900 msgr2=0x7f90241430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9021400640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90240c4900 0x7f90241430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9021400640 1 -- 172.21.15.114:0/995534607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90241edaf0 con 0x7f90240c35c0 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9022800640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90240c4900 0x7f90241430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9021400640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90240c35c0 0x7f9024142b70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f90100ae040 tx=0x7f9008005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f901a000640 1 -- 172.21.15.114:0/995534607 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9010007240 con 0x7f90240c35c0 2024-02-17T12:18:51.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f901a000640 1 -- 172.21.15.114:0/995534607 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90100073c0 con 0x7f90240c35c0 2024-02-17T12:18:51.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9029000640 1 -- 172.21.15.114:0/995534607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90241eddd0 con 0x7f90240c35c0 2024-02-17T12:18:51.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f901a000640 1 -- 172.21.15.114:0/995534607 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100b4400 con 0x7f90240c35c0 2024-02-17T12:18:51.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9029000640 1 -- 172.21.15.114:0/995534607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9024148bb0 con 0x7f90240c35c0 2024-02-17T12:18:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.428+0000 7f9029000640 1 -- 172.21.15.114:0/995534607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902406bba0 con 0x7f90240c35c0 2024-02-17T12:18:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.432+0000 7f901a000640 1 -- 172.21.15.114:0/995534607 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f90100b2040 con 0x7f90240c35c0 2024-02-17T12:18:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.432+0000 7f901a000640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9004066e40 0x7f9004069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.432+0000 7f901a000640 1 -- 172.21.15.114:0/995534607 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f901011e560 con 0x7f90240c35c0 2024-02-17T12:18:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.432+0000 7f9021e00640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9004066e40 0x7f9004069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.432+0000 7f9021e00640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9004066e40 0x7f9004069300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f90240c4560 tx=0x7f9014009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.436+0000 7f901a000640 1 -- 172.21.15.114:0/995534607 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f90100eb2e0 con 0x7f90240c35c0 2024-02-17T12:18:51.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.620+0000 7f9029000640 1 -- 172.21.15.114:0/995534607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f90241edf60 con 0x7f90240c35c0 2024-02-17T12:18:51.627 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-02-17T12:18:51.624+0000 7f5091a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-17T12:18:51.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.624+0000 7f901a000640 1 -- 172.21.15.114:0/995534607 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 163+0+0 (secure 0 0 0) 0x7f90100ee9a0 con 0x7f90240c35c0 2024-02-17T12:18:51.629 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-17T12:18:51.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 -- 172.21.15.114:0/995534607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9004066e40 msgr2=0x7f9004069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9004066e40 0x7f9004069300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f90240c4560 tx=0x7f9014009040 comp rx=0 tx=0).stop 2024-02-17T12:18:51.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 -- 172.21.15.114:0/995534607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90240c35c0 msgr2=0x7f9024142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90240c35c0 0x7f9024142b70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f90100ae040 tx=0x7f9008005800 comp rx=0 tx=0).stop 2024-02-17T12:18:51.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 -- 172.21.15.114:0/995534607 shutdown_connections 2024-02-17T12:18:51.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90240c4900 0x7f90241430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9004066e40 0x7f9004069300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90240c35c0 0x7f9024142b70 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 --2- 172.21.15.114:0/995534607 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90080047d0 0x7f9024148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 -- 172.21.15.114:0/995534607 >> 172.21.15.114:0/995534607 conn(0x7f90240a8490 msgr2=0x7f90240c1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:51.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 -- 172.21.15.114:0/995534607 shutdown_connections 2024-02-17T12:18:51.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.628+0000 7f9029000640 1 -- 172.21.15.114:0/995534607 wait complete. 2024-02-17T12:18:51.638 INFO:tasks.ceph.mds.c.smithi114.stderr: -2275> 2024-02-17T12:18:22.761+0000 7fe836e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:18:51.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-02-17T12:18:51.682 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-02-17T12:18:51.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.784+0000 7fe5d4a00640 1 Processor -- start 2024-02-17T12:18:51.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5d4a00640 1 -- start start 2024-02-17T12:18:51.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5d4a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe5d006db50 0x7fe5d014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5d4a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe5d0150490 0x7fe5d0152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5d4a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d0156270 con 0x7fe5d00c25a0 2024-02-17T12:18:51.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5d4a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d006f090 con 0x7fe5d0150490 2024-02-17T12:18:51.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5d4a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0071630 con 0x7fe5d006db50 2024-02-17T12:18:51.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5ce800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe5d0150490 0x7fe5d0152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5ce800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe5d0150490 0x7fe5d0152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48300/0 (socket says 172.21.15.114:48300) 2024-02-17T12:18:51.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5ce800640 1 -- 172.21.15.114:0/137354023 learned_addr learned my addr 172.21.15.114:0/137354023 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:51.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5cd400640 1 --2- 172.21.15.114:0/137354023 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe5d006db50 0x7fe5d014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5ce800640 1 -- 172.21.15.114:0/137354023 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe5d006db50 msgr2=0x7fe5d014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:51.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5ce800640 1 --2- 172.21.15.114:0/137354023 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe5d006db50 0x7fe5d014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5ce800640 1 -- 172.21.15.114:0/137354023 >> v1:172.21.15.116:6789/0 conn(0x7fe5d00c25a0 legacy=0x7fe5d006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.788+0000 7fe5ce800640 1 -- 172.21.15.114:0/137354023 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d0156550 con 0x7fe5d0150490 2024-02-17T12:18:51.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5ce800640 1 --2- 172.21.15.114:0/137354023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d0150490 0x7fe5d0152c50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009870 tx=0x7fe5c801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf06e2293dbb6da2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:51.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5cca00640 1 -- 172.21.15.114:0/137354023 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d01539a0 con 0x7fe5d0150490 2024-02-17T12:18:51.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5cca00640 1 -- 172.21.15.114:0/137354023 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c80ab610 con 0x7fe5d0150490 2024-02-17T12:18:51.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5cca00640 1 -- 172.21.15.114:0/137354023 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80ab9a0 con 0x7fe5d0150490 2024-02-17T12:18:51.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5d4a00640 1 -- 172.21.15.114:0/137354023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d0150490 msgr2=0x7fe5d0152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5d4a00640 1 --2- 172.21.15.114:0/137354023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d0150490 0x7fe5d0152c50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009870 tx=0x7fe5c801c410 comp rx=0 tx=0).stop 2024-02-17T12:18:51.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5d4a00640 1 -- 172.21.15.114:0/137354023 shutdown_connections 2024-02-17T12:18:51.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5d4a00640 1 --2- 172.21.15.114:0/137354023 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d0150490 0x7fe5d0152c50 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5d4a00640 1 --2- 172.21.15.114:0/137354023 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe5d006db50 0x7fe5d014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5d4a00640 1 -- 172.21.15.114:0/137354023 >> 172.21.15.114:0/137354023 conn(0x7fe5d00a8490 msgr2=0x7fe5d00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:51.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5d4a00640 1 -- 172.21.15.114:0/137354023 shutdown_connections 2024-02-17T12:18:51.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5d4a00640 1 -- 172.21.15.114:0/137354023 wait complete. 2024-02-17T12:18:51.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5d4a00640 1 Processor -- start 2024-02-17T12:18:51.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.792+0000 7fe5d4a00640 1 -- start start 2024-02-17T12:18:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5d4a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe5d006db50 0x7fe5d01552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5d4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d00c25a0 0x7fe5d013fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5d4a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5d0150490 0x7fe5d0140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5d4a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00c4b50 con 0x7fe5d00c25a0 2024-02-17T12:18:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5d4a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00c5970 con 0x7fe5d0150490 2024-02-17T12:18:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5d4a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00a8a40 con 0x7fe5d006db50 2024-02-17T12:18:51.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5cd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d00c25a0 0x7fe5d013fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5cd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d00c25a0 0x7fe5d013fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48306/0 (socket says 172.21.15.114:48306) 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5cd400640 1 -- 172.21.15.114:0/2727448281 learned_addr learned my addr 172.21.15.114:0/2727448281 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5ce800640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5d0150490 0x7fe5d0140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5cde00640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe5d006db50 0x7fe5d01552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5cd400640 1 -- 172.21.15.114:0/2727448281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe5d006db50 msgr2=0x7fe5d01552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5cd400640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe5d006db50 0x7fe5d01552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5cd400640 1 -- 172.21.15.114:0/2727448281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5d0150490 msgr2=0x7fe5d0140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5cd400640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5d0150490 0x7fe5d0140220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5cd400640 1 -- 172.21.15.114:0/2727448281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80094d0 con 0x7fe5d00c25a0 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5ce800640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5d0150490 0x7fe5d0140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5cd400640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d00c25a0 0x7fe5d013fce0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800e930 tx=0x7fe5b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5c6000640 1 -- 172.21.15.114:0/2727448281 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8009690 con 0x7fe5d00c25a0 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5c6000640 1 -- 172.21.15.114:0/2727448281 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b800ca00 con 0x7fe5d00c25a0 2024-02-17T12:18:51.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5d4a00640 1 -- 172.21.15.114:0/2727448281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d00c4d60 con 0x7fe5d00c25a0 2024-02-17T12:18:51.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5c6000640 1 -- 172.21.15.114:0/2727448281 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800cd70 con 0x7fe5d00c25a0 2024-02-17T12:18:51.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5d4a00640 1 -- 172.21.15.114:0/2727448281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d00c5320 con 0x7fe5d00c25a0 2024-02-17T12:18:51.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5d4a00640 1 -- 172.21.15.114:0/2727448281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d0141440 con 0x7fe5d00c25a0 2024-02-17T12:18:51.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.796+0000 7fe5c6000640 1 -- 172.21.15.114:0/2727448281 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe5b8013470 con 0x7fe5d00c25a0 2024-02-17T12:18:51.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.800+0000 7fe5c6000640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe5ac066e40 0x7fe5ac069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:51.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.800+0000 7fe5c6000640 1 -- 172.21.15.114:0/2727448281 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fe5b8084d80 con 0x7fe5d00c25a0 2024-02-17T12:18:51.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.800+0000 7fe5cde00640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe5ac066e40 0x7fe5ac069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:51.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.800+0000 7fe5cde00640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe5ac066e40 0x7fe5ac069300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0001d50 tx=0x7fe5c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:51.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.804+0000 7fe5c6000640 1 -- 172.21.15.114:0/2727448281 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe5b8051b70 con 0x7fe5d00c25a0 2024-02-17T12:18:51.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:51.988+0000 7fe5d4a00640 1 -- 172.21.15.114:0/2727448281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe5d0074840 con 0x7fe5d00c25a0 2024-02-17T12:18:52.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5c6000640 1 -- 172.21.15.114:0/2727448281 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe5b80170b0 con 0x7fe5d00c25a0 2024-02-17T12:18:52.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 -- 172.21.15.114:0/2727448281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe5ac066e40 msgr2=0x7fe5ac069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:52.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe5ac066e40 0x7fe5ac069300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0001d50 tx=0x7fe5c0009040 comp rx=0 tx=0).stop 2024-02-17T12:18:52.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 -- 172.21.15.114:0/2727448281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d00c25a0 msgr2=0x7fe5d013fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:52.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d00c25a0 0x7fe5d013fce0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800e930 tx=0x7fe5b800edf0 comp rx=0 tx=0).stop 2024-02-17T12:18:52.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 -- 172.21.15.114:0/2727448281 shutdown_connections 2024-02-17T12:18:52.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5d0150490 0x7fe5d0140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:52.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe5ac066e40 0x7fe5ac069300 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:52.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5d00c25a0 0x7fe5d013fce0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:52.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 --2- 172.21.15.114:0/2727448281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe5d006db50 0x7fe5d01552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:52.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 -- 172.21.15.114:0/2727448281 >> 172.21.15.114:0/2727448281 conn(0x7fe5d00a8490 msgr2=0x7fe5d01509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:52.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 -- 172.21.15.114:0/2727448281 shutdown_connections 2024-02-17T12:18:52.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.628+0000 7fe5d4a00640 1 -- 172.21.15.114:0/2727448281 wait complete. 2024-02-17T12:18:52.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-02-17T12:18:52.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76c400640 1 Processor -- start 2024-02-17T12:18:52.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76c400640 1 -- start start 2024-02-17T12:18:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76c400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc7640a6590 0x7fc76406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76c400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7641543a0 0x7fc764154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76c400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc764153640 con 0x7fc7640c38e0 2024-02-17T12:18:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76c400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7640c3cc0 con 0x7fc7640a6590 2024-02-17T12:18:52.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76c400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7641506a0 con 0x7fc7641543a0 2024-02-17T12:18:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76a400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7641543a0 0x7fc764154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc769000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc7640a6590 0x7fc76406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc769a00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc7640c38e0 0x7fc7640a6ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:41846/0 (socket says 172.21.15.114:41846) 2024-02-17T12:18:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76a400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7641543a0 0x7fc764154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:42772/0 (socket says 172.21.15.114:42772) 2024-02-17T12:18:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc769a00640 1 -- 172.21.15.114:0/3882291266 learned_addr learned my addr 172.21.15.114:0/3882291266 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76a400640 1 -- 172.21.15.114:0/3882291266 >> v2:172.21.15.116:3300/0 conn(0x7fc7640a6590 msgr2=0x7fc76406e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76a400640 1 --2- 172.21.15.114:0/3882291266 >> v2:172.21.15.116:3300/0 conn(0x7fc7640a6590 0x7fc76406e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:52.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76a400640 1 -- 172.21.15.114:0/3882291266 >> v1:172.21.15.116:6789/0 conn(0x7fc7640c38e0 legacy=0x7fc7640a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc76a400640 1 -- 172.21.15.114:0/3882291266 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764153b70 con 0x7fc7641543a0 2024-02-17T12:18:52.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.832+0000 7fc769000640 1 --2- 172.21.15.114:0/3882291266 >> v2:172.21.15.116:3300/0 conn(0x7fc7640a6590 0x7fc76406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:52.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc76a400640 1 --2- 172.21.15.114:0/3882291266 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7641543a0 0x7fc764154830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009d90 tx=0x7fc75c01c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2ffa8d6914f564d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:52.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc763e00640 1 -- 172.21.15.114:0/3882291266 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0a5800 con 0x7fc7641543a0 2024-02-17T12:18:52.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc763e00640 1 -- 172.21.15.114:0/3882291266 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c0a5960 con 0x7fc7641543a0 2024-02-17T12:18:52.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc763e00640 1 -- 172.21.15.114:0/3882291266 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0a5cf0 con 0x7fc7641543a0 2024-02-17T12:18:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc76c400640 1 -- 172.21.15.114:0/3882291266 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7641543a0 msgr2=0x7fc764154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc76c400640 1 --2- 172.21.15.114:0/3882291266 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7641543a0 0x7fc764154830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009d90 tx=0x7fc75c01c850 comp rx=0 tx=0).stop 2024-02-17T12:18:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc76c400640 1 -- 172.21.15.114:0/3882291266 shutdown_connections 2024-02-17T12:18:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc76c400640 1 --2- 172.21.15.114:0/3882291266 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7641543a0 0x7fc764154830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc76c400640 1 --2- 172.21.15.114:0/3882291266 >> v2:172.21.15.116:3300/0 conn(0x7fc7640a6590 0x7fc76406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc76c400640 1 -- 172.21.15.114:0/3882291266 >> 172.21.15.114:0/3882291266 conn(0x7fc76406b210 msgr2=0x7fc76406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc76c400640 1 -- 172.21.15.114:0/3882291266 shutdown_connections 2024-02-17T12:18:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.836+0000 7fc76c400640 1 -- 172.21.15.114:0/3882291266 wait complete. 2024-02-17T12:18:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76c400640 1 Processor -- start 2024-02-17T12:18:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76c400640 1 -- start start 2024-02-17T12:18:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76c400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7640a6590 0x7fc76415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76c400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7640c38e0 0x7fc7640c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7641543a0 0x7fc7640c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640c2010 con 0x7fc7641543a0 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76c400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640c1490 con 0x7fc7640c38e0 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76c400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640c5d90 con 0x7fc7640a6590 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7641543a0 0x7fc7640c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7641543a0 0x7fc7640c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48314/0 (socket says 172.21.15.114:48314) 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76a400640 1 -- 172.21.15.114:0/1361671034 learned_addr learned my addr 172.21.15.114:0/1361671034 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc769000640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7640c38e0 0x7fc7640c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc769a00640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7640a6590 0x7fc76415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76a400640 1 -- 172.21.15.114:0/1361671034 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7640a6590 msgr2=0x7fc76415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76a400640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7640a6590 0x7fc76415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76a400640 1 -- 172.21.15.114:0/1361671034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7640c38e0 msgr2=0x7fc7640c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76a400640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7640c38e0 0x7fc7640c5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76a400640 1 -- 172.21.15.114:0/1361671034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc750009420 con 0x7fc7641543a0 2024-02-17T12:18:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76a400640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7641543a0 0x7fc7640c5850 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0b0040 tx=0x7fc75c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc761600640 1 -- 172.21.15.114:0/1361671034 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0b9650 con 0x7fc7641543a0 2024-02-17T12:18:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc761600640 1 -- 172.21.15.114:0/1361671034 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c0b97b0 con 0x7fc7641543a0 2024-02-17T12:18:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76c400640 1 -- 172.21.15.114:0/1361671034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c009a70 con 0x7fc7641543a0 2024-02-17T12:18:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc761600640 1 -- 172.21.15.114:0/1361671034 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0b9ba0 con 0x7fc7641543a0 2024-02-17T12:18:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.840+0000 7fc76c400640 1 -- 172.21.15.114:0/1361671034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7640c19c0 con 0x7fc7641543a0 2024-02-17T12:18:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.844+0000 7fc76c400640 1 -- 172.21.15.114:0/1361671034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7640c21c0 con 0x7fc7641543a0 2024-02-17T12:18:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.844+0000 7fc761600640 1 -- 172.21.15.114:0/1361671034 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fc75c0b9d00 con 0x7fc7641543a0 2024-02-17T12:18:52.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.844+0000 7fc761600640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc744066e70 0x7fc744069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:52.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.844+0000 7fc761600640 1 -- 172.21.15.114:0/1361671034 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fc75c11fb60 con 0x7fc7641543a0 2024-02-17T12:18:52.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.844+0000 7fc769a00640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc744066e70 0x7fc744069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:52.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.844+0000 7fc769a00640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc744066e70 0x7fc744069330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc758000f70 tx=0x7fc758007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:52.848+0000 7fc761600640 1 -- 172.21.15.114:0/1361671034 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc7640c21c0 con 0x7fc7641543a0 2024-02-17T12:18:53.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.004+0000 7fc76c400640 1 -- 172.21.15.114:0/1361671034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7640c21c0 con 0x7fc7641543a0 2024-02-17T12:18:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.628+0000 7fc761600640 1 -- 172.21.15.114:0/1361671034 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v59) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc7640c21c0 con 0x7fc7641543a0 2024-02-17T12:18:53.633 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_metadata' removed 2024-02-17T12:18:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 -- 172.21.15.114:0/1361671034 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc744066e70 msgr2=0x7fc744069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc744066e70 0x7fc744069330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc758000f70 tx=0x7fc758007e90 comp rx=0 tx=0).stop 2024-02-17T12:18:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 -- 172.21.15.114:0/1361671034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7641543a0 msgr2=0x7fc7640c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7641543a0 0x7fc7640c5850 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0b0040 tx=0x7fc75c0195f0 comp rx=0 tx=0).stop 2024-02-17T12:18:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 -- 172.21.15.114:0/1361671034 shutdown_connections 2024-02-17T12:18:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc744066e70 0x7fc744069330 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7641543a0 0x7fc7640c5850 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7640c38e0 0x7fc7640c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 --2- 172.21.15.114:0/1361671034 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7640a6590 0x7fc76415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 -- 172.21.15.114:0/1361671034 >> 172.21.15.114:0/1361671034 conn(0x7fc76406b210 msgr2=0x7fc764151d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 -- 172.21.15.114:0/1361671034 shutdown_connections 2024-02-17T12:18:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.632+0000 7fc76c400640 1 -- 172.21.15.114:0/1361671034 wait complete. 2024-02-17T12:18:53.658 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-02-17T12:18:53.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.792+0000 7f8f0ca00640 1 Processor -- start 2024-02-17T12:18:53.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.792+0000 7f8f0ca00640 1 -- start start 2024-02-17T12:18:53.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.792+0000 7f8f0ca00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8f080c38e0 0x7f8f0806e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.792+0000 7f8f0ca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 0x7f8f080a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.792+0000 7f8f0ca00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f08153640 con 0x7f8f080a7020 2024-02-17T12:18:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.792+0000 7f8f0ca00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f080c3cc0 con 0x7f8f080c38e0 2024-02-17T12:18:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.792+0000 7f8f0ca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f081506a0 con 0x7f8f080a6590 2024-02-17T12:18:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.792+0000 7f8f05400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 0x7f8f080a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f05e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8f080c38e0 0x7f8f0806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f06800640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8f080a7020 0x7f8f081543a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:41852/0 (socket says 172.21.15.114:41852) 2024-02-17T12:18:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f06800640 1 -- 172.21.15.114:0/3596272224 learned_addr learned my addr 172.21.15.114:0/3596272224 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f04a00640 1 -- 172.21.15.114:0/3596272224 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205750887 0 0) 0x7f8f08153640 con 0x7f8f080a7020 2024-02-17T12:18:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f04a00640 1 -- 172.21.15.114:0/3596272224 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eec003530 con 0x7f8f080a7020 2024-02-17T12:18:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f05e00640 1 -- 172.21.15.114:0/3596272224 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 msgr2=0x7f8f080a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f05e00640 1 --2- 172.21.15.114:0/3596272224 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 0x7f8f080a6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f05e00640 1 -- 172.21.15.114:0/3596272224 >> v1:172.21.15.116:6789/0 conn(0x7f8f080a7020 legacy=0x7f8f081543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f05e00640 1 -- 172.21.15.114:0/3596272224 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f08153b70 con 0x7f8f080c38e0 2024-02-17T12:18:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f05e00640 1 --2- 172.21.15.114:0/3596272224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080c38e0 0x7f8f0806e860 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80097f0 tx=0x7f8ef801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=463cd2e2ed806d43 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f04a00640 1 -- 172.21.15.114:0/3596272224 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80ab600 con 0x7f8f080c38e0 2024-02-17T12:18:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f04a00640 1 -- 172.21.15.114:0/3596272224 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef80a7050 con 0x7f8f080c38e0 2024-02-17T12:18:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.796+0000 7f8f04a00640 1 -- 172.21.15.114:0/3596272224 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80ab960 con 0x7f8f080c38e0 2024-02-17T12:18:53.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 -- 172.21.15.114:0/3596272224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080c38e0 msgr2=0x7f8f0806e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:53.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 --2- 172.21.15.114:0/3596272224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080c38e0 0x7f8f0806e860 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80097f0 tx=0x7f8ef801c380 comp rx=0 tx=0).stop 2024-02-17T12:18:53.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 -- 172.21.15.114:0/3596272224 shutdown_connections 2024-02-17T12:18:53.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 --2- 172.21.15.114:0/3596272224 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 0x7f8f080a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:53.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 --2- 172.21.15.114:0/3596272224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080c38e0 0x7f8f0806e860 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:53.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 -- 172.21.15.114:0/3596272224 >> 172.21.15.114:0/3596272224 conn(0x7f8f0806b210 msgr2=0x7f8f0806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:53.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 -- 172.21.15.114:0/3596272224 shutdown_connections 2024-02-17T12:18:53.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 -- 172.21.15.114:0/3596272224 wait complete. 2024-02-17T12:18:53.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 Processor -- start 2024-02-17T12:18:53.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 -- start start 2024-02-17T12:18:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 0x7f8f08145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080a7020 0x7f8f080a9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f080c38e0 0x7f8f081ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080ab190 con 0x7f8f080c38e0 2024-02-17T12:18:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080aad70 con 0x7f8f080a7020 2024-02-17T12:18:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f0ca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08146050 con 0x7f8f080a6590 2024-02-17T12:18:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f05e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 0x7f8f08145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f05e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 0x7f8f08145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:42806/0 (socket says 172.21.15.114:42806) 2024-02-17T12:18:53.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f06800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f080c38e0 0x7f8f081ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:53.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f05e00640 1 -- 172.21.15.114:0/2587524884 learned_addr learned my addr 172.21.15.114:0/2587524884 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:53.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f05400640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080a7020 0x7f8f080a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:53.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f05e00640 1 -- 172.21.15.114:0/2587524884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080a7020 msgr2=0x7f8f080a9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:53.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f05e00640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080a7020 0x7f8f080a9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:53.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f05e00640 1 -- 172.21.15.114:0/2587524884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f080c38e0 msgr2=0x7f8f081ed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:53.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f05e00640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f080c38e0 0x7f8f081ed0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:53.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.800+0000 7f8f05e00640 1 -- 172.21.15.114:0/2587524884 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef8009420 con 0x7f8f080a6590 2024-02-17T12:18:53.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8f05e00640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 0x7f8f08145b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8019fb0 tx=0x7f8ef8019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:53.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8efe000640 1 -- 172.21.15.114:0/2587524884 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8003ab0 con 0x7f8f080a6590 2024-02-17T12:18:53.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8efe000640 1 -- 172.21.15.114:0/2587524884 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef8003c10 con 0x7f8f080a6590 2024-02-17T12:18:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8f0ca00640 1 -- 172.21.15.114:0/2587524884 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f080ab3c0 con 0x7f8f080a6590 2024-02-17T12:18:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8efe000640 1 -- 172.21.15.114:0/2587524884 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80b4430 con 0x7f8f080a6590 2024-02-17T12:18:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8f0ca00640 1 -- 172.21.15.114:0/2587524884 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f080ab980 con 0x7f8f080a6590 2024-02-17T12:18:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8f0ca00640 1 -- 172.21.15.114:0/2587524884 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f08074840 con 0x7f8f080a6590 2024-02-17T12:18:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8efe000640 1 -- 172.21.15.114:0/2587524884 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8ef80b2040 con 0x7f8f080a6590 2024-02-17T12:18:53.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8efe000640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee8066e70 0x7f8ee8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8efe000640 1 -- 172.21.15.114:0/2587524884 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f8ef811e090 con 0x7f8f080a6590 2024-02-17T12:18:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8f05400640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee8066e70 0x7f8ee8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:53.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.804+0000 7f8f05400640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee8066e70 0x7f8ee8069330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8f08156050 tx=0x7f8ef4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:53.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.812+0000 7f8efe000640 1 -- 172.21.15.114:0/2587524884 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8ef80eb020 con 0x7f8f080a6590 2024-02-17T12:18:53.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:53.964+0000 7f8f0ca00640 1 -- 172.21.15.114:0/2587524884 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f0806e640 con 0x7f8f080a6590 2024-02-17T12:18:54.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.636+0000 7f8efe000640 1 -- 172.21.15.114:0/2587524884 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v60) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8ef80ee6e0 con 0x7f8f080a6590 2024-02-17T12:18:54.640 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_data' removed 2024-02-17T12:18:54.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.636+0000 7f8f0ca00640 1 -- 172.21.15.114:0/2587524884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee8066e70 msgr2=0x7f8ee8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.636+0000 7f8f0ca00640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee8066e70 0x7f8ee8069330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8f08156050 tx=0x7f8ef4009190 comp rx=0 tx=0).stop 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.636+0000 7f8f0ca00640 1 -- 172.21.15.114:0/2587524884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 msgr2=0x7f8f08145b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.636+0000 7f8f0ca00640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 0x7f8f08145b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8019fb0 tx=0x7f8ef8019120 comp rx=0 tx=0).stop 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.640+0000 7f8f0ca00640 1 -- 172.21.15.114:0/2587524884 shutdown_connections 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.640+0000 7f8f0ca00640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ee8066e70 0x7f8ee8069330 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.640+0000 7f8f0ca00640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f080c38e0 0x7f8f081ed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.640+0000 7f8f0ca00640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f080a7020 0x7f8f080a9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.640+0000 7f8f0ca00640 1 --2- 172.21.15.114:0/2587524884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8f080a6590 0x7f8f08145b10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.640+0000 7f8f0ca00640 1 -- 172.21.15.114:0/2587524884 >> 172.21.15.114:0/2587524884 conn(0x7f8f0806b210 msgr2=0x7f8f0815c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.640+0000 7f8f0ca00640 1 -- 172.21.15.114:0/2587524884 shutdown_connections 2024-02-17T12:18:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.640+0000 7f8f0ca00640 1 -- 172.21.15.114:0/2587524884 wait complete. 2024-02-17T12:18:54.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-02-17T12:18:54.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8efa400640 1 Processor -- start 2024-02-17T12:18:54.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8efa400640 1 -- start start 2024-02-17T12:18:54.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8efa400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef414f110 0x7f8ef40c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:54.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8efa400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ef40c1eb0 0x7f8ef415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:54.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8efa400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef40a9420 con 0x7f8ef40c2580 2024-02-17T12:18:54.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8efa400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef414f4f0 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8efa400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40aae80 con 0x7f8ef414f110 2024-02-17T12:18:54.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8ef2a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8ef40c2580 0x7f8ef40aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43252/0 (socket says 172.21.15.114:43252) 2024-02-17T12:18:54.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8ef2a00640 1 -- 172.21.15.114:0/800137782 learned_addr learned my addr 172.21.15.114:0/800137782 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:54.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8ef3e00640 1 --2- 172.21.15.114:0/800137782 >> v2:172.21.15.114:3300/0 conn(0x7f8ef40c1eb0 0x7f8ef415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:54.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8ef3400640 1 --2- 172.21.15.114:0/800137782 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef414f110 0x7f8ef40c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:54.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8ef3e00640 1 -- 172.21.15.114:0/800137782 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef414f110 msgr2=0x7f8ef40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:54.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8ef3e00640 1 --2- 172.21.15.114:0/800137782 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef414f110 0x7f8ef40c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:54.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8ef3e00640 1 -- 172.21.15.114:0/800137782 >> v1:172.21.15.114:6789/0 conn(0x7f8ef40c2580 legacy=0x7f8ef40aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:54.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8ef3e00640 1 -- 172.21.15.114:0/800137782 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef4152850 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8ef3400640 1 --2- 172.21.15.114:0/800137782 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef414f110 0x7f8ef40c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:54.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.960+0000 7f8ef2000640 1 -- 172.21.15.114:0/800137782 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456487176 0 0) 0x7f8ef40a9420 con 0x7f8ef40c2580 2024-02-17T12:18:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8ef3e00640 1 --2- 172.21.15.114:0/800137782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 0x7f8ef415c390 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097c0 tx=0x7f8eec01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cf860e559799b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8ef2000640 1 -- 172.21.15.114:0/800137782 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0ac640 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8ef2000640 1 -- 172.21.15.114:0/800137782 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec0ac7a0 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8ef2000640 1 -- 172.21.15.114:0/800137782 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec0acb30 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8efa400640 1 -- 172.21.15.114:0/800137782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 msgr2=0x7f8ef415c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8efa400640 1 --2- 172.21.15.114:0/800137782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 0x7f8ef415c390 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097c0 tx=0x7f8eec01c3e0 comp rx=0 tx=0).stop 2024-02-17T12:18:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8efa400640 1 -- 172.21.15.114:0/800137782 shutdown_connections 2024-02-17T12:18:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8efa400640 1 --2- 172.21.15.114:0/800137782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 0x7f8ef415c390 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8efa400640 1 --2- 172.21.15.114:0/800137782 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef414f110 0x7f8ef40c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:54.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8efa400640 1 -- 172.21.15.114:0/800137782 >> 172.21.15.114:0/800137782 conn(0x7f8ef40a8490 msgr2=0x7f8ef40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:54.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8efa400640 1 -- 172.21.15.114:0/800137782 shutdown_connections 2024-02-17T12:18:54.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.964+0000 7f8efa400640 1 -- 172.21.15.114:0/800137782 wait complete. 2024-02-17T12:18:54.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 Processor -- start 2024-02-17T12:18:54.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 -- start start 2024-02-17T12:18:54.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 0x7f8ef4140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:54.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef40c2580 0x7f8ef4141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:54.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ef414f110 0x7f8ef414d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:54.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef414e6a0 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef41ec040 con 0x7f8ef414f110 2024-02-17T12:18:54.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef41ec320 con 0x7f8ef40c2580 2024-02-17T12:18:54.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 0x7f8ef4140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:54.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 0x7f8ef4140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48342/0 (socket says 172.21.15.114:48342) 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3400640 1 -- 172.21.15.114:0/74941448 learned_addr learned my addr 172.21.15.114:0/74941448 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3e00640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ef414f110 0x7f8ef414d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef2a00640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef40c2580 0x7f8ef4141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3400640 1 -- 172.21.15.114:0/74941448 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef40c2580 msgr2=0x7f8ef4141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3400640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef40c2580 0x7f8ef4141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3400640 1 -- 172.21.15.114:0/74941448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ef414f110 msgr2=0x7f8ef414d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3400640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ef414f110 0x7f8ef414d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3400640 1 -- 172.21.15.114:0/74941448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec009420 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3e00640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ef414f110 0x7f8ef414d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef2a00640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef40c2580 0x7f8ef4141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8ef3400640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 0x7f8ef4140930 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400cf60 tx=0x7f8ee400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8eeb400640 1 -- 172.21.15.114:0/74941448 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400d840 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8eeb400640 1 -- 172.21.15.114:0/74941448 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee400d9a0 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 -- 172.21.15.114:0/74941448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef414cac0 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8eeb400640 1 -- 172.21.15.114:0/74941448 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400dd30 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 -- 172.21.15.114:0/74941448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef4141c70 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.968+0000 7f8efa400640 1 -- 172.21.15.114:0/74941448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef414cfe0 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.972+0000 7f8eeb400640 1 -- 172.21.15.114:0/74941448 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8ee4015440 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.972+0000 7f8eeb400640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ed0066e40 0x7f8ed0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:54.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.972+0000 7f8eeb400640 1 -- 172.21.15.114:0/74941448 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8ee4085150 con 0x7f8ef40c1eb0 2024-02-17T12:18:54.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.972+0000 7f8ef2a00640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ed0066e40 0x7f8ed0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:54.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.972+0000 7f8ef2a00640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ed0066e40 0x7f8ed0069300 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8ef414e380 tx=0x7f8edc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:54.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:54.976+0000 7f8eeb400640 1 -- 172.21.15.114:0/74941448 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8ee4052280 con 0x7f8ef40c1eb0 2024-02-17T12:18:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.128+0000 7f8efa400640 1 -- 172.21.15.114:0/74941448 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8ef4074840 con 0x7f8ef40c1eb0 2024-02-17T12:18:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.132+0000 7f8eeb400640 1 -- 172.21.15.114:0/74941448 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8ee4055940 con 0x7f8ef40c1eb0 2024-02-17T12:18:55.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 -- 172.21.15.114:0/74941448 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ed0066e40 msgr2=0x7f8ed0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ed0066e40 0x7f8ed0069300 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8ef414e380 tx=0x7f8edc009040 comp rx=0 tx=0).stop 2024-02-17T12:18:55.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 -- 172.21.15.114:0/74941448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 msgr2=0x7f8ef4140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 0x7f8ef4140930 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400cf60 tx=0x7f8ee400cf90 comp rx=0 tx=0).stop 2024-02-17T12:18:55.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 -- 172.21.15.114:0/74941448 shutdown_connections 2024-02-17T12:18:55.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ef414f110 0x7f8ef414d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ef40c2580 0x7f8ef4141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ed0066e40 0x7f8ed0069300 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 --2- 172.21.15.114:0/74941448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40c1eb0 0x7f8ef4140930 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 -- 172.21.15.114:0/74941448 >> 172.21.15.114:0/74941448 conn(0x7f8ef40a8490 msgr2=0x7f8ef4151c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:55.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 -- 172.21.15.114:0/74941448 shutdown_connections 2024-02-17T12:18:55.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.136+0000 7f8efa400640 1 -- 172.21.15.114:0/74941448 wait complete. 2024-02-17T12:18:55.157 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2024-02-17T12:18:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.288+0000 7ffa35200640 1 Processor -- start 2024-02-17T12:18:55.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.288+0000 7ffa35200640 1 -- start start 2024-02-17T12:18:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.288+0000 7ffa35200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa300c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.288+0000 7ffa35200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ffa300c0640 0x7ffa3015f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.288+0000 7ffa35200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3006e890 con 0x7ffa3006ef60 2024-02-17T12:18:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.288+0000 7ffa35200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300c2670 con 0x7ffa300c0640 2024-02-17T12:18:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.288+0000 7ffa35200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30158370 con 0x7ffa30152510 2024-02-17T12:18:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2d400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffa3006ef60 0x7ffa30158800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56136/0 (socket says 172.21.15.114:56136) 2024-02-17T12:18:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2d400640 1 -- 172.21.15.114:0/2000717343 learned_addr learned my addr 172.21.15.114:0/2000717343 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2de00640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa300c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2e800640 1 --2- 172.21.15.114:0/2000717343 >> v2:172.21.15.116:3300/0 conn(0x7ffa300c0640 0x7ffa3015f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001806602 0 0) 0x7ffa3006e890 con 0x7ffa3006ef60 2024-02-17T12:18:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa14003530 con 0x7ffa3006ef60 2024-02-17T12:18:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4255744150 0 0) 0x7ffa14003530 con 0x7ffa3006ef60 2024-02-17T12:18:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 msgr2=0x7ffa300c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa300c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 >> v2:172.21.15.116:3300/0 conn(0x7ffa300c0640 msgr2=0x7ffa3015f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 --2- 172.21.15.114:0/2000717343 >> v2:172.21.15.116:3300/0 conn(0x7ffa300c0640 0x7ffa3015f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3006e5b0 con 0x7ffa3006ef60 2024-02-17T12:18:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7ffa1c001680 con 0x7ffa3006ef60 2024-02-17T12:18:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 >> v1:172.21.15.114:6789/0 conn(0x7ffa3006ef60 legacy=0x7ffa30158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa14003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa14003f50 0x7ffa140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa14004d10 0x7ffa14005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30158370 con 0x7ffa14004d10 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1400b9c0 con 0x7ffa14003f50 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1400bb80 con 0x7ffa30152510 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2e800640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa14004d10 0x7ffa14005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2de00640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa14003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2d400640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa14003f50 0x7ffa140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2e800640 1 -- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 msgr2=0x7ffa14003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2e800640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa30152510 0x7ffa14003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2e800640 1 -- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa14003f50 msgr2=0x7ffa140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2e800640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa14003f50 0x7ffa140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.292+0000 7ffa2e800640 1 -- 172.21.15.114:0/2000717343 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14003530 con 0x7ffa14004d10 2024-02-17T12:18:55.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa2e800640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa14004d10 0x7ffa14005190 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009fc0 tx=0x7ffa2801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef30fc81357f3ec server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280a5ca0 con 0x7ffa14004d10 2024-02-17T12:18:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2800f040 con 0x7ffa14004d10 2024-02-17T12:18:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa2ca00640 1 -- 172.21.15.114:0/2000717343 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280ad440 con 0x7ffa14004d10 2024-02-17T12:18:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 -- 172.21.15.114:0/2000717343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa14004d10 msgr2=0x7ffa14005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 --2- 172.21.15.114:0/2000717343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa14004d10 0x7ffa14005190 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009fc0 tx=0x7ffa2801cc90 comp rx=0 tx=0).stop 2024-02-17T12:18:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa2e800640 1 -- 172.21.15.114:0/2000717343 reap_dead start 2024-02-17T12:18:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 -- 172.21.15.114:0/2000717343 shutdown_connections 2024-02-17T12:18:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 -- 172.21.15.114:0/2000717343 >> 172.21.15.114:0/2000717343 conn(0x7ffa300a8490 msgr2=0x7ffa300a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 -- 172.21.15.114:0/2000717343 shutdown_connections 2024-02-17T12:18:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 -- 172.21.15.114:0/2000717343 wait complete. 2024-02-17T12:18:55.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 Processor -- start 2024-02-17T12:18:55.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 -- start start 2024-02-17T12:18:55.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa14004d10 0x7ffa30149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3014fd70 0x7ffa301e7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa301e7b50 0x7ffa301508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300c5c50 con 0x7ffa3014fd70 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30072cd0 con 0x7ffa14004d10 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa35200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa301ee970 con 0x7ffa301e7b50 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.296+0000 7ffa2d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3014fd70 0x7ffa301e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3014fd70 0x7ffa301e7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34372/0 (socket says 172.21.15.114:34372) 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2d400640 1 -- 172.21.15.114:0/2292428414 learned_addr learned my addr 172.21.15.114:0/2292428414 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2e800640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa301e7b50 0x7ffa301508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2de00640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa14004d10 0x7ffa30149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2d400640 1 -- 172.21.15.114:0/2292428414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa301e7b50 msgr2=0x7ffa301508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2d400640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa301e7b50 0x7ffa301508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2d400640 1 -- 172.21.15.114:0/2292428414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa14004d10 msgr2=0x7ffa30149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2d400640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa14004d10 0x7ffa30149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2d400640 1 -- 172.21.15.114:0/2292428414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa301edd60 con 0x7ffa3014fd70 2024-02-17T12:18:55.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2d400640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3014fd70 0x7ffa301e7610 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c011b80 tx=0x7ffa1c00f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:55.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa26000640 1 -- 172.21.15.114:0/2292428414 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00fe50 con 0x7ffa3014fd70 2024-02-17T12:18:55.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa26000640 1 -- 172.21.15.114:0/2292428414 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c011e80 con 0x7ffa3014fd70 2024-02-17T12:18:55.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa26000640 1 -- 172.21.15.114:0/2292428414 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c015650 con 0x7ffa3014fd70 2024-02-17T12:18:55.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa35200640 1 -- 172.21.15.114:0/2292428414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa301ee040 con 0x7ffa3014fd70 2024-02-17T12:18:55.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa35200640 1 -- 172.21.15.114:0/2292428414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa301ee600 con 0x7ffa3014fd70 2024-02-17T12:18:55.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa35200640 1 -- 172.21.15.114:0/2292428414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa30074840 con 0x7ffa3014fd70 2024-02-17T12:18:55.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa26000640 1 -- 172.21.15.114:0/2292428414 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ffa1c0157b0 con 0x7ffa3014fd70 2024-02-17T12:18:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa26000640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e70 0x7ffa10069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa26000640 1 -- 172.21.15.114:0/2292428414 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ffa1c087bf0 con 0x7ffa3014fd70 2024-02-17T12:18:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.300+0000 7ffa2de00640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e70 0x7ffa10069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.304+0000 7ffa2de00640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e70 0x7ffa10069330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009ae0 tx=0x7ffa20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:55.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.304+0000 7ffa26000640 1 -- 172.21.15.114:0/2292428414 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa1c054d50 con 0x7ffa3014fd70 2024-02-17T12:18:55.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.520+0000 7ffa35200640 1 -- 172.21.15.114:0/2292428414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7ffa30150640 con 0x7ffa3014fd70 2024-02-17T12:18:55.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.632+0000 7ffa26000640 1 -- 172.21.15.114:0/2292428414 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v169) v1 ==== 184+0+0 (secure 0 0 0) 0x7ffa1c058410 con 0x7ffa3014fd70 2024-02-17T12:18:55.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 -- 172.21.15.114:0/2292428414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e70 msgr2=0x7ffa10069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e70 0x7ffa10069330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009ae0 tx=0x7ffa20008040 comp rx=0 tx=0).stop 2024-02-17T12:18:55.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 -- 172.21.15.114:0/2292428414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3014fd70 msgr2=0x7ffa301e7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3014fd70 0x7ffa301e7610 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c011b80 tx=0x7ffa1c00f540 comp rx=0 tx=0).stop 2024-02-17T12:18:55.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 -- 172.21.15.114:0/2292428414 shutdown_connections 2024-02-17T12:18:55.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa301e7b50 0x7ffa301508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa10066e70 0x7ffa10069330 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3014fd70 0x7ffa301e7610 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 --2- 172.21.15.114:0/2292428414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa14004d10 0x7ffa30149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 -- 172.21.15.114:0/2292428414 >> 172.21.15.114:0/2292428414 conn(0x7ffa300a8490 msgr2=0x7ffa300c0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:55.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 -- 172.21.15.114:0/2292428414 shutdown_connections 2024-02-17T12:18:55.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.636+0000 7ffa35200640 1 -- 172.21.15.114:0/2292428414 wait complete. 2024-02-17T12:18:55.659 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2024-02-17T12:18:55.660 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-02-17T12:18:55.660 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:18:55.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff558600640 1 Processor -- start 2024-02-17T12:18:55.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff558600640 1 -- start start 2024-02-17T12:18:55.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff558600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff55006db50 0x7ff55014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff558600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff550150490 0x7ff550152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff558600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff550156270 con 0x7ff5500c25a0 2024-02-17T12:18:55.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff558600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55006f090 con 0x7ff55006db50 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff558600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff550071630 con 0x7ff550150490 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff555c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff5500c25a0 0x7ff55006e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56144/0 (socket says 172.21.15.114:56144) 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff555c00640 1 -- 172.21.15.114:0/2479939687 learned_addr learned my addr 172.21.15.114:0/2479939687 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff555200640 1 --2- 172.21.15.114:0/2479939687 >> v2:172.21.15.114:3300/0 conn(0x7ff55006db50 0x7ff55014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff556600640 1 --2- 172.21.15.114:0/2479939687 >> v2:172.21.15.116:3300/0 conn(0x7ff550150490 0x7ff550152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff54fe00640 1 -- 172.21.15.114:0/2479939687 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600877944 0 0) 0x7ff550156270 con 0x7ff5500c25a0 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff54fe00640 1 -- 172.21.15.114:0/2479939687 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff538003530 con 0x7ff5500c25a0 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff555200640 1 -- 172.21.15.114:0/2479939687 >> v2:172.21.15.116:3300/0 conn(0x7ff550150490 msgr2=0x7ff550152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff555200640 1 --2- 172.21.15.114:0/2479939687 >> v2:172.21.15.116:3300/0 conn(0x7ff550150490 0x7ff550152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff555200640 1 -- 172.21.15.114:0/2479939687 >> v1:172.21.15.114:6789/0 conn(0x7ff5500c25a0 legacy=0x7ff55006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.792+0000 7ff555200640 1 -- 172.21.15.114:0/2479939687 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff550156550 con 0x7ff55006db50 2024-02-17T12:18:55.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff555200640 1 --2- 172.21.15.114:0/2479939687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff55006db50 0x7ff55014ff50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff550153cb0 tx=0x7ff53c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb725a665356453 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:55.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff54fe00640 1 -- 172.21.15.114:0/2479939687 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5501539a0 con 0x7ff55006db50 2024-02-17T12:18:55.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff54fe00640 1 -- 172.21.15.114:0/2479939687 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c0a7050 con 0x7ff55006db50 2024-02-17T12:18:55.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff54fe00640 1 -- 172.21.15.114:0/2479939687 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0ab820 con 0x7ff55006db50 2024-02-17T12:18:55.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff558600640 1 -- 172.21.15.114:0/2479939687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff55006db50 msgr2=0x7ff55014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff558600640 1 --2- 172.21.15.114:0/2479939687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff55006db50 0x7ff55014ff50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ff550153cb0 tx=0x7ff53c01c360 comp rx=0 tx=0).stop 2024-02-17T12:18:55.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff558600640 1 -- 172.21.15.114:0/2479939687 shutdown_connections 2024-02-17T12:18:55.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff558600640 1 --2- 172.21.15.114:0/2479939687 >> v2:172.21.15.116:3300/0 conn(0x7ff550150490 0x7ff550152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff558600640 1 --2- 172.21.15.114:0/2479939687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff55006db50 0x7ff55014ff50 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff558600640 1 -- 172.21.15.114:0/2479939687 >> 172.21.15.114:0/2479939687 conn(0x7ff5500a8490 msgr2=0x7ff5500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:55.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff558600640 1 -- 172.21.15.114:0/2479939687 shutdown_connections 2024-02-17T12:18:55.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff558600640 1 -- 172.21.15.114:0/2479939687 wait complete. 2024-02-17T12:18:55.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff558600640 1 Processor -- start 2024-02-17T12:18:55.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.796+0000 7ff558600640 1 -- start start 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff558600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff55006db50 0x7ff5501ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff558600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5500c25a0 0x7ff550072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff558600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff550150490 0x7ff550144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff558600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501ee0b0 con 0x7ff550150490 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff558600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550142b70 con 0x7ff5500c25a0 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff558600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501ed5f0 con 0x7ff55006db50 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff556600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff550150490 0x7ff550144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff556600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff550150490 0x7ff550144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34388/0 (socket says 172.21.15.114:34388) 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff556600640 1 -- 172.21.15.114:0/1950401152 learned_addr learned my addr 172.21.15.114:0/1950401152 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff555200640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5500c25a0 0x7ff550072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff555c00640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff55006db50 0x7ff5501ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff556600640 1 -- 172.21.15.114:0/1950401152 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff55006db50 msgr2=0x7ff5501ed0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff556600640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff55006db50 0x7ff5501ed0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff556600640 1 -- 172.21.15.114:0/1950401152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5500c25a0 msgr2=0x7ff550072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff556600640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5500c25a0 0x7ff550072450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff556600640 1 -- 172.21.15.114:0/1950401152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c009420 con 0x7ff550150490 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff555c00640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff55006db50 0x7ff5501ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff556600640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff550150490 0x7ff550144450 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff54800efc0 tx=0x7ff54800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff54d600640 1 -- 172.21.15.114:0/1950401152 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548009ba0 con 0x7ff550150490 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff54d600640 1 -- 172.21.15.114:0/1950401152 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54800f040 con 0x7ff550150490 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff558600640 1 -- 172.21.15.114:0/1950401152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5501527f0 con 0x7ff550150490 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff54d600640 1 -- 172.21.15.114:0/1950401152 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480146c0 con 0x7ff550150490 2024-02-17T12:18:55.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff558600640 1 -- 172.21.15.114:0/1950401152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5501f1370 con 0x7ff550150490 2024-02-17T12:18:55.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff558600640 1 -- 172.21.15.114:0/1950401152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff550152980 con 0x7ff550150490 2024-02-17T12:18:55.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.800+0000 7ff54d600640 1 -- 172.21.15.114:0/1950401152 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff548014820 con 0x7ff550150490 2024-02-17T12:18:55.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.804+0000 7ff54d600640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff530066e70 0x7ff530069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:55.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.804+0000 7ff54d600640 1 -- 172.21.15.114:0/1950401152 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff5480851e0 con 0x7ff550150490 2024-02-17T12:18:55.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.804+0000 7ff555c00640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff530066e70 0x7ff530069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:55.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.804+0000 7ff555c00640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff530066e70 0x7ff530069330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff544005890 tx=0x7ff544009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:55.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.808+0000 7ff54d600640 1 -- 172.21.15.114:0/1950401152 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff548052260 con 0x7ff550150490 2024-02-17T12:18:55.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.960+0000 7ff558600640 1 -- 172.21.15.114:0/1950401152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff550074840 con 0x7ff550150490 2024-02-17T12:18:55.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff54d600640 1 -- 172.21.15.114:0/1950401152 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13165 (secure 0 0 0) 0x7ff548055920 con 0x7ff550150490 2024-02-17T12:18:55.966 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:55.967 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":60,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:54.632138+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6836/1690237872":"2024-02-18T12:18:51.626132+0000","172.21.15.114:6834/1690237872":"2024-02-18T12:18:51.626132+0000","172.21.15.114:6837/105000653":"2024-02-18T12:18:45.150507+0000","172.21.15.114:6835/105000653":"2024-02-18T12:18:45.150507+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 -- 172.21.15.114:0/1950401152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff530066e70 msgr2=0x7ff530069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff530066e70 0x7ff530069330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff544005890 tx=0x7ff544009040 comp rx=0 tx=0).stop 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 -- 172.21.15.114:0/1950401152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff550150490 msgr2=0x7ff550144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff550150490 0x7ff550144450 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff54800efc0 tx=0x7ff54800c490 comp rx=0 tx=0).stop 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 -- 172.21.15.114:0/1950401152 shutdown_connections 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff530066e70 0x7ff530069330 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff550150490 0x7ff550144450 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5500c25a0 0x7ff550072450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 --2- 172.21.15.114:0/1950401152 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff55006db50 0x7ff5501ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 -- 172.21.15.114:0/1950401152 >> 172.21.15.114:0/1950401152 conn(0x7ff5500a8490 msgr2=0x7ff5500bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 -- 172.21.15.114:0/1950401152 shutdown_connections 2024-02-17T12:18:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:55.964+0000 7ff558600640 1 -- 172.21.15.114:0/1950401152 wait complete. 2024-02-17T12:18:55.987 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:18:55.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:18:56.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.120+0000 7f9504e00640 1 Processor -- start 2024-02-17T12:18:56.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.120+0000 7f9504e00640 1 -- start start 2024-02-17T12:18:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.120+0000 7f9504e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f950014f110 0x7f95000c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.120+0000 7f9504e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f95000c1eb0 0x7f950015c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.120+0000 7f9504e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95000a9420 con 0x7f95000c2580 2024-02-17T12:18:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.120+0000 7f9504e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950014f4f0 con 0x7f950014f110 2024-02-17T12:18:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.120+0000 7f9504e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95000aae80 con 0x7f95000c1eb0 2024-02-17T12:18:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.120+0000 7f94fde00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f950014f110 0x7f95000c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.120+0000 7f94fde00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f950014f110 0x7f95000c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34396/0 (socket says 172.21.15.114:34396) 2024-02-17T12:18:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.120+0000 7f94fde00640 1 -- 172.21.15.114:0/2626971054 learned_addr learned my addr 172.21.15.114:0/2626971054 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f94fe800640 1 --2- 172.21.15.114:0/2626971054 >> v2:172.21.15.116:3300/0 conn(0x7f95000c1eb0 0x7f950015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f94fde00640 1 -- 172.21.15.114:0/2626971054 >> v2:172.21.15.116:3300/0 conn(0x7f95000c1eb0 msgr2=0x7f950015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f94fde00640 1 --2- 172.21.15.114:0/2626971054 >> v2:172.21.15.116:3300/0 conn(0x7f95000c1eb0 0x7f950015c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f94fde00640 1 -- 172.21.15.114:0/2626971054 >> v1:172.21.15.116:6789/0 conn(0x7f95000c2580 legacy=0x7f95000aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f94fde00640 1 -- 172.21.15.114:0/2626971054 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500152850 con 0x7f950014f110 2024-02-17T12:18:56.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f94fde00640 1 --2- 172.21.15.114:0/2626971054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950014f110 0x7f95000c65a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f950006ceb0 tx=0x7f94f001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bed73bfb4ea6cc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:56.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f94fca00640 1 -- 172.21.15.114:0/2626971054 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f00a57b0 con 0x7f950014f110 2024-02-17T12:18:56.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f94fca00640 1 -- 172.21.15.114:0/2626971054 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f00a5910 con 0x7f950014f110 2024-02-17T12:18:56.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f94fca00640 1 -- 172.21.15.114:0/2626971054 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f00a5ca0 con 0x7f950014f110 2024-02-17T12:18:56.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f9504e00640 1 -- 172.21.15.114:0/2626971054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950014f110 msgr2=0x7f95000c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:56.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f9504e00640 1 --2- 172.21.15.114:0/2626971054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950014f110 0x7f95000c65a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f950006ceb0 tx=0x7f94f001c8f0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f9504e00640 1 -- 172.21.15.114:0/2626971054 shutdown_connections 2024-02-17T12:18:56.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f9504e00640 1 --2- 172.21.15.114:0/2626971054 >> v2:172.21.15.116:3300/0 conn(0x7f95000c1eb0 0x7f950015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f9504e00640 1 --2- 172.21.15.114:0/2626971054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950014f110 0x7f95000c65a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.124+0000 7f9504e00640 1 -- 172.21.15.114:0/2626971054 >> 172.21.15.114:0/2626971054 conn(0x7f95000a8490 msgr2=0x7f95000a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 -- 172.21.15.114:0/2626971054 shutdown_connections 2024-02-17T12:18:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 -- 172.21.15.114:0/2626971054 wait complete. 2024-02-17T12:18:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 Processor -- start 2024-02-17T12:18:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 -- start start 2024-02-17T12:18:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f95000c1eb0 0x7f95001ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95000c2580 0x7f95001ef630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f950014f110 0x7f9500142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500142ed0 con 0x7f95000c2580 2024-02-17T12:18:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500141130 con 0x7f950014f110 2024-02-17T12:18:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95001efb70 con 0x7f95000c1eb0 2024-02-17T12:18:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fde00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f95000c1eb0 0x7f95001ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95000c2580 0x7f95001ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fde00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f95000c1eb0 0x7f95001ecb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:52118/0 (socket says 172.21.15.114:52118) 2024-02-17T12:18:56.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fe800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f950014f110 0x7f9500142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fde00640 1 -- 172.21.15.114:0/150850982 learned_addr learned my addr 172.21.15.114:0/150850982 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fd400640 1 -- 172.21.15.114:0/150850982 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f95000c1eb0 msgr2=0x7f95001ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fd400640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f95000c1eb0 0x7f95001ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fd400640 1 -- 172.21.15.114:0/150850982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f950014f110 msgr2=0x7f9500142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fd400640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f950014f110 0x7f9500142150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fd400640 1 -- 172.21.15.114:0/150850982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f0009b30 con 0x7f95000c2580 2024-02-17T12:18:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94fd400640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95000c2580 0x7f95001ef630 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f95000c29a0 tx=0x7f94e800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94f6000640 1 -- 172.21.15.114:0/150850982 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8011790 con 0x7f95000c2580 2024-02-17T12:18:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94f6000640 1 -- 172.21.15.114:0/150850982 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e80118f0 con 0x7f95000c2580 2024-02-17T12:18:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f9504e00640 1 -- 172.21.15.114:0/150850982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950014e800 con 0x7f95000c2580 2024-02-17T12:18:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.128+0000 7f94f6000640 1 -- 172.21.15.114:0/150850982 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8011ce0 con 0x7f95000c2580 2024-02-17T12:18:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.132+0000 7f9504e00640 1 -- 172.21.15.114:0/150850982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950014e0b0 con 0x7f95000c2580 2024-02-17T12:18:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.132+0000 7f9504e00640 1 -- 172.21.15.114:0/150850982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95001412c0 con 0x7f95000c2580 2024-02-17T12:18:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.132+0000 7f94f6000640 1 -- 172.21.15.114:0/150850982 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f94e801c460 con 0x7f95000c2580 2024-02-17T12:18:56.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.132+0000 7f94f6000640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e70 0x7f94dc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.132+0000 7f94f6000640 1 -- 172.21.15.114:0/150850982 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f94e8084410 con 0x7f95000c2580 2024-02-17T12:18:56.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.132+0000 7f94fde00640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e70 0x7f94dc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.132+0000 7f94fde00640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e70 0x7f94dc069330 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f94f0000f90 tx=0x7f94f00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.140+0000 7f94f6000640 1 -- 172.21.15.114:0/150850982 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94e80515e0 con 0x7f95000c2580 2024-02-17T12:18:56.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.300+0000 7f9504e00640 1 -- 172.21.15.114:0/150850982 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9500074840 con 0x7f95000c2580 2024-02-17T12:18:56.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.300+0000 7f94f6000640 1 -- 172.21.15.114:0/150850982 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94e8054ca0 con 0x7f95000c2580 2024-02-17T12:18:56.305 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:18:56.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 -- 172.21.15.114:0/150850982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e70 msgr2=0x7f94dc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:56.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e70 0x7f94dc069330 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f94f0000f90 tx=0x7f94f00a7070 comp rx=0 tx=0).stop 2024-02-17T12:18:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 -- 172.21.15.114:0/150850982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95000c2580 msgr2=0x7f95001ef630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95000c2580 0x7f95001ef630 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f95000c29a0 tx=0x7f94e800c870 comp rx=0 tx=0).stop 2024-02-17T12:18:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 -- 172.21.15.114:0/150850982 shutdown_connections 2024-02-17T12:18:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f950014f110 0x7f9500142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e70 0x7f94dc069330 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95000c2580 0x7f95001ef630 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 --2- 172.21.15.114:0/150850982 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f95000c1eb0 0x7f95001ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 -- 172.21.15.114:0/150850982 >> 172.21.15.114:0/150850982 conn(0x7f95000a8490 msgr2=0x7f95000aa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 -- 172.21.15.114:0/150850982 shutdown_connections 2024-02-17T12:18:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.304+0000 7f9504e00640 1 -- 172.21.15.114:0/150850982 wait complete. 2024-02-17T12:18:56.327 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2024-02-17T12:18:56.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.456+0000 7f3047c00640 1 Processor -- start 2024-02-17T12:18:56.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.456+0000 7f3047c00640 1 -- start start 2024-02-17T12:18:56.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3047c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c2580 0x7f30400aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3047c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f30400c1eb0 0x7f304015c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3047c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30400a9420 con 0x7f304014f110 2024-02-17T12:18:56.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3047c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304014f4f0 con 0x7f30400c1eb0 2024-02-17T12:18:56.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3047c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30400aae80 con 0x7f30400c2580 2024-02-17T12:18:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f303fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c2580 0x7f30400aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3045c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f30400c1eb0 0x7f304015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3045200640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f304014f110 0x7f30400c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:40448/0 (socket says 172.21.15.114:40448) 2024-02-17T12:18:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3045200640 1 -- 172.21.15.114:0/163841263 learned_addr learned my addr 172.21.15.114:0/163841263 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3045c00640 1 -- 172.21.15.114:0/163841263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c2580 msgr2=0x7f30400aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3045c00640 1 --2- 172.21.15.114:0/163841263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c2580 0x7f30400aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3045c00640 1 -- 172.21.15.114:0/163841263 >> v1:172.21.15.116:6789/0 conn(0x7f304014f110 legacy=0x7f30400c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f3045c00640 1 -- 172.21.15.114:0/163841263 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040152850 con 0x7f30400c1eb0 2024-02-17T12:18:56.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.460+0000 7f303fe00640 1 --2- 172.21.15.114:0/163841263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c2580 0x7f30400aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:18:56.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3045c00640 1 --2- 172.21.15.114:0/163841263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30400c1eb0 0x7f304015c390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3038009d90 tx=0x7f303801c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70a5294a13e0892e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:56.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f303f400640 1 -- 172.21.15.114:0/163841263 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30380a5970 con 0x7f30400c1eb0 2024-02-17T12:18:56.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f303f400640 1 -- 172.21.15.114:0/163841263 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30380a5ad0 con 0x7f30400c1eb0 2024-02-17T12:18:56.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f303f400640 1 -- 172.21.15.114:0/163841263 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30380a5e60 con 0x7f30400c1eb0 2024-02-17T12:18:56.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3047c00640 1 -- 172.21.15.114:0/163841263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30400c1eb0 msgr2=0x7f304015c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:56.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3047c00640 1 --2- 172.21.15.114:0/163841263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30400c1eb0 0x7f304015c390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3038009d90 tx=0x7f303801c8b0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3047c00640 1 -- 172.21.15.114:0/163841263 shutdown_connections 2024-02-17T12:18:56.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3047c00640 1 --2- 172.21.15.114:0/163841263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30400c1eb0 0x7f304015c390 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3047c00640 1 --2- 172.21.15.114:0/163841263 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c2580 0x7f30400aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3047c00640 1 -- 172.21.15.114:0/163841263 >> 172.21.15.114:0/163841263 conn(0x7f30400a8490 msgr2=0x7f30400a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:56.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3047c00640 1 -- 172.21.15.114:0/163841263 shutdown_connections 2024-02-17T12:18:56.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3047c00640 1 -- 172.21.15.114:0/163841263 wait complete. 2024-02-17T12:18:56.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3047c00640 1 Processor -- start 2024-02-17T12:18:56.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.464+0000 7f3047c00640 1 -- start start 2024-02-17T12:18:56.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3047c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c1eb0 0x7f304014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3047c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30400c2580 0x7f3040151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3047c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f304014f110 0x7f3040151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3047c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3040151ab0 con 0x7f304014f110 2024-02-17T12:18:56.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3047c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30400c5210 con 0x7f30400c2580 2024-02-17T12:18:56.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3047c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3040140d20 con 0x7f30400c1eb0 2024-02-17T12:18:56.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f304014f110 0x7f3040151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f304014f110 0x7f3040151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34416/0 (socket says 172.21.15.114:34416) 2024-02-17T12:18:56.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045c00640 1 -- 172.21.15.114:0/1111340570 learned_addr learned my addr 172.21.15.114:0/1111340570 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:56.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045200640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c1eb0 0x7f304014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f303fe00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30400c2580 0x7f3040151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045c00640 1 -- 172.21.15.114:0/1111340570 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c1eb0 msgr2=0x7f304014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:56.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045c00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c1eb0 0x7f304014d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045c00640 1 -- 172.21.15.114:0/1111340570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30400c2580 msgr2=0x7f3040151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:56.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045c00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30400c2580 0x7f3040151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:56.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045c00640 1 -- 172.21.15.114:0/1111340570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028009420 con 0x7f304014f110 2024-02-17T12:18:56.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045200640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c1eb0 0x7f304014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:56.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3045c00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f304014f110 0x7f3040151570 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f30380b0040 tx=0x7f3038019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:56.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f303cc00640 1 -- 172.21.15.114:0/1111340570 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30380add90 con 0x7f304014f110 2024-02-17T12:18:56.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f303cc00640 1 -- 172.21.15.114:0/1111340570 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3038009450 con 0x7f304014f110 2024-02-17T12:18:56.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f303cc00640 1 -- 172.21.15.114:0/1111340570 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30380b9690 con 0x7f304014f110 2024-02-17T12:18:56.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3047c00640 1 -- 172.21.15.114:0/1111340570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3038009a70 con 0x7f304014f110 2024-02-17T12:18:56.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3047c00640 1 -- 172.21.15.114:0/1111340570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30400c5740 con 0x7f304014f110 2024-02-17T12:18:56.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f3047c00640 1 -- 172.21.15.114:0/1111340570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3040074840 con 0x7f304014f110 2024-02-17T12:18:56.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.468+0000 7f303cc00640 1 -- 172.21.15.114:0/1111340570 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f30380b97f0 con 0x7f304014f110 2024-02-17T12:18:56.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.472+0000 7f303cc00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f301c066e40 0x7f301c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:56.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.472+0000 7f303cc00640 1 -- 172.21.15.114:0/1111340570 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3038120070 con 0x7f304014f110 2024-02-17T12:18:56.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.472+0000 7f3045200640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f301c066e40 0x7f301c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:56.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.472+0000 7f3045200640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f301c066e40 0x7f301c069300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3030000f70 tx=0x7f3030009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:56.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.476+0000 7f303cc00640 1 -- 172.21.15.114:0/1111340570 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f30380ed060 con 0x7f304014f110 2024-02-17T12:18:56.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:56.684+0000 7f3047c00640 1 -- 172.21.15.114:0/1111340570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f304006f1a0 con 0x7f304014f110 2024-02-17T12:18:57.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.640+0000 7f303cc00640 1 -- 172.21.15.114:0/1111340570 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v171) v1 ==== 162+0+0 (secure 0 0 0) 0x7f30380f0720 con 0x7f304014f110 2024-02-17T12:18:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 -- 172.21.15.114:0/1111340570 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f301c066e40 msgr2=0x7f301c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f301c066e40 0x7f301c069300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3030000f70 tx=0x7f3030009040 comp rx=0 tx=0).stop 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 -- 172.21.15.114:0/1111340570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f304014f110 msgr2=0x7f3040151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f304014f110 0x7f3040151570 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f30380b0040 tx=0x7f3038019650 comp rx=0 tx=0).stop 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 -- 172.21.15.114:0/1111340570 shutdown_connections 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f301c066e40 0x7f301c069300 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f304014f110 0x7f3040151570 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30400c2580 0x7f3040151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 --2- 172.21.15.114:0/1111340570 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30400c1eb0 0x7f304014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 -- 172.21.15.114:0/1111340570 >> 172.21.15.114:0/1111340570 conn(0x7f30400a8490 msgr2=0x7f30400c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 -- 172.21.15.114:0/1111340570 shutdown_connections 2024-02-17T12:18:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.644+0000 7f3047c00640 1 -- 172.21.15.114:0/1111340570 wait complete. 2024-02-17T12:18:57.673 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-02-17T12:18:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.808+0000 7fd259200640 1 Processor -- start 2024-02-17T12:18:57.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.808+0000 7fd259200640 1 -- start start 2024-02-17T12:18:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd259200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd2540c25a0 0x7fd25406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd259200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd254152c50 0x7fd2541530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd259200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd254156270 con 0x7fd25406db50 2024-02-17T12:18:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd259200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd254071630 con 0x7fd2540c25a0 2024-02-17T12:18:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd259200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd254156550 con 0x7fd254152c50 2024-02-17T12:18:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd251400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd25406db50 0x7fd25414ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56150/0 (socket says 172.21.15.114:56150) 2024-02-17T12:18:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd251400640 1 -- 172.21.15.114:0/805632752 learned_addr learned my addr 172.21.15.114:0/805632752 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd252800640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd254152c50 0x7fd2541530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd251e00640 1 --2- 172.21.15.114:0/805632752 >> v2:172.21.15.116:3300/0 conn(0x7fd2540c25a0 0x7fd25406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276828943 0 0) 0x7fd254156270 con 0x7fd25406db50 2024-02-17T12:18:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd238003530 con 0x7fd25406db50 2024-02-17T12:18:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3072993692 0 0) 0x7fd238003530 con 0x7fd25406db50 2024-02-17T12:18:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd254152c50 msgr2=0x7fd2541530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd254152c50 0x7fd2541530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 >> v2:172.21.15.116:3300/0 conn(0x7fd2540c25a0 msgr2=0x7fd25406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 --2- 172.21.15.114:0/805632752 >> v2:172.21.15.116:3300/0 conn(0x7fd2540c25a0 0x7fd25406e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd254156830 con 0x7fd25406db50 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fd2400016a0 con 0x7fd25406db50 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 >> v1:172.21.15.114:6789/0 conn(0x7fd25406db50 legacy=0x7fd25414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd254152c50 0x7fd238003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd238003f00 0x7fd2380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd238004d10 0x7fd238005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd254156550 con 0x7fd238003f00 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23800b9f0 con 0x7fd238004d10 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23800bbb0 con 0x7fd254152c50 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd251400640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd238003f00 0x7fd2380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd251e00640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd254152c50 0x7fd238003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd252800640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd238004d10 0x7fd238005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd251400640 1 -- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd254152c50 msgr2=0x7fd238003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd251400640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd254152c50 0x7fd238003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd251400640 1 -- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd238004d10 msgr2=0x7fd238005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:18:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd251400640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd238004d10 0x7fd238005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.812+0000 7fd251400640 1 -- 172.21.15.114:0/805632752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd238003530 con 0x7fd238003f00 2024-02-17T12:18:57.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd251400640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd238003f00 0x7fd2380047d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd254153ce0 tx=0x7fd24001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e152f30a970b9c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:57.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400058e0 con 0x7fd238003f00 2024-02-17T12:18:57.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240005a40 con 0x7fd238003f00 2024-02-17T12:18:57.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd250a00640 1 -- 172.21.15.114:0/805632752 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240005df0 con 0x7fd238003f00 2024-02-17T12:18:57.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd259200640 1 -- 172.21.15.114:0/805632752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd238003f00 msgr2=0x7fd2380047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:57.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd259200640 1 --2- 172.21.15.114:0/805632752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd238003f00 0x7fd2380047d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd254153ce0 tx=0x7fd24001c950 comp rx=0 tx=0).stop 2024-02-17T12:18:57.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd252800640 1 -- 172.21.15.114:0/805632752 reap_dead start 2024-02-17T12:18:57.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd259200640 1 -- 172.21.15.114:0/805632752 shutdown_connections 2024-02-17T12:18:57.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd259200640 1 -- 172.21.15.114:0/805632752 >> 172.21.15.114:0/805632752 conn(0x7fd2540a8490 msgr2=0x7fd2540a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:57.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd259200640 1 -- 172.21.15.114:0/805632752 shutdown_connections 2024-02-17T12:18:57.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd259200640 1 -- 172.21.15.114:0/805632752 wait complete. 2024-02-17T12:18:57.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd259200640 1 Processor -- start 2024-02-17T12:18:57.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.816+0000 7fd259200640 1 -- start start 2024-02-17T12:18:57.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd259200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd238003f00 0x7fd254152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:57.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd259200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2541f0780 0x7fd254151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:57.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd259200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd25414f9b0 0x7fd25414fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:57.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd259200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2541f0c10 con 0x7fd2541f0780 2024-02-17T12:18:57.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd259200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2541f0ef0 con 0x7fd238003f00 2024-02-17T12:18:57.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd259200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2541f11d0 con 0x7fd25414f9b0 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2541f0780 0x7fd254151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2541f0780 0x7fd254151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34426/0 (socket says 172.21.15.114:34426) 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251400640 1 -- 172.21.15.114:0/741705209 learned_addr learned my addr 172.21.15.114:0/741705209 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251e00640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd238003f00 0x7fd254152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd252800640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd25414f9b0 0x7fd25414fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251400640 1 -- 172.21.15.114:0/741705209 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd25414f9b0 msgr2=0x7fd25414fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251400640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd25414f9b0 0x7fd25414fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251400640 1 -- 172.21.15.114:0/741705209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd238003f00 msgr2=0x7fd254152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251400640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd238003f00 0x7fd254152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251400640 1 -- 172.21.15.114:0/741705209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2541f14b0 con 0x7fd2541f0780 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251e00640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd238003f00 0x7fd254152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:57.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd252800640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd25414f9b0 0x7fd25414fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:57.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd251400640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2541f0780 0x7fd254151470 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd240007040 tx=0x7fd238005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:57.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd24a000640 1 -- 172.21.15.114:0/741705209 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400047f0 con 0x7fd2541f0780 2024-02-17T12:18:57.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd24a000640 1 -- 172.21.15.114:0/741705209 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240004950 con 0x7fd2541f0780 2024-02-17T12:18:57.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd259200640 1 -- 172.21.15.114:0/741705209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2541529a0 con 0x7fd2541f0780 2024-02-17T12:18:57.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd24a000640 1 -- 172.21.15.114:0/741705209 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240004d00 con 0x7fd2541f0780 2024-02-17T12:18:57.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd259200640 1 -- 172.21.15.114:0/741705209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2541519b0 con 0x7fd2541f0780 2024-02-17T12:18:57.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd259200640 1 -- 172.21.15.114:0/741705209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd254151ba0 con 0x7fd2541f0780 2024-02-17T12:18:57.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.820+0000 7fd24a000640 1 -- 172.21.15.114:0/741705209 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd240007070 con 0x7fd2541f0780 2024-02-17T12:18:57.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.824+0000 7fd24a000640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd234066e40 0x7fd234069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:57.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.824+0000 7fd24a000640 1 -- 172.21.15.114:0/741705209 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd24011df20 con 0x7fd2541f0780 2024-02-17T12:18:57.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.824+0000 7fd251e00640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd234066e40 0x7fd234069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:57.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.824+0000 7fd251e00640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd234066e40 0x7fd234069300 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd244009be0 tx=0x7fd244008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:57.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.828+0000 7fd24a000640 1 -- 172.21.15.114:0/741705209 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd2400eafa0 con 0x7fd2541f0780 2024-02-17T12:18:57.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.980+0000 7fd259200640 1 -- 172.21.15.114:0/741705209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd254074840 con 0x7fd2541f0780 2024-02-17T12:18:57.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd24a000640 1 -- 172.21.15.114:0/741705209 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd240004e60 con 0x7fd2541f0780 2024-02-17T12:18:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 -- 172.21.15.114:0/741705209 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd234066e40 msgr2=0x7fd234069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd234066e40 0x7fd234069300 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd244009be0 tx=0x7fd244008040 comp rx=0 tx=0).stop 2024-02-17T12:18:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 -- 172.21.15.114:0/741705209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2541f0780 msgr2=0x7fd254151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:57.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2541f0780 0x7fd254151470 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd240007040 tx=0x7fd238005800 comp rx=0 tx=0).stop 2024-02-17T12:18:57.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 -- 172.21.15.114:0/741705209 shutdown_connections 2024-02-17T12:18:57.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd25414f9b0 0x7fd25414fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd234066e40 0x7fd234069300 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2541f0780 0x7fd254151470 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 --2- 172.21.15.114:0/741705209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd238003f00 0x7fd254152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:57.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 -- 172.21.15.114:0/741705209 >> 172.21.15.114:0/741705209 conn(0x7fd2540a8490 msgr2=0x7fd2540c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:57.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 -- 172.21.15.114:0/741705209 shutdown_connections 2024-02-17T12:18:57.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:57.984+0000 7fd259200640 1 -- 172.21.15.114:0/741705209 wait complete. 2024-02-17T12:18:58.009 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-17T12:18:58.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:18:58.061 DEBUG:teuthology.orchestra.run.smithi116:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:18:58.149 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-17T12:18:58.149 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:18:58.149 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:58.158 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354568k,nr_inodes=4088642,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2004 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-17T12:18:58.158 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:18:58.158 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:18:58.168 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3897 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-02-17T12:18:58.168 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-02-17T12:18:58.168 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:18:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.332+0000 7f5659200640 1 Processor -- start 2024-02-17T12:18:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.332+0000 7f5659200640 1 -- start start 2024-02-17T12:18:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5659200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5654152c50 0x7f5654153070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5659200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5654156270 con 0x7f56540c25a0 2024-02-17T12:18:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5659200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5654156550 con 0x7f565406db50 2024-02-17T12:18:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5659200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565406f090 con 0x7f5654152c50 2024-02-17T12:18:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5651e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f56540c25a0 0x7f565406e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56152/0 (socket says 172.21.15.114:56152) 2024-02-17T12:18:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5651e00640 1 -- 172.21.15.114:0/3383507116 learned_addr learned my addr 172.21.15.114:0/3383507116 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5652800640 1 --2- 172.21.15.114:0/3383507116 >> v2:172.21.15.116:3300/0 conn(0x7f5654152c50 0x7f5654153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5650a00640 1 -- 172.21.15.114:0/3383507116 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905902932 0 0) 0x7f5654156270 con 0x7f56540c25a0 2024-02-17T12:18:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5650a00640 1 -- 172.21.15.114:0/3383507116 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5638003530 con 0x7f56540c25a0 2024-02-17T12:18:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5650a00640 1 -- 172.21.15.114:0/3383507116 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934714111 0 0) 0x7f5654156550 con 0x7f565406db50 2024-02-17T12:18:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5650a00640 1 -- 172.21.15.114:0/3383507116 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5654156270 con 0x7f565406db50 2024-02-17T12:18:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5650a00640 1 -- 172.21.15.114:0/3383507116 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1984946198 0 0) 0x7f5638003530 con 0x7f56540c25a0 2024-02-17T12:18:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5652800640 1 -- 172.21.15.114:0/3383507116 >> v1:172.21.15.116:6789/0 conn(0x7f565406db50 legacy=0x7f565414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5652800640 1 -- 172.21.15.114:0/3383507116 >> v1:172.21.15.114:6789/0 conn(0x7f56540c25a0 legacy=0x7f565406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.336+0000 7f5652800640 1 -- 172.21.15.114:0/3383507116 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5654156830 con 0x7f5654152c50 2024-02-17T12:18:58.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5652800640 1 --2- 172.21.15.114:0/3383507116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5654152c50 0x7f5654153070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f564c009d90 tx=0x7f564c01c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64d447984601299b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5650a00640 1 -- 172.21.15.114:0/3383507116 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5644001680 con 0x7f5654152c50 2024-02-17T12:18:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5650a00640 1 -- 172.21.15.114:0/3383507116 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c0a8420 con 0x7f5654152c50 2024-02-17T12:18:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5650a00640 1 -- 172.21.15.114:0/3383507116 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c0a87b0 con 0x7f5654152c50 2024-02-17T12:18:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 -- 172.21.15.114:0/3383507116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5654152c50 msgr2=0x7f5654153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 --2- 172.21.15.114:0/3383507116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5654152c50 0x7f5654153070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f564c009d90 tx=0x7f564c01c770 comp rx=0 tx=0).stop 2024-02-17T12:18:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 -- 172.21.15.114:0/3383507116 shutdown_connections 2024-02-17T12:18:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 --2- 172.21.15.114:0/3383507116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5654152c50 0x7f5654153070 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 -- 172.21.15.114:0/3383507116 >> 172.21.15.114:0/3383507116 conn(0x7f56540a8490 msgr2=0x7f56540a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 -- 172.21.15.114:0/3383507116 shutdown_connections 2024-02-17T12:18:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 -- 172.21.15.114:0/3383507116 wait complete. 2024-02-17T12:18:58.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 Processor -- start 2024-02-17T12:18:58.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 -- start start 2024-02-17T12:18:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f565406db50 0x7f565413dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56540c25a0 0x7f565413b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5654152c50 0x7f56541ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565413e820 con 0x7f5654152c50 2024-02-17T12:18:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56541f0ad0 con 0x7f56540c25a0 2024-02-17T12:18:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5659200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56541f0d20 con 0x7f565406db50 2024-02-17T12:18:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.340+0000 7f5652800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5654152c50 0x7f56541ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5652800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5654152c50 0x7f56541ed7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34438/0 (socket says 172.21.15.114:34438) 2024-02-17T12:18:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5652800640 1 -- 172.21.15.114:0/2100914277 learned_addr learned my addr 172.21.15.114:0/2100914277 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5651400640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56540c25a0 0x7f565413b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5651e00640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f565406db50 0x7f565413dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5652800640 1 -- 172.21.15.114:0/2100914277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f565406db50 msgr2=0x7f565413dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5652800640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f565406db50 0x7f565413dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5652800640 1 -- 172.21.15.114:0/2100914277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56540c25a0 msgr2=0x7f565413b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5652800640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56540c25a0 0x7f565413b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5652800640 1 -- 172.21.15.114:0/2100914277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c009a70 con 0x7f5654152c50 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5651e00640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f565406db50 0x7f565413dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5652800640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5654152c50 0x7f56541ed7d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f564c01a3a0 tx=0x7f564c019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f564a000640 1 -- 172.21.15.114:0/2100914277 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c0b6070 con 0x7f5654152c50 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f564a000640 1 -- 172.21.15.114:0/2100914277 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c009450 con 0x7f5654152c50 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f564a000640 1 -- 172.21.15.114:0/2100914277 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c003be0 con 0x7f5654152c50 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5659200640 1 -- 172.21.15.114:0/2100914277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56541f1000 con 0x7f5654152c50 2024-02-17T12:18:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5659200640 1 -- 172.21.15.114:0/2100914277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56541f15c0 con 0x7f5654152c50 2024-02-17T12:18:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f5659200640 1 -- 172.21.15.114:0/2100914277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56541ed560 con 0x7f5654152c50 2024-02-17T12:18:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.344+0000 7f564a000640 1 -- 172.21.15.114:0/2100914277 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f564c004030 con 0x7f5654152c50 2024-02-17T12:18:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.348+0000 7f564a000640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5634066e40 0x7f5634069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.348+0000 7f564a000640 1 -- 172.21.15.114:0/2100914277 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f564c11eeb0 con 0x7f5654152c50 2024-02-17T12:18:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.348+0000 7f5651e00640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5634066e40 0x7f5634069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.348+0000 7f5651e00640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5634066e40 0x7f5634069300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5644001ec0 tx=0x7f5644009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.352+0000 7f564a000640 1 -- 172.21.15.114:0/2100914277 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f564c0ebfd0 con 0x7f5654152c50 2024-02-17T12:18:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.536+0000 7f5659200640 1 -- 172.21.15.114:0/2100914277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5654074840 con 0x7f5654152c50 2024-02-17T12:18:58.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.536+0000 7f564a000640 1 -- 172.21.15.114:0/2100914277 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f564c0ef690 con 0x7f5654152c50 2024-02-17T12:18:58.544 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:18:58.544 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5207,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/2685641040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":2685641040},{"type":"v1","addr":"172.21.15.116:6835","nonce":2685641040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/798666397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":798666397},{"type":"v1","addr":"172.21.15.116:6834","nonce":798666397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6333,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3719530640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3719530640},{"type":"v1","addr":"172.21.15.114:6837","nonce":3719530640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6432,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2652252794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2652252794},{"type":"v1","addr":"172.21.15.114:6836","nonce":2652252794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[]} 2024-02-17T12:18:58.545 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 42 2024-02-17T12:18:58.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 -- 172.21.15.114:0/2100914277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5634066e40 msgr2=0x7f5634069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5634066e40 0x7f5634069300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5644001ec0 tx=0x7f5644009040 comp rx=0 tx=0).stop 2024-02-17T12:18:58.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 -- 172.21.15.114:0/2100914277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5654152c50 msgr2=0x7f56541ed7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5654152c50 0x7f56541ed7d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f564c01a3a0 tx=0x7f564c019510 comp rx=0 tx=0).stop 2024-02-17T12:18:58.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 -- 172.21.15.114:0/2100914277 shutdown_connections 2024-02-17T12:18:58.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5634066e40 0x7f5634069300 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5654152c50 0x7f56541ed7d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56540c25a0 0x7f565413b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 --2- 172.21.15.114:0/2100914277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f565406db50 0x7f565413dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 -- 172.21.15.114:0/2100914277 >> 172.21.15.114:0/2100914277 conn(0x7f56540a8490 msgr2=0x7f56540bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:58.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 -- 172.21.15.114:0/2100914277 shutdown_connections 2024-02-17T12:18:58.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.540+0000 7f5659200640 1 -- 172.21.15.114:0/2100914277 wait complete. 2024-02-17T12:18:58.563 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-17T12:18:58.564 INFO:tasks.ceph.mds.a:Stopping old one... 2024-02-17T12:18:58.565 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-17T12:18:58.565 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:18:58.565 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-17T12:18:58.565 INFO:tasks.ceph.mds.c:Stopping old one... 2024-02-17T12:18:58.565 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-17T12:18:58.565 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:18:58.565 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-17T12:18:58.566 INFO:tasks.ceph.mds.b:Stopping old one... 2024-02-17T12:18:58.566 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-17T12:18:58.566 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:18:58.566 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-17T12:18:58.566 INFO:tasks.ceph.mds.d:Stopping old one... 2024-02-17T12:18:58.566 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-17T12:18:58.566 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:18:58.577 INFO:tasks.ceph.mds.a:Stopped 2024-02-17T12:18:58.577 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-17T12:18:58.578 INFO:tasks.ceph.mds.c:Stopped 2024-02-17T12:18:58.578 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-17T12:18:58.580 INFO:tasks.ceph.mds.b:Stopped 2024-02-17T12:18:58.580 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-17T12:18:58.581 INFO:tasks.ceph.mds.d:Stopped 2024-02-17T12:18:58.581 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-17T12:18:58.624 INFO:tasks.ceph.mds.a:Started 2024-02-17T12:18:58.624 DEBUG:teuthology.parallel:result is None 2024-02-17T12:18:58.625 INFO:tasks.ceph.mds.b:Started 2024-02-17T12:18:58.625 DEBUG:teuthology.parallel:result is None 2024-02-17T12:18:58.626 INFO:tasks.ceph.mds.c:Started 2024-02-17T12:18:58.626 DEBUG:teuthology.parallel:result is None 2024-02-17T12:18:58.627 INFO:tasks.ceph.mds.d:Started 2024-02-17T12:18:58.627 DEBUG:teuthology.parallel:result is None 2024-02-17T12:18:58.627 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-02-17T12:18:58.710 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-02-17T12:18:58.710 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-02-17T12:18:58.718 INFO:tasks.ceph.mds.b.smithi116.stdout:starting mds.b at 2024-02-17T12:18:58.718 INFO:tasks.ceph.mds.d.smithi116.stdout:starting mds.d at 2024-02-17T12:18:58.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f3777a00640 1 Processor -- start 2024-02-17T12:18:58.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f3777a00640 1 -- start start 2024-02-17T12:18:58.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f3777a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3770156d30 0x7f3770153440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:58.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f3777a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37700c3580 con 0x7f37700714c0 2024-02-17T12:18:58.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f3777a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37700c2fc0 con 0x7f3770150300 2024-02-17T12:18:58.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f3777a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37700c6900 con 0x7f3770156d30 2024-02-17T12:18:58.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f376fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f37700714c0 0x7f3770152d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56170/0 (socket says 172.21.15.114:56170) 2024-02-17T12:18:58.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f376fe00640 1 -- 172.21.15.114:0/960016270 learned_addr learned my addr 172.21.15.114:0/960016270 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:58.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f3775a00640 1 --2- 172.21.15.114:0/960016270 >> v2:172.21.15.116:3300/0 conn(0x7f3770156d30 0x7f3770153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:58.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f376f400640 1 -- 172.21.15.114:0/960016270 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369520813 0 0) 0x7f37700c3580 con 0x7f37700714c0 2024-02-17T12:18:58.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f376f400640 1 -- 172.21.15.114:0/960016270 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3754003530 con 0x7f37700714c0 2024-02-17T12:18:58.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f3775a00640 1 -- 172.21.15.114:0/960016270 >> v1:172.21.15.116:6789/0 conn(0x7f3770150300 legacy=0x7f37700aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f376f400640 1 -- 172.21.15.114:0/960016270 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953461718 0 0) 0x7f37700c2fc0 con 0x7f3770150300 2024-02-17T12:18:58.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f3775a00640 1 -- 172.21.15.114:0/960016270 >> v1:172.21.15.114:6789/0 conn(0x7f37700714c0 legacy=0x7f3770152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.768+0000 7f3775a00640 1 -- 172.21.15.114:0/960016270 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37700c32a0 con 0x7f3770156d30 2024-02-17T12:18:58.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f3775a00640 1 --2- 172.21.15.114:0/960016270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770156d30 0x7f3770153440 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3768009d90 tx=0x7f376801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4aea7979a3f19d10 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:58.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f376f400640 1 -- 172.21.15.114:0/960016270 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37680a5830 con 0x7f3770156d30 2024-02-17T12:18:58.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f376f400640 1 -- 172.21.15.114:0/960016270 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37680a5990 con 0x7f3770156d30 2024-02-17T12:18:58.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f376f400640 1 -- 172.21.15.114:0/960016270 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37680a5d20 con 0x7f3770156d30 2024-02-17T12:18:58.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f3777a00640 1 -- 172.21.15.114:0/960016270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770156d30 msgr2=0x7f3770153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f3777a00640 1 --2- 172.21.15.114:0/960016270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770156d30 0x7f3770153440 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3768009d90 tx=0x7f376801c8e0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f3777a00640 1 -- 172.21.15.114:0/960016270 shutdown_connections 2024-02-17T12:18:58.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f3777a00640 1 --2- 172.21.15.114:0/960016270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770156d30 0x7f3770153440 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f3777a00640 1 -- 172.21.15.114:0/960016270 >> 172.21.15.114:0/960016270 conn(0x7f37700c4f20 msgr2=0x7f37700c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:58.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f3777a00640 1 -- 172.21.15.114:0/960016270 shutdown_connections 2024-02-17T12:18:58.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.772+0000 7f3777a00640 1 -- 172.21.15.114:0/960016270 wait complete. 2024-02-17T12:18:58.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 Processor -- start 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 -- start start 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37700714c0 0x7f37700a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3770150300 0x7f377015c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770156d30 0x7f37700ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377006db90 con 0x7f3770150300 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37700ac5d0 con 0x7f3770156d30 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37701ee0d0 con 0x7f37700714c0 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3770150300 0x7f377015c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3770150300 0x7f377015c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34460/0 (socket says 172.21.15.114:34460) 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376fe00640 1 -- 172.21.15.114:0/4237201444 learned_addr learned my addr 172.21.15.114:0/4237201444 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3775a00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770156d30 0x7f37700ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3775000640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37700714c0 0x7f37700a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376fe00640 1 -- 172.21.15.114:0/4237201444 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37700714c0 msgr2=0x7f37700a8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376fe00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37700714c0 0x7f37700a8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376fe00640 1 -- 172.21.15.114:0/4237201444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770156d30 msgr2=0x7f37700ab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376fe00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770156d30 0x7f37700ab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376fe00640 1 -- 172.21.15.114:0/4237201444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768009a70 con 0x7f3770150300 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376fe00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3770150300 0x7f377015c6d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c3c0 tx=0x7f375c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376cc00640 1 -- 172.21.15.114:0/4237201444 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c005cf0 con 0x7f3770150300 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376cc00640 1 -- 172.21.15.114:0/4237201444 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c005e50 con 0x7f3770150300 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 -- 172.21.15.114:0/4237201444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37700ac870 con 0x7f3770150300 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f376cc00640 1 -- 172.21.15.114:0/4237201444 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0072f0 con 0x7f3770150300 2024-02-17T12:18:58.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 -- 172.21.15.114:0/4237201444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37700c1850 con 0x7f3770150300 2024-02-17T12:18:58.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.776+0000 7f3777a00640 1 -- 172.21.15.114:0/4237201444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37700acab0 con 0x7f3770150300 2024-02-17T12:18:58.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.780+0000 7f376cc00640 1 -- 172.21.15.114:0/4237201444 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f375c007450 con 0x7f3770150300 2024-02-17T12:18:58.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.780+0000 7f376cc00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3750066ec0 0x7f3750069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:58.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.780+0000 7f376cc00640 1 -- 172.21.15.114:0/4237201444 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f375c083d10 con 0x7f3770150300 2024-02-17T12:18:58.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.780+0000 7f3775000640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3750066ec0 0x7f3750069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:58.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.780+0000 7f3775000640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3750066ec0 0x7f3750069380 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3760000f70 tx=0x7f3760009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:58.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.784+0000 7f376cc00640 1 -- 172.21.15.114:0/4237201444 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f37700acab0 con 0x7f3770150300 2024-02-17T12:18:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:58.948+0000 7f3777a00640 1 -- 172.21.15.114:0/4237201444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f37700acab0 con 0x7f3770150300 2024-02-17T12:18:59.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.656+0000 7f376cc00640 1 -- 172.21.15.114:0/4237201444 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7f37700acab0 con 0x7f3770150300 2024-02-17T12:18:59.660 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-02-17T12:18:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 -- 172.21.15.114:0/4237201444 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3750066ec0 msgr2=0x7f3750069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3750066ec0 0x7f3750069380 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3760000f70 tx=0x7f3760009040 comp rx=0 tx=0).stop 2024-02-17T12:18:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 -- 172.21.15.114:0/4237201444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3770150300 msgr2=0x7f377015c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3770150300 0x7f377015c6d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f375c00c3c0 tx=0x7f375c00c880 comp rx=0 tx=0).stop 2024-02-17T12:18:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 -- 172.21.15.114:0/4237201444 shutdown_connections 2024-02-17T12:18:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3770156d30 0x7f37700ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3750066ec0 0x7f3750069380 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3770150300 0x7f377015c6d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:59.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 --2- 172.21.15.114:0/4237201444 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37700714c0 0x7f37700a8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:59.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 -- 172.21.15.114:0/4237201444 >> 172.21.15.114:0/4237201444 conn(0x7f37700c4f20 msgr2=0x7f37700c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:59.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 -- 172.21.15.114:0/4237201444 shutdown_connections 2024-02-17T12:18:59.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.660+0000 7f3777a00640 1 -- 172.21.15.114:0/4237201444 wait complete. 2024-02-17T12:18:59.686 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-02-17T12:18:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.816+0000 7f3bdc400640 1 Processor -- start 2024-02-17T12:18:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.816+0000 7f3bdc400640 1 -- start start 2024-02-17T12:18:59.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.816+0000 7f3bdc400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd414e9b0 0x7f3bd40ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:59.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.816+0000 7f3bdc400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd40aa150 con 0x7f3bd41519b0 2024-02-17T12:18:59.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.816+0000 7f3bdc400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd40c1e90 con 0x7f3bd406ef50 2024-02-17T12:18:59.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.816+0000 7f3bdc400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd414ed90 con 0x7f3bd414e9b0 2024-02-17T12:18:59.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bda400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3bd41519b0 0x7f3bd406dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56186/0 (socket says 172.21.15.114:56186) 2024-02-17T12:18:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bda400640 1 -- 172.21.15.114:0/1002848656 learned_addr learned my addr 172.21.15.114:0/1002848656 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:18:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bd9a00640 1 --2- 172.21.15.114:0/1002848656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd414e9b0 0x7f3bd40ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bd3e00640 1 -- 172.21.15.114:0/1002848656 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792596848 0 0) 0x7f3bd40aa150 con 0x7f3bd41519b0 2024-02-17T12:18:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bd3e00640 1 -- 172.21.15.114:0/1002848656 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bbc003530 con 0x7f3bd41519b0 2024-02-17T12:18:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bd3e00640 1 -- 172.21.15.114:0/1002848656 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722149197 0 0) 0x7f3bd40c1e90 con 0x7f3bd406ef50 2024-02-17T12:18:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bd3e00640 1 -- 172.21.15.114:0/1002848656 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd40aa150 con 0x7f3bd406ef50 2024-02-17T12:18:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bd9a00640 1 -- 172.21.15.114:0/1002848656 >> v1:172.21.15.116:6789/0 conn(0x7f3bd406ef50 legacy=0x7f3bd41512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:59.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bd9a00640 1 -- 172.21.15.114:0/1002848656 >> v1:172.21.15.114:6789/0 conn(0x7f3bd41519b0 legacy=0x7f3bd406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:59.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bd9a00640 1 -- 172.21.15.114:0/1002848656 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4152000 con 0x7f3bd414e9b0 2024-02-17T12:18:59.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.820+0000 7f3bd9a00640 1 --2- 172.21.15.114:0/1002848656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd414e9b0 0x7f3bd40ab5d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009dc0 tx=0x7f3bc801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e45e866ce2201d3f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:59.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd3e00640 1 -- 172.21.15.114:0/1002848656 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80a58e0 con 0x7f3bd414e9b0 2024-02-17T12:18:59.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd3e00640 1 -- 172.21.15.114:0/1002848656 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc80a5a40 con 0x7f3bd414e9b0 2024-02-17T12:18:59.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd3e00640 1 -- 172.21.15.114:0/1002848656 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80a5dd0 con 0x7f3bd414e9b0 2024-02-17T12:18:59.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 -- 172.21.15.114:0/1002848656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd414e9b0 msgr2=0x7f3bd40ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:59.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 --2- 172.21.15.114:0/1002848656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd414e9b0 0x7f3bd40ab5d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009dc0 tx=0x7f3bc801c990 comp rx=0 tx=0).stop 2024-02-17T12:18:59.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 -- 172.21.15.114:0/1002848656 shutdown_connections 2024-02-17T12:18:59.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 --2- 172.21.15.114:0/1002848656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd414e9b0 0x7f3bd40ab5d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:59.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 -- 172.21.15.114:0/1002848656 >> 172.21.15.114:0/1002848656 conn(0x7f3bd40a8490 msgr2=0x7f3bd40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:18:59.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 -- 172.21.15.114:0/1002848656 shutdown_connections 2024-02-17T12:18:59.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 -- 172.21.15.114:0/1002848656 wait complete. 2024-02-17T12:18:59.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 Processor -- start 2024-02-17T12:18:59.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 -- start start 2024-02-17T12:18:59.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bd406ef50 0x7f3bd4152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:59.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd414e9b0 0x7f3bd4145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:59.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd41519b0 0x7f3bd4145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:59.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd414bf40 con 0x7f3bd406ef50 2024-02-17T12:18:59.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4146400 con 0x7f3bd414e9b0 2024-02-17T12:18:59.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bdc400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd414f110 con 0x7f3bd41519b0 2024-02-17T12:18:59.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bd406ef50 0x7f3bd4152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:59.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bd406ef50 0x7f3bd4152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34472/0 (socket says 172.21.15.114:34472) 2024-02-17T12:18:59.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd9a00640 1 -- 172.21.15.114:0/539580035 learned_addr learned my addr 172.21.15.114:0/539580035 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:18:59.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd9000640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd414e9b0 0x7f3bd4145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:59.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bda400640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd41519b0 0x7f3bd4145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:59.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd9a00640 1 -- 172.21.15.114:0/539580035 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd41519b0 msgr2=0x7f3bd4145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:59.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd9a00640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd41519b0 0x7f3bd4145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:59.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd9a00640 1 -- 172.21.15.114:0/539580035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd414e9b0 msgr2=0x7f3bd4145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:18:59.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd9a00640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd414e9b0 0x7f3bd4145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:18:59.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.824+0000 7f3bd9a00640 1 -- 172.21.15.114:0/539580035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8009a70 con 0x7f3bd406ef50 2024-02-17T12:18:59.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bd9a00640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bd406ef50 0x7f3bd4152450 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3bc801a5c0 tx=0x7f3bc8019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:59.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bd1600640 1 -- 172.21.15.114:0/539580035 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80a58e0 con 0x7f3bd406ef50 2024-02-17T12:18:59.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bd1600640 1 -- 172.21.15.114:0/539580035 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc80ad850 con 0x7f3bd406ef50 2024-02-17T12:18:59.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bd1600640 1 -- 172.21.15.114:0/539580035 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80adc00 con 0x7f3bd406ef50 2024-02-17T12:18:59.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bdc400640 1 -- 172.21.15.114:0/539580035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd4150c30 con 0x7f3bd406ef50 2024-02-17T12:18:59.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bdc400640 1 -- 172.21.15.114:0/539580035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd414c430 con 0x7f3bd406ef50 2024-02-17T12:18:59.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bdc400640 1 -- 172.21.15.114:0/539580035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd4074840 con 0x7f3bd406ef50 2024-02-17T12:18:59.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bd1600640 1 -- 172.21.15.114:0/539580035 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3bc80b4050 con 0x7f3bd406ef50 2024-02-17T12:18:59.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bd1600640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bb4066e40 0x7f3bb4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:18:59.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bd1600640 1 -- 172.21.15.114:0/539580035 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3bc811f520 con 0x7f3bd406ef50 2024-02-17T12:18:59.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bd9000640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bb4066e40 0x7f3bb4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:18:59.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.828+0000 7f3bd9000640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bb4066e40 0x7f3bb4069300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0007fd0 tx=0x7f3bc0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:18:59.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:18:59.832+0000 7f3bd1600640 1 -- 172.21.15.114:0/539580035 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3bc80ec650 con 0x7f3bd406ef50 2024-02-17T12:19:00.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 -- 172.21.15.114:0/539580035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3bd406df50 con 0x7f3bd406ef50 2024-02-17T12:19:00.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bd1600640 1 -- 172.21.15.114:0/539580035 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5081 (secure 0 0 0) 0x7f3bc80b2090 con 0x7f3bd406ef50 2024-02-17T12:19:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:00.044 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:19:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-02-17T12:19:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-02-17T12:19:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlC5lYABAA6azd56jLhAjZE9g08V7QEg==", 2024-02-17T12:19:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:19:00.044 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:19:00.045 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:19:00.045 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.045 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.045 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.045 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-02-17T12:19:00.045 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlN91JDBAA39pNGkFXITBkFPknKh80Zg==", 2024-02-17T12:19:00.046 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.046 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlcfWBBxAAcGpOI9tt2XFAE53Z5D3IGQ==", 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.047 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9Bl6zR5ExAAhNGl0iGdaBXJGCuUW+v7mg==", 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.048 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBVo9BlIUGPHxAAYFvkX6XSdQ2zrMlbG0tyLQ==", 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBYo9BlhFOpJRAAw6abcA91k7UIqP7ZI0DJXw==", 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:19:00.049 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBbo9BlcGMaLBAAowE5MXll20j9H2Bu9ENlHA==", 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-02-17T12:19:00.050 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBeo9BlCjw4MxAAj8jUcH+AdAKzUGE1FV93AA==", 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBko9BleeA4OxAAyqyptyDYwOEwVuofLJ2FIA==", 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBoo9BlDQvsBBAARlmMLmSs370Rf6QXYzUURw==", 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBro9Bl/IOLCxAACdC11z4y11nLvXVOngFJJA==", 2024-02-17T12:19:00.052 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBuo9Bl2traERAAej15lW/SHoN/AF0WWZUHQA==", 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlaXt+FxAAn4YhbPPnUC6y0giRDPuYyQ==", 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.054 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBSo9BlffPTGhAA6uMply4Nxw6KXsGwVHriZg==", 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw pool=cephfs2_data" 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBRo9Bl3p5kIBAAlqg+W5lq86eSDqVE/pYx9Q==", 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-02-17T12:19:00.055 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.testuser", 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAZpNBlBjd9KRAAIBSuvSKH31txYdkcjazvHg==", 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow rw fsname=cephfs", 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.056 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBRo9BlkgiBNxAAv1cRMj0JAsCW3C1QET2fxg==", 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBRo9Bl3bHCMxAAWLsuBBXWkaHkJFObZxBxpQ==", 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-02-17T12:19:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-02-17T12:19:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-02-17T12:19:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-02-17T12:19:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-02-17T12:19:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:19:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 -- 172.21.15.114:0/539580035 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bb4066e40 msgr2=0x7f3bb4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bb4066e40 0x7f3bb4069300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0007fd0 tx=0x7f3bc0009040 comp rx=0 tx=0).stop 2024-02-17T12:19:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 -- 172.21.15.114:0/539580035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bd406ef50 msgr2=0x7f3bd4152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bd406ef50 0x7f3bd4152450 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3bc801a5c0 tx=0x7f3bc8019730 comp rx=0 tx=0).stop 2024-02-17T12:19:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 -- 172.21.15.114:0/539580035 shutdown_connections 2024-02-17T12:19:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3bd41519b0 0x7f3bd4145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3bd414e9b0 0x7f3bd4145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bb4066e40 0x7f3bb4069300 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 --2- 172.21.15.114:0/539580035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bd406ef50 0x7f3bd4152450 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 -- 172.21.15.114:0/539580035 >> 172.21.15.114:0/539580035 conn(0x7f3bd40a8490 msgr2=0x7f3bd4147ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:00.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 -- 172.21.15.114:0/539580035 shutdown_connections 2024-02-17T12:19:00.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.040+0000 7f3bdc400640 1 -- 172.21.15.114:0/539580035 wait complete. 2024-02-17T12:19:00.064 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2024-02-17T12:19:00.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.196+0000 7f9334000640 1 Processor -- start 2024-02-17T12:19:00.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.196+0000 7f9334000640 1 -- start start 2024-02-17T12:19:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.196+0000 7f9334000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f932c14f110 0x7f932c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.196+0000 7f9334000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f932c0c1eb0 0x7f932c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.196+0000 7f9334000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c0a9420 con 0x7f932c0c2580 2024-02-17T12:19:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.196+0000 7f9334000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c14f4f0 con 0x7f932c0c1eb0 2024-02-17T12:19:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.196+0000 7f9334000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c0aae80 con 0x7f932c14f110 2024-02-17T12:19:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.196+0000 7f9332000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f932c0c1eb0 0x7f932c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f9332000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f932c0c1eb0 0x7f932c15c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34476/0 (socket says 172.21.15.114:34476) 2024-02-17T12:19:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f9332000640 1 -- 172.21.15.114:0/1950767972 learned_addr learned my addr 172.21.15.114:0/1950767972 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:00.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f9331600640 1 --2- 172.21.15.114:0/1950767972 >> v2:172.21.15.116:3300/0 conn(0x7f932c14f110 0x7f932c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f9332000640 1 -- 172.21.15.114:0/1950767972 >> v2:172.21.15.116:3300/0 conn(0x7f932c14f110 msgr2=0x7f932c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:00.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f9332000640 1 --2- 172.21.15.114:0/1950767972 >> v2:172.21.15.116:3300/0 conn(0x7f932c14f110 0x7f932c0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f9332000640 1 -- 172.21.15.114:0/1950767972 >> v1:172.21.15.114:6789/0 conn(0x7f932c0c2580 legacy=0x7f932c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f9332000640 1 -- 172.21.15.114:0/1950767972 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c152850 con 0x7f932c0c1eb0 2024-02-17T12:19:00.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f9331600640 1 --2- 172.21.15.114:0/1950767972 >> v2:172.21.15.116:3300/0 conn(0x7f932c14f110 0x7f932c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:00.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f9332000640 1 --2- 172.21.15.114:0/1950767972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c1eb0 0x7f932c15c390 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f932c06dc70 tx=0x7f932401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84900ba9879d6f04 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:00.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f932be00640 1 -- 172.21.15.114:0/1950767972 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240a57f0 con 0x7f932c0c1eb0 2024-02-17T12:19:00.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f932be00640 1 -- 172.21.15.114:0/1950767972 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93240a5950 con 0x7f932c0c1eb0 2024-02-17T12:19:00.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f932be00640 1 -- 172.21.15.114:0/1950767972 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240a5ce0 con 0x7f932c0c1eb0 2024-02-17T12:19:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.200+0000 7f9334000640 1 -- 172.21.15.114:0/1950767972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c1eb0 msgr2=0x7f932c15c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 --2- 172.21.15.114:0/1950767972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c1eb0 0x7f932c15c390 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f932c06dc70 tx=0x7f932401c930 comp rx=0 tx=0).stop 2024-02-17T12:19:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 -- 172.21.15.114:0/1950767972 shutdown_connections 2024-02-17T12:19:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 --2- 172.21.15.114:0/1950767972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c1eb0 0x7f932c15c390 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 --2- 172.21.15.114:0/1950767972 >> v2:172.21.15.116:3300/0 conn(0x7f932c14f110 0x7f932c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 -- 172.21.15.114:0/1950767972 >> 172.21.15.114:0/1950767972 conn(0x7f932c0a8490 msgr2=0x7f932c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 -- 172.21.15.114:0/1950767972 shutdown_connections 2024-02-17T12:19:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 -- 172.21.15.114:0/1950767972 wait complete. 2024-02-17T12:19:00.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 Processor -- start 2024-02-17T12:19:00.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 -- start start 2024-02-17T12:19:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f932c0c1eb0 0x7f932c1ebfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c2580 0x7f932c06dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f932c14f110 0x7f932c1eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c154620 con 0x7f932c0c2580 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c1eb440 con 0x7f932c0c1eb0 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9334000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c143b00 con 0x7f932c14f110 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9330c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c2580 0x7f932c06dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9330c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c2580 0x7f932c06dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34486/0 (socket says 172.21.15.114:34486) 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9330c00640 1 -- 172.21.15.114:0/2755374686 learned_addr learned my addr 172.21.15.114:0/2755374686 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9331600640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f932c0c1eb0 0x7f932c1ebfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9332000640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f932c14f110 0x7f932c1eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9330c00640 1 -- 172.21.15.114:0/2755374686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f932c14f110 msgr2=0x7f932c1eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9330c00640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f932c14f110 0x7f932c1eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9330c00640 1 -- 172.21.15.114:0/2755374686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f932c0c1eb0 msgr2=0x7f932c1ebfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9330c00640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f932c0c1eb0 0x7f932c1ebfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9330c00640 1 -- 172.21.15.114:0/2755374686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9324009b30 con 0x7f932c0c2580 2024-02-17T12:19:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.204+0000 7f9330c00640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c2580 0x7f932c06dca0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f931800c430 tx=0x7f931800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:00.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9329600640 1 -- 172.21.15.114:0/2755374686 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180052d0 con 0x7f932c0c2580 2024-02-17T12:19:00.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9329600640 1 -- 172.21.15.114:0/2755374686 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318005430 con 0x7f932c0c2580 2024-02-17T12:19:00.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9329600640 1 -- 172.21.15.114:0/2755374686 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318007260 con 0x7f932c0c2580 2024-02-17T12:19:00.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9334000640 1 -- 172.21.15.114:0/2755374686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c153d80 con 0x7f932c0c2580 2024-02-17T12:19:00.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9334000640 1 -- 172.21.15.114:0/2755374686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c154340 con 0x7f932c0c2580 2024-02-17T12:19:00.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9334000640 1 -- 172.21.15.114:0/2755374686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c074840 con 0x7f932c0c2580 2024-02-17T12:19:00.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9329600640 1 -- 172.21.15.114:0/2755374686 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f93180073c0 con 0x7f932c0c2580 2024-02-17T12:19:00.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9329600640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f930c066e40 0x7f930c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9329600640 1 -- 172.21.15.114:0/2755374686 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9318083a40 con 0x7f932c0c2580 2024-02-17T12:19:00.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9331600640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f930c066e40 0x7f930c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.208+0000 7f9331600640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f930c066e40 0x7f930c069300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f932c0c0660 tx=0x7f9320008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:00.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.212+0000 7f9329600640 1 -- 172.21.15.114:0/2755374686 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9318050c20 con 0x7f932c0c2580 2024-02-17T12:19:00.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.420+0000 7f9334000640 1 -- 172.21.15.114:0/2755374686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f932c0c1380 con 0x7f932c0c2580 2024-02-17T12:19:00.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9329600640 1 -- 172.21.15.114:0/2755374686 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v16) v1 ==== 85+0+0 (secure 0 0 0) 0x7f93180542e0 con 0x7f932c0c2580 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 -- 172.21.15.114:0/2755374686 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f930c066e40 msgr2=0x7f930c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f930c066e40 0x7f930c069300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f932c0c0660 tx=0x7f9320008040 comp rx=0 tx=0).stop 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 -- 172.21.15.114:0/2755374686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c2580 msgr2=0x7f932c06dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c2580 0x7f932c06dca0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f931800c430 tx=0x7f931800c8f0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 -- 172.21.15.114:0/2755374686 shutdown_connections 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f932c14f110 0x7f932c1eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f930c066e40 0x7f930c069300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f932c0c2580 0x7f932c06dca0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 --2- 172.21.15.114:0/2755374686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f932c0c1eb0 0x7f932c1ebfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 -- 172.21.15.114:0/2755374686 >> 172.21.15.114:0/2755374686 conn(0x7f932c0a8490 msgr2=0x7f932c0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 -- 172.21.15.114:0/2755374686 shutdown_connections 2024-02-17T12:19:00.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.424+0000 7f9334000640 1 -- 172.21.15.114:0/2755374686 wait complete. 2024-02-17T12:19:00.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.580+0000 7fd881600640 1 Processor -- start 2024-02-17T12:19:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.580+0000 7fd881600640 1 -- start start 2024-02-17T12:19:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.580+0000 7fd881600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd87c0c2580 0x7fd87c0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.580+0000 7fd881600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd87c0c1eb0 0x7fd87c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.580+0000 7fd881600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c0a9420 con 0x7fd87c14f110 2024-02-17T12:19:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.580+0000 7fd881600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c14f4f0 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.580+0000 7fd881600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c0aae80 con 0x7fd87c0c2580 2024-02-17T12:19:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd87aa00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd87c14f110 0x7fd87c0c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56194/0 (socket says 172.21.15.114:56194) 2024-02-17T12:19:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd87aa00640 1 -- 172.21.15.114:0/921794788 learned_addr learned my addr 172.21.15.114:0/921794788 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd87b400640 1 --2- 172.21.15.114:0/921794788 >> v2:172.21.15.114:3300/0 conn(0x7fd87c0c1eb0 0x7fd87c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd87a000640 1 --2- 172.21.15.114:0/921794788 >> v2:172.21.15.116:3300/0 conn(0x7fd87c0c2580 0x7fd87c0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd87b400640 1 -- 172.21.15.114:0/921794788 >> v2:172.21.15.116:3300/0 conn(0x7fd87c0c2580 msgr2=0x7fd87c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd87b400640 1 --2- 172.21.15.114:0/921794788 >> v2:172.21.15.116:3300/0 conn(0x7fd87c0c2580 0x7fd87c0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd87b400640 1 -- 172.21.15.114:0/921794788 >> v1:172.21.15.114:6789/0 conn(0x7fd87c14f110 legacy=0x7fd87c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd87b400640 1 -- 172.21.15.114:0/921794788 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c152850 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd879600640 1 -- 172.21.15.114:0/921794788 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190434218 0 0) 0x7fd87c0a9420 con 0x7fd87c14f110 2024-02-17T12:19:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd87b400640 1 --2- 172.21.15.114:0/921794788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 0x7fd87c15c390 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd87c06f0d0 tx=0x7fd87401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b373de702a5461a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd879600640 1 -- 172.21.15.114:0/921794788 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740ac620 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd879600640 1 -- 172.21.15.114:0/921794788 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8740ac780 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.584+0000 7fd879600640 1 -- 172.21.15.114:0/921794788 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740acb10 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- 172.21.15.114:0/921794788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 msgr2=0x7fd87c15c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 --2- 172.21.15.114:0/921794788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 0x7fd87c15c390 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd87c06f0d0 tx=0x7fd87401c3c0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- 172.21.15.114:0/921794788 shutdown_connections 2024-02-17T12:19:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 --2- 172.21.15.114:0/921794788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 0x7fd87c15c390 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 --2- 172.21.15.114:0/921794788 >> v2:172.21.15.116:3300/0 conn(0x7fd87c0c2580 0x7fd87c0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- 172.21.15.114:0/921794788 >> 172.21.15.114:0/921794788 conn(0x7fd87c0a8490 msgr2=0x7fd87c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- 172.21.15.114:0/921794788 shutdown_connections 2024-02-17T12:19:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- 172.21.15.114:0/921794788 wait complete. 2024-02-17T12:19:00.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 Processor -- start 2024-02-17T12:19:00.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- start start 2024-02-17T12:19:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 0x7fd87c13c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd87c0c2580 0x7fd87c13ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd87c14f110 0x7fd87c14de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0c4970 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c13bb50 con 0x7fd87c14f110 2024-02-17T12:19:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0c4c30 con 0x7fd87c0c2580 2024-02-17T12:19:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd87aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 0x7fd87c13c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd87aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 0x7fd87c13c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34502/0 (socket says 172.21.15.114:34502) 2024-02-17T12:19:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd87aa00640 1 -- 172.21.15.114:0/490461916 learned_addr learned my addr 172.21.15.114:0/490461916 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd87aa00640 1 -- 172.21.15.114:0/490461916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd87c0c2580 msgr2=0x7fd87c13ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd87aa00640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd87c0c2580 0x7fd87c13ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd87aa00640 1 -- 172.21.15.114:0/490461916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd87c14f110 msgr2=0x7fd87c14de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd87aa00640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd87c14f110 0x7fd87c14de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd87aa00640 1 -- 172.21.15.114:0/490461916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874009420 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd87aa00640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 0x7fd87c13c8d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0011f0 tx=0x7fd86c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd872a00640 1 -- 172.21.15.114:0/490461916 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c0074e0 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd872a00640 1 -- 172.21.15.114:0/490461916 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c007640 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd872a00640 1 -- 172.21.15.114:0/490461916 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c004a10 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- 172.21.15.114:0/490461916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c0c4f10 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.588+0000 7fd881600640 1 -- 172.21.15.114:0/490461916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c13b840 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.592+0000 7fd881600640 1 -- 172.21.15.114:0/490461916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c14d500 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.592+0000 7fd872a00640 1 -- 172.21.15.114:0/490461916 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd86c004b70 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.592+0000 7fd872a00640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd85c066e70 0x7fd85c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.592+0000 7fd872a00640 1 -- 172.21.15.114:0/490461916 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd86c0838b0 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.592+0000 7fd87a000640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd85c066e70 0x7fd85c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.592+0000 7fd87a000640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd85c066e70 0x7fd85c069330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd8680070b0 tx=0x7fd868007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:00.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.596+0000 7fd872a00640 1 -- 172.21.15.114:0/490461916 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd87c14d500 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 -- 172.21.15.114:0/490461916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd87c14d500 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd872a00640 1 -- 172.21.15.114:0/490461916 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+12904 (secure 0 0 0) 0x7fd86c018020 con 0x7fd87c0c1eb0 2024-02-17T12:19:00.763 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:00.763 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":64,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:18:59.665277+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 -- 172.21.15.114:0/490461916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd85c066e70 msgr2=0x7fd85c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd85c066e70 0x7fd85c069330 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd8680070b0 tx=0x7fd868007040 comp rx=0 tx=0).stop 2024-02-17T12:19:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 -- 172.21.15.114:0/490461916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 msgr2=0x7fd87c13c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 0x7fd87c13c8d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0011f0 tx=0x7fd86c00c9b0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 -- 172.21.15.114:0/490461916 shutdown_connections 2024-02-17T12:19:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd87c14f110 0x7fd87c14de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd87c0c2580 0x7fd87c13ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd85c066e70 0x7fd85c069330 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 --2- 172.21.15.114:0/490461916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd87c0c1eb0 0x7fd87c13c8d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 -- 172.21.15.114:0/490461916 >> 172.21.15.114:0/490461916 conn(0x7fd87c0a8490 msgr2=0x7fd87c0c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 -- 172.21.15.114:0/490461916 shutdown_connections 2024-02-17T12:19:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.760+0000 7fd881600640 1 -- 172.21.15.114:0/490461916 wait complete. 2024-02-17T12:19:00.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:19:00.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:19:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.916+0000 7f9d10600640 1 Processor -- start 2024-02-17T12:19:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.916+0000 7f9d10600640 1 -- start start 2024-02-17T12:19:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d10600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d0806db50 0x7f9d0814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d10600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9d08150490 0x7f9d08152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d10600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d08156270 con 0x7f9d080c25a0 2024-02-17T12:19:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d10600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0806f090 con 0x7f9d08150490 2024-02-17T12:19:00.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d10600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08071630 con 0x7f9d0806db50 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d0dc00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9d080c25a0 0x7f9d0806e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56198/0 (socket says 172.21.15.114:56198) 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d0dc00640 1 -- 172.21.15.114:0/856040101 learned_addr learned my addr 172.21.15.114:0/856040101 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d0e600640 1 --2- 172.21.15.114:0/856040101 >> v2:172.21.15.116:3300/0 conn(0x7f9d08150490 0x7f9d08152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d0d200640 1 --2- 172.21.15.114:0/856040101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d0806db50 0x7f9d0814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d07e00640 1 -- 172.21.15.114:0/856040101 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114332302 0 0) 0x7f9d08156270 con 0x7f9d080c25a0 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d07e00640 1 -- 172.21.15.114:0/856040101 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cf0003530 con 0x7f9d080c25a0 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d0e600640 1 -- 172.21.15.114:0/856040101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d0806db50 msgr2=0x7f9d0814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d0e600640 1 --2- 172.21.15.114:0/856040101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d0806db50 0x7f9d0814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d0e600640 1 -- 172.21.15.114:0/856040101 >> v1:172.21.15.114:6789/0 conn(0x7f9d080c25a0 legacy=0x7f9d0806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d0e600640 1 -- 172.21.15.114:0/856040101 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d08156550 con 0x7f9d08150490 2024-02-17T12:19:00.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.920+0000 7f9d0d200640 1 --2- 172.21.15.114:0/856040101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d0806db50 0x7f9d0814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d0e600640 1 --2- 172.21.15.114:0/856040101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d08150490 0x7f9d08152c50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009d90 tx=0x7f9d0001c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c93bae90b597c62c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d07e00640 1 -- 172.21.15.114:0/856040101 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d081539a0 con 0x7f9d08150490 2024-02-17T12:19:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d07e00640 1 -- 172.21.15.114:0/856040101 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d000a58e0 con 0x7f9d08150490 2024-02-17T12:19:00.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d07e00640 1 -- 172.21.15.114:0/856040101 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d000a5c70 con 0x7f9d08150490 2024-02-17T12:19:00.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 -- 172.21.15.114:0/856040101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d08150490 msgr2=0x7f9d08152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 --2- 172.21.15.114:0/856040101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d08150490 0x7f9d08152c50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009d90 tx=0x7f9d0001c820 comp rx=0 tx=0).stop 2024-02-17T12:19:00.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 -- 172.21.15.114:0/856040101 shutdown_connections 2024-02-17T12:19:00.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 --2- 172.21.15.114:0/856040101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d08150490 0x7f9d08152c50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 --2- 172.21.15.114:0/856040101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d0806db50 0x7f9d0814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 -- 172.21.15.114:0/856040101 >> 172.21.15.114:0/856040101 conn(0x7f9d080a8490 msgr2=0x7f9d080a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:00.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 -- 172.21.15.114:0/856040101 shutdown_connections 2024-02-17T12:19:00.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 -- 172.21.15.114:0/856040101 wait complete. 2024-02-17T12:19:00.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 Processor -- start 2024-02-17T12:19:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 -- start start 2024-02-17T12:19:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0806db50 0x7f9d0814dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d080c25a0 0x7f9d080c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d08150490 0x7f9d080c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080aa390 con 0x7f9d0806db50 2024-02-17T12:19:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080ab400 con 0x7f9d08150490 2024-02-17T12:19:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d10600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080a9ec0 con 0x7f9d080c25a0 2024-02-17T12:19:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d0dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0806db50 0x7f9d0814dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d0dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0806db50 0x7f9d0814dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34514/0 (socket says 172.21.15.114:34514) 2024-02-17T12:19:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d0dc00640 1 -- 172.21.15.114:0/2716702104 learned_addr learned my addr 172.21.15.114:0/2716702104 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d0d200640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d080c25a0 0x7f9d080c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.924+0000 7f9d0e600640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d08150490 0x7f9d080c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d0d200640 1 -- 172.21.15.114:0/2716702104 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d08150490 msgr2=0x7f9d080c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d0d200640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d08150490 0x7f9d080c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d0d200640 1 -- 172.21.15.114:0/2716702104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0806db50 msgr2=0x7f9d0814dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d0d200640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0806db50 0x7f9d0814dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d0d200640 1 -- 172.21.15.114:0/2716702104 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4009420 con 0x7f9d080c25a0 2024-02-17T12:19:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d0dc00640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0806db50 0x7f9d0814dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d0d200640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d080c25a0 0x7f9d080c4f70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400e9e0 tx=0x7f9cf400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d05600640 1 -- 172.21.15.114:0/2716702104 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400c9d0 con 0x7f9d080c25a0 2024-02-17T12:19:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d05600640 1 -- 172.21.15.114:0/2716702104 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400cb30 con 0x7f9d080c25a0 2024-02-17T12:19:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d05600640 1 -- 172.21.15.114:0/2716702104 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400cee0 con 0x7f9d080c25a0 2024-02-17T12:19:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d10600640 1 -- 172.21.15.114:0/2716702104 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d00009a70 con 0x7f9d080c25a0 2024-02-17T12:19:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d10600640 1 -- 172.21.15.114:0/2716702104 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d081522a0 con 0x7f9d080c25a0 2024-02-17T12:19:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d10600640 1 -- 172.21.15.114:0/2716702104 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d08074840 con 0x7f9d080c25a0 2024-02-17T12:19:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d05600640 1 -- 172.21.15.114:0/2716702104 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9cf4013470 con 0x7f9d080c25a0 2024-02-17T12:19:00.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d05600640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ce8066e40 0x7f9ce8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:00.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.928+0000 7f9d05600640 1 -- 172.21.15.114:0/2716702104 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9cf40848a0 con 0x7f9d080c25a0 2024-02-17T12:19:00.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.932+0000 7f9d0dc00640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ce8066e40 0x7f9ce8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:00.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.932+0000 7f9d0dc00640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ce8066e40 0x7f9ce8069300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc007fd0 tx=0x7f9cfc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:00.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:00.936+0000 7f9d05600640 1 -- 172.21.15.114:0/2716702104 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9cf4051a80 con 0x7f9d080c25a0 2024-02-17T12:19:01.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.088+0000 7f9d10600640 1 -- 172.21.15.114:0/2716702104 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d0814d7c0 con 0x7f9d080c25a0 2024-02-17T12:19:01.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.088+0000 7f9d05600640 1 -- 172.21.15.114:0/2716702104 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cf4055140 con 0x7f9d080c25a0 2024-02-17T12:19:01.093 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:19:01.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.088+0000 7f9d10600640 1 -- 172.21.15.114:0/2716702104 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ce8066e40 msgr2=0x7f9ce8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ce8066e40 0x7f9ce8069300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc007fd0 tx=0x7f9cfc009040 comp rx=0 tx=0).stop 2024-02-17T12:19:01.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 -- 172.21.15.114:0/2716702104 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d080c25a0 msgr2=0x7f9d080c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d080c25a0 0x7f9d080c4f70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400e9e0 tx=0x7f9cf400eea0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 -- 172.21.15.114:0/2716702104 shutdown_connections 2024-02-17T12:19:01.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9d08150490 0x7f9d080c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9d080c25a0 0x7f9d080c4f70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ce8066e40 0x7f9ce8069300 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 --2- 172.21.15.114:0/2716702104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d0806db50 0x7f9d0814dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 -- 172.21.15.114:0/2716702104 >> 172.21.15.114:0/2716702104 conn(0x7f9d080a8490 msgr2=0x7f9d081496c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 -- 172.21.15.114:0/2716702104 shutdown_connections 2024-02-17T12:19:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.092+0000 7f9d10600640 1 -- 172.21.15.114:0/2716702104 wait complete. 2024-02-17T12:19:01.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T12:19:01.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0ef7200640 1 Processor -- start 2024-02-17T12:19:01.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0ef7200640 1 -- start start 2024-02-17T12:19:01.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0ef7200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0ef00c5e10 0x7f0ef0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0ef7200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef0156130 con 0x7f0ef00c2ba0 2024-02-17T12:19:01.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0ef7200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef006ee30 con 0x7f0ef00c5900 2024-02-17T12:19:01.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0ef7200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef0157130 con 0x7f0ef00c5e10 2024-02-17T12:19:01.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eefe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0ef00c2ba0 0x7f0ef0152b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56208/0 (socket says 172.21.15.114:56208) 2024-02-17T12:19:01.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eefe00640 1 -- 172.21.15.114:0/3917152039 learned_addr learned my addr 172.21.15.114:0/3917152039 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:01.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0ef5200640 1 --2- 172.21.15.114:0/3917152039 >> v2:172.21.15.116:3300/0 conn(0x7f0ef00c5e10 0x7f0ef0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990185549 0 0) 0x7f0ef0156130 con 0x7f0ef00c2ba0 2024-02-17T12:19:01.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed4003530 con 0x7f0ef00c2ba0 2024-02-17T12:19:01.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2702658168 0 0) 0x7f0ed4003530 con 0x7f0ef00c2ba0 2024-02-17T12:19:01.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 >> v2:172.21.15.116:3300/0 conn(0x7f0ef00c5e10 msgr2=0x7f0ef0156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:01.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 --2- 172.21.15.114:0/3917152039 >> v2:172.21.15.116:3300/0 conn(0x7f0ef00c5e10 0x7f0ef0156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 >> v1:172.21.15.116:6789/0 conn(0x7f0ef00c5900 legacy=0x7f0ef00c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef006f110 con 0x7f0ef00c2ba0 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f0ee0001680 con 0x7f0ef00c2ba0 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 >> v1:172.21.15.114:6789/0 conn(0x7f0ef00c2ba0 legacy=0x7f0ef0152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ed4003980 0x7f0ed4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4004380 0x7f0ed4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ed40050f0 0x7f0ed400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed400c000 con 0x7f0ed4003980 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed400c170 con 0x7f0ed4004380 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed400c330 con 0x7f0ed40050f0 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eefe00640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ed4003980 0x7f0ed4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eef400640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4004380 0x7f0ed4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0ef5200640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ed40050f0 0x7f0ed400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eefe00640 1 -- 172.21.15.114:0/3917152039 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ed40050f0 msgr2=0x7f0ed400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:01.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eefe00640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ed40050f0 0x7f0ed400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eefe00640 1 -- 172.21.15.114:0/3917152039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4004380 msgr2=0x7f0ed4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:01.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eefe00640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4004380 0x7f0ed4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0eefe00640 1 -- 172.21.15.114:0/3917152039 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4003530 con 0x7f0ed4003980 2024-02-17T12:19:01.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.244+0000 7f0ef5200640 1 -- 172.21.15.114:0/3917152039 reap_dead start 2024-02-17T12:19:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0eefe00640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ed4003980 0x7f0ed4003d60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c190 tx=0x7f0ee001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f02f3b2b992e28 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0005ae0 con 0x7f0ed4003980 2024-02-17T12:19:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee0005c60 con 0x7f0ed4003980 2024-02-17T12:19:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0eeea00640 1 -- 172.21.15.114:0/3917152039 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00072b0 con 0x7f0ed4003980 2024-02-17T12:19:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0ef7200640 1 -- 172.21.15.114:0/3917152039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ed4003980 msgr2=0x7f0ed4003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0ef7200640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ed4003980 0x7f0ed4003d60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0ee000c190 tx=0x7f0ee001cb80 comp rx=0 tx=0).stop 2024-02-17T12:19:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0ef7200640 1 -- 172.21.15.114:0/3917152039 shutdown_connections 2024-02-17T12:19:01.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0ef7200640 1 --2- 172.21.15.114:0/3917152039 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ed4003980 0x7f0ed4003d60 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0ef7200640 1 -- 172.21.15.114:0/3917152039 >> 172.21.15.114:0/3917152039 conn(0x7f0ef006b210 msgr2=0x7f0ef00c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:01.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0ef7200640 1 -- 172.21.15.114:0/3917152039 shutdown_connections 2024-02-17T12:19:01.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.248+0000 7f0ef7200640 1 -- 172.21.15.114:0/3917152039 wait complete. 2024-02-17T12:19:01.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 Processor -- start 2024-02-17T12:19:01.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 -- start start 2024-02-17T12:19:01.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4003980 0x7f0ef00a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef0148010 0x7f0ef01e2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ef0147490 0x7f0ef0147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00a7420 con 0x7f0ef0148010 2024-02-17T12:19:01.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0071130 con 0x7f0ed4003980 2024-02-17T12:19:01.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0147e50 con 0x7f0ef0147490 2024-02-17T12:19:01.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0eef400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef0148010 0x7f0ef01e2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0eef400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef0148010 0x7f0ef01e2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34524/0 (socket says 172.21.15.114:34524) 2024-02-17T12:19:01.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0eef400640 1 -- 172.21.15.114:0/2585286454 learned_addr learned my addr 172.21.15.114:0/2585286454 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef5200640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ef0147490 0x7f0ef0147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0eefe00640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4003980 0x7f0ef00a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0eef400640 1 -- 172.21.15.114:0/2585286454 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ef0147490 msgr2=0x7f0ef0147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0eef400640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ef0147490 0x7f0ef0147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0eef400640 1 -- 172.21.15.114:0/2585286454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4003980 msgr2=0x7f0ef00a6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0eef400640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4003980 0x7f0ef00a6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0eef400640 1 -- 172.21.15.114:0/2585286454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00a65f0 con 0x7f0ef0148010 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0eef400640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef0148010 0x7f0ef01e2820 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00f7f0 tx=0x7f0edc00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ee7e00640 1 -- 172.21.15.114:0/2585286454 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00fea0 con 0x7f0ef0148010 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ee7e00640 1 -- 172.21.15.114:0/2585286454 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc0052e0 con 0x7f0ef0148010 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ee7e00640 1 -- 172.21.15.114:0/2585286454 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00d910 con 0x7f0ef0148010 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 -- 172.21.15.114:0/2585286454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef0071c70 con 0x7f0ef0148010 2024-02-17T12:19:01.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 -- 172.21.15.114:0/2585286454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef0071620 con 0x7f0ef0148010 2024-02-17T12:19:01.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.252+0000 7f0ef7200640 1 -- 172.21.15.114:0/2585286454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef01ed740 con 0x7f0ef0148010 2024-02-17T12:19:01.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.256+0000 7f0ee7e00640 1 -- 172.21.15.114:0/2585286454 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0edc00da70 con 0x7f0ef0148010 2024-02-17T12:19:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.256+0000 7f0ee7e00640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ed0066e40 0x7f0ed0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.256+0000 7f0ee7e00640 1 -- 172.21.15.114:0/2585286454 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0edc084500 con 0x7f0ef0148010 2024-02-17T12:19:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.256+0000 7f0eefe00640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ed0066e40 0x7f0ed0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.256+0000 7f0eefe00640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ed0066e40 0x7f0ed0069300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00ab000 tx=0x7f0ee00b1040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:01.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.260+0000 7f0ee7e00640 1 -- 172.21.15.114:0/2585286454 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0edc0516e0 con 0x7f0ef0148010 2024-02-17T12:19:01.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 -- 172.21.15.114:0/2585286454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0ef0074840 con 0x7f0ef0148010 2024-02-17T12:19:01.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ee7e00640 1 -- 172.21.15.114:0/2585286454 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0edc054da0 con 0x7f0ef0148010 2024-02-17T12:19:01.420 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-02-17T12:19:01.420 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:01.420 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-02-17T12:19:01.420 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-02-17T12:19:01.420 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:01.420 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-02-17T12:19:01.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 -- 172.21.15.114:0/2585286454 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ed0066e40 msgr2=0x7f0ed0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ed0066e40 0x7f0ed0069300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00ab000 tx=0x7f0ee00b1040 comp rx=0 tx=0).stop 2024-02-17T12:19:01.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 -- 172.21.15.114:0/2585286454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef0148010 msgr2=0x7f0ef01e2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef0148010 0x7f0ef01e2820 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00f7f0 tx=0x7f0edc00fcb0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 -- 172.21.15.114:0/2585286454 shutdown_connections 2024-02-17T12:19:01.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ef0147490 0x7f0ef0147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0ed0066e40 0x7f0ed0069300 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef0148010 0x7f0ef01e2820 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 --2- 172.21.15.114:0/2585286454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ed4003980 0x7f0ef00a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 -- 172.21.15.114:0/2585286454 >> 172.21.15.114:0/2585286454 conn(0x7f0ef006b210 msgr2=0x7f0ef00c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:01.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 -- 172.21.15.114:0/2585286454 shutdown_connections 2024-02-17T12:19:01.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.416+0000 7f0ef7200640 1 -- 172.21.15.114:0/2585286454 wait complete. 2024-02-17T12:19:01.441 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-17T12:19:01.441 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-17T12:19:01.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1b3200640 1 Processor -- start 2024-02-17T12:19:01.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1b3200640 1 -- start start 2024-02-17T12:19:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1b3200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa1ac070cd0 0x7fa1ac0c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1b3200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ac0c2e00 con 0x7fa1ac14f310 2024-02-17T12:19:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1b3200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ac0c30e0 con 0x7fa1ac0a7dd0 2024-02-17T12:19:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1b3200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ac0a6980 con 0x7fa1ac070cd0 2024-02-17T12:19:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1abe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa1ac14f310 0x7fa1ac1524d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56218/0 (socket says 172.21.15.114:56218) 2024-02-17T12:19:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1abe00640 1 -- 172.21.15.114:0/1254728125 learned_addr learned my addr 172.21.15.114:0/1254728125 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1b1200640 1 --2- 172.21.15.114:0/1254728125 >> v2:172.21.15.116:3300/0 conn(0x7fa1ac070cd0 0x7fa1ac0c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779972318 0 0) 0x7fa1ac0c2e00 con 0x7fa1ac14f310 2024-02-17T12:19:01.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa190003530 con 0x7fa1ac14f310 2024-02-17T12:19:01.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3251035084 0 0) 0x7fa190003530 con 0x7fa1ac14f310 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 >> v2:172.21.15.116:3300/0 conn(0x7fa1ac070cd0 msgr2=0x7fa1ac0c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 --2- 172.21.15.114:0/1254728125 >> v2:172.21.15.116:3300/0 conn(0x7fa1ac070cd0 0x7fa1ac0c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 >> v1:172.21.15.116:6789/0 conn(0x7fa1ac0a7dd0 legacy=0x7fa1ac0c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac14f6f0 con 0x7fa1ac14f310 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fa19c001680 con 0x7fa1ac14f310 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 >> v1:172.21.15.114:6789/0 conn(0x7fa1ac14f310 legacy=0x7fa1ac1524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa190003980 0x7fa190003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa190004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa190005190 0x7fa19000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac0a6980 con 0x7fa1900047d0 2024-02-17T12:19:01.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19000c030 con 0x7fa190003980 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19000c1f0 con 0x7fa190005190 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1ab400640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa190004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1abe00640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa190003980 0x7fa190003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1b1200640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa190005190 0x7fa19000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1ab400640 1 -- 172.21.15.114:0/1254728125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa190005190 msgr2=0x7fa19000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1ab400640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa190005190 0x7fa19000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1ab400640 1 -- 172.21.15.114:0/1254728125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa190003980 msgr2=0x7fa190003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.576+0000 7fa1ab400640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa190003980 0x7fa190003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1ab400640 1 -- 172.21.15.114:0/1254728125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa190003530 con 0x7fa1900047d0 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1b1200640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa190005190 0x7fa19000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:01.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1b1200640 1 -- 172.21.15.114:0/1254728125 reap_dead start 2024-02-17T12:19:01.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1ab400640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa190004c50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa198001360 tx=0x7fa19801e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e23e90836bb90c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:01.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1980052d0 con 0x7fa1900047d0 2024-02-17T12:19:01.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1980a9050 con 0x7fa1900047d0 2024-02-17T12:19:01.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1aaa00640 1 -- 172.21.15.114:0/1254728125 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198003840 con 0x7fa1900047d0 2024-02-17T12:19:01.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1b3200640 1 -- 172.21.15.114:0/1254728125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 msgr2=0x7fa190004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1b3200640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa190004c50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa198001360 tx=0x7fa19801e610 comp rx=0 tx=0).stop 2024-02-17T12:19:01.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1b3200640 1 -- 172.21.15.114:0/1254728125 shutdown_connections 2024-02-17T12:19:01.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1b3200640 1 --2- 172.21.15.114:0/1254728125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa190004c50 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1b3200640 1 -- 172.21.15.114:0/1254728125 >> 172.21.15.114:0/1254728125 conn(0x7fa1ac06b210 msgr2=0x7fa1ac06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:01.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1b3200640 1 -- 172.21.15.114:0/1254728125 shutdown_connections 2024-02-17T12:19:01.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.580+0000 7fa1b3200640 1 -- 172.21.15.114:0/1254728125 wait complete. 2024-02-17T12:19:01.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b3200640 1 Processor -- start 2024-02-17T12:19:01.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b3200640 1 -- start start 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa1ac14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b3200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1ac151590 0x7fa1ac145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b3200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1ac1497e0 0x7fa1ac145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b3200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac0c5360 con 0x7fa1900047d0 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b3200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac151a10 con 0x7fa1ac1497e0 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b3200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac1ea330 con 0x7fa1ac151590 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1abe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa1ac14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1abe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa1ac14b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34538/0 (socket says 172.21.15.114:34538) 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1abe00640 1 -- 172.21.15.114:0/1244081123 learned_addr learned my addr 172.21.15.114:0/1244081123 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1ab400640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1ac151590 0x7fa1ac145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b1200640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1ac1497e0 0x7fa1ac145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1abe00640 1 -- 172.21.15.114:0/1244081123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1ac151590 msgr2=0x7fa1ac145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1abe00640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1ac151590 0x7fa1ac145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1abe00640 1 -- 172.21.15.114:0/1244081123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1ac1497e0 msgr2=0x7fa1ac145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:01.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1abe00640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1ac1497e0 0x7fa1ac145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:01.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1abe00640 1 -- 172.21.15.114:0/1244081123 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac0c55b0 con 0x7fa1900047d0 2024-02-17T12:19:01.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1abe00640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa1ac14b790 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0017b0 tx=0x7fa19c012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:01.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1a3e00640 1 -- 172.21.15.114:0/1244081123 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c014810 con 0x7fa1900047d0 2024-02-17T12:19:01.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1a3e00640 1 -- 172.21.15.114:0/1244081123 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c014970 con 0x7fa1900047d0 2024-02-17T12:19:01.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1a3e00640 1 -- 172.21.15.114:0/1244081123 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c014ce0 con 0x7fa1900047d0 2024-02-17T12:19:01.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b3200640 1 -- 172.21.15.114:0/1244081123 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac0c5890 con 0x7fa1900047d0 2024-02-17T12:19:01.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.584+0000 7fa1b3200640 1 -- 172.21.15.114:0/1244081123 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac14bcd0 con 0x7fa1900047d0 2024-02-17T12:19:01.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.588+0000 7fa1b3200640 1 -- 172.21.15.114:0/1244081123 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ac06bbc0 con 0x7fa1900047d0 2024-02-17T12:19:01.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.588+0000 7fa1a3e00640 1 -- 172.21.15.114:0/1244081123 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa19c0153e0 con 0x7fa1900047d0 2024-02-17T12:19:01.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.588+0000 7fa1a3e00640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e70 0x7fa18c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:01.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.588+0000 7fa1a3e00640 1 -- 172.21.15.114:0/1244081123 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa19c086fd0 con 0x7fa1900047d0 2024-02-17T12:19:01.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.588+0000 7fa1ab400640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e70 0x7fa18c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:01.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.588+0000 7fa1ab400640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e70 0x7fa18c069330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa198001750 tx=0x7fa1980011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:01.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.592+0000 7fa1a3e00640 1 -- 172.21.15.114:0/1244081123 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa19c0541b0 con 0x7fa1900047d0 2024-02-17T12:19:01.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:01.752+0000 7fa1b3200640 1 -- 172.21.15.114:0/1244081123 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa1ac149eb0 con 0x7fa1900047d0 2024-02-17T12:19:02.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.672+0000 7fa1a3e00640 1 -- 172.21.15.114:0/1244081123 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa19c01c020 con 0x7fa1900047d0 2024-02-17T12:19:02.678 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-02-17T12:19:02.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.676+0000 7fa1b3200640 1 -- 172.21.15.114:0/1244081123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e70 msgr2=0x7fa18c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:02.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.676+0000 7fa1b3200640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e70 0x7fa18c069330 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa198001750 tx=0x7fa1980011a0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.676+0000 7fa1b3200640 1 -- 172.21.15.114:0/1244081123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 msgr2=0x7fa1ac14b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:02.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.676+0000 7fa1b3200640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa1ac14b790 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0017b0 tx=0x7fa19c012920 comp rx=0 tx=0).stop 2024-02-17T12:19:02.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.680+0000 7fa1b3200640 1 -- 172.21.15.114:0/1244081123 shutdown_connections 2024-02-17T12:19:02.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.680+0000 7fa1b3200640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa1ac1497e0 0x7fa1ac145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.680+0000 7fa1b3200640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa1ac151590 0x7fa1ac145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.680+0000 7fa1b3200640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa18c066e70 0x7fa18c069330 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.680+0000 7fa1b3200640 1 --2- 172.21.15.114:0/1244081123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1900047d0 0x7fa1ac14b790 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.680+0000 7fa1b3200640 1 -- 172.21.15.114:0/1244081123 >> 172.21.15.114:0/1244081123 conn(0x7fa1ac06b210 msgr2=0x7fa1ac146570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:02.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.680+0000 7fa1b3200640 1 -- 172.21.15.114:0/1244081123 shutdown_connections 2024-02-17T12:19:02.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.680+0000 7fa1b3200640 1 -- 172.21.15.114:0/1244081123 wait complete. 2024-02-17T12:19:02.711 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T12:19:02.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0b0200640 1 Processor -- start 2024-02-17T12:19:02.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0b0200640 1 -- start start 2024-02-17T12:19:02.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0b0200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c2580 0x7fa0a80aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:02.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0b0200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0a80c1eb0 0x7fa0a815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:02.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0b0200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a80a9420 con 0x7fa0a814f110 2024-02-17T12:19:02.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0b0200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a814f4f0 con 0x7fa0a80c1eb0 2024-02-17T12:19:02.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0b0200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a80aae80 con 0x7fa0a80c2580 2024-02-17T12:19:02.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0ae200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0a80c1eb0 0x7fa0a815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:02.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0ae200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0a80c1eb0 0x7fa0a815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34540/0 (socket says 172.21.15.114:34540) 2024-02-17T12:19:02.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0ad800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa0a814f110 0x7fa0a80c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56230/0 (socket says 172.21.15.114:56230) 2024-02-17T12:19:02.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0ae200640 1 -- 172.21.15.114:0/2297925476 learned_addr learned my addr 172.21.15.114:0/2297925476 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:02.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0ace00640 1 --2- 172.21.15.114:0/2297925476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c2580 0x7fa0a80aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:02.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0ae200640 1 -- 172.21.15.114:0/2297925476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c2580 msgr2=0x7fa0a80aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:02.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0ae200640 1 --2- 172.21.15.114:0/2297925476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c2580 0x7fa0a80aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0ae200640 1 -- 172.21.15.114:0/2297925476 >> v1:172.21.15.114:6789/0 conn(0x7fa0a814f110 legacy=0x7fa0a80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:02.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0ae200640 1 -- 172.21.15.114:0/2297925476 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a8152850 con 0x7fa0a80c1eb0 2024-02-17T12:19:02.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.852+0000 7fa0a7e00640 1 -- 172.21.15.114:0/2297925476 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706629465 0 0) 0x7fa0a80a9420 con 0x7fa0a814f110 2024-02-17T12:19:02.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0ace00640 1 --2- 172.21.15.114:0/2297925476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c2580 0x7fa0a80aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:02.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0ae200640 1 --2- 172.21.15.114:0/2297925476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c1eb0 0x7fa0a815c390 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009870 tx=0x7fa0a001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a72fca1bcb87a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:02.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0a7e00640 1 -- 172.21.15.114:0/2297925476 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00a6040 con 0x7fa0a80c1eb0 2024-02-17T12:19:02.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0a7e00640 1 -- 172.21.15.114:0/2297925476 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a00aa600 con 0x7fa0a80c1eb0 2024-02-17T12:19:02.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0a7e00640 1 -- 172.21.15.114:0/2297925476 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00aa990 con 0x7fa0a80c1eb0 2024-02-17T12:19:02.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0b0200640 1 -- 172.21.15.114:0/2297925476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c1eb0 msgr2=0x7fa0a815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:02.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0b0200640 1 --2- 172.21.15.114:0/2297925476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c1eb0 0x7fa0a815c390 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009870 tx=0x7fa0a001c4a0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0b0200640 1 -- 172.21.15.114:0/2297925476 shutdown_connections 2024-02-17T12:19:02.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0b0200640 1 --2- 172.21.15.114:0/2297925476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c1eb0 0x7fa0a815c390 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0b0200640 1 --2- 172.21.15.114:0/2297925476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c2580 0x7fa0a80aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0b0200640 1 -- 172.21.15.114:0/2297925476 >> 172.21.15.114:0/2297925476 conn(0x7fa0a80a8490 msgr2=0x7fa0a80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:02.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0b0200640 1 -- 172.21.15.114:0/2297925476 shutdown_connections 2024-02-17T12:19:02.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.856+0000 7fa0b0200640 1 -- 172.21.15.114:0/2297925476 wait complete. 2024-02-17T12:19:02.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0b0200640 1 Processor -- start 2024-02-17T12:19:02.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0b0200640 1 -- start start 2024-02-17T12:19:02.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0b0200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c1eb0 0x7fa0a80c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0b0200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c2580 0x7fa0a813c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0b0200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a814f110 0x7fa0a81493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0b0200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a81eb7a0 con 0x7fa0a80c2580 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0b0200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a81ebce0 con 0x7fa0a814f110 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0b0200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a814b410 con 0x7fa0a80c1eb0 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ace00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c2580 0x7fa0a813c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ace00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c2580 0x7fa0a813c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34550/0 (socket says 172.21.15.114:34550) 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ace00640 1 -- 172.21.15.114:0/251474355 learned_addr learned my addr 172.21.15.114:0/251474355 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ad800640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c1eb0 0x7fa0a80c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ae200640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a814f110 0x7fa0a81493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ace00640 1 -- 172.21.15.114:0/251474355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c1eb0 msgr2=0x7fa0a80c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ace00640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c1eb0 0x7fa0a80c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ace00640 1 -- 172.21.15.114:0/251474355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a814f110 msgr2=0x7fa0a81493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ace00640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a814f110 0x7fa0a81493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ace00640 1 -- 172.21.15.114:0/251474355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a00094d0 con 0x7fa0a80c2580 2024-02-17T12:19:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ae200640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a814f110 0x7fa0a81493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0ace00640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c2580 0x7fa0a813c090 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c7f0 tx=0x7fa09400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0a5600640 1 -- 172.21.15.114:0/251474355 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09400cea0 con 0x7fa0a80c2580 2024-02-17T12:19:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0a5600640 1 -- 172.21.15.114:0/251474355 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094007a30 con 0x7fa0a80c2580 2024-02-17T12:19:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0b0200640 1 -- 172.21.15.114:0/251474355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a81eb9b0 con 0x7fa0a80c2580 2024-02-17T12:19:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0a5600640 1 -- 172.21.15.114:0/251474355 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094007dc0 con 0x7fa0a80c2580 2024-02-17T12:19:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.860+0000 7fa0b0200640 1 -- 172.21.15.114:0/251474355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a80c4590 con 0x7fa0a80c2580 2024-02-17T12:19:02.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.864+0000 7fa0b0200640 1 -- 172.21.15.114:0/251474355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a8074840 con 0x7fa0a80c2580 2024-02-17T12:19:02.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.864+0000 7fa0a5600640 1 -- 172.21.15.114:0/251474355 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa094024480 con 0x7fa0a80c2580 2024-02-17T12:19:02.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.864+0000 7fa0a5600640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 0x7fa088069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:02.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.864+0000 7fa0a5600640 1 -- 172.21.15.114:0/251474355 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa094084d60 con 0x7fa0a80c2580 2024-02-17T12:19:02.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.864+0000 7fa0ad800640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 0x7fa088069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:02.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.864+0000 7fa0ad800640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 0x7fa088069300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0012f0 tx=0x7fa09c001690 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:02.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:02.868+0000 7fa0a5600640 1 -- 172.21.15.114:0/251474355 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa094051e50 con 0x7fa0a80c2580 2024-02-17T12:19:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.024+0000 7fa0b0200640 1 -- 172.21.15.114:0/251474355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa0a80c3be0 con 0x7fa0a80c2580 2024-02-17T12:19:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.680+0000 7fa0a5600640 1 -- 172.21.15.114:0/251474355 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa094055510 con 0x7fa0a80c2580 2024-02-17T12:19:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-02-17T12:19:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 -- 172.21.15.114:0/251474355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 msgr2=0x7fa088069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:03.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 0x7fa088069300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0012f0 tx=0x7fa09c001690 comp rx=0 tx=0).stop 2024-02-17T12:19:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 -- 172.21.15.114:0/251474355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c2580 msgr2=0x7fa0a813c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c2580 0x7fa0a813c090 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c7f0 tx=0x7fa09400ccb0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 -- 172.21.15.114:0/251474355 shutdown_connections 2024-02-17T12:19:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa0a814f110 0x7fa0a81493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa088066e40 0x7fa088069300 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0a80c2580 0x7fa0a813c090 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 --2- 172.21.15.114:0/251474355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa0a80c1eb0 0x7fa0a80c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 -- 172.21.15.114:0/251474355 >> 172.21.15.114:0/251474355 conn(0x7fa0a80a8490 msgr2=0x7fa0a80c6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 -- 172.21.15.114:0/251474355 shutdown_connections 2024-02-17T12:19:03.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.684+0000 7fa0b0200640 1 -- 172.21.15.114:0/251474355 wait complete. 2024-02-17T12:19:03.722 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-17T12:19:03.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab49600640 1 Processor -- start 2024-02-17T12:19:03.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab49600640 1 -- start start 2024-02-17T12:19:03.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab49600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab4414e9b0 0x7fab440ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:03.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab49600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fab441519b0 0x7fab4406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:03.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab49600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab440aa150 con 0x7fab4406ef50 2024-02-17T12:19:03.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab49600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4414ed90 con 0x7fab441519b0 2024-02-17T12:19:03.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab49600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab440c1e90 con 0x7fab4414e9b0 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab42000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fab4406ef50 0x7fab441512a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56238/0 (socket says 172.21.15.114:56238) 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab42000640 1 -- 172.21.15.114:0/479809525 learned_addr learned my addr 172.21.15.114:0/479809525 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab42a00640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab4414e9b0 0x7fab440ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab43400640 1 --2- 172.21.15.114:0/479809525 >> v2:172.21.15.116:3300/0 conn(0x7fab441519b0 0x7fab4406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242164589 0 0) 0x7fab440aa150 con 0x7fab4406ef50 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab28003530 con 0x7fab4406ef50 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 714902408 0 0) 0x7fab28003530 con 0x7fab4406ef50 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab4414e9b0 msgr2=0x7fab440ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab4414e9b0 0x7fab440ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 >> v2:172.21.15.116:3300/0 conn(0x7fab441519b0 msgr2=0x7fab4406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 --2- 172.21.15.114:0/479809525 >> v2:172.21.15.116:3300/0 conn(0x7fab441519b0 0x7fab4406dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44152000 con 0x7fab4406ef50 2024-02-17T12:19:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fab30001680 con 0x7fab4406ef50 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 >> v1:172.21.15.114:6789/0 conn(0x7fab4406ef50 legacy=0x7fab441512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 0x7fab28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab4414e9b0 0x7fab280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab28004d10 0x7fab28005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4414ed90 con 0x7fab28003980 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab440c1e90 con 0x7fab28004d10 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2800b990 con 0x7fab4414e9b0 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab42a00640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 0x7fab28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab42000640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab4414e9b0 0x7fab280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab43400640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab28004d10 0x7fab28005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab42a00640 1 -- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab4414e9b0 msgr2=0x7fab280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab42a00640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab4414e9b0 0x7fab280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab42a00640 1 -- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab28004d10 msgr2=0x7fab28005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:03.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.856+0000 7fab42a00640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab28004d10 0x7fab28005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab42a00640 1 -- 172.21.15.114:0/479809525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab28003530 con 0x7fab28003980 2024-02-17T12:19:03.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab43400640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab28004d10 0x7fab28005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab42a00640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 0x7fab28003da0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fab34009670 tx=0x7fab3401eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a288502abc80ce3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340a7710 con 0x7fab28003980 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340a7870 con 0x7fab28003980 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab41600640 1 -- 172.21.15.114:0/479809525 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340a7c20 con 0x7fab28003980 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab49600640 1 -- 172.21.15.114:0/479809525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 msgr2=0x7fab28003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab49600640 1 --2- 172.21.15.114:0/479809525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 0x7fab28003da0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fab34009670 tx=0x7fab3401eca0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab43400640 1 -- 172.21.15.114:0/479809525 reap_dead start 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab49600640 1 -- 172.21.15.114:0/479809525 shutdown_connections 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab49600640 1 -- 172.21.15.114:0/479809525 >> 172.21.15.114:0/479809525 conn(0x7fab440a8490 msgr2=0x7fab440a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab49600640 1 -- 172.21.15.114:0/479809525 shutdown_connections 2024-02-17T12:19:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.860+0000 7fab49600640 1 -- 172.21.15.114:0/479809525 wait complete. 2024-02-17T12:19:03.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab49600640 1 Processor -- start 2024-02-17T12:19:03.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab49600640 1 -- start start 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab49600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 0x7fab4414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab49600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab441ed400 0x7fab441e9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab49600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab441e9740 0x7fab441ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab49600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab441ecfe0 con 0x7fab28003980 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab49600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab441e9bc0 con 0x7fab441ed400 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab49600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab441511e0 con 0x7fab441e9740 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab42a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 0x7fab4414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab42a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 0x7fab4414ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34572/0 (socket says 172.21.15.114:34572) 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab42a00640 1 -- 172.21.15.114:0/421419871 learned_addr learned my addr 172.21.15.114:0/421419871 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab43400640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab441e9740 0x7fab441ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab42000640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab441ed400 0x7fab441e9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab42a00640 1 -- 172.21.15.114:0/421419871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab441e9740 msgr2=0x7fab441ddbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab42a00640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab441e9740 0x7fab441ddbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab42a00640 1 -- 172.21.15.114:0/421419871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab441ed400 msgr2=0x7fab441e9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:03.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab42a00640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab441ed400 0x7fab441e9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:03.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab42a00640 1 -- 172.21.15.114:0/421419871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44150c20 con 0x7fab28003980 2024-02-17T12:19:03.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab42a00640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 0x7fab4414ac80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fab340b2040 tx=0x7fab28005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:03.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab3aa00640 1 -- 172.21.15.114:0/421419871 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340a7710 con 0x7fab28003980 2024-02-17T12:19:03.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab3aa00640 1 -- 172.21.15.114:0/421419871 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab34004020 con 0x7fab28003980 2024-02-17T12:19:03.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab3aa00640 1 -- 172.21.15.114:0/421419871 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340043d0 con 0x7fab28003980 2024-02-17T12:19:03.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab49600640 1 -- 172.21.15.114:0/421419871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab44150f00 con 0x7fab28003980 2024-02-17T12:19:03.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.864+0000 7fab49600640 1 -- 172.21.15.114:0/421419871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab441ecc00 con 0x7fab28003980 2024-02-17T12:19:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.868+0000 7fab49600640 1 -- 172.21.15.114:0/421419871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab44074840 con 0x7fab28003980 2024-02-17T12:19:03.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.868+0000 7fab3aa00640 1 -- 172.21.15.114:0/421419871 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fab340b6040 con 0x7fab28003980 2024-02-17T12:19:03.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.868+0000 7fab3aa00640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fab24066e40 0x7fab24069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:03.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.868+0000 7fab3aa00640 1 -- 172.21.15.114:0/421419871 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fab34120ea0 con 0x7fab28003980 2024-02-17T12:19:03.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.868+0000 7fab42000640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fab24066e40 0x7fab24069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:03.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.868+0000 7fab42000640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fab24066e40 0x7fab24069300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fab4414b5b0 tx=0x7fab30007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:03.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:03.872+0000 7fab3aa00640 1 -- 172.21.15.114:0/421419871 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fab340ede10 con 0x7fab28003980 2024-02-17T12:19:04.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.056+0000 7fab49600640 1 -- 172.21.15.114:0/421419871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fab440c0d70 con 0x7fab28003980 2024-02-17T12:19:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab3aa00640 1 -- 172.21.15.114:0/421419871 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v45) v1 ==== 174+0+0 (secure 0 0 0) 0x7fab340f14d0 con 0x7fab28003980 2024-02-17T12:19:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 12 and data pool 13 2024-02-17T12:19:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 -- 172.21.15.114:0/421419871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fab24066e40 msgr2=0x7fab24069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fab24066e40 0x7fab24069300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fab4414b5b0 tx=0x7fab30007900 comp rx=0 tx=0).stop 2024-02-17T12:19:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 -- 172.21.15.114:0/421419871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 msgr2=0x7fab4414ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 0x7fab4414ac80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fab340b2040 tx=0x7fab28005800 comp rx=0 tx=0).stop 2024-02-17T12:19:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 -- 172.21.15.114:0/421419871 shutdown_connections 2024-02-17T12:19:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fab441e9740 0x7fab441ddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab441ed400 0x7fab441e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:04.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fab24066e40 0x7fab24069300 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 --2- 172.21.15.114:0/421419871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab28003980 0x7fab4414ac80 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 -- 172.21.15.114:0/421419871 >> 172.21.15.114:0/421419871 conn(0x7fab440a8490 msgr2=0x7fab4414c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 -- 172.21.15.114:0/421419871 shutdown_connections 2024-02-17T12:19:04.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.684+0000 7fab49600640 1 -- 172.21.15.114:0/421419871 wait complete. 2024-02-17T12:19:04.731 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:04.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70dec00640 1 Processor -- start 2024-02-17T12:19:04.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70dec00640 1 -- start start 2024-02-17T12:19:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70dec00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f70d8152560 0x7f70d80c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70dec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70d8072b20 0x7f70d80c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70dec00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d80723b0 con 0x7f70d80c4760 2024-02-17T12:19:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70dec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d8070000 con 0x7f70d8072b20 2024-02-17T12:19:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70dec00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d8154dc0 con 0x7f70d8152560 2024-02-17T12:19:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70d7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70d8072b20 0x7f70d80c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70d7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f70d8072b20 0x7f70d80c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34586/0 (socket says 172.21.15.114:34586) 2024-02-17T12:19:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70d7400640 1 -- 172.21.15.114:0/864878130 learned_addr learned my addr 172.21.15.114:0/864878130 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70dcc00640 1 --1- 172.21.15.114:0/864878130 >> v1:172.21.15.114:6789/0 conn(0x7f70d80c4760 0x7f70d81586f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56254/0 (socket says 172.21.15.114:56254) 2024-02-17T12:19:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70d7e00640 1 --2- 172.21.15.114:0/864878130 >> v2:172.21.15.116:3300/0 conn(0x7f70d8152560 0x7f70d80c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70d7400640 1 -- 172.21.15.114:0/864878130 >> v2:172.21.15.116:3300/0 conn(0x7f70d8152560 msgr2=0x7f70d80c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70d7400640 1 --2- 172.21.15.114:0/864878130 >> v2:172.21.15.116:3300/0 conn(0x7f70d8152560 0x7f70d80c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70d7400640 1 -- 172.21.15.114:0/864878130 >> v1:172.21.15.114:6789/0 conn(0x7f70d80c4760 legacy=0x7f70d81586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70d7400640 1 -- 172.21.15.114:0/864878130 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80728e0 con 0x7f70d8072b20 2024-02-17T12:19:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.864+0000 7f70d6a00640 1 -- 172.21.15.114:0/864878130 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134813758 0 0) 0x7f70d80723b0 con 0x7f70d80c4760 2024-02-17T12:19:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70d7400640 1 --2- 172.21.15.114:0/864878130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d8072b20 0x7f70d80c4220 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f70d80c4d20 tx=0x7f70c401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a3c86a8ee821dd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70d6a00640 1 -- 172.21.15.114:0/864878130 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40ab600 con 0x7f70d8072b20 2024-02-17T12:19:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70d6a00640 1 -- 172.21.15.114:0/864878130 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c40a7050 con 0x7f70d8072b20 2024-02-17T12:19:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70d6a00640 1 -- 172.21.15.114:0/864878130 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40ab980 con 0x7f70d8072b20 2024-02-17T12:19:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70dec00640 1 -- 172.21.15.114:0/864878130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d8072b20 msgr2=0x7f70d80c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70dec00640 1 --2- 172.21.15.114:0/864878130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d8072b20 0x7f70d80c4220 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f70d80c4d20 tx=0x7f70c401c490 comp rx=0 tx=0).stop 2024-02-17T12:19:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70dec00640 1 -- 172.21.15.114:0/864878130 shutdown_connections 2024-02-17T12:19:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70dec00640 1 --2- 172.21.15.114:0/864878130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d8072b20 0x7f70d80c4220 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70dec00640 1 --2- 172.21.15.114:0/864878130 >> v2:172.21.15.116:3300/0 conn(0x7f70d8152560 0x7f70d80c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:04.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70dec00640 1 -- 172.21.15.114:0/864878130 >> 172.21.15.114:0/864878130 conn(0x7f70d806bef0 msgr2=0x7f70d806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:04.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70dec00640 1 -- 172.21.15.114:0/864878130 shutdown_connections 2024-02-17T12:19:04.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70dec00640 1 -- 172.21.15.114:0/864878130 wait complete. 2024-02-17T12:19:04.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70dec00640 1 Processor -- start 2024-02-17T12:19:04.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.868+0000 7f70dec00640 1 -- start start 2024-02-17T12:19:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70d8072b20 0x7f70d80ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d80c4760 0x7f70d81f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dec00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70d8152560 0x7f70d81f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d81f1450 con 0x7f70d80c4760 2024-02-17T12:19:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dec00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80ac250 con 0x7f70d8152560 2024-02-17T12:19:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d81f1910 con 0x7f70d8072b20 2024-02-17T12:19:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70d7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d80c4760 0x7f70d81f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70d7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d80c4760 0x7f70d81f09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34588/0 (socket says 172.21.15.114:34588) 2024-02-17T12:19:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70d7400640 1 -- 172.21.15.114:0/596227229 learned_addr learned my addr 172.21.15.114:0/596227229 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70d7e00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70d8072b20 0x7f70d80ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dcc00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70d8152560 0x7f70d81f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70d7400640 1 -- 172.21.15.114:0/596227229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70d8072b20 msgr2=0x7f70d80ab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70d7400640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70d8072b20 0x7f70d80ab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70d7400640 1 -- 172.21.15.114:0/596227229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70d8152560 msgr2=0x7f70d81f0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70d7400640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70d8152560 0x7f70d81f0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70d7400640 1 -- 172.21.15.114:0/596227229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c40094d0 con 0x7f70d80c4760 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dcc00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70d8152560 0x7f70d81f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70d7400640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d80c4760 0x7f70d81f09d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f70c40ae040 tx=0x7f70c401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70cfe00640 1 -- 172.21.15.114:0/596227229 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4004230 con 0x7f70d80c4760 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70cfe00640 1 -- 172.21.15.114:0/596227229 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4004390 con 0x7f70d80c4760 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dec00640 1 -- 172.21.15.114:0/596227229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d81580a0 con 0x7f70d80c4760 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70cfe00640 1 -- 172.21.15.114:0/596227229 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4003820 con 0x7f70d80c4760 2024-02-17T12:19:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dec00640 1 -- 172.21.15.114:0/596227229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d81f1630 con 0x7f70d80c4760 2024-02-17T12:19:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70dec00640 1 -- 172.21.15.114:0/596227229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d8067370 con 0x7f70d80c4760 2024-02-17T12:19:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.872+0000 7f70cfe00640 1 -- 172.21.15.114:0/596227229 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f70c40b2040 con 0x7f70d80c4760 2024-02-17T12:19:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.876+0000 7f70cfe00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f70b8066e40 0x7f70b8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.876+0000 7f70cfe00640 1 -- 172.21.15.114:0/596227229 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70c411e920 con 0x7f70d80c4760 2024-02-17T12:19:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.876+0000 7f70d7e00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f70b8066e40 0x7f70b8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.876+0000 7f70d7e00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f70b8066e40 0x7f70b8069300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f70c800b9d0 tx=0x7f70c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:04.880+0000 7f70cfe00640 1 -- 172.21.15.114:0/596227229 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f70c40eb790 con 0x7f70d80c4760 2024-02-17T12:19:05.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.032+0000 7f70dec00640 1 -- 172.21.15.114:0/596227229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70d8074840 con 0x7f70d80c4760 2024-02-17T12:19:05.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.032+0000 7f70cfe00640 1 -- 172.21.15.114:0/596227229 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16685 (secure 0 0 0) 0x7f70c40b8090 con 0x7f70d80c4760 2024-02-17T12:19:05.038 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:05.038 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":67,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:04.060900+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:05.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 -- 172.21.15.114:0/596227229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f70b8066e40 msgr2=0x7f70b8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f70b8066e40 0x7f70b8069300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f70c800b9d0 tx=0x7f70c8008040 comp rx=0 tx=0).stop 2024-02-17T12:19:05.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 -- 172.21.15.114:0/596227229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d80c4760 msgr2=0x7f70d81f09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d80c4760 0x7f70d81f09d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f70c40ae040 tx=0x7f70c401acd0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 -- 172.21.15.114:0/596227229 shutdown_connections 2024-02-17T12:19:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f70d8152560 0x7f70d81f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f70b8066e40 0x7f70b8069300 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d80c4760 0x7f70d81f09d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 --2- 172.21.15.114:0/596227229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70d8072b20 0x7f70d80ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 -- 172.21.15.114:0/596227229 >> 172.21.15.114:0/596227229 conn(0x7f70d806bef0 msgr2=0x7f70d80c37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 -- 172.21.15.114:0/596227229 shutdown_connections 2024-02-17T12:19:05.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.036+0000 7f70dec00640 1 -- 172.21.15.114:0/596227229 wait complete. 2024-02-17T12:19:05.058 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:05.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.188+0000 7f59ebe00640 1 Processor -- start 2024-02-17T12:19:05.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.188+0000 7f59ebe00640 1 -- start start 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.188+0000 7f59ebe00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f59e414f110 0x7f59e40c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.188+0000 7f59ebe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59e40c2580 0x7f59e40aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.188+0000 7f59ebe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e40a9420 con 0x7f59e40c1eb0 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.188+0000 7f59ebe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e414f4f0 con 0x7f59e40c2580 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.188+0000 7f59ebe00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e40aae80 con 0x7f59e414f110 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.192+0000 7f59e8a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59e40c2580 0x7f59e40aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.192+0000 7f59e8a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f59e40c2580 0x7f59e40aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40676/0 (socket says 172.21.15.114:40676) 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.192+0000 7f59e8a00640 1 -- 172.21.15.114:0/3183163282 learned_addr learned my addr 172.21.15.114:0/3183163282 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.192+0000 7f59e9400640 1 --2- 172.21.15.114:0/3183163282 >> v2:172.21.15.116:3300/0 conn(0x7f59e414f110 0x7f59e40c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.192+0000 7f59e8a00640 1 -- 172.21.15.114:0/3183163282 >> v2:172.21.15.116:3300/0 conn(0x7f59e414f110 msgr2=0x7f59e40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.192+0000 7f59e8a00640 1 --2- 172.21.15.114:0/3183163282 >> v2:172.21.15.116:3300/0 conn(0x7f59e414f110 0x7f59e40c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.192+0000 7f59e8a00640 1 -- 172.21.15.114:0/3183163282 >> v1:172.21.15.116:6789/0 conn(0x7f59e40c1eb0 legacy=0x7f59e4155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.192+0000 7f59e8a00640 1 -- 172.21.15.114:0/3183163282 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e4152850 con 0x7f59e40c2580 2024-02-17T12:19:05.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.192+0000 7f59e9400640 1 --2- 172.21.15.114:0/3183163282 >> v2:172.21.15.116:3300/0 conn(0x7f59e414f110 0x7f59e40c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:05.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.192+0000 7f59e8a00640 1 --2- 172.21.15.114:0/3183163282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e40c2580 0x7f59e40aa150 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f59e406dc70 tx=0x7f59d001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bcae3881b553b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:05.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e3e00640 1 -- 172.21.15.114:0/3183163282 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d00ab660 con 0x7f59e40c2580 2024-02-17T12:19:05.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e3e00640 1 -- 172.21.15.114:0/3183163282 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d00ab7c0 con 0x7f59e40c2580 2024-02-17T12:19:05.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e3e00640 1 -- 172.21.15.114:0/3183163282 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d00abb50 con 0x7f59e40c2580 2024-02-17T12:19:05.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 -- 172.21.15.114:0/3183163282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e40c2580 msgr2=0x7f59e40aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 --2- 172.21.15.114:0/3183163282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e40c2580 0x7f59e40aa150 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f59e406dc70 tx=0x7f59d001c460 comp rx=0 tx=0).stop 2024-02-17T12:19:05.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 -- 172.21.15.114:0/3183163282 shutdown_connections 2024-02-17T12:19:05.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 --2- 172.21.15.114:0/3183163282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e40c2580 0x7f59e40aa150 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 --2- 172.21.15.114:0/3183163282 >> v2:172.21.15.116:3300/0 conn(0x7f59e414f110 0x7f59e40c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 -- 172.21.15.114:0/3183163282 >> 172.21.15.114:0/3183163282 conn(0x7f59e40a8490 msgr2=0x7f59e40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 -- 172.21.15.114:0/3183163282 shutdown_connections 2024-02-17T12:19:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 -- 172.21.15.114:0/3183163282 wait complete. 2024-02-17T12:19:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 Processor -- start 2024-02-17T12:19:05.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 -- start start 2024-02-17T12:19:05.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59e40c1eb0 0x7f59e4141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59e40c2580 0x7f59e41f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e414f110 0x7f59e41f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e414d4b0 con 0x7f59e414f110 2024-02-17T12:19:05.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e414ade0 con 0x7f59e40c1eb0 2024-02-17T12:19:05.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59ebe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e41f1f50 con 0x7f59e40c2580 2024-02-17T12:19:05.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e414f110 0x7f59e41f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e414f110 0x7f59e41f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40678/0 (socket says 172.21.15.114:40678) 2024-02-17T12:19:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e9e00640 1 -- 172.21.15.114:0/3782529338 learned_addr learned my addr 172.21.15.114:0/3782529338 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e9400640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59e40c1eb0 0x7f59e4141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e8a00640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59e40c2580 0x7f59e41f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e9e00640 1 -- 172.21.15.114:0/3782529338 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59e40c2580 msgr2=0x7f59e41f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e9e00640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59e40c2580 0x7f59e41f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e9e00640 1 -- 172.21.15.114:0/3782529338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59e40c1eb0 msgr2=0x7f59e4141070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e9e00640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59e40c1eb0 0x7f59e4141070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.196+0000 7f59e9e00640 1 -- 172.21.15.114:0/3782529338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d00094d0 con 0x7f59e414f110 2024-02-17T12:19:05.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59e9e00640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e414f110 0x7f59e41f1a10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00c7a0 tx=0x7f59dc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59e1600640 1 -- 172.21.15.114:0/3782529338 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc003b80 con 0x7f59e414f110 2024-02-17T12:19:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59e1600640 1 -- 172.21.15.114:0/3782529338 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc003ce0 con 0x7f59e414f110 2024-02-17T12:19:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59e1600640 1 -- 172.21.15.114:0/3782529338 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00aa90 con 0x7f59e414f110 2024-02-17T12:19:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59ebe00640 1 -- 172.21.15.114:0/3782529338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e41f0ff0 con 0x7f59e414f110 2024-02-17T12:19:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59ebe00640 1 -- 172.21.15.114:0/3782529338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e414afe0 con 0x7f59e414f110 2024-02-17T12:19:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59ebe00640 1 -- 172.21.15.114:0/3782529338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e4074840 con 0x7f59e414f110 2024-02-17T12:19:05.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59e1600640 1 -- 172.21.15.114:0/3782529338 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f59dc00abf0 con 0x7f59e414f110 2024-02-17T12:19:05.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59e1600640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f59c4066e70 0x7f59c4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59e1600640 1 -- 172.21.15.114:0/3782529338 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59dc084720 con 0x7f59e414f110 2024-02-17T12:19:05.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59e9400640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f59c4066e70 0x7f59c4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.200+0000 7f59e9400640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f59c4066e70 0x7f59c4069330 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f59e40ab5b0 tx=0x7f59d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:05.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.204+0000 7f59e1600640 1 -- 172.21.15.114:0/3782529338 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f59dc0515b0 con 0x7f59e414f110 2024-02-17T12:19:05.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.360+0000 7f59ebe00640 1 -- 172.21.15.114:0/3782529338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59e41f1180 con 0x7f59e414f110 2024-02-17T12:19:05.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.360+0000 7f59e1600640 1 -- 172.21.15.114:0/3782529338 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16685 (secure 0 0 0) 0x7f59dc054c70 con 0x7f59e414f110 2024-02-17T12:19:05.368 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:05.368 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":67,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:04.060900+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:05.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 -- 172.21.15.114:0/3782529338 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f59c4066e70 msgr2=0x7f59c4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f59c4066e70 0x7f59c4069330 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f59e40ab5b0 tx=0x7f59d8008040 comp rx=0 tx=0).stop 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 -- 172.21.15.114:0/3782529338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e414f110 msgr2=0x7f59e41f1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e414f110 0x7f59e41f1a10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00c7a0 tx=0x7f59dc00cc60 comp rx=0 tx=0).stop 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 -- 172.21.15.114:0/3782529338 shutdown_connections 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f59c4066e70 0x7f59c4069330 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59e414f110 0x7f59e41f1a10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59e40c2580 0x7f59e41f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 --2- 172.21.15.114:0/3782529338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59e40c1eb0 0x7f59e4141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 -- 172.21.15.114:0/3782529338 >> 172.21.15.114:0/3782529338 conn(0x7f59e40a8490 msgr2=0x7f59e4145150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 -- 172.21.15.114:0/3782529338 shutdown_connections 2024-02-17T12:19:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.364+0000 7f59ebe00640 1 -- 172.21.15.114:0/3782529338 wait complete. 2024-02-17T12:19:05.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-17T12:19:05.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.520+0000 7fe9eec00640 1 Processor -- start 2024-02-17T12:19:05.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.520+0000 7fe9eec00640 1 -- start start 2024-02-17T12:19:05.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9eec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9e80c2580 0x7fe9e80aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9eec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e80c1eb0 0x7fe9e815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9eec00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e80a9420 con 0x7fe9e814f110 2024-02-17T12:19:05.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9eec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e814f4f0 con 0x7fe9e80c2580 2024-02-17T12:19:05.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9eec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80aae80 con 0x7fe9e80c1eb0 2024-02-17T12:19:05.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9e7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9e80c2580 0x7fe9e80aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9e7e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe9e814f110 0x7fe9e80c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42110/0 (socket says 172.21.15.114:42110) 2024-02-17T12:19:05.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9e7e00640 1 -- 172.21.15.114:0/1744947404 learned_addr learned my addr 172.21.15.114:0/1744947404 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:05.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9ecc00640 1 --2- 172.21.15.114:0/1744947404 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e80c1eb0 0x7fe9e815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9e7400640 1 -- 172.21.15.114:0/1744947404 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e80c1eb0 msgr2=0x7fe9e815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:05.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9e7400640 1 --2- 172.21.15.114:0/1744947404 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e80c1eb0 0x7fe9e815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9e7400640 1 -- 172.21.15.114:0/1744947404 >> v1:172.21.15.114:6789/0 conn(0x7fe9e814f110 legacy=0x7fe9e80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9e7400640 1 -- 172.21.15.114:0/1744947404 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8152850 con 0x7fe9e80c2580 2024-02-17T12:19:05.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9ecc00640 1 --2- 172.21.15.114:0/1744947404 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e80c1eb0 0x7fe9e815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:05.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.524+0000 7fe9e6a00640 1 -- 172.21.15.114:0/1744947404 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014314448 0 0) 0x7fe9e80a9420 con 0x7fe9e814f110 2024-02-17T12:19:05.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9e7400640 1 --2- 172.21.15.114:0/1744947404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 0x7fe9e80aa150 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40097c0 tx=0x7fe9d401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637e4744e0fa5599 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:05.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9e6a00640 1 -- 172.21.15.114:0/1744947404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40ac640 con 0x7fe9e80c2580 2024-02-17T12:19:05.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9e6a00640 1 -- 172.21.15.114:0/1744947404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d40ac7a0 con 0x7fe9e80c2580 2024-02-17T12:19:05.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9e6a00640 1 -- 172.21.15.114:0/1744947404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40acb30 con 0x7fe9e80c2580 2024-02-17T12:19:05.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 -- 172.21.15.114:0/1744947404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 msgr2=0x7fe9e80aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 --2- 172.21.15.114:0/1744947404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 0x7fe9e80aa150 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40097c0 tx=0x7fe9d401c3e0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 -- 172.21.15.114:0/1744947404 shutdown_connections 2024-02-17T12:19:05.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 --2- 172.21.15.114:0/1744947404 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e80c1eb0 0x7fe9e815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 --2- 172.21.15.114:0/1744947404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 0x7fe9e80aa150 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 -- 172.21.15.114:0/1744947404 >> 172.21.15.114:0/1744947404 conn(0x7fe9e80a8490 msgr2=0x7fe9e80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:05.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 -- 172.21.15.114:0/1744947404 shutdown_connections 2024-02-17T12:19:05.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 -- 172.21.15.114:0/1744947404 wait complete. 2024-02-17T12:19:05.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 Processor -- start 2024-02-17T12:19:05.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 -- start start 2024-02-17T12:19:05.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80c1eb0 0x7fe9e8071d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 0x7fe9e80c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e814f110 0x7fe9e80c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e81f1c50 con 0x7fe9e80c2580 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80c5370 con 0x7fe9e80c1eb0 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.528+0000 7fe9eec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80728d0 con 0x7fe9e814f110 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9e7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 0x7fe9e80c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9e7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 0x7fe9e80c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40698/0 (socket says 172.21.15.114:40698) 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9e7400640 1 -- 172.21.15.114:0/4083646684 learned_addr learned my addr 172.21.15.114:0/4083646684 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9e7e00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80c1eb0 0x7fe9e8071d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9ecc00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e814f110 0x7fe9e80c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9e7400640 1 -- 172.21.15.114:0/4083646684 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e814f110 msgr2=0x7fe9e80c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9e7400640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e814f110 0x7fe9e80c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9e7400640 1 -- 172.21.15.114:0/4083646684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80c1eb0 msgr2=0x7fe9e8071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:05.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9e7400640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80c1eb0 0x7fe9e8071d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9e7400640 1 -- 172.21.15.114:0/4083646684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d4009420 con 0x7fe9e80c2580 2024-02-17T12:19:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9e7400640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 0x7fe9e80c45c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40af040 tx=0x7fe9d4019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9dfe00640 1 -- 172.21.15.114:0/4083646684 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40b5820 con 0x7fe9e80c2580 2024-02-17T12:19:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9dfe00640 1 -- 172.21.15.114:0/4083646684 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d40b5980 con 0x7fe9e80c2580 2024-02-17T12:19:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9dfe00640 1 -- 172.21.15.114:0/4083646684 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40b5d30 con 0x7fe9e80c2580 2024-02-17T12:19:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9eec00640 1 -- 172.21.15.114:0/4083646684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e81f0fd0 con 0x7fe9e80c2580 2024-02-17T12:19:05.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9eec00640 1 -- 172.21.15.114:0/4083646684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e81f1590 con 0x7fe9e80c2580 2024-02-17T12:19:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9eec00640 1 -- 172.21.15.114:0/4083646684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e8074840 con 0x7fe9e80c2580 2024-02-17T12:19:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9dfe00640 1 -- 172.21.15.114:0/4083646684 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe9d40b3040 con 0x7fe9e80c2580 2024-02-17T12:19:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9dfe00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe9c8066e70 0x7fe9c8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.532+0000 7fe9dfe00640 1 -- 172.21.15.114:0/4083646684 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9d411efa0 con 0x7fe9e80c2580 2024-02-17T12:19:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.536+0000 7fe9e7e00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe9c8066e70 0x7fe9c8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:05.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.536+0000 7fe9e7e00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe9c8066e70 0x7fe9c8069330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8007fd0 tx=0x7fe9d8007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:05.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.536+0000 7fe9dfe00640 1 -- 172.21.15.114:0/4083646684 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe9d40ebe30 con 0x7fe9e80c2580 2024-02-17T12:19:05.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:05.732+0000 7fe9eec00640 1 -- 172.21.15.114:0/4083646684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe9e8155da0 con 0x7fe9e80c2580 2024-02-17T12:19:06.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9dfe00640 1 -- 172.21.15.114:0/4083646684 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe9d40c30b0 con 0x7fe9e80c2580 2024-02-17T12:19:06.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 -- 172.21.15.114:0/4083646684 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe9c8066e70 msgr2=0x7fe9c8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:06.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe9c8066e70 0x7fe9c8069330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8007fd0 tx=0x7fe9d8007d60 comp rx=0 tx=0).stop 2024-02-17T12:19:06.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 -- 172.21.15.114:0/4083646684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 msgr2=0x7fe9e80c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:06.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 0x7fe9e80c45c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40af040 tx=0x7fe9d4019180 comp rx=0 tx=0).stop 2024-02-17T12:19:06.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 -- 172.21.15.114:0/4083646684 shutdown_connections 2024-02-17T12:19:06.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe9e814f110 0x7fe9e80c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:06.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe9c8066e70 0x7fe9c8069330 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:06.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9e80c2580 0x7fe9e80c45c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:06.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 --2- 172.21.15.114:0/4083646684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e80c1eb0 0x7fe9e8071d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:06.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 -- 172.21.15.114:0/4083646684 >> 172.21.15.114:0/4083646684 conn(0x7fe9e80a8490 msgr2=0x7fe9e80a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:06.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 -- 172.21.15.114:0/4083646684 shutdown_connections 2024-02-17T12:19:06.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.712+0000 7fe9eec00640 1 -- 172.21.15.114:0/4083646684 wait complete. 2024-02-17T12:19:06.739 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-17T12:19:06.739 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-17T12:19:06.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.872+0000 7f56df000640 1 Processor -- start 2024-02-17T12:19:06.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.872+0000 7f56df000640 1 -- start start 2024-02-17T12:19:06.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.872+0000 7f56df000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56d806db50 0x7f56d814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:06.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.872+0000 7f56df000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f56d8150490 0x7f56d8152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:06.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.872+0000 7f56df000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d8156270 con 0x7f56d80c25a0 2024-02-17T12:19:06.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.872+0000 7f56df000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d806f090 con 0x7f56d8150490 2024-02-17T12:19:06.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.872+0000 7f56df000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8071630 con 0x7f56d806db50 2024-02-17T12:19:06.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56d7400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56d806db50 0x7f56d814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:06.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56dd000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f56d8150490 0x7f56d8152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:06.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56d7e00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f56d80c25a0 0x7f56d806e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:41964/0 (socket says 172.21.15.114:41964) 2024-02-17T12:19:06.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56d7e00640 1 -- 172.21.15.114:0/2466329053 learned_addr learned my addr 172.21.15.114:0/2466329053 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:06.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56dd000640 1 -- 172.21.15.114:0/2466329053 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56d806db50 msgr2=0x7f56d814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:06.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56dd000640 1 --2- 172.21.15.114:0/2466329053 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56d806db50 0x7f56d814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:06.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56dd000640 1 -- 172.21.15.114:0/2466329053 >> v1:172.21.15.116:6789/0 conn(0x7f56d80c25a0 legacy=0x7f56d806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:06.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56dd000640 1 -- 172.21.15.114:0/2466329053 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8156550 con 0x7f56d8150490 2024-02-17T12:19:06.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56dd000640 1 --2- 172.21.15.114:0/2466329053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d8150490 0x7f56d8152c50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f56d00097c0 tx=0x7f56d001c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f91a58307cc327d server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:06.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56d6a00640 1 -- 172.21.15.114:0/2466329053 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d81539a0 con 0x7f56d8150490 2024-02-17T12:19:06.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56d6a00640 1 -- 172.21.15.114:0/2466329053 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d00a7050 con 0x7f56d8150490 2024-02-17T12:19:06.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.876+0000 7f56d6a00640 1 -- 172.21.15.114:0/2466329053 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0004490 con 0x7f56d8150490 2024-02-17T12:19:06.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 -- 172.21.15.114:0/2466329053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d8150490 msgr2=0x7f56d8152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:06.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 --2- 172.21.15.114:0/2466329053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d8150490 0x7f56d8152c50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f56d00097c0 tx=0x7f56d001c350 comp rx=0 tx=0).stop 2024-02-17T12:19:06.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 -- 172.21.15.114:0/2466329053 shutdown_connections 2024-02-17T12:19:06.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 --2- 172.21.15.114:0/2466329053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d8150490 0x7f56d8152c50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:06.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 --2- 172.21.15.114:0/2466329053 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56d806db50 0x7f56d814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:06.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 -- 172.21.15.114:0/2466329053 >> 172.21.15.114:0/2466329053 conn(0x7f56d80a8490 msgr2=0x7f56d80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:06.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 -- 172.21.15.114:0/2466329053 shutdown_connections 2024-02-17T12:19:06.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 -- 172.21.15.114:0/2466329053 wait complete. 2024-02-17T12:19:06.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 Processor -- start 2024-02-17T12:19:06.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 -- start start 2024-02-17T12:19:06.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d806db50 0x7f56d8140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:06.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56d80c25a0 0x7f56d813f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:06.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d8150490 0x7f56d8143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:06.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8142620 con 0x7f56d8150490 2024-02-17T12:19:06.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80c47b0 con 0x7f56d806db50 2024-02-17T12:19:06.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56df000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d813f790 con 0x7f56d80c25a0 2024-02-17T12:19:06.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56dd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d8150490 0x7f56d8143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:06.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56dd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d8150490 0x7f56d8143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40714/0 (socket says 172.21.15.114:40714) 2024-02-17T12:19:06.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56dd000640 1 -- 172.21.15.114:0/2523256691 learned_addr learned my addr 172.21.15.114:0/2523256691 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:06.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56d7e00640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d806db50 0x7f56d8140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:06.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56d7400640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56d80c25a0 0x7f56d813f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:06.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56dd000640 1 -- 172.21.15.114:0/2523256691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56d80c25a0 msgr2=0x7f56d813f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56dd000640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56d80c25a0 0x7f56d813f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56dd000640 1 -- 172.21.15.114:0/2523256691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d806db50 msgr2=0x7f56d8140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56dd000640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d806db50 0x7f56d8140ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56dd000640 1 -- 172.21.15.114:0/2523256691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0009420 con 0x7f56d8150490 2024-02-17T12:19:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56dd000640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d8150490 0x7f56d8143f40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f56d00ae040 tx=0x7f56d00190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.880+0000 7f56cfe00640 1 -- 172.21.15.114:0/2523256691 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0003af0 con 0x7f56d8150490 2024-02-17T12:19:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.884+0000 7f56cfe00640 1 -- 172.21.15.114:0/2523256691 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d0003c50 con 0x7f56d8150490 2024-02-17T12:19:06.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.884+0000 7f56cfe00640 1 -- 172.21.15.114:0/2523256691 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00ab440 con 0x7f56d8150490 2024-02-17T12:19:06.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.884+0000 7f56df000640 1 -- 172.21.15.114:0/2523256691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d8155c80 con 0x7f56d8150490 2024-02-17T12:19:06.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.884+0000 7f56df000640 1 -- 172.21.15.114:0/2523256691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d8144480 con 0x7f56d8150490 2024-02-17T12:19:06.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.884+0000 7f56df000640 1 -- 172.21.15.114:0/2523256691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d80c6080 con 0x7f56d8150490 2024-02-17T12:19:06.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.884+0000 7f56cfe00640 1 -- 172.21.15.114:0/2523256691 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f56d00b2040 con 0x7f56d8150490 2024-02-17T12:19:06.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.884+0000 7f56cfe00640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56b8066e40 0x7f56b8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:06.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.884+0000 7f56cfe00640 1 -- 172.21.15.114:0/2523256691 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56d011e830 con 0x7f56d8150490 2024-02-17T12:19:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.884+0000 7f56d7e00640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56b8066e40 0x7f56b8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.884+0000 7f56d7e00640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56b8066e40 0x7f56b8069300 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f56c8005c10 tx=0x7f56c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:06.888+0000 7f56cfe00640 1 -- 172.21.15.114:0/2523256691 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f56d00eb760 con 0x7f56d8150490 2024-02-17T12:19:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.076+0000 7f56df000640 1 -- 172.21.15.114:0/2523256691 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f56d81468b0 con 0x7f56d8150490 2024-02-17T12:19:07.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.716+0000 7f56cfe00640 1 -- 172.21.15.114:0/2523256691 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f56d81468b0 con 0x7f56d8150490 2024-02-17T12:19:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 -- 172.21.15.114:0/2523256691 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56b8066e40 msgr2=0x7f56b8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56b8066e40 0x7f56b8069300 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f56c8005c10 tx=0x7f56c8009040 comp rx=0 tx=0).stop 2024-02-17T12:19:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 -- 172.21.15.114:0/2523256691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d8150490 msgr2=0x7f56d8143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d8150490 0x7f56d8143f40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f56d00ae040 tx=0x7f56d00190f0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 -- 172.21.15.114:0/2523256691 shutdown_connections 2024-02-17T12:19:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56b8066e40 0x7f56b8069300 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56d8150490 0x7f56d8143f40 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56d80c25a0 0x7f56d813f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 --2- 172.21.15.114:0/2523256691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56d806db50 0x7f56d8140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 -- 172.21.15.114:0/2523256691 >> 172.21.15.114:0/2523256691 conn(0x7f56d80a8490 msgr2=0x7f56d8149a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 -- 172.21.15.114:0/2523256691 shutdown_connections 2024-02-17T12:19:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.720+0000 7f56df000640 1 -- 172.21.15.114:0/2523256691 wait complete. 2024-02-17T12:19:07.747 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-17T12:19:07.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:19:07.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7fe00640 1 Processor -- start 2024-02-17T12:19:07.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7fe00640 1 -- start start 2024-02-17T12:19:07.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec78150300 0x7fec78156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:07.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7fe00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fec780714c0 0x7fec780aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:07.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7fe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec78157270 con 0x7fec780aa6a0 2024-02-17T12:19:07.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7fe00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec780c6900 con 0x7fec780714c0 2024-02-17T12:19:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec780c3580 con 0x7fec78150300 2024-02-17T12:19:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7d400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec78150300 0x7fec78156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7d400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec78150300 0x7fec78156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:45150/0 (socket says 172.21.15.114:45150) 2024-02-17T12:19:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7d400640 1 -- 172.21.15.114:0/84618432 learned_addr learned my addr 172.21.15.114:0/84618432 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7ca00640 1 --2- 172.21.15.114:0/84618432 >> v2:172.21.15.116:3300/0 conn(0x7fec780714c0 0x7fec780aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7d400640 1 -- 172.21.15.114:0/84618432 >> v2:172.21.15.116:3300/0 conn(0x7fec780714c0 msgr2=0x7fec780aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7d400640 1 --2- 172.21.15.114:0/84618432 >> v2:172.21.15.116:3300/0 conn(0x7fec780714c0 0x7fec780aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7d400640 1 -- 172.21.15.114:0/84618432 >> v1:172.21.15.116:6789/0 conn(0x7fec780aa6a0 legacy=0x7fec78152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec77e00640 1 -- 172.21.15.114:0/84618432 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731317922 0 0) 0x7fec78157270 con 0x7fec780aa6a0 2024-02-17T12:19:07.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.880+0000 7fec7d400640 1 -- 172.21.15.114:0/84618432 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec780c2fc0 con 0x7fec78150300 2024-02-17T12:19:07.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec7d400640 1 --2- 172.21.15.114:0/84618432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec78150300 0x7fec78156d30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009870 tx=0x7fec6c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cda4333e77b57de server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:07.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec77e00640 1 -- 172.21.15.114:0/84618432 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c0ac620 con 0x7fec78150300 2024-02-17T12:19:07.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec77e00640 1 -- 172.21.15.114:0/84618432 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c0ac780 con 0x7fec78150300 2024-02-17T12:19:07.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec77e00640 1 -- 172.21.15.114:0/84618432 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c0acb10 con 0x7fec78150300 2024-02-17T12:19:07.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec7fe00640 1 -- 172.21.15.114:0/84618432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec78150300 msgr2=0x7fec78156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:07.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec7fe00640 1 --2- 172.21.15.114:0/84618432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec78150300 0x7fec78156d30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009870 tx=0x7fec6c01c4d0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec7fe00640 1 -- 172.21.15.114:0/84618432 shutdown_connections 2024-02-17T12:19:07.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec7fe00640 1 --2- 172.21.15.114:0/84618432 >> v2:172.21.15.116:3300/0 conn(0x7fec780714c0 0x7fec780aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec7fe00640 1 --2- 172.21.15.114:0/84618432 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec78150300 0x7fec78156d30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec7fe00640 1 -- 172.21.15.114:0/84618432 >> 172.21.15.114:0/84618432 conn(0x7fec780c4f20 msgr2=0x7fec780c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:07.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec7fe00640 1 -- 172.21.15.114:0/84618432 shutdown_connections 2024-02-17T12:19:07.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.884+0000 7fec7fe00640 1 -- 172.21.15.114:0/84618432 wait complete. 2024-02-17T12:19:07.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7fe00640 1 Processor -- start 2024-02-17T12:19:07.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7fe00640 1 -- start start 2024-02-17T12:19:07.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec780714c0 0x7fec780c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:07.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec780aa6a0 0x7fec780c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec78150300 0x7fec781434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780abd00 con 0x7fec780aa6a0 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec781ec480 con 0x7fec78150300 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec781ebf10 con 0x7fec780714c0 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec780aa6a0 0x7fec780c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7d400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec780714c0 0x7fec780c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec780aa6a0 0x7fec780c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40720/0 (socket says 172.21.15.114:40720) 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7ca00640 1 -- 172.21.15.114:0/116363714 learned_addr learned my addr 172.21.15.114:0/116363714 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7de00640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec78150300 0x7fec781434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7ca00640 1 -- 172.21.15.114:0/116363714 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec780714c0 msgr2=0x7fec780c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7ca00640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec780714c0 0x7fec780c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7ca00640 1 -- 172.21.15.114:0/116363714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec78150300 msgr2=0x7fec781434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7ca00640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec78150300 0x7fec781434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7ca00640 1 -- 172.21.15.114:0/116363714 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c0094d0 con 0x7fec780aa6a0 2024-02-17T12:19:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7ca00640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec780aa6a0 0x7fec780c8640 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fec6400e930 tx=0x7fec6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec75600640 1 -- 172.21.15.114:0/116363714 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64009690 con 0x7fec780aa6a0 2024-02-17T12:19:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec75600640 1 -- 172.21.15.114:0/116363714 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6400ca00 con 0x7fec780aa6a0 2024-02-17T12:19:07.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec75600640 1 -- 172.21.15.114:0/116363714 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6400cd70 con 0x7fec780aa6a0 2024-02-17T12:19:07.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7fe00640 1 -- 172.21.15.114:0/116363714 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec780ab360 con 0x7fec780aa6a0 2024-02-17T12:19:07.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.888+0000 7fec7fe00640 1 -- 172.21.15.114:0/116363714 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec780ab920 con 0x7fec780aa6a0 2024-02-17T12:19:07.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.892+0000 7fec7fe00640 1 -- 172.21.15.114:0/116363714 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec78074840 con 0x7fec780aa6a0 2024-02-17T12:19:07.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.892+0000 7fec75600640 1 -- 172.21.15.114:0/116363714 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fec64013470 con 0x7fec780aa6a0 2024-02-17T12:19:07.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.892+0000 7fec75600640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec58066e40 0x7fec58069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:07.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.892+0000 7fec75600640 1 -- 172.21.15.114:0/116363714 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec64084bd0 con 0x7fec780aa6a0 2024-02-17T12:19:07.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.892+0000 7fec7d400640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec58066e40 0x7fec58069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:07.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.892+0000 7fec7d400640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec58066e40 0x7fec58069300 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0ae000 tx=0x7fec6c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:07.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:07.896+0000 7fec75600640 1 -- 172.21.15.114:0/116363714 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fec64051bc0 con 0x7fec780aa6a0 2024-02-17T12:19:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.080+0000 7fec7fe00640 1 -- 172.21.15.114:0/116363714 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec78147080 con 0x7fec780aa6a0 2024-02-17T12:19:08.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec75600640 1 -- 172.21.15.114:0/116363714 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fec64017090 con 0x7fec780aa6a0 2024-02-17T12:19:08.086 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:08.087 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6501,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1982789506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1982789506},{"type":"v1","addr":"172.21.15.114:6836","nonce":1982789506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:04.061245+0000","modified":"2024-02-17T12:19:07.080013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/709959478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":709959478},{"type":"v1","addr":"172.21.15.114:6837","nonce":709959478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-02-17T12:19:08.087 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 49 2024-02-17T12:19:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 -- 172.21.15.114:0/116363714 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec58066e40 msgr2=0x7fec58069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec58066e40 0x7fec58069300 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0ae000 tx=0x7fec6c0a7000 comp rx=0 tx=0).stop 2024-02-17T12:19:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 -- 172.21.15.114:0/116363714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec780aa6a0 msgr2=0x7fec780c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec780aa6a0 0x7fec780c8640 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fec6400e930 tx=0x7fec6400edf0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 -- 172.21.15.114:0/116363714 shutdown_connections 2024-02-17T12:19:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec78150300 0x7fec781434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fec58066e40 0x7fec58069300 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec780aa6a0 0x7fec780c8640 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 --2- 172.21.15.114:0/116363714 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fec780714c0 0x7fec780c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 -- 172.21.15.114:0/116363714 >> 172.21.15.114:0/116363714 conn(0x7fec780c4f20 msgr2=0x7fec78152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 -- 172.21.15.114:0/116363714 shutdown_connections 2024-02-17T12:19:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.084+0000 7fec7fe00640 1 -- 172.21.15.114:0/116363714 wait complete. 2024-02-17T12:19:08.107 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:08.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bee00640 1 Processor -- start 2024-02-17T12:19:08.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bee00640 1 -- start start 2024-02-17T12:19:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bee00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b80c25a0 0x7f41b806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bee00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41b8152c50 0x7f41b81530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bee00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b8156270 con 0x7f41b806db50 2024-02-17T12:19:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bee00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b8071630 con 0x7f41b8152c50 2024-02-17T12:19:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bee00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8156550 con 0x7f41b80c25a0 2024-02-17T12:19:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41b8152c50 0x7f41b81530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41b8152c50 0x7f41b81530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40730/0 (socket says 172.21.15.114:40730) 2024-02-17T12:19:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bce00640 1 -- 172.21.15.114:0/3843714894 learned_addr learned my addr 172.21.15.114:0/3843714894 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41b7e00640 1 --2- 172.21.15.114:0/3843714894 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b80c25a0 0x7f41b806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bce00640 1 -- 172.21.15.114:0/3843714894 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b80c25a0 msgr2=0x7f41b806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bce00640 1 --2- 172.21.15.114:0/3843714894 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b80c25a0 0x7f41b806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bce00640 1 -- 172.21.15.114:0/3843714894 >> v1:172.21.15.116:6789/0 conn(0x7f41b806db50 legacy=0x7f41b814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41bce00640 1 -- 172.21.15.114:0/3843714894 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b8156830 con 0x7f41b8152c50 2024-02-17T12:19:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.240+0000 7f41b7e00640 1 --2- 172.21.15.114:0/3843714894 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b80c25a0 0x7f41b806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41bce00640 1 --2- 172.21.15.114:0/3843714894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b8152c50 0x7f41b81530e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009870 tx=0x7f41b001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d75874cc85d717 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41b6a00640 1 -- 172.21.15.114:0/3843714894 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00ab600 con 0x7f41b8152c50 2024-02-17T12:19:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41b6a00640 1 -- 172.21.15.114:0/3843714894 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b00a7050 con 0x7f41b8152c50 2024-02-17T12:19:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41b6a00640 1 -- 172.21.15.114:0/3843714894 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b00ab980 con 0x7f41b8152c50 2024-02-17T12:19:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41bee00640 1 -- 172.21.15.114:0/3843714894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b8152c50 msgr2=0x7f41b81530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41bee00640 1 --2- 172.21.15.114:0/3843714894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b8152c50 0x7f41b81530e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009870 tx=0x7f41b001c3d0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41bee00640 1 -- 172.21.15.114:0/3843714894 shutdown_connections 2024-02-17T12:19:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41bee00640 1 --2- 172.21.15.114:0/3843714894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b8152c50 0x7f41b81530e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41bee00640 1 --2- 172.21.15.114:0/3843714894 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b80c25a0 0x7f41b806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41bee00640 1 -- 172.21.15.114:0/3843714894 >> 172.21.15.114:0/3843714894 conn(0x7f41b80a8490 msgr2=0x7f41b80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41bee00640 1 -- 172.21.15.114:0/3843714894 shutdown_connections 2024-02-17T12:19:08.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.244+0000 7f41bee00640 1 -- 172.21.15.114:0/3843714894 wait complete. 2024-02-17T12:19:08.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 Processor -- start 2024-02-17T12:19:08.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 -- start start 2024-02-17T12:19:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b806db50 0x7f41b8145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b80c25a0 0x7f41b8143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b8152c50 0x7f41b81ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8140eb0 con 0x7f41b806db50 2024-02-17T12:19:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8143fa0 con 0x7f41b80c25a0 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b8140860 con 0x7f41b8152c50 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41b7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b806db50 0x7f41b8145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41b7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b806db50 0x7f41b8145080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40736/0 (socket says 172.21.15.114:40736) 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41b7e00640 1 -- 172.21.15.114:0/2996829207 learned_addr learned my addr 172.21.15.114:0/2996829207 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bce00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b8152c50 0x7f41b81ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41b7400640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b80c25a0 0x7f41b8143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41b7e00640 1 -- 172.21.15.114:0/2996829207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b8152c50 msgr2=0x7f41b81ed3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41b7e00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b8152c50 0x7f41b81ed3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41b7e00640 1 -- 172.21.15.114:0/2996829207 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b80c25a0 msgr2=0x7f41b8143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41b7e00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b80c25a0 0x7f41b8143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41b7e00640 1 -- 172.21.15.114:0/2996829207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b00094d0 con 0x7f41b806db50 2024-02-17T12:19:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41b7e00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b806db50 0x7f41b8145080 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f41a800cf60 tx=0x7f41a800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41afe00640 1 -- 172.21.15.114:0/2996829207 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a800d840 con 0x7f41b806db50 2024-02-17T12:19:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41afe00640 1 -- 172.21.15.114:0/2996829207 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a800d9a0 con 0x7f41b806db50 2024-02-17T12:19:08.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41afe00640 1 -- 172.21.15.114:0/2996829207 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a800dd30 con 0x7f41b806db50 2024-02-17T12:19:08.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 -- 172.21.15.114:0/2996829207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b8140b40 con 0x7f41b806db50 2024-02-17T12:19:08.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 -- 172.21.15.114:0/2996829207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b8141340 con 0x7f41b806db50 2024-02-17T12:19:08.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.248+0000 7f41bee00640 1 -- 172.21.15.114:0/2996829207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b80c12a0 con 0x7f41b806db50 2024-02-17T12:19:08.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.252+0000 7f41afe00640 1 -- 172.21.15.114:0/2996829207 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f41a8015440 con 0x7f41b806db50 2024-02-17T12:19:08.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.252+0000 7f41afe00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4198066e40 0x7f4198069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.252+0000 7f41afe00640 1 -- 172.21.15.114:0/2996829207 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41a8085470 con 0x7f41b806db50 2024-02-17T12:19:08.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.252+0000 7f41b7400640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4198066e40 0x7f4198069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.252+0000 7f41b7400640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4198066e40 0x7f4198069300 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f41b8145f00 tx=0x7f41a4007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:08.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.256+0000 7f41afe00640 1 -- 172.21.15.114:0/2996829207 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f41a8052300 con 0x7f41b806db50 2024-02-17T12:19:08.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.412+0000 7f41bee00640 1 -- 172.21.15.114:0/2996829207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41b8074840 con 0x7f41b806db50 2024-02-17T12:19:08.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.412+0000 7f41afe00640 1 -- 172.21.15.114:0/2996829207 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16672 (secure 0 0 0) 0x7f41a80559c0 con 0x7f41b806db50 2024-02-17T12:19:08.418 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:08.418 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":68,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:05.697462+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:08.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 -- 172.21.15.114:0/2996829207 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4198066e40 msgr2=0x7f4198069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4198066e40 0x7f4198069300 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f41b8145f00 tx=0x7f41a4007e40 comp rx=0 tx=0).stop 2024-02-17T12:19:08.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 -- 172.21.15.114:0/2996829207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b806db50 msgr2=0x7f41b8145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b806db50 0x7f41b8145080 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f41a800cf60 tx=0x7f41a800cf90 comp rx=0 tx=0).stop 2024-02-17T12:19:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 -- 172.21.15.114:0/2996829207 shutdown_connections 2024-02-17T12:19:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b8152c50 0x7f41b81ed3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b80c25a0 0x7f41b8143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4198066e40 0x7f4198069300 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 --2- 172.21.15.114:0/2996829207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b806db50 0x7f41b8145080 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 -- 172.21.15.114:0/2996829207 >> 172.21.15.114:0/2996829207 conn(0x7f41b80a8490 msgr2=0x7f41b8142000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 -- 172.21.15.114:0/2996829207 shutdown_connections 2024-02-17T12:19:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.416+0000 7f41bee00640 1 -- 172.21.15.114:0/2996829207 wait complete. 2024-02-17T12:19:08.440 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T12:19:08.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:19:08.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf3a200640 1 Processor -- start 2024-02-17T12:19:08.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf3a200640 1 -- start start 2024-02-17T12:19:08.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf3a200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 0x7fcf341558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf3a200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcf340c8790 0x7fcf3406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf3a200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf34155e00 con 0x7fcf3406d170 2024-02-17T12:19:08.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf3a200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf340c60b0 con 0x7fcf340c8790 2024-02-17T12:19:08.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf3a200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340c7a00 con 0x7fcf34152460 2024-02-17T12:19:08.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf33e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcf3406d170 0x7fcf340c4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42116/0 (socket says 172.21.15.114:42116) 2024-02-17T12:19:08.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf33e00640 1 -- 172.21.15.114:0/2442249218 learned_addr learned my addr 172.21.15.114:0/2442249218 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:08.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf33400640 1 --2- 172.21.15.114:0/2442249218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 0x7fcf341558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf32a00640 1 --2- 172.21.15.114:0/2442249218 >> v2:172.21.15.116:3300/0 conn(0x7fcf340c8790 0x7fcf3406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf32000640 1 -- 172.21.15.114:0/2442249218 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206645905 0 0) 0x7fcf2c001120 con 0x7fcf3406d170 2024-02-17T12:19:08.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf32000640 1 -- 172.21.15.114:0/2442249218 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf18003530 con 0x7fcf3406d170 2024-02-17T12:19:08.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf33400640 1 -- 172.21.15.114:0/2442249218 >> v2:172.21.15.116:3300/0 conn(0x7fcf340c8790 msgr2=0x7fcf3406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:08.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf33400640 1 --2- 172.21.15.114:0/2442249218 >> v2:172.21.15.116:3300/0 conn(0x7fcf340c8790 0x7fcf3406cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf33400640 1 -- 172.21.15.114:0/2442249218 >> v1:172.21.15.114:6789/0 conn(0x7fcf3406d170 legacy=0x7fcf340c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf33400640 1 -- 172.21.15.114:0/2442249218 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3406c7a0 con 0x7fcf34152460 2024-02-17T12:19:08.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.572+0000 7fcf32a00640 1 --2- 172.21.15.114:0/2442249218 >> v2:172.21.15.116:3300/0 conn(0x7fcf340c8790 0x7fcf3406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf33400640 1 --2- 172.21.15.114:0/2442249218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 0x7fcf341558c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009d90 tx=0x7fcf2401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d3f136e3b3475a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf32000640 1 -- 172.21.15.114:0/2442249218 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf240a5890 con 0x7fcf34152460 2024-02-17T12:19:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf32000640 1 -- 172.21.15.114:0/2442249218 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf240a59f0 con 0x7fcf34152460 2024-02-17T12:19:08.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf32000640 1 -- 172.21.15.114:0/2442249218 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf240a5d80 con 0x7fcf34152460 2024-02-17T12:19:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf3a200640 1 -- 172.21.15.114:0/2442249218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 msgr2=0x7fcf341558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf3a200640 1 --2- 172.21.15.114:0/2442249218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 0x7fcf341558c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009d90 tx=0x7fcf2401c8e0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf3a200640 1 -- 172.21.15.114:0/2442249218 shutdown_connections 2024-02-17T12:19:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf3a200640 1 --2- 172.21.15.114:0/2442249218 >> v2:172.21.15.116:3300/0 conn(0x7fcf340c8790 0x7fcf3406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf3a200640 1 --2- 172.21.15.114:0/2442249218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 0x7fcf341558c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf3a200640 1 -- 172.21.15.114:0/2442249218 >> 172.21.15.114:0/2442249218 conn(0x7fcf340ac1e0 msgr2=0x7fcf340ac5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf3a200640 1 -- 172.21.15.114:0/2442249218 shutdown_connections 2024-02-17T12:19:08.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.576+0000 7fcf3a200640 1 -- 172.21.15.114:0/2442249218 wait complete. 2024-02-17T12:19:08.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 Processor -- start 2024-02-17T12:19:08.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 -- start start 2024-02-17T12:19:08.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf340c8790 0x7fcf341ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 0x7fcf34151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf341ee9a0 0x7fcf340ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340ad470 con 0x7fcf341ee9a0 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340aad60 con 0x7fcf340c8790 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340ad6c0 con 0x7fcf34152460 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf341ee9a0 0x7fcf340ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf341ee9a0 0x7fcf340ae760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40740/0 (socket says 172.21.15.114:40740) 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33e00640 1 -- 172.21.15.114:0/4253396257 learned_addr learned my addr 172.21.15.114:0/4253396257 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33400640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf340c8790 0x7fcf341ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf32a00640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 0x7fcf34151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33e00640 1 -- 172.21.15.114:0/4253396257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 msgr2=0x7fcf34151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33e00640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 0x7fcf34151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33e00640 1 -- 172.21.15.114:0/4253396257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf340c8790 msgr2=0x7fcf341ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33e00640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf340c8790 0x7fcf341ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33e00640 1 -- 172.21.15.114:0/4253396257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20009420 con 0x7fcf341ee9a0 2024-02-17T12:19:08.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33400640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf340c8790 0x7fcf341ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:08.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf33e00640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf341ee9a0 0x7fcf340ae760 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00c700 tx=0x7fcf2c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:08.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf2b400640 1 -- 172.21.15.114:0/4253396257 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c005ac0 con 0x7fcf341ee9a0 2024-02-17T12:19:08.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf2b400640 1 -- 172.21.15.114:0/4253396257 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c005c20 con 0x7fcf341ee9a0 2024-02-17T12:19:08.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 -- 172.21.15.114:0/4253396257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf24009a70 con 0x7fcf341ee9a0 2024-02-17T12:19:08.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf2b400640 1 -- 172.21.15.114:0/4253396257 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c001d60 con 0x7fcf341ee9a0 2024-02-17T12:19:08.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 -- 172.21.15.114:0/4253396257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf340adc80 con 0x7fcf341ee9a0 2024-02-17T12:19:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.580+0000 7fcf3a200640 1 -- 172.21.15.114:0/4253396257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf34074840 con 0x7fcf341ee9a0 2024-02-17T12:19:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.584+0000 7fcf2b400640 1 -- 172.21.15.114:0/4253396257 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fcf2c007070 con 0x7fcf341ee9a0 2024-02-17T12:19:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.584+0000 7fcf2b400640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcf14066e60 0x7fcf14069320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.584+0000 7fcf2b400640 1 -- 172.21.15.114:0/4253396257 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf2c083d80 con 0x7fcf341ee9a0 2024-02-17T12:19:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.584+0000 7fcf33400640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcf14066e60 0x7fcf14069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.584+0000 7fcf33400640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcf14066e60 0x7fcf14069320 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcf240af000 tx=0x7fcf240a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:08.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.588+0000 7fcf2b400640 1 -- 172.21.15.114:0/4253396257 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf2c050b90 con 0x7fcf341ee9a0 2024-02-17T12:19:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.740+0000 7fcf3a200640 1 -- 172.21.15.114:0/4253396257 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf34155e00 con 0x7fcf14066e60 2024-02-17T12:19:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.748+0000 7fcf2b400640 1 -- 172.21.15.114:0/4253396257 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287114 (secure 0 0 0) 0x7fcf34155e00 con 0x7fcf14066e60 2024-02-17T12:19:08.756 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:19:08.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 -- 172.21.15.114:0/4253396257 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcf14066e60 msgr2=0x7fcf14069320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcf14066e60 0x7fcf14069320 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcf240af000 tx=0x7fcf240a7070 comp rx=0 tx=0).stop 2024-02-17T12:19:08.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 -- 172.21.15.114:0/4253396257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf341ee9a0 msgr2=0x7fcf340ae760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf341ee9a0 0x7fcf340ae760 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00c700 tx=0x7fcf2c00cbc0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 -- 172.21.15.114:0/4253396257 shutdown_connections 2024-02-17T12:19:08.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcf14066e60 0x7fcf14069320 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf341ee9a0 0x7fcf340ae760 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcf34152460 0x7fcf34151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 --2- 172.21.15.114:0/4253396257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf340c8790 0x7fcf341ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 -- 172.21.15.114:0/4253396257 >> 172.21.15.114:0/4253396257 conn(0x7fcf340ac1e0 msgr2=0x7fcf340c9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:08.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 -- 172.21.15.114:0/4253396257 shutdown_connections 2024-02-17T12:19:08.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.752+0000 7fcf3a200640 1 -- 172.21.15.114:0/4253396257 wait complete. 2024-02-17T12:19:08.777 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-02-17T12:19:07.250908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240268,"kb_used_data":7452,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734452,"statfs":{"total":773094113280,"available":772848078848,"internally_reserved":0,"allocated":7630848,"data_stored":3963452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.571857"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.718886+0000","last_change":"2024-02-17T12:19:04.712400+0000","last_active":"2024-02-17T12:19:04.718886+0000","last_peered":"2024-02-17T12:19:04.718886+0000","last_clean":"2024-02-17T12:19:04.718886+0000","last_became_active":"2024-02-17T12:19:04.711598+0000","last_became_peered":"2024-02-17T12:19:04.711598+0000","last_unstale":"2024-02-17T12:19:04.718886+0000","last_undegraded":"2024-02-17T12:19:04.718886+0000","last_fullsized":"2024-02-17T12:19:04.718886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727092+0000","last_change":"2024-02-17T12:19:04.723008+0000","last_active":"2024-02-17T12:19:04.727092+0000","last_peered":"2024-02-17T12:19:04.727092+0000","last_clean":"2024-02-17T12:19:04.727092+0000","last_became_active":"2024-02-17T12:19:04.722730+0000","last_became_peered":"2024-02-17T12:19:04.722730+0000","last_unstale":"2024-02-17T12:19:04.727092+0000","last_undegraded":"2024-02-17T12:19:04.727092+0000","last_fullsized":"2024-02-17T12:19:04.727092+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:12:48.461694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699464+0000","last_change":"2024-02-17T12:19:03.699464+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699464+0000","last_undegraded":"2024-02-17T12:19:03.699464+0000","last_fullsized":"2024-02-17T12:19:03.699464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699042+0000","last_change":"2024-02-17T12:19:03.699042+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699042+0000","last_undegraded":"2024-02-17T12:19:03.699042+0000","last_fullsized":"2024-02-17T12:19:03.699042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.692631+0000","last_change":"2024-02-17T12:19:03.692631+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.692631+0000","last_undegraded":"2024-02-17T12:19:03.692631+0000","last_fullsized":"2024-02-17T12:19:03.692631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717921+0000","last_change":"2024-02-17T12:19:04.713676+0000","last_active":"2024-02-17T12:19:04.717921+0000","last_peered":"2024-02-17T12:19:04.717921+0000","last_clean":"2024-02-17T12:19:04.717921+0000","last_became_active":"2024-02-17T12:19:04.710032+0000","last_became_peered":"2024-02-17T12:19:04.710032+0000","last_unstale":"2024-02-17T12:19:04.717921+0000","last_undegraded":"2024-02-17T12:19:04.717921+0000","last_fullsized":"2024-02-17T12:19:04.717921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:15.747901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698538+0000","last_change":"2024-02-17T12:19:03.698538+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698538+0000","last_undegraded":"2024-02-17T12:19:03.698538+0000","last_fullsized":"2024-02-17T12:19:03.698538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719254+0000","last_change":"2024-02-17T12:19:04.716344+0000","last_active":"2024-02-17T12:19:04.719254+0000","last_peered":"2024-02-17T12:19:04.719254+0000","last_clean":"2024-02-17T12:19:04.719254+0000","last_became_active":"2024-02-17T12:19:04.716003+0000","last_became_peered":"2024-02-17T12:19:04.716003+0000","last_unstale":"2024-02-17T12:19:04.719254+0000","last_undegraded":"2024-02-17T12:19:04.719254+0000","last_fullsized":"2024-02-17T12:19:04.719254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:22.948492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.710091+0000","last_change":"2024-02-17T12:19:04.705511+0000","last_active":"2024-02-17T12:19:04.710091+0000","last_peered":"2024-02-17T12:19:04.710091+0000","last_clean":"2024-02-17T12:19:04.710091+0000","last_became_active":"2024-02-17T12:19:04.705195+0000","last_became_peered":"2024-02-17T12:19:04.705195+0000","last_unstale":"2024-02-17T12:19:04.710091+0000","last_undegraded":"2024-02-17T12:19:04.710091+0000","last_fullsized":"2024-02-17T12:19:04.710091+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:45:43.198275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726370+0000","last_change":"2024-02-17T12:19:04.721693+0000","last_active":"2024-02-17T12:19:04.726370+0000","last_peered":"2024-02-17T12:19:04.726370+0000","last_clean":"2024-02-17T12:19:04.726370+0000","last_became_active":"2024-02-17T12:19:04.721343+0000","last_became_peered":"2024-02-17T12:19:04.721343+0000","last_unstale":"2024-02-17T12:19:04.726370+0000","last_undegraded":"2024-02-17T12:19:04.726370+0000","last_fullsized":"2024-02-17T12:19:04.726370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:34:02.841400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727902+0000","last_change":"2024-02-17T12:19:04.717487+0000","last_active":"2024-02-17T12:19:04.727902+0000","last_peered":"2024-02-17T12:19:04.727902+0000","last_clean":"2024-02-17T12:19:04.727902+0000","last_became_active":"2024-02-17T12:19:04.717208+0000","last_became_peered":"2024-02-17T12:19:04.717208+0000","last_unstale":"2024-02-17T12:19:04.727902+0000","last_undegraded":"2024-02-17T12:19:04.727902+0000","last_fullsized":"2024-02-17T12:19:04.727902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:07:05.322779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726397+0000","last_change":"2024-02-17T12:19:04.720687+0000","last_active":"2024-02-17T12:19:04.726397+0000","last_peered":"2024-02-17T12:19:04.726397+0000","last_clean":"2024-02-17T12:19:04.726397+0000","last_became_active":"2024-02-17T12:19:04.720429+0000","last_became_peered":"2024-02-17T12:19:04.720429+0000","last_unstale":"2024-02-17T12:19:04.726397+0000","last_undegraded":"2024-02-17T12:19:04.726397+0000","last_fullsized":"2024-02-17T12:19:04.726397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:36:34.252865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.700312+0000","last_change":"2024-02-17T12:19:03.700312+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.700312+0000","last_undegraded":"2024-02-17T12:19:03.700312+0000","last_fullsized":"2024-02-17T12:19:03.700312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697927+0000","last_change":"2024-02-17T12:19:03.697927+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697927+0000","last_undegraded":"2024-02-17T12:19:03.697927+0000","last_fullsized":"2024-02-17T12:19:03.697927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719297+0000","last_change":"2024-02-17T12:19:04.710789+0000","last_active":"2024-02-17T12:19:04.719297+0000","last_peered":"2024-02-17T12:19:04.719297+0000","last_clean":"2024-02-17T12:19:04.719297+0000","last_became_active":"2024-02-17T12:19:04.710321+0000","last_became_peered":"2024-02-17T12:19:04.710321+0000","last_unstale":"2024-02-17T12:19:04.719297+0000","last_undegraded":"2024-02-17T12:19:04.719297+0000","last_fullsized":"2024-02-17T12:19:04.719297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:50.535947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.688714+0000","last_change":"2024-02-17T12:19:03.688714+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.688714+0000","last_undegraded":"2024-02-17T12:19:03.688714+0000","last_fullsized":"2024-02-17T12:19:03.688714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689044+0000","last_change":"2024-02-17T12:19:03.689044+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689044+0000","last_undegraded":"2024-02-17T12:19:03.689044+0000","last_fullsized":"2024-02-17T12:19:03.689044+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698438+0000","last_change":"2024-02-17T12:19:03.698438+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698438+0000","last_undegraded":"2024-02-17T12:19:03.698438+0000","last_fullsized":"2024-02-17T12:19:03.698438+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.728162+0000","last_change":"2024-02-17T12:19:04.718758+0000","last_active":"2024-02-17T12:19:04.728162+0000","last_peered":"2024-02-17T12:19:04.728162+0000","last_clean":"2024-02-17T12:19:04.728162+0000","last_became_active":"2024-02-17T12:19:04.718486+0000","last_became_peered":"2024-02-17T12:19:04.718486+0000","last_unstale":"2024-02-17T12:19:04.728162+0000","last_undegraded":"2024-02-17T12:19:04.728162+0000","last_fullsized":"2024-02-17T12:19:04.728162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698648+0000","last_change":"2024-02-17T12:19:03.698648+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698648+0000","last_undegraded":"2024-02-17T12:19:03.698648+0000","last_fullsized":"2024-02-17T12:19:03.698648+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697743+0000","last_change":"2024-02-17T12:19:03.697743+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697743+0000","last_undegraded":"2024-02-17T12:19:03.697743+0000","last_fullsized":"2024-02-17T12:19:03.697743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724367+0000","last_change":"2024-02-17T12:19:04.720604+0000","last_active":"2024-02-17T12:19:04.724367+0000","last_peered":"2024-02-17T12:19:04.724367+0000","last_clean":"2024-02-17T12:19:04.724367+0000","last_became_active":"2024-02-17T12:19:04.720350+0000","last_became_peered":"2024-02-17T12:19:04.720350+0000","last_unstale":"2024-02-17T12:19:04.724367+0000","last_undegraded":"2024-02-17T12:19:04.724367+0000","last_fullsized":"2024-02-17T12:19:04.724367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:33:24.591926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726220+0000","last_change":"2024-02-17T12:19:04.716818+0000","last_active":"2024-02-17T12:19:04.726220+0000","last_peered":"2024-02-17T12:19:04.726220+0000","last_clean":"2024-02-17T12:19:04.726220+0000","last_became_active":"2024-02-17T12:19:04.716507+0000","last_became_peered":"2024-02-17T12:19:04.716507+0000","last_unstale":"2024-02-17T12:19:04.726220+0000","last_undegraded":"2024-02-17T12:19:04.726220+0000","last_fullsized":"2024-02-17T12:19:04.726220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697274+0000","last_change":"2024-02-17T12:19:03.697274+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697274+0000","last_undegraded":"2024-02-17T12:19:03.697274+0000","last_fullsized":"2024-02-17T12:19:03.697274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731509+0000","last_change":"2024-02-17T12:19:04.726126+0000","last_active":"2024-02-17T12:19:04.731509+0000","last_peered":"2024-02-17T12:19:04.731509+0000","last_clean":"2024-02-17T12:19:04.731509+0000","last_became_active":"2024-02-17T12:19:04.725344+0000","last_became_peered":"2024-02-17T12:19:04.725344+0000","last_unstale":"2024-02-17T12:19:04.731509+0000","last_undegraded":"2024-02-17T12:19:04.731509+0000","last_fullsized":"2024-02-17T12:19:04.731509+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:35:15.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.701420+0000","last_change":"2024-02-17T12:19:03.701420+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.701420+0000","last_undegraded":"2024-02-17T12:19:03.701420+0000","last_fullsized":"2024-02-17T12:19:03.701420+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689731+0000","last_change":"2024-02-17T12:19:03.689731+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689731+0000","last_undegraded":"2024-02-17T12:19:03.689731+0000","last_fullsized":"2024-02-17T12:19:03.689731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719039+0000","last_change":"2024-02-17T12:19:04.713023+0000","last_active":"2024-02-17T12:19:04.719039+0000","last_peered":"2024-02-17T12:19:04.719039+0000","last_clean":"2024-02-17T12:19:04.719039+0000","last_became_active":"2024-02-17T12:19:04.712535+0000","last_became_peered":"2024-02-17T12:19:04.712535+0000","last_unstale":"2024-02-17T12:19:04.719039+0000","last_undegraded":"2024-02-17T12:19:04.719039+0000","last_fullsized":"2024-02-17T12:19:04.719039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724327+0000","last_change":"2024-02-17T12:19:04.721331+0000","last_active":"2024-02-17T12:19:04.724327+0000","last_peered":"2024-02-17T12:19:04.724327+0000","last_clean":"2024-02-17T12:19:04.724327+0000","last_became_active":"2024-02-17T12:19:04.721066+0000","last_became_peered":"2024-02-17T12:19:04.721066+0000","last_unstale":"2024-02-17T12:19:04.724327+0000","last_undegraded":"2024-02-17T12:19:04.724327+0000","last_fullsized":"2024-02-17T12:19:04.724327+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:26:29.549996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731487+0000","last_change":"2024-02-17T12:19:04.726119+0000","last_active":"2024-02-17T12:19:04.731487+0000","last_peered":"2024-02-17T12:19:04.731487+0000","last_clean":"2024-02-17T12:19:04.731487+0000","last_became_active":"2024-02-17T12:19:04.725509+0000","last_became_peered":"2024-02-17T12:19:04.725509+0000","last_unstale":"2024-02-17T12:19:04.731487+0000","last_undegraded":"2024-02-17T12:19:04.731487+0000","last_fullsized":"2024-02-17T12:19:04.731487+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:10:27.065029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.690070+0000","last_change":"2024-02-17T12:19:03.690070+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.690070+0000","last_undegraded":"2024-02-17T12:19:03.690070+0000","last_fullsized":"2024-02-17T12:19:03.690070+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.733015+0000","last_change":"2024-02-17T12:19:04.729805+0000","last_active":"2024-02-17T12:19:04.733015+0000","last_peered":"2024-02-17T12:19:04.733015+0000","last_clean":"2024-02-17T12:19:04.733015+0000","last_became_active":"2024-02-17T12:19:04.729388+0000","last_became_peered":"2024-02-17T12:19:04.729388+0000","last_unstale":"2024-02-17T12:19:04.733015+0000","last_undegraded":"2024-02-17T12:19:04.733015+0000","last_fullsized":"2024-02-17T12:19:04.733015+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:27.023399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.691122+0000","last_change":"2024-02-17T12:19:03.691122+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.691122+0000","last_undegraded":"2024-02-17T12:19:03.691122+0000","last_fullsized":"2024-02-17T12:19:03.691122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.721801+0000","last_change":"2024-02-17T12:19:03.709066+0000","last_active":"2024-02-17T12:19:04.721801+0000","last_peered":"2024-02-17T12:19:04.721801+0000","last_clean":"2024-02-17T12:19:04.721801+0000","last_became_active":"2024-02-17T12:19:03.708888+0000","last_became_peered":"2024-02-17T12:19:03.708888+0000","last_unstale":"2024-02-17T12:19:04.721801+0000","last_undegraded":"2024-02-17T12:19:04.721801+0000","last_fullsized":"2024-02-17T12:19:04.721801+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726321+0000","last_change":"2024-02-17T12:19:04.718756+0000","last_active":"2024-02-17T12:19:04.726321+0000","last_peered":"2024-02-17T12:19:04.726321+0000","last_clean":"2024-02-17T12:19:04.726321+0000","last_became_active":"2024-02-17T12:19:04.716924+0000","last_became_peered":"2024-02-17T12:19:04.716924+0000","last_unstale":"2024-02-17T12:19:04.726321+0000","last_undegraded":"2024-02-17T12:19:04.726321+0000","last_fullsized":"2024-02-17T12:19:04.726321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.895909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.707135+0000","last_change":"2024-02-17T12:19:03.703800+0000","last_active":"2024-02-17T12:19:03.707135+0000","last_peered":"2024-02-17T12:19:03.707135+0000","last_clean":"2024-02-17T12:19:03.707135+0000","last_became_active":"2024-02-17T12:19:03.703402+0000","last_became_peered":"2024-02-17T12:19:03.703402+0000","last_unstale":"2024-02-17T12:19:03.707135+0000","last_undegraded":"2024-02-17T12:19:03.707135+0000","last_fullsized":"2024-02-17T12:19:03.707135+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:50.069369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.733047+0000","last_change":"2024-02-17T12:19:04.730207+0000","last_active":"2024-02-17T12:19:04.733047+0000","last_peered":"2024-02-17T12:19:04.733047+0000","last_clean":"2024-02-17T12:19:04.733047+0000","last_became_active":"2024-02-17T12:19:04.729363+0000","last_became_peered":"2024-02-17T12:19:04.729363+0000","last_unstale":"2024-02-17T12:19:04.733047+0000","last_undegraded":"2024-02-17T12:19:04.733047+0000","last_fullsized":"2024-02-17T12:19:04.733047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:14:58.856139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727721+0000","last_change":"2024-02-17T12:19:03.704331+0000","last_active":"2024-02-17T12:19:04.727721+0000","last_peered":"2024-02-17T12:19:04.727721+0000","last_clean":"2024-02-17T12:19:04.727721+0000","last_became_active":"2024-02-17T12:19:03.704078+0000","last_became_peered":"2024-02-17T12:19:03.704078+0000","last_unstale":"2024-02-17T12:19:04.727721+0000","last_undegraded":"2024-02-17T12:19:04.727721+0000","last_fullsized":"2024-02-17T12:19:04.727721+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699017+0000","last_change":"2024-02-17T12:19:03.699017+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699017+0000","last_undegraded":"2024-02-17T12:19:03.699017+0000","last_fullsized":"2024-02-17T12:19:03.699017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.730660+0000","last_change":"2024-02-17T12:19:03.702411+0000","last_active":"2024-02-17T12:19:04.730660+0000","last_peered":"2024-02-17T12:19:04.730660+0000","last_clean":"2024-02-17T12:19:04.730660+0000","last_became_active":"2024-02-17T12:19:03.702166+0000","last_became_peered":"2024-02-17T12:19:03.702166+0000","last_unstale":"2024-02-17T12:19:04.730660+0000","last_undegraded":"2024-02-17T12:19:04.730660+0000","last_fullsized":"2024-02-17T12:19:04.730660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731631+0000","last_change":"2024-02-17T12:19:04.726343+0000","last_active":"2024-02-17T12:19:04.731631+0000","last_peered":"2024-02-17T12:19:04.731631+0000","last_clean":"2024-02-17T12:19:04.731631+0000","last_became_active":"2024-02-17T12:19:04.725870+0000","last_became_peered":"2024-02-17T12:19:04.725870+0000","last_unstale":"2024-02-17T12:19:04.731631+0000","last_undegraded":"2024-02-17T12:19:04.731631+0000","last_fullsized":"2024-02-17T12:19:04.731631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.707153+0000","last_change":"2024-02-17T12:19:03.703159+0000","last_active":"2024-02-17T12:19:03.707153+0000","last_peered":"2024-02-17T12:19:03.707153+0000","last_clean":"2024-02-17T12:19:03.707153+0000","last_became_active":"2024-02-17T12:19:03.702811+0000","last_became_peered":"2024-02-17T12:19:03.702811+0000","last_unstale":"2024-02-17T12:19:03.707153+0000","last_undegraded":"2024-02-17T12:19:03.707153+0000","last_fullsized":"2024-02-17T12:19:03.707153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:54:51.881257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.692218+0000","last_change":"2024-02-17T12:19:03.692218+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.692218+0000","last_undegraded":"2024-02-17T12:19:03.692218+0000","last_fullsized":"2024-02-17T12:19:03.692218+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.709981+0000","last_change":"2024-02-17T12:19:03.706093+0000","last_active":"2024-02-17T12:19:03.709981+0000","last_peered":"2024-02-17T12:19:03.709981+0000","last_clean":"2024-02-17T12:19:03.709981+0000","last_became_active":"2024-02-17T12:19:03.705445+0000","last_became_peered":"2024-02-17T12:19:03.705445+0000","last_unstale":"2024-02-17T12:19:03.709981+0000","last_undegraded":"2024-02-17T12:19:03.709981+0000","last_fullsized":"2024-02-17T12:19:03.709981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:54.097755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699811+0000","last_change":"2024-02-17T12:19:03.699811+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699811+0000","last_undegraded":"2024-02-17T12:19:03.699811+0000","last_fullsized":"2024-02-17T12:19:03.699811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.691609+0000","last_change":"2024-02-17T12:19:03.701055+0000","last_active":"2024-02-17T12:19:04.691609+0000","last_peered":"2024-02-17T12:19:04.691609+0000","last_clean":"2024-02-17T12:19:04.691609+0000","last_became_active":"2024-02-17T12:19:03.695988+0000","last_became_peered":"2024-02-17T12:19:03.695988+0000","last_unstale":"2024-02-17T12:19:04.691609+0000","last_undegraded":"2024-02-17T12:19:04.691609+0000","last_fullsized":"2024-02-17T12:19:04.691609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719274+0000","last_change":"2024-02-17T12:19:04.710559+0000","last_active":"2024-02-17T12:19:04.719274+0000","last_peered":"2024-02-17T12:19:04.719274+0000","last_clean":"2024-02-17T12:19:04.719274+0000","last_became_active":"2024-02-17T12:19:04.709979+0000","last_became_peered":"2024-02-17T12:19:04.709979+0000","last_unstale":"2024-02-17T12:19:04.719274+0000","last_undegraded":"2024-02-17T12:19:04.719274+0000","last_fullsized":"2024-02-17T12:19:04.719274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:32:13.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.705096+0000","last_change":"2024-02-17T12:19:03.702309+0000","last_active":"2024-02-17T12:19:04.705096+0000","last_peered":"2024-02-17T12:19:04.705096+0000","last_clean":"2024-02-17T12:19:04.705096+0000","last_became_active":"2024-02-17T12:19:03.702051+0000","last_became_peered":"2024-02-17T12:19:03.702051+0000","last_unstale":"2024-02-17T12:19:04.705096+0000","last_undegraded":"2024-02-17T12:19:04.705096+0000","last_fullsized":"2024-02-17T12:19:04.705096+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:58.978525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731622+0000","last_change":"2024-02-17T12:19:04.726001+0000","last_active":"2024-02-17T12:19:04.731622+0000","last_peered":"2024-02-17T12:19:04.731622+0000","last_clean":"2024-02-17T12:19:04.731622+0000","last_became_active":"2024-02-17T12:19:04.725747+0000","last_became_peered":"2024-02-17T12:19:04.725747+0000","last_unstale":"2024-02-17T12:19:04.731622+0000","last_undegraded":"2024-02-17T12:19:04.731622+0000","last_fullsized":"2024-02-17T12:19:04.731622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:00.818538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706938+0000","last_change":"2024-02-17T12:19:03.712851+0000","last_active":"2024-02-17T12:19:04.706938+0000","last_peered":"2024-02-17T12:19:04.706938+0000","last_clean":"2024-02-17T12:19:04.706938+0000","last_became_active":"2024-02-17T12:19:03.712584+0000","last_became_peered":"2024-02-17T12:19:03.712584+0000","last_unstale":"2024-02-17T12:19:04.706938+0000","last_undegraded":"2024-02-17T12:19:04.706938+0000","last_fullsized":"2024-02-17T12:19:04.706938+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.714755+0000","last_change":"2024-02-17T12:19:04.709578+0000","last_active":"2024-02-17T12:19:04.714755+0000","last_peered":"2024-02-17T12:19:04.714755+0000","last_clean":"2024-02-17T12:19:04.714755+0000","last_became_active":"2024-02-17T12:19:04.709173+0000","last_became_peered":"2024-02-17T12:19:04.709173+0000","last_unstale":"2024-02-17T12:19:04.714755+0000","last_undegraded":"2024-02-17T12:19:04.714755+0000","last_fullsized":"2024-02-17T12:19:04.714755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:19.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706482+0000","last_change":"2024-02-17T12:19:03.707721+0000","last_active":"2024-02-17T12:19:04.706482+0000","last_peered":"2024-02-17T12:19:04.706482+0000","last_clean":"2024-02-17T12:19:04.706482+0000","last_became_active":"2024-02-17T12:19:03.707435+0000","last_became_peered":"2024-02-17T12:19:03.707435+0000","last_unstale":"2024-02-17T12:19:04.706482+0000","last_undegraded":"2024-02-17T12:19:04.706482+0000","last_fullsized":"2024-02-17T12:19:04.706482+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726909+0000","last_change":"2024-02-17T12:19:04.716812+0000","last_active":"2024-02-17T12:19:04.726909+0000","last_peered":"2024-02-17T12:19:04.726909+0000","last_clean":"2024-02-17T12:19:04.726909+0000","last_became_active":"2024-02-17T12:19:04.716307+0000","last_became_peered":"2024-02-17T12:19:04.716307+0000","last_unstale":"2024-02-17T12:19:04.726909+0000","last_undegraded":"2024-02-17T12:19:04.726909+0000","last_fullsized":"2024-02-17T12:19:04.726909+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.729950+0000","last_change":"2024-02-17T12:19:03.710532+0000","last_active":"2024-02-17T12:19:04.729950+0000","last_peered":"2024-02-17T12:19:04.729950+0000","last_clean":"2024-02-17T12:19:04.729950+0000","last_became_active":"2024-02-17T12:19:03.710333+0000","last_became_peered":"2024-02-17T12:19:03.710333+0000","last_unstale":"2024-02-17T12:19:04.729950+0000","last_undegraded":"2024-02-17T12:19:04.729950+0000","last_fullsized":"2024-02-17T12:19:04.729950+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689310+0000","last_change":"2024-02-17T12:19:03.689310+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689310+0000","last_undegraded":"2024-02-17T12:19:03.689310+0000","last_fullsized":"2024-02-17T12:19:03.689310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.736361+0000","last_change":"2024-02-17T12:19:03.704237+0000","last_active":"2024-02-17T12:19:04.736361+0000","last_peered":"2024-02-17T12:19:04.736361+0000","last_clean":"2024-02-17T12:19:04.736361+0000","last_became_active":"2024-02-17T12:19:03.703964+0000","last_became_peered":"2024-02-17T12:19:03.703964+0000","last_unstale":"2024-02-17T12:19:04.736361+0000","last_undegraded":"2024-02-17T12:19:04.736361+0000","last_fullsized":"2024-02-17T12:19:04.736361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:45.097730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.710139+0000","last_change":"2024-02-17T12:19:04.702494+0000","last_active":"2024-02-17T12:19:04.710139+0000","last_peered":"2024-02-17T12:19:04.710139+0000","last_clean":"2024-02-17T12:19:04.710139+0000","last_became_active":"2024-02-17T12:19:04.702168+0000","last_became_peered":"2024-02-17T12:19:04.702168+0000","last_unstale":"2024-02-17T12:19:04.710139+0000","last_undegraded":"2024-02-17T12:19:04.710139+0000","last_fullsized":"2024-02-17T12:19:04.710139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.730818+0000","last_change":"2024-02-17T12:19:03.710630+0000","last_active":"2024-02-17T12:19:04.730818+0000","last_peered":"2024-02-17T12:19:04.730818+0000","last_clean":"2024-02-17T12:19:04.730818+0000","last_became_active":"2024-02-17T12:19:03.710185+0000","last_became_peered":"2024-02-17T12:19:03.710185+0000","last_unstale":"2024-02-17T12:19:04.730818+0000","last_undegraded":"2024-02-17T12:19:04.730818+0000","last_fullsized":"2024-02-17T12:19:04.730818+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:07:16.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699993+0000","last_change":"2024-02-17T12:19:03.699993+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699993+0000","last_undegraded":"2024-02-17T12:19:03.699993+0000","last_fullsized":"2024-02-17T12:19:03.699993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.702490+0000","last_change":"2024-02-17T12:19:03.712475+0000","last_active":"2024-02-17T12:19:04.702490+0000","last_peered":"2024-02-17T12:19:04.702490+0000","last_clean":"2024-02-17T12:19:04.702490+0000","last_became_active":"2024-02-17T12:19:03.712117+0000","last_became_peered":"2024-02-17T12:19:03.712117+0000","last_unstale":"2024-02-17T12:19:04.702490+0000","last_undegraded":"2024-02-17T12:19:04.702490+0000","last_fullsized":"2024-02-17T12:19:04.702490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:10.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.734545+0000","last_change":"2024-02-17T12:19:04.727289+0000","last_active":"2024-02-17T12:19:04.734545+0000","last_peered":"2024-02-17T12:19:04.734545+0000","last_clean":"2024-02-17T12:19:04.734545+0000","last_became_active":"2024-02-17T12:19:04.727041+0000","last_became_peered":"2024-02-17T12:19:04.727041+0000","last_unstale":"2024-02-17T12:19:04.734545+0000","last_undegraded":"2024-02-17T12:19:04.734545+0000","last_fullsized":"2024-02-17T12:19:04.734545+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:22:57.622930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.690608+0000","last_change":"2024-02-17T12:19:03.699211+0000","last_active":"2024-02-17T12:19:04.690608+0000","last_peered":"2024-02-17T12:19:04.690608+0000","last_clean":"2024-02-17T12:19:04.690608+0000","last_became_active":"2024-02-17T12:19:03.698244+0000","last_became_peered":"2024-02-17T12:19:03.698244+0000","last_unstale":"2024-02-17T12:19:04.690608+0000","last_undegraded":"2024-02-17T12:19:04.690608+0000","last_fullsized":"2024-02-17T12:19:04.690608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:42.702805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724088+0000","last_change":"2024-02-17T12:19:04.718529+0000","last_active":"2024-02-17T12:19:04.724088+0000","last_peered":"2024-02-17T12:19:04.724088+0000","last_clean":"2024-02-17T12:19:04.724088+0000","last_became_active":"2024-02-17T12:19:04.718251+0000","last_became_peered":"2024-02-17T12:19:04.718251+0000","last_unstale":"2024-02-17T12:19:04.724088+0000","last_undegraded":"2024-02-17T12:19:04.724088+0000","last_fullsized":"2024-02-17T12:19:04.724088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:36:26.635524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.728196+0000","last_change":"2024-02-17T12:19:03.706554+0000","last_active":"2024-02-17T12:19:04.728196+0000","last_peered":"2024-02-17T12:19:04.728196+0000","last_clean":"2024-02-17T12:19:04.728196+0000","last_became_active":"2024-02-17T12:19:03.706236+0000","last_became_peered":"2024-02-17T12:19:03.706236+0000","last_unstale":"2024-02-17T12:19:04.728196+0000","last_undegraded":"2024-02-17T12:19:04.728196+0000","last_fullsized":"2024-02-17T12:19:04.728196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698928+0000","last_change":"2024-02-17T12:19:03.698928+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698928+0000","last_undegraded":"2024-02-17T12:19:03.698928+0000","last_fullsized":"2024-02-17T12:19:03.698928+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.716889+0000","last_change":"2024-02-17T12:19:03.705648+0000","last_active":"2024-02-17T12:19:04.716889+0000","last_peered":"2024-02-17T12:19:04.716889+0000","last_clean":"2024-02-17T12:19:04.716889+0000","last_became_active":"2024-02-17T12:19:03.705325+0000","last_became_peered":"2024-02-17T12:19:03.705325+0000","last_unstale":"2024-02-17T12:19:04.716889+0000","last_undegraded":"2024-02-17T12:19:04.716889+0000","last_fullsized":"2024-02-17T12:19:04.716889+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726342+0000","last_change":"2024-02-17T12:19:04.719005+0000","last_active":"2024-02-17T12:19:04.726342+0000","last_peered":"2024-02-17T12:19:04.726342+0000","last_clean":"2024-02-17T12:19:04.726342+0000","last_became_active":"2024-02-17T12:19:04.717221+0000","last_became_peered":"2024-02-17T12:19:04.717221+0000","last_unstale":"2024-02-17T12:19:04.726342+0000","last_undegraded":"2024-02-17T12:19:04.726342+0000","last_fullsized":"2024-02-17T12:19:04.726342+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:30.970580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724551+0000","last_change":"2024-02-17T12:19:03.708463+0000","last_active":"2024-02-17T12:19:04.724551+0000","last_peered":"2024-02-17T12:19:04.724551+0000","last_clean":"2024-02-17T12:19:04.724551+0000","last_became_active":"2024-02-17T12:19:03.707739+0000","last_became_peered":"2024-02-17T12:19:03.707739+0000","last_unstale":"2024-02-17T12:19:04.724551+0000","last_undegraded":"2024-02-17T12:19:04.724551+0000","last_fullsized":"2024-02-17T12:19:04.724551+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.688517+0000","last_change":"2024-02-17T12:19:03.688517+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.688517+0000","last_undegraded":"2024-02-17T12:19:03.688517+0000","last_fullsized":"2024-02-17T12:19:03.688517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.692466+0000","last_change":"2024-02-17T12:19:03.700286+0000","last_active":"2024-02-17T12:19:04.692466+0000","last_peered":"2024-02-17T12:19:04.692466+0000","last_clean":"2024-02-17T12:19:04.692466+0000","last_became_active":"2024-02-17T12:19:03.700021+0000","last_became_peered":"2024-02-17T12:19:03.700021+0000","last_unstale":"2024-02-17T12:19:04.692466+0000","last_undegraded":"2024-02-17T12:19:04.692466+0000","last_fullsized":"2024-02-17T12:19:04.692466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.696470+0000","last_change":"2024-02-17T12:19:03.696470+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.696470+0000","last_undegraded":"2024-02-17T12:19:03.696470+0000","last_fullsized":"2024-02-17T12:19:03.696470+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.725054+0000","last_change":"2024-02-17T12:19:03.709412+0000","last_active":"2024-02-17T12:19:04.725054+0000","last_peered":"2024-02-17T12:19:04.725054+0000","last_clean":"2024-02-17T12:19:04.725054+0000","last_became_active":"2024-02-17T12:19:03.709021+0000","last_became_peered":"2024-02-17T12:19:03.709021+0000","last_unstale":"2024-02-17T12:19:04.725054+0000","last_undegraded":"2024-02-17T12:19:04.725054+0000","last_fullsized":"2024-02-17T12:19:04.725054+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:44.049163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717759+0000","last_change":"2024-02-17T12:19:04.712404+0000","last_active":"2024-02-17T12:19:04.717759+0000","last_peered":"2024-02-17T12:19:04.717759+0000","last_clean":"2024-02-17T12:19:04.717759+0000","last_became_active":"2024-02-17T12:19:04.711344+0000","last_became_peered":"2024-02-17T12:19:04.711344+0000","last_unstale":"2024-02-17T12:19:04.717759+0000","last_undegraded":"2024-02-17T12:19:04.717759+0000","last_fullsized":"2024-02-17T12:19:04.717759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:33.580841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.713501+0000","last_change":"2024-02-17T12:19:03.706405+0000","last_active":"2024-02-17T12:19:03.713501+0000","last_peered":"2024-02-17T12:19:03.713501+0000","last_clean":"2024-02-17T12:19:03.713501+0000","last_became_active":"2024-02-17T12:19:03.706108+0000","last_became_peered":"2024-02-17T12:19:03.706108+0000","last_unstale":"2024-02-17T12:19:03.713501+0000","last_undegraded":"2024-02-17T12:19:03.713501+0000","last_fullsized":"2024-02-17T12:19:03.713501+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:46:42.443329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.696296+0000","last_change":"2024-02-17T12:19:03.696296+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.696296+0000","last_undegraded":"2024-02-17T12:19:03.696296+0000","last_fullsized":"2024-02-17T12:19:03.696296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.706485+0000","last_change":"2024-02-17T12:19:03.701598+0000","last_active":"2024-02-17T12:19:03.706485+0000","last_peered":"2024-02-17T12:19:03.706485+0000","last_clean":"2024-02-17T12:19:03.706485+0000","last_became_active":"2024-02-17T12:19:03.701326+0000","last_became_peered":"2024-02-17T12:19:03.701326+0000","last_unstale":"2024-02-17T12:19:03.706485+0000","last_undegraded":"2024-02-17T12:19:03.706485+0000","last_fullsized":"2024-02-17T12:19:03.706485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:28:04.886936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.711704+0000","last_change":"2024-02-17T12:19:04.702184+0000","last_active":"2024-02-17T12:19:04.711704+0000","last_peered":"2024-02-17T12:19:04.711704+0000","last_clean":"2024-02-17T12:19:04.711704+0000","last_became_active":"2024-02-17T12:19:04.701908+0000","last_became_peered":"2024-02-17T12:19:04.701908+0000","last_unstale":"2024-02-17T12:19:04.711704+0000","last_undegraded":"2024-02-17T12:19:04.711704+0000","last_fullsized":"2024-02-17T12:19:04.711704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:25:38.680904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.702062+0000","last_change":"2024-02-17T12:19:03.702614+0000","last_active":"2024-02-17T12:19:04.702062+0000","last_peered":"2024-02-17T12:19:04.702062+0000","last_clean":"2024-02-17T12:19:04.702062+0000","last_became_active":"2024-02-17T12:19:03.702360+0000","last_became_peered":"2024-02-17T12:19:03.702360+0000","last_unstale":"2024-02-17T12:19:04.702062+0000","last_undegraded":"2024-02-17T12:19:04.702062+0000","last_fullsized":"2024-02-17T12:19:04.702062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:37.418089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689927+0000","last_change":"2024-02-17T12:19:03.689927+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689927+0000","last_undegraded":"2024-02-17T12:19:03.689927+0000","last_fullsized":"2024-02-17T12:19:03.689927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.725424+0000","last_change":"2024-02-17T12:19:03.706098+0000","last_active":"2024-02-17T12:19:04.725424+0000","last_peered":"2024-02-17T12:19:04.725424+0000","last_clean":"2024-02-17T12:19:04.725424+0000","last_became_active":"2024-02-17T12:19:03.705787+0000","last_became_peered":"2024-02-17T12:19:03.705787+0000","last_unstale":"2024-02-17T12:19:04.725424+0000","last_undegraded":"2024-02-17T12:19:04.725424+0000","last_fullsized":"2024-02-17T12:19:04.725424+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:59.839484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699376+0000","last_change":"2024-02-17T12:19:03.699376+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699376+0000","last_undegraded":"2024-02-17T12:19:03.699376+0000","last_fullsized":"2024-02-17T12:19:03.699376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.711323+0000","last_change":"2024-02-17T12:19:03.707121+0000","last_active":"2024-02-17T12:19:04.711323+0000","last_peered":"2024-02-17T12:19:04.711323+0000","last_clean":"2024-02-17T12:19:04.711323+0000","last_became_active":"2024-02-17T12:19:03.706873+0000","last_became_peered":"2024-02-17T12:19:03.706873+0000","last_unstale":"2024-02-17T12:19:04.711323+0000","last_undegraded":"2024-02-17T12:19:04.711323+0000","last_fullsized":"2024-02-17T12:19:04.711323+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:24.015391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726377+0000","last_change":"2024-02-17T12:19:04.718645+0000","last_active":"2024-02-17T12:19:04.726377+0000","last_peered":"2024-02-17T12:19:04.726377+0000","last_clean":"2024-02-17T12:19:04.726377+0000","last_became_active":"2024-02-17T12:19:04.715738+0000","last_became_peered":"2024-02-17T12:19:04.715738+0000","last_unstale":"2024-02-17T12:19:04.726377+0000","last_undegraded":"2024-02-17T12:19:04.726377+0000","last_fullsized":"2024-02-17T12:19:04.726377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:53.989897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706273+0000","last_change":"2024-02-17T12:19:03.705719+0000","last_active":"2024-02-17T12:19:04.706273+0000","last_peered":"2024-02-17T12:19:04.706273+0000","last_clean":"2024-02-17T12:19:04.706273+0000","last_became_active":"2024-02-17T12:19:03.705394+0000","last_became_peered":"2024-02-17T12:19:03.705394+0000","last_unstale":"2024-02-17T12:19:04.706273+0000","last_undegraded":"2024-02-17T12:19:04.706273+0000","last_fullsized":"2024-02-17T12:19:04.706273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:18.432832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.687985+0000","last_change":"2024-02-17T12:19:03.687985+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.687985+0000","last_undegraded":"2024-02-17T12:19:03.687985+0000","last_fullsized":"2024-02-17T12:19:03.687985+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706298+0000","last_change":"2024-02-17T12:19:03.712607+0000","last_active":"2024-02-17T12:19:04.706298+0000","last_peered":"2024-02-17T12:19:04.706298+0000","last_clean":"2024-02-17T12:19:04.706298+0000","last_became_active":"2024-02-17T12:19:03.712328+0000","last_became_peered":"2024-02-17T12:19:03.712328+0000","last_unstale":"2024-02-17T12:19:04.706298+0000","last_undegraded":"2024-02-17T12:19:04.706298+0000","last_fullsized":"2024-02-17T12:19:04.706298+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717437+0000","last_change":"2024-02-17T12:19:04.711425+0000","last_active":"2024-02-17T12:19:04.717437+0000","last_peered":"2024-02-17T12:19:04.717437+0000","last_clean":"2024-02-17T12:19:04.717437+0000","last_became_active":"2024-02-17T12:19:04.711149+0000","last_became_peered":"2024-02-17T12:19:04.711149+0000","last_unstale":"2024-02-17T12:19:04.717437+0000","last_undegraded":"2024-02-17T12:19:04.717437+0000","last_fullsized":"2024-02-17T12:19:04.717437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:09.191064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.692502+0000","last_change":"2024-02-17T12:19:03.708773+0000","last_active":"2024-02-17T12:19:04.692502+0000","last_peered":"2024-02-17T12:19:04.692502+0000","last_clean":"2024-02-17T12:19:04.692502+0000","last_became_active":"2024-02-17T12:19:03.707579+0000","last_became_peered":"2024-02-17T12:19:03.707579+0000","last_unstale":"2024-02-17T12:19:04.692502+0000","last_undegraded":"2024-02-17T12:19:04.692502+0000","last_fullsized":"2024-02-17T12:19:04.692502+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.709256+0000","last_change":"2024-02-17T12:19:04.699129+0000","last_active":"2024-02-17T12:19:04.709256+0000","last_peered":"2024-02-17T12:19:04.709256+0000","last_clean":"2024-02-17T12:19:04.709256+0000","last_became_active":"2024-02-17T12:19:04.698800+0000","last_became_peered":"2024-02-17T12:19:04.698800+0000","last_unstale":"2024-02-17T12:19:04.709256+0000","last_undegraded":"2024-02-17T12:19:04.709256+0000","last_fullsized":"2024-02-17T12:19:04.709256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.709959+0000","last_change":"2024-02-17T12:19:03.705779+0000","last_active":"2024-02-17T12:19:03.709959+0000","last_peered":"2024-02-17T12:19:03.709959+0000","last_clean":"2024-02-17T12:19:03.709959+0000","last_became_active":"2024-02-17T12:19:03.705453+0000","last_became_peered":"2024-02-17T12:19:03.705453+0000","last_unstale":"2024-02-17T12:19:03.709959+0000","last_undegraded":"2024-02-17T12:19:03.709959+0000","last_fullsized":"2024-02-17T12:19:03.709959+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:14.221858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699370+0000","last_change":"2024-02-17T12:19:03.699370+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699370+0000","last_undegraded":"2024-02-17T12:19:03.699370+0000","last_fullsized":"2024-02-17T12:19:03.699370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706435+0000","last_change":"2024-02-17T12:19:03.710199+0000","last_active":"2024-02-17T12:19:04.706435+0000","last_peered":"2024-02-17T12:19:04.706435+0000","last_clean":"2024-02-17T12:19:04.706435+0000","last_became_active":"2024-02-17T12:19:03.709947+0000","last_became_peered":"2024-02-17T12:19:03.709947+0000","last_unstale":"2024-02-17T12:19:04.706435+0000","last_undegraded":"2024-02-17T12:19:04.706435+0000","last_fullsized":"2024-02-17T12:19:04.706435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.718478+0000","last_change":"2024-02-17T12:19:04.713606+0000","last_active":"2024-02-17T12:19:04.718478+0000","last_peered":"2024-02-17T12:19:04.718478+0000","last_clean":"2024-02-17T12:19:04.718478+0000","last_became_active":"2024-02-17T12:19:04.708088+0000","last_became_peered":"2024-02-17T12:19:04.708088+0000","last_unstale":"2024-02-17T12:19:04.718478+0000","last_undegraded":"2024-02-17T12:19:04.718478+0000","last_fullsized":"2024-02-17T12:19:04.718478+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.704981+0000","last_change":"2024-02-17T12:19:03.701618+0000","last_active":"2024-02-17T12:19:03.704981+0000","last_peered":"2024-02-17T12:19:03.704981+0000","last_clean":"2024-02-17T12:19:03.704981+0000","last_became_active":"2024-02-17T12:19:03.701291+0000","last_became_peered":"2024-02-17T12:19:03.701291+0000","last_unstale":"2024-02-17T12:19:03.704981+0000","last_undegraded":"2024-02-17T12:19:03.704981+0000","last_fullsized":"2024-02-17T12:19:03.704981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.901708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.723067+0000","last_change":"2024-02-17T12:19:04.719250+0000","last_active":"2024-02-17T12:19:04.723067+0000","last_peered":"2024-02-17T12:19:04.723067+0000","last_clean":"2024-02-17T12:19:04.723067+0000","last_became_active":"2024-02-17T12:19:04.718856+0000","last_became_peered":"2024-02-17T12:19:04.718856+0000","last_unstale":"2024-02-17T12:19:04.723067+0000","last_undegraded":"2024-02-17T12:19:04.723067+0000","last_fullsized":"2024-02-17T12:19:04.723067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:53:35.790267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.720220+0000","last_change":"2024-02-17T12:19:03.712148+0000","last_active":"2024-02-17T12:19:03.720220+0000","last_peered":"2024-02-17T12:19:03.720220+0000","last_clean":"2024-02-17T12:19:03.720220+0000","last_became_active":"2024-02-17T12:19:03.711771+0000","last_became_peered":"2024-02-17T12:19:03.711771+0000","last_unstale":"2024-02-17T12:19:03.720220+0000","last_undegraded":"2024-02-17T12:19:03.720220+0000","last_fullsized":"2024-02-17T12:19:03.720220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:14.842866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":253,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.702332+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:19:03.702332+0000","last_peered":"2024-02-17T12:19:03.702332+0000","last_clean":"2024-02-17T12:19:03.702332+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:19:03.702332+0000","last_undegraded":"2024-02-17T12:19:03.702332+0000","last_fullsized":"2024-02-17T12:19:03.702332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88700000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":1.115,"15min":1.115},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88500000000000001,"5min":1.143,"15min":1.143},"last":0.73599999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88700000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.58399999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85299999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.82099999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":831488,"data_stored":355915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.75},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.72199999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65000000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.432},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.625}]}]},{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.44},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.36299999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.621,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":1.387,"15min":1.387},"last":1.014}]},{"osd":4,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.497,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0409999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.714,"15min":1.714},"last":1.149},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.744,"15min":1.744},"last":1.1339999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91500000000000004,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0980000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.002,"5min":1.575,"15min":1.575},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96899999999999997,"5min":1.321,"15min":1.321},"last":0.73599999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64200000000000002,"5min":1.145,"15min":1.145},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.34000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69499999999999995,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58099999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73799999999999999,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.373}]},{"osd":3,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":2.609,"15min":2.609},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.079,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59199999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.90700000000000003,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.997,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.05,"5min":1.095,"15min":1.095},"last":0.60499999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0469999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0820000000000001,"5min":5.375,"15min":5.375},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":1.0169999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.091,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.629,"15min":1.629},"last":0.56799999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":944683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47899999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45100000000000001,"15min":0.45700000000000002},"min":{"1min":0.312,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":1.046,"15min":1.046},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76900000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.58699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66700000000000004}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0129999999999999,"5min":1.139,"15min":1.139},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92800000000000005,"5min":1.038,"15min":1.038},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94499999999999995,"5min":1.095,"15min":1.095},"last":0.999}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0960000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.008}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.042},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90200000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.92200000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28372,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343468,"statfs":{"total":96636764160,"available":96607711232,"internally_reserved":0,"allocated":1384448,"data_stored":931599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84899999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.97399999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75700000000000001,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92400000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90000000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.74299999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86799999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84399999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95099999999999996,"5min":1.052,"15min":1.052},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.95399999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86799999999999999,"5min":1.264,"15min":1.264},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.198,"15min":1.198},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.171,"15min":1.171},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93600000000000005,"5min":1.522,"15min":1.522},"last":0.88200000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89900000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88100000000000001,"5min":1.228,"15min":1.228},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.74299999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":341231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.141,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81999999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93300000000000005,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2749999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.997,"5min":1.252,"15min":1.252},"last":0.83399999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91500000000000004,"5min":1.29,"15min":1.29},"last":0.876},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":1.337,"15min":1.337},"last":0.92400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:19:08.785 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:19:08.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f0557a00640 1 Processor -- start 2024-02-17T12:19:08.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f0557a00640 1 -- start start 2024-02-17T12:19:08.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f0557a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f05500c6460 0x7f055006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f0557a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0550154e30 0x7f05500aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f0557a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0550155dd0 con 0x7f0550152540 2024-02-17T12:19:08.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f0557a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05501588c0 con 0x7f05500c6460 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f0557a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0550155810 con 0x7f0550154e30 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f0555000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0550152540 0x7f0550158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42128/0 (socket says 172.21.15.114:42128) 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f0555000640 1 -- 172.21.15.114:0/1687814898 learned_addr learned my addr 172.21.15.114:0/1687814898 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f054fe00640 1 --2- 172.21.15.114:0/1687814898 >> v2:172.21.15.116:3300/0 conn(0x7f05500c6460 0x7f055006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f0555a00640 1 --2- 172.21.15.114:0/1687814898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0550154e30 0x7f05500aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f054f400640 1 -- 172.21.15.114:0/1687814898 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503945275 0 0) 0x7f0550155dd0 con 0x7f0550152540 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.948+0000 7f054f400640 1 -- 172.21.15.114:0/1687814898 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0534003530 con 0x7f0550152540 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f054f400640 1 -- 172.21.15.114:0/1687814898 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193326768 0 0) 0x7f0534003530 con 0x7f0550152540 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f054fe00640 1 -- 172.21.15.114:0/1687814898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0550154e30 msgr2=0x7f05500aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f054fe00640 1 --2- 172.21.15.114:0/1687814898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0550154e30 0x7f05500aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f054fe00640 1 -- 172.21.15.114:0/1687814898 >> v1:172.21.15.114:6789/0 conn(0x7f0550152540 legacy=0x7f0550158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f054fe00640 1 -- 172.21.15.114:0/1687814898 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550155af0 con 0x7f05500c6460 2024-02-17T12:19:08.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f054fe00640 1 --2- 172.21.15.114:0/1687814898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05500c6460 0x7f055006ff80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f05400097c0 tx=0x7f054001c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8af38218c5f87ea7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:08.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f054f400640 1 -- 172.21.15.114:0/1687814898 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538001680 con 0x7f05500c6460 2024-02-17T12:19:08.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f054f400640 1 -- 172.21.15.114:0/1687814898 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05400a7050 con 0x7f05500c6460 2024-02-17T12:19:08.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f054f400640 1 -- 172.21.15.114:0/1687814898 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400ab620 con 0x7f05500c6460 2024-02-17T12:19:08.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f0557a00640 1 -- 172.21.15.114:0/1687814898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05500c6460 msgr2=0x7f055006ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f0557a00640 1 --2- 172.21.15.114:0/1687814898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05500c6460 0x7f055006ff80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f05400097c0 tx=0x7f054001c2a0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f0557a00640 1 -- 172.21.15.114:0/1687814898 shutdown_connections 2024-02-17T12:19:08.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f0557a00640 1 --2- 172.21.15.114:0/1687814898 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0550154e30 0x7f05500aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f0557a00640 1 --2- 172.21.15.114:0/1687814898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05500c6460 0x7f055006ff80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f0557a00640 1 -- 172.21.15.114:0/1687814898 >> 172.21.15.114:0/1687814898 conn(0x7f05500c4f20 msgr2=0x7f05500c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:08.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f0557a00640 1 -- 172.21.15.114:0/1687814898 shutdown_connections 2024-02-17T12:19:08.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.952+0000 7f0557a00640 1 -- 172.21.15.114:0/1687814898 wait complete. 2024-02-17T12:19:08.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0557a00640 1 Processor -- start 2024-02-17T12:19:08.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0557a00640 1 -- start start 2024-02-17T12:19:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0557a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05500c6460 0x7f0550156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0557a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0550152540 0x7f05500add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0557a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0550154e30 0x7f05501eefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0557a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055015a650 con 0x7f05500c6460 2024-02-17T12:19:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0557a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05501ee5a0 con 0x7f0550152540 2024-02-17T12:19:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0557a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05501eead0 con 0x7f0550154e30 2024-02-17T12:19:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0555000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05500c6460 0x7f0550156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0555000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05500c6460 0x7f0550156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40748/0 (socket says 172.21.15.114:40748) 2024-02-17T12:19:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0555000640 1 -- 172.21.15.114:0/494764414 learned_addr learned my addr 172.21.15.114:0/494764414 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0555a00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0550154e30 0x7f05501eefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f054fe00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0550152540 0x7f05500add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0555000640 1 -- 172.21.15.114:0/494764414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0550154e30 msgr2=0x7f05501eefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0555000640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0550154e30 0x7f05501eefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0555000640 1 -- 172.21.15.114:0/494764414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0550152540 msgr2=0x7f05500add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:08.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0555000640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0550152540 0x7f05500add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:08.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0555000640 1 -- 172.21.15.114:0/494764414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540009420 con 0x7f05500c6460 2024-02-17T12:19:08.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0555000640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05500c6460 0x7f0550156b30 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f053800c780 tx=0x7f053800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:08.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f054cc00640 1 -- 172.21.15.114:0/494764414 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538005ae0 con 0x7f05500c6460 2024-02-17T12:19:08.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f054cc00640 1 -- 172.21.15.114:0/494764414 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0538005c40 con 0x7f05500c6460 2024-02-17T12:19:08.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0557a00640 1 -- 172.21.15.114:0/494764414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055015b760 con 0x7f05500c6460 2024-02-17T12:19:08.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f054cc00640 1 -- 172.21.15.114:0/494764414 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538007070 con 0x7f05500c6460 2024-02-17T12:19:08.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.956+0000 7f0557a00640 1 -- 172.21.15.114:0/494764414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05501ee7f0 con 0x7f05500c6460 2024-02-17T12:19:08.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.960+0000 7f0557a00640 1 -- 172.21.15.114:0/494764414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0550074840 con 0x7f05500c6460 2024-02-17T12:19:08.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.960+0000 7f054cc00640 1 -- 172.21.15.114:0/494764414 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f05380071f0 con 0x7f05500c6460 2024-02-17T12:19:08.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.960+0000 7f054cc00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f052c066e40 0x7f052c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:08.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.960+0000 7f054cc00640 1 -- 172.21.15.114:0/494764414 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05380847b0 con 0x7f05500c6460 2024-02-17T12:19:08.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.960+0000 7f054fe00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f052c066e40 0x7f052c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:08.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.960+0000 7f054fe00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f052c066e40 0x7f052c069300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f05400ad000 tx=0x7f05400a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:08.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:08.964+0000 7f054cc00640 1 -- 172.21.15.114:0/494764414 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0538051650 con 0x7f05500c6460 2024-02-17T12:19:09.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.116+0000 7f0557a00640 1 -- 172.21.15.114:0/494764414 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05500aac10 con 0x7f052c066e40 2024-02-17T12:19:09.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.120+0000 7f054cc00640 1 -- 172.21.15.114:0/494764414 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287114 (secure 0 0 0) 0x7f05500aac10 con 0x7f052c066e40 2024-02-17T12:19:09.129 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:09.130 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.124+0000 7f0557a00640 1 -- 172.21.15.114:0/494764414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f052c066e40 msgr2=0x7f052c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.124+0000 7f0557a00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f052c066e40 0x7f052c069300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f05400ad000 tx=0x7f05400a6000 comp rx=0 tx=0).stop 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.124+0000 7f0557a00640 1 -- 172.21.15.114:0/494764414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05500c6460 msgr2=0x7f0550156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.124+0000 7f0557a00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05500c6460 0x7f0550156b30 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f053800c780 tx=0x7f053800cc40 comp rx=0 tx=0).stop 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.124+0000 7f0557a00640 1 -- 172.21.15.114:0/494764414 shutdown_connections 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.124+0000 7f0557a00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0550154e30 0x7f05501eefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.124+0000 7f0557a00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0550152540 0x7f05500add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.124+0000 7f0557a00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f052c066e40 0x7f052c069300 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.124+0000 7f0557a00640 1 --2- 172.21.15.114:0/494764414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05500c6460 0x7f0550156b30 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.124+0000 7f0557a00640 1 -- 172.21.15.114:0/494764414 >> 172.21.15.114:0/494764414 conn(0x7f05500c4f20 msgr2=0x7f05500c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.128+0000 7f0557a00640 1 -- 172.21.15.114:0/494764414 shutdown_connections 2024-02-17T12:19:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.128+0000 7f0557a00640 1 -- 172.21.15.114:0/494764414 wait complete. 2024-02-17T12:19:09.149 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-02-17T12:19:07.250908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240268,"kb_used_data":7452,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734452,"statfs":{"total":773094113280,"available":772848078848,"internally_reserved":0,"allocated":7630848,"data_stored":3963452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.571857"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.718886+0000","last_change":"2024-02-17T12:19:04.712400+0000","last_active":"2024-02-17T12:19:04.718886+0000","last_peered":"2024-02-17T12:19:04.718886+0000","last_clean":"2024-02-17T12:19:04.718886+0000","last_became_active":"2024-02-17T12:19:04.711598+0000","last_became_peered":"2024-02-17T12:19:04.711598+0000","last_unstale":"2024-02-17T12:19:04.718886+0000","last_undegraded":"2024-02-17T12:19:04.718886+0000","last_fullsized":"2024-02-17T12:19:04.718886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727092+0000","last_change":"2024-02-17T12:19:04.723008+0000","last_active":"2024-02-17T12:19:04.727092+0000","last_peered":"2024-02-17T12:19:04.727092+0000","last_clean":"2024-02-17T12:19:04.727092+0000","last_became_active":"2024-02-17T12:19:04.722730+0000","last_became_peered":"2024-02-17T12:19:04.722730+0000","last_unstale":"2024-02-17T12:19:04.727092+0000","last_undegraded":"2024-02-17T12:19:04.727092+0000","last_fullsized":"2024-02-17T12:19:04.727092+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:12:48.461694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699464+0000","last_change":"2024-02-17T12:19:03.699464+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699464+0000","last_undegraded":"2024-02-17T12:19:03.699464+0000","last_fullsized":"2024-02-17T12:19:03.699464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699042+0000","last_change":"2024-02-17T12:19:03.699042+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699042+0000","last_undegraded":"2024-02-17T12:19:03.699042+0000","last_fullsized":"2024-02-17T12:19:03.699042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.692631+0000","last_change":"2024-02-17T12:19:03.692631+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.692631+0000","last_undegraded":"2024-02-17T12:19:03.692631+0000","last_fullsized":"2024-02-17T12:19:03.692631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717921+0000","last_change":"2024-02-17T12:19:04.713676+0000","last_active":"2024-02-17T12:19:04.717921+0000","last_peered":"2024-02-17T12:19:04.717921+0000","last_clean":"2024-02-17T12:19:04.717921+0000","last_became_active":"2024-02-17T12:19:04.710032+0000","last_became_peered":"2024-02-17T12:19:04.710032+0000","last_unstale":"2024-02-17T12:19:04.717921+0000","last_undegraded":"2024-02-17T12:19:04.717921+0000","last_fullsized":"2024-02-17T12:19:04.717921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:15.747901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698538+0000","last_change":"2024-02-17T12:19:03.698538+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698538+0000","last_undegraded":"2024-02-17T12:19:03.698538+0000","last_fullsized":"2024-02-17T12:19:03.698538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719254+0000","last_change":"2024-02-17T12:19:04.716344+0000","last_active":"2024-02-17T12:19:04.719254+0000","last_peered":"2024-02-17T12:19:04.719254+0000","last_clean":"2024-02-17T12:19:04.719254+0000","last_became_active":"2024-02-17T12:19:04.716003+0000","last_became_peered":"2024-02-17T12:19:04.716003+0000","last_unstale":"2024-02-17T12:19:04.719254+0000","last_undegraded":"2024-02-17T12:19:04.719254+0000","last_fullsized":"2024-02-17T12:19:04.719254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:22.948492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.710091+0000","last_change":"2024-02-17T12:19:04.705511+0000","last_active":"2024-02-17T12:19:04.710091+0000","last_peered":"2024-02-17T12:19:04.710091+0000","last_clean":"2024-02-17T12:19:04.710091+0000","last_became_active":"2024-02-17T12:19:04.705195+0000","last_became_peered":"2024-02-17T12:19:04.705195+0000","last_unstale":"2024-02-17T12:19:04.710091+0000","last_undegraded":"2024-02-17T12:19:04.710091+0000","last_fullsized":"2024-02-17T12:19:04.710091+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:45:43.198275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726370+0000","last_change":"2024-02-17T12:19:04.721693+0000","last_active":"2024-02-17T12:19:04.726370+0000","last_peered":"2024-02-17T12:19:04.726370+0000","last_clean":"2024-02-17T12:19:04.726370+0000","last_became_active":"2024-02-17T12:19:04.721343+0000","last_became_peered":"2024-02-17T12:19:04.721343+0000","last_unstale":"2024-02-17T12:19:04.726370+0000","last_undegraded":"2024-02-17T12:19:04.726370+0000","last_fullsized":"2024-02-17T12:19:04.726370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:34:02.841400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727902+0000","last_change":"2024-02-17T12:19:04.717487+0000","last_active":"2024-02-17T12:19:04.727902+0000","last_peered":"2024-02-17T12:19:04.727902+0000","last_clean":"2024-02-17T12:19:04.727902+0000","last_became_active":"2024-02-17T12:19:04.717208+0000","last_became_peered":"2024-02-17T12:19:04.717208+0000","last_unstale":"2024-02-17T12:19:04.727902+0000","last_undegraded":"2024-02-17T12:19:04.727902+0000","last_fullsized":"2024-02-17T12:19:04.727902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:07:05.322779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726397+0000","last_change":"2024-02-17T12:19:04.720687+0000","last_active":"2024-02-17T12:19:04.726397+0000","last_peered":"2024-02-17T12:19:04.726397+0000","last_clean":"2024-02-17T12:19:04.726397+0000","last_became_active":"2024-02-17T12:19:04.720429+0000","last_became_peered":"2024-02-17T12:19:04.720429+0000","last_unstale":"2024-02-17T12:19:04.726397+0000","last_undegraded":"2024-02-17T12:19:04.726397+0000","last_fullsized":"2024-02-17T12:19:04.726397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:36:34.252865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.700312+0000","last_change":"2024-02-17T12:19:03.700312+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.700312+0000","last_undegraded":"2024-02-17T12:19:03.700312+0000","last_fullsized":"2024-02-17T12:19:03.700312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697927+0000","last_change":"2024-02-17T12:19:03.697927+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697927+0000","last_undegraded":"2024-02-17T12:19:03.697927+0000","last_fullsized":"2024-02-17T12:19:03.697927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719297+0000","last_change":"2024-02-17T12:19:04.710789+0000","last_active":"2024-02-17T12:19:04.719297+0000","last_peered":"2024-02-17T12:19:04.719297+0000","last_clean":"2024-02-17T12:19:04.719297+0000","last_became_active":"2024-02-17T12:19:04.710321+0000","last_became_peered":"2024-02-17T12:19:04.710321+0000","last_unstale":"2024-02-17T12:19:04.719297+0000","last_undegraded":"2024-02-17T12:19:04.719297+0000","last_fullsized":"2024-02-17T12:19:04.719297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:50.535947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.688714+0000","last_change":"2024-02-17T12:19:03.688714+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.688714+0000","last_undegraded":"2024-02-17T12:19:03.688714+0000","last_fullsized":"2024-02-17T12:19:03.688714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689044+0000","last_change":"2024-02-17T12:19:03.689044+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689044+0000","last_undegraded":"2024-02-17T12:19:03.689044+0000","last_fullsized":"2024-02-17T12:19:03.689044+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698438+0000","last_change":"2024-02-17T12:19:03.698438+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698438+0000","last_undegraded":"2024-02-17T12:19:03.698438+0000","last_fullsized":"2024-02-17T12:19:03.698438+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.728162+0000","last_change":"2024-02-17T12:19:04.718758+0000","last_active":"2024-02-17T12:19:04.728162+0000","last_peered":"2024-02-17T12:19:04.728162+0000","last_clean":"2024-02-17T12:19:04.728162+0000","last_became_active":"2024-02-17T12:19:04.718486+0000","last_became_peered":"2024-02-17T12:19:04.718486+0000","last_unstale":"2024-02-17T12:19:04.728162+0000","last_undegraded":"2024-02-17T12:19:04.728162+0000","last_fullsized":"2024-02-17T12:19:04.728162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698648+0000","last_change":"2024-02-17T12:19:03.698648+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698648+0000","last_undegraded":"2024-02-17T12:19:03.698648+0000","last_fullsized":"2024-02-17T12:19:03.698648+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697743+0000","last_change":"2024-02-17T12:19:03.697743+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697743+0000","last_undegraded":"2024-02-17T12:19:03.697743+0000","last_fullsized":"2024-02-17T12:19:03.697743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724367+0000","last_change":"2024-02-17T12:19:04.720604+0000","last_active":"2024-02-17T12:19:04.724367+0000","last_peered":"2024-02-17T12:19:04.724367+0000","last_clean":"2024-02-17T12:19:04.724367+0000","last_became_active":"2024-02-17T12:19:04.720350+0000","last_became_peered":"2024-02-17T12:19:04.720350+0000","last_unstale":"2024-02-17T12:19:04.724367+0000","last_undegraded":"2024-02-17T12:19:04.724367+0000","last_fullsized":"2024-02-17T12:19:04.724367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:33:24.591926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726220+0000","last_change":"2024-02-17T12:19:04.716818+0000","last_active":"2024-02-17T12:19:04.726220+0000","last_peered":"2024-02-17T12:19:04.726220+0000","last_clean":"2024-02-17T12:19:04.726220+0000","last_became_active":"2024-02-17T12:19:04.716507+0000","last_became_peered":"2024-02-17T12:19:04.716507+0000","last_unstale":"2024-02-17T12:19:04.726220+0000","last_undegraded":"2024-02-17T12:19:04.726220+0000","last_fullsized":"2024-02-17T12:19:04.726220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697274+0000","last_change":"2024-02-17T12:19:03.697274+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697274+0000","last_undegraded":"2024-02-17T12:19:03.697274+0000","last_fullsized":"2024-02-17T12:19:03.697274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731509+0000","last_change":"2024-02-17T12:19:04.726126+0000","last_active":"2024-02-17T12:19:04.731509+0000","last_peered":"2024-02-17T12:19:04.731509+0000","last_clean":"2024-02-17T12:19:04.731509+0000","last_became_active":"2024-02-17T12:19:04.725344+0000","last_became_peered":"2024-02-17T12:19:04.725344+0000","last_unstale":"2024-02-17T12:19:04.731509+0000","last_undegraded":"2024-02-17T12:19:04.731509+0000","last_fullsized":"2024-02-17T12:19:04.731509+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:35:15.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.701420+0000","last_change":"2024-02-17T12:19:03.701420+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.701420+0000","last_undegraded":"2024-02-17T12:19:03.701420+0000","last_fullsized":"2024-02-17T12:19:03.701420+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689731+0000","last_change":"2024-02-17T12:19:03.689731+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689731+0000","last_undegraded":"2024-02-17T12:19:03.689731+0000","last_fullsized":"2024-02-17T12:19:03.689731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719039+0000","last_change":"2024-02-17T12:19:04.713023+0000","last_active":"2024-02-17T12:19:04.719039+0000","last_peered":"2024-02-17T12:19:04.719039+0000","last_clean":"2024-02-17T12:19:04.719039+0000","last_became_active":"2024-02-17T12:19:04.712535+0000","last_became_peered":"2024-02-17T12:19:04.712535+0000","last_unstale":"2024-02-17T12:19:04.719039+0000","last_undegraded":"2024-02-17T12:19:04.719039+0000","last_fullsized":"2024-02-17T12:19:04.719039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724327+0000","last_change":"2024-02-17T12:19:04.721331+0000","last_active":"2024-02-17T12:19:04.724327+0000","last_peered":"2024-02-17T12:19:04.724327+0000","last_clean":"2024-02-17T12:19:04.724327+0000","last_became_active":"2024-02-17T12:19:04.721066+0000","last_became_peered":"2024-02-17T12:19:04.721066+0000","last_unstale":"2024-02-17T12:19:04.724327+0000","last_undegraded":"2024-02-17T12:19:04.724327+0000","last_fullsized":"2024-02-17T12:19:04.724327+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:26:29.549996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731487+0000","last_change":"2024-02-17T12:19:04.726119+0000","last_active":"2024-02-17T12:19:04.731487+0000","last_peered":"2024-02-17T12:19:04.731487+0000","last_clean":"2024-02-17T12:19:04.731487+0000","last_became_active":"2024-02-17T12:19:04.725509+0000","last_became_peered":"2024-02-17T12:19:04.725509+0000","last_unstale":"2024-02-17T12:19:04.731487+0000","last_undegraded":"2024-02-17T12:19:04.731487+0000","last_fullsized":"2024-02-17T12:19:04.731487+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:10:27.065029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.690070+0000","last_change":"2024-02-17T12:19:03.690070+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.690070+0000","last_undegraded":"2024-02-17T12:19:03.690070+0000","last_fullsized":"2024-02-17T12:19:03.690070+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.733015+0000","last_change":"2024-02-17T12:19:04.729805+0000","last_active":"2024-02-17T12:19:04.733015+0000","last_peered":"2024-02-17T12:19:04.733015+0000","last_clean":"2024-02-17T12:19:04.733015+0000","last_became_active":"2024-02-17T12:19:04.729388+0000","last_became_peered":"2024-02-17T12:19:04.729388+0000","last_unstale":"2024-02-17T12:19:04.733015+0000","last_undegraded":"2024-02-17T12:19:04.733015+0000","last_fullsized":"2024-02-17T12:19:04.733015+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:27.023399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.691122+0000","last_change":"2024-02-17T12:19:03.691122+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.691122+0000","last_undegraded":"2024-02-17T12:19:03.691122+0000","last_fullsized":"2024-02-17T12:19:03.691122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.721801+0000","last_change":"2024-02-17T12:19:03.709066+0000","last_active":"2024-02-17T12:19:04.721801+0000","last_peered":"2024-02-17T12:19:04.721801+0000","last_clean":"2024-02-17T12:19:04.721801+0000","last_became_active":"2024-02-17T12:19:03.708888+0000","last_became_peered":"2024-02-17T12:19:03.708888+0000","last_unstale":"2024-02-17T12:19:04.721801+0000","last_undegraded":"2024-02-17T12:19:04.721801+0000","last_fullsized":"2024-02-17T12:19:04.721801+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726321+0000","last_change":"2024-02-17T12:19:04.718756+0000","last_active":"2024-02-17T12:19:04.726321+0000","last_peered":"2024-02-17T12:19:04.726321+0000","last_clean":"2024-02-17T12:19:04.726321+0000","last_became_active":"2024-02-17T12:19:04.716924+0000","last_became_peered":"2024-02-17T12:19:04.716924+0000","last_unstale":"2024-02-17T12:19:04.726321+0000","last_undegraded":"2024-02-17T12:19:04.726321+0000","last_fullsized":"2024-02-17T12:19:04.726321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.895909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.707135+0000","last_change":"2024-02-17T12:19:03.703800+0000","last_active":"2024-02-17T12:19:03.707135+0000","last_peered":"2024-02-17T12:19:03.707135+0000","last_clean":"2024-02-17T12:19:03.707135+0000","last_became_active":"2024-02-17T12:19:03.703402+0000","last_became_peered":"2024-02-17T12:19:03.703402+0000","last_unstale":"2024-02-17T12:19:03.707135+0000","last_undegraded":"2024-02-17T12:19:03.707135+0000","last_fullsized":"2024-02-17T12:19:03.707135+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:50.069369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.733047+0000","last_change":"2024-02-17T12:19:04.730207+0000","last_active":"2024-02-17T12:19:04.733047+0000","last_peered":"2024-02-17T12:19:04.733047+0000","last_clean":"2024-02-17T12:19:04.733047+0000","last_became_active":"2024-02-17T12:19:04.729363+0000","last_became_peered":"2024-02-17T12:19:04.729363+0000","last_unstale":"2024-02-17T12:19:04.733047+0000","last_undegraded":"2024-02-17T12:19:04.733047+0000","last_fullsized":"2024-02-17T12:19:04.733047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:14:58.856139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727721+0000","last_change":"2024-02-17T12:19:03.704331+0000","last_active":"2024-02-17T12:19:04.727721+0000","last_peered":"2024-02-17T12:19:04.727721+0000","last_clean":"2024-02-17T12:19:04.727721+0000","last_became_active":"2024-02-17T12:19:03.704078+0000","last_became_peered":"2024-02-17T12:19:03.704078+0000","last_unstale":"2024-02-17T12:19:04.727721+0000","last_undegraded":"2024-02-17T12:19:04.727721+0000","last_fullsized":"2024-02-17T12:19:04.727721+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699017+0000","last_change":"2024-02-17T12:19:03.699017+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699017+0000","last_undegraded":"2024-02-17T12:19:03.699017+0000","last_fullsized":"2024-02-17T12:19:03.699017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.730660+0000","last_change":"2024-02-17T12:19:03.702411+0000","last_active":"2024-02-17T12:19:04.730660+0000","last_peered":"2024-02-17T12:19:04.730660+0000","last_clean":"2024-02-17T12:19:04.730660+0000","last_became_active":"2024-02-17T12:19:03.702166+0000","last_became_peered":"2024-02-17T12:19:03.702166+0000","last_unstale":"2024-02-17T12:19:04.730660+0000","last_undegraded":"2024-02-17T12:19:04.730660+0000","last_fullsized":"2024-02-17T12:19:04.730660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731631+0000","last_change":"2024-02-17T12:19:04.726343+0000","last_active":"2024-02-17T12:19:04.731631+0000","last_peered":"2024-02-17T12:19:04.731631+0000","last_clean":"2024-02-17T12:19:04.731631+0000","last_became_active":"2024-02-17T12:19:04.725870+0000","last_became_peered":"2024-02-17T12:19:04.725870+0000","last_unstale":"2024-02-17T12:19:04.731631+0000","last_undegraded":"2024-02-17T12:19:04.731631+0000","last_fullsized":"2024-02-17T12:19:04.731631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.707153+0000","last_change":"2024-02-17T12:19:03.703159+0000","last_active":"2024-02-17T12:19:03.707153+0000","last_peered":"2024-02-17T12:19:03.707153+0000","last_clean":"2024-02-17T12:19:03.707153+0000","last_became_active":"2024-02-17T12:19:03.702811+0000","last_became_peered":"2024-02-17T12:19:03.702811+0000","last_unstale":"2024-02-17T12:19:03.707153+0000","last_undegraded":"2024-02-17T12:19:03.707153+0000","last_fullsized":"2024-02-17T12:19:03.707153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:54:51.881257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.692218+0000","last_change":"2024-02-17T12:19:03.692218+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.692218+0000","last_undegraded":"2024-02-17T12:19:03.692218+0000","last_fullsized":"2024-02-17T12:19:03.692218+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.709981+0000","last_change":"2024-02-17T12:19:03.706093+0000","last_active":"2024-02-17T12:19:03.709981+0000","last_peered":"2024-02-17T12:19:03.709981+0000","last_clean":"2024-02-17T12:19:03.709981+0000","last_became_active":"2024-02-17T12:19:03.705445+0000","last_became_peered":"2024-02-17T12:19:03.705445+0000","last_unstale":"2024-02-17T12:19:03.709981+0000","last_undegraded":"2024-02-17T12:19:03.709981+0000","last_fullsized":"2024-02-17T12:19:03.709981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:54.097755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699811+0000","last_change":"2024-02-17T12:19:03.699811+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699811+0000","last_undegraded":"2024-02-17T12:19:03.699811+0000","last_fullsized":"2024-02-17T12:19:03.699811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.691609+0000","last_change":"2024-02-17T12:19:03.701055+0000","last_active":"2024-02-17T12:19:04.691609+0000","last_peered":"2024-02-17T12:19:04.691609+0000","last_clean":"2024-02-17T12:19:04.691609+0000","last_became_active":"2024-02-17T12:19:03.695988+0000","last_became_peered":"2024-02-17T12:19:03.695988+0000","last_unstale":"2024-02-17T12:19:04.691609+0000","last_undegraded":"2024-02-17T12:19:04.691609+0000","last_fullsized":"2024-02-17T12:19:04.691609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719274+0000","last_change":"2024-02-17T12:19:04.710559+0000","last_active":"2024-02-17T12:19:04.719274+0000","last_peered":"2024-02-17T12:19:04.719274+0000","last_clean":"2024-02-17T12:19:04.719274+0000","last_became_active":"2024-02-17T12:19:04.709979+0000","last_became_peered":"2024-02-17T12:19:04.709979+0000","last_unstale":"2024-02-17T12:19:04.719274+0000","last_undegraded":"2024-02-17T12:19:04.719274+0000","last_fullsized":"2024-02-17T12:19:04.719274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:32:13.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.705096+0000","last_change":"2024-02-17T12:19:03.702309+0000","last_active":"2024-02-17T12:19:04.705096+0000","last_peered":"2024-02-17T12:19:04.705096+0000","last_clean":"2024-02-17T12:19:04.705096+0000","last_became_active":"2024-02-17T12:19:03.702051+0000","last_became_peered":"2024-02-17T12:19:03.702051+0000","last_unstale":"2024-02-17T12:19:04.705096+0000","last_undegraded":"2024-02-17T12:19:04.705096+0000","last_fullsized":"2024-02-17T12:19:04.705096+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:58.978525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731622+0000","last_change":"2024-02-17T12:19:04.726001+0000","last_active":"2024-02-17T12:19:04.731622+0000","last_peered":"2024-02-17T12:19:04.731622+0000","last_clean":"2024-02-17T12:19:04.731622+0000","last_became_active":"2024-02-17T12:19:04.725747+0000","last_became_peered":"2024-02-17T12:19:04.725747+0000","last_unstale":"2024-02-17T12:19:04.731622+0000","last_undegraded":"2024-02-17T12:19:04.731622+0000","last_fullsized":"2024-02-17T12:19:04.731622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:00.818538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706938+0000","last_change":"2024-02-17T12:19:03.712851+0000","last_active":"2024-02-17T12:19:04.706938+0000","last_peered":"2024-02-17T12:19:04.706938+0000","last_clean":"2024-02-17T12:19:04.706938+0000","last_became_active":"2024-02-17T12:19:03.712584+0000","last_became_peered":"2024-02-17T12:19:03.712584+0000","last_unstale":"2024-02-17T12:19:04.706938+0000","last_undegraded":"2024-02-17T12:19:04.706938+0000","last_fullsized":"2024-02-17T12:19:04.706938+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.714755+0000","last_change":"2024-02-17T12:19:04.709578+0000","last_active":"2024-02-17T12:19:04.714755+0000","last_peered":"2024-02-17T12:19:04.714755+0000","last_clean":"2024-02-17T12:19:04.714755+0000","last_became_active":"2024-02-17T12:19:04.709173+0000","last_became_peered":"2024-02-17T12:19:04.709173+0000","last_unstale":"2024-02-17T12:19:04.714755+0000","last_undegraded":"2024-02-17T12:19:04.714755+0000","last_fullsized":"2024-02-17T12:19:04.714755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:19.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706482+0000","last_change":"2024-02-17T12:19:03.707721+0000","last_active":"2024-02-17T12:19:04.706482+0000","last_peered":"2024-02-17T12:19:04.706482+0000","last_clean":"2024-02-17T12:19:04.706482+0000","last_became_active":"2024-02-17T12:19:03.707435+0000","last_became_peered":"2024-02-17T12:19:03.707435+0000","last_unstale":"2024-02-17T12:19:04.706482+0000","last_undegraded":"2024-02-17T12:19:04.706482+0000","last_fullsized":"2024-02-17T12:19:04.706482+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726909+0000","last_change":"2024-02-17T12:19:04.716812+0000","last_active":"2024-02-17T12:19:04.726909+0000","last_peered":"2024-02-17T12:19:04.726909+0000","last_clean":"2024-02-17T12:19:04.726909+0000","last_became_active":"2024-02-17T12:19:04.716307+0000","last_became_peered":"2024-02-17T12:19:04.716307+0000","last_unstale":"2024-02-17T12:19:04.726909+0000","last_undegraded":"2024-02-17T12:19:04.726909+0000","last_fullsized":"2024-02-17T12:19:04.726909+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.729950+0000","last_change":"2024-02-17T12:19:03.710532+0000","last_active":"2024-02-17T12:19:04.729950+0000","last_peered":"2024-02-17T12:19:04.729950+0000","last_clean":"2024-02-17T12:19:04.729950+0000","last_became_active":"2024-02-17T12:19:03.710333+0000","last_became_peered":"2024-02-17T12:19:03.710333+0000","last_unstale":"2024-02-17T12:19:04.729950+0000","last_undegraded":"2024-02-17T12:19:04.729950+0000","last_fullsized":"2024-02-17T12:19:04.729950+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689310+0000","last_change":"2024-02-17T12:19:03.689310+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689310+0000","last_undegraded":"2024-02-17T12:19:03.689310+0000","last_fullsized":"2024-02-17T12:19:03.689310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.736361+0000","last_change":"2024-02-17T12:19:03.704237+0000","last_active":"2024-02-17T12:19:04.736361+0000","last_peered":"2024-02-17T12:19:04.736361+0000","last_clean":"2024-02-17T12:19:04.736361+0000","last_became_active":"2024-02-17T12:19:03.703964+0000","last_became_peered":"2024-02-17T12:19:03.703964+0000","last_unstale":"2024-02-17T12:19:04.736361+0000","last_undegraded":"2024-02-17T12:19:04.736361+0000","last_fullsized":"2024-02-17T12:19:04.736361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:45.097730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.710139+0000","last_change":"2024-02-17T12:19:04.702494+0000","last_active":"2024-02-17T12:19:04.710139+0000","last_peered":"2024-02-17T12:19:04.710139+0000","last_clean":"2024-02-17T12:19:04.710139+0000","last_became_active":"2024-02-17T12:19:04.702168+0000","last_became_peered":"2024-02-17T12:19:04.702168+0000","last_unstale":"2024-02-17T12:19:04.710139+0000","last_undegraded":"2024-02-17T12:19:04.710139+0000","last_fullsized":"2024-02-17T12:19:04.710139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.730818+0000","last_change":"2024-02-17T12:19:03.710630+0000","last_active":"2024-02-17T12:19:04.730818+0000","last_peered":"2024-02-17T12:19:04.730818+0000","last_clean":"2024-02-17T12:19:04.730818+0000","last_became_active":"2024-02-17T12:19:03.710185+0000","last_became_peered":"2024-02-17T12:19:03.710185+0000","last_unstale":"2024-02-17T12:19:04.730818+0000","last_undegraded":"2024-02-17T12:19:04.730818+0000","last_fullsized":"2024-02-17T12:19:04.730818+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:07:16.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699993+0000","last_change":"2024-02-17T12:19:03.699993+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699993+0000","last_undegraded":"2024-02-17T12:19:03.699993+0000","last_fullsized":"2024-02-17T12:19:03.699993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.702490+0000","last_change":"2024-02-17T12:19:03.712475+0000","last_active":"2024-02-17T12:19:04.702490+0000","last_peered":"2024-02-17T12:19:04.702490+0000","last_clean":"2024-02-17T12:19:04.702490+0000","last_became_active":"2024-02-17T12:19:03.712117+0000","last_became_peered":"2024-02-17T12:19:03.712117+0000","last_unstale":"2024-02-17T12:19:04.702490+0000","last_undegraded":"2024-02-17T12:19:04.702490+0000","last_fullsized":"2024-02-17T12:19:04.702490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:10.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.734545+0000","last_change":"2024-02-17T12:19:04.727289+0000","last_active":"2024-02-17T12:19:04.734545+0000","last_peered":"2024-02-17T12:19:04.734545+0000","last_clean":"2024-02-17T12:19:04.734545+0000","last_became_active":"2024-02-17T12:19:04.727041+0000","last_became_peered":"2024-02-17T12:19:04.727041+0000","last_unstale":"2024-02-17T12:19:04.734545+0000","last_undegraded":"2024-02-17T12:19:04.734545+0000","last_fullsized":"2024-02-17T12:19:04.734545+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:22:57.622930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.690608+0000","last_change":"2024-02-17T12:19:03.699211+0000","last_active":"2024-02-17T12:19:04.690608+0000","last_peered":"2024-02-17T12:19:04.690608+0000","last_clean":"2024-02-17T12:19:04.690608+0000","last_became_active":"2024-02-17T12:19:03.698244+0000","last_became_peered":"2024-02-17T12:19:03.698244+0000","last_unstale":"2024-02-17T12:19:04.690608+0000","last_undegraded":"2024-02-17T12:19:04.690608+0000","last_fullsized":"2024-02-17T12:19:04.690608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:42.702805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724088+0000","last_change":"2024-02-17T12:19:04.718529+0000","last_active":"2024-02-17T12:19:04.724088+0000","last_peered":"2024-02-17T12:19:04.724088+0000","last_clean":"2024-02-17T12:19:04.724088+0000","last_became_active":"2024-02-17T12:19:04.718251+0000","last_became_peered":"2024-02-17T12:19:04.718251+0000","last_unstale":"2024-02-17T12:19:04.724088+0000","last_undegraded":"2024-02-17T12:19:04.724088+0000","last_fullsized":"2024-02-17T12:19:04.724088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:36:26.635524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.728196+0000","last_change":"2024-02-17T12:19:03.706554+0000","last_active":"2024-02-17T12:19:04.728196+0000","last_peered":"2024-02-17T12:19:04.728196+0000","last_clean":"2024-02-17T12:19:04.728196+0000","last_became_active":"2024-02-17T12:19:03.706236+0000","last_became_peered":"2024-02-17T12:19:03.706236+0000","last_unstale":"2024-02-17T12:19:04.728196+0000","last_undegraded":"2024-02-17T12:19:04.728196+0000","last_fullsized":"2024-02-17T12:19:04.728196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698928+0000","last_change":"2024-02-17T12:19:03.698928+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698928+0000","last_undegraded":"2024-02-17T12:19:03.698928+0000","last_fullsized":"2024-02-17T12:19:03.698928+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.716889+0000","last_change":"2024-02-17T12:19:03.705648+0000","last_active":"2024-02-17T12:19:04.716889+0000","last_peered":"2024-02-17T12:19:04.716889+0000","last_clean":"2024-02-17T12:19:04.716889+0000","last_became_active":"2024-02-17T12:19:03.705325+0000","last_became_peered":"2024-02-17T12:19:03.705325+0000","last_unstale":"2024-02-17T12:19:04.716889+0000","last_undegraded":"2024-02-17T12:19:04.716889+0000","last_fullsized":"2024-02-17T12:19:04.716889+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726342+0000","last_change":"2024-02-17T12:19:04.719005+0000","last_active":"2024-02-17T12:19:04.726342+0000","last_peered":"2024-02-17T12:19:04.726342+0000","last_clean":"2024-02-17T12:19:04.726342+0000","last_became_active":"2024-02-17T12:19:04.717221+0000","last_became_peered":"2024-02-17T12:19:04.717221+0000","last_unstale":"2024-02-17T12:19:04.726342+0000","last_undegraded":"2024-02-17T12:19:04.726342+0000","last_fullsized":"2024-02-17T12:19:04.726342+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:30.970580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724551+0000","last_change":"2024-02-17T12:19:03.708463+0000","last_active":"2024-02-17T12:19:04.724551+0000","last_peered":"2024-02-17T12:19:04.724551+0000","last_clean":"2024-02-17T12:19:04.724551+0000","last_became_active":"2024-02-17T12:19:03.707739+0000","last_became_peered":"2024-02-17T12:19:03.707739+0000","last_unstale":"2024-02-17T12:19:04.724551+0000","last_undegraded":"2024-02-17T12:19:04.724551+0000","last_fullsized":"2024-02-17T12:19:04.724551+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.688517+0000","last_change":"2024-02-17T12:19:03.688517+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.688517+0000","last_undegraded":"2024-02-17T12:19:03.688517+0000","last_fullsized":"2024-02-17T12:19:03.688517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.692466+0000","last_change":"2024-02-17T12:19:03.700286+0000","last_active":"2024-02-17T12:19:04.692466+0000","last_peered":"2024-02-17T12:19:04.692466+0000","last_clean":"2024-02-17T12:19:04.692466+0000","last_became_active":"2024-02-17T12:19:03.700021+0000","last_became_peered":"2024-02-17T12:19:03.700021+0000","last_unstale":"2024-02-17T12:19:04.692466+0000","last_undegraded":"2024-02-17T12:19:04.692466+0000","last_fullsized":"2024-02-17T12:19:04.692466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.696470+0000","last_change":"2024-02-17T12:19:03.696470+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.696470+0000","last_undegraded":"2024-02-17T12:19:03.696470+0000","last_fullsized":"2024-02-17T12:19:03.696470+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.725054+0000","last_change":"2024-02-17T12:19:03.709412+0000","last_active":"2024-02-17T12:19:04.725054+0000","last_peered":"2024-02-17T12:19:04.725054+0000","last_clean":"2024-02-17T12:19:04.725054+0000","last_became_active":"2024-02-17T12:19:03.709021+0000","last_became_peered":"2024-02-17T12:19:03.709021+0000","last_unstale":"2024-02-17T12:19:04.725054+0000","last_undegraded":"2024-02-17T12:19:04.725054+0000","last_fullsized":"2024-02-17T12:19:04.725054+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:44.049163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717759+0000","last_change":"2024-02-17T12:19:04.712404+0000","last_active":"2024-02-17T12:19:04.717759+0000","last_peered":"2024-02-17T12:19:04.717759+0000","last_clean":"2024-02-17T12:19:04.717759+0000","last_became_active":"2024-02-17T12:19:04.711344+0000","last_became_peered":"2024-02-17T12:19:04.711344+0000","last_unstale":"2024-02-17T12:19:04.717759+0000","last_undegraded":"2024-02-17T12:19:04.717759+0000","last_fullsized":"2024-02-17T12:19:04.717759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:33.580841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.713501+0000","last_change":"2024-02-17T12:19:03.706405+0000","last_active":"2024-02-17T12:19:03.713501+0000","last_peered":"2024-02-17T12:19:03.713501+0000","last_clean":"2024-02-17T12:19:03.713501+0000","last_became_active":"2024-02-17T12:19:03.706108+0000","last_became_peered":"2024-02-17T12:19:03.706108+0000","last_unstale":"2024-02-17T12:19:03.713501+0000","last_undegraded":"2024-02-17T12:19:03.713501+0000","last_fullsized":"2024-02-17T12:19:03.713501+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:46:42.443329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.696296+0000","last_change":"2024-02-17T12:19:03.696296+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.696296+0000","last_undegraded":"2024-02-17T12:19:03.696296+0000","last_fullsized":"2024-02-17T12:19:03.696296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.706485+0000","last_change":"2024-02-17T12:19:03.701598+0000","last_active":"2024-02-17T12:19:03.706485+0000","last_peered":"2024-02-17T12:19:03.706485+0000","last_clean":"2024-02-17T12:19:03.706485+0000","last_became_active":"2024-02-17T12:19:03.701326+0000","last_became_peered":"2024-02-17T12:19:03.701326+0000","last_unstale":"2024-02-17T12:19:03.706485+0000","last_undegraded":"2024-02-17T12:19:03.706485+0000","last_fullsized":"2024-02-17T12:19:03.706485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:28:04.886936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.711704+0000","last_change":"2024-02-17T12:19:04.702184+0000","last_active":"2024-02-17T12:19:04.711704+0000","last_peered":"2024-02-17T12:19:04.711704+0000","last_clean":"2024-02-17T12:19:04.711704+0000","last_became_active":"2024-02-17T12:19:04.701908+0000","last_became_peered":"2024-02-17T12:19:04.701908+0000","last_unstale":"2024-02-17T12:19:04.711704+0000","last_undegraded":"2024-02-17T12:19:04.711704+0000","last_fullsized":"2024-02-17T12:19:04.711704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:25:38.680904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.702062+0000","last_change":"2024-02-17T12:19:03.702614+0000","last_active":"2024-02-17T12:19:04.702062+0000","last_peered":"2024-02-17T12:19:04.702062+0000","last_clean":"2024-02-17T12:19:04.702062+0000","last_became_active":"2024-02-17T12:19:03.702360+0000","last_became_peered":"2024-02-17T12:19:03.702360+0000","last_unstale":"2024-02-17T12:19:04.702062+0000","last_undegraded":"2024-02-17T12:19:04.702062+0000","last_fullsized":"2024-02-17T12:19:04.702062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:37.418089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689927+0000","last_change":"2024-02-17T12:19:03.689927+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689927+0000","last_undegraded":"2024-02-17T12:19:03.689927+0000","last_fullsized":"2024-02-17T12:19:03.689927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.725424+0000","last_change":"2024-02-17T12:19:03.706098+0000","last_active":"2024-02-17T12:19:04.725424+0000","last_peered":"2024-02-17T12:19:04.725424+0000","last_clean":"2024-02-17T12:19:04.725424+0000","last_became_active":"2024-02-17T12:19:03.705787+0000","last_became_peered":"2024-02-17T12:19:03.705787+0000","last_unstale":"2024-02-17T12:19:04.725424+0000","last_undegraded":"2024-02-17T12:19:04.725424+0000","last_fullsized":"2024-02-17T12:19:04.725424+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:59.839484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699376+0000","last_change":"2024-02-17T12:19:03.699376+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699376+0000","last_undegraded":"2024-02-17T12:19:03.699376+0000","last_fullsized":"2024-02-17T12:19:03.699376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.711323+0000","last_change":"2024-02-17T12:19:03.707121+0000","last_active":"2024-02-17T12:19:04.711323+0000","last_peered":"2024-02-17T12:19:04.711323+0000","last_clean":"2024-02-17T12:19:04.711323+0000","last_became_active":"2024-02-17T12:19:03.706873+0000","last_became_peered":"2024-02-17T12:19:03.706873+0000","last_unstale":"2024-02-17T12:19:04.711323+0000","last_undegraded":"2024-02-17T12:19:04.711323+0000","last_fullsized":"2024-02-17T12:19:04.711323+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:24.015391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726377+0000","last_change":"2024-02-17T12:19:04.718645+0000","last_active":"2024-02-17T12:19:04.726377+0000","last_peered":"2024-02-17T12:19:04.726377+0000","last_clean":"2024-02-17T12:19:04.726377+0000","last_became_active":"2024-02-17T12:19:04.715738+0000","last_became_peered":"2024-02-17T12:19:04.715738+0000","last_unstale":"2024-02-17T12:19:04.726377+0000","last_undegraded":"2024-02-17T12:19:04.726377+0000","last_fullsized":"2024-02-17T12:19:04.726377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:53.989897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706273+0000","last_change":"2024-02-17T12:19:03.705719+0000","last_active":"2024-02-17T12:19:04.706273+0000","last_peered":"2024-02-17T12:19:04.706273+0000","last_clean":"2024-02-17T12:19:04.706273+0000","last_became_active":"2024-02-17T12:19:03.705394+0000","last_became_peered":"2024-02-17T12:19:03.705394+0000","last_unstale":"2024-02-17T12:19:04.706273+0000","last_undegraded":"2024-02-17T12:19:04.706273+0000","last_fullsized":"2024-02-17T12:19:04.706273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:18.432832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.687985+0000","last_change":"2024-02-17T12:19:03.687985+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.687985+0000","last_undegraded":"2024-02-17T12:19:03.687985+0000","last_fullsized":"2024-02-17T12:19:03.687985+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706298+0000","last_change":"2024-02-17T12:19:03.712607+0000","last_active":"2024-02-17T12:19:04.706298+0000","last_peered":"2024-02-17T12:19:04.706298+0000","last_clean":"2024-02-17T12:19:04.706298+0000","last_became_active":"2024-02-17T12:19:03.712328+0000","last_became_peered":"2024-02-17T12:19:03.712328+0000","last_unstale":"2024-02-17T12:19:04.706298+0000","last_undegraded":"2024-02-17T12:19:04.706298+0000","last_fullsized":"2024-02-17T12:19:04.706298+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717437+0000","last_change":"2024-02-17T12:19:04.711425+0000","last_active":"2024-02-17T12:19:04.717437+0000","last_peered":"2024-02-17T12:19:04.717437+0000","last_clean":"2024-02-17T12:19:04.717437+0000","last_became_active":"2024-02-17T12:19:04.711149+0000","last_became_peered":"2024-02-17T12:19:04.711149+0000","last_unstale":"2024-02-17T12:19:04.717437+0000","last_undegraded":"2024-02-17T12:19:04.717437+0000","last_fullsized":"2024-02-17T12:19:04.717437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:09.191064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.692502+0000","last_change":"2024-02-17T12:19:03.708773+0000","last_active":"2024-02-17T12:19:04.692502+0000","last_peered":"2024-02-17T12:19:04.692502+0000","last_clean":"2024-02-17T12:19:04.692502+0000","last_became_active":"2024-02-17T12:19:03.707579+0000","last_became_peered":"2024-02-17T12:19:03.707579+0000","last_unstale":"2024-02-17T12:19:04.692502+0000","last_undegraded":"2024-02-17T12:19:04.692502+0000","last_fullsized":"2024-02-17T12:19:04.692502+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.709256+0000","last_change":"2024-02-17T12:19:04.699129+0000","last_active":"2024-02-17T12:19:04.709256+0000","last_peered":"2024-02-17T12:19:04.709256+0000","last_clean":"2024-02-17T12:19:04.709256+0000","last_became_active":"2024-02-17T12:19:04.698800+0000","last_became_peered":"2024-02-17T12:19:04.698800+0000","last_unstale":"2024-02-17T12:19:04.709256+0000","last_undegraded":"2024-02-17T12:19:04.709256+0000","last_fullsized":"2024-02-17T12:19:04.709256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.709959+0000","last_change":"2024-02-17T12:19:03.705779+0000","last_active":"2024-02-17T12:19:03.709959+0000","last_peered":"2024-02-17T12:19:03.709959+0000","last_clean":"2024-02-17T12:19:03.709959+0000","last_became_active":"2024-02-17T12:19:03.705453+0000","last_became_peered":"2024-02-17T12:19:03.705453+0000","last_unstale":"2024-02-17T12:19:03.709959+0000","last_undegraded":"2024-02-17T12:19:03.709959+0000","last_fullsized":"2024-02-17T12:19:03.709959+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:14.221858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699370+0000","last_change":"2024-02-17T12:19:03.699370+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699370+0000","last_undegraded":"2024-02-17T12:19:03.699370+0000","last_fullsized":"2024-02-17T12:19:03.699370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706435+0000","last_change":"2024-02-17T12:19:03.710199+0000","last_active":"2024-02-17T12:19:04.706435+0000","last_peered":"2024-02-17T12:19:04.706435+0000","last_clean":"2024-02-17T12:19:04.706435+0000","last_became_active":"2024-02-17T12:19:03.709947+0000","last_became_peered":"2024-02-17T12:19:03.709947+0000","last_unstale":"2024-02-17T12:19:04.706435+0000","last_undegraded":"2024-02-17T12:19:04.706435+0000","last_fullsized":"2024-02-17T12:19:04.706435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.718478+0000","last_change":"2024-02-17T12:19:04.713606+0000","last_active":"2024-02-17T12:19:04.718478+0000","last_peered":"2024-02-17T12:19:04.718478+0000","last_clean":"2024-02-17T12:19:04.718478+0000","last_became_active":"2024-02-17T12:19:04.708088+0000","last_became_peered":"2024-02-17T12:19:04.708088+0000","last_unstale":"2024-02-17T12:19:04.718478+0000","last_undegraded":"2024-02-17T12:19:04.718478+0000","last_fullsized":"2024-02-17T12:19:04.718478+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.704981+0000","last_change":"2024-02-17T12:19:03.701618+0000","last_active":"2024-02-17T12:19:03.704981+0000","last_peered":"2024-02-17T12:19:03.704981+0000","last_clean":"2024-02-17T12:19:03.704981+0000","last_became_active":"2024-02-17T12:19:03.701291+0000","last_became_peered":"2024-02-17T12:19:03.701291+0000","last_unstale":"2024-02-17T12:19:03.704981+0000","last_undegraded":"2024-02-17T12:19:03.704981+0000","last_fullsized":"2024-02-17T12:19:03.704981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.901708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.723067+0000","last_change":"2024-02-17T12:19:04.719250+0000","last_active":"2024-02-17T12:19:04.723067+0000","last_peered":"2024-02-17T12:19:04.723067+0000","last_clean":"2024-02-17T12:19:04.723067+0000","last_became_active":"2024-02-17T12:19:04.718856+0000","last_became_peered":"2024-02-17T12:19:04.718856+0000","last_unstale":"2024-02-17T12:19:04.723067+0000","last_undegraded":"2024-02-17T12:19:04.723067+0000","last_fullsized":"2024-02-17T12:19:04.723067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:53:35.790267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.720220+0000","last_change":"2024-02-17T12:19:03.712148+0000","last_active":"2024-02-17T12:19:03.720220+0000","last_peered":"2024-02-17T12:19:03.720220+0000","last_clean":"2024-02-17T12:19:03.720220+0000","last_became_active":"2024-02-17T12:19:03.711771+0000","last_became_peered":"2024-02-17T12:19:03.711771+0000","last_unstale":"2024-02-17T12:19:03.720220+0000","last_undegraded":"2024-02-17T12:19:03.720220+0000","last_fullsized":"2024-02-17T12:19:03.720220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:14.842866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":253,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.702332+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:19:03.702332+0000","last_peered":"2024-02-17T12:19:03.702332+0000","last_clean":"2024-02-17T12:19:03.702332+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:19:03.702332+0000","last_undegraded":"2024-02-17T12:19:03.702332+0000","last_fullsized":"2024-02-17T12:19:03.702332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88700000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":1.115,"15min":1.115},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88500000000000001,"5min":1.143,"15min":1.143},"last":0.73599999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88700000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.58399999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85299999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.82099999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":831488,"data_stored":355915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.75},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.72199999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65000000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.432},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.625}]}]},{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.44},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.36299999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.621,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":1.387,"15min":1.387},"last":1.014}]},{"osd":4,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.497,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0409999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.714,"15min":1.714},"last":1.149},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.744,"15min":1.744},"last":1.1339999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91500000000000004,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0980000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.002,"5min":1.575,"15min":1.575},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96899999999999997,"5min":1.321,"15min":1.321},"last":0.73599999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64200000000000002,"5min":1.145,"15min":1.145},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.34000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69499999999999995,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58099999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73799999999999999,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.373}]},{"osd":3,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":2.609,"15min":2.609},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.079,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59199999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.90700000000000003,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.997,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.05,"5min":1.095,"15min":1.095},"last":0.60499999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0469999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0820000000000001,"5min":5.375,"15min":5.375},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":1.0169999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.091,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.629,"15min":1.629},"last":0.56799999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":944683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47899999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45100000000000001,"15min":0.45700000000000002},"min":{"1min":0.312,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":1.046,"15min":1.046},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76900000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.58699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66700000000000004}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0129999999999999,"5min":1.139,"15min":1.139},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92800000000000005,"5min":1.038,"15min":1.038},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94499999999999995,"5min":1.095,"15min":1.095},"last":0.999}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0960000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.008}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.042},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90200000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.92200000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28372,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343468,"statfs":{"total":96636764160,"available":96607711232,"internally_reserved":0,"allocated":1384448,"data_stored":931599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84899999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.97399999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75700000000000001,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92400000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90000000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.74299999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86799999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84399999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95099999999999996,"5min":1.052,"15min":1.052},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.95399999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86799999999999999,"5min":1.264,"15min":1.264},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.198,"15min":1.198},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.171,"15min":1.171},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93600000000000005,"5min":1.522,"15min":1.522},"last":0.88200000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89900000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88100000000000001,"5min":1.228,"15min":1.228},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.74299999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":341231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.141,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81999999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93300000000000005,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2749999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.997,"5min":1.252,"15min":1.252},"last":0.83399999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91500000000000004,"5min":1.29,"15min":1.29},"last":0.876},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":1.337,"15min":1.337},"last":0.92400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:19:09.154 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:19:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.324+0000 7f3beec00640 1 Processor -- start 2024-02-17T12:19:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.324+0000 7f3beec00640 1 -- start start 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.324+0000 7f3beec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3be80c25a0 0x7f3be806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.324+0000 7f3beec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3be806db50 0x7f3be814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.324+0000 7f3beec00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3be8150490 0x7f3be8152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.324+0000 7f3beec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be8071630 con 0x7f3be80c25a0 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.324+0000 7f3beec00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be8156270 con 0x7f3be8150490 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.324+0000 7f3beec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8156550 con 0x7f3be806db50 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3be80c25a0 0x7f3be806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3be80c25a0 0x7f3be806e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40754/0 (socket says 172.21.15.114:40754) 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be7e00640 1 -- 172.21.15.114:0/1713194630 learned_addr learned my addr 172.21.15.114:0/1713194630 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be7400640 1 --2- 172.21.15.114:0/1713194630 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3be806db50 0x7f3be814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3becc00640 1 --2- 172.21.15.114:0/1713194630 >> v2:172.21.15.116:3300/0 conn(0x7f3be8150490 0x7f3be8152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be7e00640 1 -- 172.21.15.114:0/1713194630 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3be806db50 msgr2=0x7f3be814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:09.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be7e00640 1 --2- 172.21.15.114:0/1713194630 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3be806db50 0x7f3be814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be7e00640 1 -- 172.21.15.114:0/1713194630 >> v2:172.21.15.116:3300/0 conn(0x7f3be8150490 msgr2=0x7f3be8152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:09.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be7e00640 1 --2- 172.21.15.114:0/1713194630 >> v2:172.21.15.116:3300/0 conn(0x7f3be8150490 0x7f3be8152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be7e00640 1 -- 172.21.15.114:0/1713194630 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8156830 con 0x7f3be80c25a0 2024-02-17T12:19:09.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3becc00640 1 --2- 172.21.15.114:0/1713194630 >> v2:172.21.15.116:3300/0 conn(0x7f3be8150490 0x7f3be8152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be7e00640 1 --2- 172.21.15.114:0/1713194630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be80c25a0 0x7f3be806e980 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3be80c0780 tx=0x7f3bd801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948c7e70d552c395 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be6a00640 1 -- 172.21.15.114:0/1713194630 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be81539a0 con 0x7f3be80c25a0 2024-02-17T12:19:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be6a00640 1 -- 172.21.15.114:0/1713194630 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd80ac410 con 0x7f3be80c25a0 2024-02-17T12:19:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.328+0000 7f3be6a00640 1 -- 172.21.15.114:0/1713194630 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80ac7a0 con 0x7f3be80c25a0 2024-02-17T12:19:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 -- 172.21.15.114:0/1713194630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be80c25a0 msgr2=0x7f3be806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 --2- 172.21.15.114:0/1713194630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be80c25a0 0x7f3be806e980 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3be80c0780 tx=0x7f3bd801c3d0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 -- 172.21.15.114:0/1713194630 shutdown_connections 2024-02-17T12:19:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 --2- 172.21.15.114:0/1713194630 >> v2:172.21.15.116:3300/0 conn(0x7f3be8150490 0x7f3be8152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 --2- 172.21.15.114:0/1713194630 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3be806db50 0x7f3be814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 --2- 172.21.15.114:0/1713194630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be80c25a0 0x7f3be806e980 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 -- 172.21.15.114:0/1713194630 >> 172.21.15.114:0/1713194630 conn(0x7f3be80a8490 msgr2=0x7f3be80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 -- 172.21.15.114:0/1713194630 shutdown_connections 2024-02-17T12:19:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 -- 172.21.15.114:0/1713194630 wait complete. 2024-02-17T12:19:09.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 Processor -- start 2024-02-17T12:19:09.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 -- start start 2024-02-17T12:19:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be806db50 0x7f3be8151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3be80c25a0 0x7f3be81456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3be8150490 0x7f3be81ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8150dd0 con 0x7f3be806db50 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8152ad0 con 0x7f3be80c25a0 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3beec00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be81ece20 con 0x7f3be8150490 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3be7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be806db50 0x7f3be8151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3be7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be806db50 0x7f3be8151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40768/0 (socket says 172.21.15.114:40768) 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3be7e00640 1 -- 172.21.15.114:0/3352397101 learned_addr learned my addr 172.21.15.114:0/3352397101 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3becc00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3be8150490 0x7f3be81ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3be7400640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3be80c25a0 0x7f3be81456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3be7e00640 1 -- 172.21.15.114:0/3352397101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3be8150490 msgr2=0x7f3be81ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3be7e00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3be8150490 0x7f3be81ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3be7e00640 1 -- 172.21.15.114:0/3352397101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3be80c25a0 msgr2=0x7f3be81456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3be7e00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3be80c25a0 0x7f3be81456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.332+0000 7f3be7e00640 1 -- 172.21.15.114:0/3352397101 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80094d0 con 0x7f3be806db50 2024-02-17T12:19:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3be7e00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be806db50 0x7f3be8151be0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3bd801cc70 tx=0x7f3bd8019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3bdfe00640 1 -- 172.21.15.114:0/3352397101 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80ace00 con 0x7f3be806db50 2024-02-17T12:19:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3bdfe00640 1 -- 172.21.15.114:0/3352397101 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd80b65f0 con 0x7f3be806db50 2024-02-17T12:19:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3bdfe00640 1 -- 172.21.15.114:0/3352397101 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80b69a0 con 0x7f3be806db50 2024-02-17T12:19:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3beec00640 1 -- 172.21.15.114:0/3352397101 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be8152230 con 0x7f3be806db50 2024-02-17T12:19:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3beec00640 1 -- 172.21.15.114:0/3352397101 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be81527f0 con 0x7f3be806db50 2024-02-17T12:19:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3beec00640 1 -- 172.21.15.114:0/3352397101 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be8074840 con 0x7f3be806db50 2024-02-17T12:19:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3bdfe00640 1 -- 172.21.15.114:0/3352397101 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3bd80b6b00 con 0x7f3be806db50 2024-02-17T12:19:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3bdfe00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bc8066e70 0x7f3bc8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3bdfe00640 1 -- 172.21.15.114:0/3352397101 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bd811f2c0 con 0x7f3be806db50 2024-02-17T12:19:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3be7400640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bc8066e70 0x7f3bc8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.336+0000 7f3be7400640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bc8066e70 0x7f3bc8069330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3be80aad20 tx=0x7f3bd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:09.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.340+0000 7f3bdfe00640 1 -- 172.21.15.114:0/3352397101 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3bd80ec0c0 con 0x7f3be806db50 2024-02-17T12:19:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.492+0000 7f3beec00640 1 -- 172.21.15.114:0/3352397101 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3be80740e0 con 0x7f3bc8066e70 2024-02-17T12:19:09.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.496+0000 7f3bdfe00640 1 -- 172.21.15.114:0/3352397101 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287114 (secure 0 0 0) 0x7f3be80740e0 con 0x7f3bc8066e70 2024-02-17T12:19:09.505 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:19:09.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 -- 172.21.15.114:0/3352397101 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bc8066e70 msgr2=0x7f3bc8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bc8066e70 0x7f3bc8069330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3be80aad20 tx=0x7f3bd4008040 comp rx=0 tx=0).stop 2024-02-17T12:19:09.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 -- 172.21.15.114:0/3352397101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be806db50 msgr2=0x7f3be8151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be806db50 0x7f3be8151be0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3bd801cc70 tx=0x7f3bd8019170 comp rx=0 tx=0).stop 2024-02-17T12:19:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 -- 172.21.15.114:0/3352397101 shutdown_connections 2024-02-17T12:19:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3be8150490 0x7f3be81ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3be80c25a0 0x7f3be81456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3bc8066e70 0x7f3bc8069330 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 --2- 172.21.15.114:0/3352397101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3be806db50 0x7f3be8151be0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 -- 172.21.15.114:0/3352397101 >> 172.21.15.114:0/3352397101 conn(0x7f3be80a8490 msgr2=0x7f3be8149c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 -- 172.21.15.114:0/3352397101 shutdown_connections 2024-02-17T12:19:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.500+0000 7f3beec00640 1 -- 172.21.15.114:0/3352397101 wait complete. 2024-02-17T12:19:09.525 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-02-17T12:19:09.251200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240268,"kb_used_data":7452,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734452,"statfs":{"total":773094113280,"available":772848078848,"internally_reserved":0,"allocated":7630848,"data_stored":3963452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000941"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.718886+0000","last_change":"2024-02-17T12:19:04.712400+0000","last_active":"2024-02-17T12:19:04.718886+0000","last_peered":"2024-02-17T12:19:04.718886+0000","last_clean":"2024-02-17T12:19:04.718886+0000","last_became_active":"2024-02-17T12:19:04.711598+0000","last_became_peered":"2024-02-17T12:19:04.711598+0000","last_unstale":"2024-02-17T12:19:04.718886+0000","last_undegraded":"2024-02-17T12:19:04.718886+0000","last_fullsized":"2024-02-17T12:19:04.718886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727092+0000","last_change":"2024-02-17T12:19:04.723008+0000","last_active":"2024-02-17T12:19:04.727092+0000","last_peered":"2024-02-17T12:19:04.727092+0000","last_clean":"2024-02-17T12:19:04.727092+0000","last_became_active":"2024-02-17T12:19:04.722730+0000","last_became_peered":"2024-02-17T12:19:04.722730+0000","last_unstale":"2024-02-17T12:19:04.727092+0000","last_undegraded":"2024-02-17T12:19:04.727092+0000","last_fullsized":"2024-02-17T12:19:04.727092+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:12:48.461694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699464+0000","last_change":"2024-02-17T12:19:03.699464+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699464+0000","last_undegraded":"2024-02-17T12:19:03.699464+0000","last_fullsized":"2024-02-17T12:19:03.699464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699042+0000","last_change":"2024-02-17T12:19:03.699042+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699042+0000","last_undegraded":"2024-02-17T12:19:03.699042+0000","last_fullsized":"2024-02-17T12:19:03.699042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.692631+0000","last_change":"2024-02-17T12:19:03.692631+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.692631+0000","last_undegraded":"2024-02-17T12:19:03.692631+0000","last_fullsized":"2024-02-17T12:19:03.692631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717921+0000","last_change":"2024-02-17T12:19:04.713676+0000","last_active":"2024-02-17T12:19:04.717921+0000","last_peered":"2024-02-17T12:19:04.717921+0000","last_clean":"2024-02-17T12:19:04.717921+0000","last_became_active":"2024-02-17T12:19:04.710032+0000","last_became_peered":"2024-02-17T12:19:04.710032+0000","last_unstale":"2024-02-17T12:19:04.717921+0000","last_undegraded":"2024-02-17T12:19:04.717921+0000","last_fullsized":"2024-02-17T12:19:04.717921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:15.747901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698538+0000","last_change":"2024-02-17T12:19:03.698538+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698538+0000","last_undegraded":"2024-02-17T12:19:03.698538+0000","last_fullsized":"2024-02-17T12:19:03.698538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719254+0000","last_change":"2024-02-17T12:19:04.716344+0000","last_active":"2024-02-17T12:19:04.719254+0000","last_peered":"2024-02-17T12:19:04.719254+0000","last_clean":"2024-02-17T12:19:04.719254+0000","last_became_active":"2024-02-17T12:19:04.716003+0000","last_became_peered":"2024-02-17T12:19:04.716003+0000","last_unstale":"2024-02-17T12:19:04.719254+0000","last_undegraded":"2024-02-17T12:19:04.719254+0000","last_fullsized":"2024-02-17T12:19:04.719254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:22.948492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.710091+0000","last_change":"2024-02-17T12:19:04.705511+0000","last_active":"2024-02-17T12:19:04.710091+0000","last_peered":"2024-02-17T12:19:04.710091+0000","last_clean":"2024-02-17T12:19:04.710091+0000","last_became_active":"2024-02-17T12:19:04.705195+0000","last_became_peered":"2024-02-17T12:19:04.705195+0000","last_unstale":"2024-02-17T12:19:04.710091+0000","last_undegraded":"2024-02-17T12:19:04.710091+0000","last_fullsized":"2024-02-17T12:19:04.710091+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:45:43.198275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726370+0000","last_change":"2024-02-17T12:19:04.721693+0000","last_active":"2024-02-17T12:19:04.726370+0000","last_peered":"2024-02-17T12:19:04.726370+0000","last_clean":"2024-02-17T12:19:04.726370+0000","last_became_active":"2024-02-17T12:19:04.721343+0000","last_became_peered":"2024-02-17T12:19:04.721343+0000","last_unstale":"2024-02-17T12:19:04.726370+0000","last_undegraded":"2024-02-17T12:19:04.726370+0000","last_fullsized":"2024-02-17T12:19:04.726370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:34:02.841400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727902+0000","last_change":"2024-02-17T12:19:04.717487+0000","last_active":"2024-02-17T12:19:04.727902+0000","last_peered":"2024-02-17T12:19:04.727902+0000","last_clean":"2024-02-17T12:19:04.727902+0000","last_became_active":"2024-02-17T12:19:04.717208+0000","last_became_peered":"2024-02-17T12:19:04.717208+0000","last_unstale":"2024-02-17T12:19:04.727902+0000","last_undegraded":"2024-02-17T12:19:04.727902+0000","last_fullsized":"2024-02-17T12:19:04.727902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:07:05.322779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726397+0000","last_change":"2024-02-17T12:19:04.720687+0000","last_active":"2024-02-17T12:19:04.726397+0000","last_peered":"2024-02-17T12:19:04.726397+0000","last_clean":"2024-02-17T12:19:04.726397+0000","last_became_active":"2024-02-17T12:19:04.720429+0000","last_became_peered":"2024-02-17T12:19:04.720429+0000","last_unstale":"2024-02-17T12:19:04.726397+0000","last_undegraded":"2024-02-17T12:19:04.726397+0000","last_fullsized":"2024-02-17T12:19:04.726397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:36:34.252865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.700312+0000","last_change":"2024-02-17T12:19:03.700312+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.700312+0000","last_undegraded":"2024-02-17T12:19:03.700312+0000","last_fullsized":"2024-02-17T12:19:03.700312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697927+0000","last_change":"2024-02-17T12:19:03.697927+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697927+0000","last_undegraded":"2024-02-17T12:19:03.697927+0000","last_fullsized":"2024-02-17T12:19:03.697927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719297+0000","last_change":"2024-02-17T12:19:04.710789+0000","last_active":"2024-02-17T12:19:04.719297+0000","last_peered":"2024-02-17T12:19:04.719297+0000","last_clean":"2024-02-17T12:19:04.719297+0000","last_became_active":"2024-02-17T12:19:04.710321+0000","last_became_peered":"2024-02-17T12:19:04.710321+0000","last_unstale":"2024-02-17T12:19:04.719297+0000","last_undegraded":"2024-02-17T12:19:04.719297+0000","last_fullsized":"2024-02-17T12:19:04.719297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:50.535947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.688714+0000","last_change":"2024-02-17T12:19:03.688714+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.688714+0000","last_undegraded":"2024-02-17T12:19:03.688714+0000","last_fullsized":"2024-02-17T12:19:03.688714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689044+0000","last_change":"2024-02-17T12:19:03.689044+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689044+0000","last_undegraded":"2024-02-17T12:19:03.689044+0000","last_fullsized":"2024-02-17T12:19:03.689044+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698438+0000","last_change":"2024-02-17T12:19:03.698438+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698438+0000","last_undegraded":"2024-02-17T12:19:03.698438+0000","last_fullsized":"2024-02-17T12:19:03.698438+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.728162+0000","last_change":"2024-02-17T12:19:04.718758+0000","last_active":"2024-02-17T12:19:04.728162+0000","last_peered":"2024-02-17T12:19:04.728162+0000","last_clean":"2024-02-17T12:19:04.728162+0000","last_became_active":"2024-02-17T12:19:04.718486+0000","last_became_peered":"2024-02-17T12:19:04.718486+0000","last_unstale":"2024-02-17T12:19:04.728162+0000","last_undegraded":"2024-02-17T12:19:04.728162+0000","last_fullsized":"2024-02-17T12:19:04.728162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698648+0000","last_change":"2024-02-17T12:19:03.698648+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698648+0000","last_undegraded":"2024-02-17T12:19:03.698648+0000","last_fullsized":"2024-02-17T12:19:03.698648+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697743+0000","last_change":"2024-02-17T12:19:03.697743+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697743+0000","last_undegraded":"2024-02-17T12:19:03.697743+0000","last_fullsized":"2024-02-17T12:19:03.697743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724367+0000","last_change":"2024-02-17T12:19:04.720604+0000","last_active":"2024-02-17T12:19:04.724367+0000","last_peered":"2024-02-17T12:19:04.724367+0000","last_clean":"2024-02-17T12:19:04.724367+0000","last_became_active":"2024-02-17T12:19:04.720350+0000","last_became_peered":"2024-02-17T12:19:04.720350+0000","last_unstale":"2024-02-17T12:19:04.724367+0000","last_undegraded":"2024-02-17T12:19:04.724367+0000","last_fullsized":"2024-02-17T12:19:04.724367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:33:24.591926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726220+0000","last_change":"2024-02-17T12:19:04.716818+0000","last_active":"2024-02-17T12:19:04.726220+0000","last_peered":"2024-02-17T12:19:04.726220+0000","last_clean":"2024-02-17T12:19:04.726220+0000","last_became_active":"2024-02-17T12:19:04.716507+0000","last_became_peered":"2024-02-17T12:19:04.716507+0000","last_unstale":"2024-02-17T12:19:04.726220+0000","last_undegraded":"2024-02-17T12:19:04.726220+0000","last_fullsized":"2024-02-17T12:19:04.726220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697274+0000","last_change":"2024-02-17T12:19:03.697274+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697274+0000","last_undegraded":"2024-02-17T12:19:03.697274+0000","last_fullsized":"2024-02-17T12:19:03.697274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731509+0000","last_change":"2024-02-17T12:19:04.726126+0000","last_active":"2024-02-17T12:19:04.731509+0000","last_peered":"2024-02-17T12:19:04.731509+0000","last_clean":"2024-02-17T12:19:04.731509+0000","last_became_active":"2024-02-17T12:19:04.725344+0000","last_became_peered":"2024-02-17T12:19:04.725344+0000","last_unstale":"2024-02-17T12:19:04.731509+0000","last_undegraded":"2024-02-17T12:19:04.731509+0000","last_fullsized":"2024-02-17T12:19:04.731509+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:35:15.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.701420+0000","last_change":"2024-02-17T12:19:03.701420+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.701420+0000","last_undegraded":"2024-02-17T12:19:03.701420+0000","last_fullsized":"2024-02-17T12:19:03.701420+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689731+0000","last_change":"2024-02-17T12:19:03.689731+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689731+0000","last_undegraded":"2024-02-17T12:19:03.689731+0000","last_fullsized":"2024-02-17T12:19:03.689731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719039+0000","last_change":"2024-02-17T12:19:04.713023+0000","last_active":"2024-02-17T12:19:04.719039+0000","last_peered":"2024-02-17T12:19:04.719039+0000","last_clean":"2024-02-17T12:19:04.719039+0000","last_became_active":"2024-02-17T12:19:04.712535+0000","last_became_peered":"2024-02-17T12:19:04.712535+0000","last_unstale":"2024-02-17T12:19:04.719039+0000","last_undegraded":"2024-02-17T12:19:04.719039+0000","last_fullsized":"2024-02-17T12:19:04.719039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724327+0000","last_change":"2024-02-17T12:19:04.721331+0000","last_active":"2024-02-17T12:19:04.724327+0000","last_peered":"2024-02-17T12:19:04.724327+0000","last_clean":"2024-02-17T12:19:04.724327+0000","last_became_active":"2024-02-17T12:19:04.721066+0000","last_became_peered":"2024-02-17T12:19:04.721066+0000","last_unstale":"2024-02-17T12:19:04.724327+0000","last_undegraded":"2024-02-17T12:19:04.724327+0000","last_fullsized":"2024-02-17T12:19:04.724327+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:26:29.549996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731487+0000","last_change":"2024-02-17T12:19:04.726119+0000","last_active":"2024-02-17T12:19:04.731487+0000","last_peered":"2024-02-17T12:19:04.731487+0000","last_clean":"2024-02-17T12:19:04.731487+0000","last_became_active":"2024-02-17T12:19:04.725509+0000","last_became_peered":"2024-02-17T12:19:04.725509+0000","last_unstale":"2024-02-17T12:19:04.731487+0000","last_undegraded":"2024-02-17T12:19:04.731487+0000","last_fullsized":"2024-02-17T12:19:04.731487+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:10:27.065029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.690070+0000","last_change":"2024-02-17T12:19:03.690070+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.690070+0000","last_undegraded":"2024-02-17T12:19:03.690070+0000","last_fullsized":"2024-02-17T12:19:03.690070+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.733015+0000","last_change":"2024-02-17T12:19:04.729805+0000","last_active":"2024-02-17T12:19:04.733015+0000","last_peered":"2024-02-17T12:19:04.733015+0000","last_clean":"2024-02-17T12:19:04.733015+0000","last_became_active":"2024-02-17T12:19:04.729388+0000","last_became_peered":"2024-02-17T12:19:04.729388+0000","last_unstale":"2024-02-17T12:19:04.733015+0000","last_undegraded":"2024-02-17T12:19:04.733015+0000","last_fullsized":"2024-02-17T12:19:04.733015+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:27.023399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.691122+0000","last_change":"2024-02-17T12:19:03.691122+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.691122+0000","last_undegraded":"2024-02-17T12:19:03.691122+0000","last_fullsized":"2024-02-17T12:19:03.691122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.721801+0000","last_change":"2024-02-17T12:19:03.709066+0000","last_active":"2024-02-17T12:19:04.721801+0000","last_peered":"2024-02-17T12:19:04.721801+0000","last_clean":"2024-02-17T12:19:04.721801+0000","last_became_active":"2024-02-17T12:19:03.708888+0000","last_became_peered":"2024-02-17T12:19:03.708888+0000","last_unstale":"2024-02-17T12:19:04.721801+0000","last_undegraded":"2024-02-17T12:19:04.721801+0000","last_fullsized":"2024-02-17T12:19:04.721801+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726321+0000","last_change":"2024-02-17T12:19:04.718756+0000","last_active":"2024-02-17T12:19:04.726321+0000","last_peered":"2024-02-17T12:19:04.726321+0000","last_clean":"2024-02-17T12:19:04.726321+0000","last_became_active":"2024-02-17T12:19:04.716924+0000","last_became_peered":"2024-02-17T12:19:04.716924+0000","last_unstale":"2024-02-17T12:19:04.726321+0000","last_undegraded":"2024-02-17T12:19:04.726321+0000","last_fullsized":"2024-02-17T12:19:04.726321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.895909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.707135+0000","last_change":"2024-02-17T12:19:03.703800+0000","last_active":"2024-02-17T12:19:03.707135+0000","last_peered":"2024-02-17T12:19:03.707135+0000","last_clean":"2024-02-17T12:19:03.707135+0000","last_became_active":"2024-02-17T12:19:03.703402+0000","last_became_peered":"2024-02-17T12:19:03.703402+0000","last_unstale":"2024-02-17T12:19:03.707135+0000","last_undegraded":"2024-02-17T12:19:03.707135+0000","last_fullsized":"2024-02-17T12:19:03.707135+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:50.069369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.733047+0000","last_change":"2024-02-17T12:19:04.730207+0000","last_active":"2024-02-17T12:19:04.733047+0000","last_peered":"2024-02-17T12:19:04.733047+0000","last_clean":"2024-02-17T12:19:04.733047+0000","last_became_active":"2024-02-17T12:19:04.729363+0000","last_became_peered":"2024-02-17T12:19:04.729363+0000","last_unstale":"2024-02-17T12:19:04.733047+0000","last_undegraded":"2024-02-17T12:19:04.733047+0000","last_fullsized":"2024-02-17T12:19:04.733047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:14:58.856139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727721+0000","last_change":"2024-02-17T12:19:03.704331+0000","last_active":"2024-02-17T12:19:04.727721+0000","last_peered":"2024-02-17T12:19:04.727721+0000","last_clean":"2024-02-17T12:19:04.727721+0000","last_became_active":"2024-02-17T12:19:03.704078+0000","last_became_peered":"2024-02-17T12:19:03.704078+0000","last_unstale":"2024-02-17T12:19:04.727721+0000","last_undegraded":"2024-02-17T12:19:04.727721+0000","last_fullsized":"2024-02-17T12:19:04.727721+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699017+0000","last_change":"2024-02-17T12:19:03.699017+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699017+0000","last_undegraded":"2024-02-17T12:19:03.699017+0000","last_fullsized":"2024-02-17T12:19:03.699017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.730660+0000","last_change":"2024-02-17T12:19:03.702411+0000","last_active":"2024-02-17T12:19:04.730660+0000","last_peered":"2024-02-17T12:19:04.730660+0000","last_clean":"2024-02-17T12:19:04.730660+0000","last_became_active":"2024-02-17T12:19:03.702166+0000","last_became_peered":"2024-02-17T12:19:03.702166+0000","last_unstale":"2024-02-17T12:19:04.730660+0000","last_undegraded":"2024-02-17T12:19:04.730660+0000","last_fullsized":"2024-02-17T12:19:04.730660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731631+0000","last_change":"2024-02-17T12:19:04.726343+0000","last_active":"2024-02-17T12:19:04.731631+0000","last_peered":"2024-02-17T12:19:04.731631+0000","last_clean":"2024-02-17T12:19:04.731631+0000","last_became_active":"2024-02-17T12:19:04.725870+0000","last_became_peered":"2024-02-17T12:19:04.725870+0000","last_unstale":"2024-02-17T12:19:04.731631+0000","last_undegraded":"2024-02-17T12:19:04.731631+0000","last_fullsized":"2024-02-17T12:19:04.731631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.707153+0000","last_change":"2024-02-17T12:19:03.703159+0000","last_active":"2024-02-17T12:19:03.707153+0000","last_peered":"2024-02-17T12:19:03.707153+0000","last_clean":"2024-02-17T12:19:03.707153+0000","last_became_active":"2024-02-17T12:19:03.702811+0000","last_became_peered":"2024-02-17T12:19:03.702811+0000","last_unstale":"2024-02-17T12:19:03.707153+0000","last_undegraded":"2024-02-17T12:19:03.707153+0000","last_fullsized":"2024-02-17T12:19:03.707153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:54:51.881257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.692218+0000","last_change":"2024-02-17T12:19:03.692218+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.692218+0000","last_undegraded":"2024-02-17T12:19:03.692218+0000","last_fullsized":"2024-02-17T12:19:03.692218+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.709981+0000","last_change":"2024-02-17T12:19:03.706093+0000","last_active":"2024-02-17T12:19:03.709981+0000","last_peered":"2024-02-17T12:19:03.709981+0000","last_clean":"2024-02-17T12:19:03.709981+0000","last_became_active":"2024-02-17T12:19:03.705445+0000","last_became_peered":"2024-02-17T12:19:03.705445+0000","last_unstale":"2024-02-17T12:19:03.709981+0000","last_undegraded":"2024-02-17T12:19:03.709981+0000","last_fullsized":"2024-02-17T12:19:03.709981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:54.097755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699811+0000","last_change":"2024-02-17T12:19:03.699811+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699811+0000","last_undegraded":"2024-02-17T12:19:03.699811+0000","last_fullsized":"2024-02-17T12:19:03.699811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.691609+0000","last_change":"2024-02-17T12:19:03.701055+0000","last_active":"2024-02-17T12:19:04.691609+0000","last_peered":"2024-02-17T12:19:04.691609+0000","last_clean":"2024-02-17T12:19:04.691609+0000","last_became_active":"2024-02-17T12:19:03.695988+0000","last_became_peered":"2024-02-17T12:19:03.695988+0000","last_unstale":"2024-02-17T12:19:04.691609+0000","last_undegraded":"2024-02-17T12:19:04.691609+0000","last_fullsized":"2024-02-17T12:19:04.691609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719274+0000","last_change":"2024-02-17T12:19:04.710559+0000","last_active":"2024-02-17T12:19:04.719274+0000","last_peered":"2024-02-17T12:19:04.719274+0000","last_clean":"2024-02-17T12:19:04.719274+0000","last_became_active":"2024-02-17T12:19:04.709979+0000","last_became_peered":"2024-02-17T12:19:04.709979+0000","last_unstale":"2024-02-17T12:19:04.719274+0000","last_undegraded":"2024-02-17T12:19:04.719274+0000","last_fullsized":"2024-02-17T12:19:04.719274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:32:13.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.705096+0000","last_change":"2024-02-17T12:19:03.702309+0000","last_active":"2024-02-17T12:19:04.705096+0000","last_peered":"2024-02-17T12:19:04.705096+0000","last_clean":"2024-02-17T12:19:04.705096+0000","last_became_active":"2024-02-17T12:19:03.702051+0000","last_became_peered":"2024-02-17T12:19:03.702051+0000","last_unstale":"2024-02-17T12:19:04.705096+0000","last_undegraded":"2024-02-17T12:19:04.705096+0000","last_fullsized":"2024-02-17T12:19:04.705096+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:58.978525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731622+0000","last_change":"2024-02-17T12:19:04.726001+0000","last_active":"2024-02-17T12:19:04.731622+0000","last_peered":"2024-02-17T12:19:04.731622+0000","last_clean":"2024-02-17T12:19:04.731622+0000","last_became_active":"2024-02-17T12:19:04.725747+0000","last_became_peered":"2024-02-17T12:19:04.725747+0000","last_unstale":"2024-02-17T12:19:04.731622+0000","last_undegraded":"2024-02-17T12:19:04.731622+0000","last_fullsized":"2024-02-17T12:19:04.731622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:00.818538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706938+0000","last_change":"2024-02-17T12:19:03.712851+0000","last_active":"2024-02-17T12:19:04.706938+0000","last_peered":"2024-02-17T12:19:04.706938+0000","last_clean":"2024-02-17T12:19:04.706938+0000","last_became_active":"2024-02-17T12:19:03.712584+0000","last_became_peered":"2024-02-17T12:19:03.712584+0000","last_unstale":"2024-02-17T12:19:04.706938+0000","last_undegraded":"2024-02-17T12:19:04.706938+0000","last_fullsized":"2024-02-17T12:19:04.706938+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.714755+0000","last_change":"2024-02-17T12:19:04.709578+0000","last_active":"2024-02-17T12:19:04.714755+0000","last_peered":"2024-02-17T12:19:04.714755+0000","last_clean":"2024-02-17T12:19:04.714755+0000","last_became_active":"2024-02-17T12:19:04.709173+0000","last_became_peered":"2024-02-17T12:19:04.709173+0000","last_unstale":"2024-02-17T12:19:04.714755+0000","last_undegraded":"2024-02-17T12:19:04.714755+0000","last_fullsized":"2024-02-17T12:19:04.714755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:19.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706482+0000","last_change":"2024-02-17T12:19:03.707721+0000","last_active":"2024-02-17T12:19:04.706482+0000","last_peered":"2024-02-17T12:19:04.706482+0000","last_clean":"2024-02-17T12:19:04.706482+0000","last_became_active":"2024-02-17T12:19:03.707435+0000","last_became_peered":"2024-02-17T12:19:03.707435+0000","last_unstale":"2024-02-17T12:19:04.706482+0000","last_undegraded":"2024-02-17T12:19:04.706482+0000","last_fullsized":"2024-02-17T12:19:04.706482+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726909+0000","last_change":"2024-02-17T12:19:04.716812+0000","last_active":"2024-02-17T12:19:04.726909+0000","last_peered":"2024-02-17T12:19:04.726909+0000","last_clean":"2024-02-17T12:19:04.726909+0000","last_became_active":"2024-02-17T12:19:04.716307+0000","last_became_peered":"2024-02-17T12:19:04.716307+0000","last_unstale":"2024-02-17T12:19:04.726909+0000","last_undegraded":"2024-02-17T12:19:04.726909+0000","last_fullsized":"2024-02-17T12:19:04.726909+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.729950+0000","last_change":"2024-02-17T12:19:03.710532+0000","last_active":"2024-02-17T12:19:04.729950+0000","last_peered":"2024-02-17T12:19:04.729950+0000","last_clean":"2024-02-17T12:19:04.729950+0000","last_became_active":"2024-02-17T12:19:03.710333+0000","last_became_peered":"2024-02-17T12:19:03.710333+0000","last_unstale":"2024-02-17T12:19:04.729950+0000","last_undegraded":"2024-02-17T12:19:04.729950+0000","last_fullsized":"2024-02-17T12:19:04.729950+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689310+0000","last_change":"2024-02-17T12:19:03.689310+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689310+0000","last_undegraded":"2024-02-17T12:19:03.689310+0000","last_fullsized":"2024-02-17T12:19:03.689310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.736361+0000","last_change":"2024-02-17T12:19:03.704237+0000","last_active":"2024-02-17T12:19:04.736361+0000","last_peered":"2024-02-17T12:19:04.736361+0000","last_clean":"2024-02-17T12:19:04.736361+0000","last_became_active":"2024-02-17T12:19:03.703964+0000","last_became_peered":"2024-02-17T12:19:03.703964+0000","last_unstale":"2024-02-17T12:19:04.736361+0000","last_undegraded":"2024-02-17T12:19:04.736361+0000","last_fullsized":"2024-02-17T12:19:04.736361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:45.097730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.710139+0000","last_change":"2024-02-17T12:19:04.702494+0000","last_active":"2024-02-17T12:19:04.710139+0000","last_peered":"2024-02-17T12:19:04.710139+0000","last_clean":"2024-02-17T12:19:04.710139+0000","last_became_active":"2024-02-17T12:19:04.702168+0000","last_became_peered":"2024-02-17T12:19:04.702168+0000","last_unstale":"2024-02-17T12:19:04.710139+0000","last_undegraded":"2024-02-17T12:19:04.710139+0000","last_fullsized":"2024-02-17T12:19:04.710139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.730818+0000","last_change":"2024-02-17T12:19:03.710630+0000","last_active":"2024-02-17T12:19:04.730818+0000","last_peered":"2024-02-17T12:19:04.730818+0000","last_clean":"2024-02-17T12:19:04.730818+0000","last_became_active":"2024-02-17T12:19:03.710185+0000","last_became_peered":"2024-02-17T12:19:03.710185+0000","last_unstale":"2024-02-17T12:19:04.730818+0000","last_undegraded":"2024-02-17T12:19:04.730818+0000","last_fullsized":"2024-02-17T12:19:04.730818+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:07:16.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699993+0000","last_change":"2024-02-17T12:19:03.699993+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699993+0000","last_undegraded":"2024-02-17T12:19:03.699993+0000","last_fullsized":"2024-02-17T12:19:03.699993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.702490+0000","last_change":"2024-02-17T12:19:03.712475+0000","last_active":"2024-02-17T12:19:04.702490+0000","last_peered":"2024-02-17T12:19:04.702490+0000","last_clean":"2024-02-17T12:19:04.702490+0000","last_became_active":"2024-02-17T12:19:03.712117+0000","last_became_peered":"2024-02-17T12:19:03.712117+0000","last_unstale":"2024-02-17T12:19:04.702490+0000","last_undegraded":"2024-02-17T12:19:04.702490+0000","last_fullsized":"2024-02-17T12:19:04.702490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:10.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.734545+0000","last_change":"2024-02-17T12:19:04.727289+0000","last_active":"2024-02-17T12:19:04.734545+0000","last_peered":"2024-02-17T12:19:04.734545+0000","last_clean":"2024-02-17T12:19:04.734545+0000","last_became_active":"2024-02-17T12:19:04.727041+0000","last_became_peered":"2024-02-17T12:19:04.727041+0000","last_unstale":"2024-02-17T12:19:04.734545+0000","last_undegraded":"2024-02-17T12:19:04.734545+0000","last_fullsized":"2024-02-17T12:19:04.734545+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:22:57.622930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.690608+0000","last_change":"2024-02-17T12:19:03.699211+0000","last_active":"2024-02-17T12:19:04.690608+0000","last_peered":"2024-02-17T12:19:04.690608+0000","last_clean":"2024-02-17T12:19:04.690608+0000","last_became_active":"2024-02-17T12:19:03.698244+0000","last_became_peered":"2024-02-17T12:19:03.698244+0000","last_unstale":"2024-02-17T12:19:04.690608+0000","last_undegraded":"2024-02-17T12:19:04.690608+0000","last_fullsized":"2024-02-17T12:19:04.690608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:42.702805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724088+0000","last_change":"2024-02-17T12:19:04.718529+0000","last_active":"2024-02-17T12:19:04.724088+0000","last_peered":"2024-02-17T12:19:04.724088+0000","last_clean":"2024-02-17T12:19:04.724088+0000","last_became_active":"2024-02-17T12:19:04.718251+0000","last_became_peered":"2024-02-17T12:19:04.718251+0000","last_unstale":"2024-02-17T12:19:04.724088+0000","last_undegraded":"2024-02-17T12:19:04.724088+0000","last_fullsized":"2024-02-17T12:19:04.724088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:36:26.635524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.728196+0000","last_change":"2024-02-17T12:19:03.706554+0000","last_active":"2024-02-17T12:19:04.728196+0000","last_peered":"2024-02-17T12:19:04.728196+0000","last_clean":"2024-02-17T12:19:04.728196+0000","last_became_active":"2024-02-17T12:19:03.706236+0000","last_became_peered":"2024-02-17T12:19:03.706236+0000","last_unstale":"2024-02-17T12:19:04.728196+0000","last_undegraded":"2024-02-17T12:19:04.728196+0000","last_fullsized":"2024-02-17T12:19:04.728196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698928+0000","last_change":"2024-02-17T12:19:03.698928+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698928+0000","last_undegraded":"2024-02-17T12:19:03.698928+0000","last_fullsized":"2024-02-17T12:19:03.698928+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.716889+0000","last_change":"2024-02-17T12:19:03.705648+0000","last_active":"2024-02-17T12:19:04.716889+0000","last_peered":"2024-02-17T12:19:04.716889+0000","last_clean":"2024-02-17T12:19:04.716889+0000","last_became_active":"2024-02-17T12:19:03.705325+0000","last_became_peered":"2024-02-17T12:19:03.705325+0000","last_unstale":"2024-02-17T12:19:04.716889+0000","last_undegraded":"2024-02-17T12:19:04.716889+0000","last_fullsized":"2024-02-17T12:19:04.716889+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726342+0000","last_change":"2024-02-17T12:19:04.719005+0000","last_active":"2024-02-17T12:19:04.726342+0000","last_peered":"2024-02-17T12:19:04.726342+0000","last_clean":"2024-02-17T12:19:04.726342+0000","last_became_active":"2024-02-17T12:19:04.717221+0000","last_became_peered":"2024-02-17T12:19:04.717221+0000","last_unstale":"2024-02-17T12:19:04.726342+0000","last_undegraded":"2024-02-17T12:19:04.726342+0000","last_fullsized":"2024-02-17T12:19:04.726342+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:30.970580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724551+0000","last_change":"2024-02-17T12:19:03.708463+0000","last_active":"2024-02-17T12:19:04.724551+0000","last_peered":"2024-02-17T12:19:04.724551+0000","last_clean":"2024-02-17T12:19:04.724551+0000","last_became_active":"2024-02-17T12:19:03.707739+0000","last_became_peered":"2024-02-17T12:19:03.707739+0000","last_unstale":"2024-02-17T12:19:04.724551+0000","last_undegraded":"2024-02-17T12:19:04.724551+0000","last_fullsized":"2024-02-17T12:19:04.724551+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.688517+0000","last_change":"2024-02-17T12:19:03.688517+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.688517+0000","last_undegraded":"2024-02-17T12:19:03.688517+0000","last_fullsized":"2024-02-17T12:19:03.688517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.692466+0000","last_change":"2024-02-17T12:19:03.700286+0000","last_active":"2024-02-17T12:19:04.692466+0000","last_peered":"2024-02-17T12:19:04.692466+0000","last_clean":"2024-02-17T12:19:04.692466+0000","last_became_active":"2024-02-17T12:19:03.700021+0000","last_became_peered":"2024-02-17T12:19:03.700021+0000","last_unstale":"2024-02-17T12:19:04.692466+0000","last_undegraded":"2024-02-17T12:19:04.692466+0000","last_fullsized":"2024-02-17T12:19:04.692466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.696470+0000","last_change":"2024-02-17T12:19:03.696470+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.696470+0000","last_undegraded":"2024-02-17T12:19:03.696470+0000","last_fullsized":"2024-02-17T12:19:03.696470+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.725054+0000","last_change":"2024-02-17T12:19:03.709412+0000","last_active":"2024-02-17T12:19:04.725054+0000","last_peered":"2024-02-17T12:19:04.725054+0000","last_clean":"2024-02-17T12:19:04.725054+0000","last_became_active":"2024-02-17T12:19:03.709021+0000","last_became_peered":"2024-02-17T12:19:03.709021+0000","last_unstale":"2024-02-17T12:19:04.725054+0000","last_undegraded":"2024-02-17T12:19:04.725054+0000","last_fullsized":"2024-02-17T12:19:04.725054+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:44.049163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717759+0000","last_change":"2024-02-17T12:19:04.712404+0000","last_active":"2024-02-17T12:19:04.717759+0000","last_peered":"2024-02-17T12:19:04.717759+0000","last_clean":"2024-02-17T12:19:04.717759+0000","last_became_active":"2024-02-17T12:19:04.711344+0000","last_became_peered":"2024-02-17T12:19:04.711344+0000","last_unstale":"2024-02-17T12:19:04.717759+0000","last_undegraded":"2024-02-17T12:19:04.717759+0000","last_fullsized":"2024-02-17T12:19:04.717759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:33.580841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.713501+0000","last_change":"2024-02-17T12:19:03.706405+0000","last_active":"2024-02-17T12:19:03.713501+0000","last_peered":"2024-02-17T12:19:03.713501+0000","last_clean":"2024-02-17T12:19:03.713501+0000","last_became_active":"2024-02-17T12:19:03.706108+0000","last_became_peered":"2024-02-17T12:19:03.706108+0000","last_unstale":"2024-02-17T12:19:03.713501+0000","last_undegraded":"2024-02-17T12:19:03.713501+0000","last_fullsized":"2024-02-17T12:19:03.713501+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:46:42.443329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.696296+0000","last_change":"2024-02-17T12:19:03.696296+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.696296+0000","last_undegraded":"2024-02-17T12:19:03.696296+0000","last_fullsized":"2024-02-17T12:19:03.696296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.706485+0000","last_change":"2024-02-17T12:19:03.701598+0000","last_active":"2024-02-17T12:19:03.706485+0000","last_peered":"2024-02-17T12:19:03.706485+0000","last_clean":"2024-02-17T12:19:03.706485+0000","last_became_active":"2024-02-17T12:19:03.701326+0000","last_became_peered":"2024-02-17T12:19:03.701326+0000","last_unstale":"2024-02-17T12:19:03.706485+0000","last_undegraded":"2024-02-17T12:19:03.706485+0000","last_fullsized":"2024-02-17T12:19:03.706485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:28:04.886936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.711704+0000","last_change":"2024-02-17T12:19:04.702184+0000","last_active":"2024-02-17T12:19:04.711704+0000","last_peered":"2024-02-17T12:19:04.711704+0000","last_clean":"2024-02-17T12:19:04.711704+0000","last_became_active":"2024-02-17T12:19:04.701908+0000","last_became_peered":"2024-02-17T12:19:04.701908+0000","last_unstale":"2024-02-17T12:19:04.711704+0000","last_undegraded":"2024-02-17T12:19:04.711704+0000","last_fullsized":"2024-02-17T12:19:04.711704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:25:38.680904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.702062+0000","last_change":"2024-02-17T12:19:03.702614+0000","last_active":"2024-02-17T12:19:04.702062+0000","last_peered":"2024-02-17T12:19:04.702062+0000","last_clean":"2024-02-17T12:19:04.702062+0000","last_became_active":"2024-02-17T12:19:03.702360+0000","last_became_peered":"2024-02-17T12:19:03.702360+0000","last_unstale":"2024-02-17T12:19:04.702062+0000","last_undegraded":"2024-02-17T12:19:04.702062+0000","last_fullsized":"2024-02-17T12:19:04.702062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:37.418089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689927+0000","last_change":"2024-02-17T12:19:03.689927+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689927+0000","last_undegraded":"2024-02-17T12:19:03.689927+0000","last_fullsized":"2024-02-17T12:19:03.689927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.725424+0000","last_change":"2024-02-17T12:19:03.706098+0000","last_active":"2024-02-17T12:19:04.725424+0000","last_peered":"2024-02-17T12:19:04.725424+0000","last_clean":"2024-02-17T12:19:04.725424+0000","last_became_active":"2024-02-17T12:19:03.705787+0000","last_became_peered":"2024-02-17T12:19:03.705787+0000","last_unstale":"2024-02-17T12:19:04.725424+0000","last_undegraded":"2024-02-17T12:19:04.725424+0000","last_fullsized":"2024-02-17T12:19:04.725424+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:59.839484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699376+0000","last_change":"2024-02-17T12:19:03.699376+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699376+0000","last_undegraded":"2024-02-17T12:19:03.699376+0000","last_fullsized":"2024-02-17T12:19:03.699376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.711323+0000","last_change":"2024-02-17T12:19:03.707121+0000","last_active":"2024-02-17T12:19:04.711323+0000","last_peered":"2024-02-17T12:19:04.711323+0000","last_clean":"2024-02-17T12:19:04.711323+0000","last_became_active":"2024-02-17T12:19:03.706873+0000","last_became_peered":"2024-02-17T12:19:03.706873+0000","last_unstale":"2024-02-17T12:19:04.711323+0000","last_undegraded":"2024-02-17T12:19:04.711323+0000","last_fullsized":"2024-02-17T12:19:04.711323+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:24.015391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726377+0000","last_change":"2024-02-17T12:19:04.718645+0000","last_active":"2024-02-17T12:19:04.726377+0000","last_peered":"2024-02-17T12:19:04.726377+0000","last_clean":"2024-02-17T12:19:04.726377+0000","last_became_active":"2024-02-17T12:19:04.715738+0000","last_became_peered":"2024-02-17T12:19:04.715738+0000","last_unstale":"2024-02-17T12:19:04.726377+0000","last_undegraded":"2024-02-17T12:19:04.726377+0000","last_fullsized":"2024-02-17T12:19:04.726377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:53.989897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706273+0000","last_change":"2024-02-17T12:19:03.705719+0000","last_active":"2024-02-17T12:19:04.706273+0000","last_peered":"2024-02-17T12:19:04.706273+0000","last_clean":"2024-02-17T12:19:04.706273+0000","last_became_active":"2024-02-17T12:19:03.705394+0000","last_became_peered":"2024-02-17T12:19:03.705394+0000","last_unstale":"2024-02-17T12:19:04.706273+0000","last_undegraded":"2024-02-17T12:19:04.706273+0000","last_fullsized":"2024-02-17T12:19:04.706273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:18.432832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.687985+0000","last_change":"2024-02-17T12:19:03.687985+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.687985+0000","last_undegraded":"2024-02-17T12:19:03.687985+0000","last_fullsized":"2024-02-17T12:19:03.687985+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706298+0000","last_change":"2024-02-17T12:19:03.712607+0000","last_active":"2024-02-17T12:19:04.706298+0000","last_peered":"2024-02-17T12:19:04.706298+0000","last_clean":"2024-02-17T12:19:04.706298+0000","last_became_active":"2024-02-17T12:19:03.712328+0000","last_became_peered":"2024-02-17T12:19:03.712328+0000","last_unstale":"2024-02-17T12:19:04.706298+0000","last_undegraded":"2024-02-17T12:19:04.706298+0000","last_fullsized":"2024-02-17T12:19:04.706298+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717437+0000","last_change":"2024-02-17T12:19:04.711425+0000","last_active":"2024-02-17T12:19:04.717437+0000","last_peered":"2024-02-17T12:19:04.717437+0000","last_clean":"2024-02-17T12:19:04.717437+0000","last_became_active":"2024-02-17T12:19:04.711149+0000","last_became_peered":"2024-02-17T12:19:04.711149+0000","last_unstale":"2024-02-17T12:19:04.717437+0000","last_undegraded":"2024-02-17T12:19:04.717437+0000","last_fullsized":"2024-02-17T12:19:04.717437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:09.191064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.692502+0000","last_change":"2024-02-17T12:19:03.708773+0000","last_active":"2024-02-17T12:19:04.692502+0000","last_peered":"2024-02-17T12:19:04.692502+0000","last_clean":"2024-02-17T12:19:04.692502+0000","last_became_active":"2024-02-17T12:19:03.707579+0000","last_became_peered":"2024-02-17T12:19:03.707579+0000","last_unstale":"2024-02-17T12:19:04.692502+0000","last_undegraded":"2024-02-17T12:19:04.692502+0000","last_fullsized":"2024-02-17T12:19:04.692502+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.709256+0000","last_change":"2024-02-17T12:19:04.699129+0000","last_active":"2024-02-17T12:19:04.709256+0000","last_peered":"2024-02-17T12:19:04.709256+0000","last_clean":"2024-02-17T12:19:04.709256+0000","last_became_active":"2024-02-17T12:19:04.698800+0000","last_became_peered":"2024-02-17T12:19:04.698800+0000","last_unstale":"2024-02-17T12:19:04.709256+0000","last_undegraded":"2024-02-17T12:19:04.709256+0000","last_fullsized":"2024-02-17T12:19:04.709256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.709959+0000","last_change":"2024-02-17T12:19:03.705779+0000","last_active":"2024-02-17T12:19:03.709959+0000","last_peered":"2024-02-17T12:19:03.709959+0000","last_clean":"2024-02-17T12:19:03.709959+0000","last_became_active":"2024-02-17T12:19:03.705453+0000","last_became_peered":"2024-02-17T12:19:03.705453+0000","last_unstale":"2024-02-17T12:19:03.709959+0000","last_undegraded":"2024-02-17T12:19:03.709959+0000","last_fullsized":"2024-02-17T12:19:03.709959+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:14.221858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699370+0000","last_change":"2024-02-17T12:19:03.699370+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699370+0000","last_undegraded":"2024-02-17T12:19:03.699370+0000","last_fullsized":"2024-02-17T12:19:03.699370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706435+0000","last_change":"2024-02-17T12:19:03.710199+0000","last_active":"2024-02-17T12:19:04.706435+0000","last_peered":"2024-02-17T12:19:04.706435+0000","last_clean":"2024-02-17T12:19:04.706435+0000","last_became_active":"2024-02-17T12:19:03.709947+0000","last_became_peered":"2024-02-17T12:19:03.709947+0000","last_unstale":"2024-02-17T12:19:04.706435+0000","last_undegraded":"2024-02-17T12:19:04.706435+0000","last_fullsized":"2024-02-17T12:19:04.706435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.718478+0000","last_change":"2024-02-17T12:19:04.713606+0000","last_active":"2024-02-17T12:19:04.718478+0000","last_peered":"2024-02-17T12:19:04.718478+0000","last_clean":"2024-02-17T12:19:04.718478+0000","last_became_active":"2024-02-17T12:19:04.708088+0000","last_became_peered":"2024-02-17T12:19:04.708088+0000","last_unstale":"2024-02-17T12:19:04.718478+0000","last_undegraded":"2024-02-17T12:19:04.718478+0000","last_fullsized":"2024-02-17T12:19:04.718478+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.704981+0000","last_change":"2024-02-17T12:19:03.701618+0000","last_active":"2024-02-17T12:19:03.704981+0000","last_peered":"2024-02-17T12:19:03.704981+0000","last_clean":"2024-02-17T12:19:03.704981+0000","last_became_active":"2024-02-17T12:19:03.701291+0000","last_became_peered":"2024-02-17T12:19:03.701291+0000","last_unstale":"2024-02-17T12:19:03.704981+0000","last_undegraded":"2024-02-17T12:19:03.704981+0000","last_fullsized":"2024-02-17T12:19:03.704981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.901708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.723067+0000","last_change":"2024-02-17T12:19:04.719250+0000","last_active":"2024-02-17T12:19:04.723067+0000","last_peered":"2024-02-17T12:19:04.723067+0000","last_clean":"2024-02-17T12:19:04.723067+0000","last_became_active":"2024-02-17T12:19:04.718856+0000","last_became_peered":"2024-02-17T12:19:04.718856+0000","last_unstale":"2024-02-17T12:19:04.723067+0000","last_undegraded":"2024-02-17T12:19:04.723067+0000","last_fullsized":"2024-02-17T12:19:04.723067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:53:35.790267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.720220+0000","last_change":"2024-02-17T12:19:03.712148+0000","last_active":"2024-02-17T12:19:03.720220+0000","last_peered":"2024-02-17T12:19:03.720220+0000","last_clean":"2024-02-17T12:19:03.720220+0000","last_became_active":"2024-02-17T12:19:03.711771+0000","last_became_peered":"2024-02-17T12:19:03.711771+0000","last_unstale":"2024-02-17T12:19:03.720220+0000","last_undegraded":"2024-02-17T12:19:03.720220+0000","last_fullsized":"2024-02-17T12:19:03.720220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:14.842866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":253,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.702332+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:19:03.702332+0000","last_peered":"2024-02-17T12:19:03.702332+0000","last_clean":"2024-02-17T12:19:03.702332+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:19:03.702332+0000","last_undegraded":"2024-02-17T12:19:03.702332+0000","last_fullsized":"2024-02-17T12:19:03.702332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88700000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":1.115,"15min":1.115},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88500000000000001,"5min":1.143,"15min":1.143},"last":0.73599999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88700000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.58399999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85299999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.82099999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":831488,"data_stored":355915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.75},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.72199999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65000000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.432},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.625}]}]},{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.44},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.36299999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.621,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":1.387,"15min":1.387},"last":1.014}]},{"osd":4,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.497,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0409999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.714,"15min":1.714},"last":1.149},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.744,"15min":1.744},"last":1.1339999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91500000000000004,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0980000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.002,"5min":1.575,"15min":1.575},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96899999999999997,"5min":1.321,"15min":1.321},"last":0.73599999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64200000000000002,"5min":1.145,"15min":1.145},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.34000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69499999999999995,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58099999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73799999999999999,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.373}]},{"osd":3,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":2.609,"15min":2.609},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.079,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59199999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.90700000000000003,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.997,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.05,"5min":1.095,"15min":1.095},"last":0.60499999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0469999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0820000000000001,"5min":5.375,"15min":5.375},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":1.0169999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.091,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.629,"15min":1.629},"last":0.56799999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":944683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47899999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45100000000000001,"15min":0.45700000000000002},"min":{"1min":0.312,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":1.046,"15min":1.046},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76900000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.58699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66700000000000004}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0129999999999999,"5min":1.139,"15min":1.139},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92800000000000005,"5min":1.038,"15min":1.038},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94499999999999995,"5min":1.095,"15min":1.095},"last":0.999}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0960000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.008}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.042},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90200000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.92200000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28372,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343468,"statfs":{"total":96636764160,"available":96607711232,"internally_reserved":0,"allocated":1384448,"data_stored":931599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84899999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.97399999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75700000000000001,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92400000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90000000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.74299999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86799999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84399999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95099999999999996,"5min":1.052,"15min":1.052},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.95399999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86799999999999999,"5min":1.264,"15min":1.264},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.198,"15min":1.198},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.171,"15min":1.171},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93600000000000005,"5min":1.522,"15min":1.522},"last":0.88200000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89900000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88100000000000001,"5min":1.228,"15min":1.228},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.74299999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":341231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.141,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81999999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93300000000000005,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2749999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.997,"5min":1.252,"15min":1.252},"last":0.83399999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91500000000000004,"5min":1.29,"15min":1.29},"last":0.876},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":1.337,"15min":1.337},"last":0.92400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:19:09.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2024-02-17T12:19:09.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.699464+0000', 'last_change': '2024-02-17T12:19:03.699464+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.699464+0000', 'last_undegraded': '2024-02-17T12:19:03.699464+0000', 'last_fullsized': '2024-02-17T12:19:03.699464+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:19:09.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2024-02-17T12:19:09.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.699042+0000', 'last_change': '2024-02-17T12:19:03.699042+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.699042+0000', 'last_undegraded': '2024-02-17T12:19:03.699042+0000', 'last_fullsized': '2024-02-17T12:19:03.699042+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:19:09.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2024-02-17T12:19:09.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.692631+0000', 'last_change': '2024-02-17T12:19:03.692631+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.692631+0000', 'last_undegraded': '2024-02-17T12:19:03.692631+0000', 'last_fullsized': '2024-02-17T12:19:03.692631+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2024-02-17T12:19:09.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.698538+0000', 'last_change': '2024-02-17T12:19:03.698538+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.698538+0000', 'last_undegraded': '2024-02-17T12:19:03.698538+0000', 'last_fullsized': '2024-02-17T12:19:03.698538+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:19:09.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2024-02-17T12:19:09.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.700312+0000', 'last_change': '2024-02-17T12:19:03.700312+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.700312+0000', 'last_undegraded': '2024-02-17T12:19:03.700312+0000', 'last_fullsized': '2024-02-17T12:19:03.700312+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:19:09.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2024-02-17T12:19:09.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.697927+0000', 'last_change': '2024-02-17T12:19:03.697927+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.697927+0000', 'last_undegraded': '2024-02-17T12:19:03.697927+0000', 'last_fullsized': '2024-02-17T12:19:03.697927+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:19:09.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2024-02-17T12:19:09.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.688714+0000', 'last_change': '2024-02-17T12:19:03.688714+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.688714+0000', 'last_undegraded': '2024-02-17T12:19:03.688714+0000', 'last_fullsized': '2024-02-17T12:19:03.688714+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2024-02-17T12:19:09.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.689044+0000', 'last_change': '2024-02-17T12:19:03.689044+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.689044+0000', 'last_undegraded': '2024-02-17T12:19:03.689044+0000', 'last_fullsized': '2024-02-17T12:19:03.689044+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.698438+0000', 'last_change': '2024-02-17T12:19:03.698438+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.698438+0000', 'last_undegraded': '2024-02-17T12:19:03.698438+0000', 'last_fullsized': '2024-02-17T12:19:03.698438+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.698648+0000', 'last_change': '2024-02-17T12:19:03.698648+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.698648+0000', 'last_undegraded': '2024-02-17T12:19:03.698648+0000', 'last_fullsized': '2024-02-17T12:19:03.698648+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.697743+0000', 'last_change': '2024-02-17T12:19:03.697743+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.697743+0000', 'last_undegraded': '2024-02-17T12:19:03.697743+0000', 'last_fullsized': '2024-02-17T12:19:03.697743+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.697274+0000', 'last_change': '2024-02-17T12:19:03.697274+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.697274+0000', 'last_undegraded': '2024-02-17T12:19:03.697274+0000', 'last_fullsized': '2024-02-17T12:19:03.697274+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.701420+0000', 'last_change': '2024-02-17T12:19:03.701420+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.701420+0000', 'last_undegraded': '2024-02-17T12:19:03.701420+0000', 'last_fullsized': '2024-02-17T12:19:03.701420+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:19:09.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.689731+0000', 'last_change': '2024-02-17T12:19:03.689731+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.689731+0000', 'last_undegraded': '2024-02-17T12:19:03.689731+0000', 'last_fullsized': '2024-02-17T12:19:03.689731+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.690070+0000', 'last_change': '2024-02-17T12:19:03.690070+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.690070+0000', 'last_undegraded': '2024-02-17T12:19:03.690070+0000', 'last_fullsized': '2024-02-17T12:19:03.690070+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.691122+0000', 'last_change': '2024-02-17T12:19:03.691122+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.691122+0000', 'last_undegraded': '2024-02-17T12:19:03.691122+0000', 'last_fullsized': '2024-02-17T12:19:03.691122+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.699017+0000', 'last_change': '2024-02-17T12:19:03.699017+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.699017+0000', 'last_undegraded': '2024-02-17T12:19:03.699017+0000', 'last_fullsized': '2024-02-17T12:19:03.699017+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.692218+0000', 'last_change': '2024-02-17T12:19:03.692218+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.692218+0000', 'last_undegraded': '2024-02-17T12:19:03.692218+0000', 'last_fullsized': '2024-02-17T12:19:03.692218+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2024-02-17T12:19:09.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.699811+0000', 'last_change': '2024-02-17T12:19:03.699811+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.699811+0000', 'last_undegraded': '2024-02-17T12:19:03.699811+0000', 'last_fullsized': '2024-02-17T12:19:03.699811+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.689310+0000', 'last_change': '2024-02-17T12:19:03.689310+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.689310+0000', 'last_undegraded': '2024-02-17T12:19:03.689310+0000', 'last_fullsized': '2024-02-17T12:19:03.689310+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.699993+0000', 'last_change': '2024-02-17T12:19:03.699993+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.699993+0000', 'last_undegraded': '2024-02-17T12:19:03.699993+0000', 'last_fullsized': '2024-02-17T12:19:03.699993+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.698928+0000', 'last_change': '2024-02-17T12:19:03.698928+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.698928+0000', 'last_undegraded': '2024-02-17T12:19:03.698928+0000', 'last_fullsized': '2024-02-17T12:19:03.698928+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.688517+0000', 'last_change': '2024-02-17T12:19:03.688517+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.688517+0000', 'last_undegraded': '2024-02-17T12:19:03.688517+0000', 'last_fullsized': '2024-02-17T12:19:03.688517+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.696470+0000', 'last_change': '2024-02-17T12:19:03.696470+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.696470+0000', 'last_undegraded': '2024-02-17T12:19:03.696470+0000', 'last_fullsized': '2024-02-17T12:19:03.696470+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:19:09.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2024-02-17T12:19:09.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.696296+0000', 'last_change': '2024-02-17T12:19:03.696296+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.696296+0000', 'last_undegraded': '2024-02-17T12:19:03.696296+0000', 'last_fullsized': '2024-02-17T12:19:03.696296+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-17T12:19:09.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2024-02-17T12:19:09.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.689927+0000', 'last_change': '2024-02-17T12:19:03.689927+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.689927+0000', 'last_undegraded': '2024-02-17T12:19:03.689927+0000', 'last_fullsized': '2024-02-17T12:19:03.689927+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2024-02-17T12:19:09.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.699376+0000', 'last_change': '2024-02-17T12:19:03.699376+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.699376+0000', 'last_undegraded': '2024-02-17T12:19:03.699376+0000', 'last_fullsized': '2024-02-17T12:19:03.699376+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:19:09.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2024-02-17T12:19:09.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.687985+0000', 'last_change': '2024-02-17T12:19:03.687985+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.687985+0000', 'last_undegraded': '2024-02-17T12:19:03.687985+0000', 'last_fullsized': '2024-02-17T12:19:03.687985+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-17T12:19:09.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2024-02-17T12:19:09.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-02-17T12:19:03.699370+0000', 'last_change': '2024-02-17T12:19:03.699370+0000', 'last_active': '2024-02-17T12:19:03.677439+0000', 'last_peered': '2024-02-17T12:19:03.677439+0000', 'last_clean': '2024-02-17T12:19:03.677439+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:03.699370+0000', 'last_undegraded': '2024-02-17T12:19:03.699370+0000', 'last_fullsized': '2024-02-17T12:19:03.699370+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:03.677439+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-17T12:19:09.536 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-17T12:19:09.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f843de00640 1 Processor -- start 2024-02-17T12:19:09.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f843de00640 1 -- start start 2024-02-17T12:19:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f843de00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f84380c1870 0x7f8438155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f843de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 0x7f843806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f843de00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84381592b0 con 0x7f843806f530 2024-02-17T12:19:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f843de00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84380c3880 con 0x7f84380c1870 2024-02-17T12:19:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f843de00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380702b0 con 0x7f843806efe0 2024-02-17T12:19:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8436a00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f843806f530 0x7f8438155210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:41986/0 (socket says 172.21.15.114:41986) 2024-02-17T12:19:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8436a00640 1 -- 172.21.15.114:0/2543297123 learned_addr learned my addr 172.21.15.114:0/2543297123 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8437400640 1 --2- 172.21.15.114:0/2543297123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 0x7f843806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8436000640 1 --2- 172.21.15.114:0/2543297123 >> v2:172.21.15.116:3300/0 conn(0x7f84380c1870 0x7f8438155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8435600640 1 -- 172.21.15.114:0/2543297123 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338332056 0 0) 0x7f84381592b0 con 0x7f843806f530 2024-02-17T12:19:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8435600640 1 -- 172.21.15.114:0/2543297123 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f841c003530 con 0x7f843806f530 2024-02-17T12:19:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8437400640 1 -- 172.21.15.114:0/2543297123 >> v2:172.21.15.116:3300/0 conn(0x7f84380c1870 msgr2=0x7f8438155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8437400640 1 --2- 172.21.15.114:0/2543297123 >> v2:172.21.15.116:3300/0 conn(0x7f84380c1870 0x7f8438155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8437400640 1 -- 172.21.15.114:0/2543297123 >> v1:172.21.15.116:6789/0 conn(0x7f843806f530 legacy=0x7f8438155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8437400640 1 -- 172.21.15.114:0/2543297123 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8438158330 con 0x7f843806efe0 2024-02-17T12:19:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.700+0000 7f8436000640 1 --2- 172.21.15.114:0/2543297123 >> v2:172.21.15.116:3300/0 conn(0x7f84380c1870 0x7f8438155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f8437400640 1 --2- 172.21.15.114:0/2543297123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 0x7f843806f910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f84300097c0 tx=0x7f843001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fed731e248bf2a83 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:09.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f8435600640 1 -- 172.21.15.114:0/2543297123 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300ab600 con 0x7f843806efe0 2024-02-17T12:19:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f8435600640 1 -- 172.21.15.114:0/2543297123 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300a7050 con 0x7f843806efe0 2024-02-17T12:19:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f8435600640 1 -- 172.21.15.114:0/2543297123 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300ab980 con 0x7f843806efe0 2024-02-17T12:19:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f843de00640 1 -- 172.21.15.114:0/2543297123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 msgr2=0x7f843806f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f843de00640 1 --2- 172.21.15.114:0/2543297123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 0x7f843806f910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f84300097c0 tx=0x7f843001c410 comp rx=0 tx=0).stop 2024-02-17T12:19:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f843de00640 1 -- 172.21.15.114:0/2543297123 shutdown_connections 2024-02-17T12:19:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f843de00640 1 --2- 172.21.15.114:0/2543297123 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 0x7f843806f910 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f843de00640 1 --2- 172.21.15.114:0/2543297123 >> v2:172.21.15.116:3300/0 conn(0x7f84380c1870 0x7f8438155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f843de00640 1 -- 172.21.15.114:0/2543297123 >> 172.21.15.114:0/2543297123 conn(0x7f843806bd20 msgr2=0x7f843806c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f843de00640 1 -- 172.21.15.114:0/2543297123 shutdown_connections 2024-02-17T12:19:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.704+0000 7f843de00640 1 -- 172.21.15.114:0/2543297123 wait complete. 2024-02-17T12:19:09.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 Processor -- start 2024-02-17T12:19:09.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 -- start start 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 0x7f84380c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f843806f530 0x7f8438151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84380c1870 0x7f8438151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84381ee350 con 0x7f843806f530 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84380c71e0 con 0x7f84380c1870 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84381ed7d0 con 0x7f843806efe0 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8436000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f843806f530 0x7f8438151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8436000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f843806f530 0x7f8438151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40780/0 (socket says 172.21.15.114:40780) 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8436000640 1 -- 172.21.15.114:0/3710929536 learned_addr learned my addr 172.21.15.114:0/3710929536 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8436a00640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 0x7f84380c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8437400640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84380c1870 0x7f8438151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8436000640 1 -- 172.21.15.114:0/3710929536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 msgr2=0x7f84380c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8436000640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 0x7f84380c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8436000640 1 -- 172.21.15.114:0/3710929536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84380c1870 msgr2=0x7f8438151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8436000640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84380c1870 0x7f8438151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8436000640 1 -- 172.21.15.114:0/3710929536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424009420 con 0x7f843806f530 2024-02-17T12:19:09.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f8436000640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f843806f530 0x7f8438151250 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f842400e9d0 tx=0x7f842400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:09.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f842f400640 1 -- 172.21.15.114:0/3710929536 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842400ca60 con 0x7f843806f530 2024-02-17T12:19:09.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f842f400640 1 -- 172.21.15.114:0/3710929536 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842400cbc0 con 0x7f843806f530 2024-02-17T12:19:09.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f842f400640 1 -- 172.21.15.114:0/3710929536 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424013470 con 0x7f843806f530 2024-02-17T12:19:09.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 -- 172.21.15.114:0/3710929536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8430009420 con 0x7f843806f530 2024-02-17T12:19:09.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 -- 172.21.15.114:0/3710929536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84381edd90 con 0x7f843806f530 2024-02-17T12:19:09.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.708+0000 7f843de00640 1 -- 172.21.15.114:0/3710929536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8438074840 con 0x7f843806f530 2024-02-17T12:19:09.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.712+0000 7f842f400640 1 -- 172.21.15.114:0/3710929536 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f84240135d0 con 0x7f843806f530 2024-02-17T12:19:09.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.712+0000 7f842f400640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8418066e40 0x7f8418069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:09.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.712+0000 7f842f400640 1 -- 172.21.15.114:0/3710929536 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8424084900 con 0x7f843806f530 2024-02-17T12:19:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.712+0000 7f8436a00640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8418066e40 0x7f8418069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.712+0000 7f8436a00640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8418066e40 0x7f8418069300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8428005c10 tx=0x7f8428009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:09.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.716+0000 7f842f400640 1 -- 172.21.15.114:0/3710929536 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8424051830 con 0x7f843806f530 2024-02-17T12:19:09.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.928+0000 7f843de00640 1 -- 172.21.15.114:0/3710929536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f84380c15e0 con 0x7f843806f530 2024-02-17T12:19:09.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.928+0000 7f842f400640 1 -- 172.21.15.114:0/3710929536 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1389 (secure 0 0 0) 0x7f8424054ef0 con 0x7f843806f530 2024-02-17T12:19:09.934 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:09.934 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":191,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1708172169,"num_in_osds":8,"osd_in_since":1708172160,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":68},{"state_name":"creating+peering","count":29}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592708,"bytes_used":246034432,"bytes_avail":772848078848,"bytes_total":773094113280,"inactive_pgs_ratio":0.29896906018257141,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":49,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6504}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-02-17T12:18:59.249747+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-17T12:19:09.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 -- 172.21.15.114:0/3710929536 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8418066e40 msgr2=0x7f8418069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8418066e40 0x7f8418069300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8428005c10 tx=0x7f8428009040 comp rx=0 tx=0).stop 2024-02-17T12:19:09.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 -- 172.21.15.114:0/3710929536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f843806f530 msgr2=0x7f8438151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:09.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f843806f530 0x7f8438151250 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f842400e9d0 tx=0x7f842400ee90 comp rx=0 tx=0).stop 2024-02-17T12:19:09.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 -- 172.21.15.114:0/3710929536 shutdown_connections 2024-02-17T12:19:09.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f84380c1870 0x7f8438151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8418066e40 0x7f8418069300 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f843806f530 0x7f8438151250 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 --2- 172.21.15.114:0/3710929536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f843806efe0 0x7f84380c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:09.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 -- 172.21.15.114:0/3710929536 >> 172.21.15.114:0/3710929536 conn(0x7f843806bd20 msgr2=0x7f8438153270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:09.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 -- 172.21.15.114:0/3710929536 shutdown_connections 2024-02-17T12:19:09.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:09.932+0000 7f843de00640 1 -- 172.21.15.114:0/3710929536 wait complete. 2024-02-17T12:19:09.954 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-17T12:19:09.954 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:19:10.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.084+0000 7fa7eb600640 1 Processor -- start 2024-02-17T12:19:10.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.084+0000 7fa7eb600640 1 -- start start 2024-02-17T12:19:10.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7eb600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa7e414f110 0x7fa7e40c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:10.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7eb600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e40a9420 con 0x7fa7e40c1eb0 2024-02-17T12:19:10.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7eb600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e4152850 con 0x7fa7e40c2580 2024-02-17T12:19:10.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7eb600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e414f4f0 con 0x7fa7e414f110 2024-02-17T12:19:10.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e9600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa7e40c1eb0 0x7fa7e415c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42144/0 (socket says 172.21.15.114:42144) 2024-02-17T12:19:10.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e9600640 1 -- 172.21.15.114:0/1657164406 learned_addr learned my addr 172.21.15.114:0/1657164406 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:10.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e8c00640 1 --2- 172.21.15.114:0/1657164406 >> v2:172.21.15.116:3300/0 conn(0x7fa7e414f110 0x7fa7e40c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:10.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497761629 0 0) 0x7fa7e40a9420 con 0x7fa7e40c1eb0 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7c8003530 con 0x7fa7e40c1eb0 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078096510 0 0) 0x7fa7e4152850 con 0x7fa7e40c2580 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e40a9420 con 0x7fa7e40c2580 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1339066024 0 0) 0x7fa7c8003530 con 0x7fa7e40c1eb0 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 >> v2:172.21.15.116:3300/0 conn(0x7fa7e414f110 msgr2=0x7fa7e40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 --2- 172.21.15.114:0/1657164406 >> v2:172.21.15.116:3300/0 conn(0x7fa7e414f110 0x7fa7e40c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 >> v1:172.21.15.116:6789/0 conn(0x7fa7e40c2580 legacy=0x7fa7e40aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e40a9670 con 0x7fa7e40c1eb0 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fa7dc001680 con 0x7fa7e40c1eb0 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e8c00640 1 --2- 172.21.15.114:0/1657164406 >> v2:172.21.15.116:3300/0 conn(0x7fa7e414f110 0x7fa7e40c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 >> v1:172.21.15.114:6789/0 conn(0x7fa7e40c1eb0 legacy=0x7fa7e415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7c8003b10 0x7fa7c8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:10.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7c80047d0 0x7fa7c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7c8005190 0x7fa7c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e414f4f0 con 0x7fa7c80047d0 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c800c0c0 con 0x7fa7c8005190 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c800c280 con 0x7fa7c8003b10 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3e00640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7c80047d0 0x7fa7c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e8c00640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7c8003b10 0x7fa7c8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e9600640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7c8005190 0x7fa7c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3e00640 1 -- 172.21.15.114:0/1657164406 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7c8003b10 msgr2=0x7fa7c8003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3e00640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7c8003b10 0x7fa7c8003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3e00640 1 -- 172.21.15.114:0/1657164406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7c8005190 msgr2=0x7fa7c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3e00640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7c8005190 0x7fa7c800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e3e00640 1 -- 172.21.15.114:0/1657164406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8003530 con 0x7fa7c80047d0 2024-02-17T12:19:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.088+0000 7fa7e9600640 1 -- 172.21.15.114:0/1657164406 reap_dead start 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7e3e00640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7c80047d0 0x7fa7c8004c50 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40c29a0 tx=0x7fa7cc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccd5132e3e8fe20 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0050d0 con 0x7fa7c80047d0 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc0a7050 con 0x7fa7c80047d0 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7e3400640 1 -- 172.21.15.114:0/1657164406 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc005470 con 0x7fa7c80047d0 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7eb600640 1 -- 172.21.15.114:0/1657164406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7c80047d0 msgr2=0x7fa7c8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7eb600640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7c80047d0 0x7fa7c8004c50 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40c29a0 tx=0x7fa7cc01c540 comp rx=0 tx=0).stop 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7eb600640 1 -- 172.21.15.114:0/1657164406 shutdown_connections 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7eb600640 1 --2- 172.21.15.114:0/1657164406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7c80047d0 0x7fa7c8004c50 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7eb600640 1 -- 172.21.15.114:0/1657164406 >> 172.21.15.114:0/1657164406 conn(0x7fa7e40a8490 msgr2=0x7fa7e40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7eb600640 1 -- 172.21.15.114:0/1657164406 shutdown_connections 2024-02-17T12:19:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.092+0000 7fa7eb600640 1 -- 172.21.15.114:0/1657164406 wait complete. 2024-02-17T12:19:10.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 Processor -- start 2024-02-17T12:19:10.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 -- start start 2024-02-17T12:19:10.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7c80047d0 0x7fa7e414cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:10.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e41f1760 0x7fa7e413e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e413eaa0 0x7fa7e413e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40c4db0 con 0x7fa7e41f1760 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e41f12d0 con 0x7fa7e413eaa0 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40c4b10 con 0x7fa7c80047d0 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e41f1760 0x7fa7e413e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e41f1760 0x7fa7e413e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40804/0 (socket says 172.21.15.114:40804) 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e3e00640 1 -- 172.21.15.114:0/3850497722 learned_addr learned my addr 172.21.15.114:0/3850497722 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e8c00640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7c80047d0 0x7fa7e414cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e9600640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e413eaa0 0x7fa7e413e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e3e00640 1 -- 172.21.15.114:0/3850497722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7c80047d0 msgr2=0x7fa7e414cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e3e00640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7c80047d0 0x7fa7e414cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e3e00640 1 -- 172.21.15.114:0/3850497722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e413eaa0 msgr2=0x7fa7e413e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e3e00640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e413eaa0 0x7fa7e413e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e3e00640 1 -- 172.21.15.114:0/3850497722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e41f0c80 con 0x7fa7e41f1760 2024-02-17T12:19:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e8c00640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7c80047d0 0x7fa7e414cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e9600640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e413eaa0 0x7fa7e413e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e3e00640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e41f1760 0x7fa7e413e000 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc000c10 tx=0x7fa7c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e0c00640 1 -- 172.21.15.114:0/3850497722 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc006920 con 0x7fa7e41f1760 2024-02-17T12:19:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e0c00640 1 -- 172.21.15.114:0/3850497722 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc006a80 con 0x7fa7e41f1760 2024-02-17T12:19:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7e0c00640 1 -- 172.21.15.114:0/3850497722 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc006df0 con 0x7fa7e41f1760 2024-02-17T12:19:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 -- 172.21.15.114:0/3850497722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e41f0f60 con 0x7fa7e41f1760 2024-02-17T12:19:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 -- 172.21.15.114:0/3850497722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e414d0e0 con 0x7fa7e41f1760 2024-02-17T12:19:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.096+0000 7fa7eb600640 1 -- 172.21.15.114:0/3850497722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e41f0ae0 con 0x7fa7e41f1760 2024-02-17T12:19:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.100+0000 7fa7e0c00640 1 -- 172.21.15.114:0/3850497722 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa7cc007040 con 0x7fa7e41f1760 2024-02-17T12:19:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.100+0000 7fa7e0c00640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa7c0066d80 0x7fa7c0069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.100+0000 7fa7e0c00640 1 -- 172.21.15.114:0/3850497722 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7cc11ec90 con 0x7fa7e41f1760 2024-02-17T12:19:10.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.100+0000 7fa7e8c00640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa7c0066d80 0x7fa7c0069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:10.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.100+0000 7fa7e8c00640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa7c0066d80 0x7fa7c0069240 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4050830 tx=0x7fa7d400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:10.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.104+0000 7fa7e0c00640 1 -- 172.21.15.114:0/3850497722 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa7e41f0ae0 con 0x7fa7e41f1760 2024-02-17T12:19:10.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.252+0000 7fa7eb600640 1 -- 172.21.15.114:0/3850497722 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7e41f0ae0 con 0x7fa7c0066d80 2024-02-17T12:19:10.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.260+0000 7fa7e0c00640 1 -- 172.21.15.114:0/3850497722 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287114 (secure 0 0 0) 0x7fa7e41f0ae0 con 0x7fa7c0066d80 2024-02-17T12:19:10.270 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:10.272 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:19:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 -- 172.21.15.114:0/3850497722 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa7c0066d80 msgr2=0x7fa7c0069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa7c0066d80 0x7fa7c0069240 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4050830 tx=0x7fa7d400b040 comp rx=0 tx=0).stop 2024-02-17T12:19:10.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 -- 172.21.15.114:0/3850497722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e41f1760 msgr2=0x7fa7e413e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e41f1760 0x7fa7e413e000 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc000c10 tx=0x7fa7c8005800 comp rx=0 tx=0).stop 2024-02-17T12:19:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 -- 172.21.15.114:0/3850497722 shutdown_connections 2024-02-17T12:19:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7e413eaa0 0x7fa7e413e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa7c0066d80 0x7fa7c0069240 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7e41f1760 0x7fa7e413e000 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 --2- 172.21.15.114:0/3850497722 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7c80047d0 0x7fa7e414cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 -- 172.21.15.114:0/3850497722 >> 172.21.15.114:0/3850497722 conn(0x7fa7e40a8490 msgr2=0x7fa7e406dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 -- 172.21.15.114:0/3850497722 shutdown_connections 2024-02-17T12:19:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:10.264+0000 7fa7eb600640 1 -- 172.21.15.114:0/3850497722 wait complete. 2024-02-17T12:19:10.289 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-02-17T12:19:09.251200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240268,"kb_used_data":7452,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734452,"statfs":{"total":773094113280,"available":772848078848,"internally_reserved":0,"allocated":7630848,"data_stored":3963452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000941"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.718886+0000","last_change":"2024-02-17T12:19:04.712400+0000","last_active":"2024-02-17T12:19:04.718886+0000","last_peered":"2024-02-17T12:19:04.718886+0000","last_clean":"2024-02-17T12:19:04.718886+0000","last_became_active":"2024-02-17T12:19:04.711598+0000","last_became_peered":"2024-02-17T12:19:04.711598+0000","last_unstale":"2024-02-17T12:19:04.718886+0000","last_undegraded":"2024-02-17T12:19:04.718886+0000","last_fullsized":"2024-02-17T12:19:04.718886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727092+0000","last_change":"2024-02-17T12:19:04.723008+0000","last_active":"2024-02-17T12:19:04.727092+0000","last_peered":"2024-02-17T12:19:04.727092+0000","last_clean":"2024-02-17T12:19:04.727092+0000","last_became_active":"2024-02-17T12:19:04.722730+0000","last_became_peered":"2024-02-17T12:19:04.722730+0000","last_unstale":"2024-02-17T12:19:04.727092+0000","last_undegraded":"2024-02-17T12:19:04.727092+0000","last_fullsized":"2024-02-17T12:19:04.727092+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:12:48.461694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699464+0000","last_change":"2024-02-17T12:19:03.699464+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699464+0000","last_undegraded":"2024-02-17T12:19:03.699464+0000","last_fullsized":"2024-02-17T12:19:03.699464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699042+0000","last_change":"2024-02-17T12:19:03.699042+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699042+0000","last_undegraded":"2024-02-17T12:19:03.699042+0000","last_fullsized":"2024-02-17T12:19:03.699042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.692631+0000","last_change":"2024-02-17T12:19:03.692631+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.692631+0000","last_undegraded":"2024-02-17T12:19:03.692631+0000","last_fullsized":"2024-02-17T12:19:03.692631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717921+0000","last_change":"2024-02-17T12:19:04.713676+0000","last_active":"2024-02-17T12:19:04.717921+0000","last_peered":"2024-02-17T12:19:04.717921+0000","last_clean":"2024-02-17T12:19:04.717921+0000","last_became_active":"2024-02-17T12:19:04.710032+0000","last_became_peered":"2024-02-17T12:19:04.710032+0000","last_unstale":"2024-02-17T12:19:04.717921+0000","last_undegraded":"2024-02-17T12:19:04.717921+0000","last_fullsized":"2024-02-17T12:19:04.717921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:15.747901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698538+0000","last_change":"2024-02-17T12:19:03.698538+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698538+0000","last_undegraded":"2024-02-17T12:19:03.698538+0000","last_fullsized":"2024-02-17T12:19:03.698538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719254+0000","last_change":"2024-02-17T12:19:04.716344+0000","last_active":"2024-02-17T12:19:04.719254+0000","last_peered":"2024-02-17T12:19:04.719254+0000","last_clean":"2024-02-17T12:19:04.719254+0000","last_became_active":"2024-02-17T12:19:04.716003+0000","last_became_peered":"2024-02-17T12:19:04.716003+0000","last_unstale":"2024-02-17T12:19:04.719254+0000","last_undegraded":"2024-02-17T12:19:04.719254+0000","last_fullsized":"2024-02-17T12:19:04.719254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:22.948492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.710091+0000","last_change":"2024-02-17T12:19:04.705511+0000","last_active":"2024-02-17T12:19:04.710091+0000","last_peered":"2024-02-17T12:19:04.710091+0000","last_clean":"2024-02-17T12:19:04.710091+0000","last_became_active":"2024-02-17T12:19:04.705195+0000","last_became_peered":"2024-02-17T12:19:04.705195+0000","last_unstale":"2024-02-17T12:19:04.710091+0000","last_undegraded":"2024-02-17T12:19:04.710091+0000","last_fullsized":"2024-02-17T12:19:04.710091+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:45:43.198275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726370+0000","last_change":"2024-02-17T12:19:04.721693+0000","last_active":"2024-02-17T12:19:04.726370+0000","last_peered":"2024-02-17T12:19:04.726370+0000","last_clean":"2024-02-17T12:19:04.726370+0000","last_became_active":"2024-02-17T12:19:04.721343+0000","last_became_peered":"2024-02-17T12:19:04.721343+0000","last_unstale":"2024-02-17T12:19:04.726370+0000","last_undegraded":"2024-02-17T12:19:04.726370+0000","last_fullsized":"2024-02-17T12:19:04.726370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:34:02.841400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727902+0000","last_change":"2024-02-17T12:19:04.717487+0000","last_active":"2024-02-17T12:19:04.727902+0000","last_peered":"2024-02-17T12:19:04.727902+0000","last_clean":"2024-02-17T12:19:04.727902+0000","last_became_active":"2024-02-17T12:19:04.717208+0000","last_became_peered":"2024-02-17T12:19:04.717208+0000","last_unstale":"2024-02-17T12:19:04.727902+0000","last_undegraded":"2024-02-17T12:19:04.727902+0000","last_fullsized":"2024-02-17T12:19:04.727902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:07:05.322779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726397+0000","last_change":"2024-02-17T12:19:04.720687+0000","last_active":"2024-02-17T12:19:04.726397+0000","last_peered":"2024-02-17T12:19:04.726397+0000","last_clean":"2024-02-17T12:19:04.726397+0000","last_became_active":"2024-02-17T12:19:04.720429+0000","last_became_peered":"2024-02-17T12:19:04.720429+0000","last_unstale":"2024-02-17T12:19:04.726397+0000","last_undegraded":"2024-02-17T12:19:04.726397+0000","last_fullsized":"2024-02-17T12:19:04.726397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:36:34.252865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.700312+0000","last_change":"2024-02-17T12:19:03.700312+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.700312+0000","last_undegraded":"2024-02-17T12:19:03.700312+0000","last_fullsized":"2024-02-17T12:19:03.700312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697927+0000","last_change":"2024-02-17T12:19:03.697927+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697927+0000","last_undegraded":"2024-02-17T12:19:03.697927+0000","last_fullsized":"2024-02-17T12:19:03.697927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719297+0000","last_change":"2024-02-17T12:19:04.710789+0000","last_active":"2024-02-17T12:19:04.719297+0000","last_peered":"2024-02-17T12:19:04.719297+0000","last_clean":"2024-02-17T12:19:04.719297+0000","last_became_active":"2024-02-17T12:19:04.710321+0000","last_became_peered":"2024-02-17T12:19:04.710321+0000","last_unstale":"2024-02-17T12:19:04.719297+0000","last_undegraded":"2024-02-17T12:19:04.719297+0000","last_fullsized":"2024-02-17T12:19:04.719297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:50.535947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.688714+0000","last_change":"2024-02-17T12:19:03.688714+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.688714+0000","last_undegraded":"2024-02-17T12:19:03.688714+0000","last_fullsized":"2024-02-17T12:19:03.688714+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689044+0000","last_change":"2024-02-17T12:19:03.689044+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689044+0000","last_undegraded":"2024-02-17T12:19:03.689044+0000","last_fullsized":"2024-02-17T12:19:03.689044+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698438+0000","last_change":"2024-02-17T12:19:03.698438+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698438+0000","last_undegraded":"2024-02-17T12:19:03.698438+0000","last_fullsized":"2024-02-17T12:19:03.698438+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.728162+0000","last_change":"2024-02-17T12:19:04.718758+0000","last_active":"2024-02-17T12:19:04.728162+0000","last_peered":"2024-02-17T12:19:04.728162+0000","last_clean":"2024-02-17T12:19:04.728162+0000","last_became_active":"2024-02-17T12:19:04.718486+0000","last_became_peered":"2024-02-17T12:19:04.718486+0000","last_unstale":"2024-02-17T12:19:04.728162+0000","last_undegraded":"2024-02-17T12:19:04.728162+0000","last_fullsized":"2024-02-17T12:19:04.728162+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698648+0000","last_change":"2024-02-17T12:19:03.698648+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698648+0000","last_undegraded":"2024-02-17T12:19:03.698648+0000","last_fullsized":"2024-02-17T12:19:03.698648+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697743+0000","last_change":"2024-02-17T12:19:03.697743+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697743+0000","last_undegraded":"2024-02-17T12:19:03.697743+0000","last_fullsized":"2024-02-17T12:19:03.697743+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724367+0000","last_change":"2024-02-17T12:19:04.720604+0000","last_active":"2024-02-17T12:19:04.724367+0000","last_peered":"2024-02-17T12:19:04.724367+0000","last_clean":"2024-02-17T12:19:04.724367+0000","last_became_active":"2024-02-17T12:19:04.720350+0000","last_became_peered":"2024-02-17T12:19:04.720350+0000","last_unstale":"2024-02-17T12:19:04.724367+0000","last_undegraded":"2024-02-17T12:19:04.724367+0000","last_fullsized":"2024-02-17T12:19:04.724367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:33:24.591926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726220+0000","last_change":"2024-02-17T12:19:04.716818+0000","last_active":"2024-02-17T12:19:04.726220+0000","last_peered":"2024-02-17T12:19:04.726220+0000","last_clean":"2024-02-17T12:19:04.726220+0000","last_became_active":"2024-02-17T12:19:04.716507+0000","last_became_peered":"2024-02-17T12:19:04.716507+0000","last_unstale":"2024-02-17T12:19:04.726220+0000","last_undegraded":"2024-02-17T12:19:04.726220+0000","last_fullsized":"2024-02-17T12:19:04.726220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.697274+0000","last_change":"2024-02-17T12:19:03.697274+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.697274+0000","last_undegraded":"2024-02-17T12:19:03.697274+0000","last_fullsized":"2024-02-17T12:19:03.697274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731509+0000","last_change":"2024-02-17T12:19:04.726126+0000","last_active":"2024-02-17T12:19:04.731509+0000","last_peered":"2024-02-17T12:19:04.731509+0000","last_clean":"2024-02-17T12:19:04.731509+0000","last_became_active":"2024-02-17T12:19:04.725344+0000","last_became_peered":"2024-02-17T12:19:04.725344+0000","last_unstale":"2024-02-17T12:19:04.731509+0000","last_undegraded":"2024-02-17T12:19:04.731509+0000","last_fullsized":"2024-02-17T12:19:04.731509+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:35:15.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.701420+0000","last_change":"2024-02-17T12:19:03.701420+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.701420+0000","last_undegraded":"2024-02-17T12:19:03.701420+0000","last_fullsized":"2024-02-17T12:19:03.701420+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689731+0000","last_change":"2024-02-17T12:19:03.689731+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689731+0000","last_undegraded":"2024-02-17T12:19:03.689731+0000","last_fullsized":"2024-02-17T12:19:03.689731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719039+0000","last_change":"2024-02-17T12:19:04.713023+0000","last_active":"2024-02-17T12:19:04.719039+0000","last_peered":"2024-02-17T12:19:04.719039+0000","last_clean":"2024-02-17T12:19:04.719039+0000","last_became_active":"2024-02-17T12:19:04.712535+0000","last_became_peered":"2024-02-17T12:19:04.712535+0000","last_unstale":"2024-02-17T12:19:04.719039+0000","last_undegraded":"2024-02-17T12:19:04.719039+0000","last_fullsized":"2024-02-17T12:19:04.719039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724327+0000","last_change":"2024-02-17T12:19:04.721331+0000","last_active":"2024-02-17T12:19:04.724327+0000","last_peered":"2024-02-17T12:19:04.724327+0000","last_clean":"2024-02-17T12:19:04.724327+0000","last_became_active":"2024-02-17T12:19:04.721066+0000","last_became_peered":"2024-02-17T12:19:04.721066+0000","last_unstale":"2024-02-17T12:19:04.724327+0000","last_undegraded":"2024-02-17T12:19:04.724327+0000","last_fullsized":"2024-02-17T12:19:04.724327+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:26:29.549996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731487+0000","last_change":"2024-02-17T12:19:04.726119+0000","last_active":"2024-02-17T12:19:04.731487+0000","last_peered":"2024-02-17T12:19:04.731487+0000","last_clean":"2024-02-17T12:19:04.731487+0000","last_became_active":"2024-02-17T12:19:04.725509+0000","last_became_peered":"2024-02-17T12:19:04.725509+0000","last_unstale":"2024-02-17T12:19:04.731487+0000","last_undegraded":"2024-02-17T12:19:04.731487+0000","last_fullsized":"2024-02-17T12:19:04.731487+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:10:27.065029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.690070+0000","last_change":"2024-02-17T12:19:03.690070+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.690070+0000","last_undegraded":"2024-02-17T12:19:03.690070+0000","last_fullsized":"2024-02-17T12:19:03.690070+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.733015+0000","last_change":"2024-02-17T12:19:04.729805+0000","last_active":"2024-02-17T12:19:04.733015+0000","last_peered":"2024-02-17T12:19:04.733015+0000","last_clean":"2024-02-17T12:19:04.733015+0000","last_became_active":"2024-02-17T12:19:04.729388+0000","last_became_peered":"2024-02-17T12:19:04.729388+0000","last_unstale":"2024-02-17T12:19:04.733015+0000","last_undegraded":"2024-02-17T12:19:04.733015+0000","last_fullsized":"2024-02-17T12:19:04.733015+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:27.023399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.691122+0000","last_change":"2024-02-17T12:19:03.691122+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.691122+0000","last_undegraded":"2024-02-17T12:19:03.691122+0000","last_fullsized":"2024-02-17T12:19:03.691122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.721801+0000","last_change":"2024-02-17T12:19:03.709066+0000","last_active":"2024-02-17T12:19:04.721801+0000","last_peered":"2024-02-17T12:19:04.721801+0000","last_clean":"2024-02-17T12:19:04.721801+0000","last_became_active":"2024-02-17T12:19:03.708888+0000","last_became_peered":"2024-02-17T12:19:03.708888+0000","last_unstale":"2024-02-17T12:19:04.721801+0000","last_undegraded":"2024-02-17T12:19:04.721801+0000","last_fullsized":"2024-02-17T12:19:04.721801+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726321+0000","last_change":"2024-02-17T12:19:04.718756+0000","last_active":"2024-02-17T12:19:04.726321+0000","last_peered":"2024-02-17T12:19:04.726321+0000","last_clean":"2024-02-17T12:19:04.726321+0000","last_became_active":"2024-02-17T12:19:04.716924+0000","last_became_peered":"2024-02-17T12:19:04.716924+0000","last_unstale":"2024-02-17T12:19:04.726321+0000","last_undegraded":"2024-02-17T12:19:04.726321+0000","last_fullsized":"2024-02-17T12:19:04.726321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.895909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.707135+0000","last_change":"2024-02-17T12:19:03.703800+0000","last_active":"2024-02-17T12:19:03.707135+0000","last_peered":"2024-02-17T12:19:03.707135+0000","last_clean":"2024-02-17T12:19:03.707135+0000","last_became_active":"2024-02-17T12:19:03.703402+0000","last_became_peered":"2024-02-17T12:19:03.703402+0000","last_unstale":"2024-02-17T12:19:03.707135+0000","last_undegraded":"2024-02-17T12:19:03.707135+0000","last_fullsized":"2024-02-17T12:19:03.707135+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:50.069369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.733047+0000","last_change":"2024-02-17T12:19:04.730207+0000","last_active":"2024-02-17T12:19:04.733047+0000","last_peered":"2024-02-17T12:19:04.733047+0000","last_clean":"2024-02-17T12:19:04.733047+0000","last_became_active":"2024-02-17T12:19:04.729363+0000","last_became_peered":"2024-02-17T12:19:04.729363+0000","last_unstale":"2024-02-17T12:19:04.733047+0000","last_undegraded":"2024-02-17T12:19:04.733047+0000","last_fullsized":"2024-02-17T12:19:04.733047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:14:58.856139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.727721+0000","last_change":"2024-02-17T12:19:03.704331+0000","last_active":"2024-02-17T12:19:04.727721+0000","last_peered":"2024-02-17T12:19:04.727721+0000","last_clean":"2024-02-17T12:19:04.727721+0000","last_became_active":"2024-02-17T12:19:03.704078+0000","last_became_peered":"2024-02-17T12:19:03.704078+0000","last_unstale":"2024-02-17T12:19:04.727721+0000","last_undegraded":"2024-02-17T12:19:04.727721+0000","last_fullsized":"2024-02-17T12:19:04.727721+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699017+0000","last_change":"2024-02-17T12:19:03.699017+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699017+0000","last_undegraded":"2024-02-17T12:19:03.699017+0000","last_fullsized":"2024-02-17T12:19:03.699017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.730660+0000","last_change":"2024-02-17T12:19:03.702411+0000","last_active":"2024-02-17T12:19:04.730660+0000","last_peered":"2024-02-17T12:19:04.730660+0000","last_clean":"2024-02-17T12:19:04.730660+0000","last_became_active":"2024-02-17T12:19:03.702166+0000","last_became_peered":"2024-02-17T12:19:03.702166+0000","last_unstale":"2024-02-17T12:19:04.730660+0000","last_undegraded":"2024-02-17T12:19:04.730660+0000","last_fullsized":"2024-02-17T12:19:04.730660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731631+0000","last_change":"2024-02-17T12:19:04.726343+0000","last_active":"2024-02-17T12:19:04.731631+0000","last_peered":"2024-02-17T12:19:04.731631+0000","last_clean":"2024-02-17T12:19:04.731631+0000","last_became_active":"2024-02-17T12:19:04.725870+0000","last_became_peered":"2024-02-17T12:19:04.725870+0000","last_unstale":"2024-02-17T12:19:04.731631+0000","last_undegraded":"2024-02-17T12:19:04.731631+0000","last_fullsized":"2024-02-17T12:19:04.731631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:04:43.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.707153+0000","last_change":"2024-02-17T12:19:03.703159+0000","last_active":"2024-02-17T12:19:03.707153+0000","last_peered":"2024-02-17T12:19:03.707153+0000","last_clean":"2024-02-17T12:19:03.707153+0000","last_became_active":"2024-02-17T12:19:03.702811+0000","last_became_peered":"2024-02-17T12:19:03.702811+0000","last_unstale":"2024-02-17T12:19:03.707153+0000","last_undegraded":"2024-02-17T12:19:03.707153+0000","last_fullsized":"2024-02-17T12:19:03.707153+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:54:51.881257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.692218+0000","last_change":"2024-02-17T12:19:03.692218+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.692218+0000","last_undegraded":"2024-02-17T12:19:03.692218+0000","last_fullsized":"2024-02-17T12:19:03.692218+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.709981+0000","last_change":"2024-02-17T12:19:03.706093+0000","last_active":"2024-02-17T12:19:03.709981+0000","last_peered":"2024-02-17T12:19:03.709981+0000","last_clean":"2024-02-17T12:19:03.709981+0000","last_became_active":"2024-02-17T12:19:03.705445+0000","last_became_peered":"2024-02-17T12:19:03.705445+0000","last_unstale":"2024-02-17T12:19:03.709981+0000","last_undegraded":"2024-02-17T12:19:03.709981+0000","last_fullsized":"2024-02-17T12:19:03.709981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:03:54.097755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699811+0000","last_change":"2024-02-17T12:19:03.699811+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699811+0000","last_undegraded":"2024-02-17T12:19:03.699811+0000","last_fullsized":"2024-02-17T12:19:03.699811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.691609+0000","last_change":"2024-02-17T12:19:03.701055+0000","last_active":"2024-02-17T12:19:04.691609+0000","last_peered":"2024-02-17T12:19:04.691609+0000","last_clean":"2024-02-17T12:19:04.691609+0000","last_became_active":"2024-02-17T12:19:03.695988+0000","last_became_peered":"2024-02-17T12:19:03.695988+0000","last_unstale":"2024-02-17T12:19:04.691609+0000","last_undegraded":"2024-02-17T12:19:04.691609+0000","last_fullsized":"2024-02-17T12:19:04.691609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.719274+0000","last_change":"2024-02-17T12:19:04.710559+0000","last_active":"2024-02-17T12:19:04.719274+0000","last_peered":"2024-02-17T12:19:04.719274+0000","last_clean":"2024-02-17T12:19:04.719274+0000","last_became_active":"2024-02-17T12:19:04.709979+0000","last_became_peered":"2024-02-17T12:19:04.709979+0000","last_unstale":"2024-02-17T12:19:04.719274+0000","last_undegraded":"2024-02-17T12:19:04.719274+0000","last_fullsized":"2024-02-17T12:19:04.719274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:32:13.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.705096+0000","last_change":"2024-02-17T12:19:03.702309+0000","last_active":"2024-02-17T12:19:04.705096+0000","last_peered":"2024-02-17T12:19:04.705096+0000","last_clean":"2024-02-17T12:19:04.705096+0000","last_became_active":"2024-02-17T12:19:03.702051+0000","last_became_peered":"2024-02-17T12:19:03.702051+0000","last_unstale":"2024-02-17T12:19:04.705096+0000","last_undegraded":"2024-02-17T12:19:04.705096+0000","last_fullsized":"2024-02-17T12:19:04.705096+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:58.978525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.731622+0000","last_change":"2024-02-17T12:19:04.726001+0000","last_active":"2024-02-17T12:19:04.731622+0000","last_peered":"2024-02-17T12:19:04.731622+0000","last_clean":"2024-02-17T12:19:04.731622+0000","last_became_active":"2024-02-17T12:19:04.725747+0000","last_became_peered":"2024-02-17T12:19:04.725747+0000","last_unstale":"2024-02-17T12:19:04.731622+0000","last_undegraded":"2024-02-17T12:19:04.731622+0000","last_fullsized":"2024-02-17T12:19:04.731622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:00.818538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706938+0000","last_change":"2024-02-17T12:19:03.712851+0000","last_active":"2024-02-17T12:19:04.706938+0000","last_peered":"2024-02-17T12:19:04.706938+0000","last_clean":"2024-02-17T12:19:04.706938+0000","last_became_active":"2024-02-17T12:19:03.712584+0000","last_became_peered":"2024-02-17T12:19:03.712584+0000","last_unstale":"2024-02-17T12:19:04.706938+0000","last_undegraded":"2024-02-17T12:19:04.706938+0000","last_fullsized":"2024-02-17T12:19:04.706938+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.714755+0000","last_change":"2024-02-17T12:19:04.709578+0000","last_active":"2024-02-17T12:19:04.714755+0000","last_peered":"2024-02-17T12:19:04.714755+0000","last_clean":"2024-02-17T12:19:04.714755+0000","last_became_active":"2024-02-17T12:19:04.709173+0000","last_became_peered":"2024-02-17T12:19:04.709173+0000","last_unstale":"2024-02-17T12:19:04.714755+0000","last_undegraded":"2024-02-17T12:19:04.714755+0000","last_fullsized":"2024-02-17T12:19:04.714755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:19.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706482+0000","last_change":"2024-02-17T12:19:03.707721+0000","last_active":"2024-02-17T12:19:04.706482+0000","last_peered":"2024-02-17T12:19:04.706482+0000","last_clean":"2024-02-17T12:19:04.706482+0000","last_became_active":"2024-02-17T12:19:03.707435+0000","last_became_peered":"2024-02-17T12:19:03.707435+0000","last_unstale":"2024-02-17T12:19:04.706482+0000","last_undegraded":"2024-02-17T12:19:04.706482+0000","last_fullsized":"2024-02-17T12:19:04.706482+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726909+0000","last_change":"2024-02-17T12:19:04.716812+0000","last_active":"2024-02-17T12:19:04.726909+0000","last_peered":"2024-02-17T12:19:04.726909+0000","last_clean":"2024-02-17T12:19:04.726909+0000","last_became_active":"2024-02-17T12:19:04.716307+0000","last_became_peered":"2024-02-17T12:19:04.716307+0000","last_unstale":"2024-02-17T12:19:04.726909+0000","last_undegraded":"2024-02-17T12:19:04.726909+0000","last_fullsized":"2024-02-17T12:19:04.726909+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.729950+0000","last_change":"2024-02-17T12:19:03.710532+0000","last_active":"2024-02-17T12:19:04.729950+0000","last_peered":"2024-02-17T12:19:04.729950+0000","last_clean":"2024-02-17T12:19:04.729950+0000","last_became_active":"2024-02-17T12:19:03.710333+0000","last_became_peered":"2024-02-17T12:19:03.710333+0000","last_unstale":"2024-02-17T12:19:04.729950+0000","last_undegraded":"2024-02-17T12:19:04.729950+0000","last_fullsized":"2024-02-17T12:19:04.729950+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689310+0000","last_change":"2024-02-17T12:19:03.689310+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689310+0000","last_undegraded":"2024-02-17T12:19:03.689310+0000","last_fullsized":"2024-02-17T12:19:03.689310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.736361+0000","last_change":"2024-02-17T12:19:03.704237+0000","last_active":"2024-02-17T12:19:04.736361+0000","last_peered":"2024-02-17T12:19:04.736361+0000","last_clean":"2024-02-17T12:19:04.736361+0000","last_became_active":"2024-02-17T12:19:03.703964+0000","last_became_peered":"2024-02-17T12:19:03.703964+0000","last_unstale":"2024-02-17T12:19:04.736361+0000","last_undegraded":"2024-02-17T12:19:04.736361+0000","last_fullsized":"2024-02-17T12:19:04.736361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:45.097730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.710139+0000","last_change":"2024-02-17T12:19:04.702494+0000","last_active":"2024-02-17T12:19:04.710139+0000","last_peered":"2024-02-17T12:19:04.710139+0000","last_clean":"2024-02-17T12:19:04.710139+0000","last_became_active":"2024-02-17T12:19:04.702168+0000","last_became_peered":"2024-02-17T12:19:04.702168+0000","last_unstale":"2024-02-17T12:19:04.710139+0000","last_undegraded":"2024-02-17T12:19:04.710139+0000","last_fullsized":"2024-02-17T12:19:04.710139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.730818+0000","last_change":"2024-02-17T12:19:03.710630+0000","last_active":"2024-02-17T12:19:04.730818+0000","last_peered":"2024-02-17T12:19:04.730818+0000","last_clean":"2024-02-17T12:19:04.730818+0000","last_became_active":"2024-02-17T12:19:03.710185+0000","last_became_peered":"2024-02-17T12:19:03.710185+0000","last_unstale":"2024-02-17T12:19:04.730818+0000","last_undegraded":"2024-02-17T12:19:04.730818+0000","last_fullsized":"2024-02-17T12:19:04.730818+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:07:16.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699993+0000","last_change":"2024-02-17T12:19:03.699993+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699993+0000","last_undegraded":"2024-02-17T12:19:03.699993+0000","last_fullsized":"2024-02-17T12:19:03.699993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.702490+0000","last_change":"2024-02-17T12:19:03.712475+0000","last_active":"2024-02-17T12:19:04.702490+0000","last_peered":"2024-02-17T12:19:04.702490+0000","last_clean":"2024-02-17T12:19:04.702490+0000","last_became_active":"2024-02-17T12:19:03.712117+0000","last_became_peered":"2024-02-17T12:19:03.712117+0000","last_unstale":"2024-02-17T12:19:04.702490+0000","last_undegraded":"2024-02-17T12:19:04.702490+0000","last_fullsized":"2024-02-17T12:19:04.702490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:10.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.734545+0000","last_change":"2024-02-17T12:19:04.727289+0000","last_active":"2024-02-17T12:19:04.734545+0000","last_peered":"2024-02-17T12:19:04.734545+0000","last_clean":"2024-02-17T12:19:04.734545+0000","last_became_active":"2024-02-17T12:19:04.727041+0000","last_became_peered":"2024-02-17T12:19:04.727041+0000","last_unstale":"2024-02-17T12:19:04.734545+0000","last_undegraded":"2024-02-17T12:19:04.734545+0000","last_fullsized":"2024-02-17T12:19:04.734545+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:22:57.622930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.690608+0000","last_change":"2024-02-17T12:19:03.699211+0000","last_active":"2024-02-17T12:19:04.690608+0000","last_peered":"2024-02-17T12:19:04.690608+0000","last_clean":"2024-02-17T12:19:04.690608+0000","last_became_active":"2024-02-17T12:19:03.698244+0000","last_became_peered":"2024-02-17T12:19:03.698244+0000","last_unstale":"2024-02-17T12:19:04.690608+0000","last_undegraded":"2024-02-17T12:19:04.690608+0000","last_fullsized":"2024-02-17T12:19:04.690608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:42.702805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724088+0000","last_change":"2024-02-17T12:19:04.718529+0000","last_active":"2024-02-17T12:19:04.724088+0000","last_peered":"2024-02-17T12:19:04.724088+0000","last_clean":"2024-02-17T12:19:04.724088+0000","last_became_active":"2024-02-17T12:19:04.718251+0000","last_became_peered":"2024-02-17T12:19:04.718251+0000","last_unstale":"2024-02-17T12:19:04.724088+0000","last_undegraded":"2024-02-17T12:19:04.724088+0000","last_fullsized":"2024-02-17T12:19:04.724088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:36:26.635524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.728196+0000","last_change":"2024-02-17T12:19:03.706554+0000","last_active":"2024-02-17T12:19:04.728196+0000","last_peered":"2024-02-17T12:19:04.728196+0000","last_clean":"2024-02-17T12:19:04.728196+0000","last_became_active":"2024-02-17T12:19:03.706236+0000","last_became_peered":"2024-02-17T12:19:03.706236+0000","last_unstale":"2024-02-17T12:19:04.728196+0000","last_undegraded":"2024-02-17T12:19:04.728196+0000","last_fullsized":"2024-02-17T12:19:04.728196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.698928+0000","last_change":"2024-02-17T12:19:03.698928+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.698928+0000","last_undegraded":"2024-02-17T12:19:03.698928+0000","last_fullsized":"2024-02-17T12:19:03.698928+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.716889+0000","last_change":"2024-02-17T12:19:03.705648+0000","last_active":"2024-02-17T12:19:04.716889+0000","last_peered":"2024-02-17T12:19:04.716889+0000","last_clean":"2024-02-17T12:19:04.716889+0000","last_became_active":"2024-02-17T12:19:03.705325+0000","last_became_peered":"2024-02-17T12:19:03.705325+0000","last_unstale":"2024-02-17T12:19:04.716889+0000","last_undegraded":"2024-02-17T12:19:04.716889+0000","last_fullsized":"2024-02-17T12:19:04.716889+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726342+0000","last_change":"2024-02-17T12:19:04.719005+0000","last_active":"2024-02-17T12:19:04.726342+0000","last_peered":"2024-02-17T12:19:04.726342+0000","last_clean":"2024-02-17T12:19:04.726342+0000","last_became_active":"2024-02-17T12:19:04.717221+0000","last_became_peered":"2024-02-17T12:19:04.717221+0000","last_unstale":"2024-02-17T12:19:04.726342+0000","last_undegraded":"2024-02-17T12:19:04.726342+0000","last_fullsized":"2024-02-17T12:19:04.726342+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:30.970580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.724551+0000","last_change":"2024-02-17T12:19:03.708463+0000","last_active":"2024-02-17T12:19:04.724551+0000","last_peered":"2024-02-17T12:19:04.724551+0000","last_clean":"2024-02-17T12:19:04.724551+0000","last_became_active":"2024-02-17T12:19:03.707739+0000","last_became_peered":"2024-02-17T12:19:03.707739+0000","last_unstale":"2024-02-17T12:19:04.724551+0000","last_undegraded":"2024-02-17T12:19:04.724551+0000","last_fullsized":"2024-02-17T12:19:04.724551+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.688517+0000","last_change":"2024-02-17T12:19:03.688517+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.688517+0000","last_undegraded":"2024-02-17T12:19:03.688517+0000","last_fullsized":"2024-02-17T12:19:03.688517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.692466+0000","last_change":"2024-02-17T12:19:03.700286+0000","last_active":"2024-02-17T12:19:04.692466+0000","last_peered":"2024-02-17T12:19:04.692466+0000","last_clean":"2024-02-17T12:19:04.692466+0000","last_became_active":"2024-02-17T12:19:03.700021+0000","last_became_peered":"2024-02-17T12:19:03.700021+0000","last_unstale":"2024-02-17T12:19:04.692466+0000","last_undegraded":"2024-02-17T12:19:04.692466+0000","last_fullsized":"2024-02-17T12:19:04.692466+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.696470+0000","last_change":"2024-02-17T12:19:03.696470+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.696470+0000","last_undegraded":"2024-02-17T12:19:03.696470+0000","last_fullsized":"2024-02-17T12:19:03.696470+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.725054+0000","last_change":"2024-02-17T12:19:03.709412+0000","last_active":"2024-02-17T12:19:04.725054+0000","last_peered":"2024-02-17T12:19:04.725054+0000","last_clean":"2024-02-17T12:19:04.725054+0000","last_became_active":"2024-02-17T12:19:03.709021+0000","last_became_peered":"2024-02-17T12:19:03.709021+0000","last_unstale":"2024-02-17T12:19:04.725054+0000","last_undegraded":"2024-02-17T12:19:04.725054+0000","last_fullsized":"2024-02-17T12:19:04.725054+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:44.049163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717759+0000","last_change":"2024-02-17T12:19:04.712404+0000","last_active":"2024-02-17T12:19:04.717759+0000","last_peered":"2024-02-17T12:19:04.717759+0000","last_clean":"2024-02-17T12:19:04.717759+0000","last_became_active":"2024-02-17T12:19:04.711344+0000","last_became_peered":"2024-02-17T12:19:04.711344+0000","last_unstale":"2024-02-17T12:19:04.717759+0000","last_undegraded":"2024-02-17T12:19:04.717759+0000","last_fullsized":"2024-02-17T12:19:04.717759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:33.580841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.713501+0000","last_change":"2024-02-17T12:19:03.706405+0000","last_active":"2024-02-17T12:19:03.713501+0000","last_peered":"2024-02-17T12:19:03.713501+0000","last_clean":"2024-02-17T12:19:03.713501+0000","last_became_active":"2024-02-17T12:19:03.706108+0000","last_became_peered":"2024-02-17T12:19:03.706108+0000","last_unstale":"2024-02-17T12:19:03.713501+0000","last_undegraded":"2024-02-17T12:19:03.713501+0000","last_fullsized":"2024-02-17T12:19:03.713501+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:46:42.443329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.696296+0000","last_change":"2024-02-17T12:19:03.696296+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.696296+0000","last_undegraded":"2024-02-17T12:19:03.696296+0000","last_fullsized":"2024-02-17T12:19:03.696296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.706485+0000","last_change":"2024-02-17T12:19:03.701598+0000","last_active":"2024-02-17T12:19:03.706485+0000","last_peered":"2024-02-17T12:19:03.706485+0000","last_clean":"2024-02-17T12:19:03.706485+0000","last_became_active":"2024-02-17T12:19:03.701326+0000","last_became_peered":"2024-02-17T12:19:03.701326+0000","last_unstale":"2024-02-17T12:19:03.706485+0000","last_undegraded":"2024-02-17T12:19:03.706485+0000","last_fullsized":"2024-02-17T12:19:03.706485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:28:04.886936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.711704+0000","last_change":"2024-02-17T12:19:04.702184+0000","last_active":"2024-02-17T12:19:04.711704+0000","last_peered":"2024-02-17T12:19:04.711704+0000","last_clean":"2024-02-17T12:19:04.711704+0000","last_became_active":"2024-02-17T12:19:04.701908+0000","last_became_peered":"2024-02-17T12:19:04.701908+0000","last_unstale":"2024-02-17T12:19:04.711704+0000","last_undegraded":"2024-02-17T12:19:04.711704+0000","last_fullsized":"2024-02-17T12:19:04.711704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:25:38.680904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.702062+0000","last_change":"2024-02-17T12:19:03.702614+0000","last_active":"2024-02-17T12:19:04.702062+0000","last_peered":"2024-02-17T12:19:04.702062+0000","last_clean":"2024-02-17T12:19:04.702062+0000","last_became_active":"2024-02-17T12:19:03.702360+0000","last_became_peered":"2024-02-17T12:19:03.702360+0000","last_unstale":"2024-02-17T12:19:04.702062+0000","last_undegraded":"2024-02-17T12:19:04.702062+0000","last_fullsized":"2024-02-17T12:19:04.702062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:37.418089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.689927+0000","last_change":"2024-02-17T12:19:03.689927+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.689927+0000","last_undegraded":"2024-02-17T12:19:03.689927+0000","last_fullsized":"2024-02-17T12:19:03.689927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.725424+0000","last_change":"2024-02-17T12:19:03.706098+0000","last_active":"2024-02-17T12:19:04.725424+0000","last_peered":"2024-02-17T12:19:04.725424+0000","last_clean":"2024-02-17T12:19:04.725424+0000","last_became_active":"2024-02-17T12:19:03.705787+0000","last_became_peered":"2024-02-17T12:19:03.705787+0000","last_unstale":"2024-02-17T12:19:04.725424+0000","last_undegraded":"2024-02-17T12:19:04.725424+0000","last_fullsized":"2024-02-17T12:19:04.725424+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:59.839484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699376+0000","last_change":"2024-02-17T12:19:03.699376+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699376+0000","last_undegraded":"2024-02-17T12:19:03.699376+0000","last_fullsized":"2024-02-17T12:19:03.699376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.711323+0000","last_change":"2024-02-17T12:19:03.707121+0000","last_active":"2024-02-17T12:19:04.711323+0000","last_peered":"2024-02-17T12:19:04.711323+0000","last_clean":"2024-02-17T12:19:04.711323+0000","last_became_active":"2024-02-17T12:19:03.706873+0000","last_became_peered":"2024-02-17T12:19:03.706873+0000","last_unstale":"2024-02-17T12:19:04.711323+0000","last_undegraded":"2024-02-17T12:19:04.711323+0000","last_fullsized":"2024-02-17T12:19:04.711323+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:24.015391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.726377+0000","last_change":"2024-02-17T12:19:04.718645+0000","last_active":"2024-02-17T12:19:04.726377+0000","last_peered":"2024-02-17T12:19:04.726377+0000","last_clean":"2024-02-17T12:19:04.726377+0000","last_became_active":"2024-02-17T12:19:04.715738+0000","last_became_peered":"2024-02-17T12:19:04.715738+0000","last_unstale":"2024-02-17T12:19:04.726377+0000","last_undegraded":"2024-02-17T12:19:04.726377+0000","last_fullsized":"2024-02-17T12:19:04.726377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:53.989897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706273+0000","last_change":"2024-02-17T12:19:03.705719+0000","last_active":"2024-02-17T12:19:04.706273+0000","last_peered":"2024-02-17T12:19:04.706273+0000","last_clean":"2024-02-17T12:19:04.706273+0000","last_became_active":"2024-02-17T12:19:03.705394+0000","last_became_peered":"2024-02-17T12:19:03.705394+0000","last_unstale":"2024-02-17T12:19:04.706273+0000","last_undegraded":"2024-02-17T12:19:04.706273+0000","last_fullsized":"2024-02-17T12:19:04.706273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:18.432832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.687985+0000","last_change":"2024-02-17T12:19:03.687985+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.687985+0000","last_undegraded":"2024-02-17T12:19:03.687985+0000","last_fullsized":"2024-02-17T12:19:03.687985+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706298+0000","last_change":"2024-02-17T12:19:03.712607+0000","last_active":"2024-02-17T12:19:04.706298+0000","last_peered":"2024-02-17T12:19:04.706298+0000","last_clean":"2024-02-17T12:19:04.706298+0000","last_became_active":"2024-02-17T12:19:03.712328+0000","last_became_peered":"2024-02-17T12:19:03.712328+0000","last_unstale":"2024-02-17T12:19:04.706298+0000","last_undegraded":"2024-02-17T12:19:04.706298+0000","last_fullsized":"2024-02-17T12:19:04.706298+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.717437+0000","last_change":"2024-02-17T12:19:04.711425+0000","last_active":"2024-02-17T12:19:04.717437+0000","last_peered":"2024-02-17T12:19:04.717437+0000","last_clean":"2024-02-17T12:19:04.717437+0000","last_became_active":"2024-02-17T12:19:04.711149+0000","last_became_peered":"2024-02-17T12:19:04.711149+0000","last_unstale":"2024-02-17T12:19:04.717437+0000","last_undegraded":"2024-02-17T12:19:04.717437+0000","last_fullsized":"2024-02-17T12:19:04.717437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:09.191064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.692502+0000","last_change":"2024-02-17T12:19:03.708773+0000","last_active":"2024-02-17T12:19:04.692502+0000","last_peered":"2024-02-17T12:19:04.692502+0000","last_clean":"2024-02-17T12:19:04.692502+0000","last_became_active":"2024-02-17T12:19:03.707579+0000","last_became_peered":"2024-02-17T12:19:03.707579+0000","last_unstale":"2024-02-17T12:19:04.692502+0000","last_undegraded":"2024-02-17T12:19:04.692502+0000","last_fullsized":"2024-02-17T12:19:04.692502+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.709256+0000","last_change":"2024-02-17T12:19:04.699129+0000","last_active":"2024-02-17T12:19:04.709256+0000","last_peered":"2024-02-17T12:19:04.709256+0000","last_clean":"2024-02-17T12:19:04.709256+0000","last_became_active":"2024-02-17T12:19:04.698800+0000","last_became_peered":"2024-02-17T12:19:04.698800+0000","last_unstale":"2024-02-17T12:19:04.709256+0000","last_undegraded":"2024-02-17T12:19:04.709256+0000","last_fullsized":"2024-02-17T12:19:04.709256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.709959+0000","last_change":"2024-02-17T12:19:03.705779+0000","last_active":"2024-02-17T12:19:03.709959+0000","last_peered":"2024-02-17T12:19:03.709959+0000","last_clean":"2024-02-17T12:19:03.709959+0000","last_became_active":"2024-02-17T12:19:03.705453+0000","last_became_peered":"2024-02-17T12:19:03.705453+0000","last_unstale":"2024-02-17T12:19:03.709959+0000","last_undegraded":"2024-02-17T12:19:03.709959+0000","last_fullsized":"2024-02-17T12:19:03.709959+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:14.221858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-02-17T12:19:03.699370+0000","last_change":"2024-02-17T12:19:03.699370+0000","last_active":"2024-02-17T12:19:03.677439+0000","last_peered":"2024-02-17T12:19:03.677439+0000","last_clean":"2024-02-17T12:19:03.677439+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:03.699370+0000","last_undegraded":"2024-02-17T12:19:03.699370+0000","last_fullsized":"2024-02-17T12:19:03.699370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.706435+0000","last_change":"2024-02-17T12:19:03.710199+0000","last_active":"2024-02-17T12:19:04.706435+0000","last_peered":"2024-02-17T12:19:04.706435+0000","last_clean":"2024-02-17T12:19:04.706435+0000","last_became_active":"2024-02-17T12:19:03.709947+0000","last_became_peered":"2024-02-17T12:19:03.709947+0000","last_unstale":"2024-02-17T12:19:04.706435+0000","last_undegraded":"2024-02-17T12:19:04.706435+0000","last_fullsized":"2024-02-17T12:19:04.706435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.718478+0000","last_change":"2024-02-17T12:19:04.713606+0000","last_active":"2024-02-17T12:19:04.718478+0000","last_peered":"2024-02-17T12:19:04.718478+0000","last_clean":"2024-02-17T12:19:04.718478+0000","last_became_active":"2024-02-17T12:19:04.708088+0000","last_became_peered":"2024-02-17T12:19:04.708088+0000","last_unstale":"2024-02-17T12:19:04.718478+0000","last_undegraded":"2024-02-17T12:19:04.718478+0000","last_fullsized":"2024-02-17T12:19:04.718478+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.704981+0000","last_change":"2024-02-17T12:19:03.701618+0000","last_active":"2024-02-17T12:19:03.704981+0000","last_peered":"2024-02-17T12:19:03.704981+0000","last_clean":"2024-02-17T12:19:03.704981+0000","last_became_active":"2024-02-17T12:19:03.701291+0000","last_became_peered":"2024-02-17T12:19:03.701291+0000","last_unstale":"2024-02-17T12:19:03.704981+0000","last_undegraded":"2024-02-17T12:19:03.704981+0000","last_fullsized":"2024-02-17T12:19:03.704981+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:52.901708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-02-17T12:19:04.723067+0000","last_change":"2024-02-17T12:19:04.719250+0000","last_active":"2024-02-17T12:19:04.723067+0000","last_peered":"2024-02-17T12:19:04.723067+0000","last_clean":"2024-02-17T12:19:04.723067+0000","last_became_active":"2024-02-17T12:19:04.718856+0000","last_became_peered":"2024-02-17T12:19:04.718856+0000","last_unstale":"2024-02-17T12:19:04.723067+0000","last_undegraded":"2024-02-17T12:19:04.723067+0000","last_fullsized":"2024-02-17T12:19:04.723067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:53:35.790267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.720220+0000","last_change":"2024-02-17T12:19:03.712148+0000","last_active":"2024-02-17T12:19:03.720220+0000","last_peered":"2024-02-17T12:19:03.720220+0000","last_clean":"2024-02-17T12:19:03.720220+0000","last_became_active":"2024-02-17T12:19:03.711771+0000","last_became_peered":"2024-02-17T12:19:03.711771+0000","last_unstale":"2024-02-17T12:19:03.720220+0000","last_undegraded":"2024-02-17T12:19:03.720220+0000","last_fullsized":"2024-02-17T12:19:03.720220+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:14.842866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":253,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-02-17T12:19:03.702332+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:19:03.702332+0000","last_peered":"2024-02-17T12:19:03.702332+0000","last_clean":"2024-02-17T12:19:03.702332+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:19:03.702332+0000","last_undegraded":"2024-02-17T12:19:03.702332+0000","last_fullsized":"2024-02-17T12:19:03.702332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88700000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":1.115,"15min":1.115},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88500000000000001,"5min":1.143,"15min":1.143},"last":0.73599999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88700000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.58399999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.85299999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.82099999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":831488,"data_stored":355915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.75},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.72199999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.65000000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.432},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.46100000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.625}]}]},{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.44},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.36299999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.621,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":1.387,"15min":1.387},"last":1.014}]},{"osd":4,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.497,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0409999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.714,"15min":1.714},"last":1.149},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.744,"15min":1.744},"last":1.1339999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91500000000000004,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0980000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.002,"5min":1.575,"15min":1.575},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96899999999999997,"5min":1.321,"15min":1.321},"last":0.73599999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64200000000000002,"5min":1.145,"15min":1.145},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.34000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69499999999999995,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58099999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73799999999999999,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.373}]},{"osd":3,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":2.609,"15min":2.609},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.079,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59199999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.90700000000000003,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.997,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.05,"5min":1.095,"15min":1.095},"last":0.60499999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0469999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0820000000000001,"5min":5.375,"15min":5.375},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":1.0169999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.091,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.629,"15min":1.629},"last":0.56799999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":944683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47899999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45100000000000001,"15min":0.45700000000000002},"min":{"1min":0.312,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":1.046,"15min":1.046},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76900000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.58699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66700000000000004}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0129999999999999,"5min":1.139,"15min":1.139},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92800000000000005,"5min":1.038,"15min":1.038},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94499999999999995,"5min":1.095,"15min":1.095},"last":0.999}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0960000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.008}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":1.042},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90200000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.92200000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28372,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343468,"statfs":{"total":96636764160,"available":96607711232,"internally_reserved":0,"allocated":1384448,"data_stored":931599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84899999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.97399999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75700000000000001,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92400000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90000000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.74299999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86799999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.84399999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95099999999999996,"5min":1.052,"15min":1.052},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.95399999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":347506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86799999999999999,"5min":1.264,"15min":1.264},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.198,"15min":1.198},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.171,"15min":1.171},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93600000000000005,"5min":1.522,"15min":1.522},"last":0.88200000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89900000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88100000000000001,"5min":1.228,"15min":1.228},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.74299999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":790528,"data_stored":341231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.141,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81999999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93300000000000005,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2749999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.997,"5min":1.252,"15min":1.252},"last":0.83399999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91500000000000004,"5min":1.29,"15min":1.29},"last":0.876},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":1.337,"15min":1.337},"last":0.92400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:19:10.669 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-02-17T12:19:10.664+0000 7fecf2600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:19:12.727 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:19:12.731 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:19:13.295 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:19:13.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.436+0000 7f4c6a400640 1 Processor -- start 2024-02-17T12:19:13.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.436+0000 7f4c6a400640 1 -- start start 2024-02-17T12:19:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c6a400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4c640c32f0 0x7f4c640a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c6a400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 0x7f4c6414eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c6a400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c640c1920 con 0x7f4c641522c0 2024-02-17T12:19:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c6a400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c640aaf30 con 0x7f4c640c32f0 2024-02-17T12:19:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c6a400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c640c2b10 con 0x7f4c6414eaa0 2024-02-17T12:19:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c63e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4c641522c0 0x7f4c641557e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42146/0 (socket says 172.21.15.114:42146) 2024-02-17T12:19:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c63e00640 1 -- 172.21.15.114:0/1018833984 learned_addr learned my addr 172.21.15.114:0/1018833984 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c69000640 1 --2- 172.21.15.114:0/1018833984 >> v2:172.21.15.116:3300/0 conn(0x7f4c640c32f0 0x7f4c640a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c69a00640 1 --2- 172.21.15.114:0/1018833984 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 0x7f4c6414eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c63400640 1 -- 172.21.15.114:0/1018833984 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003266500 0 0) 0x7f4c640c1920 con 0x7f4c641522c0 2024-02-17T12:19:13.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c63400640 1 -- 172.21.15.114:0/1018833984 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c48003530 con 0x7f4c641522c0 2024-02-17T12:19:13.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c69a00640 1 -- 172.21.15.114:0/1018833984 >> v2:172.21.15.116:3300/0 conn(0x7f4c640c32f0 msgr2=0x7f4c640a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:13.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c69a00640 1 --2- 172.21.15.114:0/1018833984 >> v2:172.21.15.116:3300/0 conn(0x7f4c640c32f0 0x7f4c640a93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c69a00640 1 -- 172.21.15.114:0/1018833984 >> v1:172.21.15.114:6789/0 conn(0x7f4c641522c0 legacy=0x7f4c641557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:13.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c69a00640 1 -- 172.21.15.114:0/1018833984 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c640a98f0 con 0x7f4c6414eaa0 2024-02-17T12:19:13.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.440+0000 7f4c69000640 1 --2- 172.21.15.114:0/1018833984 >> v2:172.21.15.116:3300/0 conn(0x7f4c640c32f0 0x7f4c640a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:13.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c69a00640 1 --2- 172.21.15.114:0/1018833984 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 0x7f4c6414eef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009d90 tx=0x7f4c5c01c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3ab7f11719c192b server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:13.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c63400640 1 -- 172.21.15.114:0/1018833984 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0a5800 con 0x7f4c6414eaa0 2024-02-17T12:19:13.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c63400640 1 -- 172.21.15.114:0/1018833984 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c0a5960 con 0x7f4c6414eaa0 2024-02-17T12:19:13.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c63400640 1 -- 172.21.15.114:0/1018833984 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0a5cf0 con 0x7f4c6414eaa0 2024-02-17T12:19:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c6a400640 1 -- 172.21.15.114:0/1018833984 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 msgr2=0x7f4c6414eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c6a400640 1 --2- 172.21.15.114:0/1018833984 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 0x7f4c6414eef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009d90 tx=0x7f4c5c01c850 comp rx=0 tx=0).stop 2024-02-17T12:19:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c6a400640 1 -- 172.21.15.114:0/1018833984 shutdown_connections 2024-02-17T12:19:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c6a400640 1 --2- 172.21.15.114:0/1018833984 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 0x7f4c6414eef0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c6a400640 1 --2- 172.21.15.114:0/1018833984 >> v2:172.21.15.116:3300/0 conn(0x7f4c640c32f0 0x7f4c640a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c6a400640 1 -- 172.21.15.114:0/1018833984 >> 172.21.15.114:0/1018833984 conn(0x7f4c640a8660 msgr2=0x7f4c640a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c6a400640 1 -- 172.21.15.114:0/1018833984 shutdown_connections 2024-02-17T12:19:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c6a400640 1 -- 172.21.15.114:0/1018833984 wait complete. 2024-02-17T12:19:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c6a400640 1 Processor -- start 2024-02-17T12:19:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.444+0000 7f4c6a400640 1 -- start start 2024-02-17T12:19:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c6a400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c640c32f0 0x7f4c641f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c6a400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 0x7f4c6415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c6a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c641522c0 0x7f4c64142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c6a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c641f1560 con 0x7f4c641522c0 2024-02-17T12:19:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c6a400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c64154110 con 0x7f4c640c32f0 2024-02-17T12:19:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c6a400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c641543f0 con 0x7f4c6414eaa0 2024-02-17T12:19:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c69a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c641522c0 0x7f4c64142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c69a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c641522c0 0x7f4c64142a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40812/0 (socket says 172.21.15.114:40812) 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c69a00640 1 -- 172.21.15.114:0/498986478 learned_addr learned my addr 172.21.15.114:0/498986478 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c63e00640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 0x7f4c6415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c69000640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c640c32f0 0x7f4c641f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c69a00640 1 -- 172.21.15.114:0/498986478 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 msgr2=0x7f4c6415a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c69a00640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 0x7f4c6415a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c69a00640 1 -- 172.21.15.114:0/498986478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c640c32f0 msgr2=0x7f4c641f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c69a00640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c640c32f0 0x7f4c641f1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c69a00640 1 -- 172.21.15.114:0/498986478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54009420 con 0x7f4c641522c0 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c69a00640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c641522c0 0x7f4c64142a90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c01af00 tx=0x7f4c5c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c60c00640 1 -- 172.21.15.114:0/498986478 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0b9650 con 0x7f4c641522c0 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c60c00640 1 -- 172.21.15.114:0/498986478 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c0b97b0 con 0x7f4c641522c0 2024-02-17T12:19:13.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c60c00640 1 -- 172.21.15.114:0/498986478 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0b9b20 con 0x7f4c641522c0 2024-02-17T12:19:13.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c6a400640 1 -- 172.21.15.114:0/498986478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c009a70 con 0x7f4c641522c0 2024-02-17T12:19:13.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c6a400640 1 -- 172.21.15.114:0/498986478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6414c5d0 con 0x7f4c641522c0 2024-02-17T12:19:13.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c6a400640 1 -- 172.21.15.114:0/498986478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6414c7c0 con 0x7f4c641522c0 2024-02-17T12:19:13.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.448+0000 7f4c60c00640 1 -- 172.21.15.114:0/498986478 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4c5c0b9c80 con 0x7f4c641522c0 2024-02-17T12:19:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.452+0000 7f4c60c00640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4c44066e40 0x7f4c44069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.452+0000 7f4c60c00640 1 -- 172.21.15.114:0/498986478 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c5c11fda0 con 0x7f4c641522c0 2024-02-17T12:19:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.452+0000 7f4c69000640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4c44066e40 0x7f4c44069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.452+0000 7f4c69000640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4c44066e40 0x7f4c44069300 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009c80 tx=0x7f4c54008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.456+0000 7f4c60c00640 1 -- 172.21.15.114:0/498986478 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4c5c0ecaf0 con 0x7f4c641522c0 2024-02-17T12:19:13.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.604+0000 7f4c6a400640 1 -- 172.21.15.114:0/498986478 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c64072f20 con 0x7f4c44066e40 2024-02-17T12:19:13.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.612+0000 7f4c60c00640 1 -- 172.21.15.114:0/498986478 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289503 (secure 0 0 0) 0x7f4c64072f20 con 0x7f4c44066e40 2024-02-17T12:19:13.619 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:13.621 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:19:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 -- 172.21.15.114:0/498986478 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4c44066e40 msgr2=0x7f4c44069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4c44066e40 0x7f4c44069300 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009c80 tx=0x7f4c54008040 comp rx=0 tx=0).stop 2024-02-17T12:19:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 -- 172.21.15.114:0/498986478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c641522c0 msgr2=0x7f4c64142a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c641522c0 0x7f4c64142a90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c01af00 tx=0x7f4c5c0195f0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 -- 172.21.15.114:0/498986478 shutdown_connections 2024-02-17T12:19:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4c44066e40 0x7f4c44069300 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c641522c0 0x7f4c64142a90 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c6414eaa0 0x7f4c6415a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 --2- 172.21.15.114:0/498986478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c640c32f0 0x7f4c641f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 -- 172.21.15.114:0/498986478 >> 172.21.15.114:0/498986478 conn(0x7f4c640a8660 msgr2=0x7f4c64151a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:13.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 -- 172.21.15.114:0/498986478 shutdown_connections 2024-02-17T12:19:13.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.616+0000 7f4c6a400640 1 -- 172.21.15.114:0/498986478 wait complete. 2024-02-17T12:19:13.639 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-02-17T12:19:13.252326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240504,"kb_used_data":7688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734216,"statfs":{"total":773094113280,"available":772847837184,"internally_reserved":0,"allocated":7872512,"data_stored":4070204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.564875"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210592+0000","last_change":"2024-02-17T12:19:04.712400+0000","last_active":"2024-02-17T12:19:06.210592+0000","last_peered":"2024-02-17T12:19:06.210592+0000","last_clean":"2024-02-17T12:19:06.210592+0000","last_became_active":"2024-02-17T12:19:04.711598+0000","last_became_peered":"2024-02-17T12:19:04.711598+0000","last_unstale":"2024-02-17T12:19:06.210592+0000","last_undegraded":"2024-02-17T12:19:06.210592+0000","last_fullsized":"2024-02-17T12:19:06.210592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:02.628891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708335+0000","last_change":"2024-02-17T12:19:04.723008+0000","last_active":"2024-02-17T12:19:05.708335+0000","last_peered":"2024-02-17T12:19:05.708335+0000","last_clean":"2024-02-17T12:19:05.708335+0000","last_became_active":"2024-02-17T12:19:04.722730+0000","last_became_peered":"2024-02-17T12:19:04.722730+0000","last_unstale":"2024-02-17T12:19:05.708335+0000","last_undegraded":"2024-02-17T12:19:05.708335+0000","last_fullsized":"2024-02-17T12:19:05.708335+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:43.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520255+0000","last_change":"2024-02-17T12:19:04.710193+0000","last_active":"2024-02-17T12:19:06.520255+0000","last_peered":"2024-02-17T12:19:06.520255+0000","last_clean":"2024-02-17T12:19:06.520255+0000","last_became_active":"2024-02-17T12:19:04.709527+0000","last_became_peered":"2024-02-17T12:19:04.709527+0000","last_unstale":"2024-02-17T12:19:06.520255+0000","last_undegraded":"2024-02-17T12:19:06.520255+0000","last_fullsized":"2024-02-17T12:19:06.520255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:10:56.143323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519984+0000","last_change":"2024-02-17T12:19:04.728530+0000","last_active":"2024-02-17T12:19:06.519984+0000","last_peered":"2024-02-17T12:19:06.519984+0000","last_clean":"2024-02-17T12:19:06.519984+0000","last_became_active":"2024-02-17T12:19:04.728245+0000","last_became_peered":"2024-02-17T12:19:04.728245+0000","last_unstale":"2024-02-17T12:19:06.519984+0000","last_undegraded":"2024-02-17T12:19:06.519984+0000","last_fullsized":"2024-02-17T12:19:06.519984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:22.116393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711493+0000","last_change":"2024-02-17T12:19:04.727165+0000","last_active":"2024-02-17T12:19:05.711493+0000","last_peered":"2024-02-17T12:19:05.711493+0000","last_clean":"2024-02-17T12:19:05.711493+0000","last_became_active":"2024-02-17T12:19:04.726850+0000","last_became_peered":"2024-02-17T12:19:04.726850+0000","last_unstale":"2024-02-17T12:19:05.711493+0000","last_undegraded":"2024-02-17T12:19:05.711493+0000","last_fullsized":"2024-02-17T12:19:05.711493+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:54.875823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711199+0000","last_change":"2024-02-17T12:19:04.713676+0000","last_active":"2024-02-17T12:19:05.711199+0000","last_peered":"2024-02-17T12:19:05.711199+0000","last_clean":"2024-02-17T12:19:05.711199+0000","last_became_active":"2024-02-17T12:19:04.710032+0000","last_became_peered":"2024-02-17T12:19:04.710032+0000","last_unstale":"2024-02-17T12:19:05.711199+0000","last_undegraded":"2024-02-17T12:19:05.711199+0000","last_fullsized":"2024-02-17T12:19:05.711199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519826+0000","last_change":"2024-02-17T12:19:04.714280+0000","last_active":"2024-02-17T12:19:06.519826+0000","last_peered":"2024-02-17T12:19:06.519826+0000","last_clean":"2024-02-17T12:19:06.519826+0000","last_became_active":"2024-02-17T12:19:04.714025+0000","last_became_peered":"2024-02-17T12:19:04.714025+0000","last_unstale":"2024-02-17T12:19:06.519826+0000","last_undegraded":"2024-02-17T12:19:06.519826+0000","last_fullsized":"2024-02-17T12:19:06.519826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:04:31.444208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711186+0000","last_change":"2024-02-17T12:19:04.716344+0000","last_active":"2024-02-17T12:19:05.711186+0000","last_peered":"2024-02-17T12:19:05.711186+0000","last_clean":"2024-02-17T12:19:05.711186+0000","last_became_active":"2024-02-17T12:19:04.716003+0000","last_became_peered":"2024-02-17T12:19:04.716003+0000","last_unstale":"2024-02-17T12:19:05.711186+0000","last_undegraded":"2024-02-17T12:19:05.711186+0000","last_fullsized":"2024-02-17T12:19:05.711186+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:37.092834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.712377+0000","last_change":"2024-02-17T12:19:04.705511+0000","last_active":"2024-02-17T12:19:05.712377+0000","last_peered":"2024-02-17T12:19:05.712377+0000","last_clean":"2024-02-17T12:19:05.712377+0000","last_became_active":"2024-02-17T12:19:04.705195+0000","last_became_peered":"2024-02-17T12:19:04.705195+0000","last_unstale":"2024-02-17T12:19:05.712377+0000","last_undegraded":"2024-02-17T12:19:05.712377+0000","last_fullsized":"2024-02-17T12:19:05.712377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210616+0000","last_change":"2024-02-17T12:19:04.721693+0000","last_active":"2024-02-17T12:19:06.210616+0000","last_peered":"2024-02-17T12:19:06.210616+0000","last_clean":"2024-02-17T12:19:06.210616+0000","last_became_active":"2024-02-17T12:19:04.721343+0000","last_became_peered":"2024-02-17T12:19:04.721343+0000","last_unstale":"2024-02-17T12:19:06.210616+0000","last_undegraded":"2024-02-17T12:19:06.210616+0000","last_fullsized":"2024-02-17T12:19:06.210616+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:38.425090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708086+0000","last_change":"2024-02-17T12:19:04.717487+0000","last_active":"2024-02-17T12:19:05.708086+0000","last_peered":"2024-02-17T12:19:05.708086+0000","last_clean":"2024-02-17T12:19:05.708086+0000","last_became_active":"2024-02-17T12:19:04.717208+0000","last_became_peered":"2024-02-17T12:19:04.717208+0000","last_unstale":"2024-02-17T12:19:05.708086+0000","last_undegraded":"2024-02-17T12:19:05.708086+0000","last_fullsized":"2024-02-17T12:19:05.708086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:36:18.116201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210251+0000","last_change":"2024-02-17T12:19:04.720687+0000","last_active":"2024-02-17T12:19:06.210251+0000","last_peered":"2024-02-17T12:19:06.210251+0000","last_clean":"2024-02-17T12:19:06.210251+0000","last_became_active":"2024-02-17T12:19:04.720429+0000","last_became_peered":"2024-02-17T12:19:04.720429+0000","last_unstale":"2024-02-17T12:19:06.210251+0000","last_undegraded":"2024-02-17T12:19:06.210251+0000","last_fullsized":"2024-02-17T12:19:06.210251+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:13:30.982744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519865+0000","last_change":"2024-02-17T12:19:04.711936+0000","last_active":"2024-02-17T12:19:06.519865+0000","last_peered":"2024-02-17T12:19:06.519865+0000","last_clean":"2024-02-17T12:19:06.519865+0000","last_became_active":"2024-02-17T12:19:04.711624+0000","last_became_peered":"2024-02-17T12:19:04.711624+0000","last_unstale":"2024-02-17T12:19:06.519865+0000","last_undegraded":"2024-02-17T12:19:06.519865+0000","last_fullsized":"2024-02-17T12:19:06.519865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:55.448178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520030+0000","last_change":"2024-02-17T12:19:04.728727+0000","last_active":"2024-02-17T12:19:06.520030+0000","last_peered":"2024-02-17T12:19:06.520030+0000","last_clean":"2024-02-17T12:19:06.520030+0000","last_became_active":"2024-02-17T12:19:04.728194+0000","last_became_peered":"2024-02-17T12:19:04.728194+0000","last_unstale":"2024-02-17T12:19:06.520030+0000","last_undegraded":"2024-02-17T12:19:06.520030+0000","last_fullsized":"2024-02-17T12:19:06.520030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:07:54.785092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519632+0000","last_change":"2024-02-17T12:19:04.710789+0000","last_active":"2024-02-17T12:19:06.519632+0000","last_peered":"2024-02-17T12:19:06.519632+0000","last_clean":"2024-02-17T12:19:06.519632+0000","last_became_active":"2024-02-17T12:19:04.710321+0000","last_became_peered":"2024-02-17T12:19:04.710321+0000","last_unstale":"2024-02-17T12:19:06.519632+0000","last_undegraded":"2024-02-17T12:19:06.519632+0000","last_fullsized":"2024-02-17T12:19:06.519632+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:20.439350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.710986+0000","last_change":"2024-02-17T12:19:04.714567+0000","last_active":"2024-02-17T12:19:05.710986+0000","last_peered":"2024-02-17T12:19:05.710986+0000","last_clean":"2024-02-17T12:19:05.710986+0000","last_became_active":"2024-02-17T12:19:04.714283+0000","last_became_peered":"2024-02-17T12:19:04.714283+0000","last_unstale":"2024-02-17T12:19:05.710986+0000","last_undegraded":"2024-02-17T12:19:05.710986+0000","last_fullsized":"2024-02-17T12:19:05.710986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:36.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.712259+0000","last_change":"2024-02-17T12:19:04.707760+0000","last_active":"2024-02-17T12:19:05.712259+0000","last_peered":"2024-02-17T12:19:05.712259+0000","last_clean":"2024-02-17T12:19:05.712259+0000","last_became_active":"2024-02-17T12:19:04.707499+0000","last_became_peered":"2024-02-17T12:19:04.707499+0000","last_unstale":"2024-02-17T12:19:05.712259+0000","last_undegraded":"2024-02-17T12:19:05.712259+0000","last_fullsized":"2024-02-17T12:19:05.712259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:24:01.313056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520174+0000","last_change":"2024-02-17T12:19:04.710944+0000","last_active":"2024-02-17T12:19:06.520174+0000","last_peered":"2024-02-17T12:19:06.520174+0000","last_clean":"2024-02-17T12:19:06.520174+0000","last_became_active":"2024-02-17T12:19:04.710625+0000","last_became_peered":"2024-02-17T12:19:04.710625+0000","last_unstale":"2024-02-17T12:19:06.520174+0000","last_undegraded":"2024-02-17T12:19:06.520174+0000","last_fullsized":"2024-02-17T12:19:06.520174+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:22:57.157645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520976+0000","last_change":"2024-02-17T12:19:04.718758+0000","last_active":"2024-02-17T12:19:06.520976+0000","last_peered":"2024-02-17T12:19:06.520976+0000","last_clean":"2024-02-17T12:19:06.520976+0000","last_became_active":"2024-02-17T12:19:04.718486+0000","last_became_peered":"2024-02-17T12:19:04.718486+0000","last_unstale":"2024-02-17T12:19:06.520976+0000","last_undegraded":"2024-02-17T12:19:06.520976+0000","last_fullsized":"2024-02-17T12:19:06.520976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.895909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520022+0000","last_change":"2024-02-17T12:19:04.714461+0000","last_active":"2024-02-17T12:19:06.520022+0000","last_peered":"2024-02-17T12:19:06.520022+0000","last_clean":"2024-02-17T12:19:06.520022+0000","last_became_active":"2024-02-17T12:19:04.714208+0000","last_became_peered":"2024-02-17T12:19:04.714208+0000","last_unstale":"2024-02-17T12:19:06.520022+0000","last_undegraded":"2024-02-17T12:19:06.520022+0000","last_fullsized":"2024-02-17T12:19:06.520022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:45.424685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519728+0000","last_change":"2024-02-17T12:19:04.722346+0000","last_active":"2024-02-17T12:19:06.519728+0000","last_peered":"2024-02-17T12:19:06.519728+0000","last_clean":"2024-02-17T12:19:06.519728+0000","last_became_active":"2024-02-17T12:19:04.722106+0000","last_became_peered":"2024-02-17T12:19:04.722106+0000","last_unstale":"2024-02-17T12:19:06.519728+0000","last_undegraded":"2024-02-17T12:19:06.519728+0000","last_fullsized":"2024-02-17T12:19:06.519728+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:11.976571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707927+0000","last_change":"2024-02-17T12:19:04.720604+0000","last_active":"2024-02-17T12:19:05.707927+0000","last_peered":"2024-02-17T12:19:05.707927+0000","last_clean":"2024-02-17T12:19:05.707927+0000","last_became_active":"2024-02-17T12:19:04.720350+0000","last_became_peered":"2024-02-17T12:19:04.720350+0000","last_unstale":"2024-02-17T12:19:05.707927+0000","last_undegraded":"2024-02-17T12:19:05.707927+0000","last_fullsized":"2024-02-17T12:19:05.707927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:21.365282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210224+0000","last_change":"2024-02-17T12:19:04.716818+0000","last_active":"2024-02-17T12:19:06.210224+0000","last_peered":"2024-02-17T12:19:06.210224+0000","last_clean":"2024-02-17T12:19:06.210224+0000","last_became_active":"2024-02-17T12:19:04.716507+0000","last_became_peered":"2024-02-17T12:19:04.716507+0000","last_unstale":"2024-02-17T12:19:06.210224+0000","last_undegraded":"2024-02-17T12:19:06.210224+0000","last_fullsized":"2024-02-17T12:19:06.210224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:56:16.543982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519533+0000","last_change":"2024-02-17T12:19:04.708458+0000","last_active":"2024-02-17T12:19:06.519533+0000","last_peered":"2024-02-17T12:19:06.519533+0000","last_clean":"2024-02-17T12:19:06.519533+0000","last_became_active":"2024-02-17T12:19:04.708170+0000","last_became_peered":"2024-02-17T12:19:04.708170+0000","last_unstale":"2024-02-17T12:19:06.519533+0000","last_undegraded":"2024-02-17T12:19:06.519533+0000","last_fullsized":"2024-02-17T12:19:06.519533+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:57.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707967+0000","last_change":"2024-02-17T12:19:04.726126+0000","last_active":"2024-02-17T12:19:05.707967+0000","last_peered":"2024-02-17T12:19:05.707967+0000","last_clean":"2024-02-17T12:19:05.707967+0000","last_became_active":"2024-02-17T12:19:04.725344+0000","last_became_peered":"2024-02-17T12:19:04.725344+0000","last_unstale":"2024-02-17T12:19:05.707967+0000","last_undegraded":"2024-02-17T12:19:05.707967+0000","last_fullsized":"2024-02-17T12:19:05.707967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:08:29.699648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520231+0000","last_change":"2024-02-17T12:19:04.725988+0000","last_active":"2024-02-17T12:19:06.520231+0000","last_peered":"2024-02-17T12:19:06.520231+0000","last_clean":"2024-02-17T12:19:06.520231+0000","last_became_active":"2024-02-17T12:19:04.725703+0000","last_became_peered":"2024-02-17T12:19:04.725703+0000","last_unstale":"2024-02-17T12:19:06.520231+0000","last_undegraded":"2024-02-17T12:19:06.520231+0000","last_fullsized":"2024-02-17T12:19:06.520231+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:26.113554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711478+0000","last_change":"2024-02-17T12:19:04.718744+0000","last_active":"2024-02-17T12:19:05.711478+0000","last_peered":"2024-02-17T12:19:05.711478+0000","last_clean":"2024-02-17T12:19:05.711478+0000","last_became_active":"2024-02-17T12:19:04.717669+0000","last_became_peered":"2024-02-17T12:19:04.717669+0000","last_unstale":"2024-02-17T12:19:05.711478+0000","last_undegraded":"2024-02-17T12:19:05.711478+0000","last_fullsized":"2024-02-17T12:19:05.711478+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:15.849867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210342+0000","last_change":"2024-02-17T12:19:04.713023+0000","last_active":"2024-02-17T12:19:06.210342+0000","last_peered":"2024-02-17T12:19:06.210342+0000","last_clean":"2024-02-17T12:19:06.210342+0000","last_became_active":"2024-02-17T12:19:04.712535+0000","last_became_peered":"2024-02-17T12:19:04.712535+0000","last_unstale":"2024-02-17T12:19:06.210342+0000","last_undegraded":"2024-02-17T12:19:06.210342+0000","last_fullsized":"2024-02-17T12:19:06.210342+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:59.570840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707750+0000","last_change":"2024-02-17T12:19:04.721331+0000","last_active":"2024-02-17T12:19:05.707750+0000","last_peered":"2024-02-17T12:19:05.707750+0000","last_clean":"2024-02-17T12:19:05.707750+0000","last_became_active":"2024-02-17T12:19:04.721066+0000","last_became_peered":"2024-02-17T12:19:04.721066+0000","last_unstale":"2024-02-17T12:19:05.707750+0000","last_undegraded":"2024-02-17T12:19:05.707750+0000","last_fullsized":"2024-02-17T12:19:05.707750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:49:57.305678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708042+0000","last_change":"2024-02-17T12:19:04.726119+0000","last_active":"2024-02-17T12:19:05.708042+0000","last_peered":"2024-02-17T12:19:05.708042+0000","last_clean":"2024-02-17T12:19:05.708042+0000","last_became_active":"2024-02-17T12:19:04.725509+0000","last_became_peered":"2024-02-17T12:19:04.725509+0000","last_unstale":"2024-02-17T12:19:05.708042+0000","last_undegraded":"2024-02-17T12:19:05.708042+0000","last_fullsized":"2024-02-17T12:19:05.708042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:56.501011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711161+0000","last_change":"2024-02-17T12:19:04.706739+0000","last_active":"2024-02-17T12:19:05.711161+0000","last_peered":"2024-02-17T12:19:05.711161+0000","last_clean":"2024-02-17T12:19:05.711161+0000","last_became_active":"2024-02-17T12:19:04.706454+0000","last_became_peered":"2024-02-17T12:19:04.706454+0000","last_unstale":"2024-02-17T12:19:05.711161+0000","last_undegraded":"2024-02-17T12:19:05.711161+0000","last_fullsized":"2024-02-17T12:19:05.711161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:14.863236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210145+0000","last_change":"2024-02-17T12:19:04.729805+0000","last_active":"2024-02-17T12:19:06.210145+0000","last_peered":"2024-02-17T12:19:06.210145+0000","last_clean":"2024-02-17T12:19:06.210145+0000","last_became_active":"2024-02-17T12:19:04.729388+0000","last_became_peered":"2024-02-17T12:19:04.729388+0000","last_unstale":"2024-02-17T12:19:06.210145+0000","last_undegraded":"2024-02-17T12:19:06.210145+0000","last_fullsized":"2024-02-17T12:19:06.210145+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:09:06.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711832+0000","last_change":"2024-02-17T12:19:04.710643+0000","last_active":"2024-02-17T12:19:05.711832+0000","last_peered":"2024-02-17T12:19:05.711832+0000","last_clean":"2024-02-17T12:19:05.711832+0000","last_became_active":"2024-02-17T12:19:04.709363+0000","last_became_peered":"2024-02-17T12:19:04.709363+0000","last_unstale":"2024-02-17T12:19:05.711832+0000","last_undegraded":"2024-02-17T12:19:05.711832+0000","last_fullsized":"2024-02-17T12:19:05.711832+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:14.810042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210786+0000","last_change":"2024-02-17T12:19:03.709066+0000","last_active":"2024-02-17T12:19:06.210786+0000","last_peered":"2024-02-17T12:19:06.210786+0000","last_clean":"2024-02-17T12:19:06.210786+0000","last_became_active":"2024-02-17T12:19:03.708888+0000","last_became_peered":"2024-02-17T12:19:03.708888+0000","last_unstale":"2024-02-17T12:19:06.210786+0000","last_undegraded":"2024-02-17T12:19:06.210786+0000","last_fullsized":"2024-02-17T12:19:06.210786+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210661+0000","last_change":"2024-02-17T12:19:04.718756+0000","last_active":"2024-02-17T12:19:06.210661+0000","last_peered":"2024-02-17T12:19:06.210661+0000","last_clean":"2024-02-17T12:19:06.210661+0000","last_became_active":"2024-02-17T12:19:04.716924+0000","last_became_peered":"2024-02-17T12:19:04.716924+0000","last_unstale":"2024-02-17T12:19:06.210661+0000","last_undegraded":"2024-02-17T12:19:06.210661+0000","last_fullsized":"2024-02-17T12:19:06.210661+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:11.015091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711975+0000","last_change":"2024-02-17T12:19:03.703800+0000","last_active":"2024-02-17T12:19:05.711975+0000","last_peered":"2024-02-17T12:19:05.711975+0000","last_clean":"2024-02-17T12:19:05.711975+0000","last_became_active":"2024-02-17T12:19:03.703402+0000","last_became_peered":"2024-02-17T12:19:03.703402+0000","last_unstale":"2024-02-17T12:19:05.711975+0000","last_undegraded":"2024-02-17T12:19:05.711975+0000","last_fullsized":"2024-02-17T12:19:05.711975+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:37:23.098316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210719+0000","last_change":"2024-02-17T12:19:04.730207+0000","last_active":"2024-02-17T12:19:06.210719+0000","last_peered":"2024-02-17T12:19:06.210719+0000","last_clean":"2024-02-17T12:19:06.210719+0000","last_became_active":"2024-02-17T12:19:04.729363+0000","last_became_peered":"2024-02-17T12:19:04.729363+0000","last_unstale":"2024-02-17T12:19:06.210719+0000","last_undegraded":"2024-02-17T12:19:06.210719+0000","last_fullsized":"2024-02-17T12:19:06.210719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:32:13.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521058+0000","last_change":"2024-02-17T12:19:03.704331+0000","last_active":"2024-02-17T12:19:06.521058+0000","last_peered":"2024-02-17T12:19:06.521058+0000","last_clean":"2024-02-17T12:19:06.521058+0000","last_became_active":"2024-02-17T12:19:03.704078+0000","last_became_peered":"2024-02-17T12:19:03.704078+0000","last_unstale":"2024-02-17T12:19:06.521058+0000","last_undegraded":"2024-02-17T12:19:06.521058+0000","last_fullsized":"2024-02-17T12:19:06.521058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520244+0000","last_change":"2024-02-17T12:19:04.710438+0000","last_active":"2024-02-17T12:19:06.520244+0000","last_peered":"2024-02-17T12:19:06.520244+0000","last_clean":"2024-02-17T12:19:06.520244+0000","last_became_active":"2024-02-17T12:19:04.709894+0000","last_became_peered":"2024-02-17T12:19:04.709894+0000","last_unstale":"2024-02-17T12:19:06.520244+0000","last_undegraded":"2024-02-17T12:19:06.520244+0000","last_fullsized":"2024-02-17T12:19:06.520244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:44.905808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521160+0000","last_change":"2024-02-17T12:19:03.702411+0000","last_active":"2024-02-17T12:19:06.521160+0000","last_peered":"2024-02-17T12:19:06.521160+0000","last_clean":"2024-02-17T12:19:06.521160+0000","last_became_active":"2024-02-17T12:19:03.702166+0000","last_became_peered":"2024-02-17T12:19:03.702166+0000","last_unstale":"2024-02-17T12:19:06.521160+0000","last_undegraded":"2024-02-17T12:19:06.521160+0000","last_fullsized":"2024-02-17T12:19:06.521160+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708166+0000","last_change":"2024-02-17T12:19:04.726343+0000","last_active":"2024-02-17T12:19:05.708166+0000","last_peered":"2024-02-17T12:19:05.708166+0000","last_clean":"2024-02-17T12:19:05.708166+0000","last_became_active":"2024-02-17T12:19:04.725870+0000","last_became_peered":"2024-02-17T12:19:04.725870+0000","last_unstale":"2024-02-17T12:19:05.708166+0000","last_undegraded":"2024-02-17T12:19:05.708166+0000","last_fullsized":"2024-02-17T12:19:05.708166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:27:42.531689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711680+0000","last_change":"2024-02-17T12:19:03.703159+0000","last_active":"2024-02-17T12:19:05.711680+0000","last_peered":"2024-02-17T12:19:05.711680+0000","last_clean":"2024-02-17T12:19:05.711680+0000","last_became_active":"2024-02-17T12:19:03.702811+0000","last_became_peered":"2024-02-17T12:19:03.702811+0000","last_unstale":"2024-02-17T12:19:05.711680+0000","last_undegraded":"2024-02-17T12:19:05.711680+0000","last_fullsized":"2024-02-17T12:19:05.711680+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:16.831548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711557+0000","last_change":"2024-02-17T12:19:04.708618+0000","last_active":"2024-02-17T12:19:05.711557+0000","last_peered":"2024-02-17T12:19:05.711557+0000","last_clean":"2024-02-17T12:19:05.711557+0000","last_became_active":"2024-02-17T12:19:04.708351+0000","last_became_peered":"2024-02-17T12:19:04.708351+0000","last_unstale":"2024-02-17T12:19:05.711557+0000","last_undegraded":"2024-02-17T12:19:05.711557+0000","last_fullsized":"2024-02-17T12:19:05.711557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:09.330073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711218+0000","last_change":"2024-02-17T12:19:03.706093+0000","last_active":"2024-02-17T12:19:05.711218+0000","last_peered":"2024-02-17T12:19:05.711218+0000","last_clean":"2024-02-17T12:19:05.711218+0000","last_became_active":"2024-02-17T12:19:03.705445+0000","last_became_peered":"2024-02-17T12:19:03.705445+0000","last_unstale":"2024-02-17T12:19:05.711218+0000","last_undegraded":"2024-02-17T12:19:05.711218+0000","last_fullsized":"2024-02-17T12:19:05.711218+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:29.842261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519766+0000","last_change":"2024-02-17T12:19:04.714305+0000","last_active":"2024-02-17T12:19:06.519766+0000","last_peered":"2024-02-17T12:19:06.519766+0000","last_clean":"2024-02-17T12:19:06.519766+0000","last_became_active":"2024-02-17T12:19:04.714041+0000","last_became_peered":"2024-02-17T12:19:04.714041+0000","last_unstale":"2024-02-17T12:19:06.519766+0000","last_undegraded":"2024-02-17T12:19:06.519766+0000","last_fullsized":"2024-02-17T12:19:06.519766+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:12.864476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520892+0000","last_change":"2024-02-17T12:19:03.701055+0000","last_active":"2024-02-17T12:19:06.520892+0000","last_peered":"2024-02-17T12:19:06.520892+0000","last_clean":"2024-02-17T12:19:06.520892+0000","last_became_active":"2024-02-17T12:19:03.695988+0000","last_became_peered":"2024-02-17T12:19:03.695988+0000","last_unstale":"2024-02-17T12:19:06.520892+0000","last_undegraded":"2024-02-17T12:19:06.520892+0000","last_fullsized":"2024-02-17T12:19:06.520892+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519713+0000","last_change":"2024-02-17T12:19:04.710559+0000","last_active":"2024-02-17T12:19:06.519713+0000","last_peered":"2024-02-17T12:19:06.519713+0000","last_clean":"2024-02-17T12:19:06.519713+0000","last_became_active":"2024-02-17T12:19:04.709979+0000","last_became_peered":"2024-02-17T12:19:04.709979+0000","last_unstale":"2024-02-17T12:19:06.519713+0000","last_undegraded":"2024-02-17T12:19:06.519713+0000","last_fullsized":"2024-02-17T12:19:06.519713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:33:12.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707814+0000","last_change":"2024-02-17T12:19:03.702309+0000","last_active":"2024-02-17T12:19:05.707814+0000","last_peered":"2024-02-17T12:19:05.707814+0000","last_clean":"2024-02-17T12:19:05.707814+0000","last_became_active":"2024-02-17T12:19:03.702051+0000","last_became_peered":"2024-02-17T12:19:03.702051+0000","last_unstale":"2024-02-17T12:19:05.707814+0000","last_undegraded":"2024-02-17T12:19:05.707814+0000","last_fullsized":"2024-02-17T12:19:05.707814+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:58.978525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520096+0000","last_change":"2024-02-17T12:19:04.726001+0000","last_active":"2024-02-17T12:19:06.520096+0000","last_peered":"2024-02-17T12:19:06.520096+0000","last_clean":"2024-02-17T12:19:06.520096+0000","last_became_active":"2024-02-17T12:19:04.725747+0000","last_became_peered":"2024-02-17T12:19:04.725747+0000","last_unstale":"2024-02-17T12:19:06.520096+0000","last_undegraded":"2024-02-17T12:19:06.520096+0000","last_fullsized":"2024-02-17T12:19:06.520096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:18:38.213214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210926+0000","last_change":"2024-02-17T12:19:03.712851+0000","last_active":"2024-02-17T12:19:06.210926+0000","last_peered":"2024-02-17T12:19:06.210926+0000","last_clean":"2024-02-17T12:19:06.210926+0000","last_became_active":"2024-02-17T12:19:03.712584+0000","last_became_peered":"2024-02-17T12:19:03.712584+0000","last_unstale":"2024-02-17T12:19:06.210926+0000","last_undegraded":"2024-02-17T12:19:06.210926+0000","last_fullsized":"2024-02-17T12:19:06.210926+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.712467+0000","last_change":"2024-02-17T12:19:04.709578+0000","last_active":"2024-02-17T12:19:05.712467+0000","last_peered":"2024-02-17T12:19:05.712467+0000","last_clean":"2024-02-17T12:19:05.712467+0000","last_became_active":"2024-02-17T12:19:04.709173+0000","last_became_peered":"2024-02-17T12:19:04.709173+0000","last_unstale":"2024-02-17T12:19:05.712467+0000","last_undegraded":"2024-02-17T12:19:05.712467+0000","last_fullsized":"2024-02-17T12:19:05.712467+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210669+0000","last_change":"2024-02-17T12:19:03.707721+0000","last_active":"2024-02-17T12:19:06.210669+0000","last_peered":"2024-02-17T12:19:06.210669+0000","last_clean":"2024-02-17T12:19:06.210669+0000","last_became_active":"2024-02-17T12:19:03.707435+0000","last_became_peered":"2024-02-17T12:19:03.707435+0000","last_unstale":"2024-02-17T12:19:06.210669+0000","last_undegraded":"2024-02-17T12:19:06.210669+0000","last_fullsized":"2024-02-17T12:19:06.210669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521092+0000","last_change":"2024-02-17T12:19:04.716812+0000","last_active":"2024-02-17T12:19:06.521092+0000","last_peered":"2024-02-17T12:19:06.521092+0000","last_clean":"2024-02-17T12:19:06.521092+0000","last_became_active":"2024-02-17T12:19:04.716307+0000","last_became_peered":"2024-02-17T12:19:04.716307+0000","last_unstale":"2024-02-17T12:19:06.521092+0000","last_undegraded":"2024-02-17T12:19:06.521092+0000","last_fullsized":"2024-02-17T12:19:06.521092+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:30.970580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210404+0000","last_change":"2024-02-17T12:19:03.710532+0000","last_active":"2024-02-17T12:19:06.210404+0000","last_peered":"2024-02-17T12:19:06.210404+0000","last_clean":"2024-02-17T12:19:06.210404+0000","last_became_active":"2024-02-17T12:19:03.710333+0000","last_became_peered":"2024-02-17T12:19:03.710333+0000","last_unstale":"2024-02-17T12:19:06.210404+0000","last_undegraded":"2024-02-17T12:19:06.210404+0000","last_fullsized":"2024-02-17T12:19:06.210404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711502+0000","last_change":"2024-02-17T12:19:04.719297+0000","last_active":"2024-02-17T12:19:05.711502+0000","last_peered":"2024-02-17T12:19:05.711502+0000","last_clean":"2024-02-17T12:19:05.711502+0000","last_became_active":"2024-02-17T12:19:04.718586+0000","last_became_peered":"2024-02-17T12:19:04.718586+0000","last_unstale":"2024-02-17T12:19:05.711502+0000","last_undegraded":"2024-02-17T12:19:05.711502+0000","last_fullsized":"2024-02-17T12:19:05.711502+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:05.970868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"67'6","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711915+0000","last_change":"2024-02-17T12:19:03.704237+0000","last_active":"2024-02-17T12:19:05.711915+0000","last_peered":"2024-02-17T12:19:05.711915+0000","last_clean":"2024-02-17T12:19:05.711915+0000","last_became_active":"2024-02-17T12:19:03.703964+0000","last_became_peered":"2024-02-17T12:19:03.703964+0000","last_unstale":"2024-02-17T12:19:05.711915+0000","last_undegraded":"2024-02-17T12:19:05.711915+0000","last_fullsized":"2024-02-17T12:19:05.711915+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:45.097730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520875+0000","last_change":"2024-02-17T12:19:04.702494+0000","last_active":"2024-02-17T12:19:06.520875+0000","last_peered":"2024-02-17T12:19:06.520875+0000","last_clean":"2024-02-17T12:19:06.520875+0000","last_became_active":"2024-02-17T12:19:04.702168+0000","last_became_peered":"2024-02-17T12:19:04.702168+0000","last_unstale":"2024-02-17T12:19:06.520875+0000","last_undegraded":"2024-02-17T12:19:06.520875+0000","last_fullsized":"2024-02-17T12:19:06.520875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:53.989897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707872+0000","last_change":"2024-02-17T12:19:03.710630+0000","last_active":"2024-02-17T12:19:05.707872+0000","last_peered":"2024-02-17T12:19:05.707872+0000","last_clean":"2024-02-17T12:19:05.707872+0000","last_became_active":"2024-02-17T12:19:03.710185+0000","last_became_peered":"2024-02-17T12:19:03.710185+0000","last_unstale":"2024-02-17T12:19:05.707872+0000","last_undegraded":"2024-02-17T12:19:05.707872+0000","last_fullsized":"2024-02-17T12:19:05.707872+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:07:16.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519960+0000","last_change":"2024-02-17T12:19:04.716555+0000","last_active":"2024-02-17T12:19:06.519960+0000","last_peered":"2024-02-17T12:19:06.519960+0000","last_clean":"2024-02-17T12:19:06.519960+0000","last_became_active":"2024-02-17T12:19:04.715235+0000","last_became_peered":"2024-02-17T12:19:04.715235+0000","last_unstale":"2024-02-17T12:19:06.519960+0000","last_undegraded":"2024-02-17T12:19:06.519960+0000","last_fullsized":"2024-02-17T12:19:06.519960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:05.685656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519744+0000","last_change":"2024-02-17T12:19:03.712475+0000","last_active":"2024-02-17T12:19:06.519744+0000","last_peered":"2024-02-17T12:19:06.519744+0000","last_clean":"2024-02-17T12:19:06.519744+0000","last_became_active":"2024-02-17T12:19:03.712117+0000","last_became_peered":"2024-02-17T12:19:03.712117+0000","last_unstale":"2024-02-17T12:19:06.519744+0000","last_undegraded":"2024-02-17T12:19:06.519744+0000","last_fullsized":"2024-02-17T12:19:06.519744+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:10.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707802+0000","last_change":"2024-02-17T12:19:04.727289+0000","last_active":"2024-02-17T12:19:05.707802+0000","last_peered":"2024-02-17T12:19:05.707802+0000","last_clean":"2024-02-17T12:19:05.707802+0000","last_became_active":"2024-02-17T12:19:04.727041+0000","last_became_peered":"2024-02-17T12:19:04.727041+0000","last_unstale":"2024-02-17T12:19:05.707802+0000","last_undegraded":"2024-02-17T12:19:05.707802+0000","last_fullsized":"2024-02-17T12:19:05.707802+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:39:43.401328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711022+0000","last_change":"2024-02-17T12:19:03.699211+0000","last_active":"2024-02-17T12:19:05.711022+0000","last_peered":"2024-02-17T12:19:05.711022+0000","last_clean":"2024-02-17T12:19:05.711022+0000","last_became_active":"2024-02-17T12:19:03.698244+0000","last_became_peered":"2024-02-17T12:19:03.698244+0000","last_unstale":"2024-02-17T12:19:05.711022+0000","last_undegraded":"2024-02-17T12:19:05.711022+0000","last_fullsized":"2024-02-17T12:19:05.711022+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:42.702805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707696+0000","last_change":"2024-02-17T12:19:04.718529+0000","last_active":"2024-02-17T12:19:05.707696+0000","last_peered":"2024-02-17T12:19:05.707696+0000","last_clean":"2024-02-17T12:19:05.707696+0000","last_became_active":"2024-02-17T12:19:04.718251+0000","last_became_peered":"2024-02-17T12:19:04.718251+0000","last_unstale":"2024-02-17T12:19:05.707696+0000","last_undegraded":"2024-02-17T12:19:05.707696+0000","last_fullsized":"2024-02-17T12:19:05.707696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:28.280713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520686+0000","last_change":"2024-02-17T12:19:03.706554+0000","last_active":"2024-02-17T12:19:06.520686+0000","last_peered":"2024-02-17T12:19:06.520686+0000","last_clean":"2024-02-17T12:19:06.520686+0000","last_became_active":"2024-02-17T12:19:03.706236+0000","last_became_peered":"2024-02-17T12:19:03.706236+0000","last_unstale":"2024-02-17T12:19:06.520686+0000","last_undegraded":"2024-02-17T12:19:06.520686+0000","last_fullsized":"2024-02-17T12:19:06.520686+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520069+0000","last_change":"2024-02-17T12:19:04.715036+0000","last_active":"2024-02-17T12:19:06.520069+0000","last_peered":"2024-02-17T12:19:06.520069+0000","last_clean":"2024-02-17T12:19:06.520069+0000","last_became_active":"2024-02-17T12:19:04.714713+0000","last_became_peered":"2024-02-17T12:19:04.714713+0000","last_unstale":"2024-02-17T12:19:06.520069+0000","last_undegraded":"2024-02-17T12:19:06.520069+0000","last_fullsized":"2024-02-17T12:19:06.520069+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:28:30.744698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210994+0000","last_change":"2024-02-17T12:19:03.705648+0000","last_active":"2024-02-17T12:19:06.210994+0000","last_peered":"2024-02-17T12:19:06.210994+0000","last_clean":"2024-02-17T12:19:06.210994+0000","last_became_active":"2024-02-17T12:19:03.705325+0000","last_became_peered":"2024-02-17T12:19:03.705325+0000","last_unstale":"2024-02-17T12:19:06.210994+0000","last_undegraded":"2024-02-17T12:19:06.210994+0000","last_fullsized":"2024-02-17T12:19:06.210994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210807+0000","last_change":"2024-02-17T12:19:04.719005+0000","last_active":"2024-02-17T12:19:06.210807+0000","last_peered":"2024-02-17T12:19:06.210807+0000","last_clean":"2024-02-17T12:19:06.210807+0000","last_became_active":"2024-02-17T12:19:04.717221+0000","last_became_peered":"2024-02-17T12:19:04.717221+0000","last_unstale":"2024-02-17T12:19:06.210807+0000","last_undegraded":"2024-02-17T12:19:06.210807+0000","last_fullsized":"2024-02-17T12:19:06.210807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:50.535947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520940+0000","last_change":"2024-02-17T12:19:03.708463+0000","last_active":"2024-02-17T12:19:06.520940+0000","last_peered":"2024-02-17T12:19:06.520940+0000","last_clean":"2024-02-17T12:19:06.520940+0000","last_became_active":"2024-02-17T12:19:03.707739+0000","last_became_peered":"2024-02-17T12:19:03.707739+0000","last_unstale":"2024-02-17T12:19:06.520940+0000","last_undegraded":"2024-02-17T12:19:06.520940+0000","last_fullsized":"2024-02-17T12:19:06.520940+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711672+0000","last_change":"2024-02-17T12:19:04.727161+0000","last_active":"2024-02-17T12:19:05.711672+0000","last_peered":"2024-02-17T12:19:05.711672+0000","last_clean":"2024-02-17T12:19:05.711672+0000","last_became_active":"2024-02-17T12:19:04.726871+0000","last_became_peered":"2024-02-17T12:19:04.726871+0000","last_unstale":"2024-02-17T12:19:05.711672+0000","last_undegraded":"2024-02-17T12:19:05.711672+0000","last_fullsized":"2024-02-17T12:19:05.711672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:50.453267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521222+0000","last_change":"2024-02-17T12:19:03.700286+0000","last_active":"2024-02-17T12:19:06.521222+0000","last_peered":"2024-02-17T12:19:06.521222+0000","last_clean":"2024-02-17T12:19:06.521222+0000","last_became_active":"2024-02-17T12:19:03.700021+0000","last_became_peered":"2024-02-17T12:19:03.700021+0000","last_unstale":"2024-02-17T12:19:06.521222+0000","last_undegraded":"2024-02-17T12:19:06.521222+0000","last_fullsized":"2024-02-17T12:19:06.521222+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520348+0000","last_change":"2024-02-17T12:19:04.727215+0000","last_active":"2024-02-17T12:19:06.520348+0000","last_peered":"2024-02-17T12:19:06.520348+0000","last_clean":"2024-02-17T12:19:06.520348+0000","last_became_active":"2024-02-17T12:19:04.726960+0000","last_became_peered":"2024-02-17T12:19:04.726960+0000","last_unstale":"2024-02-17T12:19:06.520348+0000","last_undegraded":"2024-02-17T12:19:06.520348+0000","last_fullsized":"2024-02-17T12:19:06.520348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:45.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520015+0000","last_change":"2024-02-17T12:19:03.709412+0000","last_active":"2024-02-17T12:19:06.520015+0000","last_peered":"2024-02-17T12:19:06.520015+0000","last_clean":"2024-02-17T12:19:06.520015+0000","last_became_active":"2024-02-17T12:19:03.709021+0000","last_became_peered":"2024-02-17T12:19:03.709021+0000","last_unstale":"2024-02-17T12:19:06.520015+0000","last_undegraded":"2024-02-17T12:19:06.520015+0000","last_fullsized":"2024-02-17T12:19:06.520015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:44.049163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711179+0000","last_change":"2024-02-17T12:19:04.712404+0000","last_active":"2024-02-17T12:19:05.711179+0000","last_peered":"2024-02-17T12:19:05.711179+0000","last_clean":"2024-02-17T12:19:05.711179+0000","last_became_active":"2024-02-17T12:19:04.711344+0000","last_became_peered":"2024-02-17T12:19:04.711344+0000","last_unstale":"2024-02-17T12:19:05.711179+0000","last_undegraded":"2024-02-17T12:19:05.711179+0000","last_fullsized":"2024-02-17T12:19:05.711179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:24.593812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520183+0000","last_change":"2024-02-17T12:19:03.706405+0000","last_active":"2024-02-17T12:19:06.520183+0000","last_peered":"2024-02-17T12:19:06.520183+0000","last_clean":"2024-02-17T12:19:06.520183+0000","last_became_active":"2024-02-17T12:19:03.706108+0000","last_became_peered":"2024-02-17T12:19:03.706108+0000","last_unstale":"2024-02-17T12:19:06.520183+0000","last_undegraded":"2024-02-17T12:19:06.520183+0000","last_fullsized":"2024-02-17T12:19:06.520183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.926513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519995+0000","last_change":"2024-02-17T12:19:04.712081+0000","last_active":"2024-02-17T12:19:06.519995+0000","last_peered":"2024-02-17T12:19:06.519995+0000","last_clean":"2024-02-17T12:19:06.519995+0000","last_became_active":"2024-02-17T12:19:04.711784+0000","last_became_peered":"2024-02-17T12:19:04.711784+0000","last_unstale":"2024-02-17T12:19:06.519995+0000","last_undegraded":"2024-02-17T12:19:06.519995+0000","last_fullsized":"2024-02-17T12:19:06.519995+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:47:13.952609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519939+0000","last_change":"2024-02-17T12:19:03.701598+0000","last_active":"2024-02-17T12:19:06.519939+0000","last_peered":"2024-02-17T12:19:06.519939+0000","last_clean":"2024-02-17T12:19:06.519939+0000","last_became_active":"2024-02-17T12:19:03.701326+0000","last_became_peered":"2024-02-17T12:19:03.701326+0000","last_unstale":"2024-02-17T12:19:06.519939+0000","last_undegraded":"2024-02-17T12:19:06.519939+0000","last_fullsized":"2024-02-17T12:19:06.519939+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:47:22.021385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711041+0000","last_change":"2024-02-17T12:19:04.702184+0000","last_active":"2024-02-17T12:19:05.711041+0000","last_peered":"2024-02-17T12:19:05.711041+0000","last_clean":"2024-02-17T12:19:05.711041+0000","last_became_active":"2024-02-17T12:19:04.701908+0000","last_became_peered":"2024-02-17T12:19:04.701908+0000","last_unstale":"2024-02-17T12:19:05.711041+0000","last_undegraded":"2024-02-17T12:19:05.711041+0000","last_fullsized":"2024-02-17T12:19:05.711041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:30.749868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519477+0000","last_change":"2024-02-17T12:19:03.702614+0000","last_active":"2024-02-17T12:19:06.519477+0000","last_peered":"2024-02-17T12:19:06.519477+0000","last_clean":"2024-02-17T12:19:06.519477+0000","last_became_active":"2024-02-17T12:19:03.702360+0000","last_became_peered":"2024-02-17T12:19:03.702360+0000","last_unstale":"2024-02-17T12:19:06.519477+0000","last_undegraded":"2024-02-17T12:19:06.519477+0000","last_fullsized":"2024-02-17T12:19:06.519477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:37.418089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711923+0000","last_change":"2024-02-17T12:19:04.697171+0000","last_active":"2024-02-17T12:19:05.711923+0000","last_peered":"2024-02-17T12:19:05.711923+0000","last_clean":"2024-02-17T12:19:05.711923+0000","last_became_active":"2024-02-17T12:19:04.696841+0000","last_became_peered":"2024-02-17T12:19:04.696841+0000","last_unstale":"2024-02-17T12:19:05.711923+0000","last_undegraded":"2024-02-17T12:19:05.711923+0000","last_fullsized":"2024-02-17T12:19:05.711923+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:04:51.114922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708024+0000","last_change":"2024-02-17T12:19:03.706098+0000","last_active":"2024-02-17T12:19:05.708024+0000","last_peered":"2024-02-17T12:19:05.708024+0000","last_clean":"2024-02-17T12:19:05.708024+0000","last_became_active":"2024-02-17T12:19:03.705787+0000","last_became_peered":"2024-02-17T12:19:03.705787+0000","last_unstale":"2024-02-17T12:19:05.708024+0000","last_undegraded":"2024-02-17T12:19:05.708024+0000","last_fullsized":"2024-02-17T12:19:05.708024+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:59.839484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520086+0000","last_change":"2024-02-17T12:19:04.710601+0000","last_active":"2024-02-17T12:19:06.520086+0000","last_peered":"2024-02-17T12:19:06.520086+0000","last_clean":"2024-02-17T12:19:06.520086+0000","last_became_active":"2024-02-17T12:19:04.710296+0000","last_became_peered":"2024-02-17T12:19:04.710296+0000","last_unstale":"2024-02-17T12:19:06.520086+0000","last_undegraded":"2024-02-17T12:19:06.520086+0000","last_fullsized":"2024-02-17T12:19:06.520086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:17:06.226423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708366+0000","last_change":"2024-02-17T12:19:03.707121+0000","last_active":"2024-02-17T12:19:05.708366+0000","last_peered":"2024-02-17T12:19:05.708366+0000","last_clean":"2024-02-17T12:19:05.708366+0000","last_became_active":"2024-02-17T12:19:03.706873+0000","last_became_peered":"2024-02-17T12:19:03.706873+0000","last_unstale":"2024-02-17T12:19:05.708366+0000","last_undegraded":"2024-02-17T12:19:05.708366+0000","last_fullsized":"2024-02-17T12:19:05.708366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:24.015391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210702+0000","last_change":"2024-02-17T12:19:04.718645+0000","last_active":"2024-02-17T12:19:06.210702+0000","last_peered":"2024-02-17T12:19:06.210702+0000","last_clean":"2024-02-17T12:19:06.210702+0000","last_became_active":"2024-02-17T12:19:04.715738+0000","last_became_peered":"2024-02-17T12:19:04.715738+0000","last_unstale":"2024-02-17T12:19:06.210702+0000","last_undegraded":"2024-02-17T12:19:06.210702+0000","last_fullsized":"2024-02-17T12:19:06.210702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:45.056164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210641+0000","last_change":"2024-02-17T12:19:03.705719+0000","last_active":"2024-02-17T12:19:06.210641+0000","last_peered":"2024-02-17T12:19:06.210641+0000","last_clean":"2024-02-17T12:19:06.210641+0000","last_became_active":"2024-02-17T12:19:03.705394+0000","last_became_peered":"2024-02-17T12:19:03.705394+0000","last_unstale":"2024-02-17T12:19:06.210641+0000","last_undegraded":"2024-02-17T12:19:06.210641+0000","last_fullsized":"2024-02-17T12:19:06.210641+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:18.432832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711730+0000","last_change":"2024-02-17T12:19:04.719278+0000","last_active":"2024-02-17T12:19:05.711730+0000","last_peered":"2024-02-17T12:19:05.711730+0000","last_clean":"2024-02-17T12:19:05.711730+0000","last_became_active":"2024-02-17T12:19:04.718194+0000","last_became_peered":"2024-02-17T12:19:04.718194+0000","last_unstale":"2024-02-17T12:19:05.711730+0000","last_undegraded":"2024-02-17T12:19:05.711730+0000","last_fullsized":"2024-02-17T12:19:05.711730+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:11.081786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210809+0000","last_change":"2024-02-17T12:19:03.712607+0000","last_active":"2024-02-17T12:19:06.210809+0000","last_peered":"2024-02-17T12:19:06.210809+0000","last_clean":"2024-02-17T12:19:06.210809+0000","last_became_active":"2024-02-17T12:19:03.712328+0000","last_became_peered":"2024-02-17T12:19:03.712328+0000","last_unstale":"2024-02-17T12:19:06.210809+0000","last_undegraded":"2024-02-17T12:19:06.210809+0000","last_fullsized":"2024-02-17T12:19:06.210809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711331+0000","last_change":"2024-02-17T12:19:04.711425+0000","last_active":"2024-02-17T12:19:05.711331+0000","last_peered":"2024-02-17T12:19:05.711331+0000","last_clean":"2024-02-17T12:19:05.711331+0000","last_became_active":"2024-02-17T12:19:04.711149+0000","last_became_peered":"2024-02-17T12:19:04.711149+0000","last_unstale":"2024-02-17T12:19:05.711331+0000","last_undegraded":"2024-02-17T12:19:05.711331+0000","last_fullsized":"2024-02-17T12:19:05.711331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521184+0000","last_change":"2024-02-17T12:19:03.708773+0000","last_active":"2024-02-17T12:19:06.521184+0000","last_peered":"2024-02-17T12:19:06.521184+0000","last_clean":"2024-02-17T12:19:06.521184+0000","last_became_active":"2024-02-17T12:19:03.707579+0000","last_became_peered":"2024-02-17T12:19:03.707579+0000","last_unstale":"2024-02-17T12:19:06.521184+0000","last_undegraded":"2024-02-17T12:19:06.521184+0000","last_fullsized":"2024-02-17T12:19:06.521184+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521131+0000","last_change":"2024-02-17T12:19:04.699129+0000","last_active":"2024-02-17T12:19:06.521131+0000","last_peered":"2024-02-17T12:19:06.521131+0000","last_clean":"2024-02-17T12:19:06.521131+0000","last_became_active":"2024-02-17T12:19:04.698800+0000","last_became_peered":"2024-02-17T12:19:04.698800+0000","last_unstale":"2024-02-17T12:19:06.521131+0000","last_undegraded":"2024-02-17T12:19:06.521131+0000","last_fullsized":"2024-02-17T12:19:06.521131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:36:34.252865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711336+0000","last_change":"2024-02-17T12:19:03.705779+0000","last_active":"2024-02-17T12:19:05.711336+0000","last_peered":"2024-02-17T12:19:05.711336+0000","last_clean":"2024-02-17T12:19:05.711336+0000","last_became_active":"2024-02-17T12:19:03.705453+0000","last_became_peered":"2024-02-17T12:19:03.705453+0000","last_unstale":"2024-02-17T12:19:05.711336+0000","last_undegraded":"2024-02-17T12:19:05.711336+0000","last_fullsized":"2024-02-17T12:19:05.711336+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:20.550660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519753+0000","last_change":"2024-02-17T12:19:04.717000+0000","last_active":"2024-02-17T12:19:06.519753+0000","last_peered":"2024-02-17T12:19:06.519753+0000","last_clean":"2024-02-17T12:19:06.519753+0000","last_became_active":"2024-02-17T12:19:04.716743+0000","last_became_peered":"2024-02-17T12:19:04.716743+0000","last_unstale":"2024-02-17T12:19:06.519753+0000","last_undegraded":"2024-02-17T12:19:06.519753+0000","last_fullsized":"2024-02-17T12:19:06.519753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:48:38.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210382+0000","last_change":"2024-02-17T12:19:03.710199+0000","last_active":"2024-02-17T12:19:06.210382+0000","last_peered":"2024-02-17T12:19:06.210382+0000","last_clean":"2024-02-17T12:19:06.210382+0000","last_became_active":"2024-02-17T12:19:03.709947+0000","last_became_peered":"2024-02-17T12:19:03.709947+0000","last_unstale":"2024-02-17T12:19:06.210382+0000","last_undegraded":"2024-02-17T12:19:06.210382+0000","last_fullsized":"2024-02-17T12:19:06.210382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210236+0000","last_change":"2024-02-17T12:19:04.713606+0000","last_active":"2024-02-17T12:19:06.210236+0000","last_peered":"2024-02-17T12:19:06.210236+0000","last_clean":"2024-02-17T12:19:06.210236+0000","last_became_active":"2024-02-17T12:19:04.708088+0000","last_became_peered":"2024-02-17T12:19:04.708088+0000","last_unstale":"2024-02-17T12:19:06.210236+0000","last_undegraded":"2024-02-17T12:19:06.210236+0000","last_fullsized":"2024-02-17T12:19:06.210236+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:22.491827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711286+0000","last_change":"2024-02-17T12:19:03.701618+0000","last_active":"2024-02-17T12:19:05.711286+0000","last_peered":"2024-02-17T12:19:05.711286+0000","last_clean":"2024-02-17T12:19:05.711286+0000","last_became_active":"2024-02-17T12:19:03.701291+0000","last_became_peered":"2024-02-17T12:19:03.701291+0000","last_unstale":"2024-02-17T12:19:05.711286+0000","last_undegraded":"2024-02-17T12:19:05.711286+0000","last_fullsized":"2024-02-17T12:19:05.711286+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:13.448703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708155+0000","last_change":"2024-02-17T12:19:04.719250+0000","last_active":"2024-02-17T12:19:05.708155+0000","last_peered":"2024-02-17T12:19:05.708155+0000","last_clean":"2024-02-17T12:19:05.708155+0000","last_became_active":"2024-02-17T12:19:04.718856+0000","last_became_peered":"2024-02-17T12:19:04.718856+0000","last_unstale":"2024-02-17T12:19:05.708155+0000","last_undegraded":"2024-02-17T12:19:05.708155+0000","last_fullsized":"2024-02-17T12:19:05.708155+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:43.814483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520360+0000","last_change":"2024-02-17T12:19:03.712148+0000","last_active":"2024-02-17T12:19:06.520360+0000","last_peered":"2024-02-17T12:19:06.520360+0000","last_clean":"2024-02-17T12:19:06.520360+0000","last_became_active":"2024-02-17T12:19:03.711771+0000","last_became_peered":"2024-02-17T12:19:03.711771+0000","last_unstale":"2024-02-17T12:19:06.520360+0000","last_undegraded":"2024-02-17T12:19:06.520360+0000","last_fullsized":"2024-02-17T12:19:06.520360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:53.868822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":257,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520016+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:19:06.520016+0000","last_peered":"2024-02-17T12:19:06.520016+0000","last_clean":"2024-02-17T12:19:06.520016+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:19:06.520016+0000","last_undegraded":"2024-02-17T12:19:06.520016+0000","last_fullsized":"2024-02-17T12:19:06.520016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":361275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88700000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77200000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67400000000000004,"15min":0.68100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88300000000000001,"5min":1.115,"15min":1.115},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.74099999999999999},"min":{"1min":0.52300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88500000000000001,"5min":1.143,"15min":1.143},"last":0.65000000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46899999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.749},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88700000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.622},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54100000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.82399999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73999999999999999,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.86199999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.83099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.026,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.88100000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.85499999999999998,"15min":0.86499999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.92400000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":843776,"data_stored":362215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.65500000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.61599999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.437}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.67900000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":362193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.44},"min":{"1min":0.28399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.55500000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63900000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.36699999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.48199999999999998,"15min":0.49199999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.621,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76400000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.495}]},{"osd":2,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68500000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":1.387,"15min":1.387},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.875,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.497,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.714,"15min":1.714},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":1.744,"15min":1.744},"last":0.73399999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91500000000000004,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.752},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92200000000000004,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:18:11 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78000000000000003,"15min":0.78500000000000003},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.002,"5min":1.575,"15min":1.575},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.76900000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96899999999999997,"5min":1.321,"15min":1.321},"last":0.90900000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":360775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64200000000000002,"5min":1.145,"15min":1.145},"last":0.5},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.65400000000000003,"15min":0.68200000000000005},"min":{"1min":0.34000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69499999999999995,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58099999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.443},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73799999999999999,"15min":0.77400000000000002},"min":{"1min":0.371,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.751,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.65300000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82499999999999996,"5min":2.609,"15min":2.609},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.73999999999999999,"15min":0.77600000000000002},"min":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51700000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.079,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.90700000000000003,"15min":0.94099999999999995},"min":{"1min":0.53500000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.997,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.05,"5min":1.095,"15min":1.095},"last":0.69399999999999995}]},{"osd":6,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0469999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.755},{"interface":"front","average":{"1min":0.748,"5min":0.97199999999999998,"15min":1.0089999999999999},"min":{"1min":0.57499999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0820000000000001,"5min":5.375,"15min":5.375},"last":0.86299999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:18:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.97999999999999998,"15min":1.0169999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.091,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.995,"5min":1.629,"15min":1.629},"last":0.81399999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1425408,"data_stored":950983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.26400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47899999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.61699999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.442}]},{"osd":2,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45100000000000001,"15min":0.45700000000000002},"min":{"1min":0.312,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56799999999999995,"5min":1.046,"15min":1.046},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.60999999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.58699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.46500000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.56799999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0129999999999999,"5min":1.139,"15min":1.139},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92800000000000005,"5min":1.038,"15min":1.038},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94499999999999995,"5min":1.095,"15min":1.095},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97599999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0960000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.505,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90200000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.78300000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28412,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343428,"statfs":{"total":96636764160,"available":96607670272,"internally_reserved":0,"allocated":1425408,"data_stored":951019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84899999999999998,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.63600000000000001}]},{"osd":1,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74399999999999999,"15min":0.76300000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75700000000000001,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.755,"15min":0.76500000000000001},"min":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.92400000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.60199999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.79000000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.85699999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.59199999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90000000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.72099999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86799999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61599999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95099999999999996,"5min":1.052,"15min":1.052},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93700000000000006,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68899999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":360581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86799999999999999,"5min":1.264,"15min":1.264},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67700000000000005,"15min":0.67800000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98999999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.198,"15min":1.198},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.171,"15min":1.171},"last":0.48999999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86499999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72799999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81799999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56799999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97199999999999998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93600000000000005,"5min":1.522,"15min":1.522},"last":0.59699999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.72799999999999998,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89900000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Feb 17 12:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.84399999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64800000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88100000000000001,"5min":1.228,"15min":1.228},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89000000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.747}]}]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":831488,"data_stored":361163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.44800000000000001,"15min":0.45900000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.313},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69899999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.504},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64100000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.495}]},{"osd":3,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.629,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.66800000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.78200000000000003},"min":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.141,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.93200000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93300000000000005,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.56799999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.2749999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.997,"5min":1.252,"15min":1.252},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:18:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91500000000000004,"5min":1.29,"15min":1.29},"last":0.748},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":1.337,"15min":1.337},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:19:13.644 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T12:19:13.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-02-17T12:19:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe577a00640 1 Processor -- start 2024-02-17T12:19:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe577a00640 1 -- start start 2024-02-17T12:19:13.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe577a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 0x7fe57006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe577a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe5700c6460 0x7fe570158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe577a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe570155dd0 con 0x7fe570154e30 2024-02-17T12:19:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe577a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5701588c0 con 0x7fe5700c6460 2024-02-17T12:19:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe577a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe570155810 con 0x7fe570152540 2024-02-17T12:19:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe575a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe570154e30 0x7fe5700aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42158/0 (socket says 172.21.15.114:42158) 2024-02-17T12:19:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe575a00640 1 -- 172.21.15.114:0/2716797134 learned_addr learned my addr 172.21.15.114:0/2716797134 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe575000640 1 --2- 172.21.15.114:0/2716797134 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 0x7fe57006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe56fe00640 1 --2- 172.21.15.114:0/2716797134 >> v2:172.21.15.116:3300/0 conn(0x7fe5700c6460 0x7fe570158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe56f400640 1 -- 172.21.15.114:0/2716797134 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308697113 0 0) 0x7fe570155dd0 con 0x7fe570154e30 2024-02-17T12:19:13.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe56f400640 1 -- 172.21.15.114:0/2716797134 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe554003530 con 0x7fe570154e30 2024-02-17T12:19:13.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe575000640 1 -- 172.21.15.114:0/2716797134 >> v2:172.21.15.116:3300/0 conn(0x7fe5700c6460 msgr2=0x7fe570158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:13.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe575000640 1 --2- 172.21.15.114:0/2716797134 >> v2:172.21.15.116:3300/0 conn(0x7fe5700c6460 0x7fe570158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe575000640 1 -- 172.21.15.114:0/2716797134 >> v1:172.21.15.114:6789/0 conn(0x7fe570154e30 legacy=0x7fe5700aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:13.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.820+0000 7fe575000640 1 -- 172.21.15.114:0/2716797134 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe570155af0 con 0x7fe570152540 2024-02-17T12:19:13.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe575000640 1 --2- 172.21.15.114:0/2716797134 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 0x7fe57006ff80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5600097c0 tx=0x7fe56001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce700e9103e1f4c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:13.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe56f400640 1 -- 172.21.15.114:0/2716797134 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5600ab600 con 0x7fe570152540 2024-02-17T12:19:13.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe56f400640 1 -- 172.21.15.114:0/2716797134 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5600a7050 con 0x7fe570152540 2024-02-17T12:19:13.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe56f400640 1 -- 172.21.15.114:0/2716797134 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5600ab980 con 0x7fe570152540 2024-02-17T12:19:13.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe577a00640 1 -- 172.21.15.114:0/2716797134 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 msgr2=0x7fe57006ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:13.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe577a00640 1 --2- 172.21.15.114:0/2716797134 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 0x7fe57006ff80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5600097c0 tx=0x7fe56001c380 comp rx=0 tx=0).stop 2024-02-17T12:19:13.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe577a00640 1 -- 172.21.15.114:0/2716797134 shutdown_connections 2024-02-17T12:19:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe577a00640 1 --2- 172.21.15.114:0/2716797134 >> v2:172.21.15.116:3300/0 conn(0x7fe5700c6460 0x7fe570158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe577a00640 1 --2- 172.21.15.114:0/2716797134 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 0x7fe57006ff80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe577a00640 1 -- 172.21.15.114:0/2716797134 >> 172.21.15.114:0/2716797134 conn(0x7fe5700c4f20 msgr2=0x7fe5700c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe577a00640 1 -- 172.21.15.114:0/2716797134 shutdown_connections 2024-02-17T12:19:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.824+0000 7fe577a00640 1 -- 172.21.15.114:0/2716797134 wait complete. 2024-02-17T12:19:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 Processor -- start 2024-02-17T12:19:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 -- start start 2024-02-17T12:19:13.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5700c6460 0x7fe570157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 0x7fe5700a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe570154e30 0x7fe5700a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700a9af0 con 0x7fe570154e30 2024-02-17T12:19:13.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57006c0f0 con 0x7fe5700c6460 2024-02-17T12:19:13.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5701edfb0 con 0x7fe570152540 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe575a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe570154e30 0x7fe5700a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe575a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe570154e30 0x7fe5700a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40814/0 (socket says 172.21.15.114:40814) 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe575a00640 1 -- 172.21.15.114:0/946037484 learned_addr learned my addr 172.21.15.114:0/946037484 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe575000640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5700c6460 0x7fe570157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe56fe00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 0x7fe5700a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe575a00640 1 -- 172.21.15.114:0/946037484 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 msgr2=0x7fe5700a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe575a00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 0x7fe5700a9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe575a00640 1 -- 172.21.15.114:0/946037484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5700c6460 msgr2=0x7fe570157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe575a00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5700c6460 0x7fe570157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe575a00640 1 -- 172.21.15.114:0/946037484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe560009420 con 0x7fe570154e30 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe575a00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe570154e30 0x7fe5700a95b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe56800caa0 tx=0x7fe56800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe56cc00640 1 -- 172.21.15.114:0/946037484 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800ac00 con 0x7fe570154e30 2024-02-17T12:19:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe56cc00640 1 -- 172.21.15.114:0/946037484 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800ad60 con 0x7fe570154e30 2024-02-17T12:19:13.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe56cc00640 1 -- 172.21.15.114:0/946037484 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568012620 con 0x7fe570154e30 2024-02-17T12:19:13.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 -- 172.21.15.114:0/946037484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe570143050 con 0x7fe570154e30 2024-02-17T12:19:13.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 -- 172.21.15.114:0/946037484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57006c340 con 0x7fe570154e30 2024-02-17T12:19:13.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.828+0000 7fe577a00640 1 -- 172.21.15.114:0/946037484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe570068180 con 0x7fe570154e30 2024-02-17T12:19:13.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.832+0000 7fe56cc00640 1 -- 172.21.15.114:0/946037484 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe568007070 con 0x7fe570154e30 2024-02-17T12:19:13.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.832+0000 7fe56cc00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe550066e70 0x7fe550069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:13.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.832+0000 7fe56cc00640 1 -- 172.21.15.114:0/946037484 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe568084940 con 0x7fe570154e30 2024-02-17T12:19:13.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.832+0000 7fe575000640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe550066e70 0x7fe550069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:13.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.832+0000 7fe575000640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe550066e70 0x7fe550069330 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe5600ad000 tx=0x7fe5600a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:13.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:13.836+0000 7fe56cc00640 1 -- 172.21.15.114:0/946037484 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe5680517d0 con 0x7fe570154e30 2024-02-17T12:19:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.044+0000 7fe577a00640 1 -- 172.21.15.114:0/946037484 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe570074840 con 0x7fe570154e30 2024-02-17T12:19:14.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe56cc00640 1 -- 172.21.15.114:0/946037484 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe5680170e0 con 0x7fe570154e30 2024-02-17T12:19:14.050 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-02-17T12:19:14.051 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlaXt+FxAAn4YhbPPnUC6y0giRDPuYyQ== 2024-02-17T12:19:14.051 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-02-17T12:19:14.051 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-02-17T12:19:14.051 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-02-17T12:19:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-02-17T12:19:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 -- 172.21.15.114:0/946037484 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe550066e70 msgr2=0x7fe550069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe550066e70 0x7fe550069330 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe5600ad000 tx=0x7fe5600a6000 comp rx=0 tx=0).stop 2024-02-17T12:19:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 -- 172.21.15.114:0/946037484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe570154e30 msgr2=0x7fe5700a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe570154e30 0x7fe5700a95b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe56800caa0 tx=0x7fe56800cf60 comp rx=0 tx=0).stop 2024-02-17T12:19:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 -- 172.21.15.114:0/946037484 shutdown_connections 2024-02-17T12:19:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe550066e70 0x7fe550069330 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe570154e30 0x7fe5700a95b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe570152540 0x7fe5700a9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 --2- 172.21.15.114:0/946037484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5700c6460 0x7fe570157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 -- 172.21.15.114:0/946037484 >> 172.21.15.114:0/946037484 conn(0x7fe5700c4f20 msgr2=0x7fe57014b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 -- 172.21.15.114:0/946037484 shutdown_connections 2024-02-17T12:19:14.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.048+0000 7fe577a00640 1 -- 172.21.15.114:0/946037484 wait complete. 2024-02-17T12:19:14.071 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:19:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.200+0000 7f3d66200640 1 Processor -- start 2024-02-17T12:19:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d66200640 1 -- start start 2024-02-17T12:19:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d66200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3d60150300 0x7f3d60156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d66200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d60152d30 0x7f3d601531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d66200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d60157270 con 0x7f3d600714c0 2024-02-17T12:19:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d66200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600c6900 con 0x7f3d60150300 2024-02-17T12:19:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d66200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600c3580 con 0x7f3d60152d30 2024-02-17T12:19:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5ea00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3d600714c0 0x7f3d600aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42164/0 (socket says 172.21.15.114:42164) 2024-02-17T12:19:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5ea00640 1 -- 172.21.15.114:0/921670709 learned_addr learned my addr 172.21.15.114:0/921670709 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5fe00640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d60152d30 0x7f3d601531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5f400640 1 --2- 172.21.15.114:0/921670709 >> v2:172.21.15.116:3300/0 conn(0x7f3d60150300 0x7f3d60156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672425873 0 0) 0x7f3d60157270 con 0x7f3d600714c0 2024-02-17T12:19:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d44003530 con 0x7f3d600714c0 2024-02-17T12:19:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1898322858 0 0) 0x7f3d44003530 con 0x7f3d600714c0 2024-02-17T12:19:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d60152d30 msgr2=0x7f3d601531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d60152d30 0x7f3d601531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 >> v2:172.21.15.116:3300/0 conn(0x7f3d60150300 msgr2=0x7f3d60156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 --2- 172.21.15.114:0/921670709 >> v2:172.21.15.116:3300/0 conn(0x7f3d60150300 0x7f3d60156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600c2fc0 con 0x7f3d600714c0 2024-02-17T12:19:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f3d4c001680 con 0x7f3d600714c0 2024-02-17T12:19:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 >> v1:172.21.15.114:6789/0 conn(0x7f3d600714c0 legacy=0x7f3d600aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44003980 0x7f3d44003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d440047d0 0x7f3d44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d60152d30 0x7f3d44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600c6900 con 0x7f3d440047d0 2024-02-17T12:19:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600c3580 con 0x7f3d44003980 2024-02-17T12:19:14.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4400b990 con 0x7f3d60152d30 2024-02-17T12:19:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5ea00640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d440047d0 0x7f3d44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5f400640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44003980 0x7f3d44003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5fe00640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d60152d30 0x7f3d44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5ea00640 1 -- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d60152d30 msgr2=0x7f3d44005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5ea00640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d60152d30 0x7f3d44005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5ea00640 1 -- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44003980 msgr2=0x7f3d44003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5ea00640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44003980 0x7f3d44003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.204+0000 7f3d5ea00640 1 -- 172.21.15.114:0/921670709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d44003530 con 0x7f3d440047d0 2024-02-17T12:19:14.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d5ea00640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d440047d0 0x7f3d44004c50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c270 tx=0x7f3d4c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1ba2ab6e3d245c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0058e0 con 0x7f3d440047d0 2024-02-17T12:19:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c005a40 con 0x7f3d440047d0 2024-02-17T12:19:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d5e000640 1 -- 172.21.15.114:0/921670709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c005e10 con 0x7f3d440047d0 2024-02-17T12:19:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d66200640 1 -- 172.21.15.114:0/921670709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d440047d0 msgr2=0x7f3d44004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d66200640 1 --2- 172.21.15.114:0/921670709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d440047d0 0x7f3d44004c50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c270 tx=0x7f3d4c01cc80 comp rx=0 tx=0).stop 2024-02-17T12:19:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d5fe00640 1 -- 172.21.15.114:0/921670709 reap_dead start 2024-02-17T12:19:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d66200640 1 -- 172.21.15.114:0/921670709 shutdown_connections 2024-02-17T12:19:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d66200640 1 -- 172.21.15.114:0/921670709 >> 172.21.15.114:0/921670709 conn(0x7f3d600c4f20 msgr2=0x7f3d600c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d66200640 1 -- 172.21.15.114:0/921670709 shutdown_connections 2024-02-17T12:19:14.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.208+0000 7f3d66200640 1 -- 172.21.15.114:0/921670709 wait complete. 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 Processor -- start 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 -- start start 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d440047d0 0x7f3d60149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d60149b50 0x7f3d601ee8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d601eede0 0x7f3d6014b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600ad300 con 0x7f3d60149b50 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6014d720 con 0x7f3d440047d0 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6014cc70 con 0x7f3d601eede0 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d60149b50 0x7f3d601ee8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d60149b50 0x7f3d601ee8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40836/0 (socket says 172.21.15.114:40836) 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5ea00640 1 -- 172.21.15.114:0/448395709 learned_addr learned my addr 172.21.15.114:0/448395709 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:14.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5f400640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d440047d0 0x7f3d60149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5fe00640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d601eede0 0x7f3d6014b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5ea00640 1 -- 172.21.15.114:0/448395709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d601eede0 msgr2=0x7f3d6014b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5ea00640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d601eede0 0x7f3d6014b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5ea00640 1 -- 172.21.15.114:0/448395709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d440047d0 msgr2=0x7f3d60149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5ea00640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d440047d0 0x7f3d60149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5ea00640 1 -- 172.21.15.114:0/448395709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6014c990 con 0x7f3d60149b50 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5fe00640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d601eede0 0x7f3d6014b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d5ea00640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d60149b50 0x7f3d601ee8a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c210 tx=0x7f3d44005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d57400640 1 -- 172.21.15.114:0/448395709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c005e30 con 0x7f3d60149b50 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d57400640 1 -- 172.21.15.114:0/448395709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c0047f0 con 0x7f3d60149b50 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 -- 172.21.15.114:0/448395709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6014d160 con 0x7f3d60149b50 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d57400640 1 -- 172.21.15.114:0/448395709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c004b60 con 0x7f3d60149b50 2024-02-17T12:19:14.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 -- 172.21.15.114:0/448395709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d600aa0b0 con 0x7f3d60149b50 2024-02-17T12:19:14.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.212+0000 7f3d66200640 1 -- 172.21.15.114:0/448395709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6014cfc0 con 0x7f3d60149b50 2024-02-17T12:19:14.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.216+0000 7f3d57400640 1 -- 172.21.15.114:0/448395709 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3d4c004cc0 con 0x7f3d60149b50 2024-02-17T12:19:14.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.216+0000 7f3d57400640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d40066e70 0x7f3d40069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.216+0000 7f3d57400640 1 -- 172.21.15.114:0/448395709 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d4c11e460 con 0x7f3d60149b50 2024-02-17T12:19:14.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.216+0000 7f3d5f400640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d40066e70 0x7f3d40069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.216+0000 7f3d5f400640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d40066e70 0x7f3d40069330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009b60 tx=0x7f3d50009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:14.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.220+0000 7f3d57400640 1 -- 172.21.15.114:0/448395709 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3d6014cfc0 con 0x7f3d60149b50 2024-02-17T12:19:14.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 -- 172.21.15.114:0/448395709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d6014cfc0 con 0x7f3d60149b50 2024-02-17T12:19:14.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d57400640 1 -- 172.21.15.114:0/448395709 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f3d6014cfc0 con 0x7f3d60149b50 2024-02-17T12:19:14.411 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:14.412 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6501,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1982789506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1982789506},{"type":"v1","addr":"172.21.15.114:6836","nonce":1982789506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:04.061245+0000","modified":"2024-02-17T12:19:07.080013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/709959478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":709959478},{"type":"v1","addr":"172.21.15.114:6837","nonce":709959478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-02-17T12:19:14.412 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 49 2024-02-17T12:19:14.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 -- 172.21.15.114:0/448395709 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d40066e70 msgr2=0x7f3d40069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d40066e70 0x7f3d40069330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009b60 tx=0x7f3d50009190 comp rx=0 tx=0).stop 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 -- 172.21.15.114:0/448395709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d60149b50 msgr2=0x7f3d601ee8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d60149b50 0x7f3d601ee8a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c210 tx=0x7f3d44005800 comp rx=0 tx=0).stop 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 -- 172.21.15.114:0/448395709 shutdown_connections 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d601eede0 0x7f3d6014b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3d40066e70 0x7f3d40069330 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d60149b50 0x7f3d601ee8a0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 --2- 172.21.15.114:0/448395709 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d440047d0 0x7f3d60149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 -- 172.21.15.114:0/448395709 >> 172.21.15.114:0/448395709 conn(0x7f3d600c4f20 msgr2=0x7f3d600a9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 -- 172.21.15.114:0/448395709 shutdown_connections 2024-02-17T12:19:14.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.408+0000 7f3d66200640 1 -- 172.21.15.114:0/448395709 wait complete. 2024-02-17T12:19:14.834 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-17T12:19:04.061245+0000', 'modified': '2024-02-17T12:19:07.080013+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6504}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6504': {'gid': 6504, 'name': 'c', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6837/709959478', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 709959478}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 709959478}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-17T12:19:14.835 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-17T12:19:14.835 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-02-17T12:19:14.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efccda00640 1 Processor -- start 2024-02-17T12:19:14.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efccda00640 1 -- start start 2024-02-17T12:19:14.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efccda00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efcc80c2580 0x7efcc80aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efccda00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efcc80c1eb0 0x7efcc815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efccda00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc80a9420 con 0x7efcc814f110 2024-02-17T12:19:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efccda00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc814f4f0 con 0x7efcc80c1eb0 2024-02-17T12:19:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efccda00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc80aae80 con 0x7efcc80c2580 2024-02-17T12:19:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efcc6a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efcc814f110 0x7efcc80c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42166/0 (socket says 172.21.15.114:42166) 2024-02-17T12:19:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efcc6a00640 1 -- 172.21.15.114:0/3859470536 learned_addr learned my addr 172.21.15.114:0/3859470536 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efcc7400640 1 --2- 172.21.15.114:0/3859470536 >> v2:172.21.15.114:3300/0 conn(0x7efcc80c1eb0 0x7efcc815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efcc6000640 1 --2- 172.21.15.114:0/3859470536 >> v2:172.21.15.116:3300/0 conn(0x7efcc80c2580 0x7efcc80aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efcc5600640 1 -- 172.21.15.114:0/3859470536 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605737818 0 0) 0x7efcc80a9420 con 0x7efcc814f110 2024-02-17T12:19:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efcc5600640 1 -- 172.21.15.114:0/3859470536 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcac005740 con 0x7efcc814f110 2024-02-17T12:19:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efcc7400640 1 -- 172.21.15.114:0/3859470536 >> v2:172.21.15.116:3300/0 conn(0x7efcc80c2580 msgr2=0x7efcc80aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efcc7400640 1 --2- 172.21.15.114:0/3859470536 >> v2:172.21.15.116:3300/0 conn(0x7efcc80c2580 0x7efcc80aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efcc7400640 1 -- 172.21.15.114:0/3859470536 >> v1:172.21.15.114:6789/0 conn(0x7efcc814f110 legacy=0x7efcc80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.968+0000 7efcc7400640 1 -- 172.21.15.114:0/3859470536 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8152850 con 0x7efcc80c1eb0 2024-02-17T12:19:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efcc7400640 1 --2- 172.21.15.114:0/3859470536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 0x7efcc815c390 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efcc806f0d0 tx=0x7efcc001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997f49720162f9f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efcc5600640 1 -- 172.21.15.114:0/3859470536 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc00a5830 con 0x7efcc80c1eb0 2024-02-17T12:19:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efcc5600640 1 -- 172.21.15.114:0/3859470536 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc00a5990 con 0x7efcc80c1eb0 2024-02-17T12:19:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efcc5600640 1 -- 172.21.15.114:0/3859470536 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc00a5d20 con 0x7efcc80c1eb0 2024-02-17T12:19:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efccda00640 1 -- 172.21.15.114:0/3859470536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 msgr2=0x7efcc815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efccda00640 1 --2- 172.21.15.114:0/3859470536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 0x7efcc815c390 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efcc806f0d0 tx=0x7efcc001c870 comp rx=0 tx=0).stop 2024-02-17T12:19:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efccda00640 1 -- 172.21.15.114:0/3859470536 shutdown_connections 2024-02-17T12:19:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efccda00640 1 --2- 172.21.15.114:0/3859470536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 0x7efcc815c390 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efccda00640 1 --2- 172.21.15.114:0/3859470536 >> v2:172.21.15.116:3300/0 conn(0x7efcc80c2580 0x7efcc80aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efccda00640 1 -- 172.21.15.114:0/3859470536 >> 172.21.15.114:0/3859470536 conn(0x7efcc80a8490 msgr2=0x7efcc80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efccda00640 1 -- 172.21.15.114:0/3859470536 shutdown_connections 2024-02-17T12:19:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efccda00640 1 -- 172.21.15.114:0/3859470536 wait complete. 2024-02-17T12:19:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efccda00640 1 Processor -- start 2024-02-17T12:19:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.972+0000 7efccda00640 1 -- start start 2024-02-17T12:19:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efccda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 0x7efcc8143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efccda00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc80c2580 0x7efcc8144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efccda00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcc814f110 0x7efcc8149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efccda00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc814a4b0 con 0x7efcc80c1eb0 2024-02-17T12:19:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efccda00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc8143e50 con 0x7efcc80c2580 2024-02-17T12:19:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efccda00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc8144130 con 0x7efcc814f110 2024-02-17T12:19:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 0x7efcc8143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 0x7efcc8143870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40862/0 (socket says 172.21.15.114:40862) 2024-02-17T12:19:14.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6a00640 1 -- 172.21.15.114:0/2889024667 learned_addr learned my addr 172.21.15.114:0/2889024667 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:14.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc7400640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcc814f110 0x7efcc8149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6000640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc80c2580 0x7efcc8144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6a00640 1 -- 172.21.15.114:0/2889024667 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcc814f110 msgr2=0x7efcc8149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6a00640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcc814f110 0x7efcc8149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6a00640 1 -- 172.21.15.114:0/2889024667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc80c2580 msgr2=0x7efcc8144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6a00640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc80c2580 0x7efcc8144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6a00640 1 -- 172.21.15.114:0/2889024667 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0009a70 con 0x7efcc80c1eb0 2024-02-17T12:19:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6000640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc80c2580 0x7efcc8144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcc6a00640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 0x7efcc8143870 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c450 tx=0x7efcb800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcbea00640 1 -- 172.21.15.114:0/2889024667 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8005cf0 con 0x7efcc80c1eb0 2024-02-17T12:19:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcbea00640 1 -- 172.21.15.114:0/2889024667 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb8005e50 con 0x7efcc80c1eb0 2024-02-17T12:19:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efcbea00640 1 -- 172.21.15.114:0/2889024667 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8007290 con 0x7efcc80c1eb0 2024-02-17T12:19:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efccda00640 1 -- 172.21.15.114:0/2889024667 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc8144410 con 0x7efcc80c1eb0 2024-02-17T12:19:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.976+0000 7efccda00640 1 -- 172.21.15.114:0/2889024667 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc81449d0 con 0x7efcc80c1eb0 2024-02-17T12:19:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcbea00640 1 -- 172.21.15.114:0/2889024667 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7efcb80073f0 con 0x7efcc80c1eb0 2024-02-17T12:19:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcbea00640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efca8066e40 0x7efca8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcbea00640 1 -- 172.21.15.114:0/2889024667 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcb8084090 con 0x7efcc80c1eb0 2024-02-17T12:19:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 Processor -- start 2024-02-17T12:19:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc6000640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efca8066e40 0x7efca8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 -- start start 2024-02-17T12:19:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc6000640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efca8066e40 0x7efca8069300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efcc80c5db0 tx=0x7efcb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c26e0 0x55f0ab4c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3000 0x55f0ab4c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab50c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab388d00 con 0x55f0ab4c3920 2024-02-17T12:19:14.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab31a430 con 0x55f0ab4c26e0 2024-02-17T12:19:14.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab317960 con 0x55f0ab4c3000 2024-02-17T12:19:14.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab50c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab50c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40876/0 (socket says 172.21.15.114:40876) 2024-02-17T12:19:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc7400640 1 -- 172.21.15.114:0/1052696203 learned_addr learned my addr 172.21.15.114:0/1052696203 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc6a00640 1 --2- 172.21.15.114:0/1052696203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c26e0 0x55f0ab4c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc6000640 1 --2- 172.21.15.114:0/1052696203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3000 0x55f0ab4c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc7400640 1 -- 172.21.15.114:0/1052696203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3000 msgr2=0x55f0ab4c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc7400640 1 --2- 172.21.15.114:0/1052696203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3000 0x55f0ab4c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc7400640 1 -- 172.21.15.114:0/1052696203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c26e0 msgr2=0x55f0ab4c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc7400640 1 --2- 172.21.15.114:0/1052696203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c26e0 0x55f0ab4c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc7400640 1 -- 172.21.15.114:0/1052696203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ab009890 con 0x55f0ab4c3920 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcc7400640 1 --2- 172.21.15.114:0/1052696203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab50c910 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efcc00b0040 tx=0x7efcc0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c833199e086ef server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcb3400640 1 -- 172.21.15.114:0/1052696203 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc00a5b00 con 0x55f0ab4c3920 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcb3400640 1 -- 172.21.15.114:0/1052696203 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc00a5c60 con 0x55f0ab4c3920 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcb3400640 1 -- 172.21.15.114:0/1052696203 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc00b8480 con 0x55f0ab4c3920 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 -- 172.21.15.114:0/1052696203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 msgr2=0x55f0ab50c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 --2- 172.21.15.114:0/1052696203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab50c910 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efcc00b0040 tx=0x7efcc0004ac0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 -- 172.21.15.114:0/1052696203 shutdown_connections 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 --2- 172.21.15.114:0/1052696203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab50c910 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.980+0000 7efcd0f91000 1 --2- 172.21.15.114:0/1052696203 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3000 0x55f0ab4c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 --2- 172.21.15.114:0/1052696203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c26e0 0x55f0ab4c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 -- 172.21.15.114:0/1052696203 >> 172.21.15.114:0/1052696203 conn(0x55f0ab500670 msgr2=0x55f0ab502a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 -- 172.21.15.114:0/1052696203 shutdown_connections 2024-02-17T12:19:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 -- 172.21.15.114:0/1052696203 wait complete. 2024-02-17T12:19:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 -- start start 2024-02-17T12:19:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 Processor -- start 2024-02-17T12:19:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c26e0 0x55f0ab4fee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 0x55f0ab4ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab5038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab313140 con 0x55f0ab4c3920 2024-02-17T12:19:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab2ad630 con 0x55f0ab4c3000 2024-02-17T12:19:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab2ad2d0 con 0x55f0ab4c26e0 2024-02-17T12:19:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 10 client.0 _ll_register_callbacks cb 0x55f0ab3c31c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:19:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab5038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab5038b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40878/0 (socket says 172.21.15.114:40878) 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc7400640 1 -- 172.21.15.114:0/1902021517 learned_addr learned my addr 172.21.15.114:0/1902021517 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc6a00640 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c26e0 0x55f0ab4fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc7400640 1 -- 172.21.15.114:0/1902021517 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c26e0 msgr2=0x55f0ab4fee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc7400640 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c26e0 0x55f0ab4fee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc6000640 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 0x55f0ab4ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc7400640 1 -- 172.21.15.114:0/1902021517 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 msgr2=0x55f0ab4ff3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc7400640 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 0x55f0ab4ff3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc7400640 1 -- 172.21.15.114:0/1902021517 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc8152850 con 0x55f0ab4c3920 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc6000640 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 0x55f0ab4ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc7400640 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab5038b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efcc001c8b0 tx=0x7efcc001b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f336e839693c03 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efca7e00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-02-17T12:19:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efca7e00640 1 -- 172.21.15.114:0/1902021517 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0003ba0 con 0x55f0ab4c3920 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efca7e00640 1 -- 172.21.15.114:0/1902021517 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcc00a57b0 con 0x55f0ab4c3920 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 -- 172.21.15.114:0/1902021517 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0ab2c6850 con 0x55f0ab4c3920 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efca7e00640 1 -- 172.21.15.114:0/1902021517 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcc0003d00 con 0x55f0ab4c3920 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 10 client.6669 fetch_fsmap learned FSMap version 49 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 -- 172.21.15.114:0/1902021517 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55f0ab2d2e70 con 0x55f0ab4c3920 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efca7e00640 1 -- 172.21.15.114:0/1902021517 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0ab2c6850 con 0x55f0ab4c3920 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efca7e00640 1 -- 172.21.15.114:0/1902021517 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efcc0004040 con 0x55f0ab4c3920 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 10 client.6669 fetch_fsmap finished waiting for FSMap version 49 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 10 client.6669 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 20 client.6669 populate_metadata read hostname 'smithi114' 2024-02-17T12:19:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.114:6835/709959478,v1:172.21.15.114:6837/709959478] conn(0x55f0ab504620 0x55f0ab504a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 4 client.6669 mds_command: new command op to 6504 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcd0f91000 1 -- 172.21.15.114:0/1902021517 --> [v2:172.21.15.114:6835/709959478,v1:172.21.15.114:6837/709959478] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0ab30ff20 con 0x55f0ab504620 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.984+0000 7efcc6a00640 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.114:6835/709959478,v1:172.21.15.114:6837/709959478] conn(0x55f0ab504620 0x55f0ab504a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcc6a00640 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.114:6835/709959478,v1:172.21.15.114:6837/709959478] conn(0x55f0ab504620 0x55f0ab504a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6e697e2be63875c server_cookie=ac1f3fabbe9fe7d1 in_seq=0 out_seq=0 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efca7e00640 10 client.6669 ms_handle_connect on v2:172.21.15.114:6835/709959478 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efca7e00640 1 -- 172.21.15.114:0/1902021517 <== mds.0 v2:172.21.15.114:6835/709959478 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f0ab30ff20 con 0x55f0ab504620 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efca7e00640 10 client.6669 handle_command_reply: tid=0 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 client.6669 shutdown 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 -- 172.21.15.114:0/1902021517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 msgr2=0x55f0ab5038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab5038b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efcc001c8b0 tx=0x7efcc001b0b0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 -- 172.21.15.114:0/1902021517 shutdown_connections 2024-02-17T12:19:15.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.114:6835/709959478,v1:172.21.15.114:6837/709959478] conn(0x55f0ab504620 0x55f0ab504a00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c3920 0x55f0ab5038b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 0x55f0ab4ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 --2- 172.21.15.114:0/1902021517 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c26e0 0x55f0ab4fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efca7e00640 0 client.6669 ms_handle_reset on v2:172.21.15.114:6835/709959478 2024-02-17T12:19:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 -- 172.21.15.114:0/1902021517 >> 172.21.15.114:0/1902021517 conn(0x55f0ab500670 msgr2=0x55f0ab4c1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 -- 172.21.15.114:0/1902021517 shutdown_connections 2024-02-17T12:19:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 1 -- 172.21.15.114:0/1902021517 wait complete. 2024-02-17T12:19:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:14.988+0000 7efcd0f91000 20 client.6669 trim_cache size 0 max 16384 2024-02-17T12:19:15.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 Processor -- start 2024-02-17T12:19:15.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 -- start start 2024-02-17T12:19:15.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab516ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 0x55f0ab5173e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3920 0x55f0ab517920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0aafca940 con 0x55f0ab4c26e0 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab2d5a60 con 0x55f0ab4c3000 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab2d28c0 con 0x55f0ab4c3920 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab516ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab516ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40884/0 (socket says 172.21.15.114:40884) 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6a00640 1 -- 172.21.15.114:0/3952639153 learned_addr learned my addr 172.21.15.114:0/3952639153 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc7400640 1 --2- 172.21.15.114:0/3952639153 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3920 0x55f0ab517920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6000640 1 --2- 172.21.15.114:0/3952639153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 0x55f0ab5173e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6a00640 1 -- 172.21.15.114:0/3952639153 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3920 msgr2=0x55f0ab517920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6a00640 1 --2- 172.21.15.114:0/3952639153 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3920 0x55f0ab517920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6a00640 1 -- 172.21.15.114:0/3952639153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 msgr2=0x55f0ab5173e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6a00640 1 --2- 172.21.15.114:0/3952639153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 0x55f0ab5173e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6a00640 1 -- 172.21.15.114:0/3952639153 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ab2b8e10 con 0x55f0ab4c26e0 2024-02-17T12:19:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6000640 1 --2- 172.21.15.114:0/3952639153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 0x55f0ab5173e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcc6a00640 1 --2- 172.21.15.114:0/3952639153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab516ea0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efcb8054a80 tx=0x7efcb805b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59fe4d052519d43 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcb2a00640 1 -- 172.21.15.114:0/3952639153 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb80076a0 con 0x55f0ab4c26e0 2024-02-17T12:19:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcb2a00640 1 -- 172.21.15.114:0/3952639153 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb8052e40 con 0x55f0ab4c26e0 2024-02-17T12:19:15.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcb2a00640 1 -- 172.21.15.114:0/3952639153 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb805cdc0 con 0x55f0ab4c26e0 2024-02-17T12:19:15.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 -- 172.21.15.114:0/3952639153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 msgr2=0x55f0ab516ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:15.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 --2- 172.21.15.114:0/3952639153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab516ea0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7efcb8054a80 tx=0x7efcb805b040 comp rx=0 tx=0).stop 2024-02-17T12:19:15.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 -- 172.21.15.114:0/3952639153 shutdown_connections 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 --2- 172.21.15.114:0/3952639153 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3920 0x55f0ab517920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 --2- 172.21.15.114:0/3952639153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3000 0x55f0ab5173e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 --2- 172.21.15.114:0/3952639153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab516ea0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 -- 172.21.15.114:0/3952639153 >> 172.21.15.114:0/3952639153 conn(0x55f0ab500670 msgr2=0x55f0ab55e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 -- 172.21.15.114:0/3952639153 shutdown_connections 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 -- 172.21.15.114:0/3952639153 wait complete. 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.004+0000 7efcd0f91000 1 -- start start 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 Processor -- start 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab55e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3000 0x55f0ab55eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3920 0x55f0ab55fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab30d2c0 con 0x55f0ab4c26e0 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab30e930 con 0x55f0ab4c3920 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0ab31ae80 con 0x55f0ab4c3000 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 10 client.0 _ll_register_callbacks cb 0x55f0ab2bc010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab55e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab55e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40890/0 (socket says 172.21.15.114:40890) 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6a00640 1 -- 172.21.15.114:0/3127707438 learned_addr learned my addr 172.21.15.114:0/3127707438 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6000640 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3000 0x55f0ab55eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc7400640 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3920 0x55f0ab55fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6a00640 1 -- 172.21.15.114:0/3127707438 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3000 msgr2=0x55f0ab55eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6a00640 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3000 0x55f0ab55eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6a00640 1 -- 172.21.15.114:0/3127707438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3920 msgr2=0x55f0ab55fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6a00640 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3920 0x55f0ab55fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6a00640 1 -- 172.21.15.114:0/3127707438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb8055e70 con 0x55f0ab4c26e0 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6a00640 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab55e990 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7efcb805cd20 tx=0x7efcc00a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0876efb14f3ebf1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efca7e00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efca7e00640 1 -- 172.21.15.114:0/3127707438 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8071070 con 0x55f0ab4c26e0 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efca7e00640 1 -- 172.21.15.114:0/3127707438 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcb80511b0 con 0x55f0ab4c26e0 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 -- 172.21.15.114:0/3127707438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0ab298e80 con 0x55f0ab4c26e0 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efca7e00640 1 -- 172.21.15.114:0/3127707438 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcb8051390 con 0x55f0ab4c26e0 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 10 client.6675 fetch_fsmap learned FSMap version 49 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 -- 172.21.15.114:0/3127707438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55f0ab009cc0 con 0x55f0ab4c26e0 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efca7e00640 1 -- 172.21.15.114:0/3127707438 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0ab298e80 con 0x55f0ab4c26e0 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efca7e00640 1 -- 172.21.15.114:0/3127707438 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efcb805cdc0 con 0x55f0ab4c26e0 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 10 client.6675 fetch_fsmap finished waiting for FSMap version 49 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 10 client.6675 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-17T12:19:15.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 20 client.6675 populate_metadata read hostname 'smithi114' 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.114:6835/709959478,v1:172.21.15.114:6837/709959478] conn(0x55f0ab560500 0x55f0ab5608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 4 client.6675 mds_command: new command op to 6504 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 -- 172.21.15.114:0/3127707438 --> [v2:172.21.15.114:6835/709959478,v1:172.21.15.114:6837/709959478] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f0ab2dbfa0 con 0x55f0ab560500 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6000640 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.114:6835/709959478,v1:172.21.15.114:6837/709959478] conn(0x55f0ab560500 0x55f0ab5608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcc6000640 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.114:6835/709959478,v1:172.21.15.114:6837/709959478] conn(0x55f0ab560500 0x55f0ab5608e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfb6dffdff7e8b43 server_cookie=fdc9d29b232049e9 in_seq=0 out_seq=0 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efca7e00640 10 client.6675 ms_handle_connect on v2:172.21.15.114:6835/709959478 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efca7e00640 1 -- 172.21.15.114:0/3127707438 <== mds.0 v2:172.21.15.114:6835/709959478 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f0ab2dbfa0 con 0x55f0ab560500 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efca7e00640 10 client.6675 handle_command_reply: tid=0 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 client.6675 shutdown 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 -- 172.21.15.114:0/3127707438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 msgr2=0x55f0ab55e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab55e990 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7efcb805cd20 tx=0x7efcc00a7000 comp rx=0 tx=0).stop 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 -- 172.21.15.114:0/3127707438 shutdown_connections 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.114:6835/709959478,v1:172.21.15.114:6837/709959478] conn(0x55f0ab560500 0x55f0ab5608e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0ab4c3920 0x55f0ab55fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x55f0ab4c3000 0x55f0ab55eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 --2- 172.21.15.114:0/3127707438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f0ab4c26e0 0x55f0ab55e990 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efca7e00640 0 client.6675 ms_handle_reset on v2:172.21.15.114:6835/709959478 2024-02-17T12:19:15.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.008+0000 7efcd0f91000 1 -- 172.21.15.114:0/3127707438 >> 172.21.15.114:0/3127707438 conn(0x55f0ab500670 msgr2=0x55f0ab51c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:15.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efcd0f91000 1 -- 172.21.15.114:0/3127707438 shutdown_connections 2024-02-17T12:19:15.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efcd0f91000 1 -- 172.21.15.114:0/3127707438 wait complete. 2024-02-17T12:19:15.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efcd0f91000 20 client.6675 trim_cache size 0 max 16384 2024-02-17T12:19:15.019 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:19:15.019 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "718e3165-e11b-4138-adc9-584dcfeb6e24", 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6504, 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.326287693999999, 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 49, 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 68, 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 68, 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 16.299271843 2024-02-17T12:19:15.020 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:19:15.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 -- 172.21.15.114:0/2889024667 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efca8066e40 msgr2=0x7efca8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:15.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efca8066e40 0x7efca8069300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efcc80c5db0 tx=0x7efcb4008040 comp rx=0 tx=0).stop 2024-02-17T12:19:15.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 -- 172.21.15.114:0/2889024667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 msgr2=0x7efcc8143870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:15.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 0x7efcc8143870 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c450 tx=0x7efcb800c910 comp rx=0 tx=0).stop 2024-02-17T12:19:15.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 -- 172.21.15.114:0/2889024667 shutdown_connections 2024-02-17T12:19:15.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcc814f110 0x7efcc8149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc80c2580 0x7efcc8144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efca8066e40 0x7efca8069300 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 --2- 172.21.15.114:0/2889024667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc80c1eb0 0x7efcc8143870 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 -- 172.21.15.114:0/2889024667 >> 172.21.15.114:0/2889024667 conn(0x7efcc80a8490 msgr2=0x7efcc80a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:15.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 -- 172.21.15.114:0/2889024667 shutdown_connections 2024-02-17T12:19:15.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.012+0000 7efccda00640 1 -- 172.21.15.114:0/2889024667 wait complete. 2024-02-17T12:19:15.033 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:19:15.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4834800640 1 Processor -- start 2024-02-17T12:19:15.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4834800640 1 -- start start 2024-02-17T12:19:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4834800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f482c156840 0x7f482c0aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4834800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f482c0c6720 0x7f482c15ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4834800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c159d20 0x7f482c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4834800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c0c3f20 con 0x7f482c0c6720 2024-02-17T12:19:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4834800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c15a200 con 0x7f482c156840 2024-02-17T12:19:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4834800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0c2ec0 con 0x7f482c159d20 2024-02-17T12:19:15.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4831400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f482c0c6720 0x7f482c15ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4831400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f482c0c6720 0x7f482c15ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47324/0 (socket says 172.21.15.114:47324) 2024-02-17T12:19:15.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4831400640 1 -- 172.21.15.114:0/26221419 learned_addr learned my addr 172.21.15.114:0/26221419 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:15.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4831e00640 1 --2- 172.21.15.114:0/26221419 >> v2:172.21.15.116:3300/0 conn(0x7f482c156840 0x7f482c0aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4832800640 1 --2- 172.21.15.114:0/26221419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c159d20 0x7f482c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4831400640 1 -- 172.21.15.114:0/26221419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c159d20 msgr2=0x7f482c15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4831400640 1 --2- 172.21.15.114:0/26221419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c159d20 0x7f482c15d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4831400640 1 -- 172.21.15.114:0/26221419 >> v2:172.21.15.116:3300/0 conn(0x7f482c156840 msgr2=0x7f482c0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4831400640 1 --2- 172.21.15.114:0/26221419 >> v2:172.21.15.116:3300/0 conn(0x7f482c156840 0x7f482c0aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4831400640 1 -- 172.21.15.114:0/26221419 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c0c31a0 con 0x7f482c0c6720 2024-02-17T12:19:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4831e00640 1 --2- 172.21.15.114:0/26221419 >> v2:172.21.15.116:3300/0 conn(0x7f482c156840 0x7f482c0aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.164+0000 7f4832800640 1 --2- 172.21.15.114:0/26221419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c159d20 0x7f482c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4831400640 1 --2- 172.21.15.114:0/26221419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 0x7f482c15ce80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f482c0ab100 tx=0x7f481c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c65bb8f646356d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4830a00640 1 -- 172.21.15.114:0/26221419 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0ac410 con 0x7f482c0c6720 2024-02-17T12:19:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4830a00640 1 -- 172.21.15.114:0/26221419 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c0ac570 con 0x7f482c0c6720 2024-02-17T12:19:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4830a00640 1 -- 172.21.15.114:0/26221419 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0ac900 con 0x7f482c0c6720 2024-02-17T12:19:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4834800640 1 -- 172.21.15.114:0/26221419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 msgr2=0x7f482c15ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4834800640 1 --2- 172.21.15.114:0/26221419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 0x7f482c15ce80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f482c0ab100 tx=0x7f481c01c3d0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4834800640 1 -- 172.21.15.114:0/26221419 shutdown_connections 2024-02-17T12:19:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4834800640 1 --2- 172.21.15.114:0/26221419 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c159d20 0x7f482c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4834800640 1 --2- 172.21.15.114:0/26221419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 0x7f482c15ce80 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4834800640 1 --2- 172.21.15.114:0/26221419 >> v2:172.21.15.116:3300/0 conn(0x7f482c156840 0x7f482c0aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4834800640 1 -- 172.21.15.114:0/26221419 >> 172.21.15.114:0/26221419 conn(0x7f482c0c4f20 msgr2=0x7f482c0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4834800640 1 -- 172.21.15.114:0/26221419 shutdown_connections 2024-02-17T12:19:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.168+0000 7f4834800640 1 -- 172.21.15.114:0/26221419 wait complete. 2024-02-17T12:19:15.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4834800640 1 Processor -- start 2024-02-17T12:19:15.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4834800640 1 -- start start 2024-02-17T12:19:15.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4834800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 0x7f482c0ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4834800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c156840 0x7f482c1f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4834800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f482c159d20 0x7f482c15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4834800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c1f2bb0 con 0x7f482c0c6720 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4834800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0aba20 con 0x7f482c159d20 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4834800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0ab460 con 0x7f482c156840 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 0x7f482c0ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 0x7f482c0ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47336/0 (socket says 172.21.15.114:47336) 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831e00640 1 -- 172.21.15.114:0/2616223566 learned_addr learned my addr 172.21.15.114:0/2616223566 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4832800640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f482c159d20 0x7f482c15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831400640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c156840 0x7f482c1f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831e00640 1 -- 172.21.15.114:0/2616223566 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c156840 msgr2=0x7f482c1f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831e00640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c156840 0x7f482c1f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831e00640 1 -- 172.21.15.114:0/2616223566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f482c159d20 msgr2=0x7f482c15b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831e00640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f482c159d20 0x7f482c15b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831e00640 1 -- 172.21.15.114:0/2616223566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c0094d0 con 0x7f482c0c6720 2024-02-17T12:19:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4832800640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f482c159d20 0x7f482c15b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831400640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c156840 0x7f482c1f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4831e00640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 0x7f482c0ac4b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f482000c7c0 tx=0x7f482000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4826000640 1 -- 172.21.15.114:0/2616223566 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820007a30 con 0x7f482c0c6720 2024-02-17T12:19:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4826000640 1 -- 172.21.15.114:0/2616223566 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4820007b90 con 0x7f482c0c6720 2024-02-17T12:19:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4826000640 1 -- 172.21.15.114:0/2616223566 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482000ce70 con 0x7f482c0c6720 2024-02-17T12:19:15.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4834800640 1 -- 172.21.15.114:0/2616223566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c0ab740 con 0x7f482c0c6720 2024-02-17T12:19:15.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.172+0000 7f4834800640 1 -- 172.21.15.114:0/2616223566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c0a95f0 con 0x7f482c0c6720 2024-02-17T12:19:15.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.176+0000 7f4834800640 1 -- 172.21.15.114:0/2616223566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c0a97e0 con 0x7f482c0c6720 2024-02-17T12:19:15.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.176+0000 7f4826000640 1 -- 172.21.15.114:0/2616223566 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f48200113f0 con 0x7f482c0c6720 2024-02-17T12:19:15.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.176+0000 7f4826000640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4810066e40 0x7f4810069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:15.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.176+0000 7f4826000640 1 -- 172.21.15.114:0/2616223566 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4820084ea0 con 0x7f482c0c6720 2024-02-17T12:19:15.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.176+0000 7f4831400640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4810066e40 0x7f4810069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:15.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.176+0000 7f4831400640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4810066e40 0x7f4810069300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f481c0ae000 tx=0x7f481c0a6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:15.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.180+0000 7f4826000640 1 -- 172.21.15.114:0/2616223566 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4820051d20 con 0x7f482c0c6720 2024-02-17T12:19:15.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.372+0000 7f4834800640 1 -- 172.21.15.114:0/2616223566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f482c074840 con 0x7f482c0c6720 2024-02-17T12:19:15.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.372+0000 7f4826000640 1 -- 172.21.15.114:0/2616223566 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f48200553e0 con 0x7f482c0c6720 2024-02-17T12:19:15.377 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:19:15.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 -- 172.21.15.114:0/2616223566 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4810066e40 msgr2=0x7f4810069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4810066e40 0x7f4810069300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f481c0ae000 tx=0x7f481c0a6040 comp rx=0 tx=0).stop 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 -- 172.21.15.114:0/2616223566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 msgr2=0x7f482c0ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 0x7f482c0ac4b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f482000c7c0 tx=0x7f482000cc80 comp rx=0 tx=0).stop 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 -- 172.21.15.114:0/2616223566 shutdown_connections 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f482c159d20 0x7f482c15b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f482c156840 0x7f482c1f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4810066e40 0x7f4810069300 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 --2- 172.21.15.114:0/2616223566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f482c0c6720 0x7f482c0ac4b0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 -- 172.21.15.114:0/2616223566 >> 172.21.15.114:0/2616223566 conn(0x7f482c0c4f20 msgr2=0x7f482c0c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 -- 172.21.15.114:0/2616223566 shutdown_connections 2024-02-17T12:19:15.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:15.376+0000 7f4834800640 1 -- 172.21.15.114:0/2616223566 wait complete. 2024-02-17T12:19:15.398 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T12:19:15.398 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:19:15.398 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-02-17T12:19:15.398 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-17T12:19:15.398 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:15.398 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T12:19:15.398 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:19:15.398 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:19:15.398 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:19:15.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:15.399 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-02-17T12:19:15.408 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:19:15.408 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:19:15.408 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:19:15.408 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:15.408 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-02-17T12:19:15.408 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:15.408 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:15.409 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:15.409 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-02-17T12:19:15.409 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:15.409 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:15.409 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-02-17T12:19:15.409 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:15.410 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:15.410 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:19:15.410 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:15.410 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:19:15.410 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42331sec preferred_lft 42331sec 2024-02-17T12:19:15.410 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-02-17T12:19:15.411 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:15.411 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:19:15.411 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:a0:c1:dc:19 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:15.411 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:19:15.411 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:15.411 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:19:15.412 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:15.412 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:19:15.412 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:15.412 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:19:15.412 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:15.412 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:19:15.413 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:19:15.413 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:19:15.413 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:15.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:15.414 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:19:15.471 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-02-17T12:19:15.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:15.473 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-02-17T12:19:15.528 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-02-17T12:19:15.528 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:19:15.529 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:19:15.529 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:19:15.529 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:19:15.529 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:19:15.529 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:15.529 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:15.529 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:15.529 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:19:15.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:15.530 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:19:15.530 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:19:15.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:19:15.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:19:15.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:19:15.530 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:19:15.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:15.621 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-02-17T12:19:15.671 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T12:19:15.671 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:19:15.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:15.672 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-02-17T12:19:15.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:19:15.733 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:15.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:19:15.782 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:15.835 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:19:15.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:15.836 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:19:15.926 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:19:15.926 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:19:15.926 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:19:15.941 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:19:15.941 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:19:15.942 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:19:15.942 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:19:15.942 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:19:15.950 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-17T12:19:15.950 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-17T12:19:15.950 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:19:15.950 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:19:15.950 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:19:15.951 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:19:15.951 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:19:15.951 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:19:15.955 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:19:15.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:15.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:16.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:16.017 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:19:16.073 INFO:teuthology.orchestra.run.smithi114.stdout:client6394 2024-02-17T12:19:16.074 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:16.074 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:16.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:19:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25ff200640 1 Processor -- start 2024-02-17T12:19:16.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25ff200640 1 -- start start 2024-02-17T12:19:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25ff200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 0x7f25f8156b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25ff200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25f8070b60 0x7f25f8072d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25ff200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f25f8152b40 0x7f25f80c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25ff200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f8156730 con 0x7f25f8070b60 2024-02-17T12:19:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25ff200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f8073290 con 0x7f25f8152b40 2024-02-17T12:19:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25ff200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f806e780 con 0x7f25f813be90 2024-02-17T12:19:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25f8070b60 0x7f25f8072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25f8070b60 0x7f25f8072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47350/0 (socket says 172.21.15.114:47350) 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fd400640 1 -- 172.21.15.114:0/4255413233 learned_addr learned my addr 172.21.15.114:0/4255413233 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fde00640 1 --2- 172.21.15.114:0/4255413233 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 0x7f25f8156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fd400640 1 -- 172.21.15.114:0/4255413233 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 msgr2=0x7f25f8156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fe800640 1 --2- 172.21.15.114:0/4255413233 >> v2:172.21.15.116:3300/0 conn(0x7f25f8152b40 0x7f25f80c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fd400640 1 --2- 172.21.15.114:0/4255413233 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 0x7f25f8156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fd400640 1 -- 172.21.15.114:0/4255413233 >> v2:172.21.15.116:3300/0 conn(0x7f25f8152b40 msgr2=0x7f25f80c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fd400640 1 --2- 172.21.15.114:0/4255413233 >> v2:172.21.15.116:3300/0 conn(0x7f25f8152b40 0x7f25f80c3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fd400640 1 -- 172.21.15.114:0/4255413233 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f806ea60 con 0x7f25f8070b60 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fde00640 1 --2- 172.21.15.114:0/4255413233 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 0x7f25f8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.300+0000 7f25fe800640 1 --2- 172.21.15.114:0/4255413233 >> v2:172.21.15.116:3300/0 conn(0x7f25f8152b40 0x7f25f80c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25fd400640 1 --2- 172.21.15.114:0/4255413233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8070b60 0x7f25f8072d50 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f25f806d800 tx=0x7f25e801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfdb7a4ac5352b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25fca00640 1 -- 172.21.15.114:0/4255413233 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80ab600 con 0x7f25f8070b60 2024-02-17T12:19:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25fca00640 1 -- 172.21.15.114:0/4255413233 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e80ab760 con 0x7f25f8070b60 2024-02-17T12:19:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25fca00640 1 -- 172.21.15.114:0/4255413233 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e80abaf0 con 0x7f25f8070b60 2024-02-17T12:19:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25ff200640 1 -- 172.21.15.114:0/4255413233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8070b60 msgr2=0x7f25f8072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25ff200640 1 --2- 172.21.15.114:0/4255413233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8070b60 0x7f25f8072d50 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f25f806d800 tx=0x7f25e801c460 comp rx=0 tx=0).stop 2024-02-17T12:19:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25ff200640 1 -- 172.21.15.114:0/4255413233 shutdown_connections 2024-02-17T12:19:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25ff200640 1 --2- 172.21.15.114:0/4255413233 >> v2:172.21.15.116:3300/0 conn(0x7f25f8152b40 0x7f25f80c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25ff200640 1 --2- 172.21.15.114:0/4255413233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8070b60 0x7f25f8072d50 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25ff200640 1 --2- 172.21.15.114:0/4255413233 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 0x7f25f8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25ff200640 1 -- 172.21.15.114:0/4255413233 >> 172.21.15.114:0/4255413233 conn(0x7f25f80a8660 msgr2=0x7f25f80a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25ff200640 1 -- 172.21.15.114:0/4255413233 shutdown_connections 2024-02-17T12:19:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.304+0000 7f25ff200640 1 -- 172.21.15.114:0/4255413233 wait complete. 2024-02-17T12:19:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 Processor -- start 2024-02-17T12:19:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 -- start start 2024-02-17T12:19:16.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f8070b60 0x7f25f80c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 0x7f25f81336b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8152b40 0x7f25f814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f80c2ac0 con 0x7f25f8152b40 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f81eb380 con 0x7f25f8070b60 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f81eb660 con 0x7f25f813be90 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8152b40 0x7f25f814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8152b40 0x7f25f814eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47360/0 (socket says 172.21.15.114:47360) 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fe800640 1 -- 172.21.15.114:0/431835385 learned_addr learned my addr 172.21.15.114:0/431835385 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fde00640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f8070b60 0x7f25f80c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fd400640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 0x7f25f81336b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fe800640 1 -- 172.21.15.114:0/431835385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 msgr2=0x7f25f81336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fe800640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 0x7f25f81336b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fe800640 1 -- 172.21.15.114:0/431835385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f8070b60 msgr2=0x7f25f80c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fe800640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f8070b60 0x7f25f80c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fe800640 1 -- 172.21.15.114:0/431835385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80094d0 con 0x7f25f8152b40 2024-02-17T12:19:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fde00640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f8070b60 0x7f25f80c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25fe800640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8152b40 0x7f25f814eb50 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f25f400c7f0 tx=0x7f25f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ee000640 1 -- 172.21.15.114:0/431835385 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f4004230 con 0x7f25f8152b40 2024-02-17T12:19:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ee000640 1 -- 172.21.15.114:0/431835385 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f40043b0 con 0x7f25f8152b40 2024-02-17T12:19:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 -- 172.21.15.114:0/431835385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f81eb940 con 0x7f25f8152b40 2024-02-17T12:19:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ee000640 1 -- 172.21.15.114:0/431835385 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f4003860 con 0x7f25f8152b40 2024-02-17T12:19:16.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 -- 172.21.15.114:0/431835385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f81ebf00 con 0x7f25f8152b40 2024-02-17T12:19:16.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.308+0000 7f25ff200640 1 -- 172.21.15.114:0/431835385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f81ec0f0 con 0x7f25f8152b40 2024-02-17T12:19:16.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.312+0000 7f25ee000640 1 -- 172.21.15.114:0/431835385 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f25f4003bd0 con 0x7f25f8152b40 2024-02-17T12:19:16.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.312+0000 7f25ee000640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25dc066e40 0x7f25dc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:16.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.312+0000 7f25ee000640 1 -- 172.21.15.114:0/431835385 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25f4084e30 con 0x7f25f8152b40 2024-02-17T12:19:16.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.312+0000 7f25fde00640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25dc066e40 0x7f25dc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:16.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.312+0000 7f25fde00640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25dc066e40 0x7f25dc069300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f25f0007130 tx=0x7f25f0007670 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.316+0000 7f25ee000640 1 -- 172.21.15.114:0/431835385 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f25f4051c10 con 0x7f25f8152b40 2024-02-17T12:19:16.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.504+0000 7f25ff200640 1 -- 172.21.15.114:0/431835385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f25f804eef0 con 0x7f25f8152b40 2024-02-17T12:19:16.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.504+0000 7f25ee000640 1 -- 172.21.15.114:0/431835385 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f25f4015070 con 0x7f25f8152b40 2024-02-17T12:19:16.510 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:19:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 -- 172.21.15.114:0/431835385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25dc066e40 msgr2=0x7f25dc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25dc066e40 0x7f25dc069300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f25f0007130 tx=0x7f25f0007670 comp rx=0 tx=0).stop 2024-02-17T12:19:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 -- 172.21.15.114:0/431835385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8152b40 msgr2=0x7f25f814eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8152b40 0x7f25f814eb50 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f25f400c7f0 tx=0x7f25f400ccb0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 -- 172.21.15.114:0/431835385 shutdown_connections 2024-02-17T12:19:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f25dc066e40 0x7f25dc069300 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25f8152b40 0x7f25f814eb50 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f25f813be90 0x7f25f81336b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 --2- 172.21.15.114:0/431835385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f8070b60 0x7f25f80c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:16.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 -- 172.21.15.114:0/431835385 >> 172.21.15.114:0/431835385 conn(0x7f25f80a8660 msgr2=0x7f25f81569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:16.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 -- 172.21.15.114:0/431835385 shutdown_connections 2024-02-17T12:19:16.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:16.508+0000 7f25ff200640 1 -- 172.21.15.114:0/431835385 wait complete. 2024-02-17T12:19:16.531 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T12:19:16.531 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:19:16.531 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-17T12:19:16.532 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-17T12:19:16.532 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:16.532 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T12:19:16.532 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:19:16.532 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:19:16.532 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:19:16.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:16.532 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-17T12:19:16.543 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:19:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:19:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:19:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:19:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:19:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42159sec preferred_lft 42159sec 2024-02-17T12:19:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-17T12:19:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:16.545 INFO:teuthology.orchestra.run.smithi116.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:19:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 02:42:58:59:74:79 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:19:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:16.546 INFO:teuthology.orchestra.run.smithi116.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:19:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:19:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:19:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:16.547 INFO:teuthology.orchestra.run.smithi116.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:19:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T12:19:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:19:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:16.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:16.548 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:19:16.608 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-17T12:19:16.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:16.611 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-17T12:19:16.665 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-17T12:19:16.665 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:19:16.665 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:19:16.665 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:19:16.665 INFO:teuthology.orchestra.run.smithi116.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:19:16.665 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:19:16.665 INFO:teuthology.orchestra.run.smithi116.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:16.666 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:16.666 INFO:teuthology.orchestra.run.smithi116.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:16.666 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:19:16.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:16.666 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:19:16.666 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:19:16.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:19:16.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:19:16.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:19:16.666 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:19:16.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:16.758 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-17T12:19:16.767 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-17T12:19:16.767 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:19:16.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:16.768 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-02-17T12:19:16.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:19:16.830 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:16.886 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:19:16.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:19:16.887 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:16.937 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:19:16.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:16.938 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:19:17.028 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:19:17.029 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:19:17.029 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:19:17.044 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:19:17.044 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:19:17.044 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:19:17.045 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:19:17.045 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:19:17.054 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-17T12:19:17.054 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-17T12:19:17.054 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:19:17.054 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:19:17.054 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:19:17.054 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:19:17.054 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:19:17.054 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:19:17.058 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:19:17.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:17.059 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:17.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:17.078 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:19:17.133 INFO:teuthology.orchestra.run.smithi116.stdout:client6400 2024-02-17T12:19:17.133 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:17.133 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:17.186 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-02-17T12:19:17.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.324+0000 7f56d1c00640 1 Processor -- start 2024-02-17T12:19:17.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.324+0000 7f56d1c00640 1 -- start start 2024-02-17T12:19:17.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56d1c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f56cc14e9b0 0x7f56cc0ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56d1c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 0x7f56cc1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56d1c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc0aa150 con 0x7f56cc1517e0 2024-02-17T12:19:17.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56d1c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc14ed90 con 0x7f56cc14e9b0 2024-02-17T12:19:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56d1c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0c1e90 con 0x7f56cc06ef50 2024-02-17T12:19:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56c3e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 0x7f56cc1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56caa00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f56cc14e9b0 0x7f56cc0ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56c3e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 0x7f56cc1512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:53520/0 (socket says 172.21.15.114:53520) 2024-02-17T12:19:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56c3e00640 1 -- 172.21.15.114:0/1599453220 learned_addr learned my addr 172.21.15.114:0/1599453220 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56c3e00640 1 -- 172.21.15.114:0/1599453220 >> v2:172.21.15.116:3300/0 conn(0x7f56cc14e9b0 msgr2=0x7f56cc0ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56ca000640 1 -- 172.21.15.114:0/1599453220 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018325127 0 0) 0x7f56cc0aa150 con 0x7f56cc1517e0 2024-02-17T12:19:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56c3e00640 1 --2- 172.21.15.114:0/1599453220 >> v2:172.21.15.116:3300/0 conn(0x7f56cc14e9b0 0x7f56cc0ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56c3e00640 1 -- 172.21.15.114:0/1599453220 >> v1:172.21.15.116:6789/0 conn(0x7f56cc1517e0 legacy=0x7f56cc06dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56c3e00640 1 -- 172.21.15.114:0/1599453220 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc152000 con 0x7f56cc06ef50 2024-02-17T12:19:17.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.328+0000 7f56c3e00640 1 --2- 172.21.15.114:0/1599453220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 0x7f56cc1512a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f56b4006fd0 tx=0x7f56b401e9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c47f7277846d9717 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:17.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56ca000640 1 -- 172.21.15.114:0/1599453220 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b4004230 con 0x7f56cc06ef50 2024-02-17T12:19:17.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56ca000640 1 -- 172.21.15.114:0/1599453220 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b40ab070 con 0x7f56cc06ef50 2024-02-17T12:19:17.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56ca000640 1 -- 172.21.15.114:0/1599453220 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b40a7750 con 0x7f56cc06ef50 2024-02-17T12:19:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 -- 172.21.15.114:0/1599453220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 msgr2=0x7f56cc1512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 --2- 172.21.15.114:0/1599453220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 0x7f56cc1512a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f56b4006fd0 tx=0x7f56b401e9f0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 -- 172.21.15.114:0/1599453220 shutdown_connections 2024-02-17T12:19:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 --2- 172.21.15.114:0/1599453220 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 0x7f56cc1512a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 --2- 172.21.15.114:0/1599453220 >> v2:172.21.15.116:3300/0 conn(0x7f56cc14e9b0 0x7f56cc0ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 -- 172.21.15.114:0/1599453220 >> 172.21.15.114:0/1599453220 conn(0x7f56cc0a8490 msgr2=0x7f56cc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 -- 172.21.15.114:0/1599453220 shutdown_connections 2024-02-17T12:19:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 -- 172.21.15.114:0/1599453220 wait complete. 2024-02-17T12:19:17.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 Processor -- start 2024-02-17T12:19:17.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 -- start start 2024-02-17T12:19:17.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 0x7f56cc070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56cc14e9b0 0x7f56cc1ede30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56cc1517e0 0x7f56cc0c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc072580 con 0x7f56cc1517e0 2024-02-17T12:19:17.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc071210 con 0x7f56cc14e9b0 2024-02-17T12:19:17.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56d1c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc1ee370 con 0x7f56cc06ef50 2024-02-17T12:19:17.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56cb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56cc1517e0 0x7f56cc0c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56caa00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 0x7f56cc070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56cb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56cc1517e0 0x7f56cc0c27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47372/0 (socket says 172.21.15.114:47372) 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56cb400640 1 -- 172.21.15.114:0/2791521586 learned_addr learned my addr 172.21.15.114:0/2791521586 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.332+0000 7f56c3e00640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56cc14e9b0 0x7f56cc1ede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56cb400640 1 -- 172.21.15.114:0/2791521586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 msgr2=0x7f56cc070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56cb400640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 0x7f56cc070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56cb400640 1 -- 172.21.15.114:0/2791521586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56cc14e9b0 msgr2=0x7f56cc1ede30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56cb400640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56cc14e9b0 0x7f56cc1ede30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56cb400640 1 -- 172.21.15.114:0/2791521586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b400b780 con 0x7f56cc1517e0 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56cb400640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56cc1517e0 0x7f56cc0c27b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f56c400c750 tx=0x7f56c400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56c2a00640 1 -- 172.21.15.114:0/2791521586 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4003db0 con 0x7f56cc1517e0 2024-02-17T12:19:17.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56c2a00640 1 -- 172.21.15.114:0/2791521586 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c400ce60 con 0x7f56cc1517e0 2024-02-17T12:19:17.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56d1c00640 1 -- 172.21.15.114:0/2791521586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc14ca60 con 0x7f56cc1517e0 2024-02-17T12:19:17.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56c2a00640 1 -- 172.21.15.114:0/2791521586 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c40052b0 con 0x7f56cc1517e0 2024-02-17T12:19:17.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56d1c00640 1 -- 172.21.15.114:0/2791521586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc14d270 con 0x7f56cc1517e0 2024-02-17T12:19:17.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56d1c00640 1 -- 172.21.15.114:0/2791521586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc074840 con 0x7f56cc1517e0 2024-02-17T12:19:17.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56c2a00640 1 -- 172.21.15.114:0/2791521586 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f56c4005410 con 0x7f56cc1517e0 2024-02-17T12:19:17.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56c2a00640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56a8066e40 0x7f56a8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56c2a00640 1 -- 172.21.15.114:0/2791521586 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56c4084710 con 0x7f56cc1517e0 2024-02-17T12:19:17.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.336+0000 7f56caa00640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56a8066e40 0x7f56a8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.340+0000 7f56caa00640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56a8066e40 0x7f56a8069300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f56cc14c9f0 tx=0x7f56bc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:17.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.340+0000 7f56c2a00640 1 -- 172.21.15.114:0/2791521586 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f56c40515a0 con 0x7f56cc1517e0 2024-02-17T12:19:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.552+0000 7f56d1c00640 1 -- 172.21.15.114:0/2791521586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f56cc0c0d70 con 0x7f56cc1517e0 2024-02-17T12:19:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.552+0000 7f56c2a00640 1 -- 172.21.15.114:0/2791521586 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v17) v1 ==== 84+0+0 (secure 0 0 0) 0x7f56c4054c60 con 0x7f56cc1517e0 2024-02-17T12:19:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 -- 172.21.15.114:0/2791521586 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56a8066e40 msgr2=0x7f56a8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56a8066e40 0x7f56a8069300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f56cc14c9f0 tx=0x7f56bc009190 comp rx=0 tx=0).stop 2024-02-17T12:19:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 -- 172.21.15.114:0/2791521586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56cc1517e0 msgr2=0x7f56cc0c27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56cc1517e0 0x7f56cc0c27b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f56c400c750 tx=0x7f56c400cc10 comp rx=0 tx=0).stop 2024-02-17T12:19:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 -- 172.21.15.114:0/2791521586 shutdown_connections 2024-02-17T12:19:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f56a8066e40 0x7f56a8069300 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56cc1517e0 0x7f56cc0c27b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f56cc14e9b0 0x7f56cc1ede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 --2- 172.21.15.114:0/2791521586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56cc06ef50 0x7f56cc070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 -- 172.21.15.114:0/2791521586 >> 172.21.15.114:0/2791521586 conn(0x7f56cc0a8490 msgr2=0x7f56cc0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 -- 172.21.15.114:0/2791521586 shutdown_connections 2024-02-17T12:19:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.556+0000 7f56d1c00640 1 -- 172.21.15.114:0/2791521586 wait complete. 2024-02-17T12:19:17.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:17.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd8000640 1 Processor -- start 2024-02-17T12:19:17.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd8000640 1 -- start start 2024-02-17T12:19:17.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd8000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcbd00c1eb0 0x7fcbd015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd8000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd00a9420 con 0x7fcbd00c2580 2024-02-17T12:19:17.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd8000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd0152850 con 0x7fcbd014f110 2024-02-17T12:19:17.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd8000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd014f4f0 con 0x7fcbd00c1eb0 2024-02-17T12:19:17.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd4c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcbd00c2580 0x7fcbd00aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55278/0 (socket says 172.21.15.114:55278) 2024-02-17T12:19:17.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd4c00640 1 -- 172.21.15.114:0/223219103 learned_addr learned my addr 172.21.15.114:0/223219103 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:17.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd6000640 1 --2- 172.21.15.114:0/223219103 >> v2:172.21.15.116:3300/0 conn(0x7fcbd00c1eb0 0x7fcbd015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbcfe00640 1 -- 172.21.15.114:0/223219103 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720861285 0 0) 0x7fcbd00a9420 con 0x7fcbd00c2580 2024-02-17T12:19:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbcfe00640 1 -- 172.21.15.114:0/223219103 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbb8003530 con 0x7fcbd00c2580 2024-02-17T12:19:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbcfe00640 1 -- 172.21.15.114:0/223219103 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112754648 0 0) 0x7fcbd0152850 con 0x7fcbd014f110 2024-02-17T12:19:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbcfe00640 1 -- 172.21.15.114:0/223219103 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd00a9420 con 0x7fcbd014f110 2024-02-17T12:19:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd6000640 1 -- 172.21.15.114:0/223219103 >> v1:172.21.15.116:6789/0 conn(0x7fcbd014f110 legacy=0x7fcbd00c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd6000640 1 -- 172.21.15.114:0/223219103 >> v1:172.21.15.114:6789/0 conn(0x7fcbd00c2580 legacy=0x7fcbd00aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.712+0000 7fcbd6000640 1 -- 172.21.15.114:0/223219103 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd00a9670 con 0x7fcbd00c1eb0 2024-02-17T12:19:17.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbd6000640 1 --2- 172.21.15.114:0/223219103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbd00c1eb0 0x7fcbd015d3a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009d90 tx=0x7fcbc801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e657ef5d94f4800 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:17.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbcfe00640 1 -- 172.21.15.114:0/223219103 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80a5790 con 0x7fcbd00c1eb0 2024-02-17T12:19:17.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbcfe00640 1 -- 172.21.15.114:0/223219103 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc80a58f0 con 0x7fcbd00c1eb0 2024-02-17T12:19:17.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbcfe00640 1 -- 172.21.15.114:0/223219103 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80a5c80 con 0x7fcbd00c1eb0 2024-02-17T12:19:17.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbd8000640 1 -- 172.21.15.114:0/223219103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbd00c1eb0 msgr2=0x7fcbd015d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbd8000640 1 --2- 172.21.15.114:0/223219103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbd00c1eb0 0x7fcbd015d3a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009d90 tx=0x7fcbc801c8e0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbd8000640 1 -- 172.21.15.114:0/223219103 shutdown_connections 2024-02-17T12:19:17.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbd8000640 1 --2- 172.21.15.114:0/223219103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbd00c1eb0 0x7fcbd015d3a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbd8000640 1 -- 172.21.15.114:0/223219103 >> 172.21.15.114:0/223219103 conn(0x7fcbd00a8490 msgr2=0x7fcbd00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:17.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbd8000640 1 -- 172.21.15.114:0/223219103 shutdown_connections 2024-02-17T12:19:17.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.716+0000 7fcbd8000640 1 -- 172.21.15.114:0/223219103 wait complete. 2024-02-17T12:19:17.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 Processor -- start 2024-02-17T12:19:17.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 -- start start 2024-02-17T12:19:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbd00c1eb0 0x7fcbd00c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbd00c2580 0x7fcbd0148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbd014f110 0x7fcbd01ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd01f0da0 con 0x7fcbd014f110 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd01f1080 con 0x7fcbd00c1eb0 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd01f1360 con 0x7fcbd00c2580 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbd014f110 0x7fcbd01ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbd014f110 0x7fcbd01ed890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47376/0 (socket says 172.21.15.114:47376) 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd6000640 1 -- 172.21.15.114:0/3573255595 learned_addr learned my addr 172.21.15.114:0/3573255595 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd4c00640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbd00c2580 0x7fcbd0148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd5600640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbd00c1eb0 0x7fcbd00c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd6000640 1 -- 172.21.15.114:0/3573255595 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbd00c2580 msgr2=0x7fcbd0148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd6000640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbd00c2580 0x7fcbd0148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd6000640 1 -- 172.21.15.114:0/3573255595 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbd00c1eb0 msgr2=0x7fcbd00c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd6000640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbd00c1eb0 0x7fcbd00c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd6000640 1 -- 172.21.15.114:0/3573255595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8009a70 con 0x7fcbd014f110 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd4c00640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbd00c2580 0x7fcbd0148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:17.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd6000640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbd014f110 0x7fcbd01ed890 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcbc801a510 tx=0x7fcbc8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:17.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbcd600640 1 -- 172.21.15.114:0/3573255595 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80b9650 con 0x7fcbd014f110 2024-02-17T12:19:17.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbcd600640 1 -- 172.21.15.114:0/3573255595 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc80b97b0 con 0x7fcbd014f110 2024-02-17T12:19:17.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 -- 172.21.15.114:0/3573255595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd01f1640 con 0x7fcbd014f110 2024-02-17T12:19:17.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbcd600640 1 -- 172.21.15.114:0/3573255595 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80b9b20 con 0x7fcbd014f110 2024-02-17T12:19:17.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 -- 172.21.15.114:0/3573255595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd0155d50 con 0x7fcbd014f110 2024-02-17T12:19:17.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.720+0000 7fcbd8000640 1 -- 172.21.15.114:0/3573255595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd0074840 con 0x7fcbd014f110 2024-02-17T12:19:17.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.724+0000 7fcbcd600640 1 -- 172.21.15.114:0/3573255595 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fcbc80b9c80 con 0x7fcbd014f110 2024-02-17T12:19:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.724+0000 7fcbcd600640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbb0066e40 0x7fcbb0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.724+0000 7fcbcd600640 1 -- 172.21.15.114:0/3573255595 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbc811fa90 con 0x7fcbd014f110 2024-02-17T12:19:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.724+0000 7fcbd5600640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbb0066e40 0x7fcbb0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:17.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.724+0000 7fcbd5600640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbb0066e40 0x7fcbb0069300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40011f0 tx=0x7fcbc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:17.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.728+0000 7fcbcd600640 1 -- 172.21.15.114:0/3573255595 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcbc80ec990 con 0x7fcbd014f110 2024-02-17T12:19:17.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 -- 172.21.15.114:0/3573255595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbd01f1af0 con 0x7fcbd014f110 2024-02-17T12:19:17.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbcd600640 1 -- 172.21.15.114:0/3573255595 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16672 (secure 0 0 0) 0x7fcbc80f0050 con 0x7fcbd014f110 2024-02-17T12:19:17.887 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:17.888 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":68,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:05.697462+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:17.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 -- 172.21.15.114:0/3573255595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbb0066e40 msgr2=0x7fcbb0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbb0066e40 0x7fcbb0069300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40011f0 tx=0x7fcbc4009040 comp rx=0 tx=0).stop 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 -- 172.21.15.114:0/3573255595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbd014f110 msgr2=0x7fcbd01ed890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbd014f110 0x7fcbd01ed890 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcbc801a510 tx=0x7fcbc8019680 comp rx=0 tx=0).stop 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 -- 172.21.15.114:0/3573255595 shutdown_connections 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbb0066e40 0x7fcbb0069300 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbd014f110 0x7fcbd01ed890 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbd00c2580 0x7fcbd0148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 --2- 172.21.15.114:0/3573255595 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbd00c1eb0 0x7fcbd00c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 -- 172.21.15.114:0/3573255595 >> 172.21.15.114:0/3573255595 conn(0x7fcbd00a8490 msgr2=0x7fcbd00aa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 -- 172.21.15.114:0/3573255595 shutdown_connections 2024-02-17T12:19:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:17.884+0000 7fcbd8000640 1 -- 172.21.15.114:0/3573255595 wait complete. 2024-02-17T12:19:17.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:19:01.796651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:19:03.070707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:19:17.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:19:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc09000640 1 Processor -- start 2024-02-17T12:19:18.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc09000640 1 -- start start 2024-02-17T12:19:18.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc09000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcc04152510 0x7fcc040c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc09000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcc0406ef60 0x7fcc04158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc09000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc040c0640 0x7fcc04158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc09000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc040c2670 con 0x7fcc04152510 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc09000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0406e890 con 0x7fcc0406ef60 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc09000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc04158370 con 0x7fcc040c0640 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc01e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcc04152510 0x7fcc040c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc01e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcc04152510 0x7fcc040c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47392/0 (socket says 172.21.15.114:47392) 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc01e00640 1 -- 172.21.15.114:0/1342462764 learned_addr learned my addr 172.21.15.114:0/1342462764 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc01400640 1 --2- 172.21.15.114:0/1342462764 >> v2:172.21.15.116:3300/0 conn(0x7fcc0406ef60 0x7fcc04158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc02800640 1 --2- 172.21.15.114:0/1342462764 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc040c0640 0x7fcc04158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc01e00640 1 -- 172.21.15.114:0/1342462764 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc040c0640 msgr2=0x7fcc04158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc01e00640 1 --2- 172.21.15.114:0/1342462764 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc040c0640 0x7fcc04158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc01e00640 1 -- 172.21.15.114:0/1342462764 >> v2:172.21.15.116:3300/0 conn(0x7fcc0406ef60 msgr2=0x7fcc04158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc01e00640 1 --2- 172.21.15.114:0/1342462764 >> v2:172.21.15.116:3300/0 conn(0x7fcc0406ef60 0x7fcc04158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.044+0000 7fcc01e00640 1 -- 172.21.15.114:0/1342462764 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc04159280 con 0x7fcc04152510 2024-02-17T12:19:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc01e00640 1 --2- 172.21.15.114:0/1342462764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 0x7fcc040c65a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fcc0406ced0 tx=0x7fcbf401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d0561212447355 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc00a00640 1 -- 172.21.15.114:0/1342462764 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40ab600 con 0x7fcc04152510 2024-02-17T12:19:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc00a00640 1 -- 172.21.15.114:0/1342462764 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf40ab760 con 0x7fcc04152510 2024-02-17T12:19:18.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc00a00640 1 -- 172.21.15.114:0/1342462764 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40abaf0 con 0x7fcc04152510 2024-02-17T12:19:18.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 -- 172.21.15.114:0/1342462764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 msgr2=0x7fcc040c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 --2- 172.21.15.114:0/1342462764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 0x7fcc040c65a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fcc0406ced0 tx=0x7fcbf401c440 comp rx=0 tx=0).stop 2024-02-17T12:19:18.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 -- 172.21.15.114:0/1342462764 shutdown_connections 2024-02-17T12:19:18.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 --2- 172.21.15.114:0/1342462764 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc040c0640 0x7fcc04158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 --2- 172.21.15.114:0/1342462764 >> v2:172.21.15.116:3300/0 conn(0x7fcc0406ef60 0x7fcc04158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 --2- 172.21.15.114:0/1342462764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 0x7fcc040c65a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 -- 172.21.15.114:0/1342462764 >> 172.21.15.114:0/1342462764 conn(0x7fcc040a8490 msgr2=0x7fcc040a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:18.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 -- 172.21.15.114:0/1342462764 shutdown_connections 2024-02-17T12:19:18.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 -- 172.21.15.114:0/1342462764 wait complete. 2024-02-17T12:19:18.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 Processor -- start 2024-02-17T12:19:18.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.048+0000 7fcc09000640 1 -- start start 2024-02-17T12:19:18.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc09000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc0406ef60 0x7fcc040713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc09000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc040c0640 0x7fcc04151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc09000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 0x7fcc0414a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc09000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0414af80 con 0x7fcc04152510 2024-02-17T12:19:18.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc09000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0414c610 con 0x7fcc0406ef60 2024-02-17T12:19:18.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc09000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc041516c0 con 0x7fcc040c0640 2024-02-17T12:19:18.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc02800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 0x7fcc0414a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc02800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 0x7fcc0414a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47398/0 (socket says 172.21.15.114:47398) 2024-02-17T12:19:18.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc02800640 1 -- 172.21.15.114:0/4279881277 learned_addr learned my addr 172.21.15.114:0/4279881277 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:18.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc01400640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc040c0640 0x7fcc04151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc01e00640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc0406ef60 0x7fcc040713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc02800640 1 -- 172.21.15.114:0/4279881277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc040c0640 msgr2=0x7fcc04151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc02800640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc040c0640 0x7fcc04151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc02800640 1 -- 172.21.15.114:0/4279881277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc0406ef60 msgr2=0x7fcc040713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc02800640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc0406ef60 0x7fcc040713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc02800640 1 -- 172.21.15.114:0/4279881277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf40094d0 con 0x7fcc04152510 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc01e00640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc0406ef60 0x7fcc040713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc02800640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 0x7fcc0414a440 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc007e40 tx=0x7fcbfc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcbfa000640 1 -- 172.21.15.114:0/4279881277 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc014620 con 0x7fcc04152510 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcbfa000640 1 -- 172.21.15.114:0/4279881277 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc00ee90 con 0x7fcc04152510 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcbfa000640 1 -- 172.21.15.114:0/4279881277 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0149e0 con 0x7fcc04152510 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc09000640 1 -- 172.21.15.114:0/4279881277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0414c070 con 0x7fcc04152510 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc09000640 1 -- 172.21.15.114:0/4279881277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc040ab5f0 con 0x7fcc04152510 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcc09000640 1 -- 172.21.15.114:0/4279881277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc040ab450 con 0x7fcc04152510 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.052+0000 7fcbfa000640 1 -- 172.21.15.114:0/4279881277 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fcbfc014b40 con 0x7fcc04152510 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.056+0000 7fcbfa000640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbe4066e40 0x7fcbe4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.056+0000 7fcbfa000640 1 -- 172.21.15.114:0/4279881277 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbfc085450 con 0x7fcc04152510 2024-02-17T12:19:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.056+0000 7fcc01e00640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbe4066e40 0x7fcbe4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.056+0000 7fcc01e00640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbe4066e40 0x7fcbe4069300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40af000 tx=0x7fcbf4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:18.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.060+0000 7fcbfa000640 1 -- 172.21.15.114:0/4279881277 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcc040ab450 con 0x7fcc04152510 2024-02-17T12:19:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.212+0000 7fcc09000640 1 -- 172.21.15.114:0/4279881277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc041f5b10 con 0x7fcc04152510 2024-02-17T12:19:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.212+0000 7fcbfa000640 1 -- 172.21.15.114:0/4279881277 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc041f5b10 con 0x7fcc04152510 2024-02-17T12:19:18.217 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:19:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 -- 172.21.15.114:0/4279881277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbe4066e40 msgr2=0x7fcbe4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbe4066e40 0x7fcbe4069300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40af000 tx=0x7fcbf4008040 comp rx=0 tx=0).stop 2024-02-17T12:19:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 -- 172.21.15.114:0/4279881277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 msgr2=0x7fcc0414a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 0x7fcc0414a440 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc007e40 tx=0x7fcbfc00e4b0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 -- 172.21.15.114:0/4279881277 shutdown_connections 2024-02-17T12:19:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcbe4066e40 0x7fcbe4069300 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc04152510 0x7fcc0414a440 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc040c0640 0x7fcc04151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 --2- 172.21.15.114:0/4279881277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc0406ef60 0x7fcc040713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 -- 172.21.15.114:0/4279881277 >> 172.21.15.114:0/4279881277 conn(0x7fcc040a8490 msgr2=0x7fcc041534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 -- 172.21.15.114:0/4279881277 shutdown_connections 2024-02-17T12:19:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.216+0000 7fcc09000640 1 -- 172.21.15.114:0/4279881277 wait complete. 2024-02-17T12:19:18.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:19:18.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd33000640 1 Processor -- start 2024-02-17T12:19:18.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd33000640 1 -- start start 2024-02-17T12:19:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd33000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd2c0c25a0 0x7fbd2c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd33000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbd2c152c50 0x7fbd2c153070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd33000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c156270 con 0x7fbd2c06db50 2024-02-17T12:19:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd33000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c071630 con 0x7fbd2c0c25a0 2024-02-17T12:19:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd33000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c156550 con 0x7fbd2c152c50 2024-02-17T12:19:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd2be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd2c0c25a0 0x7fbd2c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd2be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd2c0c25a0 0x7fbd2c06e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47414/0 (socket says 172.21.15.114:47414) 2024-02-17T12:19:18.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd2be00640 1 -- 172.21.15.114:0/4004871065 learned_addr learned my addr 172.21.15.114:0/4004871065 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:18.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd31000640 1 --2- 172.21.15.114:0/4004871065 >> v2:172.21.15.116:3300/0 conn(0x7fbd2c152c50 0x7fbd2c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd2be00640 1 -- 172.21.15.114:0/4004871065 >> v2:172.21.15.116:3300/0 conn(0x7fbd2c152c50 msgr2=0x7fbd2c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:18.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd2be00640 1 --2- 172.21.15.114:0/4004871065 >> v2:172.21.15.116:3300/0 conn(0x7fbd2c152c50 0x7fbd2c153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd2be00640 1 -- 172.21.15.114:0/4004871065 >> v1:172.21.15.116:6789/0 conn(0x7fbd2c06db50 legacy=0x7fbd2c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:18.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd2be00640 1 -- 172.21.15.114:0/4004871065 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c156830 con 0x7fbd2c0c25a0 2024-02-17T12:19:18.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.372+0000 7fbd31000640 1 --2- 172.21.15.114:0/4004871065 >> v2:172.21.15.116:3300/0 conn(0x7fbd2c152c50 0x7fbd2c153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:18.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd2be00640 1 --2- 172.21.15.114:0/4004871065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c0c25a0 0x7fbd2c06e980 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c153cb0 tx=0x7fbd1c01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770e61f7c64bfc0e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd2aa00640 1 -- 172.21.15.114:0/4004871065 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0a5630 con 0x7fbd2c0c25a0 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd2aa00640 1 -- 172.21.15.114:0/4004871065 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c0a5790 con 0x7fbd2c0c25a0 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd2aa00640 1 -- 172.21.15.114:0/4004871065 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0a5b20 con 0x7fbd2c0c25a0 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd33000640 1 -- 172.21.15.114:0/4004871065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c0c25a0 msgr2=0x7fbd2c06e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd33000640 1 --2- 172.21.15.114:0/4004871065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c0c25a0 0x7fbd2c06e980 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c153cb0 tx=0x7fbd1c01c860 comp rx=0 tx=0).stop 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd33000640 1 -- 172.21.15.114:0/4004871065 shutdown_connections 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd33000640 1 --2- 172.21.15.114:0/4004871065 >> v2:172.21.15.116:3300/0 conn(0x7fbd2c152c50 0x7fbd2c153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd33000640 1 --2- 172.21.15.114:0/4004871065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c0c25a0 0x7fbd2c06e980 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd33000640 1 -- 172.21.15.114:0/4004871065 >> 172.21.15.114:0/4004871065 conn(0x7fbd2c0a8490 msgr2=0x7fbd2c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd33000640 1 -- 172.21.15.114:0/4004871065 shutdown_connections 2024-02-17T12:19:18.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.376+0000 7fbd33000640 1 -- 172.21.15.114:0/4004871065 wait complete. 2024-02-17T12:19:18.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 Processor -- start 2024-02-17T12:19:18.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 -- start start 2024-02-17T12:19:18.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c06db50 0x7fbd2c148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd2c0c25a0 0x7fbd2c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd2c152c50 0x7fbd2c143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c153e60 con 0x7fbd2c06db50 2024-02-17T12:19:18.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c148ea0 con 0x7fbd2c152c50 2024-02-17T12:19:18.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c155f30 con 0x7fbd2c0c25a0 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd2be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c06db50 0x7fbd2c148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd2be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c06db50 0x7fbd2c148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47428/0 (socket says 172.21.15.114:47428) 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd2be00640 1 -- 172.21.15.114:0/1637695371 learned_addr learned my addr 172.21.15.114:0/1637695371 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd2be00640 1 -- 172.21.15.114:0/1637695371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd2c0c25a0 msgr2=0x7fbd2c1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd2be00640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd2c0c25a0 0x7fbd2c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd31000640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd2c152c50 0x7fbd2c143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd2be00640 1 -- 172.21.15.114:0/1637695371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd2c152c50 msgr2=0x7fbd2c143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd2be00640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd2c152c50 0x7fbd2c143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd2be00640 1 -- 172.21.15.114:0/1637695371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c009b30 con 0x7fbd2c06db50 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd31000640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd2c152c50 0x7fbd2c143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:18.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd2be00640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c06db50 0x7fbd2c148960 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c01af10 tx=0x7fbd1c019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:18.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd23e00640 1 -- 172.21.15.114:0/1637695371 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0b8670 con 0x7fbd2c06db50 2024-02-17T12:19:18.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd23e00640 1 -- 172.21.15.114:0/1637695371 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c0b87d0 con 0x7fbd2c06db50 2024-02-17T12:19:18.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 -- 172.21.15.114:0/1637695371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c1eddd0 con 0x7fbd2c06db50 2024-02-17T12:19:18.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd23e00640 1 -- 172.21.15.114:0/1637695371 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0b8b60 con 0x7fbd2c06db50 2024-02-17T12:19:18.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 -- 172.21.15.114:0/1637695371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c1414a0 con 0x7fbd2c06db50 2024-02-17T12:19:18.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.380+0000 7fbd33000640 1 -- 172.21.15.114:0/1637695371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c074840 con 0x7fbd2c06db50 2024-02-17T12:19:18.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.384+0000 7fbd23e00640 1 -- 172.21.15.114:0/1637695371 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbd1c0b8cc0 con 0x7fbd2c06db50 2024-02-17T12:19:18.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.384+0000 7fbd23e00640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd0c066e70 0x7fbd0c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.384+0000 7fbd23e00640 1 -- 172.21.15.114:0/1637695371 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd1c11fe60 con 0x7fbd2c06db50 2024-02-17T12:19:18.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.384+0000 7fbd2b400640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd0c066e70 0x7fbd0c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.384+0000 7fbd2b400640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd0c066e70 0x7fbd0c069330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbd18007fd0 tx=0x7fbd180079a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:18.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.388+0000 7fbd23e00640 1 -- 172.21.15.114:0/1637695371 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbd1c0ecd60 con 0x7fbd2c06db50 2024-02-17T12:19:18.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.540+0000 7fbd33000640 1 -- 172.21.15.114:0/1637695371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd2c0a8bf0 con 0x7fbd2c06db50 2024-02-17T12:19:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.540+0000 7fbd23e00640 1 -- 172.21.15.114:0/1637695371 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd1c0f0420 con 0x7fbd2c06db50 2024-02-17T12:19:18.545 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 -- 172.21.15.114:0/1637695371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd0c066e70 msgr2=0x7fbd0c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd0c066e70 0x7fbd0c069330 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbd18007fd0 tx=0x7fbd180079a0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 -- 172.21.15.114:0/1637695371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c06db50 msgr2=0x7fbd2c148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c06db50 0x7fbd2c148960 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c01af10 tx=0x7fbd1c019600 comp rx=0 tx=0).stop 2024-02-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 -- 172.21.15.114:0/1637695371 shutdown_connections 2024-02-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd2c152c50 0x7fbd2c143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd2c0c25a0 0x7fbd2c1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd0c066e70 0x7fbd0c069330 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 --2- 172.21.15.114:0/1637695371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd2c06db50 0x7fbd2c148960 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 -- 172.21.15.114:0/1637695371 >> 172.21.15.114:0/1637695371 conn(0x7fbd2c0a8490 msgr2=0x7fbd2c072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:18.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 -- 172.21.15.114:0/1637695371 shutdown_connections 2024-02-17T12:19:18.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.544+0000 7fbd33000640 1 -- 172.21.15.114:0/1637695371 wait complete. 2024-02-17T12:19:18.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:19:18.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8807800640 1 Processor -- start 2024-02-17T12:19:18.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8807800640 1 -- start start 2024-02-17T12:19:18.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8807800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f880006db50 0x7f880014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8807800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8800150490 0x7f8800152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8807800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8800156270 con 0x7f88000c25a0 2024-02-17T12:19:18.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8807800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880006f090 con 0x7f8800150490 2024-02-17T12:19:18.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8807800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8800071630 con 0x7f880006db50 2024-02-17T12:19:18.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8804e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f88000c25a0 0x7f880006e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55280/0 (socket says 172.21.15.114:55280) 2024-02-17T12:19:18.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8804e00640 1 -- 172.21.15.114:0/2690664400 learned_addr learned my addr 172.21.15.114:0/2690664400 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:18.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8805800640 1 --2- 172.21.15.114:0/2690664400 >> v2:172.21.15.116:3300/0 conn(0x7f8800150490 0x7f8800152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f87ffe00640 1 --2- 172.21.15.114:0/2690664400 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f880006db50 0x7f880014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f87ff400640 1 -- 172.21.15.114:0/2690664400 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682861915 0 0) 0x7f8800156270 con 0x7f88000c25a0 2024-02-17T12:19:18.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f87ff400640 1 -- 172.21.15.114:0/2690664400 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e4003530 con 0x7f88000c25a0 2024-02-17T12:19:18.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8805800640 1 -- 172.21.15.114:0/2690664400 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f880006db50 msgr2=0x7f880014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:18.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8805800640 1 --2- 172.21.15.114:0/2690664400 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f880006db50 0x7f880014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f87ff400640 1 -- 172.21.15.114:0/2690664400 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1585476376 0 0) 0x7f87e4003530 con 0x7f88000c25a0 2024-02-17T12:19:18.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8805800640 1 -- 172.21.15.114:0/2690664400 >> v1:172.21.15.114:6789/0 conn(0x7f88000c25a0 legacy=0x7f880006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.700+0000 7f8805800640 1 -- 172.21.15.114:0/2690664400 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800156550 con 0x7f8800150490 2024-02-17T12:19:18.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f8805800640 1 --2- 172.21.15.114:0/2690664400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8800150490 0x7f8800152c50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097c0 tx=0x7f87f801c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bfcc0e5cdc78df9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:18.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f87ff400640 1 -- 172.21.15.114:0/2690664400 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88001539a0 con 0x7f8800150490 2024-02-17T12:19:18.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f87ff400640 1 -- 172.21.15.114:0/2690664400 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f80a7050 con 0x7f8800150490 2024-02-17T12:19:18.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f87ff400640 1 -- 172.21.15.114:0/2690664400 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0001a00 con 0x7f8800150490 2024-02-17T12:19:18.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f8807800640 1 -- 172.21.15.114:0/2690664400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8800150490 msgr2=0x7f8800152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f8807800640 1 --2- 172.21.15.114:0/2690664400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8800150490 0x7f8800152c50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097c0 tx=0x7f87f801c270 comp rx=0 tx=0).stop 2024-02-17T12:19:18.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f8807800640 1 -- 172.21.15.114:0/2690664400 shutdown_connections 2024-02-17T12:19:18.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f8807800640 1 --2- 172.21.15.114:0/2690664400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8800150490 0x7f8800152c50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f8807800640 1 --2- 172.21.15.114:0/2690664400 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f880006db50 0x7f880014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f8807800640 1 -- 172.21.15.114:0/2690664400 >> 172.21.15.114:0/2690664400 conn(0x7f88000a8490 msgr2=0x7f88000a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:18.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f8807800640 1 -- 172.21.15.114:0/2690664400 shutdown_connections 2024-02-17T12:19:18.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.704+0000 7f8807800640 1 -- 172.21.15.114:0/2690664400 wait complete. 2024-02-17T12:19:18.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 Processor -- start 2024-02-17T12:19:18.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 -- start start 2024-02-17T12:19:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f880006db50 0x7f8800141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88000c25a0 0x7f8800155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8800150490 0x7f88001f0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88001f0690 con 0x7f88000c25a0 2024-02-17T12:19:18.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8800142910 con 0x7f8800150490 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8800142350 con 0x7f880006db50 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88000c25a0 0x7f8800155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88000c25a0 0x7f8800155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47438/0 (socket says 172.21.15.114:47438) 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87ffe00640 1 -- 172.21.15.114:0/2940968374 learned_addr learned my addr 172.21.15.114:0/2940968374 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8804e00640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f880006db50 0x7f8800141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8805800640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8800150490 0x7f88001f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87ffe00640 1 -- 172.21.15.114:0/2940968374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f880006db50 msgr2=0x7f8800141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87ffe00640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f880006db50 0x7f8800141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87ffe00640 1 -- 172.21.15.114:0/2940968374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8800150490 msgr2=0x7f88001f0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87ffe00640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8800150490 0x7f88001f0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87ffe00640 1 -- 172.21.15.114:0/2940968374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8009420 con 0x7f88000c25a0 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87ffe00640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88000c25a0 0x7f8800155b80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00e960 tx=0x7f87ec00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:18.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87fcc00640 1 -- 172.21.15.114:0/2940968374 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec009690 con 0x7f88000c25a0 2024-02-17T12:19:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87fcc00640 1 -- 172.21.15.114:0/2940968374 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec00ca00 con 0x7f88000c25a0 2024-02-17T12:19:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f87fcc00640 1 -- 172.21.15.114:0/2940968374 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec00cd70 con 0x7f88000c25a0 2024-02-17T12:19:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 -- 172.21.15.114:0/2940968374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8800142630 con 0x7f88000c25a0 2024-02-17T12:19:18.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 -- 172.21.15.114:0/2940968374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88001ecfc0 con 0x7f88000c25a0 2024-02-17T12:19:18.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.708+0000 7f8807800640 1 -- 172.21.15.114:0/2940968374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8800074840 con 0x7f88000c25a0 2024-02-17T12:19:18.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.712+0000 7f87fcc00640 1 -- 172.21.15.114:0/2940968374 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f87ec013470 con 0x7f88000c25a0 2024-02-17T12:19:18.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.712+0000 7f87fcc00640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87e0066e40 0x7f87e0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:18.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.712+0000 7f87fcc00640 1 -- 172.21.15.114:0/2940968374 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87ec084c10 con 0x7f88000c25a0 2024-02-17T12:19:18.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.712+0000 7f8804e00640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87e0066e40 0x7f87e0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:18.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.712+0000 7f8804e00640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87e0066e40 0x7f87e0069300 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87f000f440 tx=0x7f87f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.716+0000 7f87fcc00640 1 -- 172.21.15.114:0/2940968374 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f87ec051aa0 con 0x7f88000c25a0 2024-02-17T12:19:18.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.868+0000 7f8807800640 1 -- 172.21.15.114:0/2940968374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88000a8a50 con 0x7f88000c25a0 2024-02-17T12:19:18.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.868+0000 7f87fcc00640 1 -- 172.21.15.114:0/2940968374 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87ec0170a0 con 0x7f88000c25a0 2024-02-17T12:19:18.872 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:18.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.868+0000 7f8807800640 1 -- 172.21.15.114:0/2940968374 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87e0066e40 msgr2=0x7f87e0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.868+0000 7f8807800640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87e0066e40 0x7f87e0069300 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87f000f440 tx=0x7f87f0009040 comp rx=0 tx=0).stop 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.872+0000 7f8807800640 1 -- 172.21.15.114:0/2940968374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88000c25a0 msgr2=0x7f8800155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.872+0000 7f8807800640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88000c25a0 0x7f8800155b80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00e960 tx=0x7f87ec00ee20 comp rx=0 tx=0).stop 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.872+0000 7f8807800640 1 -- 172.21.15.114:0/2940968374 shutdown_connections 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.872+0000 7f8807800640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8800150490 0x7f88001f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.872+0000 7f8807800640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f87e0066e40 0x7f87e0069300 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.872+0000 7f8807800640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88000c25a0 0x7f8800155b80 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.872+0000 7f8807800640 1 --2- 172.21.15.114:0/2940968374 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f880006db50 0x7f8800141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.872+0000 7f8807800640 1 -- 172.21.15.114:0/2940968374 >> 172.21.15.114:0/2940968374 conn(0x7f88000a8490 msgr2=0x7f8800072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.872+0000 7f8807800640 1 -- 172.21.15.114:0/2940968374 shutdown_connections 2024-02-17T12:19:18.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:18.872+0000 7f8807800640 1 -- 172.21.15.114:0/2940968374 wait complete. 2024-02-17T12:19:18.894 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-17T12:19:19.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d88800640 1 Processor -- start 2024-02-17T12:19:19.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d88800640 1 -- start start 2024-02-17T12:19:19.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d88800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 0x7f4d800c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d88800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d800c2580 0x7f4d800aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d88800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4d800c1eb0 0x7f4d80155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d88800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8014f4f0 con 0x7f4d800c2580 2024-02-17T12:19:19.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d88800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800aae80 con 0x7f4d800c1eb0 2024-02-17T12:19:19.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d88800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800a9420 con 0x7f4d8014f110 2024-02-17T12:19:19.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d85400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d800c2580 0x7f4d800aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d85400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4d800c2580 0x7f4d800aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47452/0 (socket says 172.21.15.114:47452) 2024-02-17T12:19:19.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d85400640 1 -- 172.21.15.114:0/1003615322 learned_addr learned my addr 172.21.15.114:0/1003615322 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:19.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d85e00640 1 --2- 172.21.15.114:0/1003615322 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 0x7f4d800c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d86800640 1 --2- 172.21.15.114:0/1003615322 >> v2:172.21.15.116:3300/0 conn(0x7f4d800c1eb0 0x7f4d80155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d85400640 1 -- 172.21.15.114:0/1003615322 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 msgr2=0x7f4d800c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:19.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d85400640 1 --2- 172.21.15.114:0/1003615322 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 0x7f4d800c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d85400640 1 -- 172.21.15.114:0/1003615322 >> v2:172.21.15.116:3300/0 conn(0x7f4d800c1eb0 msgr2=0x7f4d80155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:19.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d85400640 1 --2- 172.21.15.114:0/1003615322 >> v2:172.21.15.116:3300/0 conn(0x7f4d800c1eb0 0x7f4d80155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d85400640 1 -- 172.21.15.114:0/1003615322 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d80152850 con 0x7f4d800c2580 2024-02-17T12:19:19.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d85e00640 1 --2- 172.21.15.114:0/1003615322 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 0x7f4d800c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:19.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.024+0000 7f4d86800640 1 --2- 172.21.15.114:0/1003615322 >> v2:172.21.15.116:3300/0 conn(0x7f4d800c1eb0 0x7f4d80155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:19.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d85400640 1 --2- 172.21.15.114:0/1003615322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c2580 0x7f4d800aa150 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4d800c1090 tx=0x7f4d7001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882d55578fc8c905 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:19.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d84a00640 1 -- 172.21.15.114:0/1003615322 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700ab620 con 0x7f4d800c2580 2024-02-17T12:19:19.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d84a00640 1 -- 172.21.15.114:0/1003615322 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d700ab780 con 0x7f4d800c2580 2024-02-17T12:19:19.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d84a00640 1 -- 172.21.15.114:0/1003615322 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700abb10 con 0x7f4d800c2580 2024-02-17T12:19:19.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d88800640 1 -- 172.21.15.114:0/1003615322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c2580 msgr2=0x7f4d800aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:19.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d88800640 1 --2- 172.21.15.114:0/1003615322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c2580 0x7f4d800aa150 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4d800c1090 tx=0x7f4d7001c460 comp rx=0 tx=0).stop 2024-02-17T12:19:19.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d88800640 1 -- 172.21.15.114:0/1003615322 shutdown_connections 2024-02-17T12:19:19.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d88800640 1 --2- 172.21.15.114:0/1003615322 >> v2:172.21.15.116:3300/0 conn(0x7f4d800c1eb0 0x7f4d80155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d88800640 1 --2- 172.21.15.114:0/1003615322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c2580 0x7f4d800aa150 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d88800640 1 --2- 172.21.15.114:0/1003615322 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 0x7f4d800c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d88800640 1 -- 172.21.15.114:0/1003615322 >> 172.21.15.114:0/1003615322 conn(0x7f4d800a8490 msgr2=0x7f4d800a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:19.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d88800640 1 -- 172.21.15.114:0/1003615322 shutdown_connections 2024-02-17T12:19:19.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.028+0000 7f4d88800640 1 -- 172.21.15.114:0/1003615322 wait complete. 2024-02-17T12:19:19.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d88800640 1 Processor -- start 2024-02-17T12:19:19.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d88800640 1 -- start start 2024-02-17T12:19:19.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d88800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c1eb0 0x7f4d8015a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d88800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d800c2580 0x7f4d80141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d88800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 0x7f4d80141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d88800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801ed930 con 0x7f4d800c1eb0 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d88800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801edc10 con 0x7f4d800c2580 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d88800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801edef0 con 0x7f4d8014f110 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d85e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c1eb0 0x7f4d8015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d85e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c1eb0 0x7f4d8015a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47466/0 (socket says 172.21.15.114:47466) 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d85e00640 1 -- 172.21.15.114:0/4164473571 learned_addr learned my addr 172.21.15.114:0/4164473571 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d85400640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d800c2580 0x7f4d80141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d86800640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 0x7f4d80141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d85e00640 1 -- 172.21.15.114:0/4164473571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 msgr2=0x7f4d80141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d85e00640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 0x7f4d80141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d85e00640 1 -- 172.21.15.114:0/4164473571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d800c2580 msgr2=0x7f4d80141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d85e00640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d800c2580 0x7f4d80141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d85e00640 1 -- 172.21.15.114:0/4164473571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700094d0 con 0x7f4d800c1eb0 2024-02-17T12:19:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d86800640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 0x7f4d80141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d85e00640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c1eb0 0x7f4d8015a770 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400c7c0 tx=0x7f4d7400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d7a000640 1 -- 172.21.15.114:0/4164473571 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74007a30 con 0x7f4d800c1eb0 2024-02-17T12:19:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d7a000640 1 -- 172.21.15.114:0/4164473571 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d74007b90 con 0x7f4d800c1eb0 2024-02-17T12:19:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d7a000640 1 -- 172.21.15.114:0/4164473571 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400ce70 con 0x7f4d800c1eb0 2024-02-17T12:19:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d88800640 1 -- 172.21.15.114:0/4164473571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d801ee1d0 con 0x7f4d800c1eb0 2024-02-17T12:19:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.032+0000 7f4d88800640 1 -- 172.21.15.114:0/4164473571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d800c67f0 con 0x7f4d800c1eb0 2024-02-17T12:19:19.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.036+0000 7f4d88800640 1 -- 172.21.15.114:0/4164473571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d80074840 con 0x7f4d800c1eb0 2024-02-17T12:19:19.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.036+0000 7f4d7a000640 1 -- 172.21.15.114:0/4164473571 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4d740113f0 con 0x7f4d800c1eb0 2024-02-17T12:19:19.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.036+0000 7f4d7a000640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d64066e40 0x7f4d64069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.036+0000 7f4d7a000640 1 -- 172.21.15.114:0/4164473571 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d74084e90 con 0x7f4d800c1eb0 2024-02-17T12:19:19.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.036+0000 7f4d85400640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d64066e40 0x7f4d64069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.036+0000 7f4d85400640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d64066e40 0x7f4d64069300 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4d700af000 tx=0x7f4d700b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:19.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.040+0000 7f4d7a000640 1 -- 172.21.15.114:0/4164473571 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4d74051d20 con 0x7f4d800c1eb0 2024-02-17T12:19:19.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 -- 172.21.15.114:0/4164473571 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4d801ee680 con 0x7f4d800c1eb0 2024-02-17T12:19:19.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d7a000640 1 -- 172.21.15.114:0/4164473571 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+209 (secure 0 0 0) 0x7f4d740553e0 con 0x7f4d800c1eb0 2024-02-17T12:19:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:19.200 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-02-17T12:19:19.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 12, 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "cephfs_metadata" 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 13, 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "cephfs_data" 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-02-17T12:19:19.201 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-02-17T12:19:19.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 -- 172.21.15.114:0/4164473571 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d64066e40 msgr2=0x7f4d64069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:19.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d64066e40 0x7f4d64069300 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4d700af000 tx=0x7f4d700b6040 comp rx=0 tx=0).stop 2024-02-17T12:19:19.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 -- 172.21.15.114:0/4164473571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c1eb0 msgr2=0x7f4d8015a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:19.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c1eb0 0x7f4d8015a770 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400c7c0 tx=0x7f4d7400cc80 comp rx=0 tx=0).stop 2024-02-17T12:19:19.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 -- 172.21.15.114:0/4164473571 shutdown_connections 2024-02-17T12:19:19.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8014f110 0x7f4d80141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d800c2580 0x7f4d80141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4d64066e40 0x7f4d64069300 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 --2- 172.21.15.114:0/4164473571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d800c1eb0 0x7f4d8015a770 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 -- 172.21.15.114:0/4164473571 >> 172.21.15.114:0/4164473571 conn(0x7f4d800a8490 msgr2=0x7f4d8006dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:19.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 -- 172.21.15.114:0/4164473571 shutdown_connections 2024-02-17T12:19:19.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.196+0000 7f4d88800640 1 -- 172.21.15.114:0/4164473571 wait complete. 2024-02-17T12:19:19.221 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-02-17T12:19:19.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-02-17T12:19:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.356+0000 7fb9ed600640 1 Processor -- start 2024-02-17T12:19:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.356+0000 7fb9ed600640 1 -- start start 2024-02-17T12:19:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9ed600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 0x7fb9e806e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9ed600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9e80a6590 0x7fb9e80a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9ed600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e8153640 con 0x7fb9e80a7020 2024-02-17T12:19:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9ed600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e80c3cc0 con 0x7fb9e80a6590 2024-02-17T12:19:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9ed600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e81506a0 con 0x7fb9e80c38e0 2024-02-17T12:19:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9e6000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9e80a6590 0x7fb9e80a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9e7400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb9e80a7020 0x7fb9e81543a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55284/0 (socket says 172.21.15.114:55284) 2024-02-17T12:19:19.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9e7400640 1 -- 172.21.15.114:0/3845141157 learned_addr learned my addr 172.21.15.114:0/3845141157 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9e6a00640 1 --2- 172.21.15.114:0/3845141157 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 0x7fb9e806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9e6000640 1 -- 172.21.15.114:0/3845141157 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 msgr2=0x7fb9e806e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9e6000640 1 --2- 172.21.15.114:0/3845141157 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 0x7fb9e806e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9e6000640 1 -- 172.21.15.114:0/3845141157 >> v1:172.21.15.114:6789/0 conn(0x7fb9e80a7020 legacy=0x7fb9e81543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9e6000640 1 -- 172.21.15.114:0/3845141157 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e8153b70 con 0x7fb9e80a6590 2024-02-17T12:19:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9e5600640 1 -- 172.21.15.114:0/3845141157 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769974867 0 0) 0x7fb9e8153640 con 0x7fb9e80a7020 2024-02-17T12:19:19.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.360+0000 7fb9e6a00640 1 --2- 172.21.15.114:0/3845141157 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 0x7fb9e806e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:19.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9e6000640 1 --2- 172.21.15.114:0/3845141157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 0x7fb9e80a6ae0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00097f0 tx=0x7fb9d001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2175e7cb0395a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:19.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9e5600640 1 -- 172.21.15.114:0/3845141157 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d00ab600 con 0x7fb9e80a6590 2024-02-17T12:19:19.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9e5600640 1 -- 172.21.15.114:0/3845141157 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d00a7050 con 0x7fb9e80a6590 2024-02-17T12:19:19.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9e5600640 1 -- 172.21.15.114:0/3845141157 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d00ab980 con 0x7fb9e80a6590 2024-02-17T12:19:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 -- 172.21.15.114:0/3845141157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 msgr2=0x7fb9e80a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 --2- 172.21.15.114:0/3845141157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 0x7fb9e80a6ae0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00097f0 tx=0x7fb9d001c380 comp rx=0 tx=0).stop 2024-02-17T12:19:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 -- 172.21.15.114:0/3845141157 shutdown_connections 2024-02-17T12:19:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 --2- 172.21.15.114:0/3845141157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 0x7fb9e80a6ae0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 --2- 172.21.15.114:0/3845141157 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 0x7fb9e806e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 -- 172.21.15.114:0/3845141157 >> 172.21.15.114:0/3845141157 conn(0x7fb9e806b210 msgr2=0x7fb9e806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 -- 172.21.15.114:0/3845141157 shutdown_connections 2024-02-17T12:19:19.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 -- 172.21.15.114:0/3845141157 wait complete. 2024-02-17T12:19:19.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 Processor -- start 2024-02-17T12:19:19.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 -- start start 2024-02-17T12:19:19.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 0x7fb9e80c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e80a7020 0x7fb9e8152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 0x7fb9e80ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e81f19a0 con 0x7fb9e80a6590 2024-02-17T12:19:19.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e81f1ed0 con 0x7fb9e80a7020 2024-02-17T12:19:19.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9ed600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80ac250 con 0x7fb9e80c38e0 2024-02-17T12:19:19.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9e6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 0x7fb9e80c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9e6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 0x7fb9e80c51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47470/0 (socket says 172.21.15.114:47470) 2024-02-17T12:19:19.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9e6a00640 1 -- 172.21.15.114:0/2763244331 learned_addr learned my addr 172.21.15.114:0/2763244331 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:19.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9e6000640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e80a7020 0x7fb9e8152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.364+0000 7fb9e7400640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 0x7fb9e80ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9e6a00640 1 -- 172.21.15.114:0/2763244331 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 msgr2=0x7fb9e80ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:19.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9e6a00640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 0x7fb9e80ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9e6a00640 1 -- 172.21.15.114:0/2763244331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e80a7020 msgr2=0x7fb9e8152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:19.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9e6a00640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e80a7020 0x7fb9e8152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:19.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9e6a00640 1 -- 172.21.15.114:0/2763244331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d0009420 con 0x7fb9e80a6590 2024-02-17T12:19:19.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9e7400640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 0x7fb9e80ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:19.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9e6a00640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 0x7fb9e80c51c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800cf90 tx=0x7fb9d800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:19.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9dea00640 1 -- 172.21.15.114:0/2763244331 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800d840 con 0x7fb9e80a6590 2024-02-17T12:19:19.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9dea00640 1 -- 172.21.15.114:0/2763244331 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800d9a0 con 0x7fb9e80a6590 2024-02-17T12:19:19.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9dea00640 1 -- 172.21.15.114:0/2763244331 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800dd30 con 0x7fb9e80a6590 2024-02-17T12:19:19.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9ed600640 1 -- 172.21.15.114:0/2763244331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e81f1bf0 con 0x7fb9e80a6590 2024-02-17T12:19:19.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9ed600640 1 -- 172.21.15.114:0/2763244331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e81527a0 con 0x7fb9e80a6590 2024-02-17T12:19:19.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9ed600640 1 -- 172.21.15.114:0/2763244331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e80c0ac0 con 0x7fb9e80a6590 2024-02-17T12:19:19.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9dea00640 1 -- 172.21.15.114:0/2763244331 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb9d8015440 con 0x7fb9e80a6590 2024-02-17T12:19:19.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9dea00640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c4066e70 0x7fb9c4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:19.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9dea00640 1 -- 172.21.15.114:0/2763244331 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9d80853f0 con 0x7fb9e80a6590 2024-02-17T12:19:19.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.368+0000 7fb9e6000640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c4066e70 0x7fb9c4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:19.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.372+0000 7fb9e6000640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c4066e70 0x7fb9c4069330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00ad000 tx=0x7fb9d00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:19.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.372+0000 7fb9dea00640 1 -- 172.21.15.114:0/2763244331 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb9d8052320 con 0x7fb9e80a6590 2024-02-17T12:19:19.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:19.528+0000 7fb9ed600640 1 -- 172.21.15.114:0/2763244331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb9e8074840 con 0x7fb9e80a6590 2024-02-17T12:19:20.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.336+0000 7fb9dea00640 1 -- 172.21.15.114:0/2763244331 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v69) v1 ==== 140+0+0 (secure 0 0 0) 0x7fb9d80559e0 con 0x7fb9e80a6590 2024-02-17T12:19:20.341 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_metadata' created 2024-02-17T12:19:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 -- 172.21.15.114:0/2763244331 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c4066e70 msgr2=0x7fb9c4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c4066e70 0x7fb9c4069330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00ad000 tx=0x7fb9d00a6000 comp rx=0 tx=0).stop 2024-02-17T12:19:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 -- 172.21.15.114:0/2763244331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 msgr2=0x7fb9e80c51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 0x7fb9e80c51c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800cf90 tx=0x7fb9d800a7d0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 -- 172.21.15.114:0/2763244331 shutdown_connections 2024-02-17T12:19:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9e80c38e0 0x7fb9e80ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9e80a7020 0x7fb9e8152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9c4066e70 0x7fb9c4069330 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 --2- 172.21.15.114:0/2763244331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9e80a6590 0x7fb9e80c51c0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 -- 172.21.15.114:0/2763244331 >> 172.21.15.114:0/2763244331 conn(0x7fb9e806b210 msgr2=0x7fb9e806e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:20.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 -- 172.21.15.114:0/2763244331 shutdown_connections 2024-02-17T12:19:20.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.340+0000 7fb9ed600640 1 -- 172.21.15.114:0/2763244331 wait complete. 2024-02-17T12:19:20.370 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-17T12:19:20.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ebe00640 1 Processor -- start 2024-02-17T12:19:20.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ebe00640 1 -- start start 2024-02-17T12:19:20.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ebe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55ec14cb50 0x7f55ec06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:20.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ebe00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f55ec06b150 0x7f55ec06dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:20.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ebe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ec1538c0 con 0x7f55ec06b740 2024-02-17T12:19:20.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ebe00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec0aa340 con 0x7f55ec06b150 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ebe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0c0f20 con 0x7f55ec14cb50 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55eb400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f55ec06b740 0x7f55ec06e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55298/0 (socket says 172.21.15.114:55298) 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55eb400640 1 -- 172.21.15.114:0/2895192218 learned_addr learned my addr 172.21.15.114:0/2895192218 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ea000640 1 --2- 172.21.15.114:0/2895192218 >> v2:172.21.15.116:3300/0 conn(0x7f55ec06b150 0x7f55ec06dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55eaa00640 1 --2- 172.21.15.114:0/2895192218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55ec14cb50 0x7f55ec06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55e9600640 1 -- 172.21.15.114:0/2895192218 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159509215 0 0) 0x7f55ec1538c0 con 0x7f55ec06b740 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55e9600640 1 -- 172.21.15.114:0/2895192218 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d0003530 con 0x7f55ec06b740 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ea000640 1 -- 172.21.15.114:0/2895192218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55ec14cb50 msgr2=0x7f55ec06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ea000640 1 --2- 172.21.15.114:0/2895192218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55ec14cb50 0x7f55ec06ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ea000640 1 -- 172.21.15.114:0/2895192218 >> v1:172.21.15.114:6789/0 conn(0x7f55ec06b740 legacy=0x7f55ec06e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:20.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.508+0000 7f55ea000640 1 -- 172.21.15.114:0/2895192218 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec152cb0 con 0x7f55ec06b150 2024-02-17T12:19:20.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ea000640 1 --2- 172.21.15.114:0/2895192218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55ec06b150 0x7f55ec06dbc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f55d80097c0 tx=0x7f55d801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c03c14da5013959 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:20.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55e9600640 1 -- 172.21.15.114:0/2895192218 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80ac640 con 0x7f55ec06b150 2024-02-17T12:19:20.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55e9600640 1 -- 172.21.15.114:0/2895192218 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d80ac7a0 con 0x7f55ec06b150 2024-02-17T12:19:20.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55e9600640 1 -- 172.21.15.114:0/2895192218 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80acb30 con 0x7f55ec06b150 2024-02-17T12:19:20.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ebe00640 1 -- 172.21.15.114:0/2895192218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55ec06b150 msgr2=0x7f55ec06dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:20.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ebe00640 1 --2- 172.21.15.114:0/2895192218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55ec06b150 0x7f55ec06dbc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f55d80097c0 tx=0x7f55d801c3e0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ebe00640 1 -- 172.21.15.114:0/2895192218 shutdown_connections 2024-02-17T12:19:20.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ebe00640 1 --2- 172.21.15.114:0/2895192218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55ec06b150 0x7f55ec06dbc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ebe00640 1 --2- 172.21.15.114:0/2895192218 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55ec14cb50 0x7f55ec06ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ebe00640 1 -- 172.21.15.114:0/2895192218 >> 172.21.15.114:0/2895192218 conn(0x7f55ec0c6300 msgr2=0x7f55ec0c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:20.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ebe00640 1 -- 172.21.15.114:0/2895192218 shutdown_connections 2024-02-17T12:19:20.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ebe00640 1 -- 172.21.15.114:0/2895192218 wait complete. 2024-02-17T12:19:20.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ebe00640 1 Processor -- start 2024-02-17T12:19:20.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.512+0000 7f55ebe00640 1 -- start start 2024-02-17T12:19:20.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ebe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55ec06b150 0x7f55ec1f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:20.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ebe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55ec06b740 0x7f55ec1482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:20.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ebe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55ec14cb50 0x7f55ec14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:20.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ebe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec155930 con 0x7f55ec06b740 2024-02-17T12:19:20.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ebe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec14a0f0 con 0x7f55ec06b150 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ebe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec14ad40 con 0x7f55ec14cb50 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ea000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55ec06b740 0x7f55ec1482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ea000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55ec06b740 0x7f55ec1482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47484/0 (socket says 172.21.15.114:47484) 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ea000640 1 -- 172.21.15.114:0/2978096689 learned_addr learned my addr 172.21.15.114:0/2978096689 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55eb400640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55ec14cb50 0x7f55ec14ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55eaa00640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55ec06b150 0x7f55ec1f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ea000640 1 -- 172.21.15.114:0/2978096689 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55ec14cb50 msgr2=0x7f55ec14ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ea000640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55ec14cb50 0x7f55ec14ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ea000640 1 -- 172.21.15.114:0/2978096689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55ec06b150 msgr2=0x7f55ec1f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ea000640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55ec06b150 0x7f55ec1f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ea000640 1 -- 172.21.15.114:0/2978096689 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d8009420 con 0x7f55ec06b740 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ea000640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55ec06b740 0x7f55ec1482e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f55d801a010 tx=0x7f55d8019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55e2a00640 1 -- 172.21.15.114:0/2978096689 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80b5610 con 0x7f55ec06b740 2024-02-17T12:19:20.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55e2a00640 1 -- 172.21.15.114:0/2978096689 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d80b5770 con 0x7f55ec06b740 2024-02-17T12:19:20.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55e2a00640 1 -- 172.21.15.114:0/2978096689 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80b5b20 con 0x7f55ec06b740 2024-02-17T12:19:20.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ebe00640 1 -- 172.21.15.114:0/2978096689 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec14b020 con 0x7f55ec06b740 2024-02-17T12:19:20.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ebe00640 1 -- 172.21.15.114:0/2978096689 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec1f0830 con 0x7f55ec06b740 2024-02-17T12:19:20.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.516+0000 7f55ebe00640 1 -- 172.21.15.114:0/2978096689 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec04eef0 con 0x7f55ec06b740 2024-02-17T12:19:20.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.520+0000 7f55e2a00640 1 -- 172.21.15.114:0/2978096689 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f55d80b3040 con 0x7f55ec06b740 2024-02-17T12:19:20.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.520+0000 7f55e2a00640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f55cc066e40 0x7f55cc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:20.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.520+0000 7f55e2a00640 1 -- 172.21.15.114:0/2978096689 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f55d811ec20 con 0x7f55ec06b740 2024-02-17T12:19:20.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.520+0000 7f55eaa00640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f55cc066e40 0x7f55cc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:20.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.520+0000 7f55eaa00640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f55cc066e40 0x7f55cc069300 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0c6120 tx=0x7f55dc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:20.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.524+0000 7f55e2a00640 1 -- 172.21.15.114:0/2978096689 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f55d811ee60 con 0x7f55ec06b740 2024-02-17T12:19:20.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:20.684+0000 7f55ebe00640 1 -- 172.21.15.114:0/2978096689 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f55ec0c0d00 con 0x7f55ec06b740 2024-02-17T12:19:21.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55e2a00640 1 -- 172.21.15.114:0/2978096689 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v70) v1 ==== 172+0+0 (secure 0 0 0) 0x7f55d80b10d0 con 0x7f55ec06b740 2024-02-17T12:19:21.347 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_data' created 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 -- 172.21.15.114:0/2978096689 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f55cc066e40 msgr2=0x7f55cc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f55cc066e40 0x7f55cc069300 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0c6120 tx=0x7f55dc00b040 comp rx=0 tx=0).stop 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 -- 172.21.15.114:0/2978096689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55ec06b740 msgr2=0x7f55ec1482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55ec06b740 0x7f55ec1482e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f55d801a010 tx=0x7f55d8019180 comp rx=0 tx=0).stop 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 -- 172.21.15.114:0/2978096689 shutdown_connections 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55ec14cb50 0x7f55ec14ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f55cc066e40 0x7f55cc069300 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55ec06b740 0x7f55ec1482e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 --2- 172.21.15.114:0/2978096689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55ec06b150 0x7f55ec1f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 -- 172.21.15.114:0/2978096689 >> 172.21.15.114:0/2978096689 conn(0x7f55ec0c6300 msgr2=0x7f55ec0c2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 -- 172.21.15.114:0/2978096689 shutdown_connections 2024-02-17T12:19:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.344+0000 7f55ebe00640 1 -- 172.21.15.114:0/2978096689 wait complete. 2024-02-17T12:19:21.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-02-17T12:19:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38f2200640 1 Processor -- start 2024-02-17T12:19:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38f2200640 1 -- start start 2024-02-17T12:19:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38f2200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f38ec14f110 0x7f38ec0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38f2200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f38ec0c2580 0x7f38ec0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38f2200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ec0a9420 con 0x7f38ec0c1eb0 2024-02-17T12:19:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38f2200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ec14f4f0 con 0x7f38ec14f110 2024-02-17T12:19:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38f2200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ec0aae80 con 0x7f38ec0c2580 2024-02-17T12:19:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38eb400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f38ec14f110 0x7f38ec0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38eb400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f38ec14f110 0x7f38ec0c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47490/0 (socket says 172.21.15.114:47490) 2024-02-17T12:19:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38eb400640 1 -- 172.21.15.114:0/2286537475 learned_addr learned my addr 172.21.15.114:0/2286537475 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38e2a00640 1 --2- 172.21.15.114:0/2286537475 >> v2:172.21.15.116:3300/0 conn(0x7f38ec0c2580 0x7f38ec0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38eb400640 1 -- 172.21.15.114:0/2286537475 >> v2:172.21.15.116:3300/0 conn(0x7f38ec0c2580 msgr2=0x7f38ec0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38eb400640 1 --2- 172.21.15.114:0/2286537475 >> v2:172.21.15.116:3300/0 conn(0x7f38ec0c2580 0x7f38ec0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38eb400640 1 -- 172.21.15.114:0/2286537475 >> v1:172.21.15.114:6789/0 conn(0x7f38ec0c1eb0 legacy=0x7f38ec155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.520+0000 7f38eb400640 1 -- 172.21.15.114:0/2286537475 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec152850 con 0x7f38ec14f110 2024-02-17T12:19:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38eb400640 1 --2- 172.21.15.114:0/2286537475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec14f110 0x7f38ec0c65a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f38ec06f0d0 tx=0x7f38dc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c18801e68a56542 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38eaa00640 1 -- 172.21.15.114:0/2286537475 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0a57f0 con 0x7f38ec14f110 2024-02-17T12:19:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38eaa00640 1 -- 172.21.15.114:0/2286537475 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38dc0a5950 con 0x7f38ec14f110 2024-02-17T12:19:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38eaa00640 1 -- 172.21.15.114:0/2286537475 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0a5ce0 con 0x7f38ec14f110 2024-02-17T12:19:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38f2200640 1 -- 172.21.15.114:0/2286537475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec14f110 msgr2=0x7f38ec0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38f2200640 1 --2- 172.21.15.114:0/2286537475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec14f110 0x7f38ec0c65a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f38ec06f0d0 tx=0x7f38dc01c930 comp rx=0 tx=0).stop 2024-02-17T12:19:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38f2200640 1 -- 172.21.15.114:0/2286537475 shutdown_connections 2024-02-17T12:19:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38f2200640 1 --2- 172.21.15.114:0/2286537475 >> v2:172.21.15.116:3300/0 conn(0x7f38ec0c2580 0x7f38ec0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38f2200640 1 --2- 172.21.15.114:0/2286537475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec14f110 0x7f38ec0c65a0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38f2200640 1 -- 172.21.15.114:0/2286537475 >> 172.21.15.114:0/2286537475 conn(0x7f38ec0a8490 msgr2=0x7f38ec0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38f2200640 1 -- 172.21.15.114:0/2286537475 shutdown_connections 2024-02-17T12:19:21.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38f2200640 1 -- 172.21.15.114:0/2286537475 wait complete. 2024-02-17T12:19:21.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38f2200640 1 Processor -- start 2024-02-17T12:19:21.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.524+0000 7f38f2200640 1 -- start start 2024-02-17T12:19:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38f2200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ec0c1eb0 0x7f38ec154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38f2200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec0c2580 0x7f38ec150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38f2200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38ec14f110 0x7f38ec144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38f2200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec1537e0 con 0x7f38ec0c2580 2024-02-17T12:19:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38f2200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec151850 con 0x7f38ec0c1eb0 2024-02-17T12:19:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38f2200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec0c6110 con 0x7f38ec14f110 2024-02-17T12:19:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec0c2580 0x7f38ec150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec0c2580 0x7f38ec150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47500/0 (socket says 172.21.15.114:47500) 2024-02-17T12:19:21.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e2a00640 1 -- 172.21.15.114:0/2618116458 learned_addr learned my addr 172.21.15.114:0/2618116458 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e2a00640 1 -- 172.21.15.114:0/2618116458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38ec14f110 msgr2=0x7f38ec144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e2a00640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38ec14f110 0x7f38ec144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e2a00640 1 -- 172.21.15.114:0/2618116458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ec0c1eb0 msgr2=0x7f38ec154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e2a00640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ec0c1eb0 0x7f38ec154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e2a00640 1 -- 172.21.15.114:0/2618116458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc009b30 con 0x7f38ec0c2580 2024-02-17T12:19:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e2a00640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec0c2580 0x7f38ec150210 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f38d400d800 tx=0x7f38d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:21.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e3e00640 1 -- 172.21.15.114:0/2618116458 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d400b660 con 0x7f38ec0c2580 2024-02-17T12:19:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e3e00640 1 -- 172.21.15.114:0/2618116458 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d400b7c0 con 0x7f38ec0c2580 2024-02-17T12:19:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e3e00640 1 -- 172.21.15.114:0/2618116458 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d400bb70 con 0x7f38ec0c2580 2024-02-17T12:19:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38f2200640 1 -- 172.21.15.114:0/2618116458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ec0c5be0 con 0x7f38ec0c2580 2024-02-17T12:19:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38f2200640 1 -- 172.21.15.114:0/2618116458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ec0c5e30 con 0x7f38ec0c2580 2024-02-17T12:19:21.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38f2200640 1 -- 172.21.15.114:0/2618116458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ec06bb70 con 0x7f38ec0c2580 2024-02-17T12:19:21.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.528+0000 7f38e3e00640 1 -- 172.21.15.114:0/2618116458 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f38d400bcd0 con 0x7f38ec0c2580 2024-02-17T12:19:21.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.532+0000 7f38e3e00640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f38c8066e70 0x7f38c8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:21.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.532+0000 7f38e3e00640 1 -- 172.21.15.114:0/2618116458 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f38d4085140 con 0x7f38ec0c2580 2024-02-17T12:19:21.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.532+0000 7f38eb400640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f38c8066e70 0x7f38c8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:21.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.532+0000 7f38eb400640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f38c8066e70 0x7f38c8069330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0ae000 tx=0x7f38dc004ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:21.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.536+0000 7f38e3e00640 1 -- 172.21.15.114:0/2618116458 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f38d4051c30 con 0x7f38ec0c2580 2024-02-17T12:19:21.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:21.720+0000 7f38f2200640 1 -- 172.21.15.114:0/2618116458 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f38ec074840 con 0x7f38ec0c2580 2024-02-17T12:19:22.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.344+0000 7f38e3e00640 1 -- 172.21.15.114:0/2618116458 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v50) v1 ==== 177+0+0 (secure 0 0 0) 0x7f38d4011340 con 0x7f38ec0c2580 2024-02-17T12:19:22.350 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 14 and data pool 15 2024-02-17T12:19:22.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.348+0000 7f38f2200640 1 -- 172.21.15.114:0/2618116458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f38c8066e70 msgr2=0x7f38c8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.348+0000 7f38f2200640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f38c8066e70 0x7f38c8069330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0ae000 tx=0x7f38dc004ac0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.348+0000 7f38f2200640 1 -- 172.21.15.114:0/2618116458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec0c2580 msgr2=0x7f38ec150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.348+0000 7f38f2200640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec0c2580 0x7f38ec150210 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f38d400d800 tx=0x7f38d400dcc0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.348+0000 7f38f2200640 1 -- 172.21.15.114:0/2618116458 shutdown_connections 2024-02-17T12:19:22.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.348+0000 7f38f2200640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38ec14f110 0x7f38ec144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.348+0000 7f38f2200640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f38c8066e70 0x7f38c8069330 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.348+0000 7f38f2200640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38ec0c2580 0x7f38ec150210 secure :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f38d400d800 tx=0x7f38d400dcc0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.348+0000 7f38f2200640 1 --2- 172.21.15.114:0/2618116458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ec0c1eb0 0x7f38ec154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.348+0000 7f38f2200640 1 -- 172.21.15.114:0/2618116458 >> 172.21.15.114:0/2618116458 conn(0x7f38ec0a8490 msgr2=0x7f38ec0a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:22.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.352+0000 7f38f2200640 1 -- 172.21.15.114:0/2618116458 shutdown_connections 2024-02-17T12:19:22.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.352+0000 7f38f2200640 1 -- 172.21.15.114:0/2618116458 wait complete. 2024-02-17T12:19:22.398 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:22.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.528+0000 7f69f4000640 1 Processor -- start 2024-02-17T12:19:22.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.528+0000 7f69f4000640 1 -- start start 2024-02-17T12:19:22.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.528+0000 7f69f4000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f69ec14f110 0x7f69ec0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.528+0000 7f69f4000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f69ec0c2580 0x7f69ec0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.528+0000 7f69f4000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec0a9420 con 0x7f69ec0c1eb0 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f4000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec14f4f0 con 0x7f69ec14f110 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f4000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec0aae80 con 0x7f69ec0c2580 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f69ec14f110 0x7f69ec0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f69ec14f110 0x7f69ec0c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47510/0 (socket says 172.21.15.114:47510) 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f1600640 1 -- 172.21.15.114:0/1284103051 learned_addr learned my addr 172.21.15.114:0/1284103051 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f1600640 1 -- 172.21.15.114:0/1284103051 >> v2:172.21.15.116:3300/0 conn(0x7f69ec0c2580 msgr2=0x7f69ec0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f0c00640 1 --2- 172.21.15.114:0/1284103051 >> v2:172.21.15.116:3300/0 conn(0x7f69ec0c2580 0x7f69ec0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f1600640 1 --2- 172.21.15.114:0/1284103051 >> v2:172.21.15.116:3300/0 conn(0x7f69ec0c2580 0x7f69ec0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f1600640 1 -- 172.21.15.114:0/1284103051 >> v1:172.21.15.114:6789/0 conn(0x7f69ec0c1eb0 legacy=0x7f69ec155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f1600640 1 -- 172.21.15.114:0/1284103051 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec152850 con 0x7f69ec14f110 2024-02-17T12:19:22.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f0c00640 1 --2- 172.21.15.114:0/1284103051 >> v2:172.21.15.116:3300/0 conn(0x7f69ec0c2580 0x7f69ec0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:22.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69f1600640 1 --2- 172.21.15.114:0/1284103051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 0x7f69ec0c65a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f69ec06f0d0 tx=0x7f69e001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e19f6ad5cbe73f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69ebe00640 1 -- 172.21.15.114:0/1284103051 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00a57f0 con 0x7f69ec14f110 2024-02-17T12:19:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69ebe00640 1 -- 172.21.15.114:0/1284103051 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e00a5950 con 0x7f69ec14f110 2024-02-17T12:19:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.532+0000 7f69ebe00640 1 -- 172.21.15.114:0/1284103051 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00a5ce0 con 0x7f69ec14f110 2024-02-17T12:19:22.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 -- 172.21.15.114:0/1284103051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 msgr2=0x7f69ec0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 --2- 172.21.15.114:0/1284103051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 0x7f69ec0c65a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f69ec06f0d0 tx=0x7f69e001c930 comp rx=0 tx=0).stop 2024-02-17T12:19:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 -- 172.21.15.114:0/1284103051 shutdown_connections 2024-02-17T12:19:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 --2- 172.21.15.114:0/1284103051 >> v2:172.21.15.116:3300/0 conn(0x7f69ec0c2580 0x7f69ec0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 --2- 172.21.15.114:0/1284103051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 0x7f69ec0c65a0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 -- 172.21.15.114:0/1284103051 >> 172.21.15.114:0/1284103051 conn(0x7f69ec0a8490 msgr2=0x7f69ec0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 -- 172.21.15.114:0/1284103051 shutdown_connections 2024-02-17T12:19:22.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 -- 172.21.15.114:0/1284103051 wait complete. 2024-02-17T12:19:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 Processor -- start 2024-02-17T12:19:22.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 -- start start 2024-02-17T12:19:22.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69ec0c1eb0 0x7f69ec1461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69ec0c2580 0x7f69ec0c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 0x7f69ec144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec14fd10 con 0x7f69ec14f110 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec14fff0 con 0x7f69ec0c2580 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f4000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec1502d0 con 0x7f69ec0c1eb0 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 0x7f69ec144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 0x7f69ec144740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47514/0 (socket says 172.21.15.114:47514) 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f2000640 1 -- 172.21.15.114:0/90837013 learned_addr learned my addr 172.21.15.114:0/90837013 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f0c00640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69ec0c2580 0x7f69ec0c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f1600640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69ec0c1eb0 0x7f69ec1461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f2000640 1 -- 172.21.15.114:0/90837013 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69ec0c1eb0 msgr2=0x7f69ec1461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f2000640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69ec0c1eb0 0x7f69ec1461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f2000640 1 -- 172.21.15.114:0/90837013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69ec0c2580 msgr2=0x7f69ec0c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f2000640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69ec0c2580 0x7f69ec0c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f2000640 1 -- 172.21.15.114:0/90837013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e0009b30 con 0x7f69ec14f110 2024-02-17T12:19:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.536+0000 7f69f2000640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 0x7f69ec144740 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f69e400c430 tx=0x7f69e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.540+0000 7f69e9600640 1 -- 172.21.15.114:0/90837013 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4005220 con 0x7f69ec14f110 2024-02-17T12:19:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.540+0000 7f69e9600640 1 -- 172.21.15.114:0/90837013 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e4005380 con 0x7f69ec14f110 2024-02-17T12:19:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.540+0000 7f69e9600640 1 -- 172.21.15.114:0/90837013 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4007270 con 0x7f69ec14f110 2024-02-17T12:19:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.540+0000 7f69f4000640 1 -- 172.21.15.114:0/90837013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec1505b0 con 0x7f69ec14f110 2024-02-17T12:19:22.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.540+0000 7f69f4000640 1 -- 172.21.15.114:0/90837013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec14f880 con 0x7f69ec14f110 2024-02-17T12:19:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.540+0000 7f69f4000640 1 -- 172.21.15.114:0/90837013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec074840 con 0x7f69ec14f110 2024-02-17T12:19:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.540+0000 7f69e9600640 1 -- 172.21.15.114:0/90837013 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f69e40073d0 con 0x7f69ec14f110 2024-02-17T12:19:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.540+0000 7f69e9600640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f69cc066e70 0x7f69cc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.540+0000 7f69e9600640 1 -- 172.21.15.114:0/90837013 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f69e40842a0 con 0x7f69ec14f110 2024-02-17T12:19:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.540+0000 7f69f1600640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f69cc066e70 0x7f69cc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.544+0000 7f69f1600640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f69cc066e70 0x7f69cc069330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f69e00ae000 tx=0x7f69e00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:22.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.544+0000 7f69e9600640 1 -- 172.21.15.114:0/90837013 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f69e4050d20 con 0x7f69ec14f110 2024-02-17T12:19:22.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.700+0000 7f69f4000640 1 -- 172.21.15.114:0/90837013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69ec0c1380 con 0x7f69ec14f110 2024-02-17T12:19:22.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.700+0000 7f69e9600640 1 -- 172.21.15.114:0/90837013 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20405 (secure 0 0 0) 0x7f69e40543e0 con 0x7f69ec14f110 2024-02-17T12:19:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:22.705 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":71,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:21.725740+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 -- 172.21.15.114:0/90837013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f69cc066e70 msgr2=0x7f69cc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f69cc066e70 0x7f69cc069330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f69e00ae000 tx=0x7f69e00a7070 comp rx=0 tx=0).stop 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 -- 172.21.15.114:0/90837013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 msgr2=0x7f69ec144740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 0x7f69ec144740 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f69e400c430 tx=0x7f69e400c8f0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 -- 172.21.15.114:0/90837013 shutdown_connections 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f69cc066e70 0x7f69cc069330 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69ec14f110 0x7f69ec144740 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69ec0c2580 0x7f69ec0c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 --2- 172.21.15.114:0/90837013 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69ec0c1eb0 0x7f69ec1461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 -- 172.21.15.114:0/90837013 >> 172.21.15.114:0/90837013 conn(0x7f69ec0a8490 msgr2=0x7f69ec06da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 -- 172.21.15.114:0/90837013 shutdown_connections 2024-02-17T12:19:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.704+0000 7f69f4000640 1 -- 172.21.15.114:0/90837013 wait complete. 2024-02-17T12:19:22.726 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:22.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.856+0000 7fa958400640 1 Processor -- start 2024-02-17T12:19:22.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.856+0000 7fa958400640 1 -- start start 2024-02-17T12:19:22.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.856+0000 7fa958400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9500c2580 0x7fa9500aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.856+0000 7fa958400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9500a9420 con 0x7fa9500c1eb0 2024-02-17T12:19:22.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.856+0000 7fa958400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa950152850 con 0x7fa95014f110 2024-02-17T12:19:22.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.856+0000 7fa958400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95014f4f0 con 0x7fa9500c2580 2024-02-17T12:19:22.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.856+0000 7fa955000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9500c2580 0x7fa9500aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.856+0000 7fa955000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9500c2580 0x7fa9500aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47516/0 (socket says 172.21.15.114:47516) 2024-02-17T12:19:22.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.856+0000 7fa955000640 1 -- 172.21.15.114:0/1640781070 learned_addr learned my addr 172.21.15.114:0/1640781070 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:22.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.856+0000 7fa956400640 1 --1- 172.21.15.114:0/1640781070 >> v1:172.21.15.114:6789/0 conn(0x7fa9500c1eb0 0x7fa95015c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55326/0 (socket says 172.21.15.114:55326) 2024-02-17T12:19:22.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.860+0000 7fa955000640 1 -- 172.21.15.114:0/1640781070 >> v1:172.21.15.116:6789/0 conn(0x7fa95014f110 legacy=0x7fa9500c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.860+0000 7fa955000640 1 -- 172.21.15.114:0/1640781070 >> v1:172.21.15.114:6789/0 conn(0x7fa9500c1eb0 legacy=0x7fa95015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.860+0000 7fa955000640 1 -- 172.21.15.114:0/1640781070 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9500a9670 con 0x7fa9500c2580 2024-02-17T12:19:22.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.860+0000 7fa94fe00640 1 -- 172.21.15.114:0/1640781070 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126137280 0 0) 0x7fa9500a9420 con 0x7fa9500c1eb0 2024-02-17T12:19:22.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.860+0000 7fa955000640 1 --2- 172.21.15.114:0/1640781070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 0x7fa9500aa150 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009870 tx=0x7fa93c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a95024e4f6d3e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:22.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.860+0000 7fa94fe00640 1 -- 172.21.15.114:0/1640781070 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0ac620 con 0x7fa9500c2580 2024-02-17T12:19:22.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.860+0000 7fa94fe00640 1 -- 172.21.15.114:0/1640781070 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c0ac780 con 0x7fa9500c2580 2024-02-17T12:19:22.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.860+0000 7fa94fe00640 1 -- 172.21.15.114:0/1640781070 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0acb10 con 0x7fa9500c2580 2024-02-17T12:19:22.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.860+0000 7fa958400640 1 -- 172.21.15.114:0/1640781070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 msgr2=0x7fa9500aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.860+0000 7fa958400640 1 --2- 172.21.15.114:0/1640781070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 0x7fa9500aa150 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009870 tx=0x7fa93c01c4d0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 -- 172.21.15.114:0/1640781070 shutdown_connections 2024-02-17T12:19:22.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 --2- 172.21.15.114:0/1640781070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 0x7fa9500aa150 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 -- 172.21.15.114:0/1640781070 >> 172.21.15.114:0/1640781070 conn(0x7fa9500a8490 msgr2=0x7fa9500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:22.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 -- 172.21.15.114:0/1640781070 shutdown_connections 2024-02-17T12:19:22.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 -- 172.21.15.114:0/1640781070 wait complete. 2024-02-17T12:19:22.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 Processor -- start 2024-02-17T12:19:22.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 -- start start 2024-02-17T12:19:22.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9500c1eb0 0x7fa9500c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 0x7fa9500c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa95014f110 0x7fa95014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa950141e90 con 0x7fa9500c2580 2024-02-17T12:19:22.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500c3f60 con 0x7fa95014f110 2024-02-17T12:19:22.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501efab0 con 0x7fa9500c1eb0 2024-02-17T12:19:22.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 0x7fa9500c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 0x7fa9500c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47518/0 (socket says 172.21.15.114:47518) 2024-02-17T12:19:22.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955000640 1 -- 172.21.15.114:0/1534981659 learned_addr learned my addr 172.21.15.114:0/1534981659 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:22.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955a00640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9500c1eb0 0x7fa9500c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa956400640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa95014f110 0x7fa95014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955000640 1 -- 172.21.15.114:0/1534981659 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9500c1eb0 msgr2=0x7fa9500c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955000640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9500c1eb0 0x7fa9500c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955000640 1 -- 172.21.15.114:0/1534981659 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa95014f110 msgr2=0x7fa95014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955000640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa95014f110 0x7fa95014dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955000640 1 -- 172.21.15.114:0/1534981659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c0094d0 con 0x7fa9500c2580 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa956400640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa95014f110 0x7fa95014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955a00640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9500c1eb0 0x7fa9500c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa955000640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 0x7fa9500c57e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0af040 tx=0x7fa93c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa94d600640 1 -- 172.21.15.114:0/1534981659 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0b7670 con 0x7fa9500c2580 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa94d600640 1 -- 172.21.15.114:0/1534981659 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c0b77d0 con 0x7fa9500c2580 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa958400640 1 -- 172.21.15.114:0/1534981659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9500c41b0 con 0x7fa9500c2580 2024-02-17T12:19:22.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.864+0000 7fa94d600640 1 -- 172.21.15.114:0/1534981659 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0b7b80 con 0x7fa9500c2580 2024-02-17T12:19:22.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.868+0000 7fa958400640 1 -- 172.21.15.114:0/1534981659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9500c4770 con 0x7fa9500c2580 2024-02-17T12:19:22.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.868+0000 7fa958400640 1 -- 172.21.15.114:0/1534981659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9500c4960 con 0x7fa9500c2580 2024-02-17T12:19:22.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.868+0000 7fa94d600640 1 -- 172.21.15.114:0/1534981659 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa93c0b3070 con 0x7fa9500c2580 2024-02-17T12:19:22.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.868+0000 7fa94d600640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa930066e40 0x7fa930069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:22.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.868+0000 7fa94d600640 1 -- 172.21.15.114:0/1534981659 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa93c11f600 con 0x7fa9500c2580 2024-02-17T12:19:22.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.868+0000 7fa955a00640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa930066e40 0x7fa930069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:22.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.868+0000 7fa955a00640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa930066e40 0x7fa930069300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa944000f70 tx=0x7fa944009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:22.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:22.872+0000 7fa94d600640 1 -- 172.21.15.114:0/1534981659 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa93c0ec000 con 0x7fa9500c2580 2024-02-17T12:19:23.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.028+0000 7fa958400640 1 -- 172.21.15.114:0/1534981659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa950074840 con 0x7fa9500c2580 2024-02-17T12:19:23.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa94d600640 1 -- 172.21.15.114:0/1534981659 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20405 (secure 0 0 0) 0x7fa93c0ac5e0 con 0x7fa9500c2580 2024-02-17T12:19:23.035 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:23.035 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":71,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:21.725740+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:23.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 -- 172.21.15.114:0/1534981659 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa930066e40 msgr2=0x7fa930069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:23.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa930066e40 0x7fa930069300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa944000f70 tx=0x7fa944009040 comp rx=0 tx=0).stop 2024-02-17T12:19:23.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 -- 172.21.15.114:0/1534981659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 msgr2=0x7fa9500c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:23.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 0x7fa9500c57e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0af040 tx=0x7fa93c019270 comp rx=0 tx=0).stop 2024-02-17T12:19:23.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 -- 172.21.15.114:0/1534981659 shutdown_connections 2024-02-17T12:19:23.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa95014f110 0x7fa95014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:23.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa930066e40 0x7fa930069300 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:23.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9500c2580 0x7fa9500c57e0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:23.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 --2- 172.21.15.114:0/1534981659 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9500c1eb0 0x7fa9500c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:23.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 -- 172.21.15.114:0/1534981659 >> 172.21.15.114:0/1534981659 conn(0x7fa9500a8490 msgr2=0x7fa950071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:23.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 -- 172.21.15.114:0/1534981659 shutdown_connections 2024-02-17T12:19:23.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.032+0000 7fa958400640 1 -- 172.21.15.114:0/1534981659 wait complete. 2024-02-17T12:19:23.056 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-02-17T12:19:23.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.188+0000 7fda72000640 1 Processor -- start 2024-02-17T12:19:23.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda72000640 1 -- start start 2024-02-17T12:19:23.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda72000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda6c0c25a0 0x7fda6c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda72000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda6c06db50 0x7fda6c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda72000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6c156270 con 0x7fda6c150490 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda72000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6c071630 con 0x7fda6c06db50 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda72000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c156550 con 0x7fda6c0c25a0 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda6aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda6c06db50 0x7fda6c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda6aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fda6c06db50 0x7fda6c14ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47532/0 (socket says 172.21.15.114:47532) 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda6aa00640 1 -- 172.21.15.114:0/648763890 learned_addr learned my addr 172.21.15.114:0/648763890 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda6b400640 1 --2- 172.21.15.114:0/648763890 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda6c0c25a0 0x7fda6c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda6aa00640 1 -- 172.21.15.114:0/648763890 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda6c0c25a0 msgr2=0x7fda6c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda6aa00640 1 --2- 172.21.15.114:0/648763890 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda6c0c25a0 0x7fda6c06e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:23.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda6aa00640 1 -- 172.21.15.114:0/648763890 >> v1:172.21.15.116:6789/0 conn(0x7fda6c150490 legacy=0x7fda6c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:23.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.192+0000 7fda6aa00640 1 -- 172.21.15.114:0/648763890 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c156830 con 0x7fda6c06db50 2024-02-17T12:19:23.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda6aa00640 1 --2- 172.21.15.114:0/648763890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c06db50 0x7fda6c14ff50 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fda58009870 tx=0x7fda5801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a8f645f6e2af7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:23.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda6a000640 1 -- 172.21.15.114:0/648763890 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda580ab600 con 0x7fda6c06db50 2024-02-17T12:19:23.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda6a000640 1 -- 172.21.15.114:0/648763890 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda580a7050 con 0x7fda6c06db50 2024-02-17T12:19:23.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda6a000640 1 -- 172.21.15.114:0/648763890 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda580ab980 con 0x7fda6c06db50 2024-02-17T12:19:23.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda72000640 1 -- 172.21.15.114:0/648763890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c06db50 msgr2=0x7fda6c14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:23.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda72000640 1 --2- 172.21.15.114:0/648763890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c06db50 0x7fda6c14ff50 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fda58009870 tx=0x7fda5801c3d0 comp rx=0 tx=0).stop 2024-02-17T12:19:23.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda72000640 1 -- 172.21.15.114:0/648763890 shutdown_connections 2024-02-17T12:19:23.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda72000640 1 --2- 172.21.15.114:0/648763890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c06db50 0x7fda6c14ff50 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:23.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda72000640 1 --2- 172.21.15.114:0/648763890 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda6c0c25a0 0x7fda6c06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:23.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda72000640 1 -- 172.21.15.114:0/648763890 >> 172.21.15.114:0/648763890 conn(0x7fda6c0a8490 msgr2=0x7fda6c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:23.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda72000640 1 -- 172.21.15.114:0/648763890 shutdown_connections 2024-02-17T12:19:23.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda72000640 1 -- 172.21.15.114:0/648763890 wait complete. 2024-02-17T12:19:23.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda72000640 1 Processor -- start 2024-02-17T12:19:23.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.196+0000 7fda72000640 1 -- start start 2024-02-17T12:19:23.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda72000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda6c06db50 0x7fda6c0aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda72000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c0c25a0 0x7fda6c0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda72000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda6c150490 0x7fda6c0c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda72000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c148e80 con 0x7fda6c0c25a0 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda72000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c142af0 con 0x7fda6c06db50 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda72000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c1428c0 con 0x7fda6c150490 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c0c25a0 0x7fda6c0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c0c25a0 0x7fda6c0bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47542/0 (socket says 172.21.15.114:47542) 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6aa00640 1 -- 172.21.15.114:0/1236735573 learned_addr learned my addr 172.21.15.114:0/1236735573 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6b400640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda6c06db50 0x7fda6c0aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6be00640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda6c150490 0x7fda6c0c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:23.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6aa00640 1 -- 172.21.15.114:0/1236735573 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda6c150490 msgr2=0x7fda6c0c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6aa00640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda6c150490 0x7fda6c0c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6aa00640 1 -- 172.21.15.114:0/1236735573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda6c06db50 msgr2=0x7fda6c0aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6aa00640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda6c06db50 0x7fda6c0aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6aa00640 1 -- 172.21.15.114:0/1236735573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda580094d0 con 0x7fda6c0c25a0 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6b400640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda6c06db50 0x7fda6c0aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda6aa00640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c0c25a0 0x7fda6c0bfa00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fda5801cc70 tx=0x7fda58019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda63400640 1 -- 172.21.15.114:0/1236735573 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda580b4420 con 0x7fda6c0c25a0 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda63400640 1 -- 172.21.15.114:0/1236735573 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda580b4580 con 0x7fda6c0c25a0 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda72000640 1 -- 172.21.15.114:0/1236735573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c0aac70 con 0x7fda6c0c25a0 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda63400640 1 -- 172.21.15.114:0/1236735573 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda580b4930 con 0x7fda6c0c25a0 2024-02-17T12:19:23.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda72000640 1 -- 172.21.15.114:0/1236735573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6c149090 con 0x7fda6c0c25a0 2024-02-17T12:19:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda72000640 1 -- 172.21.15.114:0/1236735573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c141f40 con 0x7fda6c0c25a0 2024-02-17T12:19:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.200+0000 7fda63400640 1 -- 172.21.15.114:0/1236735573 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fda580b2070 con 0x7fda6c0c25a0 2024-02-17T12:19:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.204+0000 7fda63400640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda4c066e40 0x7fda4c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.204+0000 7fda63400640 1 -- 172.21.15.114:0/1236735573 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fda5811e940 con 0x7fda6c0c25a0 2024-02-17T12:19:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.204+0000 7fda6b400640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda4c066e40 0x7fda4c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:23.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.204+0000 7fda6b400640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda4c066e40 0x7fda4c069300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fda5c003fd0 tx=0x7fda5c0039e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:23.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.208+0000 7fda63400640 1 -- 172.21.15.114:0/1236735573 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fda6c141f40 con 0x7fda6c0c25a0 2024-02-17T12:19:23.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:23.400+0000 7fda72000640 1 -- 172.21.15.114:0/1236735573 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fda6c141f40 con 0x7fda6c0c25a0 2024-02-17T12:19:24.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda63400640 1 -- 172.21.15.114:0/1236735573 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v52) v1 ==== 119+0+0 (secure 0 0 0) 0x7fda6c141f40 con 0x7fda6c0c25a0 2024-02-17T12:19:24.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 -- 172.21.15.114:0/1236735573 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda4c066e40 msgr2=0x7fda4c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda4c066e40 0x7fda4c069300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fda5c003fd0 tx=0x7fda5c0039e0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 -- 172.21.15.114:0/1236735573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c0c25a0 msgr2=0x7fda6c0bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c0c25a0 0x7fda6c0bfa00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fda5801cc70 tx=0x7fda58019170 comp rx=0 tx=0).stop 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 -- 172.21.15.114:0/1236735573 shutdown_connections 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda6c150490 0x7fda6c0c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fda4c066e40 0x7fda4c069300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda6c0c25a0 0x7fda6c0bfa00 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 --2- 172.21.15.114:0/1236735573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda6c06db50 0x7fda6c0aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 -- 172.21.15.114:0/1236735573 >> 172.21.15.114:0/1236735573 conn(0x7fda6c0a8490 msgr2=0x7fda6c0c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 -- 172.21.15.114:0/1236735573 shutdown_connections 2024-02-17T12:19:24.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.372+0000 7fda72000640 1 -- 172.21.15.114:0/1236735573 wait complete. 2024-02-17T12:19:24.399 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-17T12:19:24.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-02-17T12:19:24.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd6d600640 1 Processor -- start 2024-02-17T12:19:24.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd6d600640 1 -- start start 2024-02-17T12:19:24.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd6d600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680c4b30 0x7fcd681583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:24.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd6d600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd680a6360 0x7fcd68155520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:24.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd6d600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd68155090 con 0x7fcd680c58b0 2024-02-17T12:19:24.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd6d600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd680c6110 con 0x7fcd680a6360 2024-02-17T12:19:24.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd6d600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68159300 con 0x7fcd680c4b30 2024-02-17T12:19:24.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd67400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd680a6360 0x7fcd68155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:24.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd67400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd680a6360 0x7fcd68155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47558/0 (socket says 172.21.15.114:47558) 2024-02-17T12:19:24.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd67400640 1 -- 172.21.15.114:0/181444378 learned_addr learned my addr 172.21.15.114:0/181444378 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:24.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd66000640 1 --2- 172.21.15.114:0/181444378 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680c4b30 0x7fcd681583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:24.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd67400640 1 -- 172.21.15.114:0/181444378 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680c4b30 msgr2=0x7fcd681583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:24.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd67400640 1 --2- 172.21.15.114:0/181444378 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680c4b30 0x7fcd681583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd67400640 1 -- 172.21.15.114:0/181444378 >> v1:172.21.15.116:6789/0 conn(0x7fcd680c58b0 legacy=0x7fcd6806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:24.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd67400640 1 -- 172.21.15.114:0/181444378 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68158a60 con 0x7fcd680a6360 2024-02-17T12:19:24.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.536+0000 7fcd66000640 1 --2- 172.21.15.114:0/181444378 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680c4b30 0x7fcd681583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:24.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd67400640 1 --2- 172.21.15.114:0/181444378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680a6360 0x7fcd68155520 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009870 tx=0x7fcd6001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9daa14639b9bbfe server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:24.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd65600640 1 -- 172.21.15.114:0/181444378 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd600ac620 con 0x7fcd680a6360 2024-02-17T12:19:24.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd65600640 1 -- 172.21.15.114:0/181444378 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd600ac780 con 0x7fcd680a6360 2024-02-17T12:19:24.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd65600640 1 -- 172.21.15.114:0/181444378 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd600acb10 con 0x7fcd680a6360 2024-02-17T12:19:24.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd6d600640 1 -- 172.21.15.114:0/181444378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680a6360 msgr2=0x7fcd68155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:24.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd6d600640 1 --2- 172.21.15.114:0/181444378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680a6360 0x7fcd68155520 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009870 tx=0x7fcd6001c4f0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd6d600640 1 -- 172.21.15.114:0/181444378 shutdown_connections 2024-02-17T12:19:24.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd6d600640 1 --2- 172.21.15.114:0/181444378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680a6360 0x7fcd68155520 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd6d600640 1 --2- 172.21.15.114:0/181444378 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680c4b30 0x7fcd681583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd6d600640 1 -- 172.21.15.114:0/181444378 >> 172.21.15.114:0/181444378 conn(0x7fcd680c3730 msgr2=0x7fcd680c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:24.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd6d600640 1 -- 172.21.15.114:0/181444378 shutdown_connections 2024-02-17T12:19:24.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.540+0000 7fcd6d600640 1 -- 172.21.15.114:0/181444378 wait complete. 2024-02-17T12:19:24.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd6d600640 1 Processor -- start 2024-02-17T12:19:24.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd6d600640 1 -- start start 2024-02-17T12:19:24.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd6d600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680a6360 0x7fcd68151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:24.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd6d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680c4b30 0x7fcd6814a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd6d600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd680c58b0 0x7fcd6814ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd6d600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6814b1a0 con 0x7fcd680c4b30 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd6d600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68156370 con 0x7fcd680c58b0 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd6d600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68156650 con 0x7fcd680a6360 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd66000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680c4b30 0x7fcd6814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd66000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680c4b30 0x7fcd6814a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47560/0 (socket says 172.21.15.114:47560) 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd66000640 1 -- 172.21.15.114:0/2502968355 learned_addr learned my addr 172.21.15.114:0/2502968355 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd66a00640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680a6360 0x7fcd68151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd67400640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd680c58b0 0x7fcd6814ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd66000640 1 -- 172.21.15.114:0/2502968355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680a6360 msgr2=0x7fcd68151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd66000640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680a6360 0x7fcd68151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd66000640 1 -- 172.21.15.114:0/2502968355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd680c58b0 msgr2=0x7fcd6814ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:24.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd66000640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd680c58b0 0x7fcd6814ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:24.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd66000640 1 -- 172.21.15.114:0/2502968355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd600094d0 con 0x7fcd680c4b30 2024-02-17T12:19:24.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd66000640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680c4b30 0x7fcd6814a720 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000c7f0 tx=0x7fcd5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:24.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd5ea00640 1 -- 172.21.15.114:0/2502968355 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5000cea0 con 0x7fcd680c4b30 2024-02-17T12:19:24.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd5ea00640 1 -- 172.21.15.114:0/2502968355 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd50007a30 con 0x7fcd680c4b30 2024-02-17T12:19:24.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd5ea00640 1 -- 172.21.15.114:0/2502968355 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50007dc0 con 0x7fcd680c4b30 2024-02-17T12:19:24.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd6d600640 1 -- 172.21.15.114:0/2502968355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd68156930 con 0x7fcd680c4b30 2024-02-17T12:19:24.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.544+0000 7fcd6d600640 1 -- 172.21.15.114:0/2502968355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd68151d50 con 0x7fcd680c4b30 2024-02-17T12:19:24.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.548+0000 7fcd6d600640 1 -- 172.21.15.114:0/2502968355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd68067170 con 0x7fcd680c4b30 2024-02-17T12:19:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.548+0000 7fcd5ea00640 1 -- 172.21.15.114:0/2502968355 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fcd500113f0 con 0x7fcd680c4b30 2024-02-17T12:19:24.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.548+0000 7fcd5ea00640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd44066e40 0x7fcd44069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:24.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.548+0000 7fcd5ea00640 1 -- 172.21.15.114:0/2502968355 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcd50084f10 con 0x7fcd680c4b30 2024-02-17T12:19:24.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.548+0000 7fcd66a00640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd44066e40 0x7fcd44069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:24.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.548+0000 7fcd66a00640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd44066e40 0x7fcd44069300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800b450 tx=0x7fcd5800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:24.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.552+0000 7fcd5ea00640 1 -- 172.21.15.114:0/2502968355 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd50051a40 con 0x7fcd680c4b30 2024-02-17T12:19:24.663 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-02-17T12:19:24.660+0000 7f7b5d000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:19:24.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:24.744+0000 7fcd6d600640 1 -- 172.21.15.114:0/2502968355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcd68156e50 con 0x7fcd680c4b30 2024-02-17T12:19:25.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.376+0000 7fcd5ea00640 1 -- 172.21.15.114:0/2502968355 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v53) v1 ==== 123+0+0 (secure 0 0 0) 0x7fcd5001f0c0 con 0x7fcd680c4b30 2024-02-17T12:19:25.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 -- 172.21.15.114:0/2502968355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd44066e40 msgr2=0x7fcd44069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd44066e40 0x7fcd44069300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800b450 tx=0x7fcd5800d040 comp rx=0 tx=0).stop 2024-02-17T12:19:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 -- 172.21.15.114:0/2502968355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680c4b30 msgr2=0x7fcd6814a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680c4b30 0x7fcd6814a720 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000c7f0 tx=0x7fcd5000ccb0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 -- 172.21.15.114:0/2502968355 shutdown_connections 2024-02-17T12:19:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd680c58b0 0x7fcd6814ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcd44066e40 0x7fcd44069300 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd680c4b30 0x7fcd6814a720 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 --2- 172.21.15.114:0/2502968355 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcd680a6360 0x7fcd68151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 -- 172.21.15.114:0/2502968355 >> 172.21.15.114:0/2502968355 conn(0x7fcd680c3730 msgr2=0x7fcd680c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 -- 172.21.15.114:0/2502968355 shutdown_connections 2024-02-17T12:19:25.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.380+0000 7fcd6d600640 1 -- 172.21.15.114:0/2502968355 wait complete. 2024-02-17T12:19:25.409 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-02-17T12:19:25.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:19:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.540+0000 7f1e47000640 1 Processor -- start 2024-02-17T12:19:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.540+0000 7f1e47000640 1 -- start start 2024-02-17T12:19:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e47000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1e400c4720 0x7f1e401558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e47000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e400c8000 con 0x7f1e400c1920 2024-02-17T12:19:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e47000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e40070c10 con 0x7f1e40152570 2024-02-17T12:19:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e47000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e40070ef0 con 0x7f1e400c4720 2024-02-17T12:19:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e45200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1e400c1920 0x7f1e401551b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56110/0 (socket says 172.21.15.114:56110) 2024-02-17T12:19:25.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e45200640 1 -- 172.21.15.114:0/404792465 learned_addr learned my addr 172.21.15.114:0/404792465 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089520347 0 0) 0x7f1e400c8000 con 0x7f1e400c1920 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e46600640 1 --2- 172.21.15.114:0/404792465 >> v2:172.21.15.116:3300/0 conn(0x7f1e400c4720 0x7f1e401558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e28003530 con 0x7f1e400c1920 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1142400787 0 0) 0x7f1e28003530 con 0x7f1e400c1920 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 >> v2:172.21.15.116:3300/0 conn(0x7f1e400c4720 msgr2=0x7f1e401558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 --2- 172.21.15.114:0/404792465 >> v2:172.21.15.116:3300/0 conn(0x7f1e400c4720 0x7f1e401558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 >> v1:172.21.15.116:6789/0 conn(0x7f1e40152570 legacy=0x7f1e400c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400c6cc0 con 0x7f1e400c1920 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f1e2c001680 con 0x7f1e400c1920 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e46600640 1 --2- 172.21.15.114:0/404792465 >> v2:172.21.15.116:3300/0 conn(0x7f1e400c4720 0x7f1e401558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 >> v1:172.21.15.114:6789/0 conn(0x7f1e400c1920 legacy=0x7f1e401551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e280047d0 0x7f1e28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1e280052b0 0x7f1e2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e40070ef0 con 0x7f1e28003980 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2800c180 con 0x7f1e280047d0 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2800c340 con 0x7f1e280052b0 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e45c00640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e45200640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e280047d0 0x7f1e28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e46600640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1e280052b0 0x7f1e2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e45c00640 1 -- 172.21.15.114:0/404792465 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1e280052b0 msgr2=0x7f1e2800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e45c00640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1e280052b0 0x7f1e2800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e45c00640 1 -- 172.21.15.114:0/404792465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e280047d0 msgr2=0x7f1e28004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e45c00640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e280047d0 0x7f1e28004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e45c00640 1 -- 172.21.15.114:0/404792465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28003530 con 0x7f1e28003980 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e45200640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e280047d0 0x7f1e28004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.544+0000 7f1e46600640 1 -- 172.21.15.114:0/404792465 reap_dead start 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e45c00640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e28003da0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1e34001e40 tx=0x7f1e3401c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a907e055e48251 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34003980 con 0x7f1e28003980 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e34003ae0 con 0x7f1e28003980 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e3fe00640 1 -- 172.21.15.114:0/404792465 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34003e90 con 0x7f1e28003980 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e47000640 1 -- 172.21.15.114:0/404792465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 msgr2=0x7f1e28003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e47000640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e28003da0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1e34001e40 tx=0x7f1e3401c720 comp rx=0 tx=0).stop 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e47000640 1 -- 172.21.15.114:0/404792465 shutdown_connections 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e47000640 1 --2- 172.21.15.114:0/404792465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e28003da0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e47000640 1 -- 172.21.15.114:0/404792465 >> 172.21.15.114:0/404792465 conn(0x7f1e40066960 msgr2=0x7f1e40066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e47000640 1 -- 172.21.15.114:0/404792465 shutdown_connections 2024-02-17T12:19:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e47000640 1 -- 172.21.15.114:0/404792465 wait complete. 2024-02-17T12:19:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e47000640 1 Processor -- start 2024-02-17T12:19:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.548+0000 7f1e47000640 1 -- start start 2024-02-17T12:19:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e47000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e4014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e47000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1e4014f4c0 0x7f1e4014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e47000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e40146520 0x7f1e401469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e47000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4014e030 con 0x7f1e28003980 2024-02-17T12:19:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e47000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e401ee050 con 0x7f1e40146520 2024-02-17T12:19:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e47000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4014cc50 con 0x7f1e4014f4c0 2024-02-17T12:19:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e45c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e4014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e45c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e4014cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35380/0 (socket says 172.21.15.114:35380) 2024-02-17T12:19:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e45c00640 1 -- 172.21.15.114:0/392648906 learned_addr learned my addr 172.21.15.114:0/392648906 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:25.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e45c00640 1 -- 172.21.15.114:0/392648906 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1e4014f4c0 msgr2=0x7f1e4014d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e45c00640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1e4014f4c0 0x7f1e4014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e45c00640 1 -- 172.21.15.114:0/392648906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e40146520 msgr2=0x7f1e401469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e45c00640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e40146520 0x7f1e401469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e45c00640 1 -- 172.21.15.114:0/392648906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e401529f0 con 0x7f1e28003980 2024-02-17T12:19:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e45c00640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e4014cee0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1e3401c550 tx=0x7f1e28005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e3d600640 1 -- 172.21.15.114:0/392648906 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34006e20 con 0x7f1e28003980 2024-02-17T12:19:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e3d600640 1 -- 172.21.15.114:0/392648906 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e34005130 con 0x7f1e28003980 2024-02-17T12:19:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e47000640 1 -- 172.21.15.114:0/392648906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e401ee2c0 con 0x7f1e28003980 2024-02-17T12:19:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e3d600640 1 -- 172.21.15.114:0/392648906 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340054c0 con 0x7f1e28003980 2024-02-17T12:19:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e47000640 1 -- 172.21.15.114:0/392648906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4014dbf0 con 0x7f1e28003980 2024-02-17T12:19:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e47000640 1 -- 172.21.15.114:0/392648906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4004eef0 con 0x7f1e28003980 2024-02-17T12:19:25.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.552+0000 7f1e3d600640 1 -- 172.21.15.114:0/392648906 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1e34005620 con 0x7f1e28003980 2024-02-17T12:19:25.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.556+0000 7f1e3d600640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1e20066e40 0x7f1e20069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.556+0000 7f1e3d600640 1 -- 172.21.15.114:0/392648906 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1e3411dd70 con 0x7f1e28003980 2024-02-17T12:19:25.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.556+0000 7f1e45200640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1e20066e40 0x7f1e20069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.556+0000 7f1e45200640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1e20066e40 0x7f1e20069300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c000f70 tx=0x7f1e2c001b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:25.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.560+0000 7f1e3d600640 1 -- 172.21.15.114:0/392648906 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1e340ea880 con 0x7f1e28003980 2024-02-17T12:19:25.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.744+0000 7f1e47000640 1 -- 172.21.15.114:0/392648906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e40070610 con 0x7f1e28003980 2024-02-17T12:19:25.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.744+0000 7f1e3d600640 1 -- 172.21.15.114:0/392648906 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6187 (secure 0 0 0) 0x7f1e340b8090 con 0x7f1e28003980 2024-02-17T12:19:25.749 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:25.749 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:04.061245+0000","modified":"2024-02-17T12:19:07.080013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/709959478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":709959478},{"type":"v1","addr":"172.21.15.114:6837","nonce":709959478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:21.726155+0000","modified":"2024-02-17T12:19:24.747374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1982789506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1982789506},{"type":"v1","addr":"172.21.15.114:6836","nonce":1982789506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-02-17T12:19:25.750 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 53 2024-02-17T12:19:25.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 -- 172.21.15.114:0/392648906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1e20066e40 msgr2=0x7f1e20069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1e20066e40 0x7f1e20069300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c000f70 tx=0x7f1e2c001b30 comp rx=0 tx=0).stop 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 -- 172.21.15.114:0/392648906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 msgr2=0x7f1e4014cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e4014cee0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1e3401c550 tx=0x7f1e28005800 comp rx=0 tx=0).stop 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 -- 172.21.15.114:0/392648906 shutdown_connections 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e40146520 0x7f1e401469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1e4014f4c0 0x7f1e4014d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1e20066e40 0x7f1e20069300 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 --2- 172.21.15.114:0/392648906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e28003980 0x7f1e4014cee0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 -- 172.21.15.114:0/392648906 >> 172.21.15.114:0/392648906 conn(0x7f1e40066960 msgr2=0x7f1e4014c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 -- 172.21.15.114:0/392648906 shutdown_connections 2024-02-17T12:19:25.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.748+0000 7f1e47000640 1 -- 172.21.15.114:0/392648906 wait complete. 2024-02-17T12:19:25.770 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:25.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.900+0000 7f68bb000640 1 Processor -- start 2024-02-17T12:19:25.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.900+0000 7f68bb000640 1 -- start start 2024-02-17T12:19:25.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68bb000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f68b41521d0 0x7f68b406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68bb000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f68b4071d80 0x7f68b406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68bb000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b40c0820 con 0x7f68b406f390 2024-02-17T12:19:25.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68bb000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b406bab0 con 0x7f68b4071d80 2024-02-17T12:19:25.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68bb000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40722d0 con 0x7f68b41521d0 2024-02-17T12:19:25.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68ba600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f68b4071d80 0x7f68b406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68b9200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f68b406f390 0x7f68b4154c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56122/0 (socket says 172.21.15.114:56122) 2024-02-17T12:19:25.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68b9200640 1 -- 172.21.15.114:0/4004250270 learned_addr learned my addr 172.21.15.114:0/4004250270 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:25.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68b9c00640 1 --2- 172.21.15.114:0/4004250270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f68b41521d0 0x7f68b406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68ba600640 1 -- 172.21.15.114:0/4004250270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f68b41521d0 msgr2=0x7f68b406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:25.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68ba600640 1 --2- 172.21.15.114:0/4004250270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f68b41521d0 0x7f68b406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68ba600640 1 -- 172.21.15.114:0/4004250270 >> v1:172.21.15.114:6789/0 conn(0x7f68b406f390 legacy=0x7f68b4154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.904+0000 7f68ba600640 1 -- 172.21.15.114:0/4004250270 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40c0a70 con 0x7f68b4071d80 2024-02-17T12:19:25.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68ba600640 1 --2- 172.21.15.114:0/4004250270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 0x7f68b406b150 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009d90 tx=0x7f68ac01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d05091117190364 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:25.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68b3e00640 1 -- 172.21.15.114:0/4004250270 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0a5820 con 0x7f68b4071d80 2024-02-17T12:19:25.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68b3e00640 1 -- 172.21.15.114:0/4004250270 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac0a5980 con 0x7f68b4071d80 2024-02-17T12:19:25.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68b3e00640 1 -- 172.21.15.114:0/4004250270 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0a5d10 con 0x7f68b4071d80 2024-02-17T12:19:25.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 -- 172.21.15.114:0/4004250270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 msgr2=0x7f68b406b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 --2- 172.21.15.114:0/4004250270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 0x7f68b406b150 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009d90 tx=0x7f68ac01c850 comp rx=0 tx=0).stop 2024-02-17T12:19:25.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 -- 172.21.15.114:0/4004250270 shutdown_connections 2024-02-17T12:19:25.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 --2- 172.21.15.114:0/4004250270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 0x7f68b406b150 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 --2- 172.21.15.114:0/4004250270 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f68b41521d0 0x7f68b406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 -- 172.21.15.114:0/4004250270 >> 172.21.15.114:0/4004250270 conn(0x7f68b4066f60 msgr2=0x7f68b40c73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:25.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 -- 172.21.15.114:0/4004250270 shutdown_connections 2024-02-17T12:19:25.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 -- 172.21.15.114:0/4004250270 wait complete. 2024-02-17T12:19:25.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 Processor -- start 2024-02-17T12:19:25.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 -- start start 2024-02-17T12:19:25.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f68b406f390 0x7f68b41489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 0x7f68b414b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68b41521d0 0x7f68b4147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40ab480 con 0x7f68b4071d80 2024-02-17T12:19:25.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b4148fd0 con 0x7f68b41521d0 2024-02-17T12:19:25.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.908+0000 7f68bb000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40abfe0 con 0x7f68b406f390 2024-02-17T12:19:25.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 0x7f68b414b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 0x7f68b414b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35396/0 (socket says 172.21.15.114:35396) 2024-02-17T12:19:25.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b9200640 1 -- 172.21.15.114:0/2316746085 learned_addr learned my addr 172.21.15.114:0/2316746085 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:25.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68ba600640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68b41521d0 0x7f68b4147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b9c00640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f68b406f390 0x7f68b41489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b9200640 1 -- 172.21.15.114:0/2316746085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f68b406f390 msgr2=0x7f68b41489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b9200640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f68b406f390 0x7f68b41489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b9200640 1 -- 172.21.15.114:0/2316746085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68b41521d0 msgr2=0x7f68b4147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:25.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b9200640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68b41521d0 0x7f68b4147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:25.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b9200640 1 -- 172.21.15.114:0/2316746085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac009a70 con 0x7f68b4071d80 2024-02-17T12:19:25.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b9200640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 0x7f68b414b380 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f68a000c370 tx=0x7f68a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:25.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b1600640 1 -- 172.21.15.114:0/2316746085 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0005cf0 con 0x7f68b4071d80 2024-02-17T12:19:25.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b1600640 1 -- 172.21.15.114:0/2316746085 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a0005e50 con 0x7f68b4071d80 2024-02-17T12:19:25.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b1600640 1 -- 172.21.15.114:0/2316746085 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a00072f0 con 0x7f68b4071d80 2024-02-17T12:19:25.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68bb000640 1 -- 172.21.15.114:0/2316746085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b40c1b60 con 0x7f68b4071d80 2024-02-17T12:19:25.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68bb000640 1 -- 172.21.15.114:0/2316746085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b40ab6b0 con 0x7f68b4071d80 2024-02-17T12:19:25.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68bb000640 1 -- 172.21.15.114:0/2316746085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b404eef0 con 0x7f68b4071d80 2024-02-17T12:19:25.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.912+0000 7f68b1600640 1 -- 172.21.15.114:0/2316746085 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f68a0007450 con 0x7f68b4071d80 2024-02-17T12:19:25.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.916+0000 7f68b1600640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6894066e40 0x7f6894069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:25.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.916+0000 7f68b1600640 1 -- 172.21.15.114:0/2316746085 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f68a0084250 con 0x7f68b4071d80 2024-02-17T12:19:25.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.916+0000 7f68b9c00640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6894066e40 0x7f6894069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:25.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.916+0000 7f68b9c00640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6894066e40 0x7f6894069300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f68a8007a60 tx=0x7f68a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:25.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:25.920+0000 7f68b1600640 1 -- 172.21.15.114:0/2316746085 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f68a0050d90 con 0x7f68b4071d80 2024-02-17T12:19:26.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.076+0000 7f68bb000640 1 -- 172.21.15.114:0/2316746085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68b40ac120 con 0x7f68b4071d80 2024-02-17T12:19:26.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.076+0000 7f68b1600640 1 -- 172.21.15.114:0/2316746085 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20392 (secure 0 0 0) 0x7f68a0054450 con 0x7f68b4071d80 2024-02-17T12:19:26.080 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:26.081 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:23.364663+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:26.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 -- 172.21.15.114:0/2316746085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6894066e40 msgr2=0x7f6894069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6894066e40 0x7f6894069300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f68a8007a60 tx=0x7f68a8008040 comp rx=0 tx=0).stop 2024-02-17T12:19:26.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 -- 172.21.15.114:0/2316746085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 msgr2=0x7f68b414b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 0x7f68b414b380 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f68a000c370 tx=0x7f68a000c830 comp rx=0 tx=0).stop 2024-02-17T12:19:26.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 -- 172.21.15.114:0/2316746085 shutdown_connections 2024-02-17T12:19:26.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68b41521d0 0x7f68b4147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6894066e40 0x7f6894069300 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68b4071d80 0x7f68b414b380 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 --2- 172.21.15.114:0/2316746085 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f68b406f390 0x7f68b41489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 -- 172.21.15.114:0/2316746085 >> 172.21.15.114:0/2316746085 conn(0x7f68b4066f60 msgr2=0x7f68b4151110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:26.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 -- 172.21.15.114:0/2316746085 shutdown_connections 2024-02-17T12:19:26.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.080+0000 7f68bb000640 1 -- 172.21.15.114:0/2316746085 wait complete. 2024-02-17T12:19:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-17T12:19:26.102 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:19:26.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.232+0000 7f5877200640 1 Processor -- start 2024-02-17T12:19:26.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.232+0000 7f5877200640 1 -- start start 2024-02-17T12:19:26.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5877200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f58780a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5877200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f58781522c0 0x7f58781557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5877200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58780c1920 con 0x7f587814eaa0 2024-02-17T12:19:26.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5877200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58780aaf30 con 0x7f58781522c0 2024-02-17T12:19:26.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5877200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58780c2b10 con 0x7f58780c32f0 2024-02-17T12:19:26.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5875e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f58780a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5875400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f58781522c0 0x7f58781557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5875e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f58780a93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:44572/0 (socket says 172.21.15.114:44572) 2024-02-17T12:19:26.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5875e00640 1 -- 172.21.15.114:0/1343795242 learned_addr learned my addr 172.21.15.114:0/1343795242 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:26.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5875e00640 1 -- 172.21.15.114:0/1343795242 >> v2:172.21.15.116:3300/0 conn(0x7f58781522c0 msgr2=0x7f58781557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:26.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5875e00640 1 --2- 172.21.15.114:0/1343795242 >> v2:172.21.15.116:3300/0 conn(0x7f58781522c0 0x7f58781557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5875e00640 1 -- 172.21.15.114:0/1343795242 >> v1:172.21.15.116:6789/0 conn(0x7f587814eaa0 legacy=0x7f587806d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5875e00640 1 -- 172.21.15.114:0/1343795242 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58780a98f0 con 0x7f58780c32f0 2024-02-17T12:19:26.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.236+0000 7f5875e00640 1 --2- 172.21.15.114:0/1343795242 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f58780a93b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5868009e50 tx=0x7f586801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f9cbb137709c246 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:26.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5874a00640 1 -- 172.21.15.114:0/1343795242 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680a5660 con 0x7f58780c32f0 2024-02-17T12:19:26.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5874a00640 1 -- 172.21.15.114:0/1343795242 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58680a57c0 con 0x7f58780c32f0 2024-02-17T12:19:26.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5874a00640 1 -- 172.21.15.114:0/1343795242 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680a5b50 con 0x7f58780c32f0 2024-02-17T12:19:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 -- 172.21.15.114:0/1343795242 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 msgr2=0x7f58780a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 --2- 172.21.15.114:0/1343795242 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f58780a93b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5868009e50 tx=0x7f586801c9a0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 -- 172.21.15.114:0/1343795242 shutdown_connections 2024-02-17T12:19:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 --2- 172.21.15.114:0/1343795242 >> v2:172.21.15.116:3300/0 conn(0x7f58781522c0 0x7f58781557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 --2- 172.21.15.114:0/1343795242 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f58780a93b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 -- 172.21.15.114:0/1343795242 >> 172.21.15.114:0/1343795242 conn(0x7f58780a8660 msgr2=0x7f58780a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:26.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 -- 172.21.15.114:0/1343795242 shutdown_connections 2024-02-17T12:19:26.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 -- 172.21.15.114:0/1343795242 wait complete. 2024-02-17T12:19:26.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 Processor -- start 2024-02-17T12:19:26.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 -- start start 2024-02-17T12:19:26.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f587814d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f587814eaa0 0x7f5878140950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58781522c0 0x7f5878140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58781413d0 con 0x7f58781522c0 2024-02-17T12:19:26.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58780c50d0 con 0x7f587814eaa0 2024-02-17T12:19:26.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5877200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58780c53b0 con 0x7f58780c32f0 2024-02-17T12:19:26.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5876800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58781522c0 0x7f5878140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5875e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f587814d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5875400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f587814eaa0 0x7f5878140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5876800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58781522c0 0x7f5878140e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35408/0 (socket says 172.21.15.114:35408) 2024-02-17T12:19:26.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5875e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f587814d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:44586/0 (socket says 172.21.15.114:44586) 2024-02-17T12:19:26.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.240+0000 7f5876800640 1 -- 172.21.15.114:0/2613676871 learned_addr learned my addr 172.21.15.114:0/2613676871 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:26.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f5875e00640 1 -- 172.21.15.114:0/2613676871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f587814eaa0 msgr2=0x7f5878140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f5875e00640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f587814eaa0 0x7f5878140950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f5875e00640 1 -- 172.21.15.114:0/2613676871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58781522c0 msgr2=0x7f5878140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f5875e00640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58781522c0 0x7f5878140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f5875e00640 1 -- 172.21.15.114:0/2613676871 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868009b30 con 0x7f58780c32f0 2024-02-17T12:19:26.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f5876800640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58781522c0 0x7f5878140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:26.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f5875e00640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f587814d910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f58680ab000 tx=0x7f5868019740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:26.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f586e000640 1 -- 172.21.15.114:0/2613676871 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680b8670 con 0x7f58780c32f0 2024-02-17T12:19:26.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f586e000640 1 -- 172.21.15.114:0/2613676871 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58680b87d0 con 0x7f58780c32f0 2024-02-17T12:19:26.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f586e000640 1 -- 172.21.15.114:0/2613676871 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680b8b80 con 0x7f58780c32f0 2024-02-17T12:19:26.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f5877200640 1 -- 172.21.15.114:0/2613676871 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58780c5690 con 0x7f58780c32f0 2024-02-17T12:19:26.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f5877200640 1 -- 172.21.15.114:0/2613676871 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58780c5c50 con 0x7f58780c32f0 2024-02-17T12:19:26.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f5877200640 1 -- 172.21.15.114:0/2613676871 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587804eef0 con 0x7f58780c32f0 2024-02-17T12:19:26.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f586e000640 1 -- 172.21.15.114:0/2613676871 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f58680b8ce0 con 0x7f58780c32f0 2024-02-17T12:19:26.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f586e000640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5858066e40 0x7f5858069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.244+0000 7f586e000640 1 -- 172.21.15.114:0/2613676871 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f58681201f0 con 0x7f58780c32f0 2024-02-17T12:19:26.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.248+0000 7f5875400640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5858066e40 0x7f5858069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.248+0000 7f5875400640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5858066e40 0x7f5858069300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5878154ff0 tx=0x7f5864009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:26.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.248+0000 7f586e000640 1 -- 172.21.15.114:0/2613676871 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f58680ecec0 con 0x7f58780c32f0 2024-02-17T12:19:26.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.400+0000 7f5877200640 1 -- 172.21.15.114:0/2613676871 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f587806ece0 con 0x7f5858066e40 2024-02-17T12:19:26.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.416+0000 7f586e000640 1 -- 172.21.15.114:0/2613676871 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+518901 (secure 0 0 0) 0x7f587806ece0 con 0x7f5858066e40 2024-02-17T12:19:26.423 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:26.427 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:19:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 -- 172.21.15.114:0/2613676871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5858066e40 msgr2=0x7f5858069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5858066e40 0x7f5858069300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5878154ff0 tx=0x7f5864009190 comp rx=0 tx=0).stop 2024-02-17T12:19:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 -- 172.21.15.114:0/2613676871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 msgr2=0x7f587814d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f587814d910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f58680ab000 tx=0x7f5868019740 comp rx=0 tx=0).stop 2024-02-17T12:19:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 -- 172.21.15.114:0/2613676871 shutdown_connections 2024-02-17T12:19:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5858066e40 0x7f5858069300 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58781522c0 0x7f5878140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f587814eaa0 0x7f5878140950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 --2- 172.21.15.114:0/2613676871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f58780c32f0 0x7f587814d910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 -- 172.21.15.114:0/2613676871 >> 172.21.15.114:0/2613676871 conn(0x7f58780a8660 msgr2=0x7f587806b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 -- 172.21.15.114:0/2613676871 shutdown_connections 2024-02-17T12:19:26.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.420+0000 7f5877200640 1 -- 172.21.15.114:0/2613676871 wait complete. 2024-02-17T12:19:26.442 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-02-17T12:19:25.254893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596039,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":223,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":270,"acting":270,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":224,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244816,"kb_used_data":7840,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729904,"statfs":{"total":773094113280,"available":772843421696,"internally_reserved":0,"allocated":8028160,"data_stored":4146551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914084"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210592+0000","last_change":"2024-02-17T12:19:04.712400+0000","last_active":"2024-02-17T12:19:06.210592+0000","last_peered":"2024-02-17T12:19:06.210592+0000","last_clean":"2024-02-17T12:19:06.210592+0000","last_became_active":"2024-02-17T12:19:04.711598+0000","last_became_peered":"2024-02-17T12:19:04.711598+0000","last_unstale":"2024-02-17T12:19:06.210592+0000","last_undegraded":"2024-02-17T12:19:06.210592+0000","last_fullsized":"2024-02-17T12:19:06.210592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:02.628891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708335+0000","last_change":"2024-02-17T12:19:04.723008+0000","last_active":"2024-02-17T12:19:05.708335+0000","last_peered":"2024-02-17T12:19:05.708335+0000","last_clean":"2024-02-17T12:19:05.708335+0000","last_became_active":"2024-02-17T12:19:04.722730+0000","last_became_peered":"2024-02-17T12:19:04.722730+0000","last_unstale":"2024-02-17T12:19:05.708335+0000","last_undegraded":"2024-02-17T12:19:05.708335+0000","last_fullsized":"2024-02-17T12:19:05.708335+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:43.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537537+0000","last_change":"2024-02-17T12:19:04.710193+0000","last_active":"2024-02-17T12:19:23.537537+0000","last_peered":"2024-02-17T12:19:23.537537+0000","last_clean":"2024-02-17T12:19:23.537537+0000","last_became_active":"2024-02-17T12:19:04.709527+0000","last_became_peered":"2024-02-17T12:19:04.709527+0000","last_unstale":"2024-02-17T12:19:23.537537+0000","last_undegraded":"2024-02-17T12:19:23.537537+0000","last_fullsized":"2024-02-17T12:19:23.537537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:10:56.143323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537666+0000","last_change":"2024-02-17T12:19:04.728530+0000","last_active":"2024-02-17T12:19:23.537666+0000","last_peered":"2024-02-17T12:19:23.537666+0000","last_clean":"2024-02-17T12:19:23.537666+0000","last_became_active":"2024-02-17T12:19:04.728245+0000","last_became_peered":"2024-02-17T12:19:04.728245+0000","last_unstale":"2024-02-17T12:19:23.537666+0000","last_undegraded":"2024-02-17T12:19:23.537666+0000","last_fullsized":"2024-02-17T12:19:23.537666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:22.116393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535753+0000","last_change":"2024-02-17T12:19:22.369693+0000","last_active":"2024-02-17T12:19:23.535753+0000","last_peered":"2024-02-17T12:19:23.535753+0000","last_clean":"2024-02-17T12:19:23.535753+0000","last_became_active":"2024-02-17T12:19:22.368141+0000","last_became_peered":"2024-02-17T12:19:22.368141+0000","last_unstale":"2024-02-17T12:19:23.535753+0000","last_undegraded":"2024-02-17T12:19:23.535753+0000","last_fullsized":"2024-02-17T12:19:23.535753+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:16.792200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380238+0000","last_change":"2024-02-17T12:19:04.727165+0000","last_active":"2024-02-17T12:19:23.380238+0000","last_peered":"2024-02-17T12:19:23.380238+0000","last_clean":"2024-02-17T12:19:23.380238+0000","last_became_active":"2024-02-17T12:19:04.726850+0000","last_became_peered":"2024-02-17T12:19:04.726850+0000","last_unstale":"2024-02-17T12:19:23.380238+0000","last_undegraded":"2024-02-17T12:19:23.380238+0000","last_fullsized":"2024-02-17T12:19:23.380238+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:54.875823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711199+0000","last_change":"2024-02-17T12:19:04.713676+0000","last_active":"2024-02-17T12:19:05.711199+0000","last_peered":"2024-02-17T12:19:05.711199+0000","last_clean":"2024-02-17T12:19:05.711199+0000","last_became_active":"2024-02-17T12:19:04.710032+0000","last_became_peered":"2024-02-17T12:19:04.710032+0000","last_unstale":"2024-02-17T12:19:05.711199+0000","last_undegraded":"2024-02-17T12:19:05.711199+0000","last_fullsized":"2024-02-17T12:19:05.711199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536303+0000","last_change":"2024-02-17T12:19:04.714280+0000","last_active":"2024-02-17T12:19:23.536303+0000","last_peered":"2024-02-17T12:19:23.536303+0000","last_clean":"2024-02-17T12:19:23.536303+0000","last_became_active":"2024-02-17T12:19:04.714025+0000","last_became_peered":"2024-02-17T12:19:04.714025+0000","last_unstale":"2024-02-17T12:19:23.536303+0000","last_undegraded":"2024-02-17T12:19:23.536303+0000","last_fullsized":"2024-02-17T12:19:23.536303+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:04:31.444208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536568+0000","last_change":"2024-02-17T12:19:22.376606+0000","last_active":"2024-02-17T12:19:23.536568+0000","last_peered":"2024-02-17T12:19:23.536568+0000","last_clean":"2024-02-17T12:19:23.536568+0000","last_became_active":"2024-02-17T12:19:22.375794+0000","last_became_peered":"2024-02-17T12:19:22.375794+0000","last_unstale":"2024-02-17T12:19:23.536568+0000","last_undegraded":"2024-02-17T12:19:23.536568+0000","last_fullsized":"2024-02-17T12:19:23.536568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:41:26.244504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711186+0000","last_change":"2024-02-17T12:19:04.716344+0000","last_active":"2024-02-17T12:19:05.711186+0000","last_peered":"2024-02-17T12:19:05.711186+0000","last_clean":"2024-02-17T12:19:05.711186+0000","last_became_active":"2024-02-17T12:19:04.716003+0000","last_became_peered":"2024-02-17T12:19:04.716003+0000","last_unstale":"2024-02-17T12:19:05.711186+0000","last_undegraded":"2024-02-17T12:19:05.711186+0000","last_fullsized":"2024-02-17T12:19:05.711186+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:37.092834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537290+0000","last_change":"2024-02-17T12:19:22.380385+0000","last_active":"2024-02-17T12:19:23.537290+0000","last_peered":"2024-02-17T12:19:23.537290+0000","last_clean":"2024-02-17T12:19:23.537290+0000","last_became_active":"2024-02-17T12:19:22.380030+0000","last_became_peered":"2024-02-17T12:19:22.380030+0000","last_unstale":"2024-02-17T12:19:23.537290+0000","last_undegraded":"2024-02-17T12:19:23.537290+0000","last_fullsized":"2024-02-17T12:19:23.537290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:33:39.599699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.712377+0000","last_change":"2024-02-17T12:19:04.705511+0000","last_active":"2024-02-17T12:19:05.712377+0000","last_peered":"2024-02-17T12:19:05.712377+0000","last_clean":"2024-02-17T12:19:05.712377+0000","last_became_active":"2024-02-17T12:19:04.705195+0000","last_became_peered":"2024-02-17T12:19:04.705195+0000","last_unstale":"2024-02-17T12:19:05.712377+0000","last_undegraded":"2024-02-17T12:19:05.712377+0000","last_fullsized":"2024-02-17T12:19:05.712377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380515+0000","last_change":"2024-02-17T12:19:22.376957+0000","last_active":"2024-02-17T12:19:23.380515+0000","last_peered":"2024-02-17T12:19:23.380515+0000","last_clean":"2024-02-17T12:19:23.380515+0000","last_became_active":"2024-02-17T12:19:22.375810+0000","last_became_peered":"2024-02-17T12:19:22.375810+0000","last_unstale":"2024-02-17T12:19:23.380515+0000","last_undegraded":"2024-02-17T12:19:23.380515+0000","last_fullsized":"2024-02-17T12:19:23.380515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:06:06.364890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210616+0000","last_change":"2024-02-17T12:19:04.721693+0000","last_active":"2024-02-17T12:19:06.210616+0000","last_peered":"2024-02-17T12:19:06.210616+0000","last_clean":"2024-02-17T12:19:06.210616+0000","last_became_active":"2024-02-17T12:19:04.721343+0000","last_became_peered":"2024-02-17T12:19:04.721343+0000","last_unstale":"2024-02-17T12:19:06.210616+0000","last_undegraded":"2024-02-17T12:19:06.210616+0000","last_fullsized":"2024-02-17T12:19:06.210616+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:38.425090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381058+0000","last_change":"2024-02-17T12:19:22.370504+0000","last_active":"2024-02-17T12:19:23.381058+0000","last_peered":"2024-02-17T12:19:23.381058+0000","last_clean":"2024-02-17T12:19:23.381058+0000","last_became_active":"2024-02-17T12:19:22.370262+0000","last_became_peered":"2024-02-17T12:19:22.370262+0000","last_unstale":"2024-02-17T12:19:23.381058+0000","last_undegraded":"2024-02-17T12:19:23.381058+0000","last_fullsized":"2024-02-17T12:19:23.381058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:43:12.017524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708086+0000","last_change":"2024-02-17T12:19:04.717487+0000","last_active":"2024-02-17T12:19:05.708086+0000","last_peered":"2024-02-17T12:19:05.708086+0000","last_clean":"2024-02-17T12:19:05.708086+0000","last_became_active":"2024-02-17T12:19:04.717208+0000","last_became_peered":"2024-02-17T12:19:04.717208+0000","last_unstale":"2024-02-17T12:19:05.708086+0000","last_undegraded":"2024-02-17T12:19:05.708086+0000","last_fullsized":"2024-02-17T12:19:05.708086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:36:18.116201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210251+0000","last_change":"2024-02-17T12:19:04.720687+0000","last_active":"2024-02-17T12:19:06.210251+0000","last_peered":"2024-02-17T12:19:06.210251+0000","last_clean":"2024-02-17T12:19:06.210251+0000","last_became_active":"2024-02-17T12:19:04.720429+0000","last_became_peered":"2024-02-17T12:19:04.720429+0000","last_unstale":"2024-02-17T12:19:06.210251+0000","last_undegraded":"2024-02-17T12:19:06.210251+0000","last_fullsized":"2024-02-17T12:19:06.210251+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:13:30.982744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536857+0000","last_change":"2024-02-17T12:19:04.711936+0000","last_active":"2024-02-17T12:19:23.536857+0000","last_peered":"2024-02-17T12:19:23.536857+0000","last_clean":"2024-02-17T12:19:23.536857+0000","last_became_active":"2024-02-17T12:19:04.711624+0000","last_became_peered":"2024-02-17T12:19:04.711624+0000","last_unstale":"2024-02-17T12:19:23.536857+0000","last_undegraded":"2024-02-17T12:19:23.536857+0000","last_fullsized":"2024-02-17T12:19:23.536857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:55.448178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535626+0000","last_change":"2024-02-17T12:19:22.375472+0000","last_active":"2024-02-17T12:19:23.535626+0000","last_peered":"2024-02-17T12:19:23.535626+0000","last_clean":"2024-02-17T12:19:23.535626+0000","last_became_active":"2024-02-17T12:19:22.375196+0000","last_became_peered":"2024-02-17T12:19:22.375196+0000","last_unstale":"2024-02-17T12:19:23.535626+0000","last_undegraded":"2024-02-17T12:19:23.535626+0000","last_fullsized":"2024-02-17T12:19:23.535626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:17.057488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538389+0000","last_change":"2024-02-17T12:19:04.728727+0000","last_active":"2024-02-17T12:19:23.538389+0000","last_peered":"2024-02-17T12:19:23.538389+0000","last_clean":"2024-02-17T12:19:23.538389+0000","last_became_active":"2024-02-17T12:19:04.728194+0000","last_became_peered":"2024-02-17T12:19:04.728194+0000","last_unstale":"2024-02-17T12:19:23.538389+0000","last_undegraded":"2024-02-17T12:19:23.538389+0000","last_fullsized":"2024-02-17T12:19:23.538389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:07:54.785092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519632+0000","last_change":"2024-02-17T12:19:04.710789+0000","last_active":"2024-02-17T12:19:06.519632+0000","last_peered":"2024-02-17T12:19:06.519632+0000","last_clean":"2024-02-17T12:19:06.519632+0000","last_became_active":"2024-02-17T12:19:04.710321+0000","last_became_peered":"2024-02-17T12:19:04.710321+0000","last_unstale":"2024-02-17T12:19:06.519632+0000","last_undegraded":"2024-02-17T12:19:06.519632+0000","last_fullsized":"2024-02-17T12:19:06.519632+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:20.439350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537575+0000","last_change":"2024-02-17T12:19:22.389161+0000","last_active":"2024-02-17T12:19:23.537575+0000","last_peered":"2024-02-17T12:19:23.537575+0000","last_clean":"2024-02-17T12:19:23.537575+0000","last_became_active":"2024-02-17T12:19:22.388885+0000","last_became_peered":"2024-02-17T12:19:22.388885+0000","last_unstale":"2024-02-17T12:19:23.537575+0000","last_undegraded":"2024-02-17T12:19:23.537575+0000","last_fullsized":"2024-02-17T12:19:23.537575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:32.525943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379396+0000","last_change":"2024-02-17T12:19:04.714567+0000","last_active":"2024-02-17T12:19:23.379396+0000","last_peered":"2024-02-17T12:19:23.379396+0000","last_clean":"2024-02-17T12:19:23.379396+0000","last_became_active":"2024-02-17T12:19:04.714283+0000","last_became_peered":"2024-02-17T12:19:04.714283+0000","last_unstale":"2024-02-17T12:19:23.379396+0000","last_undegraded":"2024-02-17T12:19:23.379396+0000","last_fullsized":"2024-02-17T12:19:23.379396+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:36.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537786+0000","last_change":"2024-02-17T12:19:22.388259+0000","last_active":"2024-02-17T12:19:23.537786+0000","last_peered":"2024-02-17T12:19:23.537786+0000","last_clean":"2024-02-17T12:19:23.537786+0000","last_became_active":"2024-02-17T12:19:22.387822+0000","last_became_peered":"2024-02-17T12:19:22.387822+0000","last_unstale":"2024-02-17T12:19:23.537786+0000","last_undegraded":"2024-02-17T12:19:23.537786+0000","last_fullsized":"2024-02-17T12:19:23.537786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:23.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381171+0000","last_change":"2024-02-17T12:19:04.707760+0000","last_active":"2024-02-17T12:19:23.381171+0000","last_peered":"2024-02-17T12:19:23.381171+0000","last_clean":"2024-02-17T12:19:23.381171+0000","last_became_active":"2024-02-17T12:19:04.707499+0000","last_became_peered":"2024-02-17T12:19:04.707499+0000","last_unstale":"2024-02-17T12:19:23.381171+0000","last_undegraded":"2024-02-17T12:19:23.381171+0000","last_fullsized":"2024-02-17T12:19:23.381171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:24:01.313056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380698+0000","last_change":"2024-02-17T12:19:22.378610+0000","last_active":"2024-02-17T12:19:23.380698+0000","last_peered":"2024-02-17T12:19:23.380698+0000","last_clean":"2024-02-17T12:19:23.380698+0000","last_became_active":"2024-02-17T12:19:22.377368+0000","last_became_peered":"2024-02-17T12:19:22.377368+0000","last_unstale":"2024-02-17T12:19:23.380698+0000","last_undegraded":"2024-02-17T12:19:23.380698+0000","last_fullsized":"2024-02-17T12:19:23.380698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:32.414191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538289+0000","last_change":"2024-02-17T12:19:04.710944+0000","last_active":"2024-02-17T12:19:23.538289+0000","last_peered":"2024-02-17T12:19:23.538289+0000","last_clean":"2024-02-17T12:19:23.538289+0000","last_became_active":"2024-02-17T12:19:04.710625+0000","last_became_peered":"2024-02-17T12:19:04.710625+0000","last_unstale":"2024-02-17T12:19:23.538289+0000","last_undegraded":"2024-02-17T12:19:23.538289+0000","last_fullsized":"2024-02-17T12:19:23.538289+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:22:57.157645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520976+0000","last_change":"2024-02-17T12:19:04.718758+0000","last_active":"2024-02-17T12:19:06.520976+0000","last_peered":"2024-02-17T12:19:06.520976+0000","last_clean":"2024-02-17T12:19:06.520976+0000","last_became_active":"2024-02-17T12:19:04.718486+0000","last_became_peered":"2024-02-17T12:19:04.718486+0000","last_unstale":"2024-02-17T12:19:06.520976+0000","last_undegraded":"2024-02-17T12:19:06.520976+0000","last_fullsized":"2024-02-17T12:19:06.520976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.895909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537775+0000","last_change":"2024-02-17T12:19:04.714461+0000","last_active":"2024-02-17T12:19:23.537775+0000","last_peered":"2024-02-17T12:19:23.537775+0000","last_clean":"2024-02-17T12:19:23.537775+0000","last_became_active":"2024-02-17T12:19:04.714208+0000","last_became_peered":"2024-02-17T12:19:04.714208+0000","last_unstale":"2024-02-17T12:19:23.537775+0000","last_undegraded":"2024-02-17T12:19:23.537775+0000","last_fullsized":"2024-02-17T12:19:23.537775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:45.424685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538193+0000","last_change":"2024-02-17T12:19:04.722346+0000","last_active":"2024-02-17T12:19:23.538193+0000","last_peered":"2024-02-17T12:19:23.538193+0000","last_clean":"2024-02-17T12:19:23.538193+0000","last_became_active":"2024-02-17T12:19:04.722106+0000","last_became_peered":"2024-02-17T12:19:04.722106+0000","last_unstale":"2024-02-17T12:19:23.538193+0000","last_undegraded":"2024-02-17T12:19:23.538193+0000","last_fullsized":"2024-02-17T12:19:23.538193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:11.976571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535907+0000","last_change":"2024-02-17T12:19:22.372825+0000","last_active":"2024-02-17T12:19:23.535907+0000","last_peered":"2024-02-17T12:19:23.535907+0000","last_clean":"2024-02-17T12:19:23.535907+0000","last_became_active":"2024-02-17T12:19:22.372503+0000","last_became_peered":"2024-02-17T12:19:22.372503+0000","last_unstale":"2024-02-17T12:19:23.535907+0000","last_undegraded":"2024-02-17T12:19:23.535907+0000","last_fullsized":"2024-02-17T12:19:23.535907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:52:37.591482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707927+0000","last_change":"2024-02-17T12:19:04.720604+0000","last_active":"2024-02-17T12:19:05.707927+0000","last_peered":"2024-02-17T12:19:05.707927+0000","last_clean":"2024-02-17T12:19:05.707927+0000","last_became_active":"2024-02-17T12:19:04.720350+0000","last_became_peered":"2024-02-17T12:19:04.720350+0000","last_unstale":"2024-02-17T12:19:05.707927+0000","last_undegraded":"2024-02-17T12:19:05.707927+0000","last_fullsized":"2024-02-17T12:19:05.707927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:21.365282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537757+0000","last_change":"2024-02-17T12:19:22.380747+0000","last_active":"2024-02-17T12:19:23.537757+0000","last_peered":"2024-02-17T12:19:23.537757+0000","last_clean":"2024-02-17T12:19:23.537757+0000","last_became_active":"2024-02-17T12:19:22.380112+0000","last_became_peered":"2024-02-17T12:19:22.380112+0000","last_unstale":"2024-02-17T12:19:23.537757+0000","last_undegraded":"2024-02-17T12:19:23.537757+0000","last_fullsized":"2024-02-17T12:19:23.537757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:49:12.538531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210224+0000","last_change":"2024-02-17T12:19:04.716818+0000","last_active":"2024-02-17T12:19:06.210224+0000","last_peered":"2024-02-17T12:19:06.210224+0000","last_clean":"2024-02-17T12:19:06.210224+0000","last_became_active":"2024-02-17T12:19:04.716507+0000","last_became_peered":"2024-02-17T12:19:04.716507+0000","last_unstale":"2024-02-17T12:19:06.210224+0000","last_undegraded":"2024-02-17T12:19:06.210224+0000","last_fullsized":"2024-02-17T12:19:06.210224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:56:16.543982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536132+0000","last_change":"2024-02-17T12:19:04.708458+0000","last_active":"2024-02-17T12:19:23.536132+0000","last_peered":"2024-02-17T12:19:23.536132+0000","last_clean":"2024-02-17T12:19:23.536132+0000","last_became_active":"2024-02-17T12:19:04.708170+0000","last_became_peered":"2024-02-17T12:19:04.708170+0000","last_unstale":"2024-02-17T12:19:23.536132+0000","last_undegraded":"2024-02-17T12:19:23.536132+0000","last_fullsized":"2024-02-17T12:19:23.536132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:57.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537653+0000","last_change":"2024-02-17T12:19:22.380274+0000","last_active":"2024-02-17T12:19:23.537653+0000","last_peered":"2024-02-17T12:19:23.537653+0000","last_clean":"2024-02-17T12:19:23.537653+0000","last_became_active":"2024-02-17T12:19:22.379913+0000","last_became_peered":"2024-02-17T12:19:22.379913+0000","last_unstale":"2024-02-17T12:19:23.537653+0000","last_undegraded":"2024-02-17T12:19:23.537653+0000","last_fullsized":"2024-02-17T12:19:23.537653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:33:02.035794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707967+0000","last_change":"2024-02-17T12:19:04.726126+0000","last_active":"2024-02-17T12:19:05.707967+0000","last_peered":"2024-02-17T12:19:05.707967+0000","last_clean":"2024-02-17T12:19:05.707967+0000","last_became_active":"2024-02-17T12:19:04.725344+0000","last_became_peered":"2024-02-17T12:19:04.725344+0000","last_unstale":"2024-02-17T12:19:05.707967+0000","last_undegraded":"2024-02-17T12:19:05.707967+0000","last_fullsized":"2024-02-17T12:19:05.707967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:08:29.699648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537028+0000","last_change":"2024-02-17T12:19:04.725988+0000","last_active":"2024-02-17T12:19:23.537028+0000","last_peered":"2024-02-17T12:19:23.537028+0000","last_clean":"2024-02-17T12:19:23.537028+0000","last_became_active":"2024-02-17T12:19:04.725703+0000","last_became_peered":"2024-02-17T12:19:04.725703+0000","last_unstale":"2024-02-17T12:19:23.537028+0000","last_undegraded":"2024-02-17T12:19:23.537028+0000","last_fullsized":"2024-02-17T12:19:23.537028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:26.113554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380518+0000","last_change":"2024-02-17T12:19:04.718744+0000","last_active":"2024-02-17T12:19:23.380518+0000","last_peered":"2024-02-17T12:19:23.380518+0000","last_clean":"2024-02-17T12:19:23.380518+0000","last_became_active":"2024-02-17T12:19:04.717669+0000","last_became_peered":"2024-02-17T12:19:04.717669+0000","last_unstale":"2024-02-17T12:19:23.380518+0000","last_undegraded":"2024-02-17T12:19:23.380518+0000","last_fullsized":"2024-02-17T12:19:23.380518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:15.849867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210342+0000","last_change":"2024-02-17T12:19:04.713023+0000","last_active":"2024-02-17T12:19:06.210342+0000","last_peered":"2024-02-17T12:19:06.210342+0000","last_clean":"2024-02-17T12:19:06.210342+0000","last_became_active":"2024-02-17T12:19:04.712535+0000","last_became_peered":"2024-02-17T12:19:04.712535+0000","last_unstale":"2024-02-17T12:19:06.210342+0000","last_undegraded":"2024-02-17T12:19:06.210342+0000","last_fullsized":"2024-02-17T12:19:06.210342+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:59.570840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707750+0000","last_change":"2024-02-17T12:19:04.721331+0000","last_active":"2024-02-17T12:19:05.707750+0000","last_peered":"2024-02-17T12:19:05.707750+0000","last_clean":"2024-02-17T12:19:05.707750+0000","last_became_active":"2024-02-17T12:19:04.721066+0000","last_became_peered":"2024-02-17T12:19:04.721066+0000","last_unstale":"2024-02-17T12:19:05.707750+0000","last_undegraded":"2024-02-17T12:19:05.707750+0000","last_fullsized":"2024-02-17T12:19:05.707750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:49:57.305678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708042+0000","last_change":"2024-02-17T12:19:04.726119+0000","last_active":"2024-02-17T12:19:05.708042+0000","last_peered":"2024-02-17T12:19:05.708042+0000","last_clean":"2024-02-17T12:19:05.708042+0000","last_became_active":"2024-02-17T12:19:04.725509+0000","last_became_peered":"2024-02-17T12:19:04.725509+0000","last_unstale":"2024-02-17T12:19:05.708042+0000","last_undegraded":"2024-02-17T12:19:05.708042+0000","last_fullsized":"2024-02-17T12:19:05.708042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:56.501011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380391+0000","last_change":"2024-02-17T12:19:04.706739+0000","last_active":"2024-02-17T12:19:23.380391+0000","last_peered":"2024-02-17T12:19:23.380391+0000","last_clean":"2024-02-17T12:19:23.380391+0000","last_became_active":"2024-02-17T12:19:04.706454+0000","last_became_peered":"2024-02-17T12:19:04.706454+0000","last_unstale":"2024-02-17T12:19:23.380391+0000","last_undegraded":"2024-02-17T12:19:23.380391+0000","last_fullsized":"2024-02-17T12:19:23.380391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:14.863236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538605+0000","last_change":"2024-02-17T12:19:22.382789+0000","last_active":"2024-02-17T12:19:23.538605+0000","last_peered":"2024-02-17T12:19:23.538605+0000","last_clean":"2024-02-17T12:19:23.538605+0000","last_became_active":"2024-02-17T12:19:22.382329+0000","last_became_peered":"2024-02-17T12:19:22.382329+0000","last_unstale":"2024-02-17T12:19:23.538605+0000","last_undegraded":"2024-02-17T12:19:23.538605+0000","last_fullsized":"2024-02-17T12:19:23.538605+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:32.472749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210145+0000","last_change":"2024-02-17T12:19:04.729805+0000","last_active":"2024-02-17T12:19:06.210145+0000","last_peered":"2024-02-17T12:19:06.210145+0000","last_clean":"2024-02-17T12:19:06.210145+0000","last_became_active":"2024-02-17T12:19:04.729388+0000","last_became_peered":"2024-02-17T12:19:04.729388+0000","last_unstale":"2024-02-17T12:19:06.210145+0000","last_undegraded":"2024-02-17T12:19:06.210145+0000","last_fullsized":"2024-02-17T12:19:06.210145+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:09:06.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380519+0000","last_change":"2024-02-17T12:19:04.710643+0000","last_active":"2024-02-17T12:19:23.380519+0000","last_peered":"2024-02-17T12:19:23.380519+0000","last_clean":"2024-02-17T12:19:23.380519+0000","last_became_active":"2024-02-17T12:19:04.709363+0000","last_became_peered":"2024-02-17T12:19:04.709363+0000","last_unstale":"2024-02-17T12:19:23.380519+0000","last_undegraded":"2024-02-17T12:19:23.380519+0000","last_fullsized":"2024-02-17T12:19:23.380519+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:14.810042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210786+0000","last_change":"2024-02-17T12:19:03.709066+0000","last_active":"2024-02-17T12:19:06.210786+0000","last_peered":"2024-02-17T12:19:06.210786+0000","last_clean":"2024-02-17T12:19:06.210786+0000","last_became_active":"2024-02-17T12:19:03.708888+0000","last_became_peered":"2024-02-17T12:19:03.708888+0000","last_unstale":"2024-02-17T12:19:06.210786+0000","last_undegraded":"2024-02-17T12:19:06.210786+0000","last_fullsized":"2024-02-17T12:19:06.210786+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380917+0000","last_change":"2024-02-17T12:19:22.369924+0000","last_active":"2024-02-17T12:19:23.380917+0000","last_peered":"2024-02-17T12:19:23.380917+0000","last_clean":"2024-02-17T12:19:23.380917+0000","last_became_active":"2024-02-17T12:19:22.369681+0000","last_became_peered":"2024-02-17T12:19:22.369681+0000","last_unstale":"2024-02-17T12:19:23.380917+0000","last_undegraded":"2024-02-17T12:19:23.380917+0000","last_fullsized":"2024-02-17T12:19:23.380917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:28.541757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210661+0000","last_change":"2024-02-17T12:19:04.718756+0000","last_active":"2024-02-17T12:19:06.210661+0000","last_peered":"2024-02-17T12:19:06.210661+0000","last_clean":"2024-02-17T12:19:06.210661+0000","last_became_active":"2024-02-17T12:19:04.716924+0000","last_became_peered":"2024-02-17T12:19:04.716924+0000","last_unstale":"2024-02-17T12:19:06.210661+0000","last_undegraded":"2024-02-17T12:19:06.210661+0000","last_fullsized":"2024-02-17T12:19:06.210661+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:11.015091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380711+0000","last_change":"2024-02-17T12:19:03.703800+0000","last_active":"2024-02-17T12:19:23.380711+0000","last_peered":"2024-02-17T12:19:23.380711+0000","last_clean":"2024-02-17T12:19:23.380711+0000","last_became_active":"2024-02-17T12:19:03.703402+0000","last_became_peered":"2024-02-17T12:19:03.703402+0000","last_unstale":"2024-02-17T12:19:23.380711+0000","last_undegraded":"2024-02-17T12:19:23.380711+0000","last_fullsized":"2024-02-17T12:19:23.380711+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:37:23.098316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537751+0000","last_change":"2024-02-17T12:19:22.373889+0000","last_active":"2024-02-17T12:19:23.537751+0000","last_peered":"2024-02-17T12:19:23.537751+0000","last_clean":"2024-02-17T12:19:23.537751+0000","last_became_active":"2024-02-17T12:19:22.372667+0000","last_became_peered":"2024-02-17T12:19:22.372667+0000","last_unstale":"2024-02-17T12:19:23.537751+0000","last_undegraded":"2024-02-17T12:19:23.537751+0000","last_fullsized":"2024-02-17T12:19:23.537751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:33.512575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210719+0000","last_change":"2024-02-17T12:19:04.730207+0000","last_active":"2024-02-17T12:19:06.210719+0000","last_peered":"2024-02-17T12:19:06.210719+0000","last_clean":"2024-02-17T12:19:06.210719+0000","last_became_active":"2024-02-17T12:19:04.729363+0000","last_became_peered":"2024-02-17T12:19:04.729363+0000","last_unstale":"2024-02-17T12:19:06.210719+0000","last_undegraded":"2024-02-17T12:19:06.210719+0000","last_fullsized":"2024-02-17T12:19:06.210719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:32:13.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521058+0000","last_change":"2024-02-17T12:19:03.704331+0000","last_active":"2024-02-17T12:19:06.521058+0000","last_peered":"2024-02-17T12:19:06.521058+0000","last_clean":"2024-02-17T12:19:06.521058+0000","last_became_active":"2024-02-17T12:19:03.704078+0000","last_became_peered":"2024-02-17T12:19:03.704078+0000","last_unstale":"2024-02-17T12:19:06.521058+0000","last_undegraded":"2024-02-17T12:19:06.521058+0000","last_fullsized":"2024-02-17T12:19:06.521058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537210+0000","last_change":"2024-02-17T12:19:21.377375+0000","last_active":"2024-02-17T12:19:23.537210+0000","last_peered":"2024-02-17T12:19:23.537210+0000","last_clean":"2024-02-17T12:19:23.537210+0000","last_became_active":"2024-02-17T12:19:21.377083+0000","last_became_peered":"2024-02-17T12:19:21.377083+0000","last_unstale":"2024-02-17T12:19:23.537210+0000","last_undegraded":"2024-02-17T12:19:23.537210+0000","last_fullsized":"2024-02-17T12:19:23.537210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:53.185121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537641+0000","last_change":"2024-02-17T12:19:04.710438+0000","last_active":"2024-02-17T12:19:23.537641+0000","last_peered":"2024-02-17T12:19:23.537641+0000","last_clean":"2024-02-17T12:19:23.537641+0000","last_became_active":"2024-02-17T12:19:04.709894+0000","last_became_peered":"2024-02-17T12:19:04.709894+0000","last_unstale":"2024-02-17T12:19:23.537641+0000","last_undegraded":"2024-02-17T12:19:23.537641+0000","last_fullsized":"2024-02-17T12:19:23.537641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:44.905808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521160+0000","last_change":"2024-02-17T12:19:03.702411+0000","last_active":"2024-02-17T12:19:06.521160+0000","last_peered":"2024-02-17T12:19:06.521160+0000","last_clean":"2024-02-17T12:19:06.521160+0000","last_became_active":"2024-02-17T12:19:03.702166+0000","last_became_peered":"2024-02-17T12:19:03.702166+0000","last_unstale":"2024-02-17T12:19:06.521160+0000","last_undegraded":"2024-02-17T12:19:06.521160+0000","last_fullsized":"2024-02-17T12:19:06.521160+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708166+0000","last_change":"2024-02-17T12:19:04.726343+0000","last_active":"2024-02-17T12:19:05.708166+0000","last_peered":"2024-02-17T12:19:05.708166+0000","last_clean":"2024-02-17T12:19:05.708166+0000","last_became_active":"2024-02-17T12:19:04.725870+0000","last_became_peered":"2024-02-17T12:19:04.725870+0000","last_unstale":"2024-02-17T12:19:05.708166+0000","last_undegraded":"2024-02-17T12:19:05.708166+0000","last_fullsized":"2024-02-17T12:19:05.708166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:27:42.531689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380548+0000","last_change":"2024-02-17T12:19:03.703159+0000","last_active":"2024-02-17T12:19:23.380548+0000","last_peered":"2024-02-17T12:19:23.380548+0000","last_clean":"2024-02-17T12:19:23.380548+0000","last_became_active":"2024-02-17T12:19:03.702811+0000","last_became_peered":"2024-02-17T12:19:03.702811+0000","last_unstale":"2024-02-17T12:19:23.380548+0000","last_undegraded":"2024-02-17T12:19:23.380548+0000","last_fullsized":"2024-02-17T12:19:23.380548+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:16.831548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379607+0000","last_change":"2024-02-17T12:19:22.368488+0000","last_active":"2024-02-17T12:19:23.379607+0000","last_peered":"2024-02-17T12:19:23.379607+0000","last_clean":"2024-02-17T12:19:23.379607+0000","last_became_active":"2024-02-17T12:19:22.368213+0000","last_became_peered":"2024-02-17T12:19:22.368213+0000","last_unstale":"2024-02-17T12:19:23.379607+0000","last_undegraded":"2024-02-17T12:19:23.379607+0000","last_fullsized":"2024-02-17T12:19:23.379607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:09:41.215827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380350+0000","last_change":"2024-02-17T12:19:04.708618+0000","last_active":"2024-02-17T12:19:23.380350+0000","last_peered":"2024-02-17T12:19:23.380350+0000","last_clean":"2024-02-17T12:19:23.380350+0000","last_became_active":"2024-02-17T12:19:04.708351+0000","last_became_peered":"2024-02-17T12:19:04.708351+0000","last_unstale":"2024-02-17T12:19:23.380350+0000","last_undegraded":"2024-02-17T12:19:23.380350+0000","last_fullsized":"2024-02-17T12:19:23.380350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:09.330073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380335+0000","last_change":"2024-02-17T12:19:03.706093+0000","last_active":"2024-02-17T12:19:23.380335+0000","last_peered":"2024-02-17T12:19:23.380335+0000","last_clean":"2024-02-17T12:19:23.380335+0000","last_became_active":"2024-02-17T12:19:03.705445+0000","last_became_peered":"2024-02-17T12:19:03.705445+0000","last_unstale":"2024-02-17T12:19:23.380335+0000","last_undegraded":"2024-02-17T12:19:23.380335+0000","last_fullsized":"2024-02-17T12:19:23.380335+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:29.842261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535697+0000","last_change":"2024-02-17T12:19:04.714305+0000","last_active":"2024-02-17T12:19:23.535697+0000","last_peered":"2024-02-17T12:19:23.535697+0000","last_clean":"2024-02-17T12:19:23.535697+0000","last_became_active":"2024-02-17T12:19:04.714041+0000","last_became_peered":"2024-02-17T12:19:04.714041+0000","last_unstale":"2024-02-17T12:19:23.535697+0000","last_undegraded":"2024-02-17T12:19:23.535697+0000","last_fullsized":"2024-02-17T12:19:23.535697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:12.864476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520892+0000","last_change":"2024-02-17T12:19:03.701055+0000","last_active":"2024-02-17T12:19:06.520892+0000","last_peered":"2024-02-17T12:19:06.520892+0000","last_clean":"2024-02-17T12:19:06.520892+0000","last_became_active":"2024-02-17T12:19:03.695988+0000","last_became_peered":"2024-02-17T12:19:03.695988+0000","last_unstale":"2024-02-17T12:19:06.520892+0000","last_undegraded":"2024-02-17T12:19:06.520892+0000","last_fullsized":"2024-02-17T12:19:06.520892+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536792+0000","last_change":"2024-02-17T12:19:22.379284+0000","last_active":"2024-02-17T12:19:23.536792+0000","last_peered":"2024-02-17T12:19:23.536792+0000","last_clean":"2024-02-17T12:19:23.536792+0000","last_became_active":"2024-02-17T12:19:22.378837+0000","last_became_peered":"2024-02-17T12:19:22.378837+0000","last_unstale":"2024-02-17T12:19:23.536792+0000","last_undegraded":"2024-02-17T12:19:23.536792+0000","last_fullsized":"2024-02-17T12:19:23.536792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519713+0000","last_change":"2024-02-17T12:19:04.710559+0000","last_active":"2024-02-17T12:19:06.519713+0000","last_peered":"2024-02-17T12:19:06.519713+0000","last_clean":"2024-02-17T12:19:06.519713+0000","last_became_active":"2024-02-17T12:19:04.709979+0000","last_became_peered":"2024-02-17T12:19:04.709979+0000","last_unstale":"2024-02-17T12:19:06.519713+0000","last_undegraded":"2024-02-17T12:19:06.519713+0000","last_fullsized":"2024-02-17T12:19:06.519713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:33:12.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707814+0000","last_change":"2024-02-17T12:19:03.702309+0000","last_active":"2024-02-17T12:19:05.707814+0000","last_peered":"2024-02-17T12:19:05.707814+0000","last_clean":"2024-02-17T12:19:05.707814+0000","last_became_active":"2024-02-17T12:19:03.702051+0000","last_became_peered":"2024-02-17T12:19:03.702051+0000","last_unstale":"2024-02-17T12:19:05.707814+0000","last_undegraded":"2024-02-17T12:19:05.707814+0000","last_fullsized":"2024-02-17T12:19:05.707814+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:58.978525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"71'3","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537726+0000","last_change":"2024-02-17T12:19:21.375965+0000","last_active":"2024-02-17T12:19:23.537726+0000","last_peered":"2024-02-17T12:19:23.537726+0000","last_clean":"2024-02-17T12:19:23.537726+0000","last_became_active":"2024-02-17T12:19:21.375551+0000","last_became_peered":"2024-02-17T12:19:21.375551+0000","last_unstale":"2024-02-17T12:19:23.537726+0000","last_undegraded":"2024-02-17T12:19:23.537726+0000","last_fullsized":"2024-02-17T12:19:23.537726+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:25.240966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520096+0000","last_change":"2024-02-17T12:19:04.726001+0000","last_active":"2024-02-17T12:19:06.520096+0000","last_peered":"2024-02-17T12:19:06.520096+0000","last_clean":"2024-02-17T12:19:06.520096+0000","last_became_active":"2024-02-17T12:19:04.725747+0000","last_became_peered":"2024-02-17T12:19:04.725747+0000","last_unstale":"2024-02-17T12:19:06.520096+0000","last_undegraded":"2024-02-17T12:19:06.520096+0000","last_fullsized":"2024-02-17T12:19:06.520096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:18:38.213214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210926+0000","last_change":"2024-02-17T12:19:03.712851+0000","last_active":"2024-02-17T12:19:06.210926+0000","last_peered":"2024-02-17T12:19:06.210926+0000","last_clean":"2024-02-17T12:19:06.210926+0000","last_became_active":"2024-02-17T12:19:03.712584+0000","last_became_peered":"2024-02-17T12:19:03.712584+0000","last_unstale":"2024-02-17T12:19:06.210926+0000","last_undegraded":"2024-02-17T12:19:06.210926+0000","last_fullsized":"2024-02-17T12:19:06.210926+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537449+0000","last_change":"2024-02-17T12:19:22.379237+0000","last_active":"2024-02-17T12:19:23.537449+0000","last_peered":"2024-02-17T12:19:23.537449+0000","last_clean":"2024-02-17T12:19:23.537449+0000","last_became_active":"2024-02-17T12:19:22.377019+0000","last_became_peered":"2024-02-17T12:19:22.377019+0000","last_unstale":"2024-02-17T12:19:23.537449+0000","last_undegraded":"2024-02-17T12:19:23.537449+0000","last_fullsized":"2024-02-17T12:19:23.537449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:53.311764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"71'6","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380677+0000","last_change":"2024-02-17T12:19:21.372337+0000","last_active":"2024-02-17T12:19:23.380677+0000","last_peered":"2024-02-17T12:19:23.380677+0000","last_clean":"2024-02-17T12:19:23.380677+0000","last_became_active":"2024-02-17T12:19:21.371919+0000","last_became_peered":"2024-02-17T12:19:21.371919+0000","last_unstale":"2024-02-17T12:19:23.380677+0000","last_undegraded":"2024-02-17T12:19:23.380677+0000","last_fullsized":"2024-02-17T12:19:23.380677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:11:12.798689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.712467+0000","last_change":"2024-02-17T12:19:04.709578+0000","last_active":"2024-02-17T12:19:05.712467+0000","last_peered":"2024-02-17T12:19:05.712467+0000","last_clean":"2024-02-17T12:19:05.712467+0000","last_became_active":"2024-02-17T12:19:04.709173+0000","last_became_peered":"2024-02-17T12:19:04.709173+0000","last_unstale":"2024-02-17T12:19:05.712467+0000","last_undegraded":"2024-02-17T12:19:05.712467+0000","last_fullsized":"2024-02-17T12:19:05.712467+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210669+0000","last_change":"2024-02-17T12:19:03.707721+0000","last_active":"2024-02-17T12:19:06.210669+0000","last_peered":"2024-02-17T12:19:06.210669+0000","last_clean":"2024-02-17T12:19:06.210669+0000","last_became_active":"2024-02-17T12:19:03.707435+0000","last_became_peered":"2024-02-17T12:19:03.707435+0000","last_unstale":"2024-02-17T12:19:06.210669+0000","last_undegraded":"2024-02-17T12:19:06.210669+0000","last_fullsized":"2024-02-17T12:19:06.210669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521092+0000","last_change":"2024-02-17T12:19:04.716812+0000","last_active":"2024-02-17T12:19:06.521092+0000","last_peered":"2024-02-17T12:19:06.521092+0000","last_clean":"2024-02-17T12:19:06.521092+0000","last_became_active":"2024-02-17T12:19:04.716307+0000","last_became_peered":"2024-02-17T12:19:04.716307+0000","last_unstale":"2024-02-17T12:19:06.521092+0000","last_undegraded":"2024-02-17T12:19:06.521092+0000","last_fullsized":"2024-02-17T12:19:06.521092+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:30.970580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210404+0000","last_change":"2024-02-17T12:19:03.710532+0000","last_active":"2024-02-17T12:19:06.210404+0000","last_peered":"2024-02-17T12:19:06.210404+0000","last_clean":"2024-02-17T12:19:06.210404+0000","last_became_active":"2024-02-17T12:19:03.710333+0000","last_became_peered":"2024-02-17T12:19:03.710333+0000","last_unstale":"2024-02-17T12:19:06.210404+0000","last_undegraded":"2024-02-17T12:19:06.210404+0000","last_fullsized":"2024-02-17T12:19:06.210404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381122+0000","last_change":"2024-02-17T12:19:22.367647+0000","last_active":"2024-02-17T12:19:23.381122+0000","last_peered":"2024-02-17T12:19:23.381122+0000","last_clean":"2024-02-17T12:19:23.381122+0000","last_became_active":"2024-02-17T12:19:22.366850+0000","last_became_peered":"2024-02-17T12:19:22.366850+0000","last_unstale":"2024-02-17T12:19:23.381122+0000","last_undegraded":"2024-02-17T12:19:23.381122+0000","last_fullsized":"2024-02-17T12:19:23.381122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:21:05.316175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380757+0000","last_change":"2024-02-17T12:19:04.719297+0000","last_active":"2024-02-17T12:19:23.380757+0000","last_peered":"2024-02-17T12:19:23.380757+0000","last_clean":"2024-02-17T12:19:23.380757+0000","last_became_active":"2024-02-17T12:19:04.718586+0000","last_became_peered":"2024-02-17T12:19:04.718586+0000","last_unstale":"2024-02-17T12:19:23.380757+0000","last_undegraded":"2024-02-17T12:19:23.380757+0000","last_fullsized":"2024-02-17T12:19:23.380757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:05.970868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:15.947048+0000","last_change":"2024-02-17T12:19:03.704237+0000","last_active":"2024-02-17T12:19:15.947048+0000","last_peered":"2024-02-17T12:19:15.947048+0000","last_clean":"2024-02-17T12:19:15.947048+0000","last_became_active":"2024-02-17T12:19:03.703964+0000","last_became_peered":"2024-02-17T12:19:03.703964+0000","last_unstale":"2024-02-17T12:19:15.947048+0000","last_undegraded":"2024-02-17T12:19:15.947048+0000","last_fullsized":"2024-02-17T12:19:15.947048+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:45.097730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379221+0000","last_change":"2024-02-17T12:19:22.366381+0000","last_active":"2024-02-17T12:19:23.379221+0000","last_peered":"2024-02-17T12:19:23.379221+0000","last_clean":"2024-02-17T12:19:23.379221+0000","last_became_active":"2024-02-17T12:19:22.366074+0000","last_became_peered":"2024-02-17T12:19:22.366074+0000","last_unstale":"2024-02-17T12:19:23.379221+0000","last_undegraded":"2024-02-17T12:19:23.379221+0000","last_fullsized":"2024-02-17T12:19:23.379221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:54.192462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380317+0000","last_change":"2024-02-17T12:19:21.358035+0000","last_active":"2024-02-17T12:19:23.380317+0000","last_peered":"2024-02-17T12:19:23.380317+0000","last_clean":"2024-02-17T12:19:23.380317+0000","last_became_active":"2024-02-17T12:19:21.357766+0000","last_became_peered":"2024-02-17T12:19:21.357766+0000","last_unstale":"2024-02-17T12:19:23.380317+0000","last_undegraded":"2024-02-17T12:19:23.380317+0000","last_fullsized":"2024-02-17T12:19:23.380317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:42.768921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520875+0000","last_change":"2024-02-17T12:19:04.702494+0000","last_active":"2024-02-17T12:19:06.520875+0000","last_peered":"2024-02-17T12:19:06.520875+0000","last_clean":"2024-02-17T12:19:06.520875+0000","last_became_active":"2024-02-17T12:19:04.702168+0000","last_became_peered":"2024-02-17T12:19:04.702168+0000","last_unstale":"2024-02-17T12:19:06.520875+0000","last_undegraded":"2024-02-17T12:19:06.520875+0000","last_fullsized":"2024-02-17T12:19:06.520875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:53.989897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707872+0000","last_change":"2024-02-17T12:19:03.710630+0000","last_active":"2024-02-17T12:19:05.707872+0000","last_peered":"2024-02-17T12:19:05.707872+0000","last_clean":"2024-02-17T12:19:05.707872+0000","last_became_active":"2024-02-17T12:19:03.710185+0000","last_became_peered":"2024-02-17T12:19:03.710185+0000","last_unstale":"2024-02-17T12:19:05.707872+0000","last_undegraded":"2024-02-17T12:19:05.707872+0000","last_fullsized":"2024-02-17T12:19:05.707872+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:07:16.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536196+0000","last_change":"2024-02-17T12:19:22.379291+0000","last_active":"2024-02-17T12:19:23.536196+0000","last_peered":"2024-02-17T12:19:23.536196+0000","last_clean":"2024-02-17T12:19:23.536196+0000","last_became_active":"2024-02-17T12:19:22.379052+0000","last_became_peered":"2024-02-17T12:19:22.379052+0000","last_unstale":"2024-02-17T12:19:23.536196+0000","last_undegraded":"2024-02-17T12:19:23.536196+0000","last_fullsized":"2024-02-17T12:19:23.536196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:30.791284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536979+0000","last_change":"2024-02-17T12:19:04.716555+0000","last_active":"2024-02-17T12:19:23.536979+0000","last_peered":"2024-02-17T12:19:23.536979+0000","last_clean":"2024-02-17T12:19:23.536979+0000","last_became_active":"2024-02-17T12:19:04.715235+0000","last_became_peered":"2024-02-17T12:19:04.715235+0000","last_unstale":"2024-02-17T12:19:23.536979+0000","last_undegraded":"2024-02-17T12:19:23.536979+0000","last_fullsized":"2024-02-17T12:19:23.536979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:05.685656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519744+0000","last_change":"2024-02-17T12:19:03.712475+0000","last_active":"2024-02-17T12:19:06.519744+0000","last_peered":"2024-02-17T12:19:06.519744+0000","last_clean":"2024-02-17T12:19:06.519744+0000","last_became_active":"2024-02-17T12:19:03.712117+0000","last_became_peered":"2024-02-17T12:19:03.712117+0000","last_unstale":"2024-02-17T12:19:06.519744+0000","last_undegraded":"2024-02-17T12:19:06.519744+0000","last_fullsized":"2024-02-17T12:19:06.519744+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:10.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538079+0000","last_change":"2024-02-17T12:19:21.362585+0000","last_active":"2024-02-17T12:19:23.538079+0000","last_peered":"2024-02-17T12:19:23.538079+0000","last_clean":"2024-02-17T12:19:23.538079+0000","last_became_active":"2024-02-17T12:19:21.361851+0000","last_became_peered":"2024-02-17T12:19:21.361851+0000","last_unstale":"2024-02-17T12:19:23.538079+0000","last_undegraded":"2024-02-17T12:19:23.538079+0000","last_fullsized":"2024-02-17T12:19:23.538079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:31.111070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707802+0000","last_change":"2024-02-17T12:19:04.727289+0000","last_active":"2024-02-17T12:19:05.707802+0000","last_peered":"2024-02-17T12:19:05.707802+0000","last_clean":"2024-02-17T12:19:05.707802+0000","last_became_active":"2024-02-17T12:19:04.727041+0000","last_became_peered":"2024-02-17T12:19:04.727041+0000","last_unstale":"2024-02-17T12:19:05.707802+0000","last_undegraded":"2024-02-17T12:19:05.707802+0000","last_fullsized":"2024-02-17T12:19:05.707802+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:39:43.401328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711022+0000","last_change":"2024-02-17T12:19:03.699211+0000","last_active":"2024-02-17T12:19:05.711022+0000","last_peered":"2024-02-17T12:19:05.711022+0000","last_clean":"2024-02-17T12:19:05.711022+0000","last_became_active":"2024-02-17T12:19:03.698244+0000","last_became_peered":"2024-02-17T12:19:03.698244+0000","last_unstale":"2024-02-17T12:19:05.711022+0000","last_undegraded":"2024-02-17T12:19:05.711022+0000","last_fullsized":"2024-02-17T12:19:05.711022+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:42.702805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538270+0000","last_change":"2024-02-17T12:19:21.368493+0000","last_active":"2024-02-17T12:19:23.538270+0000","last_peered":"2024-02-17T12:19:23.538270+0000","last_clean":"2024-02-17T12:19:23.538270+0000","last_became_active":"2024-02-17T12:19:21.368162+0000","last_became_peered":"2024-02-17T12:19:21.368162+0000","last_unstale":"2024-02-17T12:19:23.538270+0000","last_undegraded":"2024-02-17T12:19:23.538270+0000","last_fullsized":"2024-02-17T12:19:23.538270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:38.213027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707696+0000","last_change":"2024-02-17T12:19:04.718529+0000","last_active":"2024-02-17T12:19:05.707696+0000","last_peered":"2024-02-17T12:19:05.707696+0000","last_clean":"2024-02-17T12:19:05.707696+0000","last_became_active":"2024-02-17T12:19:04.718251+0000","last_became_peered":"2024-02-17T12:19:04.718251+0000","last_unstale":"2024-02-17T12:19:05.707696+0000","last_undegraded":"2024-02-17T12:19:05.707696+0000","last_fullsized":"2024-02-17T12:19:05.707696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:28.280713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520686+0000","last_change":"2024-02-17T12:19:03.706554+0000","last_active":"2024-02-17T12:19:06.520686+0000","last_peered":"2024-02-17T12:19:06.520686+0000","last_clean":"2024-02-17T12:19:06.520686+0000","last_became_active":"2024-02-17T12:19:03.706236+0000","last_became_peered":"2024-02-17T12:19:03.706236+0000","last_unstale":"2024-02-17T12:19:06.520686+0000","last_undegraded":"2024-02-17T12:19:06.520686+0000","last_fullsized":"2024-02-17T12:19:06.520686+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537259+0000","last_change":"2024-02-17T12:19:04.715036+0000","last_active":"2024-02-17T12:19:23.537259+0000","last_peered":"2024-02-17T12:19:23.537259+0000","last_clean":"2024-02-17T12:19:23.537259+0000","last_became_active":"2024-02-17T12:19:04.714713+0000","last_became_peered":"2024-02-17T12:19:04.714713+0000","last_unstale":"2024-02-17T12:19:23.537259+0000","last_undegraded":"2024-02-17T12:19:23.537259+0000","last_fullsized":"2024-02-17T12:19:23.537259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:28:30.744698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210994+0000","last_change":"2024-02-17T12:19:03.705648+0000","last_active":"2024-02-17T12:19:06.210994+0000","last_peered":"2024-02-17T12:19:06.210994+0000","last_clean":"2024-02-17T12:19:06.210994+0000","last_became_active":"2024-02-17T12:19:03.705325+0000","last_became_peered":"2024-02-17T12:19:03.705325+0000","last_unstale":"2024-02-17T12:19:06.210994+0000","last_undegraded":"2024-02-17T12:19:06.210994+0000","last_fullsized":"2024-02-17T12:19:06.210994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537452+0000","last_change":"2024-02-17T12:19:22.380167+0000","last_active":"2024-02-17T12:19:23.537452+0000","last_peered":"2024-02-17T12:19:23.537452+0000","last_clean":"2024-02-17T12:19:23.537452+0000","last_became_active":"2024-02-17T12:19:22.379704+0000","last_became_peered":"2024-02-17T12:19:22.379704+0000","last_unstale":"2024-02-17T12:19:23.537452+0000","last_undegraded":"2024-02-17T12:19:23.537452+0000","last_fullsized":"2024-02-17T12:19:23.537452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:28:11.111883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210807+0000","last_change":"2024-02-17T12:19:04.719005+0000","last_active":"2024-02-17T12:19:06.210807+0000","last_peered":"2024-02-17T12:19:06.210807+0000","last_clean":"2024-02-17T12:19:06.210807+0000","last_became_active":"2024-02-17T12:19:04.717221+0000","last_became_peered":"2024-02-17T12:19:04.717221+0000","last_unstale":"2024-02-17T12:19:06.210807+0000","last_undegraded":"2024-02-17T12:19:06.210807+0000","last_fullsized":"2024-02-17T12:19:06.210807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:50.535947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520940+0000","last_change":"2024-02-17T12:19:03.708463+0000","last_active":"2024-02-17T12:19:06.520940+0000","last_peered":"2024-02-17T12:19:06.520940+0000","last_clean":"2024-02-17T12:19:06.520940+0000","last_became_active":"2024-02-17T12:19:03.707739+0000","last_became_peered":"2024-02-17T12:19:03.707739+0000","last_unstale":"2024-02-17T12:19:06.520940+0000","last_undegraded":"2024-02-17T12:19:06.520940+0000","last_fullsized":"2024-02-17T12:19:06.520940+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380282+0000","last_change":"2024-02-17T12:19:21.361415+0000","last_active":"2024-02-17T12:19:23.380282+0000","last_peered":"2024-02-17T12:19:23.380282+0000","last_clean":"2024-02-17T12:19:23.380282+0000","last_became_active":"2024-02-17T12:19:21.360522+0000","last_became_peered":"2024-02-17T12:19:21.360522+0000","last_unstale":"2024-02-17T12:19:23.380282+0000","last_undegraded":"2024-02-17T12:19:23.380282+0000","last_fullsized":"2024-02-17T12:19:23.380282+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:19:01.561174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380889+0000","last_change":"2024-02-17T12:19:04.727161+0000","last_active":"2024-02-17T12:19:23.380889+0000","last_peered":"2024-02-17T12:19:23.380889+0000","last_clean":"2024-02-17T12:19:23.380889+0000","last_became_active":"2024-02-17T12:19:04.726871+0000","last_became_peered":"2024-02-17T12:19:04.726871+0000","last_unstale":"2024-02-17T12:19:23.380889+0000","last_undegraded":"2024-02-17T12:19:23.380889+0000","last_fullsized":"2024-02-17T12:19:23.380889+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:50.453267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521222+0000","last_change":"2024-02-17T12:19:03.700286+0000","last_active":"2024-02-17T12:19:06.521222+0000","last_peered":"2024-02-17T12:19:06.521222+0000","last_clean":"2024-02-17T12:19:06.521222+0000","last_became_active":"2024-02-17T12:19:03.700021+0000","last_became_peered":"2024-02-17T12:19:03.700021+0000","last_unstale":"2024-02-17T12:19:06.521222+0000","last_undegraded":"2024-02-17T12:19:06.521222+0000","last_fullsized":"2024-02-17T12:19:06.521222+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535774+0000","last_change":"2024-02-17T12:19:22.370952+0000","last_active":"2024-02-17T12:19:23.535774+0000","last_peered":"2024-02-17T12:19:23.535774+0000","last_clean":"2024-02-17T12:19:23.535774+0000","last_became_active":"2024-02-17T12:19:22.370205+0000","last_became_peered":"2024-02-17T12:19:22.370205+0000","last_unstale":"2024-02-17T12:19:23.535774+0000","last_undegraded":"2024-02-17T12:19:23.535774+0000","last_fullsized":"2024-02-17T12:19:23.535774+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:42:14.086969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538438+0000","last_change":"2024-02-17T12:19:04.727215+0000","last_active":"2024-02-17T12:19:23.538438+0000","last_peered":"2024-02-17T12:19:23.538438+0000","last_clean":"2024-02-17T12:19:23.538438+0000","last_became_active":"2024-02-17T12:19:04.726960+0000","last_became_peered":"2024-02-17T12:19:04.726960+0000","last_unstale":"2024-02-17T12:19:23.538438+0000","last_undegraded":"2024-02-17T12:19:23.538438+0000","last_fullsized":"2024-02-17T12:19:23.538438+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:45.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520015+0000","last_change":"2024-02-17T12:19:03.709412+0000","last_active":"2024-02-17T12:19:06.520015+0000","last_peered":"2024-02-17T12:19:06.520015+0000","last_clean":"2024-02-17T12:19:06.520015+0000","last_became_active":"2024-02-17T12:19:03.709021+0000","last_became_peered":"2024-02-17T12:19:03.709021+0000","last_unstale":"2024-02-17T12:19:06.520015+0000","last_undegraded":"2024-02-17T12:19:06.520015+0000","last_fullsized":"2024-02-17T12:19:06.520015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:44.049163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711179+0000","last_change":"2024-02-17T12:19:04.712404+0000","last_active":"2024-02-17T12:19:05.711179+0000","last_peered":"2024-02-17T12:19:05.711179+0000","last_clean":"2024-02-17T12:19:05.711179+0000","last_became_active":"2024-02-17T12:19:04.711344+0000","last_became_peered":"2024-02-17T12:19:04.711344+0000","last_unstale":"2024-02-17T12:19:05.711179+0000","last_undegraded":"2024-02-17T12:19:05.711179+0000","last_fullsized":"2024-02-17T12:19:05.711179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:24.593812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538531+0000","last_change":"2024-02-17T12:19:03.706405+0000","last_active":"2024-02-17T12:19:23.538531+0000","last_peered":"2024-02-17T12:19:23.538531+0000","last_clean":"2024-02-17T12:19:23.538531+0000","last_became_active":"2024-02-17T12:19:03.706108+0000","last_became_peered":"2024-02-17T12:19:03.706108+0000","last_unstale":"2024-02-17T12:19:23.538531+0000","last_undegraded":"2024-02-17T12:19:23.538531+0000","last_fullsized":"2024-02-17T12:19:23.538531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.926513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538039+0000","last_change":"2024-02-17T12:19:22.389822+0000","last_active":"2024-02-17T12:19:23.538039+0000","last_peered":"2024-02-17T12:19:23.538039+0000","last_clean":"2024-02-17T12:19:23.538039+0000","last_became_active":"2024-02-17T12:19:22.389495+0000","last_became_peered":"2024-02-17T12:19:22.389495+0000","last_unstale":"2024-02-17T12:19:23.538039+0000","last_undegraded":"2024-02-17T12:19:23.538039+0000","last_fullsized":"2024-02-17T12:19:23.538039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:02:08.115974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536274+0000","last_change":"2024-02-17T12:19:04.712081+0000","last_active":"2024-02-17T12:19:23.536274+0000","last_peered":"2024-02-17T12:19:23.536274+0000","last_clean":"2024-02-17T12:19:23.536274+0000","last_became_active":"2024-02-17T12:19:04.711784+0000","last_became_peered":"2024-02-17T12:19:04.711784+0000","last_unstale":"2024-02-17T12:19:23.536274+0000","last_undegraded":"2024-02-17T12:19:23.536274+0000","last_fullsized":"2024-02-17T12:19:23.536274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:47:13.952609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536391+0000","last_change":"2024-02-17T12:19:03.701598+0000","last_active":"2024-02-17T12:19:23.536391+0000","last_peered":"2024-02-17T12:19:23.536391+0000","last_clean":"2024-02-17T12:19:23.536391+0000","last_became_active":"2024-02-17T12:19:03.701326+0000","last_became_peered":"2024-02-17T12:19:03.701326+0000","last_unstale":"2024-02-17T12:19:23.536391+0000","last_undegraded":"2024-02-17T12:19:23.536391+0000","last_fullsized":"2024-02-17T12:19:23.536391+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:47:22.021385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537974+0000","last_change":"2024-02-17T12:19:22.380952+0000","last_active":"2024-02-17T12:19:23.537974+0000","last_peered":"2024-02-17T12:19:23.537974+0000","last_clean":"2024-02-17T12:19:23.537974+0000","last_became_active":"2024-02-17T12:19:22.380493+0000","last_became_peered":"2024-02-17T12:19:22.380493+0000","last_unstale":"2024-02-17T12:19:23.537974+0000","last_undegraded":"2024-02-17T12:19:23.537974+0000","last_fullsized":"2024-02-17T12:19:23.537974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:54.242151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711041+0000","last_change":"2024-02-17T12:19:04.702184+0000","last_active":"2024-02-17T12:19:05.711041+0000","last_peered":"2024-02-17T12:19:05.711041+0000","last_clean":"2024-02-17T12:19:05.711041+0000","last_became_active":"2024-02-17T12:19:04.701908+0000","last_became_peered":"2024-02-17T12:19:04.701908+0000","last_unstale":"2024-02-17T12:19:05.711041+0000","last_undegraded":"2024-02-17T12:19:05.711041+0000","last_fullsized":"2024-02-17T12:19:05.711041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:30.749868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519477+0000","last_change":"2024-02-17T12:19:03.702614+0000","last_active":"2024-02-17T12:19:06.519477+0000","last_peered":"2024-02-17T12:19:06.519477+0000","last_clean":"2024-02-17T12:19:06.519477+0000","last_became_active":"2024-02-17T12:19:03.702360+0000","last_became_peered":"2024-02-17T12:19:03.702360+0000","last_unstale":"2024-02-17T12:19:06.519477+0000","last_undegraded":"2024-02-17T12:19:06.519477+0000","last_fullsized":"2024-02-17T12:19:06.519477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:37.418089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380585+0000","last_change":"2024-02-17T12:19:04.697171+0000","last_active":"2024-02-17T12:19:23.380585+0000","last_peered":"2024-02-17T12:19:23.380585+0000","last_clean":"2024-02-17T12:19:23.380585+0000","last_became_active":"2024-02-17T12:19:04.696841+0000","last_became_peered":"2024-02-17T12:19:04.696841+0000","last_unstale":"2024-02-17T12:19:23.380585+0000","last_undegraded":"2024-02-17T12:19:23.380585+0000","last_fullsized":"2024-02-17T12:19:23.380585+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:04:51.114922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708024+0000","last_change":"2024-02-17T12:19:03.706098+0000","last_active":"2024-02-17T12:19:05.708024+0000","last_peered":"2024-02-17T12:19:05.708024+0000","last_clean":"2024-02-17T12:19:05.708024+0000","last_became_active":"2024-02-17T12:19:03.705787+0000","last_became_peered":"2024-02-17T12:19:03.705787+0000","last_unstale":"2024-02-17T12:19:05.708024+0000","last_undegraded":"2024-02-17T12:19:05.708024+0000","last_fullsized":"2024-02-17T12:19:05.708024+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:59.839484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536855+0000","last_change":"2024-02-17T12:19:04.710601+0000","last_active":"2024-02-17T12:19:23.536855+0000","last_peered":"2024-02-17T12:19:23.536855+0000","last_clean":"2024-02-17T12:19:23.536855+0000","last_became_active":"2024-02-17T12:19:04.710296+0000","last_became_peered":"2024-02-17T12:19:04.710296+0000","last_unstale":"2024-02-17T12:19:23.536855+0000","last_undegraded":"2024-02-17T12:19:23.536855+0000","last_fullsized":"2024-02-17T12:19:23.536855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:17:06.226423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708366+0000","last_change":"2024-02-17T12:19:03.707121+0000","last_active":"2024-02-17T12:19:05.708366+0000","last_peered":"2024-02-17T12:19:05.708366+0000","last_clean":"2024-02-17T12:19:05.708366+0000","last_became_active":"2024-02-17T12:19:03.706873+0000","last_became_peered":"2024-02-17T12:19:03.706873+0000","last_unstale":"2024-02-17T12:19:05.708366+0000","last_undegraded":"2024-02-17T12:19:05.708366+0000","last_fullsized":"2024-02-17T12:19:05.708366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:24.015391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210702+0000","last_change":"2024-02-17T12:19:04.718645+0000","last_active":"2024-02-17T12:19:06.210702+0000","last_peered":"2024-02-17T12:19:06.210702+0000","last_clean":"2024-02-17T12:19:06.210702+0000","last_became_active":"2024-02-17T12:19:04.715738+0000","last_became_peered":"2024-02-17T12:19:04.715738+0000","last_unstale":"2024-02-17T12:19:06.210702+0000","last_undegraded":"2024-02-17T12:19:06.210702+0000","last_fullsized":"2024-02-17T12:19:06.210702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:45.056164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210641+0000","last_change":"2024-02-17T12:19:03.705719+0000","last_active":"2024-02-17T12:19:06.210641+0000","last_peered":"2024-02-17T12:19:06.210641+0000","last_clean":"2024-02-17T12:19:06.210641+0000","last_became_active":"2024-02-17T12:19:03.705394+0000","last_became_peered":"2024-02-17T12:19:03.705394+0000","last_unstale":"2024-02-17T12:19:06.210641+0000","last_undegraded":"2024-02-17T12:19:06.210641+0000","last_fullsized":"2024-02-17T12:19:06.210641+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:18.432832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380958+0000","last_change":"2024-02-17T12:19:04.719278+0000","last_active":"2024-02-17T12:19:23.380958+0000","last_peered":"2024-02-17T12:19:23.380958+0000","last_clean":"2024-02-17T12:19:23.380958+0000","last_became_active":"2024-02-17T12:19:04.718194+0000","last_became_peered":"2024-02-17T12:19:04.718194+0000","last_unstale":"2024-02-17T12:19:23.380958+0000","last_undegraded":"2024-02-17T12:19:23.380958+0000","last_fullsized":"2024-02-17T12:19:23.380958+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:11.081786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210809+0000","last_change":"2024-02-17T12:19:03.712607+0000","last_active":"2024-02-17T12:19:06.210809+0000","last_peered":"2024-02-17T12:19:06.210809+0000","last_clean":"2024-02-17T12:19:06.210809+0000","last_became_active":"2024-02-17T12:19:03.712328+0000","last_became_peered":"2024-02-17T12:19:03.712328+0000","last_unstale":"2024-02-17T12:19:06.210809+0000","last_undegraded":"2024-02-17T12:19:06.210809+0000","last_fullsized":"2024-02-17T12:19:06.210809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535812+0000","last_change":"2024-02-17T12:19:22.379938+0000","last_active":"2024-02-17T12:19:23.535812+0000","last_peered":"2024-02-17T12:19:23.535812+0000","last_clean":"2024-02-17T12:19:23.535812+0000","last_became_active":"2024-02-17T12:19:22.379601+0000","last_became_peered":"2024-02-17T12:19:22.379601+0000","last_unstale":"2024-02-17T12:19:23.535812+0000","last_undegraded":"2024-02-17T12:19:23.535812+0000","last_fullsized":"2024-02-17T12:19:23.535812+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:24:23.237404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711331+0000","last_change":"2024-02-17T12:19:04.711425+0000","last_active":"2024-02-17T12:19:05.711331+0000","last_peered":"2024-02-17T12:19:05.711331+0000","last_clean":"2024-02-17T12:19:05.711331+0000","last_became_active":"2024-02-17T12:19:04.711149+0000","last_became_peered":"2024-02-17T12:19:04.711149+0000","last_unstale":"2024-02-17T12:19:05.711331+0000","last_undegraded":"2024-02-17T12:19:05.711331+0000","last_fullsized":"2024-02-17T12:19:05.711331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521184+0000","last_change":"2024-02-17T12:19:03.708773+0000","last_active":"2024-02-17T12:19:06.521184+0000","last_peered":"2024-02-17T12:19:06.521184+0000","last_clean":"2024-02-17T12:19:06.521184+0000","last_became_active":"2024-02-17T12:19:03.707579+0000","last_became_peered":"2024-02-17T12:19:03.707579+0000","last_unstale":"2024-02-17T12:19:06.521184+0000","last_undegraded":"2024-02-17T12:19:06.521184+0000","last_fullsized":"2024-02-17T12:19:06.521184+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537328+0000","last_change":"2024-02-17T12:19:21.376109+0000","last_active":"2024-02-17T12:19:23.537328+0000","last_peered":"2024-02-17T12:19:23.537328+0000","last_clean":"2024-02-17T12:19:23.537328+0000","last_became_active":"2024-02-17T12:19:21.375805+0000","last_became_peered":"2024-02-17T12:19:21.375805+0000","last_unstale":"2024-02-17T12:19:23.537328+0000","last_undegraded":"2024-02-17T12:19:23.537328+0000","last_fullsized":"2024-02-17T12:19:23.537328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:31.884225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521131+0000","last_change":"2024-02-17T12:19:04.699129+0000","last_active":"2024-02-17T12:19:06.521131+0000","last_peered":"2024-02-17T12:19:06.521131+0000","last_clean":"2024-02-17T12:19:06.521131+0000","last_became_active":"2024-02-17T12:19:04.698800+0000","last_became_peered":"2024-02-17T12:19:04.698800+0000","last_unstale":"2024-02-17T12:19:06.521131+0000","last_undegraded":"2024-02-17T12:19:06.521131+0000","last_fullsized":"2024-02-17T12:19:06.521131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:36:34.252865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380734+0000","last_change":"2024-02-17T12:19:03.705779+0000","last_active":"2024-02-17T12:19:23.380734+0000","last_peered":"2024-02-17T12:19:23.380734+0000","last_clean":"2024-02-17T12:19:23.380734+0000","last_became_active":"2024-02-17T12:19:03.705453+0000","last_became_peered":"2024-02-17T12:19:03.705453+0000","last_unstale":"2024-02-17T12:19:23.380734+0000","last_undegraded":"2024-02-17T12:19:23.380734+0000","last_fullsized":"2024-02-17T12:19:23.380734+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:20.550660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538181+0000","last_change":"2024-02-17T12:19:22.382589+0000","last_active":"2024-02-17T12:19:23.538181+0000","last_peered":"2024-02-17T12:19:23.538181+0000","last_clean":"2024-02-17T12:19:23.538181+0000","last_became_active":"2024-02-17T12:19:22.381978+0000","last_became_peered":"2024-02-17T12:19:22.381978+0000","last_unstale":"2024-02-17T12:19:23.538181+0000","last_undegraded":"2024-02-17T12:19:23.538181+0000","last_fullsized":"2024-02-17T12:19:23.538181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:28.744493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535962+0000","last_change":"2024-02-17T12:19:04.717000+0000","last_active":"2024-02-17T12:19:23.535962+0000","last_peered":"2024-02-17T12:19:23.535962+0000","last_clean":"2024-02-17T12:19:23.535962+0000","last_became_active":"2024-02-17T12:19:04.716743+0000","last_became_peered":"2024-02-17T12:19:04.716743+0000","last_unstale":"2024-02-17T12:19:23.535962+0000","last_undegraded":"2024-02-17T12:19:23.535962+0000","last_fullsized":"2024-02-17T12:19:23.535962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:48:38.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210382+0000","last_change":"2024-02-17T12:19:03.710199+0000","last_active":"2024-02-17T12:19:06.210382+0000","last_peered":"2024-02-17T12:19:06.210382+0000","last_clean":"2024-02-17T12:19:06.210382+0000","last_became_active":"2024-02-17T12:19:03.709947+0000","last_became_peered":"2024-02-17T12:19:03.709947+0000","last_unstale":"2024-02-17T12:19:06.210382+0000","last_undegraded":"2024-02-17T12:19:06.210382+0000","last_fullsized":"2024-02-17T12:19:06.210382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380107+0000","last_change":"2024-02-17T12:19:22.375575+0000","last_active":"2024-02-17T12:19:23.380107+0000","last_peered":"2024-02-17T12:19:23.380107+0000","last_clean":"2024-02-17T12:19:23.380107+0000","last_became_active":"2024-02-17T12:19:22.375217+0000","last_became_peered":"2024-02-17T12:19:22.375217+0000","last_unstale":"2024-02-17T12:19:23.380107+0000","last_undegraded":"2024-02-17T12:19:23.380107+0000","last_fullsized":"2024-02-17T12:19:23.380107+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:26.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210236+0000","last_change":"2024-02-17T12:19:04.713606+0000","last_active":"2024-02-17T12:19:06.210236+0000","last_peered":"2024-02-17T12:19:06.210236+0000","last_clean":"2024-02-17T12:19:06.210236+0000","last_became_active":"2024-02-17T12:19:04.708088+0000","last_became_peered":"2024-02-17T12:19:04.708088+0000","last_unstale":"2024-02-17T12:19:06.210236+0000","last_undegraded":"2024-02-17T12:19:06.210236+0000","last_fullsized":"2024-02-17T12:19:06.210236+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:22.491827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379511+0000","last_change":"2024-02-17T12:19:03.701618+0000","last_active":"2024-02-17T12:19:23.379511+0000","last_peered":"2024-02-17T12:19:23.379511+0000","last_clean":"2024-02-17T12:19:23.379511+0000","last_became_active":"2024-02-17T12:19:03.701291+0000","last_became_peered":"2024-02-17T12:19:03.701291+0000","last_unstale":"2024-02-17T12:19:23.379511+0000","last_undegraded":"2024-02-17T12:19:23.379511+0000","last_fullsized":"2024-02-17T12:19:23.379511+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:13.448703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537887+0000","last_change":"2024-02-17T12:19:22.389793+0000","last_active":"2024-02-17T12:19:23.537887+0000","last_peered":"2024-02-17T12:19:23.537887+0000","last_clean":"2024-02-17T12:19:23.537887+0000","last_became_active":"2024-02-17T12:19:22.389415+0000","last_became_peered":"2024-02-17T12:19:22.389415+0000","last_unstale":"2024-02-17T12:19:23.537887+0000","last_undegraded":"2024-02-17T12:19:23.537887+0000","last_fullsized":"2024-02-17T12:19:23.537887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:26.992781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536720+0000","last_change":"2024-02-17T12:19:21.375230+0000","last_active":"2024-02-17T12:19:23.536720+0000","last_peered":"2024-02-17T12:19:23.536720+0000","last_clean":"2024-02-17T12:19:23.536720+0000","last_became_active":"2024-02-17T12:19:21.374933+0000","last_became_peered":"2024-02-17T12:19:21.374933+0000","last_unstale":"2024-02-17T12:19:23.536720+0000","last_undegraded":"2024-02-17T12:19:23.536720+0000","last_fullsized":"2024-02-17T12:19:23.536720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:09:40.208486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708155+0000","last_change":"2024-02-17T12:19:04.719250+0000","last_active":"2024-02-17T12:19:05.708155+0000","last_peered":"2024-02-17T12:19:05.708155+0000","last_clean":"2024-02-17T12:19:05.708155+0000","last_became_active":"2024-02-17T12:19:04.718856+0000","last_became_peered":"2024-02-17T12:19:04.718856+0000","last_unstale":"2024-02-17T12:19:05.708155+0000","last_undegraded":"2024-02-17T12:19:05.708155+0000","last_fullsized":"2024-02-17T12:19:05.708155+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:43.814483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537757+0000","last_change":"2024-02-17T12:19:03.712148+0000","last_active":"2024-02-17T12:19:23.537757+0000","last_peered":"2024-02-17T12:19:23.537757+0000","last_clean":"2024-02-17T12:19:23.537757+0000","last_became_active":"2024-02-17T12:19:03.711771+0000","last_became_peered":"2024-02-17T12:19:03.711771+0000","last_unstale":"2024-02-17T12:19:23.537757+0000","last_undegraded":"2024-02-17T12:19:23.537757+0000","last_fullsized":"2024-02-17T12:19:23.537757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:53.868822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":265,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536127+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:19:23.536127+0000","last_peered":"2024-02-17T12:19:23.536127+0000","last_clean":"2024-02-17T12:19:23.536127+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:19:23.536127+0000","last_undegraded":"2024-02-17T12:19:23.536127+0000","last_fullsized":"2024-02-17T12:19:23.536127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":3},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":18,"acting":18,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":361275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97299999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.115,"15min":1.115},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.143,"15min":1.143},"last":0.75800000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.629},{"interface":"front","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0640000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":1.734,"15min":1.734},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68200000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0840000000000001,"5min":1.804,"15min":1.804},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.5,"15min":1.5},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1419999999999999,"5min":1.855,"15min":1.855},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.77700000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":843776,"data_stored":363718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.73699999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.751}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.64100000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.45500000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.5},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.54400000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":839680,"data_stored":363696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57599999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54600000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.014,"5min":1.387,"15min":1.387},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.626},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0409999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.149,"5min":1.714,"15min":1.714},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1339999999999999,"5min":1.744,"15min":1.744},"last":0.64200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0980000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0720000000000001,"5min":1.575,"15min":1.575},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95099999999999996,"5min":1.321,"15min":1.321},"last":0.70499999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":360775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":1.145,"15min":1.145},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60599999999999998,"15min":0.66600000000000004},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.37}]},{"osd":2,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.755},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.48799999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.626,"15min":0.66100000000000003},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":2.609,"15min":2.609},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.68200000000000005,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.5}]},{"osd":4,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.03,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.54700000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.012,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.042,"5min":1.095,"15min":1.095},"last":0.69199999999999995}]},{"osd":6,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.96999999999999997,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.91600000000000004,"15min":0.98999999999999999},"min":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0549999999999999,"5min":5.375,"15min":5.375},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.92400000000000004,"15min":0.998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95099999999999996,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":1.629,"15min":1.629},"last":0.65100000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1425408,"data_stored":950983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58799999999999997,"5min":1.046,"15min":1.046},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66700000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96699999999999997,"5min":1.139,"15min":1.139},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.746,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.071,"15min":1.071},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.095,"15min":1.095},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.008,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.749},"min":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.73999999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1470464,"data_stored":972565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97399999999999998,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.50700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.502}]},{"osd":4,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61799999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98199999999999998,"5min":1.052,"15min":1.052},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":390908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81699999999999995,"5min":1.264,"15min":1.264},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89200000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.749,"15min":0.755},"min":{"1min":0.61599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96699999999999997,"5min":1.198,"15min":1.198},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48999999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.171,"15min":1.171},"last":0.72499999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1040000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.999,"5min":1.522,"15min":1.522},"last":0.82299999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.503},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60899999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":1.228,"15min":1.228},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":382631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.376},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45600000000000002},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.439}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.179,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93200000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.59799999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.042,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.995,"5min":1.252,"15min":1.252},"last":0.71599999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0669999999999999,"5min":1.29,"15min":1.29},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1319999999999999,"5min":1.337,"15min":1.337},"last":0.82899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:19:26.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:19:26.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa387400640 1 Processor -- start 2024-02-17T12:19:26.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa387400640 1 -- start start 2024-02-17T12:19:26.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa387400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3800714c0 0x7fa380156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa387400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa380152d30 0x7fa3801531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa387400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa380157270 con 0x7fa380150300 2024-02-17T12:19:26.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa387400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3800c6900 con 0x7fa3800714c0 2024-02-17T12:19:26.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa387400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800c3580 con 0x7fa380152d30 2024-02-17T12:19:26.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa37fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3800714c0 0x7fa380156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa37fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3800714c0 0x7fa380156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35422/0 (socket says 172.21.15.114:35422) 2024-02-17T12:19:26.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa37fe00640 1 -- 172.21.15.114:0/1570391190 learned_addr learned my addr 172.21.15.114:0/1570391190 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:26.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa385400640 1 --2- 172.21.15.114:0/1570391190 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa380152d30 0x7fa3801531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa37fe00640 1 -- 172.21.15.114:0/1570391190 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa380152d30 msgr2=0x7fa3801531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:26.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa37fe00640 1 --2- 172.21.15.114:0/1570391190 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa380152d30 0x7fa3801531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa37fe00640 1 -- 172.21.15.114:0/1570391190 >> v1:172.21.15.116:6789/0 conn(0x7fa380150300 legacy=0x7fa3800aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.620+0000 7fa37fe00640 1 -- 172.21.15.114:0/1570391190 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800c2fc0 con 0x7fa3800714c0 2024-02-17T12:19:26.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa37fe00640 1 --2- 172.21.15.114:0/1570391190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3800714c0 0x7fa380156d30 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009870 tx=0x7fa36c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef623699f4585e33 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:26.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa37f400640 1 -- 172.21.15.114:0/1570391190 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0ab600 con 0x7fa3800714c0 2024-02-17T12:19:26.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa37f400640 1 -- 172.21.15.114:0/1570391190 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c0a7050 con 0x7fa3800714c0 2024-02-17T12:19:26.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa37f400640 1 -- 172.21.15.114:0/1570391190 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0ab980 con 0x7fa3800714c0 2024-02-17T12:19:26.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa387400640 1 -- 172.21.15.114:0/1570391190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3800714c0 msgr2=0x7fa380156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa387400640 1 --2- 172.21.15.114:0/1570391190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3800714c0 0x7fa380156d30 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009870 tx=0x7fa36c01c4d0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa387400640 1 -- 172.21.15.114:0/1570391190 shutdown_connections 2024-02-17T12:19:26.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa387400640 1 --2- 172.21.15.114:0/1570391190 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa380152d30 0x7fa3801531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa387400640 1 --2- 172.21.15.114:0/1570391190 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3800714c0 0x7fa380156d30 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa387400640 1 -- 172.21.15.114:0/1570391190 >> 172.21.15.114:0/1570391190 conn(0x7fa3800c4f20 msgr2=0x7fa3800c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:26.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa387400640 1 -- 172.21.15.114:0/1570391190 shutdown_connections 2024-02-17T12:19:26.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.624+0000 7fa387400640 1 -- 172.21.15.114:0/1570391190 wait complete. 2024-02-17T12:19:26.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa387400640 1 Processor -- start 2024-02-17T12:19:26.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa387400640 1 -- start start 2024-02-17T12:19:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa387400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3800714c0 0x7fa3801ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa387400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa380150300 0x7fa3800c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa387400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa380152d30 0x7fa3800ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa387400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3800a9590 con 0x7fa380150300 2024-02-17T12:19:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa387400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3801f1c10 con 0x7fa380152d30 2024-02-17T12:19:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa387400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3801f1090 con 0x7fa3800714c0 2024-02-17T12:19:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa380150300 0x7fa3800c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa380150300 0x7fa3800c1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35430/0 (socket says 172.21.15.114:35430) 2024-02-17T12:19:26.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37fe00640 1 -- 172.21.15.114:0/3346981491 learned_addr learned my addr 172.21.15.114:0/3346981491 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa385400640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa380152d30 0x7fa3800ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa384a00640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3800714c0 0x7fa3801ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37fe00640 1 -- 172.21.15.114:0/3346981491 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3800714c0 msgr2=0x7fa3801ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37fe00640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3800714c0 0x7fa3801ed6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37fe00640 1 -- 172.21.15.114:0/3346981491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa380152d30 msgr2=0x7fa3800ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37fe00640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa380152d30 0x7fa3800ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37fe00640 1 -- 172.21.15.114:0/3346981491 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c0094d0 con 0x7fa380150300 2024-02-17T12:19:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa384a00640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3800714c0 0x7fa3801ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:26.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa385400640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa380152d30 0x7fa3800ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:26.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37fe00640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa380150300 0x7fa3800c1ab0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0ae040 tx=0x7fa36c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:26.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37cc00640 1 -- 172.21.15.114:0/3346981491 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0b6470 con 0x7fa380150300 2024-02-17T12:19:26.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37cc00640 1 -- 172.21.15.114:0/3346981491 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c0b65d0 con 0x7fa380150300 2024-02-17T12:19:26.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa37cc00640 1 -- 172.21.15.114:0/3346981491 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0b6980 con 0x7fa380150300 2024-02-17T12:19:26.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa387400640 1 -- 172.21.15.114:0/3346981491 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3801f1370 con 0x7fa380150300 2024-02-17T12:19:26.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.628+0000 7fa387400640 1 -- 172.21.15.114:0/3346981491 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3801f1930 con 0x7fa380150300 2024-02-17T12:19:26.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.632+0000 7fa387400640 1 -- 172.21.15.114:0/3346981491 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa380074840 con 0x7fa380150300 2024-02-17T12:19:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.632+0000 7fa37cc00640 1 -- 172.21.15.114:0/3346981491 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa36c0b2070 con 0x7fa380150300 2024-02-17T12:19:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.632+0000 7fa37cc00640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa360066e70 0x7fa360069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.632+0000 7fa37cc00640 1 -- 172.21.15.114:0/3346981491 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa36c11f400 con 0x7fa380150300 2024-02-17T12:19:26.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.632+0000 7fa384a00640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa360066e70 0x7fa360069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:26.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.632+0000 7fa384a00640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa360066e70 0x7fa360069330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa3800a9220 tx=0x7fa370009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:26.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.636+0000 7fa37cc00640 1 -- 172.21.15.114:0/3346981491 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa36c0ebdf0 con 0x7fa380150300 2024-02-17T12:19:26.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.788+0000 7fa387400640 1 -- 172.21.15.114:0/3346981491 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3800ae7b0 con 0x7fa360066e70 2024-02-17T12:19:26.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.800+0000 7fa37cc00640 1 -- 172.21.15.114:0/3346981491 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+518901 (secure 0 0 0) 0x7fa3800ae7b0 con 0x7fa360066e70 2024-02-17T12:19:26.807 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:26.811 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:19:26.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 -- 172.21.15.114:0/3346981491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa360066e70 msgr2=0x7fa360069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa360066e70 0x7fa360069330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa3800a9220 tx=0x7fa370009040 comp rx=0 tx=0).stop 2024-02-17T12:19:26.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 -- 172.21.15.114:0/3346981491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa380150300 msgr2=0x7fa3800c1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:26.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa380150300 0x7fa3800c1ab0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0ae040 tx=0x7fa36c019270 comp rx=0 tx=0).stop 2024-02-17T12:19:26.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 -- 172.21.15.114:0/3346981491 shutdown_connections 2024-02-17T12:19:26.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa380152d30 0x7fa3800ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa360066e70 0x7fa360069330 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa380150300 0x7fa3800c1ab0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 --2- 172.21.15.114:0/3346981491 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3800714c0 0x7fa3801ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:26.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 -- 172.21.15.114:0/3346981491 >> 172.21.15.114:0/3346981491 conn(0x7fa3800c4f20 msgr2=0x7fa38014e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:26.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 -- 172.21.15.114:0/3346981491 shutdown_connections 2024-02-17T12:19:26.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:26.804+0000 7fa387400640 1 -- 172.21.15.114:0/3346981491 wait complete. 2024-02-17T12:19:26.826 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-02-17T12:19:25.254893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596039,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":223,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":270,"acting":270,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":224,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244816,"kb_used_data":7840,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729904,"statfs":{"total":773094113280,"available":772843421696,"internally_reserved":0,"allocated":8028160,"data_stored":4146551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914084"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210592+0000","last_change":"2024-02-17T12:19:04.712400+0000","last_active":"2024-02-17T12:19:06.210592+0000","last_peered":"2024-02-17T12:19:06.210592+0000","last_clean":"2024-02-17T12:19:06.210592+0000","last_became_active":"2024-02-17T12:19:04.711598+0000","last_became_peered":"2024-02-17T12:19:04.711598+0000","last_unstale":"2024-02-17T12:19:06.210592+0000","last_undegraded":"2024-02-17T12:19:06.210592+0000","last_fullsized":"2024-02-17T12:19:06.210592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:02.628891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708335+0000","last_change":"2024-02-17T12:19:04.723008+0000","last_active":"2024-02-17T12:19:05.708335+0000","last_peered":"2024-02-17T12:19:05.708335+0000","last_clean":"2024-02-17T12:19:05.708335+0000","last_became_active":"2024-02-17T12:19:04.722730+0000","last_became_peered":"2024-02-17T12:19:04.722730+0000","last_unstale":"2024-02-17T12:19:05.708335+0000","last_undegraded":"2024-02-17T12:19:05.708335+0000","last_fullsized":"2024-02-17T12:19:05.708335+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:43.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537537+0000","last_change":"2024-02-17T12:19:04.710193+0000","last_active":"2024-02-17T12:19:23.537537+0000","last_peered":"2024-02-17T12:19:23.537537+0000","last_clean":"2024-02-17T12:19:23.537537+0000","last_became_active":"2024-02-17T12:19:04.709527+0000","last_became_peered":"2024-02-17T12:19:04.709527+0000","last_unstale":"2024-02-17T12:19:23.537537+0000","last_undegraded":"2024-02-17T12:19:23.537537+0000","last_fullsized":"2024-02-17T12:19:23.537537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:10:56.143323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537666+0000","last_change":"2024-02-17T12:19:04.728530+0000","last_active":"2024-02-17T12:19:23.537666+0000","last_peered":"2024-02-17T12:19:23.537666+0000","last_clean":"2024-02-17T12:19:23.537666+0000","last_became_active":"2024-02-17T12:19:04.728245+0000","last_became_peered":"2024-02-17T12:19:04.728245+0000","last_unstale":"2024-02-17T12:19:23.537666+0000","last_undegraded":"2024-02-17T12:19:23.537666+0000","last_fullsized":"2024-02-17T12:19:23.537666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:22.116393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535753+0000","last_change":"2024-02-17T12:19:22.369693+0000","last_active":"2024-02-17T12:19:23.535753+0000","last_peered":"2024-02-17T12:19:23.535753+0000","last_clean":"2024-02-17T12:19:23.535753+0000","last_became_active":"2024-02-17T12:19:22.368141+0000","last_became_peered":"2024-02-17T12:19:22.368141+0000","last_unstale":"2024-02-17T12:19:23.535753+0000","last_undegraded":"2024-02-17T12:19:23.535753+0000","last_fullsized":"2024-02-17T12:19:23.535753+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:16.792200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380238+0000","last_change":"2024-02-17T12:19:04.727165+0000","last_active":"2024-02-17T12:19:23.380238+0000","last_peered":"2024-02-17T12:19:23.380238+0000","last_clean":"2024-02-17T12:19:23.380238+0000","last_became_active":"2024-02-17T12:19:04.726850+0000","last_became_peered":"2024-02-17T12:19:04.726850+0000","last_unstale":"2024-02-17T12:19:23.380238+0000","last_undegraded":"2024-02-17T12:19:23.380238+0000","last_fullsized":"2024-02-17T12:19:23.380238+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:54.875823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711199+0000","last_change":"2024-02-17T12:19:04.713676+0000","last_active":"2024-02-17T12:19:05.711199+0000","last_peered":"2024-02-17T12:19:05.711199+0000","last_clean":"2024-02-17T12:19:05.711199+0000","last_became_active":"2024-02-17T12:19:04.710032+0000","last_became_peered":"2024-02-17T12:19:04.710032+0000","last_unstale":"2024-02-17T12:19:05.711199+0000","last_undegraded":"2024-02-17T12:19:05.711199+0000","last_fullsized":"2024-02-17T12:19:05.711199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536303+0000","last_change":"2024-02-17T12:19:04.714280+0000","last_active":"2024-02-17T12:19:23.536303+0000","last_peered":"2024-02-17T12:19:23.536303+0000","last_clean":"2024-02-17T12:19:23.536303+0000","last_became_active":"2024-02-17T12:19:04.714025+0000","last_became_peered":"2024-02-17T12:19:04.714025+0000","last_unstale":"2024-02-17T12:19:23.536303+0000","last_undegraded":"2024-02-17T12:19:23.536303+0000","last_fullsized":"2024-02-17T12:19:23.536303+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:04:31.444208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536568+0000","last_change":"2024-02-17T12:19:22.376606+0000","last_active":"2024-02-17T12:19:23.536568+0000","last_peered":"2024-02-17T12:19:23.536568+0000","last_clean":"2024-02-17T12:19:23.536568+0000","last_became_active":"2024-02-17T12:19:22.375794+0000","last_became_peered":"2024-02-17T12:19:22.375794+0000","last_unstale":"2024-02-17T12:19:23.536568+0000","last_undegraded":"2024-02-17T12:19:23.536568+0000","last_fullsized":"2024-02-17T12:19:23.536568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:41:26.244504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711186+0000","last_change":"2024-02-17T12:19:04.716344+0000","last_active":"2024-02-17T12:19:05.711186+0000","last_peered":"2024-02-17T12:19:05.711186+0000","last_clean":"2024-02-17T12:19:05.711186+0000","last_became_active":"2024-02-17T12:19:04.716003+0000","last_became_peered":"2024-02-17T12:19:04.716003+0000","last_unstale":"2024-02-17T12:19:05.711186+0000","last_undegraded":"2024-02-17T12:19:05.711186+0000","last_fullsized":"2024-02-17T12:19:05.711186+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:37.092834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537290+0000","last_change":"2024-02-17T12:19:22.380385+0000","last_active":"2024-02-17T12:19:23.537290+0000","last_peered":"2024-02-17T12:19:23.537290+0000","last_clean":"2024-02-17T12:19:23.537290+0000","last_became_active":"2024-02-17T12:19:22.380030+0000","last_became_peered":"2024-02-17T12:19:22.380030+0000","last_unstale":"2024-02-17T12:19:23.537290+0000","last_undegraded":"2024-02-17T12:19:23.537290+0000","last_fullsized":"2024-02-17T12:19:23.537290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:33:39.599699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.712377+0000","last_change":"2024-02-17T12:19:04.705511+0000","last_active":"2024-02-17T12:19:05.712377+0000","last_peered":"2024-02-17T12:19:05.712377+0000","last_clean":"2024-02-17T12:19:05.712377+0000","last_became_active":"2024-02-17T12:19:04.705195+0000","last_became_peered":"2024-02-17T12:19:04.705195+0000","last_unstale":"2024-02-17T12:19:05.712377+0000","last_undegraded":"2024-02-17T12:19:05.712377+0000","last_fullsized":"2024-02-17T12:19:05.712377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380515+0000","last_change":"2024-02-17T12:19:22.376957+0000","last_active":"2024-02-17T12:19:23.380515+0000","last_peered":"2024-02-17T12:19:23.380515+0000","last_clean":"2024-02-17T12:19:23.380515+0000","last_became_active":"2024-02-17T12:19:22.375810+0000","last_became_peered":"2024-02-17T12:19:22.375810+0000","last_unstale":"2024-02-17T12:19:23.380515+0000","last_undegraded":"2024-02-17T12:19:23.380515+0000","last_fullsized":"2024-02-17T12:19:23.380515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:06:06.364890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210616+0000","last_change":"2024-02-17T12:19:04.721693+0000","last_active":"2024-02-17T12:19:06.210616+0000","last_peered":"2024-02-17T12:19:06.210616+0000","last_clean":"2024-02-17T12:19:06.210616+0000","last_became_active":"2024-02-17T12:19:04.721343+0000","last_became_peered":"2024-02-17T12:19:04.721343+0000","last_unstale":"2024-02-17T12:19:06.210616+0000","last_undegraded":"2024-02-17T12:19:06.210616+0000","last_fullsized":"2024-02-17T12:19:06.210616+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:38.425090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381058+0000","last_change":"2024-02-17T12:19:22.370504+0000","last_active":"2024-02-17T12:19:23.381058+0000","last_peered":"2024-02-17T12:19:23.381058+0000","last_clean":"2024-02-17T12:19:23.381058+0000","last_became_active":"2024-02-17T12:19:22.370262+0000","last_became_peered":"2024-02-17T12:19:22.370262+0000","last_unstale":"2024-02-17T12:19:23.381058+0000","last_undegraded":"2024-02-17T12:19:23.381058+0000","last_fullsized":"2024-02-17T12:19:23.381058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:43:12.017524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708086+0000","last_change":"2024-02-17T12:19:04.717487+0000","last_active":"2024-02-17T12:19:05.708086+0000","last_peered":"2024-02-17T12:19:05.708086+0000","last_clean":"2024-02-17T12:19:05.708086+0000","last_became_active":"2024-02-17T12:19:04.717208+0000","last_became_peered":"2024-02-17T12:19:04.717208+0000","last_unstale":"2024-02-17T12:19:05.708086+0000","last_undegraded":"2024-02-17T12:19:05.708086+0000","last_fullsized":"2024-02-17T12:19:05.708086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:36:18.116201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210251+0000","last_change":"2024-02-17T12:19:04.720687+0000","last_active":"2024-02-17T12:19:06.210251+0000","last_peered":"2024-02-17T12:19:06.210251+0000","last_clean":"2024-02-17T12:19:06.210251+0000","last_became_active":"2024-02-17T12:19:04.720429+0000","last_became_peered":"2024-02-17T12:19:04.720429+0000","last_unstale":"2024-02-17T12:19:06.210251+0000","last_undegraded":"2024-02-17T12:19:06.210251+0000","last_fullsized":"2024-02-17T12:19:06.210251+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:13:30.982744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536857+0000","last_change":"2024-02-17T12:19:04.711936+0000","last_active":"2024-02-17T12:19:23.536857+0000","last_peered":"2024-02-17T12:19:23.536857+0000","last_clean":"2024-02-17T12:19:23.536857+0000","last_became_active":"2024-02-17T12:19:04.711624+0000","last_became_peered":"2024-02-17T12:19:04.711624+0000","last_unstale":"2024-02-17T12:19:23.536857+0000","last_undegraded":"2024-02-17T12:19:23.536857+0000","last_fullsized":"2024-02-17T12:19:23.536857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:55.448178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535626+0000","last_change":"2024-02-17T12:19:22.375472+0000","last_active":"2024-02-17T12:19:23.535626+0000","last_peered":"2024-02-17T12:19:23.535626+0000","last_clean":"2024-02-17T12:19:23.535626+0000","last_became_active":"2024-02-17T12:19:22.375196+0000","last_became_peered":"2024-02-17T12:19:22.375196+0000","last_unstale":"2024-02-17T12:19:23.535626+0000","last_undegraded":"2024-02-17T12:19:23.535626+0000","last_fullsized":"2024-02-17T12:19:23.535626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:17.057488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538389+0000","last_change":"2024-02-17T12:19:04.728727+0000","last_active":"2024-02-17T12:19:23.538389+0000","last_peered":"2024-02-17T12:19:23.538389+0000","last_clean":"2024-02-17T12:19:23.538389+0000","last_became_active":"2024-02-17T12:19:04.728194+0000","last_became_peered":"2024-02-17T12:19:04.728194+0000","last_unstale":"2024-02-17T12:19:23.538389+0000","last_undegraded":"2024-02-17T12:19:23.538389+0000","last_fullsized":"2024-02-17T12:19:23.538389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:07:54.785092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519632+0000","last_change":"2024-02-17T12:19:04.710789+0000","last_active":"2024-02-17T12:19:06.519632+0000","last_peered":"2024-02-17T12:19:06.519632+0000","last_clean":"2024-02-17T12:19:06.519632+0000","last_became_active":"2024-02-17T12:19:04.710321+0000","last_became_peered":"2024-02-17T12:19:04.710321+0000","last_unstale":"2024-02-17T12:19:06.519632+0000","last_undegraded":"2024-02-17T12:19:06.519632+0000","last_fullsized":"2024-02-17T12:19:06.519632+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:20.439350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537575+0000","last_change":"2024-02-17T12:19:22.389161+0000","last_active":"2024-02-17T12:19:23.537575+0000","last_peered":"2024-02-17T12:19:23.537575+0000","last_clean":"2024-02-17T12:19:23.537575+0000","last_became_active":"2024-02-17T12:19:22.388885+0000","last_became_peered":"2024-02-17T12:19:22.388885+0000","last_unstale":"2024-02-17T12:19:23.537575+0000","last_undegraded":"2024-02-17T12:19:23.537575+0000","last_fullsized":"2024-02-17T12:19:23.537575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:32.525943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379396+0000","last_change":"2024-02-17T12:19:04.714567+0000","last_active":"2024-02-17T12:19:23.379396+0000","last_peered":"2024-02-17T12:19:23.379396+0000","last_clean":"2024-02-17T12:19:23.379396+0000","last_became_active":"2024-02-17T12:19:04.714283+0000","last_became_peered":"2024-02-17T12:19:04.714283+0000","last_unstale":"2024-02-17T12:19:23.379396+0000","last_undegraded":"2024-02-17T12:19:23.379396+0000","last_fullsized":"2024-02-17T12:19:23.379396+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:36.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537786+0000","last_change":"2024-02-17T12:19:22.388259+0000","last_active":"2024-02-17T12:19:23.537786+0000","last_peered":"2024-02-17T12:19:23.537786+0000","last_clean":"2024-02-17T12:19:23.537786+0000","last_became_active":"2024-02-17T12:19:22.387822+0000","last_became_peered":"2024-02-17T12:19:22.387822+0000","last_unstale":"2024-02-17T12:19:23.537786+0000","last_undegraded":"2024-02-17T12:19:23.537786+0000","last_fullsized":"2024-02-17T12:19:23.537786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:23.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381171+0000","last_change":"2024-02-17T12:19:04.707760+0000","last_active":"2024-02-17T12:19:23.381171+0000","last_peered":"2024-02-17T12:19:23.381171+0000","last_clean":"2024-02-17T12:19:23.381171+0000","last_became_active":"2024-02-17T12:19:04.707499+0000","last_became_peered":"2024-02-17T12:19:04.707499+0000","last_unstale":"2024-02-17T12:19:23.381171+0000","last_undegraded":"2024-02-17T12:19:23.381171+0000","last_fullsized":"2024-02-17T12:19:23.381171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:24:01.313056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380698+0000","last_change":"2024-02-17T12:19:22.378610+0000","last_active":"2024-02-17T12:19:23.380698+0000","last_peered":"2024-02-17T12:19:23.380698+0000","last_clean":"2024-02-17T12:19:23.380698+0000","last_became_active":"2024-02-17T12:19:22.377368+0000","last_became_peered":"2024-02-17T12:19:22.377368+0000","last_unstale":"2024-02-17T12:19:23.380698+0000","last_undegraded":"2024-02-17T12:19:23.380698+0000","last_fullsized":"2024-02-17T12:19:23.380698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:32.414191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538289+0000","last_change":"2024-02-17T12:19:04.710944+0000","last_active":"2024-02-17T12:19:23.538289+0000","last_peered":"2024-02-17T12:19:23.538289+0000","last_clean":"2024-02-17T12:19:23.538289+0000","last_became_active":"2024-02-17T12:19:04.710625+0000","last_became_peered":"2024-02-17T12:19:04.710625+0000","last_unstale":"2024-02-17T12:19:23.538289+0000","last_undegraded":"2024-02-17T12:19:23.538289+0000","last_fullsized":"2024-02-17T12:19:23.538289+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:22:57.157645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520976+0000","last_change":"2024-02-17T12:19:04.718758+0000","last_active":"2024-02-17T12:19:06.520976+0000","last_peered":"2024-02-17T12:19:06.520976+0000","last_clean":"2024-02-17T12:19:06.520976+0000","last_became_active":"2024-02-17T12:19:04.718486+0000","last_became_peered":"2024-02-17T12:19:04.718486+0000","last_unstale":"2024-02-17T12:19:06.520976+0000","last_undegraded":"2024-02-17T12:19:06.520976+0000","last_fullsized":"2024-02-17T12:19:06.520976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.895909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537775+0000","last_change":"2024-02-17T12:19:04.714461+0000","last_active":"2024-02-17T12:19:23.537775+0000","last_peered":"2024-02-17T12:19:23.537775+0000","last_clean":"2024-02-17T12:19:23.537775+0000","last_became_active":"2024-02-17T12:19:04.714208+0000","last_became_peered":"2024-02-17T12:19:04.714208+0000","last_unstale":"2024-02-17T12:19:23.537775+0000","last_undegraded":"2024-02-17T12:19:23.537775+0000","last_fullsized":"2024-02-17T12:19:23.537775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:45.424685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538193+0000","last_change":"2024-02-17T12:19:04.722346+0000","last_active":"2024-02-17T12:19:23.538193+0000","last_peered":"2024-02-17T12:19:23.538193+0000","last_clean":"2024-02-17T12:19:23.538193+0000","last_became_active":"2024-02-17T12:19:04.722106+0000","last_became_peered":"2024-02-17T12:19:04.722106+0000","last_unstale":"2024-02-17T12:19:23.538193+0000","last_undegraded":"2024-02-17T12:19:23.538193+0000","last_fullsized":"2024-02-17T12:19:23.538193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:11.976571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535907+0000","last_change":"2024-02-17T12:19:22.372825+0000","last_active":"2024-02-17T12:19:23.535907+0000","last_peered":"2024-02-17T12:19:23.535907+0000","last_clean":"2024-02-17T12:19:23.535907+0000","last_became_active":"2024-02-17T12:19:22.372503+0000","last_became_peered":"2024-02-17T12:19:22.372503+0000","last_unstale":"2024-02-17T12:19:23.535907+0000","last_undegraded":"2024-02-17T12:19:23.535907+0000","last_fullsized":"2024-02-17T12:19:23.535907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:52:37.591482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707927+0000","last_change":"2024-02-17T12:19:04.720604+0000","last_active":"2024-02-17T12:19:05.707927+0000","last_peered":"2024-02-17T12:19:05.707927+0000","last_clean":"2024-02-17T12:19:05.707927+0000","last_became_active":"2024-02-17T12:19:04.720350+0000","last_became_peered":"2024-02-17T12:19:04.720350+0000","last_unstale":"2024-02-17T12:19:05.707927+0000","last_undegraded":"2024-02-17T12:19:05.707927+0000","last_fullsized":"2024-02-17T12:19:05.707927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:21.365282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537757+0000","last_change":"2024-02-17T12:19:22.380747+0000","last_active":"2024-02-17T12:19:23.537757+0000","last_peered":"2024-02-17T12:19:23.537757+0000","last_clean":"2024-02-17T12:19:23.537757+0000","last_became_active":"2024-02-17T12:19:22.380112+0000","last_became_peered":"2024-02-17T12:19:22.380112+0000","last_unstale":"2024-02-17T12:19:23.537757+0000","last_undegraded":"2024-02-17T12:19:23.537757+0000","last_fullsized":"2024-02-17T12:19:23.537757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:49:12.538531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210224+0000","last_change":"2024-02-17T12:19:04.716818+0000","last_active":"2024-02-17T12:19:06.210224+0000","last_peered":"2024-02-17T12:19:06.210224+0000","last_clean":"2024-02-17T12:19:06.210224+0000","last_became_active":"2024-02-17T12:19:04.716507+0000","last_became_peered":"2024-02-17T12:19:04.716507+0000","last_unstale":"2024-02-17T12:19:06.210224+0000","last_undegraded":"2024-02-17T12:19:06.210224+0000","last_fullsized":"2024-02-17T12:19:06.210224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:56:16.543982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536132+0000","last_change":"2024-02-17T12:19:04.708458+0000","last_active":"2024-02-17T12:19:23.536132+0000","last_peered":"2024-02-17T12:19:23.536132+0000","last_clean":"2024-02-17T12:19:23.536132+0000","last_became_active":"2024-02-17T12:19:04.708170+0000","last_became_peered":"2024-02-17T12:19:04.708170+0000","last_unstale":"2024-02-17T12:19:23.536132+0000","last_undegraded":"2024-02-17T12:19:23.536132+0000","last_fullsized":"2024-02-17T12:19:23.536132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:57.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537653+0000","last_change":"2024-02-17T12:19:22.380274+0000","last_active":"2024-02-17T12:19:23.537653+0000","last_peered":"2024-02-17T12:19:23.537653+0000","last_clean":"2024-02-17T12:19:23.537653+0000","last_became_active":"2024-02-17T12:19:22.379913+0000","last_became_peered":"2024-02-17T12:19:22.379913+0000","last_unstale":"2024-02-17T12:19:23.537653+0000","last_undegraded":"2024-02-17T12:19:23.537653+0000","last_fullsized":"2024-02-17T12:19:23.537653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:33:02.035794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707967+0000","last_change":"2024-02-17T12:19:04.726126+0000","last_active":"2024-02-17T12:19:05.707967+0000","last_peered":"2024-02-17T12:19:05.707967+0000","last_clean":"2024-02-17T12:19:05.707967+0000","last_became_active":"2024-02-17T12:19:04.725344+0000","last_became_peered":"2024-02-17T12:19:04.725344+0000","last_unstale":"2024-02-17T12:19:05.707967+0000","last_undegraded":"2024-02-17T12:19:05.707967+0000","last_fullsized":"2024-02-17T12:19:05.707967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:08:29.699648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537028+0000","last_change":"2024-02-17T12:19:04.725988+0000","last_active":"2024-02-17T12:19:23.537028+0000","last_peered":"2024-02-17T12:19:23.537028+0000","last_clean":"2024-02-17T12:19:23.537028+0000","last_became_active":"2024-02-17T12:19:04.725703+0000","last_became_peered":"2024-02-17T12:19:04.725703+0000","last_unstale":"2024-02-17T12:19:23.537028+0000","last_undegraded":"2024-02-17T12:19:23.537028+0000","last_fullsized":"2024-02-17T12:19:23.537028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:26.113554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380518+0000","last_change":"2024-02-17T12:19:04.718744+0000","last_active":"2024-02-17T12:19:23.380518+0000","last_peered":"2024-02-17T12:19:23.380518+0000","last_clean":"2024-02-17T12:19:23.380518+0000","last_became_active":"2024-02-17T12:19:04.717669+0000","last_became_peered":"2024-02-17T12:19:04.717669+0000","last_unstale":"2024-02-17T12:19:23.380518+0000","last_undegraded":"2024-02-17T12:19:23.380518+0000","last_fullsized":"2024-02-17T12:19:23.380518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:15.849867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210342+0000","last_change":"2024-02-17T12:19:04.713023+0000","last_active":"2024-02-17T12:19:06.210342+0000","last_peered":"2024-02-17T12:19:06.210342+0000","last_clean":"2024-02-17T12:19:06.210342+0000","last_became_active":"2024-02-17T12:19:04.712535+0000","last_became_peered":"2024-02-17T12:19:04.712535+0000","last_unstale":"2024-02-17T12:19:06.210342+0000","last_undegraded":"2024-02-17T12:19:06.210342+0000","last_fullsized":"2024-02-17T12:19:06.210342+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:59.570840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707750+0000","last_change":"2024-02-17T12:19:04.721331+0000","last_active":"2024-02-17T12:19:05.707750+0000","last_peered":"2024-02-17T12:19:05.707750+0000","last_clean":"2024-02-17T12:19:05.707750+0000","last_became_active":"2024-02-17T12:19:04.721066+0000","last_became_peered":"2024-02-17T12:19:04.721066+0000","last_unstale":"2024-02-17T12:19:05.707750+0000","last_undegraded":"2024-02-17T12:19:05.707750+0000","last_fullsized":"2024-02-17T12:19:05.707750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:49:57.305678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708042+0000","last_change":"2024-02-17T12:19:04.726119+0000","last_active":"2024-02-17T12:19:05.708042+0000","last_peered":"2024-02-17T12:19:05.708042+0000","last_clean":"2024-02-17T12:19:05.708042+0000","last_became_active":"2024-02-17T12:19:04.725509+0000","last_became_peered":"2024-02-17T12:19:04.725509+0000","last_unstale":"2024-02-17T12:19:05.708042+0000","last_undegraded":"2024-02-17T12:19:05.708042+0000","last_fullsized":"2024-02-17T12:19:05.708042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:56.501011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380391+0000","last_change":"2024-02-17T12:19:04.706739+0000","last_active":"2024-02-17T12:19:23.380391+0000","last_peered":"2024-02-17T12:19:23.380391+0000","last_clean":"2024-02-17T12:19:23.380391+0000","last_became_active":"2024-02-17T12:19:04.706454+0000","last_became_peered":"2024-02-17T12:19:04.706454+0000","last_unstale":"2024-02-17T12:19:23.380391+0000","last_undegraded":"2024-02-17T12:19:23.380391+0000","last_fullsized":"2024-02-17T12:19:23.380391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:14.863236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538605+0000","last_change":"2024-02-17T12:19:22.382789+0000","last_active":"2024-02-17T12:19:23.538605+0000","last_peered":"2024-02-17T12:19:23.538605+0000","last_clean":"2024-02-17T12:19:23.538605+0000","last_became_active":"2024-02-17T12:19:22.382329+0000","last_became_peered":"2024-02-17T12:19:22.382329+0000","last_unstale":"2024-02-17T12:19:23.538605+0000","last_undegraded":"2024-02-17T12:19:23.538605+0000","last_fullsized":"2024-02-17T12:19:23.538605+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:32.472749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210145+0000","last_change":"2024-02-17T12:19:04.729805+0000","last_active":"2024-02-17T12:19:06.210145+0000","last_peered":"2024-02-17T12:19:06.210145+0000","last_clean":"2024-02-17T12:19:06.210145+0000","last_became_active":"2024-02-17T12:19:04.729388+0000","last_became_peered":"2024-02-17T12:19:04.729388+0000","last_unstale":"2024-02-17T12:19:06.210145+0000","last_undegraded":"2024-02-17T12:19:06.210145+0000","last_fullsized":"2024-02-17T12:19:06.210145+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:09:06.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380519+0000","last_change":"2024-02-17T12:19:04.710643+0000","last_active":"2024-02-17T12:19:23.380519+0000","last_peered":"2024-02-17T12:19:23.380519+0000","last_clean":"2024-02-17T12:19:23.380519+0000","last_became_active":"2024-02-17T12:19:04.709363+0000","last_became_peered":"2024-02-17T12:19:04.709363+0000","last_unstale":"2024-02-17T12:19:23.380519+0000","last_undegraded":"2024-02-17T12:19:23.380519+0000","last_fullsized":"2024-02-17T12:19:23.380519+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:14.810042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210786+0000","last_change":"2024-02-17T12:19:03.709066+0000","last_active":"2024-02-17T12:19:06.210786+0000","last_peered":"2024-02-17T12:19:06.210786+0000","last_clean":"2024-02-17T12:19:06.210786+0000","last_became_active":"2024-02-17T12:19:03.708888+0000","last_became_peered":"2024-02-17T12:19:03.708888+0000","last_unstale":"2024-02-17T12:19:06.210786+0000","last_undegraded":"2024-02-17T12:19:06.210786+0000","last_fullsized":"2024-02-17T12:19:06.210786+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380917+0000","last_change":"2024-02-17T12:19:22.369924+0000","last_active":"2024-02-17T12:19:23.380917+0000","last_peered":"2024-02-17T12:19:23.380917+0000","last_clean":"2024-02-17T12:19:23.380917+0000","last_became_active":"2024-02-17T12:19:22.369681+0000","last_became_peered":"2024-02-17T12:19:22.369681+0000","last_unstale":"2024-02-17T12:19:23.380917+0000","last_undegraded":"2024-02-17T12:19:23.380917+0000","last_fullsized":"2024-02-17T12:19:23.380917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:28.541757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210661+0000","last_change":"2024-02-17T12:19:04.718756+0000","last_active":"2024-02-17T12:19:06.210661+0000","last_peered":"2024-02-17T12:19:06.210661+0000","last_clean":"2024-02-17T12:19:06.210661+0000","last_became_active":"2024-02-17T12:19:04.716924+0000","last_became_peered":"2024-02-17T12:19:04.716924+0000","last_unstale":"2024-02-17T12:19:06.210661+0000","last_undegraded":"2024-02-17T12:19:06.210661+0000","last_fullsized":"2024-02-17T12:19:06.210661+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:11.015091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380711+0000","last_change":"2024-02-17T12:19:03.703800+0000","last_active":"2024-02-17T12:19:23.380711+0000","last_peered":"2024-02-17T12:19:23.380711+0000","last_clean":"2024-02-17T12:19:23.380711+0000","last_became_active":"2024-02-17T12:19:03.703402+0000","last_became_peered":"2024-02-17T12:19:03.703402+0000","last_unstale":"2024-02-17T12:19:23.380711+0000","last_undegraded":"2024-02-17T12:19:23.380711+0000","last_fullsized":"2024-02-17T12:19:23.380711+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:37:23.098316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537751+0000","last_change":"2024-02-17T12:19:22.373889+0000","last_active":"2024-02-17T12:19:23.537751+0000","last_peered":"2024-02-17T12:19:23.537751+0000","last_clean":"2024-02-17T12:19:23.537751+0000","last_became_active":"2024-02-17T12:19:22.372667+0000","last_became_peered":"2024-02-17T12:19:22.372667+0000","last_unstale":"2024-02-17T12:19:23.537751+0000","last_undegraded":"2024-02-17T12:19:23.537751+0000","last_fullsized":"2024-02-17T12:19:23.537751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:33.512575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210719+0000","last_change":"2024-02-17T12:19:04.730207+0000","last_active":"2024-02-17T12:19:06.210719+0000","last_peered":"2024-02-17T12:19:06.210719+0000","last_clean":"2024-02-17T12:19:06.210719+0000","last_became_active":"2024-02-17T12:19:04.729363+0000","last_became_peered":"2024-02-17T12:19:04.729363+0000","last_unstale":"2024-02-17T12:19:06.210719+0000","last_undegraded":"2024-02-17T12:19:06.210719+0000","last_fullsized":"2024-02-17T12:19:06.210719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:32:13.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521058+0000","last_change":"2024-02-17T12:19:03.704331+0000","last_active":"2024-02-17T12:19:06.521058+0000","last_peered":"2024-02-17T12:19:06.521058+0000","last_clean":"2024-02-17T12:19:06.521058+0000","last_became_active":"2024-02-17T12:19:03.704078+0000","last_became_peered":"2024-02-17T12:19:03.704078+0000","last_unstale":"2024-02-17T12:19:06.521058+0000","last_undegraded":"2024-02-17T12:19:06.521058+0000","last_fullsized":"2024-02-17T12:19:06.521058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537210+0000","last_change":"2024-02-17T12:19:21.377375+0000","last_active":"2024-02-17T12:19:23.537210+0000","last_peered":"2024-02-17T12:19:23.537210+0000","last_clean":"2024-02-17T12:19:23.537210+0000","last_became_active":"2024-02-17T12:19:21.377083+0000","last_became_peered":"2024-02-17T12:19:21.377083+0000","last_unstale":"2024-02-17T12:19:23.537210+0000","last_undegraded":"2024-02-17T12:19:23.537210+0000","last_fullsized":"2024-02-17T12:19:23.537210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:53.185121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537641+0000","last_change":"2024-02-17T12:19:04.710438+0000","last_active":"2024-02-17T12:19:23.537641+0000","last_peered":"2024-02-17T12:19:23.537641+0000","last_clean":"2024-02-17T12:19:23.537641+0000","last_became_active":"2024-02-17T12:19:04.709894+0000","last_became_peered":"2024-02-17T12:19:04.709894+0000","last_unstale":"2024-02-17T12:19:23.537641+0000","last_undegraded":"2024-02-17T12:19:23.537641+0000","last_fullsized":"2024-02-17T12:19:23.537641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:44.905808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521160+0000","last_change":"2024-02-17T12:19:03.702411+0000","last_active":"2024-02-17T12:19:06.521160+0000","last_peered":"2024-02-17T12:19:06.521160+0000","last_clean":"2024-02-17T12:19:06.521160+0000","last_became_active":"2024-02-17T12:19:03.702166+0000","last_became_peered":"2024-02-17T12:19:03.702166+0000","last_unstale":"2024-02-17T12:19:06.521160+0000","last_undegraded":"2024-02-17T12:19:06.521160+0000","last_fullsized":"2024-02-17T12:19:06.521160+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708166+0000","last_change":"2024-02-17T12:19:04.726343+0000","last_active":"2024-02-17T12:19:05.708166+0000","last_peered":"2024-02-17T12:19:05.708166+0000","last_clean":"2024-02-17T12:19:05.708166+0000","last_became_active":"2024-02-17T12:19:04.725870+0000","last_became_peered":"2024-02-17T12:19:04.725870+0000","last_unstale":"2024-02-17T12:19:05.708166+0000","last_undegraded":"2024-02-17T12:19:05.708166+0000","last_fullsized":"2024-02-17T12:19:05.708166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:27:42.531689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380548+0000","last_change":"2024-02-17T12:19:03.703159+0000","last_active":"2024-02-17T12:19:23.380548+0000","last_peered":"2024-02-17T12:19:23.380548+0000","last_clean":"2024-02-17T12:19:23.380548+0000","last_became_active":"2024-02-17T12:19:03.702811+0000","last_became_peered":"2024-02-17T12:19:03.702811+0000","last_unstale":"2024-02-17T12:19:23.380548+0000","last_undegraded":"2024-02-17T12:19:23.380548+0000","last_fullsized":"2024-02-17T12:19:23.380548+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:16.831548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379607+0000","last_change":"2024-02-17T12:19:22.368488+0000","last_active":"2024-02-17T12:19:23.379607+0000","last_peered":"2024-02-17T12:19:23.379607+0000","last_clean":"2024-02-17T12:19:23.379607+0000","last_became_active":"2024-02-17T12:19:22.368213+0000","last_became_peered":"2024-02-17T12:19:22.368213+0000","last_unstale":"2024-02-17T12:19:23.379607+0000","last_undegraded":"2024-02-17T12:19:23.379607+0000","last_fullsized":"2024-02-17T12:19:23.379607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:09:41.215827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380350+0000","last_change":"2024-02-17T12:19:04.708618+0000","last_active":"2024-02-17T12:19:23.380350+0000","last_peered":"2024-02-17T12:19:23.380350+0000","last_clean":"2024-02-17T12:19:23.380350+0000","last_became_active":"2024-02-17T12:19:04.708351+0000","last_became_peered":"2024-02-17T12:19:04.708351+0000","last_unstale":"2024-02-17T12:19:23.380350+0000","last_undegraded":"2024-02-17T12:19:23.380350+0000","last_fullsized":"2024-02-17T12:19:23.380350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:09.330073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380335+0000","last_change":"2024-02-17T12:19:03.706093+0000","last_active":"2024-02-17T12:19:23.380335+0000","last_peered":"2024-02-17T12:19:23.380335+0000","last_clean":"2024-02-17T12:19:23.380335+0000","last_became_active":"2024-02-17T12:19:03.705445+0000","last_became_peered":"2024-02-17T12:19:03.705445+0000","last_unstale":"2024-02-17T12:19:23.380335+0000","last_undegraded":"2024-02-17T12:19:23.380335+0000","last_fullsized":"2024-02-17T12:19:23.380335+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:29.842261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535697+0000","last_change":"2024-02-17T12:19:04.714305+0000","last_active":"2024-02-17T12:19:23.535697+0000","last_peered":"2024-02-17T12:19:23.535697+0000","last_clean":"2024-02-17T12:19:23.535697+0000","last_became_active":"2024-02-17T12:19:04.714041+0000","last_became_peered":"2024-02-17T12:19:04.714041+0000","last_unstale":"2024-02-17T12:19:23.535697+0000","last_undegraded":"2024-02-17T12:19:23.535697+0000","last_fullsized":"2024-02-17T12:19:23.535697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:12.864476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520892+0000","last_change":"2024-02-17T12:19:03.701055+0000","last_active":"2024-02-17T12:19:06.520892+0000","last_peered":"2024-02-17T12:19:06.520892+0000","last_clean":"2024-02-17T12:19:06.520892+0000","last_became_active":"2024-02-17T12:19:03.695988+0000","last_became_peered":"2024-02-17T12:19:03.695988+0000","last_unstale":"2024-02-17T12:19:06.520892+0000","last_undegraded":"2024-02-17T12:19:06.520892+0000","last_fullsized":"2024-02-17T12:19:06.520892+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536792+0000","last_change":"2024-02-17T12:19:22.379284+0000","last_active":"2024-02-17T12:19:23.536792+0000","last_peered":"2024-02-17T12:19:23.536792+0000","last_clean":"2024-02-17T12:19:23.536792+0000","last_became_active":"2024-02-17T12:19:22.378837+0000","last_became_peered":"2024-02-17T12:19:22.378837+0000","last_unstale":"2024-02-17T12:19:23.536792+0000","last_undegraded":"2024-02-17T12:19:23.536792+0000","last_fullsized":"2024-02-17T12:19:23.536792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519713+0000","last_change":"2024-02-17T12:19:04.710559+0000","last_active":"2024-02-17T12:19:06.519713+0000","last_peered":"2024-02-17T12:19:06.519713+0000","last_clean":"2024-02-17T12:19:06.519713+0000","last_became_active":"2024-02-17T12:19:04.709979+0000","last_became_peered":"2024-02-17T12:19:04.709979+0000","last_unstale":"2024-02-17T12:19:06.519713+0000","last_undegraded":"2024-02-17T12:19:06.519713+0000","last_fullsized":"2024-02-17T12:19:06.519713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:33:12.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707814+0000","last_change":"2024-02-17T12:19:03.702309+0000","last_active":"2024-02-17T12:19:05.707814+0000","last_peered":"2024-02-17T12:19:05.707814+0000","last_clean":"2024-02-17T12:19:05.707814+0000","last_became_active":"2024-02-17T12:19:03.702051+0000","last_became_peered":"2024-02-17T12:19:03.702051+0000","last_unstale":"2024-02-17T12:19:05.707814+0000","last_undegraded":"2024-02-17T12:19:05.707814+0000","last_fullsized":"2024-02-17T12:19:05.707814+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:58.978525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"71'3","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537726+0000","last_change":"2024-02-17T12:19:21.375965+0000","last_active":"2024-02-17T12:19:23.537726+0000","last_peered":"2024-02-17T12:19:23.537726+0000","last_clean":"2024-02-17T12:19:23.537726+0000","last_became_active":"2024-02-17T12:19:21.375551+0000","last_became_peered":"2024-02-17T12:19:21.375551+0000","last_unstale":"2024-02-17T12:19:23.537726+0000","last_undegraded":"2024-02-17T12:19:23.537726+0000","last_fullsized":"2024-02-17T12:19:23.537726+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:25.240966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520096+0000","last_change":"2024-02-17T12:19:04.726001+0000","last_active":"2024-02-17T12:19:06.520096+0000","last_peered":"2024-02-17T12:19:06.520096+0000","last_clean":"2024-02-17T12:19:06.520096+0000","last_became_active":"2024-02-17T12:19:04.725747+0000","last_became_peered":"2024-02-17T12:19:04.725747+0000","last_unstale":"2024-02-17T12:19:06.520096+0000","last_undegraded":"2024-02-17T12:19:06.520096+0000","last_fullsized":"2024-02-17T12:19:06.520096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:18:38.213214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210926+0000","last_change":"2024-02-17T12:19:03.712851+0000","last_active":"2024-02-17T12:19:06.210926+0000","last_peered":"2024-02-17T12:19:06.210926+0000","last_clean":"2024-02-17T12:19:06.210926+0000","last_became_active":"2024-02-17T12:19:03.712584+0000","last_became_peered":"2024-02-17T12:19:03.712584+0000","last_unstale":"2024-02-17T12:19:06.210926+0000","last_undegraded":"2024-02-17T12:19:06.210926+0000","last_fullsized":"2024-02-17T12:19:06.210926+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537449+0000","last_change":"2024-02-17T12:19:22.379237+0000","last_active":"2024-02-17T12:19:23.537449+0000","last_peered":"2024-02-17T12:19:23.537449+0000","last_clean":"2024-02-17T12:19:23.537449+0000","last_became_active":"2024-02-17T12:19:22.377019+0000","last_became_peered":"2024-02-17T12:19:22.377019+0000","last_unstale":"2024-02-17T12:19:23.537449+0000","last_undegraded":"2024-02-17T12:19:23.537449+0000","last_fullsized":"2024-02-17T12:19:23.537449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:53.311764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"71'6","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380677+0000","last_change":"2024-02-17T12:19:21.372337+0000","last_active":"2024-02-17T12:19:23.380677+0000","last_peered":"2024-02-17T12:19:23.380677+0000","last_clean":"2024-02-17T12:19:23.380677+0000","last_became_active":"2024-02-17T12:19:21.371919+0000","last_became_peered":"2024-02-17T12:19:21.371919+0000","last_unstale":"2024-02-17T12:19:23.380677+0000","last_undegraded":"2024-02-17T12:19:23.380677+0000","last_fullsized":"2024-02-17T12:19:23.380677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:11:12.798689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.712467+0000","last_change":"2024-02-17T12:19:04.709578+0000","last_active":"2024-02-17T12:19:05.712467+0000","last_peered":"2024-02-17T12:19:05.712467+0000","last_clean":"2024-02-17T12:19:05.712467+0000","last_became_active":"2024-02-17T12:19:04.709173+0000","last_became_peered":"2024-02-17T12:19:04.709173+0000","last_unstale":"2024-02-17T12:19:05.712467+0000","last_undegraded":"2024-02-17T12:19:05.712467+0000","last_fullsized":"2024-02-17T12:19:05.712467+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210669+0000","last_change":"2024-02-17T12:19:03.707721+0000","last_active":"2024-02-17T12:19:06.210669+0000","last_peered":"2024-02-17T12:19:06.210669+0000","last_clean":"2024-02-17T12:19:06.210669+0000","last_became_active":"2024-02-17T12:19:03.707435+0000","last_became_peered":"2024-02-17T12:19:03.707435+0000","last_unstale":"2024-02-17T12:19:06.210669+0000","last_undegraded":"2024-02-17T12:19:06.210669+0000","last_fullsized":"2024-02-17T12:19:06.210669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521092+0000","last_change":"2024-02-17T12:19:04.716812+0000","last_active":"2024-02-17T12:19:06.521092+0000","last_peered":"2024-02-17T12:19:06.521092+0000","last_clean":"2024-02-17T12:19:06.521092+0000","last_became_active":"2024-02-17T12:19:04.716307+0000","last_became_peered":"2024-02-17T12:19:04.716307+0000","last_unstale":"2024-02-17T12:19:06.521092+0000","last_undegraded":"2024-02-17T12:19:06.521092+0000","last_fullsized":"2024-02-17T12:19:06.521092+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:30.970580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210404+0000","last_change":"2024-02-17T12:19:03.710532+0000","last_active":"2024-02-17T12:19:06.210404+0000","last_peered":"2024-02-17T12:19:06.210404+0000","last_clean":"2024-02-17T12:19:06.210404+0000","last_became_active":"2024-02-17T12:19:03.710333+0000","last_became_peered":"2024-02-17T12:19:03.710333+0000","last_unstale":"2024-02-17T12:19:06.210404+0000","last_undegraded":"2024-02-17T12:19:06.210404+0000","last_fullsized":"2024-02-17T12:19:06.210404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381122+0000","last_change":"2024-02-17T12:19:22.367647+0000","last_active":"2024-02-17T12:19:23.381122+0000","last_peered":"2024-02-17T12:19:23.381122+0000","last_clean":"2024-02-17T12:19:23.381122+0000","last_became_active":"2024-02-17T12:19:22.366850+0000","last_became_peered":"2024-02-17T12:19:22.366850+0000","last_unstale":"2024-02-17T12:19:23.381122+0000","last_undegraded":"2024-02-17T12:19:23.381122+0000","last_fullsized":"2024-02-17T12:19:23.381122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:21:05.316175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380757+0000","last_change":"2024-02-17T12:19:04.719297+0000","last_active":"2024-02-17T12:19:23.380757+0000","last_peered":"2024-02-17T12:19:23.380757+0000","last_clean":"2024-02-17T12:19:23.380757+0000","last_became_active":"2024-02-17T12:19:04.718586+0000","last_became_peered":"2024-02-17T12:19:04.718586+0000","last_unstale":"2024-02-17T12:19:23.380757+0000","last_undegraded":"2024-02-17T12:19:23.380757+0000","last_fullsized":"2024-02-17T12:19:23.380757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:05.970868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:15.947048+0000","last_change":"2024-02-17T12:19:03.704237+0000","last_active":"2024-02-17T12:19:15.947048+0000","last_peered":"2024-02-17T12:19:15.947048+0000","last_clean":"2024-02-17T12:19:15.947048+0000","last_became_active":"2024-02-17T12:19:03.703964+0000","last_became_peered":"2024-02-17T12:19:03.703964+0000","last_unstale":"2024-02-17T12:19:15.947048+0000","last_undegraded":"2024-02-17T12:19:15.947048+0000","last_fullsized":"2024-02-17T12:19:15.947048+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:45.097730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379221+0000","last_change":"2024-02-17T12:19:22.366381+0000","last_active":"2024-02-17T12:19:23.379221+0000","last_peered":"2024-02-17T12:19:23.379221+0000","last_clean":"2024-02-17T12:19:23.379221+0000","last_became_active":"2024-02-17T12:19:22.366074+0000","last_became_peered":"2024-02-17T12:19:22.366074+0000","last_unstale":"2024-02-17T12:19:23.379221+0000","last_undegraded":"2024-02-17T12:19:23.379221+0000","last_fullsized":"2024-02-17T12:19:23.379221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:54.192462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380317+0000","last_change":"2024-02-17T12:19:21.358035+0000","last_active":"2024-02-17T12:19:23.380317+0000","last_peered":"2024-02-17T12:19:23.380317+0000","last_clean":"2024-02-17T12:19:23.380317+0000","last_became_active":"2024-02-17T12:19:21.357766+0000","last_became_peered":"2024-02-17T12:19:21.357766+0000","last_unstale":"2024-02-17T12:19:23.380317+0000","last_undegraded":"2024-02-17T12:19:23.380317+0000","last_fullsized":"2024-02-17T12:19:23.380317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:42.768921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520875+0000","last_change":"2024-02-17T12:19:04.702494+0000","last_active":"2024-02-17T12:19:06.520875+0000","last_peered":"2024-02-17T12:19:06.520875+0000","last_clean":"2024-02-17T12:19:06.520875+0000","last_became_active":"2024-02-17T12:19:04.702168+0000","last_became_peered":"2024-02-17T12:19:04.702168+0000","last_unstale":"2024-02-17T12:19:06.520875+0000","last_undegraded":"2024-02-17T12:19:06.520875+0000","last_fullsized":"2024-02-17T12:19:06.520875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:53.989897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707872+0000","last_change":"2024-02-17T12:19:03.710630+0000","last_active":"2024-02-17T12:19:05.707872+0000","last_peered":"2024-02-17T12:19:05.707872+0000","last_clean":"2024-02-17T12:19:05.707872+0000","last_became_active":"2024-02-17T12:19:03.710185+0000","last_became_peered":"2024-02-17T12:19:03.710185+0000","last_unstale":"2024-02-17T12:19:05.707872+0000","last_undegraded":"2024-02-17T12:19:05.707872+0000","last_fullsized":"2024-02-17T12:19:05.707872+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:07:16.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536196+0000","last_change":"2024-02-17T12:19:22.379291+0000","last_active":"2024-02-17T12:19:23.536196+0000","last_peered":"2024-02-17T12:19:23.536196+0000","last_clean":"2024-02-17T12:19:23.536196+0000","last_became_active":"2024-02-17T12:19:22.379052+0000","last_became_peered":"2024-02-17T12:19:22.379052+0000","last_unstale":"2024-02-17T12:19:23.536196+0000","last_undegraded":"2024-02-17T12:19:23.536196+0000","last_fullsized":"2024-02-17T12:19:23.536196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:30.791284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536979+0000","last_change":"2024-02-17T12:19:04.716555+0000","last_active":"2024-02-17T12:19:23.536979+0000","last_peered":"2024-02-17T12:19:23.536979+0000","last_clean":"2024-02-17T12:19:23.536979+0000","last_became_active":"2024-02-17T12:19:04.715235+0000","last_became_peered":"2024-02-17T12:19:04.715235+0000","last_unstale":"2024-02-17T12:19:23.536979+0000","last_undegraded":"2024-02-17T12:19:23.536979+0000","last_fullsized":"2024-02-17T12:19:23.536979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:05.685656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519744+0000","last_change":"2024-02-17T12:19:03.712475+0000","last_active":"2024-02-17T12:19:06.519744+0000","last_peered":"2024-02-17T12:19:06.519744+0000","last_clean":"2024-02-17T12:19:06.519744+0000","last_became_active":"2024-02-17T12:19:03.712117+0000","last_became_peered":"2024-02-17T12:19:03.712117+0000","last_unstale":"2024-02-17T12:19:06.519744+0000","last_undegraded":"2024-02-17T12:19:06.519744+0000","last_fullsized":"2024-02-17T12:19:06.519744+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:10.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538079+0000","last_change":"2024-02-17T12:19:21.362585+0000","last_active":"2024-02-17T12:19:23.538079+0000","last_peered":"2024-02-17T12:19:23.538079+0000","last_clean":"2024-02-17T12:19:23.538079+0000","last_became_active":"2024-02-17T12:19:21.361851+0000","last_became_peered":"2024-02-17T12:19:21.361851+0000","last_unstale":"2024-02-17T12:19:23.538079+0000","last_undegraded":"2024-02-17T12:19:23.538079+0000","last_fullsized":"2024-02-17T12:19:23.538079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:31.111070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707802+0000","last_change":"2024-02-17T12:19:04.727289+0000","last_active":"2024-02-17T12:19:05.707802+0000","last_peered":"2024-02-17T12:19:05.707802+0000","last_clean":"2024-02-17T12:19:05.707802+0000","last_became_active":"2024-02-17T12:19:04.727041+0000","last_became_peered":"2024-02-17T12:19:04.727041+0000","last_unstale":"2024-02-17T12:19:05.707802+0000","last_undegraded":"2024-02-17T12:19:05.707802+0000","last_fullsized":"2024-02-17T12:19:05.707802+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:39:43.401328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711022+0000","last_change":"2024-02-17T12:19:03.699211+0000","last_active":"2024-02-17T12:19:05.711022+0000","last_peered":"2024-02-17T12:19:05.711022+0000","last_clean":"2024-02-17T12:19:05.711022+0000","last_became_active":"2024-02-17T12:19:03.698244+0000","last_became_peered":"2024-02-17T12:19:03.698244+0000","last_unstale":"2024-02-17T12:19:05.711022+0000","last_undegraded":"2024-02-17T12:19:05.711022+0000","last_fullsized":"2024-02-17T12:19:05.711022+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:42.702805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538270+0000","last_change":"2024-02-17T12:19:21.368493+0000","last_active":"2024-02-17T12:19:23.538270+0000","last_peered":"2024-02-17T12:19:23.538270+0000","last_clean":"2024-02-17T12:19:23.538270+0000","last_became_active":"2024-02-17T12:19:21.368162+0000","last_became_peered":"2024-02-17T12:19:21.368162+0000","last_unstale":"2024-02-17T12:19:23.538270+0000","last_undegraded":"2024-02-17T12:19:23.538270+0000","last_fullsized":"2024-02-17T12:19:23.538270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:38.213027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707696+0000","last_change":"2024-02-17T12:19:04.718529+0000","last_active":"2024-02-17T12:19:05.707696+0000","last_peered":"2024-02-17T12:19:05.707696+0000","last_clean":"2024-02-17T12:19:05.707696+0000","last_became_active":"2024-02-17T12:19:04.718251+0000","last_became_peered":"2024-02-17T12:19:04.718251+0000","last_unstale":"2024-02-17T12:19:05.707696+0000","last_undegraded":"2024-02-17T12:19:05.707696+0000","last_fullsized":"2024-02-17T12:19:05.707696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:28.280713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520686+0000","last_change":"2024-02-17T12:19:03.706554+0000","last_active":"2024-02-17T12:19:06.520686+0000","last_peered":"2024-02-17T12:19:06.520686+0000","last_clean":"2024-02-17T12:19:06.520686+0000","last_became_active":"2024-02-17T12:19:03.706236+0000","last_became_peered":"2024-02-17T12:19:03.706236+0000","last_unstale":"2024-02-17T12:19:06.520686+0000","last_undegraded":"2024-02-17T12:19:06.520686+0000","last_fullsized":"2024-02-17T12:19:06.520686+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537259+0000","last_change":"2024-02-17T12:19:04.715036+0000","last_active":"2024-02-17T12:19:23.537259+0000","last_peered":"2024-02-17T12:19:23.537259+0000","last_clean":"2024-02-17T12:19:23.537259+0000","last_became_active":"2024-02-17T12:19:04.714713+0000","last_became_peered":"2024-02-17T12:19:04.714713+0000","last_unstale":"2024-02-17T12:19:23.537259+0000","last_undegraded":"2024-02-17T12:19:23.537259+0000","last_fullsized":"2024-02-17T12:19:23.537259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:28:30.744698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210994+0000","last_change":"2024-02-17T12:19:03.705648+0000","last_active":"2024-02-17T12:19:06.210994+0000","last_peered":"2024-02-17T12:19:06.210994+0000","last_clean":"2024-02-17T12:19:06.210994+0000","last_became_active":"2024-02-17T12:19:03.705325+0000","last_became_peered":"2024-02-17T12:19:03.705325+0000","last_unstale":"2024-02-17T12:19:06.210994+0000","last_undegraded":"2024-02-17T12:19:06.210994+0000","last_fullsized":"2024-02-17T12:19:06.210994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537452+0000","last_change":"2024-02-17T12:19:22.380167+0000","last_active":"2024-02-17T12:19:23.537452+0000","last_peered":"2024-02-17T12:19:23.537452+0000","last_clean":"2024-02-17T12:19:23.537452+0000","last_became_active":"2024-02-17T12:19:22.379704+0000","last_became_peered":"2024-02-17T12:19:22.379704+0000","last_unstale":"2024-02-17T12:19:23.537452+0000","last_undegraded":"2024-02-17T12:19:23.537452+0000","last_fullsized":"2024-02-17T12:19:23.537452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:28:11.111883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210807+0000","last_change":"2024-02-17T12:19:04.719005+0000","last_active":"2024-02-17T12:19:06.210807+0000","last_peered":"2024-02-17T12:19:06.210807+0000","last_clean":"2024-02-17T12:19:06.210807+0000","last_became_active":"2024-02-17T12:19:04.717221+0000","last_became_peered":"2024-02-17T12:19:04.717221+0000","last_unstale":"2024-02-17T12:19:06.210807+0000","last_undegraded":"2024-02-17T12:19:06.210807+0000","last_fullsized":"2024-02-17T12:19:06.210807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:50.535947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520940+0000","last_change":"2024-02-17T12:19:03.708463+0000","last_active":"2024-02-17T12:19:06.520940+0000","last_peered":"2024-02-17T12:19:06.520940+0000","last_clean":"2024-02-17T12:19:06.520940+0000","last_became_active":"2024-02-17T12:19:03.707739+0000","last_became_peered":"2024-02-17T12:19:03.707739+0000","last_unstale":"2024-02-17T12:19:06.520940+0000","last_undegraded":"2024-02-17T12:19:06.520940+0000","last_fullsized":"2024-02-17T12:19:06.520940+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380282+0000","last_change":"2024-02-17T12:19:21.361415+0000","last_active":"2024-02-17T12:19:23.380282+0000","last_peered":"2024-02-17T12:19:23.380282+0000","last_clean":"2024-02-17T12:19:23.380282+0000","last_became_active":"2024-02-17T12:19:21.360522+0000","last_became_peered":"2024-02-17T12:19:21.360522+0000","last_unstale":"2024-02-17T12:19:23.380282+0000","last_undegraded":"2024-02-17T12:19:23.380282+0000","last_fullsized":"2024-02-17T12:19:23.380282+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:19:01.561174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380889+0000","last_change":"2024-02-17T12:19:04.727161+0000","last_active":"2024-02-17T12:19:23.380889+0000","last_peered":"2024-02-17T12:19:23.380889+0000","last_clean":"2024-02-17T12:19:23.380889+0000","last_became_active":"2024-02-17T12:19:04.726871+0000","last_became_peered":"2024-02-17T12:19:04.726871+0000","last_unstale":"2024-02-17T12:19:23.380889+0000","last_undegraded":"2024-02-17T12:19:23.380889+0000","last_fullsized":"2024-02-17T12:19:23.380889+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:50.453267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521222+0000","last_change":"2024-02-17T12:19:03.700286+0000","last_active":"2024-02-17T12:19:06.521222+0000","last_peered":"2024-02-17T12:19:06.521222+0000","last_clean":"2024-02-17T12:19:06.521222+0000","last_became_active":"2024-02-17T12:19:03.700021+0000","last_became_peered":"2024-02-17T12:19:03.700021+0000","last_unstale":"2024-02-17T12:19:06.521222+0000","last_undegraded":"2024-02-17T12:19:06.521222+0000","last_fullsized":"2024-02-17T12:19:06.521222+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535774+0000","last_change":"2024-02-17T12:19:22.370952+0000","last_active":"2024-02-17T12:19:23.535774+0000","last_peered":"2024-02-17T12:19:23.535774+0000","last_clean":"2024-02-17T12:19:23.535774+0000","last_became_active":"2024-02-17T12:19:22.370205+0000","last_became_peered":"2024-02-17T12:19:22.370205+0000","last_unstale":"2024-02-17T12:19:23.535774+0000","last_undegraded":"2024-02-17T12:19:23.535774+0000","last_fullsized":"2024-02-17T12:19:23.535774+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:42:14.086969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538438+0000","last_change":"2024-02-17T12:19:04.727215+0000","last_active":"2024-02-17T12:19:23.538438+0000","last_peered":"2024-02-17T12:19:23.538438+0000","last_clean":"2024-02-17T12:19:23.538438+0000","last_became_active":"2024-02-17T12:19:04.726960+0000","last_became_peered":"2024-02-17T12:19:04.726960+0000","last_unstale":"2024-02-17T12:19:23.538438+0000","last_undegraded":"2024-02-17T12:19:23.538438+0000","last_fullsized":"2024-02-17T12:19:23.538438+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:45.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520015+0000","last_change":"2024-02-17T12:19:03.709412+0000","last_active":"2024-02-17T12:19:06.520015+0000","last_peered":"2024-02-17T12:19:06.520015+0000","last_clean":"2024-02-17T12:19:06.520015+0000","last_became_active":"2024-02-17T12:19:03.709021+0000","last_became_peered":"2024-02-17T12:19:03.709021+0000","last_unstale":"2024-02-17T12:19:06.520015+0000","last_undegraded":"2024-02-17T12:19:06.520015+0000","last_fullsized":"2024-02-17T12:19:06.520015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:44.049163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711179+0000","last_change":"2024-02-17T12:19:04.712404+0000","last_active":"2024-02-17T12:19:05.711179+0000","last_peered":"2024-02-17T12:19:05.711179+0000","last_clean":"2024-02-17T12:19:05.711179+0000","last_became_active":"2024-02-17T12:19:04.711344+0000","last_became_peered":"2024-02-17T12:19:04.711344+0000","last_unstale":"2024-02-17T12:19:05.711179+0000","last_undegraded":"2024-02-17T12:19:05.711179+0000","last_fullsized":"2024-02-17T12:19:05.711179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:24.593812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538531+0000","last_change":"2024-02-17T12:19:03.706405+0000","last_active":"2024-02-17T12:19:23.538531+0000","last_peered":"2024-02-17T12:19:23.538531+0000","last_clean":"2024-02-17T12:19:23.538531+0000","last_became_active":"2024-02-17T12:19:03.706108+0000","last_became_peered":"2024-02-17T12:19:03.706108+0000","last_unstale":"2024-02-17T12:19:23.538531+0000","last_undegraded":"2024-02-17T12:19:23.538531+0000","last_fullsized":"2024-02-17T12:19:23.538531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.926513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538039+0000","last_change":"2024-02-17T12:19:22.389822+0000","last_active":"2024-02-17T12:19:23.538039+0000","last_peered":"2024-02-17T12:19:23.538039+0000","last_clean":"2024-02-17T12:19:23.538039+0000","last_became_active":"2024-02-17T12:19:22.389495+0000","last_became_peered":"2024-02-17T12:19:22.389495+0000","last_unstale":"2024-02-17T12:19:23.538039+0000","last_undegraded":"2024-02-17T12:19:23.538039+0000","last_fullsized":"2024-02-17T12:19:23.538039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:02:08.115974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536274+0000","last_change":"2024-02-17T12:19:04.712081+0000","last_active":"2024-02-17T12:19:23.536274+0000","last_peered":"2024-02-17T12:19:23.536274+0000","last_clean":"2024-02-17T12:19:23.536274+0000","last_became_active":"2024-02-17T12:19:04.711784+0000","last_became_peered":"2024-02-17T12:19:04.711784+0000","last_unstale":"2024-02-17T12:19:23.536274+0000","last_undegraded":"2024-02-17T12:19:23.536274+0000","last_fullsized":"2024-02-17T12:19:23.536274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:47:13.952609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536391+0000","last_change":"2024-02-17T12:19:03.701598+0000","last_active":"2024-02-17T12:19:23.536391+0000","last_peered":"2024-02-17T12:19:23.536391+0000","last_clean":"2024-02-17T12:19:23.536391+0000","last_became_active":"2024-02-17T12:19:03.701326+0000","last_became_peered":"2024-02-17T12:19:03.701326+0000","last_unstale":"2024-02-17T12:19:23.536391+0000","last_undegraded":"2024-02-17T12:19:23.536391+0000","last_fullsized":"2024-02-17T12:19:23.536391+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:47:22.021385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537974+0000","last_change":"2024-02-17T12:19:22.380952+0000","last_active":"2024-02-17T12:19:23.537974+0000","last_peered":"2024-02-17T12:19:23.537974+0000","last_clean":"2024-02-17T12:19:23.537974+0000","last_became_active":"2024-02-17T12:19:22.380493+0000","last_became_peered":"2024-02-17T12:19:22.380493+0000","last_unstale":"2024-02-17T12:19:23.537974+0000","last_undegraded":"2024-02-17T12:19:23.537974+0000","last_fullsized":"2024-02-17T12:19:23.537974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:54.242151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711041+0000","last_change":"2024-02-17T12:19:04.702184+0000","last_active":"2024-02-17T12:19:05.711041+0000","last_peered":"2024-02-17T12:19:05.711041+0000","last_clean":"2024-02-17T12:19:05.711041+0000","last_became_active":"2024-02-17T12:19:04.701908+0000","last_became_peered":"2024-02-17T12:19:04.701908+0000","last_unstale":"2024-02-17T12:19:05.711041+0000","last_undegraded":"2024-02-17T12:19:05.711041+0000","last_fullsized":"2024-02-17T12:19:05.711041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:30.749868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519477+0000","last_change":"2024-02-17T12:19:03.702614+0000","last_active":"2024-02-17T12:19:06.519477+0000","last_peered":"2024-02-17T12:19:06.519477+0000","last_clean":"2024-02-17T12:19:06.519477+0000","last_became_active":"2024-02-17T12:19:03.702360+0000","last_became_peered":"2024-02-17T12:19:03.702360+0000","last_unstale":"2024-02-17T12:19:06.519477+0000","last_undegraded":"2024-02-17T12:19:06.519477+0000","last_fullsized":"2024-02-17T12:19:06.519477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:37.418089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380585+0000","last_change":"2024-02-17T12:19:04.697171+0000","last_active":"2024-02-17T12:19:23.380585+0000","last_peered":"2024-02-17T12:19:23.380585+0000","last_clean":"2024-02-17T12:19:23.380585+0000","last_became_active":"2024-02-17T12:19:04.696841+0000","last_became_peered":"2024-02-17T12:19:04.696841+0000","last_unstale":"2024-02-17T12:19:23.380585+0000","last_undegraded":"2024-02-17T12:19:23.380585+0000","last_fullsized":"2024-02-17T12:19:23.380585+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:04:51.114922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708024+0000","last_change":"2024-02-17T12:19:03.706098+0000","last_active":"2024-02-17T12:19:05.708024+0000","last_peered":"2024-02-17T12:19:05.708024+0000","last_clean":"2024-02-17T12:19:05.708024+0000","last_became_active":"2024-02-17T12:19:03.705787+0000","last_became_peered":"2024-02-17T12:19:03.705787+0000","last_unstale":"2024-02-17T12:19:05.708024+0000","last_undegraded":"2024-02-17T12:19:05.708024+0000","last_fullsized":"2024-02-17T12:19:05.708024+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:59.839484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536855+0000","last_change":"2024-02-17T12:19:04.710601+0000","last_active":"2024-02-17T12:19:23.536855+0000","last_peered":"2024-02-17T12:19:23.536855+0000","last_clean":"2024-02-17T12:19:23.536855+0000","last_became_active":"2024-02-17T12:19:04.710296+0000","last_became_peered":"2024-02-17T12:19:04.710296+0000","last_unstale":"2024-02-17T12:19:23.536855+0000","last_undegraded":"2024-02-17T12:19:23.536855+0000","last_fullsized":"2024-02-17T12:19:23.536855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:17:06.226423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708366+0000","last_change":"2024-02-17T12:19:03.707121+0000","last_active":"2024-02-17T12:19:05.708366+0000","last_peered":"2024-02-17T12:19:05.708366+0000","last_clean":"2024-02-17T12:19:05.708366+0000","last_became_active":"2024-02-17T12:19:03.706873+0000","last_became_peered":"2024-02-17T12:19:03.706873+0000","last_unstale":"2024-02-17T12:19:05.708366+0000","last_undegraded":"2024-02-17T12:19:05.708366+0000","last_fullsized":"2024-02-17T12:19:05.708366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:24.015391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210702+0000","last_change":"2024-02-17T12:19:04.718645+0000","last_active":"2024-02-17T12:19:06.210702+0000","last_peered":"2024-02-17T12:19:06.210702+0000","last_clean":"2024-02-17T12:19:06.210702+0000","last_became_active":"2024-02-17T12:19:04.715738+0000","last_became_peered":"2024-02-17T12:19:04.715738+0000","last_unstale":"2024-02-17T12:19:06.210702+0000","last_undegraded":"2024-02-17T12:19:06.210702+0000","last_fullsized":"2024-02-17T12:19:06.210702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:45.056164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210641+0000","last_change":"2024-02-17T12:19:03.705719+0000","last_active":"2024-02-17T12:19:06.210641+0000","last_peered":"2024-02-17T12:19:06.210641+0000","last_clean":"2024-02-17T12:19:06.210641+0000","last_became_active":"2024-02-17T12:19:03.705394+0000","last_became_peered":"2024-02-17T12:19:03.705394+0000","last_unstale":"2024-02-17T12:19:06.210641+0000","last_undegraded":"2024-02-17T12:19:06.210641+0000","last_fullsized":"2024-02-17T12:19:06.210641+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:18.432832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380958+0000","last_change":"2024-02-17T12:19:04.719278+0000","last_active":"2024-02-17T12:19:23.380958+0000","last_peered":"2024-02-17T12:19:23.380958+0000","last_clean":"2024-02-17T12:19:23.380958+0000","last_became_active":"2024-02-17T12:19:04.718194+0000","last_became_peered":"2024-02-17T12:19:04.718194+0000","last_unstale":"2024-02-17T12:19:23.380958+0000","last_undegraded":"2024-02-17T12:19:23.380958+0000","last_fullsized":"2024-02-17T12:19:23.380958+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:11.081786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210809+0000","last_change":"2024-02-17T12:19:03.712607+0000","last_active":"2024-02-17T12:19:06.210809+0000","last_peered":"2024-02-17T12:19:06.210809+0000","last_clean":"2024-02-17T12:19:06.210809+0000","last_became_active":"2024-02-17T12:19:03.712328+0000","last_became_peered":"2024-02-17T12:19:03.712328+0000","last_unstale":"2024-02-17T12:19:06.210809+0000","last_undegraded":"2024-02-17T12:19:06.210809+0000","last_fullsized":"2024-02-17T12:19:06.210809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535812+0000","last_change":"2024-02-17T12:19:22.379938+0000","last_active":"2024-02-17T12:19:23.535812+0000","last_peered":"2024-02-17T12:19:23.535812+0000","last_clean":"2024-02-17T12:19:23.535812+0000","last_became_active":"2024-02-17T12:19:22.379601+0000","last_became_peered":"2024-02-17T12:19:22.379601+0000","last_unstale":"2024-02-17T12:19:23.535812+0000","last_undegraded":"2024-02-17T12:19:23.535812+0000","last_fullsized":"2024-02-17T12:19:23.535812+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:24:23.237404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711331+0000","last_change":"2024-02-17T12:19:04.711425+0000","last_active":"2024-02-17T12:19:05.711331+0000","last_peered":"2024-02-17T12:19:05.711331+0000","last_clean":"2024-02-17T12:19:05.711331+0000","last_became_active":"2024-02-17T12:19:04.711149+0000","last_became_peered":"2024-02-17T12:19:04.711149+0000","last_unstale":"2024-02-17T12:19:05.711331+0000","last_undegraded":"2024-02-17T12:19:05.711331+0000","last_fullsized":"2024-02-17T12:19:05.711331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521184+0000","last_change":"2024-02-17T12:19:03.708773+0000","last_active":"2024-02-17T12:19:06.521184+0000","last_peered":"2024-02-17T12:19:06.521184+0000","last_clean":"2024-02-17T12:19:06.521184+0000","last_became_active":"2024-02-17T12:19:03.707579+0000","last_became_peered":"2024-02-17T12:19:03.707579+0000","last_unstale":"2024-02-17T12:19:06.521184+0000","last_undegraded":"2024-02-17T12:19:06.521184+0000","last_fullsized":"2024-02-17T12:19:06.521184+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537328+0000","last_change":"2024-02-17T12:19:21.376109+0000","last_active":"2024-02-17T12:19:23.537328+0000","last_peered":"2024-02-17T12:19:23.537328+0000","last_clean":"2024-02-17T12:19:23.537328+0000","last_became_active":"2024-02-17T12:19:21.375805+0000","last_became_peered":"2024-02-17T12:19:21.375805+0000","last_unstale":"2024-02-17T12:19:23.537328+0000","last_undegraded":"2024-02-17T12:19:23.537328+0000","last_fullsized":"2024-02-17T12:19:23.537328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:31.884225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521131+0000","last_change":"2024-02-17T12:19:04.699129+0000","last_active":"2024-02-17T12:19:06.521131+0000","last_peered":"2024-02-17T12:19:06.521131+0000","last_clean":"2024-02-17T12:19:06.521131+0000","last_became_active":"2024-02-17T12:19:04.698800+0000","last_became_peered":"2024-02-17T12:19:04.698800+0000","last_unstale":"2024-02-17T12:19:06.521131+0000","last_undegraded":"2024-02-17T12:19:06.521131+0000","last_fullsized":"2024-02-17T12:19:06.521131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:36:34.252865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380734+0000","last_change":"2024-02-17T12:19:03.705779+0000","last_active":"2024-02-17T12:19:23.380734+0000","last_peered":"2024-02-17T12:19:23.380734+0000","last_clean":"2024-02-17T12:19:23.380734+0000","last_became_active":"2024-02-17T12:19:03.705453+0000","last_became_peered":"2024-02-17T12:19:03.705453+0000","last_unstale":"2024-02-17T12:19:23.380734+0000","last_undegraded":"2024-02-17T12:19:23.380734+0000","last_fullsized":"2024-02-17T12:19:23.380734+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:20.550660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538181+0000","last_change":"2024-02-17T12:19:22.382589+0000","last_active":"2024-02-17T12:19:23.538181+0000","last_peered":"2024-02-17T12:19:23.538181+0000","last_clean":"2024-02-17T12:19:23.538181+0000","last_became_active":"2024-02-17T12:19:22.381978+0000","last_became_peered":"2024-02-17T12:19:22.381978+0000","last_unstale":"2024-02-17T12:19:23.538181+0000","last_undegraded":"2024-02-17T12:19:23.538181+0000","last_fullsized":"2024-02-17T12:19:23.538181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:28.744493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535962+0000","last_change":"2024-02-17T12:19:04.717000+0000","last_active":"2024-02-17T12:19:23.535962+0000","last_peered":"2024-02-17T12:19:23.535962+0000","last_clean":"2024-02-17T12:19:23.535962+0000","last_became_active":"2024-02-17T12:19:04.716743+0000","last_became_peered":"2024-02-17T12:19:04.716743+0000","last_unstale":"2024-02-17T12:19:23.535962+0000","last_undegraded":"2024-02-17T12:19:23.535962+0000","last_fullsized":"2024-02-17T12:19:23.535962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:48:38.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210382+0000","last_change":"2024-02-17T12:19:03.710199+0000","last_active":"2024-02-17T12:19:06.210382+0000","last_peered":"2024-02-17T12:19:06.210382+0000","last_clean":"2024-02-17T12:19:06.210382+0000","last_became_active":"2024-02-17T12:19:03.709947+0000","last_became_peered":"2024-02-17T12:19:03.709947+0000","last_unstale":"2024-02-17T12:19:06.210382+0000","last_undegraded":"2024-02-17T12:19:06.210382+0000","last_fullsized":"2024-02-17T12:19:06.210382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380107+0000","last_change":"2024-02-17T12:19:22.375575+0000","last_active":"2024-02-17T12:19:23.380107+0000","last_peered":"2024-02-17T12:19:23.380107+0000","last_clean":"2024-02-17T12:19:23.380107+0000","last_became_active":"2024-02-17T12:19:22.375217+0000","last_became_peered":"2024-02-17T12:19:22.375217+0000","last_unstale":"2024-02-17T12:19:23.380107+0000","last_undegraded":"2024-02-17T12:19:23.380107+0000","last_fullsized":"2024-02-17T12:19:23.380107+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:26.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210236+0000","last_change":"2024-02-17T12:19:04.713606+0000","last_active":"2024-02-17T12:19:06.210236+0000","last_peered":"2024-02-17T12:19:06.210236+0000","last_clean":"2024-02-17T12:19:06.210236+0000","last_became_active":"2024-02-17T12:19:04.708088+0000","last_became_peered":"2024-02-17T12:19:04.708088+0000","last_unstale":"2024-02-17T12:19:06.210236+0000","last_undegraded":"2024-02-17T12:19:06.210236+0000","last_fullsized":"2024-02-17T12:19:06.210236+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:22.491827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379511+0000","last_change":"2024-02-17T12:19:03.701618+0000","last_active":"2024-02-17T12:19:23.379511+0000","last_peered":"2024-02-17T12:19:23.379511+0000","last_clean":"2024-02-17T12:19:23.379511+0000","last_became_active":"2024-02-17T12:19:03.701291+0000","last_became_peered":"2024-02-17T12:19:03.701291+0000","last_unstale":"2024-02-17T12:19:23.379511+0000","last_undegraded":"2024-02-17T12:19:23.379511+0000","last_fullsized":"2024-02-17T12:19:23.379511+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:13.448703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537887+0000","last_change":"2024-02-17T12:19:22.389793+0000","last_active":"2024-02-17T12:19:23.537887+0000","last_peered":"2024-02-17T12:19:23.537887+0000","last_clean":"2024-02-17T12:19:23.537887+0000","last_became_active":"2024-02-17T12:19:22.389415+0000","last_became_peered":"2024-02-17T12:19:22.389415+0000","last_unstale":"2024-02-17T12:19:23.537887+0000","last_undegraded":"2024-02-17T12:19:23.537887+0000","last_fullsized":"2024-02-17T12:19:23.537887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:26.992781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536720+0000","last_change":"2024-02-17T12:19:21.375230+0000","last_active":"2024-02-17T12:19:23.536720+0000","last_peered":"2024-02-17T12:19:23.536720+0000","last_clean":"2024-02-17T12:19:23.536720+0000","last_became_active":"2024-02-17T12:19:21.374933+0000","last_became_peered":"2024-02-17T12:19:21.374933+0000","last_unstale":"2024-02-17T12:19:23.536720+0000","last_undegraded":"2024-02-17T12:19:23.536720+0000","last_fullsized":"2024-02-17T12:19:23.536720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:09:40.208486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708155+0000","last_change":"2024-02-17T12:19:04.719250+0000","last_active":"2024-02-17T12:19:05.708155+0000","last_peered":"2024-02-17T12:19:05.708155+0000","last_clean":"2024-02-17T12:19:05.708155+0000","last_became_active":"2024-02-17T12:19:04.718856+0000","last_became_peered":"2024-02-17T12:19:04.718856+0000","last_unstale":"2024-02-17T12:19:05.708155+0000","last_undegraded":"2024-02-17T12:19:05.708155+0000","last_fullsized":"2024-02-17T12:19:05.708155+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:43.814483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537757+0000","last_change":"2024-02-17T12:19:03.712148+0000","last_active":"2024-02-17T12:19:23.537757+0000","last_peered":"2024-02-17T12:19:23.537757+0000","last_clean":"2024-02-17T12:19:23.537757+0000","last_became_active":"2024-02-17T12:19:03.711771+0000","last_became_peered":"2024-02-17T12:19:03.711771+0000","last_unstale":"2024-02-17T12:19:23.537757+0000","last_undegraded":"2024-02-17T12:19:23.537757+0000","last_fullsized":"2024-02-17T12:19:23.537757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:53.868822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":265,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536127+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:19:23.536127+0000","last_peered":"2024-02-17T12:19:23.536127+0000","last_clean":"2024-02-17T12:19:23.536127+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:19:23.536127+0000","last_undegraded":"2024-02-17T12:19:23.536127+0000","last_fullsized":"2024-02-17T12:19:23.536127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":3},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":18,"acting":18,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":361275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97299999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.115,"15min":1.115},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.143,"15min":1.143},"last":0.75800000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.629},{"interface":"front","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0640000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":1.734,"15min":1.734},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68200000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0840000000000001,"5min":1.804,"15min":1.804},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.5,"15min":1.5},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1419999999999999,"5min":1.855,"15min":1.855},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.77700000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":843776,"data_stored":363718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.73699999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.751}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.64100000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.45500000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.5},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.54400000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":839680,"data_stored":363696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57599999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54600000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.014,"5min":1.387,"15min":1.387},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.626},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0409999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.149,"5min":1.714,"15min":1.714},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1339999999999999,"5min":1.744,"15min":1.744},"last":0.64200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0980000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0720000000000001,"5min":1.575,"15min":1.575},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95099999999999996,"5min":1.321,"15min":1.321},"last":0.70499999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":360775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":1.145,"15min":1.145},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60599999999999998,"15min":0.66600000000000004},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.37}]},{"osd":2,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.755},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.48799999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.626,"15min":0.66100000000000003},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":2.609,"15min":2.609},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.68200000000000005,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.5}]},{"osd":4,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.03,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.54700000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.012,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.042,"5min":1.095,"15min":1.095},"last":0.69199999999999995}]},{"osd":6,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.96999999999999997,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.91600000000000004,"15min":0.98999999999999999},"min":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0549999999999999,"5min":5.375,"15min":5.375},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.92400000000000004,"15min":0.998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95099999999999996,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":1.629,"15min":1.629},"last":0.65100000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1425408,"data_stored":950983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58799999999999997,"5min":1.046,"15min":1.046},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66700000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96699999999999997,"5min":1.139,"15min":1.139},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.746,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.071,"15min":1.071},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.095,"15min":1.095},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.008,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.749},"min":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.73999999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1470464,"data_stored":972565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97399999999999998,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.50700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.502}]},{"osd":4,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61799999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98199999999999998,"5min":1.052,"15min":1.052},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":390908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81699999999999995,"5min":1.264,"15min":1.264},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89200000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.749,"15min":0.755},"min":{"1min":0.61599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96699999999999997,"5min":1.198,"15min":1.198},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48999999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.171,"15min":1.171},"last":0.72499999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1040000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.999,"5min":1.522,"15min":1.522},"last":0.82299999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.503},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60899999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":1.228,"15min":1.228},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":382631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.376},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45600000000000002},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.439}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.179,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93200000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.59799999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.042,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.995,"5min":1.252,"15min":1.252},"last":0.71599999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0669999999999999,"5min":1.29,"15min":1.29},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1319999999999999,"5min":1.337,"15min":1.337},"last":0.82899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:19:26.834 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:19:27.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f3956a00640 1 Processor -- start 2024-02-17T12:19:27.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f3956a00640 1 -- start start 2024-02-17T12:19:27.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f3956a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f395014f110 0x7f39500c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f3956a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39500c1eb0 0x7f395015c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f3956a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39500a9420 con 0x7f39500c2580 2024-02-17T12:19:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f3956a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395014f4f0 con 0x7f39500c1eb0 2024-02-17T12:19:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f3956a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39500aae80 con 0x7f395014f110 2024-02-17T12:19:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f3954a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39500c1eb0 0x7f395015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f3954a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f39500c1eb0 0x7f395015c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35442/0 (socket says 172.21.15.114:35442) 2024-02-17T12:19:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f3954a00640 1 -- 172.21.15.114:0/914261544 learned_addr learned my addr 172.21.15.114:0/914261544 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.000+0000 7f394fe00640 1 --2- 172.21.15.114:0/914261544 >> v2:172.21.15.116:3300/0 conn(0x7f395014f110 0x7f39500c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3954a00640 1 -- 172.21.15.114:0/914261544 >> v2:172.21.15.116:3300/0 conn(0x7f395014f110 msgr2=0x7f39500c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:27.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3954a00640 1 --2- 172.21.15.114:0/914261544 >> v2:172.21.15.116:3300/0 conn(0x7f395014f110 0x7f39500c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3954a00640 1 -- 172.21.15.114:0/914261544 >> v1:172.21.15.116:6789/0 conn(0x7f39500c2580 legacy=0x7f39500aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3954a00640 1 -- 172.21.15.114:0/914261544 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950152850 con 0x7f39500c1eb0 2024-02-17T12:19:27.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3954a00640 1 --2- 172.21.15.114:0/914261544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 0x7f395015c390 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f395006dc70 tx=0x7f394801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b85fc636515b82 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:27.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f394ea00640 1 -- 172.21.15.114:0/914261544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39480a57f0 con 0x7f39500c1eb0 2024-02-17T12:19:27.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f394ea00640 1 -- 172.21.15.114:0/914261544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39480a5950 con 0x7f39500c1eb0 2024-02-17T12:19:27.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f394ea00640 1 -- 172.21.15.114:0/914261544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39480a5ce0 con 0x7f39500c1eb0 2024-02-17T12:19:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3956a00640 1 -- 172.21.15.114:0/914261544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 msgr2=0x7f395015c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3956a00640 1 --2- 172.21.15.114:0/914261544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 0x7f395015c390 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f395006dc70 tx=0x7f394801c930 comp rx=0 tx=0).stop 2024-02-17T12:19:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3956a00640 1 -- 172.21.15.114:0/914261544 shutdown_connections 2024-02-17T12:19:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3956a00640 1 --2- 172.21.15.114:0/914261544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 0x7f395015c390 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3956a00640 1 --2- 172.21.15.114:0/914261544 >> v2:172.21.15.116:3300/0 conn(0x7f395014f110 0x7f39500c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3956a00640 1 -- 172.21.15.114:0/914261544 >> 172.21.15.114:0/914261544 conn(0x7f39500a8490 msgr2=0x7f39500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3956a00640 1 -- 172.21.15.114:0/914261544 shutdown_connections 2024-02-17T12:19:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.004+0000 7f3956a00640 1 -- 172.21.15.114:0/914261544 wait complete. 2024-02-17T12:19:27.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3956a00640 1 Processor -- start 2024-02-17T12:19:27.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3956a00640 1 -- start start 2024-02-17T12:19:27.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3956a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 0x7f39501f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3956a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39500c2580 0x7f395015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3956a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f395014f110 0x7f39500bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3956a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395015e830 con 0x7f39500c1eb0 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3956a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950141cf0 con 0x7f395014f110 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3956a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3950141f40 con 0x7f39500c2580 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 0x7f39501f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 0x7f39501f1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35450/0 (socket says 172.21.15.114:35450) 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394fe00640 1 -- 172.21.15.114:0/4275675631 learned_addr learned my addr 172.21.15.114:0/4275675631 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3954a00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f395014f110 0x7f39500bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394f400640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39500c2580 0x7f395015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394fe00640 1 -- 172.21.15.114:0/4275675631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39500c2580 msgr2=0x7f395015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394fe00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39500c2580 0x7f395015e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394fe00640 1 -- 172.21.15.114:0/4275675631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f395014f110 msgr2=0x7f39500bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394fe00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f395014f110 0x7f39500bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394fe00640 1 -- 172.21.15.114:0/4275675631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3948009b30 con 0x7f39500c1eb0 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394f400640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39500c2580 0x7f395015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f394fe00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 0x7f39501f1820 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f394000e930 tx=0x7f394000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3947e00640 1 -- 172.21.15.114:0/4275675631 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940009690 con 0x7f39500c1eb0 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3947e00640 1 -- 172.21.15.114:0/4275675631 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394000ca00 con 0x7f39500c1eb0 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3947e00640 1 -- 172.21.15.114:0/4275675631 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394000cd70 con 0x7f39500c1eb0 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3956a00640 1 -- 172.21.15.114:0/4275675631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39501f0d40 con 0x7f39500c1eb0 2024-02-17T12:19:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.008+0000 7f3956a00640 1 -- 172.21.15.114:0/4275675631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39501f1300 con 0x7f39500c1eb0 2024-02-17T12:19:27.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.012+0000 7f3956a00640 1 -- 172.21.15.114:0/4275675631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3950074840 con 0x7f39500c1eb0 2024-02-17T12:19:27.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.012+0000 7f3947e00640 1 -- 172.21.15.114:0/4275675631 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f3940013470 con 0x7f39500c1eb0 2024-02-17T12:19:27.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.012+0000 7f3947e00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3930066e40 0x7f3930069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.012+0000 7f3947e00640 1 -- 172.21.15.114:0/4275675631 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3940084f80 con 0x7f39500c1eb0 2024-02-17T12:19:27.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.012+0000 7f394f400640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3930066e40 0x7f3930069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.012+0000 7f394f400640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3930066e40 0x7f3930069300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f395014c5a0 tx=0x7f393c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:27.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.016+0000 7f3947e00640 1 -- 172.21.15.114:0/4275675631 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3940051b70 con 0x7f39500c1eb0 2024-02-17T12:19:27.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.168+0000 7f3956a00640 1 -- 172.21.15.114:0/4275675631 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3950152440 con 0x7f3930066e40 2024-02-17T12:19:27.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.180+0000 7f3947e00640 1 -- 172.21.15.114:0/4275675631 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+518901 (secure 0 0 0) 0x7f393c001c60 con 0x7f3930066e40 2024-02-17T12:19:27.188 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:27.192 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:19:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 -- 172.21.15.114:0/4275675631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3930066e40 msgr2=0x7f3930069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3930066e40 0x7f3930069300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f395014c5a0 tx=0x7f393c009040 comp rx=0 tx=0).stop 2024-02-17T12:19:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 -- 172.21.15.114:0/4275675631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 msgr2=0x7f39501f1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 0x7f39501f1820 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f394000e930 tx=0x7f394000edf0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 -- 172.21.15.114:0/4275675631 shutdown_connections 2024-02-17T12:19:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f395014f110 0x7f39500bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f39500c2580 0x7f395015e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3930066e40 0x7f3930069300 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 --2- 172.21.15.114:0/4275675631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39500c1eb0 0x7f39501f1820 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 -- 172.21.15.114:0/4275675631 >> 172.21.15.114:0/4275675631 conn(0x7f39500a8490 msgr2=0x7f39500c29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 -- 172.21.15.114:0/4275675631 shutdown_connections 2024-02-17T12:19:27.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.184+0000 7f3956a00640 1 -- 172.21.15.114:0/4275675631 wait complete. 2024-02-17T12:19:27.208 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-02-17T12:19:25.254893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596039,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":223,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":270,"acting":270,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":224,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244816,"kb_used_data":7840,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729904,"statfs":{"total":773094113280,"available":772843421696,"internally_reserved":0,"allocated":8028160,"data_stored":4146551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914084"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210592+0000","last_change":"2024-02-17T12:19:04.712400+0000","last_active":"2024-02-17T12:19:06.210592+0000","last_peered":"2024-02-17T12:19:06.210592+0000","last_clean":"2024-02-17T12:19:06.210592+0000","last_became_active":"2024-02-17T12:19:04.711598+0000","last_became_peered":"2024-02-17T12:19:04.711598+0000","last_unstale":"2024-02-17T12:19:06.210592+0000","last_undegraded":"2024-02-17T12:19:06.210592+0000","last_fullsized":"2024-02-17T12:19:06.210592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:02.628891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708335+0000","last_change":"2024-02-17T12:19:04.723008+0000","last_active":"2024-02-17T12:19:05.708335+0000","last_peered":"2024-02-17T12:19:05.708335+0000","last_clean":"2024-02-17T12:19:05.708335+0000","last_became_active":"2024-02-17T12:19:04.722730+0000","last_became_peered":"2024-02-17T12:19:04.722730+0000","last_unstale":"2024-02-17T12:19:05.708335+0000","last_undegraded":"2024-02-17T12:19:05.708335+0000","last_fullsized":"2024-02-17T12:19:05.708335+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:43.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537537+0000","last_change":"2024-02-17T12:19:04.710193+0000","last_active":"2024-02-17T12:19:23.537537+0000","last_peered":"2024-02-17T12:19:23.537537+0000","last_clean":"2024-02-17T12:19:23.537537+0000","last_became_active":"2024-02-17T12:19:04.709527+0000","last_became_peered":"2024-02-17T12:19:04.709527+0000","last_unstale":"2024-02-17T12:19:23.537537+0000","last_undegraded":"2024-02-17T12:19:23.537537+0000","last_fullsized":"2024-02-17T12:19:23.537537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:10:56.143323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537666+0000","last_change":"2024-02-17T12:19:04.728530+0000","last_active":"2024-02-17T12:19:23.537666+0000","last_peered":"2024-02-17T12:19:23.537666+0000","last_clean":"2024-02-17T12:19:23.537666+0000","last_became_active":"2024-02-17T12:19:04.728245+0000","last_became_peered":"2024-02-17T12:19:04.728245+0000","last_unstale":"2024-02-17T12:19:23.537666+0000","last_undegraded":"2024-02-17T12:19:23.537666+0000","last_fullsized":"2024-02-17T12:19:23.537666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:22.116393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535753+0000","last_change":"2024-02-17T12:19:22.369693+0000","last_active":"2024-02-17T12:19:23.535753+0000","last_peered":"2024-02-17T12:19:23.535753+0000","last_clean":"2024-02-17T12:19:23.535753+0000","last_became_active":"2024-02-17T12:19:22.368141+0000","last_became_peered":"2024-02-17T12:19:22.368141+0000","last_unstale":"2024-02-17T12:19:23.535753+0000","last_undegraded":"2024-02-17T12:19:23.535753+0000","last_fullsized":"2024-02-17T12:19:23.535753+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:16.792200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380238+0000","last_change":"2024-02-17T12:19:04.727165+0000","last_active":"2024-02-17T12:19:23.380238+0000","last_peered":"2024-02-17T12:19:23.380238+0000","last_clean":"2024-02-17T12:19:23.380238+0000","last_became_active":"2024-02-17T12:19:04.726850+0000","last_became_peered":"2024-02-17T12:19:04.726850+0000","last_unstale":"2024-02-17T12:19:23.380238+0000","last_undegraded":"2024-02-17T12:19:23.380238+0000","last_fullsized":"2024-02-17T12:19:23.380238+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:54.875823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711199+0000","last_change":"2024-02-17T12:19:04.713676+0000","last_active":"2024-02-17T12:19:05.711199+0000","last_peered":"2024-02-17T12:19:05.711199+0000","last_clean":"2024-02-17T12:19:05.711199+0000","last_became_active":"2024-02-17T12:19:04.710032+0000","last_became_peered":"2024-02-17T12:19:04.710032+0000","last_unstale":"2024-02-17T12:19:05.711199+0000","last_undegraded":"2024-02-17T12:19:05.711199+0000","last_fullsized":"2024-02-17T12:19:05.711199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536303+0000","last_change":"2024-02-17T12:19:04.714280+0000","last_active":"2024-02-17T12:19:23.536303+0000","last_peered":"2024-02-17T12:19:23.536303+0000","last_clean":"2024-02-17T12:19:23.536303+0000","last_became_active":"2024-02-17T12:19:04.714025+0000","last_became_peered":"2024-02-17T12:19:04.714025+0000","last_unstale":"2024-02-17T12:19:23.536303+0000","last_undegraded":"2024-02-17T12:19:23.536303+0000","last_fullsized":"2024-02-17T12:19:23.536303+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:04:31.444208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536568+0000","last_change":"2024-02-17T12:19:22.376606+0000","last_active":"2024-02-17T12:19:23.536568+0000","last_peered":"2024-02-17T12:19:23.536568+0000","last_clean":"2024-02-17T12:19:23.536568+0000","last_became_active":"2024-02-17T12:19:22.375794+0000","last_became_peered":"2024-02-17T12:19:22.375794+0000","last_unstale":"2024-02-17T12:19:23.536568+0000","last_undegraded":"2024-02-17T12:19:23.536568+0000","last_fullsized":"2024-02-17T12:19:23.536568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:41:26.244504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711186+0000","last_change":"2024-02-17T12:19:04.716344+0000","last_active":"2024-02-17T12:19:05.711186+0000","last_peered":"2024-02-17T12:19:05.711186+0000","last_clean":"2024-02-17T12:19:05.711186+0000","last_became_active":"2024-02-17T12:19:04.716003+0000","last_became_peered":"2024-02-17T12:19:04.716003+0000","last_unstale":"2024-02-17T12:19:05.711186+0000","last_undegraded":"2024-02-17T12:19:05.711186+0000","last_fullsized":"2024-02-17T12:19:05.711186+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:37.092834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537290+0000","last_change":"2024-02-17T12:19:22.380385+0000","last_active":"2024-02-17T12:19:23.537290+0000","last_peered":"2024-02-17T12:19:23.537290+0000","last_clean":"2024-02-17T12:19:23.537290+0000","last_became_active":"2024-02-17T12:19:22.380030+0000","last_became_peered":"2024-02-17T12:19:22.380030+0000","last_unstale":"2024-02-17T12:19:23.537290+0000","last_undegraded":"2024-02-17T12:19:23.537290+0000","last_fullsized":"2024-02-17T12:19:23.537290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:33:39.599699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.712377+0000","last_change":"2024-02-17T12:19:04.705511+0000","last_active":"2024-02-17T12:19:05.712377+0000","last_peered":"2024-02-17T12:19:05.712377+0000","last_clean":"2024-02-17T12:19:05.712377+0000","last_became_active":"2024-02-17T12:19:04.705195+0000","last_became_peered":"2024-02-17T12:19:04.705195+0000","last_unstale":"2024-02-17T12:19:05.712377+0000","last_undegraded":"2024-02-17T12:19:05.712377+0000","last_fullsized":"2024-02-17T12:19:05.712377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380515+0000","last_change":"2024-02-17T12:19:22.376957+0000","last_active":"2024-02-17T12:19:23.380515+0000","last_peered":"2024-02-17T12:19:23.380515+0000","last_clean":"2024-02-17T12:19:23.380515+0000","last_became_active":"2024-02-17T12:19:22.375810+0000","last_became_peered":"2024-02-17T12:19:22.375810+0000","last_unstale":"2024-02-17T12:19:23.380515+0000","last_undegraded":"2024-02-17T12:19:23.380515+0000","last_fullsized":"2024-02-17T12:19:23.380515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:06:06.364890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210616+0000","last_change":"2024-02-17T12:19:04.721693+0000","last_active":"2024-02-17T12:19:06.210616+0000","last_peered":"2024-02-17T12:19:06.210616+0000","last_clean":"2024-02-17T12:19:06.210616+0000","last_became_active":"2024-02-17T12:19:04.721343+0000","last_became_peered":"2024-02-17T12:19:04.721343+0000","last_unstale":"2024-02-17T12:19:06.210616+0000","last_undegraded":"2024-02-17T12:19:06.210616+0000","last_fullsized":"2024-02-17T12:19:06.210616+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:38.425090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381058+0000","last_change":"2024-02-17T12:19:22.370504+0000","last_active":"2024-02-17T12:19:23.381058+0000","last_peered":"2024-02-17T12:19:23.381058+0000","last_clean":"2024-02-17T12:19:23.381058+0000","last_became_active":"2024-02-17T12:19:22.370262+0000","last_became_peered":"2024-02-17T12:19:22.370262+0000","last_unstale":"2024-02-17T12:19:23.381058+0000","last_undegraded":"2024-02-17T12:19:23.381058+0000","last_fullsized":"2024-02-17T12:19:23.381058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:43:12.017524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708086+0000","last_change":"2024-02-17T12:19:04.717487+0000","last_active":"2024-02-17T12:19:05.708086+0000","last_peered":"2024-02-17T12:19:05.708086+0000","last_clean":"2024-02-17T12:19:05.708086+0000","last_became_active":"2024-02-17T12:19:04.717208+0000","last_became_peered":"2024-02-17T12:19:04.717208+0000","last_unstale":"2024-02-17T12:19:05.708086+0000","last_undegraded":"2024-02-17T12:19:05.708086+0000","last_fullsized":"2024-02-17T12:19:05.708086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:36:18.116201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210251+0000","last_change":"2024-02-17T12:19:04.720687+0000","last_active":"2024-02-17T12:19:06.210251+0000","last_peered":"2024-02-17T12:19:06.210251+0000","last_clean":"2024-02-17T12:19:06.210251+0000","last_became_active":"2024-02-17T12:19:04.720429+0000","last_became_peered":"2024-02-17T12:19:04.720429+0000","last_unstale":"2024-02-17T12:19:06.210251+0000","last_undegraded":"2024-02-17T12:19:06.210251+0000","last_fullsized":"2024-02-17T12:19:06.210251+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:13:30.982744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536857+0000","last_change":"2024-02-17T12:19:04.711936+0000","last_active":"2024-02-17T12:19:23.536857+0000","last_peered":"2024-02-17T12:19:23.536857+0000","last_clean":"2024-02-17T12:19:23.536857+0000","last_became_active":"2024-02-17T12:19:04.711624+0000","last_became_peered":"2024-02-17T12:19:04.711624+0000","last_unstale":"2024-02-17T12:19:23.536857+0000","last_undegraded":"2024-02-17T12:19:23.536857+0000","last_fullsized":"2024-02-17T12:19:23.536857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:55.448178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535626+0000","last_change":"2024-02-17T12:19:22.375472+0000","last_active":"2024-02-17T12:19:23.535626+0000","last_peered":"2024-02-17T12:19:23.535626+0000","last_clean":"2024-02-17T12:19:23.535626+0000","last_became_active":"2024-02-17T12:19:22.375196+0000","last_became_peered":"2024-02-17T12:19:22.375196+0000","last_unstale":"2024-02-17T12:19:23.535626+0000","last_undegraded":"2024-02-17T12:19:23.535626+0000","last_fullsized":"2024-02-17T12:19:23.535626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:17.057488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538389+0000","last_change":"2024-02-17T12:19:04.728727+0000","last_active":"2024-02-17T12:19:23.538389+0000","last_peered":"2024-02-17T12:19:23.538389+0000","last_clean":"2024-02-17T12:19:23.538389+0000","last_became_active":"2024-02-17T12:19:04.728194+0000","last_became_peered":"2024-02-17T12:19:04.728194+0000","last_unstale":"2024-02-17T12:19:23.538389+0000","last_undegraded":"2024-02-17T12:19:23.538389+0000","last_fullsized":"2024-02-17T12:19:23.538389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:07:54.785092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519632+0000","last_change":"2024-02-17T12:19:04.710789+0000","last_active":"2024-02-17T12:19:06.519632+0000","last_peered":"2024-02-17T12:19:06.519632+0000","last_clean":"2024-02-17T12:19:06.519632+0000","last_became_active":"2024-02-17T12:19:04.710321+0000","last_became_peered":"2024-02-17T12:19:04.710321+0000","last_unstale":"2024-02-17T12:19:06.519632+0000","last_undegraded":"2024-02-17T12:19:06.519632+0000","last_fullsized":"2024-02-17T12:19:06.519632+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:20.439350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537575+0000","last_change":"2024-02-17T12:19:22.389161+0000","last_active":"2024-02-17T12:19:23.537575+0000","last_peered":"2024-02-17T12:19:23.537575+0000","last_clean":"2024-02-17T12:19:23.537575+0000","last_became_active":"2024-02-17T12:19:22.388885+0000","last_became_peered":"2024-02-17T12:19:22.388885+0000","last_unstale":"2024-02-17T12:19:23.537575+0000","last_undegraded":"2024-02-17T12:19:23.537575+0000","last_fullsized":"2024-02-17T12:19:23.537575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:32.525943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379396+0000","last_change":"2024-02-17T12:19:04.714567+0000","last_active":"2024-02-17T12:19:23.379396+0000","last_peered":"2024-02-17T12:19:23.379396+0000","last_clean":"2024-02-17T12:19:23.379396+0000","last_became_active":"2024-02-17T12:19:04.714283+0000","last_became_peered":"2024-02-17T12:19:04.714283+0000","last_unstale":"2024-02-17T12:19:23.379396+0000","last_undegraded":"2024-02-17T12:19:23.379396+0000","last_fullsized":"2024-02-17T12:19:23.379396+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:36.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537786+0000","last_change":"2024-02-17T12:19:22.388259+0000","last_active":"2024-02-17T12:19:23.537786+0000","last_peered":"2024-02-17T12:19:23.537786+0000","last_clean":"2024-02-17T12:19:23.537786+0000","last_became_active":"2024-02-17T12:19:22.387822+0000","last_became_peered":"2024-02-17T12:19:22.387822+0000","last_unstale":"2024-02-17T12:19:23.537786+0000","last_undegraded":"2024-02-17T12:19:23.537786+0000","last_fullsized":"2024-02-17T12:19:23.537786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:23.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381171+0000","last_change":"2024-02-17T12:19:04.707760+0000","last_active":"2024-02-17T12:19:23.381171+0000","last_peered":"2024-02-17T12:19:23.381171+0000","last_clean":"2024-02-17T12:19:23.381171+0000","last_became_active":"2024-02-17T12:19:04.707499+0000","last_became_peered":"2024-02-17T12:19:04.707499+0000","last_unstale":"2024-02-17T12:19:23.381171+0000","last_undegraded":"2024-02-17T12:19:23.381171+0000","last_fullsized":"2024-02-17T12:19:23.381171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:24:01.313056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380698+0000","last_change":"2024-02-17T12:19:22.378610+0000","last_active":"2024-02-17T12:19:23.380698+0000","last_peered":"2024-02-17T12:19:23.380698+0000","last_clean":"2024-02-17T12:19:23.380698+0000","last_became_active":"2024-02-17T12:19:22.377368+0000","last_became_peered":"2024-02-17T12:19:22.377368+0000","last_unstale":"2024-02-17T12:19:23.380698+0000","last_undegraded":"2024-02-17T12:19:23.380698+0000","last_fullsized":"2024-02-17T12:19:23.380698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:32.414191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538289+0000","last_change":"2024-02-17T12:19:04.710944+0000","last_active":"2024-02-17T12:19:23.538289+0000","last_peered":"2024-02-17T12:19:23.538289+0000","last_clean":"2024-02-17T12:19:23.538289+0000","last_became_active":"2024-02-17T12:19:04.710625+0000","last_became_peered":"2024-02-17T12:19:04.710625+0000","last_unstale":"2024-02-17T12:19:23.538289+0000","last_undegraded":"2024-02-17T12:19:23.538289+0000","last_fullsized":"2024-02-17T12:19:23.538289+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:22:57.157645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520976+0000","last_change":"2024-02-17T12:19:04.718758+0000","last_active":"2024-02-17T12:19:06.520976+0000","last_peered":"2024-02-17T12:19:06.520976+0000","last_clean":"2024-02-17T12:19:06.520976+0000","last_became_active":"2024-02-17T12:19:04.718486+0000","last_became_peered":"2024-02-17T12:19:04.718486+0000","last_unstale":"2024-02-17T12:19:06.520976+0000","last_undegraded":"2024-02-17T12:19:06.520976+0000","last_fullsized":"2024-02-17T12:19:06.520976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.895909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537775+0000","last_change":"2024-02-17T12:19:04.714461+0000","last_active":"2024-02-17T12:19:23.537775+0000","last_peered":"2024-02-17T12:19:23.537775+0000","last_clean":"2024-02-17T12:19:23.537775+0000","last_became_active":"2024-02-17T12:19:04.714208+0000","last_became_peered":"2024-02-17T12:19:04.714208+0000","last_unstale":"2024-02-17T12:19:23.537775+0000","last_undegraded":"2024-02-17T12:19:23.537775+0000","last_fullsized":"2024-02-17T12:19:23.537775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:45.424685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538193+0000","last_change":"2024-02-17T12:19:04.722346+0000","last_active":"2024-02-17T12:19:23.538193+0000","last_peered":"2024-02-17T12:19:23.538193+0000","last_clean":"2024-02-17T12:19:23.538193+0000","last_became_active":"2024-02-17T12:19:04.722106+0000","last_became_peered":"2024-02-17T12:19:04.722106+0000","last_unstale":"2024-02-17T12:19:23.538193+0000","last_undegraded":"2024-02-17T12:19:23.538193+0000","last_fullsized":"2024-02-17T12:19:23.538193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:11.976571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535907+0000","last_change":"2024-02-17T12:19:22.372825+0000","last_active":"2024-02-17T12:19:23.535907+0000","last_peered":"2024-02-17T12:19:23.535907+0000","last_clean":"2024-02-17T12:19:23.535907+0000","last_became_active":"2024-02-17T12:19:22.372503+0000","last_became_peered":"2024-02-17T12:19:22.372503+0000","last_unstale":"2024-02-17T12:19:23.535907+0000","last_undegraded":"2024-02-17T12:19:23.535907+0000","last_fullsized":"2024-02-17T12:19:23.535907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:52:37.591482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707927+0000","last_change":"2024-02-17T12:19:04.720604+0000","last_active":"2024-02-17T12:19:05.707927+0000","last_peered":"2024-02-17T12:19:05.707927+0000","last_clean":"2024-02-17T12:19:05.707927+0000","last_became_active":"2024-02-17T12:19:04.720350+0000","last_became_peered":"2024-02-17T12:19:04.720350+0000","last_unstale":"2024-02-17T12:19:05.707927+0000","last_undegraded":"2024-02-17T12:19:05.707927+0000","last_fullsized":"2024-02-17T12:19:05.707927+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:21.365282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537757+0000","last_change":"2024-02-17T12:19:22.380747+0000","last_active":"2024-02-17T12:19:23.537757+0000","last_peered":"2024-02-17T12:19:23.537757+0000","last_clean":"2024-02-17T12:19:23.537757+0000","last_became_active":"2024-02-17T12:19:22.380112+0000","last_became_peered":"2024-02-17T12:19:22.380112+0000","last_unstale":"2024-02-17T12:19:23.537757+0000","last_undegraded":"2024-02-17T12:19:23.537757+0000","last_fullsized":"2024-02-17T12:19:23.537757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:49:12.538531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210224+0000","last_change":"2024-02-17T12:19:04.716818+0000","last_active":"2024-02-17T12:19:06.210224+0000","last_peered":"2024-02-17T12:19:06.210224+0000","last_clean":"2024-02-17T12:19:06.210224+0000","last_became_active":"2024-02-17T12:19:04.716507+0000","last_became_peered":"2024-02-17T12:19:04.716507+0000","last_unstale":"2024-02-17T12:19:06.210224+0000","last_undegraded":"2024-02-17T12:19:06.210224+0000","last_fullsized":"2024-02-17T12:19:06.210224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:56:16.543982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536132+0000","last_change":"2024-02-17T12:19:04.708458+0000","last_active":"2024-02-17T12:19:23.536132+0000","last_peered":"2024-02-17T12:19:23.536132+0000","last_clean":"2024-02-17T12:19:23.536132+0000","last_became_active":"2024-02-17T12:19:04.708170+0000","last_became_peered":"2024-02-17T12:19:04.708170+0000","last_unstale":"2024-02-17T12:19:23.536132+0000","last_undegraded":"2024-02-17T12:19:23.536132+0000","last_fullsized":"2024-02-17T12:19:23.536132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:57.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537653+0000","last_change":"2024-02-17T12:19:22.380274+0000","last_active":"2024-02-17T12:19:23.537653+0000","last_peered":"2024-02-17T12:19:23.537653+0000","last_clean":"2024-02-17T12:19:23.537653+0000","last_became_active":"2024-02-17T12:19:22.379913+0000","last_became_peered":"2024-02-17T12:19:22.379913+0000","last_unstale":"2024-02-17T12:19:23.537653+0000","last_undegraded":"2024-02-17T12:19:23.537653+0000","last_fullsized":"2024-02-17T12:19:23.537653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:33:02.035794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707967+0000","last_change":"2024-02-17T12:19:04.726126+0000","last_active":"2024-02-17T12:19:05.707967+0000","last_peered":"2024-02-17T12:19:05.707967+0000","last_clean":"2024-02-17T12:19:05.707967+0000","last_became_active":"2024-02-17T12:19:04.725344+0000","last_became_peered":"2024-02-17T12:19:04.725344+0000","last_unstale":"2024-02-17T12:19:05.707967+0000","last_undegraded":"2024-02-17T12:19:05.707967+0000","last_fullsized":"2024-02-17T12:19:05.707967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:08:29.699648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537028+0000","last_change":"2024-02-17T12:19:04.725988+0000","last_active":"2024-02-17T12:19:23.537028+0000","last_peered":"2024-02-17T12:19:23.537028+0000","last_clean":"2024-02-17T12:19:23.537028+0000","last_became_active":"2024-02-17T12:19:04.725703+0000","last_became_peered":"2024-02-17T12:19:04.725703+0000","last_unstale":"2024-02-17T12:19:23.537028+0000","last_undegraded":"2024-02-17T12:19:23.537028+0000","last_fullsized":"2024-02-17T12:19:23.537028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:26.113554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380518+0000","last_change":"2024-02-17T12:19:04.718744+0000","last_active":"2024-02-17T12:19:23.380518+0000","last_peered":"2024-02-17T12:19:23.380518+0000","last_clean":"2024-02-17T12:19:23.380518+0000","last_became_active":"2024-02-17T12:19:04.717669+0000","last_became_peered":"2024-02-17T12:19:04.717669+0000","last_unstale":"2024-02-17T12:19:23.380518+0000","last_undegraded":"2024-02-17T12:19:23.380518+0000","last_fullsized":"2024-02-17T12:19:23.380518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:15.849867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210342+0000","last_change":"2024-02-17T12:19:04.713023+0000","last_active":"2024-02-17T12:19:06.210342+0000","last_peered":"2024-02-17T12:19:06.210342+0000","last_clean":"2024-02-17T12:19:06.210342+0000","last_became_active":"2024-02-17T12:19:04.712535+0000","last_became_peered":"2024-02-17T12:19:04.712535+0000","last_unstale":"2024-02-17T12:19:06.210342+0000","last_undegraded":"2024-02-17T12:19:06.210342+0000","last_fullsized":"2024-02-17T12:19:06.210342+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:59.570840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707750+0000","last_change":"2024-02-17T12:19:04.721331+0000","last_active":"2024-02-17T12:19:05.707750+0000","last_peered":"2024-02-17T12:19:05.707750+0000","last_clean":"2024-02-17T12:19:05.707750+0000","last_became_active":"2024-02-17T12:19:04.721066+0000","last_became_peered":"2024-02-17T12:19:04.721066+0000","last_unstale":"2024-02-17T12:19:05.707750+0000","last_undegraded":"2024-02-17T12:19:05.707750+0000","last_fullsized":"2024-02-17T12:19:05.707750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:49:57.305678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708042+0000","last_change":"2024-02-17T12:19:04.726119+0000","last_active":"2024-02-17T12:19:05.708042+0000","last_peered":"2024-02-17T12:19:05.708042+0000","last_clean":"2024-02-17T12:19:05.708042+0000","last_became_active":"2024-02-17T12:19:04.725509+0000","last_became_peered":"2024-02-17T12:19:04.725509+0000","last_unstale":"2024-02-17T12:19:05.708042+0000","last_undegraded":"2024-02-17T12:19:05.708042+0000","last_fullsized":"2024-02-17T12:19:05.708042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:56.501011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380391+0000","last_change":"2024-02-17T12:19:04.706739+0000","last_active":"2024-02-17T12:19:23.380391+0000","last_peered":"2024-02-17T12:19:23.380391+0000","last_clean":"2024-02-17T12:19:23.380391+0000","last_became_active":"2024-02-17T12:19:04.706454+0000","last_became_peered":"2024-02-17T12:19:04.706454+0000","last_unstale":"2024-02-17T12:19:23.380391+0000","last_undegraded":"2024-02-17T12:19:23.380391+0000","last_fullsized":"2024-02-17T12:19:23.380391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:14.863236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538605+0000","last_change":"2024-02-17T12:19:22.382789+0000","last_active":"2024-02-17T12:19:23.538605+0000","last_peered":"2024-02-17T12:19:23.538605+0000","last_clean":"2024-02-17T12:19:23.538605+0000","last_became_active":"2024-02-17T12:19:22.382329+0000","last_became_peered":"2024-02-17T12:19:22.382329+0000","last_unstale":"2024-02-17T12:19:23.538605+0000","last_undegraded":"2024-02-17T12:19:23.538605+0000","last_fullsized":"2024-02-17T12:19:23.538605+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:32.472749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210145+0000","last_change":"2024-02-17T12:19:04.729805+0000","last_active":"2024-02-17T12:19:06.210145+0000","last_peered":"2024-02-17T12:19:06.210145+0000","last_clean":"2024-02-17T12:19:06.210145+0000","last_became_active":"2024-02-17T12:19:04.729388+0000","last_became_peered":"2024-02-17T12:19:04.729388+0000","last_unstale":"2024-02-17T12:19:06.210145+0000","last_undegraded":"2024-02-17T12:19:06.210145+0000","last_fullsized":"2024-02-17T12:19:06.210145+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:09:06.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380519+0000","last_change":"2024-02-17T12:19:04.710643+0000","last_active":"2024-02-17T12:19:23.380519+0000","last_peered":"2024-02-17T12:19:23.380519+0000","last_clean":"2024-02-17T12:19:23.380519+0000","last_became_active":"2024-02-17T12:19:04.709363+0000","last_became_peered":"2024-02-17T12:19:04.709363+0000","last_unstale":"2024-02-17T12:19:23.380519+0000","last_undegraded":"2024-02-17T12:19:23.380519+0000","last_fullsized":"2024-02-17T12:19:23.380519+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:14.810042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210786+0000","last_change":"2024-02-17T12:19:03.709066+0000","last_active":"2024-02-17T12:19:06.210786+0000","last_peered":"2024-02-17T12:19:06.210786+0000","last_clean":"2024-02-17T12:19:06.210786+0000","last_became_active":"2024-02-17T12:19:03.708888+0000","last_became_peered":"2024-02-17T12:19:03.708888+0000","last_unstale":"2024-02-17T12:19:06.210786+0000","last_undegraded":"2024-02-17T12:19:06.210786+0000","last_fullsized":"2024-02-17T12:19:06.210786+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380917+0000","last_change":"2024-02-17T12:19:22.369924+0000","last_active":"2024-02-17T12:19:23.380917+0000","last_peered":"2024-02-17T12:19:23.380917+0000","last_clean":"2024-02-17T12:19:23.380917+0000","last_became_active":"2024-02-17T12:19:22.369681+0000","last_became_peered":"2024-02-17T12:19:22.369681+0000","last_unstale":"2024-02-17T12:19:23.380917+0000","last_undegraded":"2024-02-17T12:19:23.380917+0000","last_fullsized":"2024-02-17T12:19:23.380917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:28.541757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210661+0000","last_change":"2024-02-17T12:19:04.718756+0000","last_active":"2024-02-17T12:19:06.210661+0000","last_peered":"2024-02-17T12:19:06.210661+0000","last_clean":"2024-02-17T12:19:06.210661+0000","last_became_active":"2024-02-17T12:19:04.716924+0000","last_became_peered":"2024-02-17T12:19:04.716924+0000","last_unstale":"2024-02-17T12:19:06.210661+0000","last_undegraded":"2024-02-17T12:19:06.210661+0000","last_fullsized":"2024-02-17T12:19:06.210661+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:11.015091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380711+0000","last_change":"2024-02-17T12:19:03.703800+0000","last_active":"2024-02-17T12:19:23.380711+0000","last_peered":"2024-02-17T12:19:23.380711+0000","last_clean":"2024-02-17T12:19:23.380711+0000","last_became_active":"2024-02-17T12:19:03.703402+0000","last_became_peered":"2024-02-17T12:19:03.703402+0000","last_unstale":"2024-02-17T12:19:23.380711+0000","last_undegraded":"2024-02-17T12:19:23.380711+0000","last_fullsized":"2024-02-17T12:19:23.380711+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:37:23.098316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537751+0000","last_change":"2024-02-17T12:19:22.373889+0000","last_active":"2024-02-17T12:19:23.537751+0000","last_peered":"2024-02-17T12:19:23.537751+0000","last_clean":"2024-02-17T12:19:23.537751+0000","last_became_active":"2024-02-17T12:19:22.372667+0000","last_became_peered":"2024-02-17T12:19:22.372667+0000","last_unstale":"2024-02-17T12:19:23.537751+0000","last_undegraded":"2024-02-17T12:19:23.537751+0000","last_fullsized":"2024-02-17T12:19:23.537751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:33.512575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210719+0000","last_change":"2024-02-17T12:19:04.730207+0000","last_active":"2024-02-17T12:19:06.210719+0000","last_peered":"2024-02-17T12:19:06.210719+0000","last_clean":"2024-02-17T12:19:06.210719+0000","last_became_active":"2024-02-17T12:19:04.729363+0000","last_became_peered":"2024-02-17T12:19:04.729363+0000","last_unstale":"2024-02-17T12:19:06.210719+0000","last_undegraded":"2024-02-17T12:19:06.210719+0000","last_fullsized":"2024-02-17T12:19:06.210719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:32:13.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521058+0000","last_change":"2024-02-17T12:19:03.704331+0000","last_active":"2024-02-17T12:19:06.521058+0000","last_peered":"2024-02-17T12:19:06.521058+0000","last_clean":"2024-02-17T12:19:06.521058+0000","last_became_active":"2024-02-17T12:19:03.704078+0000","last_became_peered":"2024-02-17T12:19:03.704078+0000","last_unstale":"2024-02-17T12:19:06.521058+0000","last_undegraded":"2024-02-17T12:19:06.521058+0000","last_fullsized":"2024-02-17T12:19:06.521058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537210+0000","last_change":"2024-02-17T12:19:21.377375+0000","last_active":"2024-02-17T12:19:23.537210+0000","last_peered":"2024-02-17T12:19:23.537210+0000","last_clean":"2024-02-17T12:19:23.537210+0000","last_became_active":"2024-02-17T12:19:21.377083+0000","last_became_peered":"2024-02-17T12:19:21.377083+0000","last_unstale":"2024-02-17T12:19:23.537210+0000","last_undegraded":"2024-02-17T12:19:23.537210+0000","last_fullsized":"2024-02-17T12:19:23.537210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:53.185121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537641+0000","last_change":"2024-02-17T12:19:04.710438+0000","last_active":"2024-02-17T12:19:23.537641+0000","last_peered":"2024-02-17T12:19:23.537641+0000","last_clean":"2024-02-17T12:19:23.537641+0000","last_became_active":"2024-02-17T12:19:04.709894+0000","last_became_peered":"2024-02-17T12:19:04.709894+0000","last_unstale":"2024-02-17T12:19:23.537641+0000","last_undegraded":"2024-02-17T12:19:23.537641+0000","last_fullsized":"2024-02-17T12:19:23.537641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:44.905808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521160+0000","last_change":"2024-02-17T12:19:03.702411+0000","last_active":"2024-02-17T12:19:06.521160+0000","last_peered":"2024-02-17T12:19:06.521160+0000","last_clean":"2024-02-17T12:19:06.521160+0000","last_became_active":"2024-02-17T12:19:03.702166+0000","last_became_peered":"2024-02-17T12:19:03.702166+0000","last_unstale":"2024-02-17T12:19:06.521160+0000","last_undegraded":"2024-02-17T12:19:06.521160+0000","last_fullsized":"2024-02-17T12:19:06.521160+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708166+0000","last_change":"2024-02-17T12:19:04.726343+0000","last_active":"2024-02-17T12:19:05.708166+0000","last_peered":"2024-02-17T12:19:05.708166+0000","last_clean":"2024-02-17T12:19:05.708166+0000","last_became_active":"2024-02-17T12:19:04.725870+0000","last_became_peered":"2024-02-17T12:19:04.725870+0000","last_unstale":"2024-02-17T12:19:05.708166+0000","last_undegraded":"2024-02-17T12:19:05.708166+0000","last_fullsized":"2024-02-17T12:19:05.708166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:27:42.531689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380548+0000","last_change":"2024-02-17T12:19:03.703159+0000","last_active":"2024-02-17T12:19:23.380548+0000","last_peered":"2024-02-17T12:19:23.380548+0000","last_clean":"2024-02-17T12:19:23.380548+0000","last_became_active":"2024-02-17T12:19:03.702811+0000","last_became_peered":"2024-02-17T12:19:03.702811+0000","last_unstale":"2024-02-17T12:19:23.380548+0000","last_undegraded":"2024-02-17T12:19:23.380548+0000","last_fullsized":"2024-02-17T12:19:23.380548+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:16.831548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379607+0000","last_change":"2024-02-17T12:19:22.368488+0000","last_active":"2024-02-17T12:19:23.379607+0000","last_peered":"2024-02-17T12:19:23.379607+0000","last_clean":"2024-02-17T12:19:23.379607+0000","last_became_active":"2024-02-17T12:19:22.368213+0000","last_became_peered":"2024-02-17T12:19:22.368213+0000","last_unstale":"2024-02-17T12:19:23.379607+0000","last_undegraded":"2024-02-17T12:19:23.379607+0000","last_fullsized":"2024-02-17T12:19:23.379607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:09:41.215827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380350+0000","last_change":"2024-02-17T12:19:04.708618+0000","last_active":"2024-02-17T12:19:23.380350+0000","last_peered":"2024-02-17T12:19:23.380350+0000","last_clean":"2024-02-17T12:19:23.380350+0000","last_became_active":"2024-02-17T12:19:04.708351+0000","last_became_peered":"2024-02-17T12:19:04.708351+0000","last_unstale":"2024-02-17T12:19:23.380350+0000","last_undegraded":"2024-02-17T12:19:23.380350+0000","last_fullsized":"2024-02-17T12:19:23.380350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:09.330073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380335+0000","last_change":"2024-02-17T12:19:03.706093+0000","last_active":"2024-02-17T12:19:23.380335+0000","last_peered":"2024-02-17T12:19:23.380335+0000","last_clean":"2024-02-17T12:19:23.380335+0000","last_became_active":"2024-02-17T12:19:03.705445+0000","last_became_peered":"2024-02-17T12:19:03.705445+0000","last_unstale":"2024-02-17T12:19:23.380335+0000","last_undegraded":"2024-02-17T12:19:23.380335+0000","last_fullsized":"2024-02-17T12:19:23.380335+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:29.842261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535697+0000","last_change":"2024-02-17T12:19:04.714305+0000","last_active":"2024-02-17T12:19:23.535697+0000","last_peered":"2024-02-17T12:19:23.535697+0000","last_clean":"2024-02-17T12:19:23.535697+0000","last_became_active":"2024-02-17T12:19:04.714041+0000","last_became_peered":"2024-02-17T12:19:04.714041+0000","last_unstale":"2024-02-17T12:19:23.535697+0000","last_undegraded":"2024-02-17T12:19:23.535697+0000","last_fullsized":"2024-02-17T12:19:23.535697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:12.864476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520892+0000","last_change":"2024-02-17T12:19:03.701055+0000","last_active":"2024-02-17T12:19:06.520892+0000","last_peered":"2024-02-17T12:19:06.520892+0000","last_clean":"2024-02-17T12:19:06.520892+0000","last_became_active":"2024-02-17T12:19:03.695988+0000","last_became_peered":"2024-02-17T12:19:03.695988+0000","last_unstale":"2024-02-17T12:19:06.520892+0000","last_undegraded":"2024-02-17T12:19:06.520892+0000","last_fullsized":"2024-02-17T12:19:06.520892+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536792+0000","last_change":"2024-02-17T12:19:22.379284+0000","last_active":"2024-02-17T12:19:23.536792+0000","last_peered":"2024-02-17T12:19:23.536792+0000","last_clean":"2024-02-17T12:19:23.536792+0000","last_became_active":"2024-02-17T12:19:22.378837+0000","last_became_peered":"2024-02-17T12:19:22.378837+0000","last_unstale":"2024-02-17T12:19:23.536792+0000","last_undegraded":"2024-02-17T12:19:23.536792+0000","last_fullsized":"2024-02-17T12:19:23.536792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519713+0000","last_change":"2024-02-17T12:19:04.710559+0000","last_active":"2024-02-17T12:19:06.519713+0000","last_peered":"2024-02-17T12:19:06.519713+0000","last_clean":"2024-02-17T12:19:06.519713+0000","last_became_active":"2024-02-17T12:19:04.709979+0000","last_became_peered":"2024-02-17T12:19:04.709979+0000","last_unstale":"2024-02-17T12:19:06.519713+0000","last_undegraded":"2024-02-17T12:19:06.519713+0000","last_fullsized":"2024-02-17T12:19:06.519713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:33:12.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707814+0000","last_change":"2024-02-17T12:19:03.702309+0000","last_active":"2024-02-17T12:19:05.707814+0000","last_peered":"2024-02-17T12:19:05.707814+0000","last_clean":"2024-02-17T12:19:05.707814+0000","last_became_active":"2024-02-17T12:19:03.702051+0000","last_became_peered":"2024-02-17T12:19:03.702051+0000","last_unstale":"2024-02-17T12:19:05.707814+0000","last_undegraded":"2024-02-17T12:19:05.707814+0000","last_fullsized":"2024-02-17T12:19:05.707814+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:58.978525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"71'3","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537726+0000","last_change":"2024-02-17T12:19:21.375965+0000","last_active":"2024-02-17T12:19:23.537726+0000","last_peered":"2024-02-17T12:19:23.537726+0000","last_clean":"2024-02-17T12:19:23.537726+0000","last_became_active":"2024-02-17T12:19:21.375551+0000","last_became_peered":"2024-02-17T12:19:21.375551+0000","last_unstale":"2024-02-17T12:19:23.537726+0000","last_undegraded":"2024-02-17T12:19:23.537726+0000","last_fullsized":"2024-02-17T12:19:23.537726+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:25.240966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520096+0000","last_change":"2024-02-17T12:19:04.726001+0000","last_active":"2024-02-17T12:19:06.520096+0000","last_peered":"2024-02-17T12:19:06.520096+0000","last_clean":"2024-02-17T12:19:06.520096+0000","last_became_active":"2024-02-17T12:19:04.725747+0000","last_became_peered":"2024-02-17T12:19:04.725747+0000","last_unstale":"2024-02-17T12:19:06.520096+0000","last_undegraded":"2024-02-17T12:19:06.520096+0000","last_fullsized":"2024-02-17T12:19:06.520096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:18:38.213214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210926+0000","last_change":"2024-02-17T12:19:03.712851+0000","last_active":"2024-02-17T12:19:06.210926+0000","last_peered":"2024-02-17T12:19:06.210926+0000","last_clean":"2024-02-17T12:19:06.210926+0000","last_became_active":"2024-02-17T12:19:03.712584+0000","last_became_peered":"2024-02-17T12:19:03.712584+0000","last_unstale":"2024-02-17T12:19:06.210926+0000","last_undegraded":"2024-02-17T12:19:06.210926+0000","last_fullsized":"2024-02-17T12:19:06.210926+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537449+0000","last_change":"2024-02-17T12:19:22.379237+0000","last_active":"2024-02-17T12:19:23.537449+0000","last_peered":"2024-02-17T12:19:23.537449+0000","last_clean":"2024-02-17T12:19:23.537449+0000","last_became_active":"2024-02-17T12:19:22.377019+0000","last_became_peered":"2024-02-17T12:19:22.377019+0000","last_unstale":"2024-02-17T12:19:23.537449+0000","last_undegraded":"2024-02-17T12:19:23.537449+0000","last_fullsized":"2024-02-17T12:19:23.537449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:53.311764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"71'6","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380677+0000","last_change":"2024-02-17T12:19:21.372337+0000","last_active":"2024-02-17T12:19:23.380677+0000","last_peered":"2024-02-17T12:19:23.380677+0000","last_clean":"2024-02-17T12:19:23.380677+0000","last_became_active":"2024-02-17T12:19:21.371919+0000","last_became_peered":"2024-02-17T12:19:21.371919+0000","last_unstale":"2024-02-17T12:19:23.380677+0000","last_undegraded":"2024-02-17T12:19:23.380677+0000","last_fullsized":"2024-02-17T12:19:23.380677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:11:12.798689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.712467+0000","last_change":"2024-02-17T12:19:04.709578+0000","last_active":"2024-02-17T12:19:05.712467+0000","last_peered":"2024-02-17T12:19:05.712467+0000","last_clean":"2024-02-17T12:19:05.712467+0000","last_became_active":"2024-02-17T12:19:04.709173+0000","last_became_peered":"2024-02-17T12:19:04.709173+0000","last_unstale":"2024-02-17T12:19:05.712467+0000","last_undegraded":"2024-02-17T12:19:05.712467+0000","last_fullsized":"2024-02-17T12:19:05.712467+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210669+0000","last_change":"2024-02-17T12:19:03.707721+0000","last_active":"2024-02-17T12:19:06.210669+0000","last_peered":"2024-02-17T12:19:06.210669+0000","last_clean":"2024-02-17T12:19:06.210669+0000","last_became_active":"2024-02-17T12:19:03.707435+0000","last_became_peered":"2024-02-17T12:19:03.707435+0000","last_unstale":"2024-02-17T12:19:06.210669+0000","last_undegraded":"2024-02-17T12:19:06.210669+0000","last_fullsized":"2024-02-17T12:19:06.210669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521092+0000","last_change":"2024-02-17T12:19:04.716812+0000","last_active":"2024-02-17T12:19:06.521092+0000","last_peered":"2024-02-17T12:19:06.521092+0000","last_clean":"2024-02-17T12:19:06.521092+0000","last_became_active":"2024-02-17T12:19:04.716307+0000","last_became_peered":"2024-02-17T12:19:04.716307+0000","last_unstale":"2024-02-17T12:19:06.521092+0000","last_undegraded":"2024-02-17T12:19:06.521092+0000","last_fullsized":"2024-02-17T12:19:06.521092+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:30.970580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210404+0000","last_change":"2024-02-17T12:19:03.710532+0000","last_active":"2024-02-17T12:19:06.210404+0000","last_peered":"2024-02-17T12:19:06.210404+0000","last_clean":"2024-02-17T12:19:06.210404+0000","last_became_active":"2024-02-17T12:19:03.710333+0000","last_became_peered":"2024-02-17T12:19:03.710333+0000","last_unstale":"2024-02-17T12:19:06.210404+0000","last_undegraded":"2024-02-17T12:19:06.210404+0000","last_fullsized":"2024-02-17T12:19:06.210404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381122+0000","last_change":"2024-02-17T12:19:22.367647+0000","last_active":"2024-02-17T12:19:23.381122+0000","last_peered":"2024-02-17T12:19:23.381122+0000","last_clean":"2024-02-17T12:19:23.381122+0000","last_became_active":"2024-02-17T12:19:22.366850+0000","last_became_peered":"2024-02-17T12:19:22.366850+0000","last_unstale":"2024-02-17T12:19:23.381122+0000","last_undegraded":"2024-02-17T12:19:23.381122+0000","last_fullsized":"2024-02-17T12:19:23.381122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:21:05.316175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380757+0000","last_change":"2024-02-17T12:19:04.719297+0000","last_active":"2024-02-17T12:19:23.380757+0000","last_peered":"2024-02-17T12:19:23.380757+0000","last_clean":"2024-02-17T12:19:23.380757+0000","last_became_active":"2024-02-17T12:19:04.718586+0000","last_became_peered":"2024-02-17T12:19:04.718586+0000","last_unstale":"2024-02-17T12:19:23.380757+0000","last_undegraded":"2024-02-17T12:19:23.380757+0000","last_fullsized":"2024-02-17T12:19:23.380757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:05.970868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:15.947048+0000","last_change":"2024-02-17T12:19:03.704237+0000","last_active":"2024-02-17T12:19:15.947048+0000","last_peered":"2024-02-17T12:19:15.947048+0000","last_clean":"2024-02-17T12:19:15.947048+0000","last_became_active":"2024-02-17T12:19:03.703964+0000","last_became_peered":"2024-02-17T12:19:03.703964+0000","last_unstale":"2024-02-17T12:19:15.947048+0000","last_undegraded":"2024-02-17T12:19:15.947048+0000","last_fullsized":"2024-02-17T12:19:15.947048+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:45.097730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379221+0000","last_change":"2024-02-17T12:19:22.366381+0000","last_active":"2024-02-17T12:19:23.379221+0000","last_peered":"2024-02-17T12:19:23.379221+0000","last_clean":"2024-02-17T12:19:23.379221+0000","last_became_active":"2024-02-17T12:19:22.366074+0000","last_became_peered":"2024-02-17T12:19:22.366074+0000","last_unstale":"2024-02-17T12:19:23.379221+0000","last_undegraded":"2024-02-17T12:19:23.379221+0000","last_fullsized":"2024-02-17T12:19:23.379221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:54.192462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380317+0000","last_change":"2024-02-17T12:19:21.358035+0000","last_active":"2024-02-17T12:19:23.380317+0000","last_peered":"2024-02-17T12:19:23.380317+0000","last_clean":"2024-02-17T12:19:23.380317+0000","last_became_active":"2024-02-17T12:19:21.357766+0000","last_became_peered":"2024-02-17T12:19:21.357766+0000","last_unstale":"2024-02-17T12:19:23.380317+0000","last_undegraded":"2024-02-17T12:19:23.380317+0000","last_fullsized":"2024-02-17T12:19:23.380317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:42.768921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520875+0000","last_change":"2024-02-17T12:19:04.702494+0000","last_active":"2024-02-17T12:19:06.520875+0000","last_peered":"2024-02-17T12:19:06.520875+0000","last_clean":"2024-02-17T12:19:06.520875+0000","last_became_active":"2024-02-17T12:19:04.702168+0000","last_became_peered":"2024-02-17T12:19:04.702168+0000","last_unstale":"2024-02-17T12:19:06.520875+0000","last_undegraded":"2024-02-17T12:19:06.520875+0000","last_fullsized":"2024-02-17T12:19:06.520875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:53.989897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707872+0000","last_change":"2024-02-17T12:19:03.710630+0000","last_active":"2024-02-17T12:19:05.707872+0000","last_peered":"2024-02-17T12:19:05.707872+0000","last_clean":"2024-02-17T12:19:05.707872+0000","last_became_active":"2024-02-17T12:19:03.710185+0000","last_became_peered":"2024-02-17T12:19:03.710185+0000","last_unstale":"2024-02-17T12:19:05.707872+0000","last_undegraded":"2024-02-17T12:19:05.707872+0000","last_fullsized":"2024-02-17T12:19:05.707872+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:07:16.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536196+0000","last_change":"2024-02-17T12:19:22.379291+0000","last_active":"2024-02-17T12:19:23.536196+0000","last_peered":"2024-02-17T12:19:23.536196+0000","last_clean":"2024-02-17T12:19:23.536196+0000","last_became_active":"2024-02-17T12:19:22.379052+0000","last_became_peered":"2024-02-17T12:19:22.379052+0000","last_unstale":"2024-02-17T12:19:23.536196+0000","last_undegraded":"2024-02-17T12:19:23.536196+0000","last_fullsized":"2024-02-17T12:19:23.536196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:30.791284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536979+0000","last_change":"2024-02-17T12:19:04.716555+0000","last_active":"2024-02-17T12:19:23.536979+0000","last_peered":"2024-02-17T12:19:23.536979+0000","last_clean":"2024-02-17T12:19:23.536979+0000","last_became_active":"2024-02-17T12:19:04.715235+0000","last_became_peered":"2024-02-17T12:19:04.715235+0000","last_unstale":"2024-02-17T12:19:23.536979+0000","last_undegraded":"2024-02-17T12:19:23.536979+0000","last_fullsized":"2024-02-17T12:19:23.536979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:05.685656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519744+0000","last_change":"2024-02-17T12:19:03.712475+0000","last_active":"2024-02-17T12:19:06.519744+0000","last_peered":"2024-02-17T12:19:06.519744+0000","last_clean":"2024-02-17T12:19:06.519744+0000","last_became_active":"2024-02-17T12:19:03.712117+0000","last_became_peered":"2024-02-17T12:19:03.712117+0000","last_unstale":"2024-02-17T12:19:06.519744+0000","last_undegraded":"2024-02-17T12:19:06.519744+0000","last_fullsized":"2024-02-17T12:19:06.519744+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:10.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538079+0000","last_change":"2024-02-17T12:19:21.362585+0000","last_active":"2024-02-17T12:19:23.538079+0000","last_peered":"2024-02-17T12:19:23.538079+0000","last_clean":"2024-02-17T12:19:23.538079+0000","last_became_active":"2024-02-17T12:19:21.361851+0000","last_became_peered":"2024-02-17T12:19:21.361851+0000","last_unstale":"2024-02-17T12:19:23.538079+0000","last_undegraded":"2024-02-17T12:19:23.538079+0000","last_fullsized":"2024-02-17T12:19:23.538079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:31.111070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707802+0000","last_change":"2024-02-17T12:19:04.727289+0000","last_active":"2024-02-17T12:19:05.707802+0000","last_peered":"2024-02-17T12:19:05.707802+0000","last_clean":"2024-02-17T12:19:05.707802+0000","last_became_active":"2024-02-17T12:19:04.727041+0000","last_became_peered":"2024-02-17T12:19:04.727041+0000","last_unstale":"2024-02-17T12:19:05.707802+0000","last_undegraded":"2024-02-17T12:19:05.707802+0000","last_fullsized":"2024-02-17T12:19:05.707802+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:39:43.401328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711022+0000","last_change":"2024-02-17T12:19:03.699211+0000","last_active":"2024-02-17T12:19:05.711022+0000","last_peered":"2024-02-17T12:19:05.711022+0000","last_clean":"2024-02-17T12:19:05.711022+0000","last_became_active":"2024-02-17T12:19:03.698244+0000","last_became_peered":"2024-02-17T12:19:03.698244+0000","last_unstale":"2024-02-17T12:19:05.711022+0000","last_undegraded":"2024-02-17T12:19:05.711022+0000","last_fullsized":"2024-02-17T12:19:05.711022+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:42.702805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538270+0000","last_change":"2024-02-17T12:19:21.368493+0000","last_active":"2024-02-17T12:19:23.538270+0000","last_peered":"2024-02-17T12:19:23.538270+0000","last_clean":"2024-02-17T12:19:23.538270+0000","last_became_active":"2024-02-17T12:19:21.368162+0000","last_became_peered":"2024-02-17T12:19:21.368162+0000","last_unstale":"2024-02-17T12:19:23.538270+0000","last_undegraded":"2024-02-17T12:19:23.538270+0000","last_fullsized":"2024-02-17T12:19:23.538270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:38.213027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.707696+0000","last_change":"2024-02-17T12:19:04.718529+0000","last_active":"2024-02-17T12:19:05.707696+0000","last_peered":"2024-02-17T12:19:05.707696+0000","last_clean":"2024-02-17T12:19:05.707696+0000","last_became_active":"2024-02-17T12:19:04.718251+0000","last_became_peered":"2024-02-17T12:19:04.718251+0000","last_unstale":"2024-02-17T12:19:05.707696+0000","last_undegraded":"2024-02-17T12:19:05.707696+0000","last_fullsized":"2024-02-17T12:19:05.707696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:28.280713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520686+0000","last_change":"2024-02-17T12:19:03.706554+0000","last_active":"2024-02-17T12:19:06.520686+0000","last_peered":"2024-02-17T12:19:06.520686+0000","last_clean":"2024-02-17T12:19:06.520686+0000","last_became_active":"2024-02-17T12:19:03.706236+0000","last_became_peered":"2024-02-17T12:19:03.706236+0000","last_unstale":"2024-02-17T12:19:06.520686+0000","last_undegraded":"2024-02-17T12:19:06.520686+0000","last_fullsized":"2024-02-17T12:19:06.520686+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537259+0000","last_change":"2024-02-17T12:19:04.715036+0000","last_active":"2024-02-17T12:19:23.537259+0000","last_peered":"2024-02-17T12:19:23.537259+0000","last_clean":"2024-02-17T12:19:23.537259+0000","last_became_active":"2024-02-17T12:19:04.714713+0000","last_became_peered":"2024-02-17T12:19:04.714713+0000","last_unstale":"2024-02-17T12:19:23.537259+0000","last_undegraded":"2024-02-17T12:19:23.537259+0000","last_fullsized":"2024-02-17T12:19:23.537259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:28:30.744698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210994+0000","last_change":"2024-02-17T12:19:03.705648+0000","last_active":"2024-02-17T12:19:06.210994+0000","last_peered":"2024-02-17T12:19:06.210994+0000","last_clean":"2024-02-17T12:19:06.210994+0000","last_became_active":"2024-02-17T12:19:03.705325+0000","last_became_peered":"2024-02-17T12:19:03.705325+0000","last_unstale":"2024-02-17T12:19:06.210994+0000","last_undegraded":"2024-02-17T12:19:06.210994+0000","last_fullsized":"2024-02-17T12:19:06.210994+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537452+0000","last_change":"2024-02-17T12:19:22.380167+0000","last_active":"2024-02-17T12:19:23.537452+0000","last_peered":"2024-02-17T12:19:23.537452+0000","last_clean":"2024-02-17T12:19:23.537452+0000","last_became_active":"2024-02-17T12:19:22.379704+0000","last_became_peered":"2024-02-17T12:19:22.379704+0000","last_unstale":"2024-02-17T12:19:23.537452+0000","last_undegraded":"2024-02-17T12:19:23.537452+0000","last_fullsized":"2024-02-17T12:19:23.537452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:28:11.111883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210807+0000","last_change":"2024-02-17T12:19:04.719005+0000","last_active":"2024-02-17T12:19:06.210807+0000","last_peered":"2024-02-17T12:19:06.210807+0000","last_clean":"2024-02-17T12:19:06.210807+0000","last_became_active":"2024-02-17T12:19:04.717221+0000","last_became_peered":"2024-02-17T12:19:04.717221+0000","last_unstale":"2024-02-17T12:19:06.210807+0000","last_undegraded":"2024-02-17T12:19:06.210807+0000","last_fullsized":"2024-02-17T12:19:06.210807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:50.535947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520940+0000","last_change":"2024-02-17T12:19:03.708463+0000","last_active":"2024-02-17T12:19:06.520940+0000","last_peered":"2024-02-17T12:19:06.520940+0000","last_clean":"2024-02-17T12:19:06.520940+0000","last_became_active":"2024-02-17T12:19:03.707739+0000","last_became_peered":"2024-02-17T12:19:03.707739+0000","last_unstale":"2024-02-17T12:19:06.520940+0000","last_undegraded":"2024-02-17T12:19:06.520940+0000","last_fullsized":"2024-02-17T12:19:06.520940+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380282+0000","last_change":"2024-02-17T12:19:21.361415+0000","last_active":"2024-02-17T12:19:23.380282+0000","last_peered":"2024-02-17T12:19:23.380282+0000","last_clean":"2024-02-17T12:19:23.380282+0000","last_became_active":"2024-02-17T12:19:21.360522+0000","last_became_peered":"2024-02-17T12:19:21.360522+0000","last_unstale":"2024-02-17T12:19:23.380282+0000","last_undegraded":"2024-02-17T12:19:23.380282+0000","last_fullsized":"2024-02-17T12:19:23.380282+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:19:01.561174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380889+0000","last_change":"2024-02-17T12:19:04.727161+0000","last_active":"2024-02-17T12:19:23.380889+0000","last_peered":"2024-02-17T12:19:23.380889+0000","last_clean":"2024-02-17T12:19:23.380889+0000","last_became_active":"2024-02-17T12:19:04.726871+0000","last_became_peered":"2024-02-17T12:19:04.726871+0000","last_unstale":"2024-02-17T12:19:23.380889+0000","last_undegraded":"2024-02-17T12:19:23.380889+0000","last_fullsized":"2024-02-17T12:19:23.380889+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:50.453267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521222+0000","last_change":"2024-02-17T12:19:03.700286+0000","last_active":"2024-02-17T12:19:06.521222+0000","last_peered":"2024-02-17T12:19:06.521222+0000","last_clean":"2024-02-17T12:19:06.521222+0000","last_became_active":"2024-02-17T12:19:03.700021+0000","last_became_peered":"2024-02-17T12:19:03.700021+0000","last_unstale":"2024-02-17T12:19:06.521222+0000","last_undegraded":"2024-02-17T12:19:06.521222+0000","last_fullsized":"2024-02-17T12:19:06.521222+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535774+0000","last_change":"2024-02-17T12:19:22.370952+0000","last_active":"2024-02-17T12:19:23.535774+0000","last_peered":"2024-02-17T12:19:23.535774+0000","last_clean":"2024-02-17T12:19:23.535774+0000","last_became_active":"2024-02-17T12:19:22.370205+0000","last_became_peered":"2024-02-17T12:19:22.370205+0000","last_unstale":"2024-02-17T12:19:23.535774+0000","last_undegraded":"2024-02-17T12:19:23.535774+0000","last_fullsized":"2024-02-17T12:19:23.535774+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:42:14.086969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538438+0000","last_change":"2024-02-17T12:19:04.727215+0000","last_active":"2024-02-17T12:19:23.538438+0000","last_peered":"2024-02-17T12:19:23.538438+0000","last_clean":"2024-02-17T12:19:23.538438+0000","last_became_active":"2024-02-17T12:19:04.726960+0000","last_became_peered":"2024-02-17T12:19:04.726960+0000","last_unstale":"2024-02-17T12:19:23.538438+0000","last_undegraded":"2024-02-17T12:19:23.538438+0000","last_fullsized":"2024-02-17T12:19:23.538438+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:45.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.520015+0000","last_change":"2024-02-17T12:19:03.709412+0000","last_active":"2024-02-17T12:19:06.520015+0000","last_peered":"2024-02-17T12:19:06.520015+0000","last_clean":"2024-02-17T12:19:06.520015+0000","last_became_active":"2024-02-17T12:19:03.709021+0000","last_became_peered":"2024-02-17T12:19:03.709021+0000","last_unstale":"2024-02-17T12:19:06.520015+0000","last_undegraded":"2024-02-17T12:19:06.520015+0000","last_fullsized":"2024-02-17T12:19:06.520015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:44.049163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711179+0000","last_change":"2024-02-17T12:19:04.712404+0000","last_active":"2024-02-17T12:19:05.711179+0000","last_peered":"2024-02-17T12:19:05.711179+0000","last_clean":"2024-02-17T12:19:05.711179+0000","last_became_active":"2024-02-17T12:19:04.711344+0000","last_became_peered":"2024-02-17T12:19:04.711344+0000","last_unstale":"2024-02-17T12:19:05.711179+0000","last_undegraded":"2024-02-17T12:19:05.711179+0000","last_fullsized":"2024-02-17T12:19:05.711179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:24.593812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538531+0000","last_change":"2024-02-17T12:19:03.706405+0000","last_active":"2024-02-17T12:19:23.538531+0000","last_peered":"2024-02-17T12:19:23.538531+0000","last_clean":"2024-02-17T12:19:23.538531+0000","last_became_active":"2024-02-17T12:19:03.706108+0000","last_became_peered":"2024-02-17T12:19:03.706108+0000","last_unstale":"2024-02-17T12:19:23.538531+0000","last_undegraded":"2024-02-17T12:19:23.538531+0000","last_fullsized":"2024-02-17T12:19:23.538531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.926513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538039+0000","last_change":"2024-02-17T12:19:22.389822+0000","last_active":"2024-02-17T12:19:23.538039+0000","last_peered":"2024-02-17T12:19:23.538039+0000","last_clean":"2024-02-17T12:19:23.538039+0000","last_became_active":"2024-02-17T12:19:22.389495+0000","last_became_peered":"2024-02-17T12:19:22.389495+0000","last_unstale":"2024-02-17T12:19:23.538039+0000","last_undegraded":"2024-02-17T12:19:23.538039+0000","last_fullsized":"2024-02-17T12:19:23.538039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:02:08.115974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536274+0000","last_change":"2024-02-17T12:19:04.712081+0000","last_active":"2024-02-17T12:19:23.536274+0000","last_peered":"2024-02-17T12:19:23.536274+0000","last_clean":"2024-02-17T12:19:23.536274+0000","last_became_active":"2024-02-17T12:19:04.711784+0000","last_became_peered":"2024-02-17T12:19:04.711784+0000","last_unstale":"2024-02-17T12:19:23.536274+0000","last_undegraded":"2024-02-17T12:19:23.536274+0000","last_fullsized":"2024-02-17T12:19:23.536274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:47:13.952609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536391+0000","last_change":"2024-02-17T12:19:03.701598+0000","last_active":"2024-02-17T12:19:23.536391+0000","last_peered":"2024-02-17T12:19:23.536391+0000","last_clean":"2024-02-17T12:19:23.536391+0000","last_became_active":"2024-02-17T12:19:03.701326+0000","last_became_peered":"2024-02-17T12:19:03.701326+0000","last_unstale":"2024-02-17T12:19:23.536391+0000","last_undegraded":"2024-02-17T12:19:23.536391+0000","last_fullsized":"2024-02-17T12:19:23.536391+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:47:22.021385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537974+0000","last_change":"2024-02-17T12:19:22.380952+0000","last_active":"2024-02-17T12:19:23.537974+0000","last_peered":"2024-02-17T12:19:23.537974+0000","last_clean":"2024-02-17T12:19:23.537974+0000","last_became_active":"2024-02-17T12:19:22.380493+0000","last_became_peered":"2024-02-17T12:19:22.380493+0000","last_unstale":"2024-02-17T12:19:23.537974+0000","last_undegraded":"2024-02-17T12:19:23.537974+0000","last_fullsized":"2024-02-17T12:19:23.537974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:54.242151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711041+0000","last_change":"2024-02-17T12:19:04.702184+0000","last_active":"2024-02-17T12:19:05.711041+0000","last_peered":"2024-02-17T12:19:05.711041+0000","last_clean":"2024-02-17T12:19:05.711041+0000","last_became_active":"2024-02-17T12:19:04.701908+0000","last_became_peered":"2024-02-17T12:19:04.701908+0000","last_unstale":"2024-02-17T12:19:05.711041+0000","last_undegraded":"2024-02-17T12:19:05.711041+0000","last_fullsized":"2024-02-17T12:19:05.711041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:30.749868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.519477+0000","last_change":"2024-02-17T12:19:03.702614+0000","last_active":"2024-02-17T12:19:06.519477+0000","last_peered":"2024-02-17T12:19:06.519477+0000","last_clean":"2024-02-17T12:19:06.519477+0000","last_became_active":"2024-02-17T12:19:03.702360+0000","last_became_peered":"2024-02-17T12:19:03.702360+0000","last_unstale":"2024-02-17T12:19:06.519477+0000","last_undegraded":"2024-02-17T12:19:06.519477+0000","last_fullsized":"2024-02-17T12:19:06.519477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:37.418089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380585+0000","last_change":"2024-02-17T12:19:04.697171+0000","last_active":"2024-02-17T12:19:23.380585+0000","last_peered":"2024-02-17T12:19:23.380585+0000","last_clean":"2024-02-17T12:19:23.380585+0000","last_became_active":"2024-02-17T12:19:04.696841+0000","last_became_peered":"2024-02-17T12:19:04.696841+0000","last_unstale":"2024-02-17T12:19:23.380585+0000","last_undegraded":"2024-02-17T12:19:23.380585+0000","last_fullsized":"2024-02-17T12:19:23.380585+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:04:51.114922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708024+0000","last_change":"2024-02-17T12:19:03.706098+0000","last_active":"2024-02-17T12:19:05.708024+0000","last_peered":"2024-02-17T12:19:05.708024+0000","last_clean":"2024-02-17T12:19:05.708024+0000","last_became_active":"2024-02-17T12:19:03.705787+0000","last_became_peered":"2024-02-17T12:19:03.705787+0000","last_unstale":"2024-02-17T12:19:05.708024+0000","last_undegraded":"2024-02-17T12:19:05.708024+0000","last_fullsized":"2024-02-17T12:19:05.708024+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:59.839484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536855+0000","last_change":"2024-02-17T12:19:04.710601+0000","last_active":"2024-02-17T12:19:23.536855+0000","last_peered":"2024-02-17T12:19:23.536855+0000","last_clean":"2024-02-17T12:19:23.536855+0000","last_became_active":"2024-02-17T12:19:04.710296+0000","last_became_peered":"2024-02-17T12:19:04.710296+0000","last_unstale":"2024-02-17T12:19:23.536855+0000","last_undegraded":"2024-02-17T12:19:23.536855+0000","last_fullsized":"2024-02-17T12:19:23.536855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:17:06.226423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708366+0000","last_change":"2024-02-17T12:19:03.707121+0000","last_active":"2024-02-17T12:19:05.708366+0000","last_peered":"2024-02-17T12:19:05.708366+0000","last_clean":"2024-02-17T12:19:05.708366+0000","last_became_active":"2024-02-17T12:19:03.706873+0000","last_became_peered":"2024-02-17T12:19:03.706873+0000","last_unstale":"2024-02-17T12:19:05.708366+0000","last_undegraded":"2024-02-17T12:19:05.708366+0000","last_fullsized":"2024-02-17T12:19:05.708366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:24.015391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210702+0000","last_change":"2024-02-17T12:19:04.718645+0000","last_active":"2024-02-17T12:19:06.210702+0000","last_peered":"2024-02-17T12:19:06.210702+0000","last_clean":"2024-02-17T12:19:06.210702+0000","last_became_active":"2024-02-17T12:19:04.715738+0000","last_became_peered":"2024-02-17T12:19:04.715738+0000","last_unstale":"2024-02-17T12:19:06.210702+0000","last_undegraded":"2024-02-17T12:19:06.210702+0000","last_fullsized":"2024-02-17T12:19:06.210702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:45.056164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210641+0000","last_change":"2024-02-17T12:19:03.705719+0000","last_active":"2024-02-17T12:19:06.210641+0000","last_peered":"2024-02-17T12:19:06.210641+0000","last_clean":"2024-02-17T12:19:06.210641+0000","last_became_active":"2024-02-17T12:19:03.705394+0000","last_became_peered":"2024-02-17T12:19:03.705394+0000","last_unstale":"2024-02-17T12:19:06.210641+0000","last_undegraded":"2024-02-17T12:19:06.210641+0000","last_fullsized":"2024-02-17T12:19:06.210641+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:18.432832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380958+0000","last_change":"2024-02-17T12:19:04.719278+0000","last_active":"2024-02-17T12:19:23.380958+0000","last_peered":"2024-02-17T12:19:23.380958+0000","last_clean":"2024-02-17T12:19:23.380958+0000","last_became_active":"2024-02-17T12:19:04.718194+0000","last_became_peered":"2024-02-17T12:19:04.718194+0000","last_unstale":"2024-02-17T12:19:23.380958+0000","last_undegraded":"2024-02-17T12:19:23.380958+0000","last_fullsized":"2024-02-17T12:19:23.380958+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:11.081786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210809+0000","last_change":"2024-02-17T12:19:03.712607+0000","last_active":"2024-02-17T12:19:06.210809+0000","last_peered":"2024-02-17T12:19:06.210809+0000","last_clean":"2024-02-17T12:19:06.210809+0000","last_became_active":"2024-02-17T12:19:03.712328+0000","last_became_peered":"2024-02-17T12:19:03.712328+0000","last_unstale":"2024-02-17T12:19:06.210809+0000","last_undegraded":"2024-02-17T12:19:06.210809+0000","last_fullsized":"2024-02-17T12:19:06.210809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535812+0000","last_change":"2024-02-17T12:19:22.379938+0000","last_active":"2024-02-17T12:19:23.535812+0000","last_peered":"2024-02-17T12:19:23.535812+0000","last_clean":"2024-02-17T12:19:23.535812+0000","last_became_active":"2024-02-17T12:19:22.379601+0000","last_became_peered":"2024-02-17T12:19:22.379601+0000","last_unstale":"2024-02-17T12:19:23.535812+0000","last_undegraded":"2024-02-17T12:19:23.535812+0000","last_fullsized":"2024-02-17T12:19:23.535812+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:24:23.237404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.711331+0000","last_change":"2024-02-17T12:19:04.711425+0000","last_active":"2024-02-17T12:19:05.711331+0000","last_peered":"2024-02-17T12:19:05.711331+0000","last_clean":"2024-02-17T12:19:05.711331+0000","last_became_active":"2024-02-17T12:19:04.711149+0000","last_became_peered":"2024-02-17T12:19:04.711149+0000","last_unstale":"2024-02-17T12:19:05.711331+0000","last_undegraded":"2024-02-17T12:19:05.711331+0000","last_fullsized":"2024-02-17T12:19:05.711331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521184+0000","last_change":"2024-02-17T12:19:03.708773+0000","last_active":"2024-02-17T12:19:06.521184+0000","last_peered":"2024-02-17T12:19:06.521184+0000","last_clean":"2024-02-17T12:19:06.521184+0000","last_became_active":"2024-02-17T12:19:03.707579+0000","last_became_peered":"2024-02-17T12:19:03.707579+0000","last_unstale":"2024-02-17T12:19:06.521184+0000","last_undegraded":"2024-02-17T12:19:06.521184+0000","last_fullsized":"2024-02-17T12:19:06.521184+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:21.340147+0000","last_change":"2024-02-17T12:19:21.340147+0000","last_active":"2024-02-17T12:19:21.340147+0000","last_peered":"2024-02-17T12:19:21.340147+0000","last_clean":"2024-02-17T12:19:21.340147+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:21.340147+0000","last_undegraded":"2024-02-17T12:19:21.340147+0000","last_fullsized":"2024-02-17T12:19:21.340147+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537328+0000","last_change":"2024-02-17T12:19:21.376109+0000","last_active":"2024-02-17T12:19:23.537328+0000","last_peered":"2024-02-17T12:19:23.537328+0000","last_clean":"2024-02-17T12:19:23.537328+0000","last_became_active":"2024-02-17T12:19:21.375805+0000","last_became_peered":"2024-02-17T12:19:21.375805+0000","last_unstale":"2024-02-17T12:19:23.537328+0000","last_undegraded":"2024-02-17T12:19:23.537328+0000","last_fullsized":"2024-02-17T12:19:23.537328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:31.884225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.521131+0000","last_change":"2024-02-17T12:19:04.699129+0000","last_active":"2024-02-17T12:19:06.521131+0000","last_peered":"2024-02-17T12:19:06.521131+0000","last_clean":"2024-02-17T12:19:06.521131+0000","last_became_active":"2024-02-17T12:19:04.698800+0000","last_became_peered":"2024-02-17T12:19:04.698800+0000","last_unstale":"2024-02-17T12:19:06.521131+0000","last_undegraded":"2024-02-17T12:19:06.521131+0000","last_fullsized":"2024-02-17T12:19:06.521131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:36:34.252865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380734+0000","last_change":"2024-02-17T12:19:03.705779+0000","last_active":"2024-02-17T12:19:23.380734+0000","last_peered":"2024-02-17T12:19:23.380734+0000","last_clean":"2024-02-17T12:19:23.380734+0000","last_became_active":"2024-02-17T12:19:03.705453+0000","last_became_peered":"2024-02-17T12:19:03.705453+0000","last_unstale":"2024-02-17T12:19:23.380734+0000","last_undegraded":"2024-02-17T12:19:23.380734+0000","last_fullsized":"2024-02-17T12:19:23.380734+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:20.550660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538181+0000","last_change":"2024-02-17T12:19:22.382589+0000","last_active":"2024-02-17T12:19:23.538181+0000","last_peered":"2024-02-17T12:19:23.538181+0000","last_clean":"2024-02-17T12:19:23.538181+0000","last_became_active":"2024-02-17T12:19:22.381978+0000","last_became_peered":"2024-02-17T12:19:22.381978+0000","last_unstale":"2024-02-17T12:19:23.538181+0000","last_undegraded":"2024-02-17T12:19:23.538181+0000","last_fullsized":"2024-02-17T12:19:23.538181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:28.744493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535962+0000","last_change":"2024-02-17T12:19:04.717000+0000","last_active":"2024-02-17T12:19:23.535962+0000","last_peered":"2024-02-17T12:19:23.535962+0000","last_clean":"2024-02-17T12:19:23.535962+0000","last_became_active":"2024-02-17T12:19:04.716743+0000","last_became_peered":"2024-02-17T12:19:04.716743+0000","last_unstale":"2024-02-17T12:19:23.535962+0000","last_undegraded":"2024-02-17T12:19:23.535962+0000","last_fullsized":"2024-02-17T12:19:23.535962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:48:38.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210382+0000","last_change":"2024-02-17T12:19:03.710199+0000","last_active":"2024-02-17T12:19:06.210382+0000","last_peered":"2024-02-17T12:19:06.210382+0000","last_clean":"2024-02-17T12:19:06.210382+0000","last_became_active":"2024-02-17T12:19:03.709947+0000","last_became_peered":"2024-02-17T12:19:03.709947+0000","last_unstale":"2024-02-17T12:19:06.210382+0000","last_undegraded":"2024-02-17T12:19:06.210382+0000","last_fullsized":"2024-02-17T12:19:06.210382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380107+0000","last_change":"2024-02-17T12:19:22.375575+0000","last_active":"2024-02-17T12:19:23.380107+0000","last_peered":"2024-02-17T12:19:23.380107+0000","last_clean":"2024-02-17T12:19:23.380107+0000","last_became_active":"2024-02-17T12:19:22.375217+0000","last_became_peered":"2024-02-17T12:19:22.375217+0000","last_unstale":"2024-02-17T12:19:23.380107+0000","last_undegraded":"2024-02-17T12:19:23.380107+0000","last_fullsized":"2024-02-17T12:19:23.380107+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:26.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-02-17T12:19:20.332805+0000","last_change":"2024-02-17T12:19:20.332805+0000","last_active":"2024-02-17T12:19:20.332805+0000","last_peered":"2024-02-17T12:19:20.332805+0000","last_clean":"2024-02-17T12:19:20.332805+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-17T12:19:20.332805+0000","last_undegraded":"2024-02-17T12:19:20.332805+0000","last_fullsized":"2024-02-17T12:19:20.332805+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:06.210236+0000","last_change":"2024-02-17T12:19:04.713606+0000","last_active":"2024-02-17T12:19:06.210236+0000","last_peered":"2024-02-17T12:19:06.210236+0000","last_clean":"2024-02-17T12:19:06.210236+0000","last_became_active":"2024-02-17T12:19:04.708088+0000","last_became_peered":"2024-02-17T12:19:04.708088+0000","last_unstale":"2024-02-17T12:19:06.210236+0000","last_undegraded":"2024-02-17T12:19:06.210236+0000","last_fullsized":"2024-02-17T12:19:06.210236+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:22.491827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379511+0000","last_change":"2024-02-17T12:19:03.701618+0000","last_active":"2024-02-17T12:19:23.379511+0000","last_peered":"2024-02-17T12:19:23.379511+0000","last_clean":"2024-02-17T12:19:23.379511+0000","last_became_active":"2024-02-17T12:19:03.701291+0000","last_became_peered":"2024-02-17T12:19:03.701291+0000","last_unstale":"2024-02-17T12:19:23.379511+0000","last_undegraded":"2024-02-17T12:19:23.379511+0000","last_fullsized":"2024-02-17T12:19:23.379511+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:13.448703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537887+0000","last_change":"2024-02-17T12:19:22.389793+0000","last_active":"2024-02-17T12:19:23.537887+0000","last_peered":"2024-02-17T12:19:23.537887+0000","last_clean":"2024-02-17T12:19:23.537887+0000","last_became_active":"2024-02-17T12:19:22.389415+0000","last_became_peered":"2024-02-17T12:19:22.389415+0000","last_unstale":"2024-02-17T12:19:23.537887+0000","last_undegraded":"2024-02-17T12:19:23.537887+0000","last_fullsized":"2024-02-17T12:19:23.537887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:26.992781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536720+0000","last_change":"2024-02-17T12:19:21.375230+0000","last_active":"2024-02-17T12:19:23.536720+0000","last_peered":"2024-02-17T12:19:23.536720+0000","last_clean":"2024-02-17T12:19:23.536720+0000","last_became_active":"2024-02-17T12:19:21.374933+0000","last_became_peered":"2024-02-17T12:19:21.374933+0000","last_unstale":"2024-02-17T12:19:23.536720+0000","last_undegraded":"2024-02-17T12:19:23.536720+0000","last_fullsized":"2024-02-17T12:19:23.536720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:09:40.208486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-02-17T12:19:05.708155+0000","last_change":"2024-02-17T12:19:04.719250+0000","last_active":"2024-02-17T12:19:05.708155+0000","last_peered":"2024-02-17T12:19:05.708155+0000","last_clean":"2024-02-17T12:19:05.708155+0000","last_became_active":"2024-02-17T12:19:04.718856+0000","last_became_peered":"2024-02-17T12:19:04.718856+0000","last_unstale":"2024-02-17T12:19:05.708155+0000","last_undegraded":"2024-02-17T12:19:05.708155+0000","last_fullsized":"2024-02-17T12:19:05.708155+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:43.814483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537757+0000","last_change":"2024-02-17T12:19:03.712148+0000","last_active":"2024-02-17T12:19:23.537757+0000","last_peered":"2024-02-17T12:19:23.537757+0000","last_clean":"2024-02-17T12:19:23.537757+0000","last_became_active":"2024-02-17T12:19:03.711771+0000","last_became_peered":"2024-02-17T12:19:03.711771+0000","last_unstale":"2024-02-17T12:19:23.537757+0000","last_undegraded":"2024-02-17T12:19:23.537757+0000","last_fullsized":"2024-02-17T12:19:23.537757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:53.868822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":265,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536127+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:19:23.536127+0000","last_peered":"2024-02-17T12:19:23.536127+0000","last_clean":"2024-02-17T12:19:23.536127+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:19:23.536127+0000","last_undegraded":"2024-02-17T12:19:23.536127+0000","last_fullsized":"2024-02-17T12:19:23.536127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":3},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":18,"acting":18,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":839680,"data_stored":361275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97299999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.115,"15min":1.115},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.143,"15min":1.143},"last":0.75800000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.629},{"interface":"front","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0640000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":1.734,"15min":1.734},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.68200000000000005}]},{"osd":4,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0840000000000001,"5min":1.804,"15min":1.804},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.5,"15min":1.5},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1419999999999999,"5min":1.855,"15min":1.855},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.77700000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":843776,"data_stored":363718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92600000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.103},"last":0.73699999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.52800000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79300000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.628}]},{"osd":2,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95199999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86399999999999999,"5min":1.377,"15min":1.377},"last":0.751}]},{"osd":3,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":1.415,"15min":1.415},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.57599999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.91600000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.64100000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":1.52,"15min":1.52},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60899999999999999,"15min":0.61099999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84199999999999997,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.45500000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:18:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":0.89000000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.5},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.026,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.54400000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":839680,"data_stored":363696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57599999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54600000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.014,"5min":1.387,"15min":1.387},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.626},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0409999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.149,"5min":1.714,"15min":1.714},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1339999999999999,"5min":1.744,"15min":1.744},"last":0.64200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0980000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0720000000000001,"5min":1.575,"15min":1.575},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95099999999999996,"5min":1.321,"15min":1.321},"last":0.70499999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":360775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":1.145,"15min":1.145},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60599999999999998,"15min":0.66600000000000004},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.37}]},{"osd":2,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.755},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.48799999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.626,"15min":0.66100000000000003},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":2.609,"15min":2.609},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.68200000000000005,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.5}]},{"osd":4,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.03,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.54700000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.012,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.042,"5min":1.095,"15min":1.095},"last":0.69199999999999995}]},{"osd":6,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.96999999999999997,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.91600000000000004,"15min":0.98999999999999999},"min":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0549999999999999,"5min":5.375,"15min":5.375},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.92400000000000004,"15min":0.998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95099999999999996,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":1.629,"15min":1.629},"last":0.65100000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1425408,"data_stored":950983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58799999999999997,"5min":1.046,"15min":1.046},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66700000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96699999999999997,"5min":1.139,"15min":1.139},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.746,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.071,"15min":1.071},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.095,"15min":1.095},"last":0.65400000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.008,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.749},"min":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.73999999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1470464,"data_stored":972565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97399999999999998,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.50700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.502}]},{"osd":4,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61799999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98199999999999998,"5min":1.052,"15min":1.052},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":390908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81699999999999995,"5min":1.264,"15min":1.264},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89200000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.749,"15min":0.755},"min":{"1min":0.61599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96699999999999997,"5min":1.198,"15min":1.198},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48999999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.171,"15min":1.171},"last":0.72499999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1040000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.999,"5min":1.522,"15min":1.522},"last":0.82299999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.503},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60899999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":1.228,"15min":1.228},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":382631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.376},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45600000000000002},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.439}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.179,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93200000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.59799999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.042,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.995,"5min":1.252,"15min":1.252},"last":0.71599999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0669999999999999,"5min":1.29,"15min":1.29},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1319999999999999,"5min":1.337,"15min":1.337},"last":0.82899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:19:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2024-02-17T12:19:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2024-02-17T12:19:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2024-02-17T12:19:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2024-02-17T12:19:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2024-02-17T12:19:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2024-02-17T12:19:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2024-02-17T12:19:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2024-02-17T12:19:27.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2024-02-17T12:19:27.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2024-02-17T12:19:27.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2024-02-17T12:19:27.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2024-02-17T12:19:27.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:21.340147+0000', 'last_change': '2024-02-17T12:19:21.340147+0000', 'last_active': '2024-02-17T12:19:21.340147+0000', 'last_peered': '2024-02-17T12:19:21.340147+0000', 'last_clean': '2024-02-17T12:19:21.340147+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:21.340147+0000', 'last_undegraded': '2024-02-17T12:19:21.340147+0000', 'last_fullsized': '2024-02-17T12:19:21.340147+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:21.340147+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2024-02-17T12:19:27.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-02-17T12:19:20.332805+0000', 'last_change': '2024-02-17T12:19:20.332805+0000', 'last_active': '2024-02-17T12:19:20.332805+0000', 'last_peered': '2024-02-17T12:19:20.332805+0000', 'last_clean': '2024-02-17T12:19:20.332805+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-17T12:19:20.332805+0000', 'last_undegraded': '2024-02-17T12:19:20.332805+0000', 'last_fullsized': '2024-02-17T12:19:20.332805+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'last_clean_scrub_stamp': '2024-02-17T12:19:20.332805+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-02-17T12:19:27.228 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-17T12:19:27.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4358000640 1 Processor -- start 2024-02-17T12:19:27.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4358000640 1 -- start start 2024-02-17T12:19:27.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4358000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4350148760 0x7f4350071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4358000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43500c5680 0x7f4350152470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4358000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43501529b0 con 0x7f4350155730 2024-02-17T12:19:27.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4358000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4350155030 con 0x7f4350148760 2024-02-17T12:19:27.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4358000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4350155310 con 0x7f43500c5680 2024-02-17T12:19:27.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4355600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4350148760 0x7f4350071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4354c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43500c5680 0x7f4350152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4355600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4350148760 0x7f4350071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:39196/0 (socket says 172.21.15.114:39196) 2024-02-17T12:19:27.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4355600640 1 -- 172.21.15.114:0/626620106 learned_addr learned my addr 172.21.15.114:0/626620106 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:27.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.384+0000 7f4356000640 1 --1- 172.21.15.114:0/626620106 >> v1:172.21.15.116:6789/0 conn(0x7f4350155730 0x7f43500c2fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:35708/0 (socket says 172.21.15.114:35708) 2024-02-17T12:19:27.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.388+0000 7f4354c00640 1 -- 172.21.15.114:0/626620106 >> v2:172.21.15.116:3300/0 conn(0x7f4350148760 msgr2=0x7f4350071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:27.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.388+0000 7f4354c00640 1 --2- 172.21.15.114:0/626620106 >> v2:172.21.15.116:3300/0 conn(0x7f4350148760 0x7f4350071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.388+0000 7f4354c00640 1 -- 172.21.15.114:0/626620106 >> v1:172.21.15.116:6789/0 conn(0x7f4350155730 legacy=0x7f43500c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.388+0000 7f4354c00640 1 -- 172.21.15.114:0/626620106 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43500c5c00 con 0x7f43500c5680 2024-02-17T12:19:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.388+0000 7f4354c00640 1 --2- 172.21.15.114:0/626620106 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43500c5680 0x7f4350152470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f433c0097c0 tx=0x7f433c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36248efe5bbe4be7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:27.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f434fe00640 1 -- 172.21.15.114:0/626620106 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c0ab600 con 0x7f43500c5680 2024-02-17T12:19:27.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f434fe00640 1 -- 172.21.15.114:0/626620106 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c0a7050 con 0x7f43500c5680 2024-02-17T12:19:27.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f434fe00640 1 -- 172.21.15.114:0/626620106 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c0ab980 con 0x7f43500c5680 2024-02-17T12:19:27.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f4358000640 1 -- 172.21.15.114:0/626620106 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43500c5680 msgr2=0x7f4350152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f4358000640 1 --2- 172.21.15.114:0/626620106 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43500c5680 0x7f4350152470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f433c0097c0 tx=0x7f433c01c4a0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f4358000640 1 -- 172.21.15.114:0/626620106 shutdown_connections 2024-02-17T12:19:27.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f4358000640 1 --2- 172.21.15.114:0/626620106 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43500c5680 0x7f4350152470 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f4358000640 1 --2- 172.21.15.114:0/626620106 >> v2:172.21.15.116:3300/0 conn(0x7f4350148760 0x7f4350071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f4358000640 1 -- 172.21.15.114:0/626620106 >> 172.21.15.114:0/626620106 conn(0x7f43500c6550 msgr2=0x7f43500c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:27.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f4358000640 1 -- 172.21.15.114:0/626620106 shutdown_connections 2024-02-17T12:19:27.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.392+0000 7f4358000640 1 -- 172.21.15.114:0/626620106 wait complete. 2024-02-17T12:19:27.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 Processor -- start 2024-02-17T12:19:27.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 -- start start 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43500c5680 0x7f43501452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4350148760 0x7f435014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4350155730 0x7f43501edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43501f1850 con 0x7f4350155730 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500c3f50 con 0x7f43500c5680 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43501eda70 con 0x7f4350148760 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4356000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4350155730 0x7f43501edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4356000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4350155730 0x7f43501edf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35458/0 (socket says 172.21.15.114:35458) 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4356000640 1 -- 172.21.15.114:0/1994162892 learned_addr learned my addr 172.21.15.114:0/1994162892 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4354c00640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4350148760 0x7f435014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4355600640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43500c5680 0x7f43501452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4356000640 1 -- 172.21.15.114:0/1994162892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4350148760 msgr2=0x7f435014e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4356000640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4350148760 0x7f435014e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4356000640 1 -- 172.21.15.114:0/1994162892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43500c5680 msgr2=0x7f43501452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4356000640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43500c5680 0x7f43501452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4356000640 1 -- 172.21.15.114:0/1994162892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c009420 con 0x7f4350155730 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4356000640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4350155730 0x7f43501edf00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f434800c3f0 tx=0x7f434800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f434d600640 1 -- 172.21.15.114:0/1994162892 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480074e0 con 0x7f4350155730 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f434d600640 1 -- 172.21.15.114:0/1994162892 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4348007640 con 0x7f4350155730 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 -- 172.21.15.114:0/1994162892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43501f1d10 con 0x7f4350155730 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f434d600640 1 -- 172.21.15.114:0/1994162892 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348004a10 con 0x7f4350155730 2024-02-17T12:19:27.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 -- 172.21.15.114:0/1994162892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43501f1a30 con 0x7f4350155730 2024-02-17T12:19:27.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.396+0000 7f4358000640 1 -- 172.21.15.114:0/1994162892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43501edbe0 con 0x7f4350155730 2024-02-17T12:19:27.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.400+0000 7f434d600640 1 -- 172.21.15.114:0/1994162892 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4348004b70 con 0x7f4350155730 2024-02-17T12:19:27.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.400+0000 7f434d600640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4330066e70 0x7f4330069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.400+0000 7f434d600640 1 -- 172.21.15.114:0/1994162892 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f43480846e0 con 0x7f4350155730 2024-02-17T12:19:27.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.400+0000 7f4355600640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4330066e70 0x7f4330069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.400+0000 7f4355600640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4330066e70 0x7f4330069330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f43440113e0 tx=0x7f434400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:27.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.404+0000 7f434d600640 1 -- 172.21.15.114:0/1994162892 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4348054c30 con 0x7f4350155730 2024-02-17T12:19:27.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.612+0000 7f4358000640 1 -- 172.21.15.114:0/1994162892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f43500c06b0 con 0x7f4350155730 2024-02-17T12:19:27.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.612+0000 7f434d600640 1 -- 172.21.15.114:0/1994162892 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1406 (secure 0 0 0) 0x7f43480547c0 con 0x7f4350155730 2024-02-17T12:19:27.618 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:27.618 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":209,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":72,"num_osds":8,"num_up_osds":8,"osd_up_since":1708172169,"num_in_osds":8,"osd_in_since":1708172160,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":193}],"num_pgs":193,"num_pools":5,"num_objects":46,"data_bytes":596691,"bytes_used":251002880,"bytes_avail":772843110400,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":53,"id":6,"up":1,"in":1,"max":1,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":6501},{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6504}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-02-17T12:18:59.249747+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-17T12:19:27.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 -- 172.21.15.114:0/1994162892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4330066e70 msgr2=0x7f4330069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4330066e70 0x7f4330069330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f43440113e0 tx=0x7f434400b040 comp rx=0 tx=0).stop 2024-02-17T12:19:27.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 -- 172.21.15.114:0/1994162892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4350155730 msgr2=0x7f43501edf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4350155730 0x7f43501edf00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f434800c3f0 tx=0x7f434800c8b0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 -- 172.21.15.114:0/1994162892 shutdown_connections 2024-02-17T12:19:27.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4330066e70 0x7f4330069330 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4350155730 0x7f43501edf00 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4350148760 0x7f435014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 --2- 172.21.15.114:0/1994162892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43500c5680 0x7f43501452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 -- 172.21.15.114:0/1994162892 >> 172.21.15.114:0/1994162892 conn(0x7f43500c6550 msgr2=0x7f43501479b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:27.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 -- 172.21.15.114:0/1994162892 shutdown_connections 2024-02-17T12:19:27.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.616+0000 7f4358000640 1 -- 172.21.15.114:0/1994162892 wait complete. 2024-02-17T12:19:27.638 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-17T12:19:27.639 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:19:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568e200640 1 Processor -- start 2024-02-17T12:19:27.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568e200640 1 -- start start 2024-02-17T12:19:27.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568e200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f568806fdc0 0x7f5688152d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568e200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f56880c2620 0x7f56881532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568e200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5688070c60 con 0x7f5688150190 2024-02-17T12:19:27.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568e200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5688070370 con 0x7f56880c2620 2024-02-17T12:19:27.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568e200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5688070610 con 0x7f568806fdc0 2024-02-17T12:19:27.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568ce00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5688150190 0x7f56880aa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56132/0 (socket says 172.21.15.114:56132) 2024-02-17T12:19:27.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568ce00640 1 -- 172.21.15.114:0/382776653 learned_addr learned my addr 172.21.15.114:0/382776653 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:27.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568d800640 1 --2- 172.21.15.114:0/382776653 >> v2:172.21.15.116:3300/0 conn(0x7f56880c2620 0x7f56881532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687e00640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f568806fdc0 0x7f5688152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279077110 0 0) 0x7f5688070c60 con 0x7f5688150190 2024-02-17T12:19:27.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5670003530 con 0x7f5688150190 2024-02-17T12:19:27.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3718906005 0 0) 0x7f5670003530 con 0x7f5688150190 2024-02-17T12:19:27.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f568806fdc0 msgr2=0x7f5688152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:27.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f568806fdc0 0x7f5688152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 >> v2:172.21.15.116:3300/0 conn(0x7f56880c2620 msgr2=0x7f56881532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:27.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 --2- 172.21.15.114:0/382776653 >> v2:172.21.15.116:3300/0 conn(0x7f56880c2620 0x7f56881532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880708f0 con 0x7f5688150190 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f567c001680 con 0x7f5688150190 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568d800640 1 --2- 172.21.15.114:0/382776653 >> v2:172.21.15.116:3300/0 conn(0x7f56880c2620 0x7f56881532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 >> v1:172.21.15.114:6789/0 conn(0x7f5688150190 legacy=0x7f56880aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5670003980 0x7f5670003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f568806fdc0 0x7f56700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 0x7f5670005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5688070370 con 0x7f5670004d10 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5688070610 con 0x7f5670003980 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567000b990 con 0x7f568806fdc0 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568d800640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 0x7f5670005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f5687e00640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f568806fdc0 0x7f56700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568ce00640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5670003980 0x7f5670003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568d800640 1 -- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f568806fdc0 msgr2=0x7f56700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:27.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568d800640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f568806fdc0 0x7f56700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568d800640 1 -- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5670003980 msgr2=0x7f5670003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:27.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568d800640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5670003980 0x7f5670003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.772+0000 7f568d800640 1 -- 172.21.15.114:0/382776653 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670003530 con 0x7f5670004d10 2024-02-17T12:19:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f568d800640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 0x7f5670005190 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f568000e350 tx=0x7f568001ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a522620a5445261 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800a5e90 con 0x7f5670004d10 2024-02-17T12:19:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568000f040 con 0x7f5670004d10 2024-02-17T12:19:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f5687400640 1 -- 172.21.15.114:0/382776653 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800ad640 con 0x7f5670004d10 2024-02-17T12:19:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f568e200640 1 -- 172.21.15.114:0/382776653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 msgr2=0x7f5670005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f568e200640 1 --2- 172.21.15.114:0/382776653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 0x7f5670005190 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f568000e350 tx=0x7f568001ce80 comp rx=0 tx=0).stop 2024-02-17T12:19:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f568d800640 1 -- 172.21.15.114:0/382776653 reap_dead start 2024-02-17T12:19:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f568e200640 1 -- 172.21.15.114:0/382776653 shutdown_connections 2024-02-17T12:19:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f568e200640 1 -- 172.21.15.114:0/382776653 >> 172.21.15.114:0/382776653 conn(0x7f568806ed70 msgr2=0x7f568806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:27.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f568e200640 1 -- 172.21.15.114:0/382776653 shutdown_connections 2024-02-17T12:19:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.776+0000 7f568e200640 1 -- 172.21.15.114:0/382776653 wait complete. 2024-02-17T12:19:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 Processor -- start 2024-02-17T12:19:27.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 -- start start 2024-02-17T12:19:27.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 0x7f5688148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5688150aa0 0x7f56880c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56880c1d10 0x7f56881edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5688151fe0 con 0x7f5670004d10 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5688152b00 con 0x7f5688150aa0 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56880a9a70 con 0x7f56880c1d10 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 0x7f5688148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 0x7f5688148df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35470/0 (socket says 172.21.15.114:35470) 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568ce00640 1 -- 172.21.15.114:0/4143707518 learned_addr learned my addr 172.21.15.114:0/4143707518 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568d800640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56880c1d10 0x7f56881edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f5687e00640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5688150aa0 0x7f56880c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568ce00640 1 -- 172.21.15.114:0/4143707518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56880c1d10 msgr2=0x7f56881edb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568ce00640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56880c1d10 0x7f56881edb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568ce00640 1 -- 172.21.15.114:0/4143707518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5688150aa0 msgr2=0x7f56880c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568ce00640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5688150aa0 0x7f56880c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568ce00640 1 -- 172.21.15.114:0/4143707518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5688149330 con 0x7f5670004d10 2024-02-17T12:19:27.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f5687e00640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5688150aa0 0x7f56880c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:27.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568ce00640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 0x7f5688148df0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f567c012540 tx=0x7f567c012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:27.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f5684c00640 1 -- 172.21.15.114:0/4143707518 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c014810 con 0x7f5670004d10 2024-02-17T12:19:27.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f5684c00640 1 -- 172.21.15.114:0/4143707518 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c014990 con 0x7f5670004d10 2024-02-17T12:19:27.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 -- 172.21.15.114:0/4143707518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5688151520 con 0x7f5670004d10 2024-02-17T12:19:27.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f5684c00640 1 -- 172.21.15.114:0/4143707518 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c014d40 con 0x7f5670004d10 2024-02-17T12:19:27.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 -- 172.21.15.114:0/4143707518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56880a9790 con 0x7f5670004d10 2024-02-17T12:19:27.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.780+0000 7f568e200640 1 -- 172.21.15.114:0/4143707518 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5688068180 con 0x7f5670004d10 2024-02-17T12:19:27.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.784+0000 7f5684c00640 1 -- 172.21.15.114:0/4143707518 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f567c016480 con 0x7f5670004d10 2024-02-17T12:19:27.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.784+0000 7f5684c00640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5668066e40 0x7f5668069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:27.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.784+0000 7f5684c00640 1 -- 172.21.15.114:0/4143707518 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f567c088180 con 0x7f5670004d10 2024-02-17T12:19:27.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.784+0000 7f5687e00640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5668066e40 0x7f5668069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:27.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.784+0000 7f5687e00640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5668066e40 0x7f5668069300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f56880c8380 tx=0x7f5674008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:27.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.788+0000 7f5684c00640 1 -- 172.21.15.114:0/4143707518 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f567c054c00 con 0x7f5670004d10 2024-02-17T12:19:27.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.936+0000 7f568e200640 1 -- 172.21.15.114:0/4143707518 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5688068730 con 0x7f5668066e40 2024-02-17T12:19:27.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.948+0000 7f5684c00640 1 -- 172.21.15.114:0/4143707518 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527814 (secure 0 0 0) 0x7f5688068730 con 0x7f5668066e40 2024-02-17T12:19:27.959 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:27.963 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:19:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 -- 172.21.15.114:0/4143707518 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5668066e40 msgr2=0x7f5668069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5668066e40 0x7f5668069300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f56880c8380 tx=0x7f5674008040 comp rx=0 tx=0).stop 2024-02-17T12:19:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 -- 172.21.15.114:0/4143707518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 msgr2=0x7f5688148df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 0x7f5688148df0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f567c012540 tx=0x7f567c012a00 comp rx=0 tx=0).stop 2024-02-17T12:19:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 -- 172.21.15.114:0/4143707518 shutdown_connections 2024-02-17T12:19:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f56880c1d10 0x7f56881edb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5688150aa0 0x7f56880c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5668066e40 0x7f5668069300 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 --2- 172.21.15.114:0/4143707518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5670004d10 0x7f5688148df0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:27.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 -- 172.21.15.114:0/4143707518 >> 172.21.15.114:0/4143707518 conn(0x7f568806ed70 msgr2=0x7f568814c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:27.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 -- 172.21.15.114:0/4143707518 shutdown_connections 2024-02-17T12:19:27.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:27.956+0000 7f568e200640 1 -- 172.21.15.114:0/4143707518 wait complete. 2024-02-17T12:19:27.978 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-02-17T12:19:27.255399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596691,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":348,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245120,"kb_used_data":8112,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729600,"statfs":{"total":773094113280,"available":772843110400,"internally_reserved":0,"allocated":8306688,"data_stored":4292444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001350"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374764+0000","last_change":"2024-02-17T12:19:22.372866+0000","last_active":"2024-02-17T12:19:23.374764+0000","last_peered":"2024-02-17T12:19:23.374764+0000","last_clean":"2024-02-17T12:19:23.374764+0000","last_became_active":"2024-02-17T12:19:22.367866+0000","last_became_peered":"2024-02-17T12:19:22.367866+0000","last_unstale":"2024-02-17T12:19:23.374764+0000","last_undegraded":"2024-02-17T12:19:23.374764+0000","last_fullsized":"2024-02-17T12:19:23.374764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:09:24.409975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536287+0000","last_change":"2024-02-17T12:19:04.712400+0000","last_active":"2024-02-17T12:19:23.536287+0000","last_peered":"2024-02-17T12:19:23.536287+0000","last_clean":"2024-02-17T12:19:23.536287+0000","last_became_active":"2024-02-17T12:19:04.711598+0000","last_became_peered":"2024-02-17T12:19:04.711598+0000","last_unstale":"2024-02-17T12:19:23.536287+0000","last_undegraded":"2024-02-17T12:19:23.536287+0000","last_fullsized":"2024-02-17T12:19:23.536287+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:02.628891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537250+0000","last_change":"2024-02-17T12:19:22.376081+0000","last_active":"2024-02-17T12:19:23.537250+0000","last_peered":"2024-02-17T12:19:23.537250+0000","last_clean":"2024-02-17T12:19:23.537250+0000","last_became_active":"2024-02-17T12:19:22.373107+0000","last_became_peered":"2024-02-17T12:19:22.373107+0000","last_unstale":"2024-02-17T12:19:23.537250+0000","last_undegraded":"2024-02-17T12:19:23.537250+0000","last_fullsized":"2024-02-17T12:19:23.537250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:07:54.942290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375063+0000","last_change":"2024-02-17T12:19:04.723008+0000","last_active":"2024-02-17T12:19:23.375063+0000","last_peered":"2024-02-17T12:19:23.375063+0000","last_clean":"2024-02-17T12:19:23.375063+0000","last_became_active":"2024-02-17T12:19:04.722730+0000","last_became_peered":"2024-02-17T12:19:04.722730+0000","last_unstale":"2024-02-17T12:19:23.375063+0000","last_undegraded":"2024-02-17T12:19:23.375063+0000","last_fullsized":"2024-02-17T12:19:23.375063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:43.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375043+0000","last_change":"2024-02-17T12:19:22.376699+0000","last_active":"2024-02-17T12:19:23.375043+0000","last_peered":"2024-02-17T12:19:23.375043+0000","last_clean":"2024-02-17T12:19:23.375043+0000","last_became_active":"2024-02-17T12:19:22.375901+0000","last_became_peered":"2024-02-17T12:19:22.375901+0000","last_unstale":"2024-02-17T12:19:23.375043+0000","last_undegraded":"2024-02-17T12:19:23.375043+0000","last_fullsized":"2024-02-17T12:19:23.375043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:40.154535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537537+0000","last_change":"2024-02-17T12:19:04.710193+0000","last_active":"2024-02-17T12:19:23.537537+0000","last_peered":"2024-02-17T12:19:23.537537+0000","last_clean":"2024-02-17T12:19:23.537537+0000","last_became_active":"2024-02-17T12:19:04.709527+0000","last_became_peered":"2024-02-17T12:19:04.709527+0000","last_unstale":"2024-02-17T12:19:23.537537+0000","last_undegraded":"2024-02-17T12:19:23.537537+0000","last_fullsized":"2024-02-17T12:19:23.537537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:10:56.143323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536961+0000","last_change":"2024-02-17T12:19:22.361226+0000","last_active":"2024-02-17T12:19:23.536961+0000","last_peered":"2024-02-17T12:19:23.536961+0000","last_clean":"2024-02-17T12:19:23.536961+0000","last_became_active":"2024-02-17T12:19:22.360955+0000","last_became_peered":"2024-02-17T12:19:22.360955+0000","last_unstale":"2024-02-17T12:19:23.536961+0000","last_undegraded":"2024-02-17T12:19:23.536961+0000","last_fullsized":"2024-02-17T12:19:23.536961+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:16:00.710300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537666+0000","last_change":"2024-02-17T12:19:04.728530+0000","last_active":"2024-02-17T12:19:23.537666+0000","last_peered":"2024-02-17T12:19:23.537666+0000","last_clean":"2024-02-17T12:19:23.537666+0000","last_became_active":"2024-02-17T12:19:04.728245+0000","last_became_peered":"2024-02-17T12:19:04.728245+0000","last_unstale":"2024-02-17T12:19:23.537666+0000","last_undegraded":"2024-02-17T12:19:23.537666+0000","last_fullsized":"2024-02-17T12:19:23.537666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:22.116393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535753+0000","last_change":"2024-02-17T12:19:22.369693+0000","last_active":"2024-02-17T12:19:23.535753+0000","last_peered":"2024-02-17T12:19:23.535753+0000","last_clean":"2024-02-17T12:19:23.535753+0000","last_became_active":"2024-02-17T12:19:22.368141+0000","last_became_peered":"2024-02-17T12:19:22.368141+0000","last_unstale":"2024-02-17T12:19:23.535753+0000","last_undegraded":"2024-02-17T12:19:23.535753+0000","last_fullsized":"2024-02-17T12:19:23.535753+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:16.792200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380238+0000","last_change":"2024-02-17T12:19:04.727165+0000","last_active":"2024-02-17T12:19:23.380238+0000","last_peered":"2024-02-17T12:19:23.380238+0000","last_clean":"2024-02-17T12:19:23.380238+0000","last_became_active":"2024-02-17T12:19:04.726850+0000","last_became_peered":"2024-02-17T12:19:04.726850+0000","last_unstale":"2024-02-17T12:19:23.380238+0000","last_undegraded":"2024-02-17T12:19:23.380238+0000","last_fullsized":"2024-02-17T12:19:23.380238+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:54.875823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537084+0000","last_change":"2024-02-17T12:19:22.368525+0000","last_active":"2024-02-17T12:19:23.537084+0000","last_peered":"2024-02-17T12:19:23.537084+0000","last_clean":"2024-02-17T12:19:23.537084+0000","last_became_active":"2024-02-17T12:19:22.368202+0000","last_became_peered":"2024-02-17T12:19:22.368202+0000","last_unstale":"2024-02-17T12:19:23.537084+0000","last_undegraded":"2024-02-17T12:19:23.537084+0000","last_fullsized":"2024-02-17T12:19:23.537084+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:06:13.563565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379920+0000","last_change":"2024-02-17T12:19:04.713676+0000","last_active":"2024-02-17T12:19:23.379920+0000","last_peered":"2024-02-17T12:19:23.379920+0000","last_clean":"2024-02-17T12:19:23.379920+0000","last_became_active":"2024-02-17T12:19:04.710032+0000","last_became_peered":"2024-02-17T12:19:04.710032+0000","last_unstale":"2024-02-17T12:19:23.379920+0000","last_undegraded":"2024-02-17T12:19:23.379920+0000","last_fullsized":"2024-02-17T12:19:23.379920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536228+0000","last_change":"2024-02-17T12:19:22.388054+0000","last_active":"2024-02-17T12:19:23.536228+0000","last_peered":"2024-02-17T12:19:23.536228+0000","last_clean":"2024-02-17T12:19:23.536228+0000","last_became_active":"2024-02-17T12:19:22.387745+0000","last_became_peered":"2024-02-17T12:19:22.387745+0000","last_unstale":"2024-02-17T12:19:23.536228+0000","last_undegraded":"2024-02-17T12:19:23.536228+0000","last_fullsized":"2024-02-17T12:19:23.536228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:59:13.071369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536303+0000","last_change":"2024-02-17T12:19:04.714280+0000","last_active":"2024-02-17T12:19:23.536303+0000","last_peered":"2024-02-17T12:19:23.536303+0000","last_clean":"2024-02-17T12:19:23.536303+0000","last_became_active":"2024-02-17T12:19:04.714025+0000","last_became_peered":"2024-02-17T12:19:04.714025+0000","last_unstale":"2024-02-17T12:19:23.536303+0000","last_undegraded":"2024-02-17T12:19:23.536303+0000","last_fullsized":"2024-02-17T12:19:23.536303+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:04:31.444208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536568+0000","last_change":"2024-02-17T12:19:22.376606+0000","last_active":"2024-02-17T12:19:23.536568+0000","last_peered":"2024-02-17T12:19:23.536568+0000","last_clean":"2024-02-17T12:19:23.536568+0000","last_became_active":"2024-02-17T12:19:22.375794+0000","last_became_peered":"2024-02-17T12:19:22.375794+0000","last_unstale":"2024-02-17T12:19:23.536568+0000","last_undegraded":"2024-02-17T12:19:23.536568+0000","last_fullsized":"2024-02-17T12:19:23.536568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:41:26.244504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379190+0000","last_change":"2024-02-17T12:19:04.716344+0000","last_active":"2024-02-17T12:19:23.379190+0000","last_peered":"2024-02-17T12:19:23.379190+0000","last_clean":"2024-02-17T12:19:23.379190+0000","last_became_active":"2024-02-17T12:19:04.716003+0000","last_became_peered":"2024-02-17T12:19:04.716003+0000","last_unstale":"2024-02-17T12:19:23.379190+0000","last_undegraded":"2024-02-17T12:19:23.379190+0000","last_fullsized":"2024-02-17T12:19:23.379190+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:37.092834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537290+0000","last_change":"2024-02-17T12:19:22.380385+0000","last_active":"2024-02-17T12:19:23.537290+0000","last_peered":"2024-02-17T12:19:23.537290+0000","last_clean":"2024-02-17T12:19:23.537290+0000","last_became_active":"2024-02-17T12:19:22.380030+0000","last_became_peered":"2024-02-17T12:19:22.380030+0000","last_unstale":"2024-02-17T12:19:23.537290+0000","last_undegraded":"2024-02-17T12:19:23.537290+0000","last_fullsized":"2024-02-17T12:19:23.537290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:33:39.599699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380107+0000","last_change":"2024-02-17T12:19:04.705511+0000","last_active":"2024-02-17T12:19:23.380107+0000","last_peered":"2024-02-17T12:19:23.380107+0000","last_clean":"2024-02-17T12:19:23.380107+0000","last_became_active":"2024-02-17T12:19:04.705195+0000","last_became_peered":"2024-02-17T12:19:04.705195+0000","last_unstale":"2024-02-17T12:19:23.380107+0000","last_undegraded":"2024-02-17T12:19:23.380107+0000","last_fullsized":"2024-02-17T12:19:23.380107+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380515+0000","last_change":"2024-02-17T12:19:22.376957+0000","last_active":"2024-02-17T12:19:23.380515+0000","last_peered":"2024-02-17T12:19:23.380515+0000","last_clean":"2024-02-17T12:19:23.380515+0000","last_became_active":"2024-02-17T12:19:22.375810+0000","last_became_peered":"2024-02-17T12:19:22.375810+0000","last_unstale":"2024-02-17T12:19:23.380515+0000","last_undegraded":"2024-02-17T12:19:23.380515+0000","last_fullsized":"2024-02-17T12:19:23.380515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:06:06.364890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537313+0000","last_change":"2024-02-17T12:19:04.721693+0000","last_active":"2024-02-17T12:19:23.537313+0000","last_peered":"2024-02-17T12:19:23.537313+0000","last_clean":"2024-02-17T12:19:23.537313+0000","last_became_active":"2024-02-17T12:19:04.721343+0000","last_became_peered":"2024-02-17T12:19:04.721343+0000","last_unstale":"2024-02-17T12:19:23.537313+0000","last_undegraded":"2024-02-17T12:19:23.537313+0000","last_fullsized":"2024-02-17T12:19:23.537313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:38.425090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381058+0000","last_change":"2024-02-17T12:19:22.370504+0000","last_active":"2024-02-17T12:19:23.381058+0000","last_peered":"2024-02-17T12:19:23.381058+0000","last_clean":"2024-02-17T12:19:23.381058+0000","last_became_active":"2024-02-17T12:19:22.370262+0000","last_became_peered":"2024-02-17T12:19:22.370262+0000","last_unstale":"2024-02-17T12:19:23.381058+0000","last_undegraded":"2024-02-17T12:19:23.381058+0000","last_fullsized":"2024-02-17T12:19:23.381058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:43:12.017524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374854+0000","last_change":"2024-02-17T12:19:04.717487+0000","last_active":"2024-02-17T12:19:23.374854+0000","last_peered":"2024-02-17T12:19:23.374854+0000","last_clean":"2024-02-17T12:19:23.374854+0000","last_became_active":"2024-02-17T12:19:04.717208+0000","last_became_peered":"2024-02-17T12:19:04.717208+0000","last_unstale":"2024-02-17T12:19:23.374854+0000","last_undegraded":"2024-02-17T12:19:23.374854+0000","last_fullsized":"2024-02-17T12:19:23.374854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:36:18.116201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537182+0000","last_change":"2024-02-17T12:19:22.381136+0000","last_active":"2024-02-17T12:19:23.537182+0000","last_peered":"2024-02-17T12:19:23.537182+0000","last_clean":"2024-02-17T12:19:23.537182+0000","last_became_active":"2024-02-17T12:19:22.379997+0000","last_became_peered":"2024-02-17T12:19:22.379997+0000","last_unstale":"2024-02-17T12:19:23.537182+0000","last_undegraded":"2024-02-17T12:19:23.537182+0000","last_fullsized":"2024-02-17T12:19:23.537182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:07:54.942290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536256+0000","last_change":"2024-02-17T12:19:04.720687+0000","last_active":"2024-02-17T12:19:23.536256+0000","last_peered":"2024-02-17T12:19:23.536256+0000","last_clean":"2024-02-17T12:19:23.536256+0000","last_became_active":"2024-02-17T12:19:04.720429+0000","last_became_peered":"2024-02-17T12:19:04.720429+0000","last_unstale":"2024-02-17T12:19:23.536256+0000","last_undegraded":"2024-02-17T12:19:23.536256+0000","last_fullsized":"2024-02-17T12:19:23.536256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:13:30.982744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536240+0000","last_change":"2024-02-17T12:19:22.368923+0000","last_active":"2024-02-17T12:19:23.536240+0000","last_peered":"2024-02-17T12:19:23.536240+0000","last_clean":"2024-02-17T12:19:23.536240+0000","last_became_active":"2024-02-17T12:19:22.368664+0000","last_became_peered":"2024-02-17T12:19:22.368664+0000","last_unstale":"2024-02-17T12:19:23.536240+0000","last_undegraded":"2024-02-17T12:19:23.536240+0000","last_fullsized":"2024-02-17T12:19:23.536240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:05.733697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536857+0000","last_change":"2024-02-17T12:19:04.711936+0000","last_active":"2024-02-17T12:19:23.536857+0000","last_peered":"2024-02-17T12:19:23.536857+0000","last_clean":"2024-02-17T12:19:23.536857+0000","last_became_active":"2024-02-17T12:19:04.711624+0000","last_became_peered":"2024-02-17T12:19:04.711624+0000","last_unstale":"2024-02-17T12:19:23.536857+0000","last_undegraded":"2024-02-17T12:19:23.536857+0000","last_fullsized":"2024-02-17T12:19:23.536857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:55.448178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535626+0000","last_change":"2024-02-17T12:19:22.375472+0000","last_active":"2024-02-17T12:19:23.535626+0000","last_peered":"2024-02-17T12:19:23.535626+0000","last_clean":"2024-02-17T12:19:23.535626+0000","last_became_active":"2024-02-17T12:19:22.375196+0000","last_became_peered":"2024-02-17T12:19:22.375196+0000","last_unstale":"2024-02-17T12:19:23.535626+0000","last_undegraded":"2024-02-17T12:19:23.535626+0000","last_fullsized":"2024-02-17T12:19:23.535626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:17.057488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538389+0000","last_change":"2024-02-17T12:19:04.728727+0000","last_active":"2024-02-17T12:19:23.538389+0000","last_peered":"2024-02-17T12:19:23.538389+0000","last_clean":"2024-02-17T12:19:23.538389+0000","last_became_active":"2024-02-17T12:19:04.728194+0000","last_became_peered":"2024-02-17T12:19:04.728194+0000","last_unstale":"2024-02-17T12:19:23.538389+0000","last_undegraded":"2024-02-17T12:19:23.538389+0000","last_fullsized":"2024-02-17T12:19:23.538389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:07:54.785092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537771+0000","last_change":"2024-02-17T12:19:22.385290+0000","last_active":"2024-02-17T12:19:23.537771+0000","last_peered":"2024-02-17T12:19:23.537771+0000","last_clean":"2024-02-17T12:19:23.537771+0000","last_became_active":"2024-02-17T12:19:22.385011+0000","last_became_peered":"2024-02-17T12:19:22.385011+0000","last_unstale":"2024-02-17T12:19:23.537771+0000","last_undegraded":"2024-02-17T12:19:23.537771+0000","last_fullsized":"2024-02-17T12:19:23.537771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:52:59.929878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536295+0000","last_change":"2024-02-17T12:19:04.710789+0000","last_active":"2024-02-17T12:19:23.536295+0000","last_peered":"2024-02-17T12:19:23.536295+0000","last_clean":"2024-02-17T12:19:23.536295+0000","last_became_active":"2024-02-17T12:19:04.710321+0000","last_became_peered":"2024-02-17T12:19:04.710321+0000","last_unstale":"2024-02-17T12:19:23.536295+0000","last_undegraded":"2024-02-17T12:19:23.536295+0000","last_fullsized":"2024-02-17T12:19:23.536295+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:20.439350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537575+0000","last_change":"2024-02-17T12:19:22.389161+0000","last_active":"2024-02-17T12:19:23.537575+0000","last_peered":"2024-02-17T12:19:23.537575+0000","last_clean":"2024-02-17T12:19:23.537575+0000","last_became_active":"2024-02-17T12:19:22.388885+0000","last_became_peered":"2024-02-17T12:19:22.388885+0000","last_unstale":"2024-02-17T12:19:23.537575+0000","last_undegraded":"2024-02-17T12:19:23.537575+0000","last_fullsized":"2024-02-17T12:19:23.537575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:32.525943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379396+0000","last_change":"2024-02-17T12:19:04.714567+0000","last_active":"2024-02-17T12:19:23.379396+0000","last_peered":"2024-02-17T12:19:23.379396+0000","last_clean":"2024-02-17T12:19:23.379396+0000","last_became_active":"2024-02-17T12:19:04.714283+0000","last_became_peered":"2024-02-17T12:19:04.714283+0000","last_unstale":"2024-02-17T12:19:23.379396+0000","last_undegraded":"2024-02-17T12:19:23.379396+0000","last_fullsized":"2024-02-17T12:19:23.379396+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:36.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537786+0000","last_change":"2024-02-17T12:19:22.388259+0000","last_active":"2024-02-17T12:19:23.537786+0000","last_peered":"2024-02-17T12:19:23.537786+0000","last_clean":"2024-02-17T12:19:23.537786+0000","last_became_active":"2024-02-17T12:19:22.387822+0000","last_became_peered":"2024-02-17T12:19:22.387822+0000","last_unstale":"2024-02-17T12:19:23.537786+0000","last_undegraded":"2024-02-17T12:19:23.537786+0000","last_fullsized":"2024-02-17T12:19:23.537786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:23.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381171+0000","last_change":"2024-02-17T12:19:04.707760+0000","last_active":"2024-02-17T12:19:23.381171+0000","last_peered":"2024-02-17T12:19:23.381171+0000","last_clean":"2024-02-17T12:19:23.381171+0000","last_became_active":"2024-02-17T12:19:04.707499+0000","last_became_peered":"2024-02-17T12:19:04.707499+0000","last_unstale":"2024-02-17T12:19:23.381171+0000","last_undegraded":"2024-02-17T12:19:23.381171+0000","last_fullsized":"2024-02-17T12:19:23.381171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:24:01.313056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380698+0000","last_change":"2024-02-17T12:19:22.378610+0000","last_active":"2024-02-17T12:19:23.380698+0000","last_peered":"2024-02-17T12:19:23.380698+0000","last_clean":"2024-02-17T12:19:23.380698+0000","last_became_active":"2024-02-17T12:19:22.377368+0000","last_became_peered":"2024-02-17T12:19:22.377368+0000","last_unstale":"2024-02-17T12:19:23.380698+0000","last_undegraded":"2024-02-17T12:19:23.380698+0000","last_fullsized":"2024-02-17T12:19:23.380698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:32.414191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538289+0000","last_change":"2024-02-17T12:19:04.710944+0000","last_active":"2024-02-17T12:19:23.538289+0000","last_peered":"2024-02-17T12:19:23.538289+0000","last_clean":"2024-02-17T12:19:23.538289+0000","last_became_active":"2024-02-17T12:19:04.710625+0000","last_became_peered":"2024-02-17T12:19:04.710625+0000","last_unstale":"2024-02-17T12:19:23.538289+0000","last_undegraded":"2024-02-17T12:19:23.538289+0000","last_fullsized":"2024-02-17T12:19:23.538289+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:22:57.157645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537050+0000","last_change":"2024-02-17T12:19:22.367671+0000","last_active":"2024-02-17T12:19:23.537050+0000","last_peered":"2024-02-17T12:19:23.537050+0000","last_clean":"2024-02-17T12:19:23.537050+0000","last_became_active":"2024-02-17T12:19:22.367444+0000","last_became_peered":"2024-02-17T12:19:22.367444+0000","last_unstale":"2024-02-17T12:19:23.537050+0000","last_undegraded":"2024-02-17T12:19:23.537050+0000","last_fullsized":"2024-02-17T12:19:23.537050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:05.733697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536778+0000","last_change":"2024-02-17T12:19:04.718758+0000","last_active":"2024-02-17T12:19:23.536778+0000","last_peered":"2024-02-17T12:19:23.536778+0000","last_clean":"2024-02-17T12:19:23.536778+0000","last_became_active":"2024-02-17T12:19:04.718486+0000","last_became_peered":"2024-02-17T12:19:04.718486+0000","last_unstale":"2024-02-17T12:19:23.536778+0000","last_undegraded":"2024-02-17T12:19:23.536778+0000","last_fullsized":"2024-02-17T12:19:23.536778+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.895909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537294+0000","last_change":"2024-02-17T12:19:22.385130+0000","last_active":"2024-02-17T12:19:23.537294+0000","last_peered":"2024-02-17T12:19:23.537294+0000","last_clean":"2024-02-17T12:19:23.537294+0000","last_became_active":"2024-02-17T12:19:22.384885+0000","last_became_peered":"2024-02-17T12:19:22.384885+0000","last_unstale":"2024-02-17T12:19:23.537294+0000","last_undegraded":"2024-02-17T12:19:23.537294+0000","last_fullsized":"2024-02-17T12:19:23.537294+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:35:45.209068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537775+0000","last_change":"2024-02-17T12:19:04.714461+0000","last_active":"2024-02-17T12:19:23.537775+0000","last_peered":"2024-02-17T12:19:23.537775+0000","last_clean":"2024-02-17T12:19:23.537775+0000","last_became_active":"2024-02-17T12:19:04.714208+0000","last_became_peered":"2024-02-17T12:19:04.714208+0000","last_unstale":"2024-02-17T12:19:23.537775+0000","last_undegraded":"2024-02-17T12:19:23.537775+0000","last_fullsized":"2024-02-17T12:19:23.537775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:45.424685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535652+0000","last_change":"2024-02-17T12:19:22.365696+0000","last_active":"2024-02-17T12:19:23.535652+0000","last_peered":"2024-02-17T12:19:23.535652+0000","last_clean":"2024-02-17T12:19:23.535652+0000","last_became_active":"2024-02-17T12:19:22.365394+0000","last_became_peered":"2024-02-17T12:19:22.365394+0000","last_unstale":"2024-02-17T12:19:23.535652+0000","last_undegraded":"2024-02-17T12:19:23.535652+0000","last_fullsized":"2024-02-17T12:19:23.535652+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:55:55.797745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538193+0000","last_change":"2024-02-17T12:19:04.722346+0000","last_active":"2024-02-17T12:19:23.538193+0000","last_peered":"2024-02-17T12:19:23.538193+0000","last_clean":"2024-02-17T12:19:23.538193+0000","last_became_active":"2024-02-17T12:19:04.722106+0000","last_became_peered":"2024-02-17T12:19:04.722106+0000","last_unstale":"2024-02-17T12:19:23.538193+0000","last_undegraded":"2024-02-17T12:19:23.538193+0000","last_fullsized":"2024-02-17T12:19:23.538193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:11.976571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535907+0000","last_change":"2024-02-17T12:19:22.372825+0000","last_active":"2024-02-17T12:19:23.535907+0000","last_peered":"2024-02-17T12:19:23.535907+0000","last_clean":"2024-02-17T12:19:23.535907+0000","last_became_active":"2024-02-17T12:19:22.372503+0000","last_became_peered":"2024-02-17T12:19:22.372503+0000","last_unstale":"2024-02-17T12:19:23.535907+0000","last_undegraded":"2024-02-17T12:19:23.535907+0000","last_fullsized":"2024-02-17T12:19:23.535907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:52:37.591482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374470+0000","last_change":"2024-02-17T12:19:04.720604+0000","last_active":"2024-02-17T12:19:23.374470+0000","last_peered":"2024-02-17T12:19:23.374470+0000","last_clean":"2024-02-17T12:19:23.374470+0000","last_became_active":"2024-02-17T12:19:04.720350+0000","last_became_peered":"2024-02-17T12:19:04.720350+0000","last_unstale":"2024-02-17T12:19:23.374470+0000","last_undegraded":"2024-02-17T12:19:23.374470+0000","last_fullsized":"2024-02-17T12:19:23.374470+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:21.365282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537757+0000","last_change":"2024-02-17T12:19:22.380747+0000","last_active":"2024-02-17T12:19:23.537757+0000","last_peered":"2024-02-17T12:19:23.537757+0000","last_clean":"2024-02-17T12:19:23.537757+0000","last_became_active":"2024-02-17T12:19:22.380112+0000","last_became_peered":"2024-02-17T12:19:22.380112+0000","last_unstale":"2024-02-17T12:19:23.537757+0000","last_undegraded":"2024-02-17T12:19:23.537757+0000","last_fullsized":"2024-02-17T12:19:23.537757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:49:12.538531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536587+0000","last_change":"2024-02-17T12:19:04.716818+0000","last_active":"2024-02-17T12:19:23.536587+0000","last_peered":"2024-02-17T12:19:23.536587+0000","last_clean":"2024-02-17T12:19:23.536587+0000","last_became_active":"2024-02-17T12:19:04.716507+0000","last_became_peered":"2024-02-17T12:19:04.716507+0000","last_unstale":"2024-02-17T12:19:23.536587+0000","last_undegraded":"2024-02-17T12:19:23.536587+0000","last_fullsized":"2024-02-17T12:19:23.536587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:56:16.543982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536058+0000","last_change":"2024-02-17T12:19:22.362093+0000","last_active":"2024-02-17T12:19:23.536058+0000","last_peered":"2024-02-17T12:19:23.536058+0000","last_clean":"2024-02-17T12:19:23.536058+0000","last_became_active":"2024-02-17T12:19:22.361819+0000","last_became_peered":"2024-02-17T12:19:22.361819+0000","last_unstale":"2024-02-17T12:19:23.536058+0000","last_undegraded":"2024-02-17T12:19:23.536058+0000","last_fullsized":"2024-02-17T12:19:23.536058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:18:04.816919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536132+0000","last_change":"2024-02-17T12:19:04.708458+0000","last_active":"2024-02-17T12:19:23.536132+0000","last_peered":"2024-02-17T12:19:23.536132+0000","last_clean":"2024-02-17T12:19:23.536132+0000","last_became_active":"2024-02-17T12:19:04.708170+0000","last_became_peered":"2024-02-17T12:19:04.708170+0000","last_unstale":"2024-02-17T12:19:23.536132+0000","last_undegraded":"2024-02-17T12:19:23.536132+0000","last_fullsized":"2024-02-17T12:19:23.536132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:57.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537653+0000","last_change":"2024-02-17T12:19:22.380274+0000","last_active":"2024-02-17T12:19:23.537653+0000","last_peered":"2024-02-17T12:19:23.537653+0000","last_clean":"2024-02-17T12:19:23.537653+0000","last_became_active":"2024-02-17T12:19:22.379913+0000","last_became_peered":"2024-02-17T12:19:22.379913+0000","last_unstale":"2024-02-17T12:19:23.537653+0000","last_undegraded":"2024-02-17T12:19:23.537653+0000","last_fullsized":"2024-02-17T12:19:23.537653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:33:02.035794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375166+0000","last_change":"2024-02-17T12:19:04.726126+0000","last_active":"2024-02-17T12:19:23.375166+0000","last_peered":"2024-02-17T12:19:23.375166+0000","last_clean":"2024-02-17T12:19:23.375166+0000","last_became_active":"2024-02-17T12:19:04.725344+0000","last_became_peered":"2024-02-17T12:19:04.725344+0000","last_unstale":"2024-02-17T12:19:23.375166+0000","last_undegraded":"2024-02-17T12:19:23.375166+0000","last_fullsized":"2024-02-17T12:19:23.375166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:08:29.699648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536909+0000","last_change":"2024-02-17T12:19:22.392188+0000","last_active":"2024-02-17T12:19:23.536909+0000","last_peered":"2024-02-17T12:19:23.536909+0000","last_clean":"2024-02-17T12:19:23.536909+0000","last_became_active":"2024-02-17T12:19:22.391851+0000","last_became_peered":"2024-02-17T12:19:22.391851+0000","last_unstale":"2024-02-17T12:19:23.536909+0000","last_undegraded":"2024-02-17T12:19:23.536909+0000","last_fullsized":"2024-02-17T12:19:23.536909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:18:00.473789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537028+0000","last_change":"2024-02-17T12:19:04.725988+0000","last_active":"2024-02-17T12:19:23.537028+0000","last_peered":"2024-02-17T12:19:23.537028+0000","last_clean":"2024-02-17T12:19:23.537028+0000","last_became_active":"2024-02-17T12:19:04.725703+0000","last_became_peered":"2024-02-17T12:19:04.725703+0000","last_unstale":"2024-02-17T12:19:23.537028+0000","last_undegraded":"2024-02-17T12:19:23.537028+0000","last_fullsized":"2024-02-17T12:19:23.537028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:26.113554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536897+0000","last_change":"2024-02-17T12:19:22.386280+0000","last_active":"2024-02-17T12:19:23.536897+0000","last_peered":"2024-02-17T12:19:23.536897+0000","last_clean":"2024-02-17T12:19:23.536897+0000","last_became_active":"2024-02-17T12:19:22.385788+0000","last_became_peered":"2024-02-17T12:19:22.385788+0000","last_unstale":"2024-02-17T12:19:23.536897+0000","last_undegraded":"2024-02-17T12:19:23.536897+0000","last_fullsized":"2024-02-17T12:19:23.536897+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:52.083369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380518+0000","last_change":"2024-02-17T12:19:04.718744+0000","last_active":"2024-02-17T12:19:23.380518+0000","last_peered":"2024-02-17T12:19:23.380518+0000","last_clean":"2024-02-17T12:19:23.380518+0000","last_became_active":"2024-02-17T12:19:04.717669+0000","last_became_peered":"2024-02-17T12:19:04.717669+0000","last_unstale":"2024-02-17T12:19:23.380518+0000","last_undegraded":"2024-02-17T12:19:23.380518+0000","last_fullsized":"2024-02-17T12:19:23.380518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:15.849867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537162+0000","last_change":"2024-02-17T12:19:22.364774+0000","last_active":"2024-02-17T12:19:23.537162+0000","last_peered":"2024-02-17T12:19:23.537162+0000","last_clean":"2024-02-17T12:19:23.537162+0000","last_became_active":"2024-02-17T12:19:22.364508+0000","last_became_peered":"2024-02-17T12:19:22.364508+0000","last_unstale":"2024-02-17T12:19:23.537162+0000","last_undegraded":"2024-02-17T12:19:23.537162+0000","last_fullsized":"2024-02-17T12:19:23.537162+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:22:35.457951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536644+0000","last_change":"2024-02-17T12:19:04.713023+0000","last_active":"2024-02-17T12:19:23.536644+0000","last_peered":"2024-02-17T12:19:23.536644+0000","last_clean":"2024-02-17T12:19:23.536644+0000","last_became_active":"2024-02-17T12:19:04.712535+0000","last_became_peered":"2024-02-17T12:19:04.712535+0000","last_unstale":"2024-02-17T12:19:23.536644+0000","last_undegraded":"2024-02-17T12:19:23.536644+0000","last_fullsized":"2024-02-17T12:19:23.536644+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:59.570840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536474+0000","last_change":"2024-02-17T12:19:22.384348+0000","last_active":"2024-02-17T12:19:23.536474+0000","last_peered":"2024-02-17T12:19:23.536474+0000","last_clean":"2024-02-17T12:19:23.536474+0000","last_became_active":"2024-02-17T12:19:22.384089+0000","last_became_peered":"2024-02-17T12:19:22.384089+0000","last_unstale":"2024-02-17T12:19:23.536474+0000","last_undegraded":"2024-02-17T12:19:23.536474+0000","last_fullsized":"2024-02-17T12:19:23.536474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:22:35.457951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374363+0000","last_change":"2024-02-17T12:19:04.721331+0000","last_active":"2024-02-17T12:19:23.374363+0000","last_peered":"2024-02-17T12:19:23.374363+0000","last_clean":"2024-02-17T12:19:23.374363+0000","last_became_active":"2024-02-17T12:19:04.721066+0000","last_became_peered":"2024-02-17T12:19:04.721066+0000","last_unstale":"2024-02-17T12:19:23.374363+0000","last_undegraded":"2024-02-17T12:19:23.374363+0000","last_fullsized":"2024-02-17T12:19:23.374363+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:49:57.305678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374098+0000","last_change":"2024-02-17T12:19:22.374576+0000","last_active":"2024-02-17T12:19:23.374098+0000","last_peered":"2024-02-17T12:19:23.374098+0000","last_clean":"2024-02-17T12:19:23.374098+0000","last_became_active":"2024-02-17T12:19:22.370327+0000","last_became_peered":"2024-02-17T12:19:22.370327+0000","last_unstale":"2024-02-17T12:19:23.374098+0000","last_undegraded":"2024-02-17T12:19:23.374098+0000","last_fullsized":"2024-02-17T12:19:23.374098+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:44.686107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374503+0000","last_change":"2024-02-17T12:19:04.726119+0000","last_active":"2024-02-17T12:19:23.374503+0000","last_peered":"2024-02-17T12:19:23.374503+0000","last_clean":"2024-02-17T12:19:23.374503+0000","last_became_active":"2024-02-17T12:19:04.725509+0000","last_became_peered":"2024-02-17T12:19:04.725509+0000","last_unstale":"2024-02-17T12:19:23.374503+0000","last_undegraded":"2024-02-17T12:19:23.374503+0000","last_fullsized":"2024-02-17T12:19:23.374503+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:56.501011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536690+0000","last_change":"2024-02-17T12:19:22.373666+0000","last_active":"2024-02-17T12:19:23.536690+0000","last_peered":"2024-02-17T12:19:23.536690+0000","last_clean":"2024-02-17T12:19:23.536690+0000","last_became_active":"2024-02-17T12:19:22.367569+0000","last_became_peered":"2024-02-17T12:19:22.367569+0000","last_unstale":"2024-02-17T12:19:23.536690+0000","last_undegraded":"2024-02-17T12:19:23.536690+0000","last_fullsized":"2024-02-17T12:19:23.536690+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:37:38.428413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380391+0000","last_change":"2024-02-17T12:19:04.706739+0000","last_active":"2024-02-17T12:19:23.380391+0000","last_peered":"2024-02-17T12:19:23.380391+0000","last_clean":"2024-02-17T12:19:23.380391+0000","last_became_active":"2024-02-17T12:19:04.706454+0000","last_became_peered":"2024-02-17T12:19:04.706454+0000","last_unstale":"2024-02-17T12:19:23.380391+0000","last_undegraded":"2024-02-17T12:19:23.380391+0000","last_fullsized":"2024-02-17T12:19:23.380391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:14.863236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538605+0000","last_change":"2024-02-17T12:19:22.382789+0000","last_active":"2024-02-17T12:19:23.538605+0000","last_peered":"2024-02-17T12:19:23.538605+0000","last_clean":"2024-02-17T12:19:23.538605+0000","last_became_active":"2024-02-17T12:19:22.382329+0000","last_became_peered":"2024-02-17T12:19:22.382329+0000","last_unstale":"2024-02-17T12:19:23.538605+0000","last_undegraded":"2024-02-17T12:19:23.538605+0000","last_fullsized":"2024-02-17T12:19:23.538605+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:32.472749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535528+0000","last_change":"2024-02-17T12:19:04.729805+0000","last_active":"2024-02-17T12:19:23.535528+0000","last_peered":"2024-02-17T12:19:23.535528+0000","last_clean":"2024-02-17T12:19:23.535528+0000","last_became_active":"2024-02-17T12:19:04.729388+0000","last_became_peered":"2024-02-17T12:19:04.729388+0000","last_unstale":"2024-02-17T12:19:23.535528+0000","last_undegraded":"2024-02-17T12:19:23.535528+0000","last_fullsized":"2024-02-17T12:19:23.535528+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:09:06.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374752+0000","last_change":"2024-02-17T12:19:22.379912+0000","last_active":"2024-02-17T12:19:23.374752+0000","last_peered":"2024-02-17T12:19:23.374752+0000","last_clean":"2024-02-17T12:19:23.374752+0000","last_became_active":"2024-02-17T12:19:22.379560+0000","last_became_peered":"2024-02-17T12:19:22.379560+0000","last_unstale":"2024-02-17T12:19:23.374752+0000","last_undegraded":"2024-02-17T12:19:23.374752+0000","last_fullsized":"2024-02-17T12:19:23.374752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:05:14.132326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536723+0000","last_change":"2024-02-17T12:19:21.376471+0000","last_active":"2024-02-17T12:19:23.536723+0000","last_peered":"2024-02-17T12:19:23.536723+0000","last_clean":"2024-02-17T12:19:23.536723+0000","last_became_active":"2024-02-17T12:19:21.375256+0000","last_became_peered":"2024-02-17T12:19:21.375256+0000","last_unstale":"2024-02-17T12:19:23.536723+0000","last_undegraded":"2024-02-17T12:19:23.536723+0000","last_fullsized":"2024-02-17T12:19:23.536723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:15.784953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380519+0000","last_change":"2024-02-17T12:19:04.710643+0000","last_active":"2024-02-17T12:19:23.380519+0000","last_peered":"2024-02-17T12:19:23.380519+0000","last_clean":"2024-02-17T12:19:23.380519+0000","last_became_active":"2024-02-17T12:19:04.709363+0000","last_became_peered":"2024-02-17T12:19:04.709363+0000","last_unstale":"2024-02-17T12:19:23.380519+0000","last_undegraded":"2024-02-17T12:19:23.380519+0000","last_fullsized":"2024-02-17T12:19:23.380519+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:14.810042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536656+0000","last_change":"2024-02-17T12:19:03.709066+0000","last_active":"2024-02-17T12:19:23.536656+0000","last_peered":"2024-02-17T12:19:23.536656+0000","last_clean":"2024-02-17T12:19:23.536656+0000","last_became_active":"2024-02-17T12:19:03.708888+0000","last_became_peered":"2024-02-17T12:19:03.708888+0000","last_unstale":"2024-02-17T12:19:23.536656+0000","last_undegraded":"2024-02-17T12:19:23.536656+0000","last_fullsized":"2024-02-17T12:19:23.536656+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380917+0000","last_change":"2024-02-17T12:19:22.369924+0000","last_active":"2024-02-17T12:19:23.380917+0000","last_peered":"2024-02-17T12:19:23.380917+0000","last_clean":"2024-02-17T12:19:23.380917+0000","last_became_active":"2024-02-17T12:19:22.369681+0000","last_became_peered":"2024-02-17T12:19:22.369681+0000","last_unstale":"2024-02-17T12:19:23.380917+0000","last_undegraded":"2024-02-17T12:19:23.380917+0000","last_fullsized":"2024-02-17T12:19:23.380917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:28.541757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537380+0000","last_change":"2024-02-17T12:19:21.377243+0000","last_active":"2024-02-17T12:19:23.537380+0000","last_peered":"2024-02-17T12:19:23.537380+0000","last_clean":"2024-02-17T12:19:23.537380+0000","last_became_active":"2024-02-17T12:19:21.376701+0000","last_became_peered":"2024-02-17T12:19:21.376701+0000","last_unstale":"2024-02-17T12:19:23.537380+0000","last_undegraded":"2024-02-17T12:19:23.537380+0000","last_fullsized":"2024-02-17T12:19:23.537380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:33:29.544346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536419+0000","last_change":"2024-02-17T12:19:04.718756+0000","last_active":"2024-02-17T12:19:23.536419+0000","last_peered":"2024-02-17T12:19:23.536419+0000","last_clean":"2024-02-17T12:19:23.536419+0000","last_became_active":"2024-02-17T12:19:04.716924+0000","last_became_peered":"2024-02-17T12:19:04.716924+0000","last_unstale":"2024-02-17T12:19:23.536419+0000","last_undegraded":"2024-02-17T12:19:23.536419+0000","last_fullsized":"2024-02-17T12:19:23.536419+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:11.015091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380711+0000","last_change":"2024-02-17T12:19:03.703800+0000","last_active":"2024-02-17T12:19:23.380711+0000","last_peered":"2024-02-17T12:19:23.380711+0000","last_clean":"2024-02-17T12:19:23.380711+0000","last_became_active":"2024-02-17T12:19:03.703402+0000","last_became_peered":"2024-02-17T12:19:03.703402+0000","last_unstale":"2024-02-17T12:19:23.380711+0000","last_undegraded":"2024-02-17T12:19:23.380711+0000","last_fullsized":"2024-02-17T12:19:23.380711+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:37:23.098316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537751+0000","last_change":"2024-02-17T12:19:22.373889+0000","last_active":"2024-02-17T12:19:23.537751+0000","last_peered":"2024-02-17T12:19:23.537751+0000","last_clean":"2024-02-17T12:19:23.537751+0000","last_became_active":"2024-02-17T12:19:22.372667+0000","last_became_peered":"2024-02-17T12:19:22.372667+0000","last_unstale":"2024-02-17T12:19:23.537751+0000","last_undegraded":"2024-02-17T12:19:23.537751+0000","last_fullsized":"2024-02-17T12:19:23.537751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:33.512575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"71'4","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536818+0000","last_change":"2024-02-17T12:19:21.373647+0000","last_active":"2024-02-17T12:19:23.536818+0000","last_peered":"2024-02-17T12:19:23.536818+0000","last_clean":"2024-02-17T12:19:23.536818+0000","last_became_active":"2024-02-17T12:19:21.373244+0000","last_became_peered":"2024-02-17T12:19:21.373244+0000","last_unstale":"2024-02-17T12:19:23.536818+0000","last_undegraded":"2024-02-17T12:19:23.536818+0000","last_fullsized":"2024-02-17T12:19:23.536818+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:17.473904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536967+0000","last_change":"2024-02-17T12:19:04.730207+0000","last_active":"2024-02-17T12:19:23.536967+0000","last_peered":"2024-02-17T12:19:23.536967+0000","last_clean":"2024-02-17T12:19:23.536967+0000","last_became_active":"2024-02-17T12:19:04.729363+0000","last_became_peered":"2024-02-17T12:19:04.729363+0000","last_unstale":"2024-02-17T12:19:23.536967+0000","last_undegraded":"2024-02-17T12:19:23.536967+0000","last_fullsized":"2024-02-17T12:19:23.536967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:32:13.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536876+0000","last_change":"2024-02-17T12:19:03.704331+0000","last_active":"2024-02-17T12:19:23.536876+0000","last_peered":"2024-02-17T12:19:23.536876+0000","last_clean":"2024-02-17T12:19:23.536876+0000","last_became_active":"2024-02-17T12:19:03.704078+0000","last_became_peered":"2024-02-17T12:19:03.704078+0000","last_unstale":"2024-02-17T12:19:23.536876+0000","last_undegraded":"2024-02-17T12:19:23.536876+0000","last_fullsized":"2024-02-17T12:19:23.536876+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536306+0000","last_change":"2024-02-17T12:19:22.379113+0000","last_active":"2024-02-17T12:19:23.536306+0000","last_peered":"2024-02-17T12:19:23.536306+0000","last_clean":"2024-02-17T12:19:23.536306+0000","last_became_active":"2024-02-17T12:19:22.378722+0000","last_became_peered":"2024-02-17T12:19:22.378722+0000","last_unstale":"2024-02-17T12:19:23.536306+0000","last_undegraded":"2024-02-17T12:19:23.536306+0000","last_fullsized":"2024-02-17T12:19:23.536306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:06:13.563565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537210+0000","last_change":"2024-02-17T12:19:21.377375+0000","last_active":"2024-02-17T12:19:23.537210+0000","last_peered":"2024-02-17T12:19:23.537210+0000","last_clean":"2024-02-17T12:19:23.537210+0000","last_became_active":"2024-02-17T12:19:21.377083+0000","last_became_peered":"2024-02-17T12:19:21.377083+0000","last_unstale":"2024-02-17T12:19:23.537210+0000","last_undegraded":"2024-02-17T12:19:23.537210+0000","last_fullsized":"2024-02-17T12:19:23.537210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:53.185121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537641+0000","last_change":"2024-02-17T12:19:04.710438+0000","last_active":"2024-02-17T12:19:23.537641+0000","last_peered":"2024-02-17T12:19:23.537641+0000","last_clean":"2024-02-17T12:19:23.537641+0000","last_became_active":"2024-02-17T12:19:04.709894+0000","last_became_peered":"2024-02-17T12:19:04.709894+0000","last_unstale":"2024-02-17T12:19:23.537641+0000","last_undegraded":"2024-02-17T12:19:23.537641+0000","last_fullsized":"2024-02-17T12:19:23.537641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:44.905808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537500+0000","last_change":"2024-02-17T12:19:03.702411+0000","last_active":"2024-02-17T12:19:23.537500+0000","last_peered":"2024-02-17T12:19:23.537500+0000","last_clean":"2024-02-17T12:19:23.537500+0000","last_became_active":"2024-02-17T12:19:03.702166+0000","last_became_peered":"2024-02-17T12:19:03.702166+0000","last_unstale":"2024-02-17T12:19:23.537500+0000","last_undegraded":"2024-02-17T12:19:23.537500+0000","last_fullsized":"2024-02-17T12:19:23.537500+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535601+0000","last_change":"2024-02-17T12:19:22.375330+0000","last_active":"2024-02-17T12:19:23.535601+0000","last_peered":"2024-02-17T12:19:23.535601+0000","last_clean":"2024-02-17T12:19:23.535601+0000","last_became_active":"2024-02-17T12:19:22.375017+0000","last_became_peered":"2024-02-17T12:19:22.375017+0000","last_unstale":"2024-02-17T12:19:23.535601+0000","last_undegraded":"2024-02-17T12:19:23.535601+0000","last_fullsized":"2024-02-17T12:19:23.535601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:16:00.710300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536507+0000","last_change":"2024-02-17T12:19:21.366120+0000","last_active":"2024-02-17T12:19:23.536507+0000","last_peered":"2024-02-17T12:19:23.536507+0000","last_clean":"2024-02-17T12:19:23.536507+0000","last_became_active":"2024-02-17T12:19:21.365805+0000","last_became_peered":"2024-02-17T12:19:21.365805+0000","last_unstale":"2024-02-17T12:19:23.536507+0000","last_undegraded":"2024-02-17T12:19:23.536507+0000","last_fullsized":"2024-02-17T12:19:23.536507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:02.834283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374608+0000","last_change":"2024-02-17T12:19:04.726343+0000","last_active":"2024-02-17T12:19:23.374608+0000","last_peered":"2024-02-17T12:19:23.374608+0000","last_clean":"2024-02-17T12:19:23.374608+0000","last_became_active":"2024-02-17T12:19:04.725870+0000","last_became_peered":"2024-02-17T12:19:04.725870+0000","last_unstale":"2024-02-17T12:19:23.374608+0000","last_undegraded":"2024-02-17T12:19:23.374608+0000","last_fullsized":"2024-02-17T12:19:23.374608+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:27:42.531689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380548+0000","last_change":"2024-02-17T12:19:03.703159+0000","last_active":"2024-02-17T12:19:23.380548+0000","last_peered":"2024-02-17T12:19:23.380548+0000","last_clean":"2024-02-17T12:19:23.380548+0000","last_became_active":"2024-02-17T12:19:03.702811+0000","last_became_peered":"2024-02-17T12:19:03.702811+0000","last_unstale":"2024-02-17T12:19:23.380548+0000","last_undegraded":"2024-02-17T12:19:23.380548+0000","last_fullsized":"2024-02-17T12:19:23.380548+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:16.831548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379607+0000","last_change":"2024-02-17T12:19:22.368488+0000","last_active":"2024-02-17T12:19:23.379607+0000","last_peered":"2024-02-17T12:19:23.379607+0000","last_clean":"2024-02-17T12:19:23.379607+0000","last_became_active":"2024-02-17T12:19:22.368213+0000","last_became_peered":"2024-02-17T12:19:22.368213+0000","last_unstale":"2024-02-17T12:19:23.379607+0000","last_undegraded":"2024-02-17T12:19:23.379607+0000","last_fullsized":"2024-02-17T12:19:23.379607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:09:41.215827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374109+0000","last_change":"2024-02-17T12:19:21.375502+0000","last_active":"2024-02-17T12:19:23.374109+0000","last_peered":"2024-02-17T12:19:23.374109+0000","last_clean":"2024-02-17T12:19:23.374109+0000","last_became_active":"2024-02-17T12:19:21.375075+0000","last_became_peered":"2024-02-17T12:19:21.375075+0000","last_unstale":"2024-02-17T12:19:23.374109+0000","last_undegraded":"2024-02-17T12:19:23.374109+0000","last_fullsized":"2024-02-17T12:19:23.374109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:53.748200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380350+0000","last_change":"2024-02-17T12:19:04.708618+0000","last_active":"2024-02-17T12:19:23.380350+0000","last_peered":"2024-02-17T12:19:23.380350+0000","last_clean":"2024-02-17T12:19:23.380350+0000","last_became_active":"2024-02-17T12:19:04.708351+0000","last_became_peered":"2024-02-17T12:19:04.708351+0000","last_unstale":"2024-02-17T12:19:23.380350+0000","last_undegraded":"2024-02-17T12:19:23.380350+0000","last_fullsized":"2024-02-17T12:19:23.380350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:09.330073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380335+0000","last_change":"2024-02-17T12:19:03.706093+0000","last_active":"2024-02-17T12:19:23.380335+0000","last_peered":"2024-02-17T12:19:23.380335+0000","last_clean":"2024-02-17T12:19:23.380335+0000","last_became_active":"2024-02-17T12:19:03.705445+0000","last_became_peered":"2024-02-17T12:19:03.705445+0000","last_unstale":"2024-02-17T12:19:23.380335+0000","last_undegraded":"2024-02-17T12:19:23.380335+0000","last_fullsized":"2024-02-17T12:19:23.380335+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:29.842261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379824+0000","last_change":"2024-02-17T12:19:22.376298+0000","last_active":"2024-02-17T12:19:23.379824+0000","last_peered":"2024-02-17T12:19:23.379824+0000","last_clean":"2024-02-17T12:19:23.379824+0000","last_became_active":"2024-02-17T12:19:22.375342+0000","last_became_peered":"2024-02-17T12:19:22.375342+0000","last_unstale":"2024-02-17T12:19:23.379824+0000","last_undegraded":"2024-02-17T12:19:23.379824+0000","last_fullsized":"2024-02-17T12:19:23.379824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:28.677798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374395+0000","last_change":"2024-02-17T12:19:21.370519+0000","last_active":"2024-02-17T12:19:23.374395+0000","last_peered":"2024-02-17T12:19:23.374395+0000","last_clean":"2024-02-17T12:19:23.374395+0000","last_became_active":"2024-02-17T12:19:21.369831+0000","last_became_peered":"2024-02-17T12:19:21.369831+0000","last_unstale":"2024-02-17T12:19:23.374395+0000","last_undegraded":"2024-02-17T12:19:23.374395+0000","last_fullsized":"2024-02-17T12:19:23.374395+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:13:10.363299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535697+0000","last_change":"2024-02-17T12:19:04.714305+0000","last_active":"2024-02-17T12:19:23.535697+0000","last_peered":"2024-02-17T12:19:23.535697+0000","last_clean":"2024-02-17T12:19:23.535697+0000","last_became_active":"2024-02-17T12:19:04.714041+0000","last_became_peered":"2024-02-17T12:19:04.714041+0000","last_unstale":"2024-02-17T12:19:23.535697+0000","last_undegraded":"2024-02-17T12:19:23.535697+0000","last_fullsized":"2024-02-17T12:19:23.535697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:12.864476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535908+0000","last_change":"2024-02-17T12:19:03.701055+0000","last_active":"2024-02-17T12:19:23.535908+0000","last_peered":"2024-02-17T12:19:23.535908+0000","last_clean":"2024-02-17T12:19:23.535908+0000","last_became_active":"2024-02-17T12:19:03.695988+0000","last_became_peered":"2024-02-17T12:19:03.695988+0000","last_unstale":"2024-02-17T12:19:23.535908+0000","last_undegraded":"2024-02-17T12:19:23.535908+0000","last_fullsized":"2024-02-17T12:19:23.535908+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536792+0000","last_change":"2024-02-17T12:19:22.379284+0000","last_active":"2024-02-17T12:19:23.536792+0000","last_peered":"2024-02-17T12:19:23.536792+0000","last_clean":"2024-02-17T12:19:23.536792+0000","last_became_active":"2024-02-17T12:19:22.378837+0000","last_became_peered":"2024-02-17T12:19:22.378837+0000","last_unstale":"2024-02-17T12:19:23.536792+0000","last_undegraded":"2024-02-17T12:19:23.536792+0000","last_fullsized":"2024-02-17T12:19:23.536792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536153+0000","last_change":"2024-02-17T12:19:21.378185+0000","last_active":"2024-02-17T12:19:23.536153+0000","last_peered":"2024-02-17T12:19:23.536153+0000","last_clean":"2024-02-17T12:19:23.536153+0000","last_became_active":"2024-02-17T12:19:21.377907+0000","last_became_peered":"2024-02-17T12:19:21.377907+0000","last_unstale":"2024-02-17T12:19:23.536153+0000","last_undegraded":"2024-02-17T12:19:23.536153+0000","last_fullsized":"2024-02-17T12:19:23.536153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:37.094716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536582+0000","last_change":"2024-02-17T12:19:04.710559+0000","last_active":"2024-02-17T12:19:23.536582+0000","last_peered":"2024-02-17T12:19:23.536582+0000","last_clean":"2024-02-17T12:19:23.536582+0000","last_became_active":"2024-02-17T12:19:04.709979+0000","last_became_peered":"2024-02-17T12:19:04.709979+0000","last_unstale":"2024-02-17T12:19:23.536582+0000","last_undegraded":"2024-02-17T12:19:23.536582+0000","last_fullsized":"2024-02-17T12:19:23.536582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:33:12.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374414+0000","last_change":"2024-02-17T12:19:03.702309+0000","last_active":"2024-02-17T12:19:23.374414+0000","last_peered":"2024-02-17T12:19:23.374414+0000","last_clean":"2024-02-17T12:19:23.374414+0000","last_became_active":"2024-02-17T12:19:03.702051+0000","last_became_peered":"2024-02-17T12:19:03.702051+0000","last_unstale":"2024-02-17T12:19:23.374414+0000","last_undegraded":"2024-02-17T12:19:23.374414+0000","last_fullsized":"2024-02-17T12:19:23.374414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:58.978525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536166+0000","last_change":"2024-02-17T12:19:22.379801+0000","last_active":"2024-02-17T12:19:23.536166+0000","last_peered":"2024-02-17T12:19:23.536166+0000","last_clean":"2024-02-17T12:19:23.536166+0000","last_became_active":"2024-02-17T12:19:22.379377+0000","last_became_peered":"2024-02-17T12:19:22.379377+0000","last_unstale":"2024-02-17T12:19:23.536166+0000","last_undegraded":"2024-02-17T12:19:23.536166+0000","last_fullsized":"2024-02-17T12:19:23.536166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:22:35.457951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"71'3","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537726+0000","last_change":"2024-02-17T12:19:21.375965+0000","last_active":"2024-02-17T12:19:23.537726+0000","last_peered":"2024-02-17T12:19:23.537726+0000","last_clean":"2024-02-17T12:19:23.537726+0000","last_became_active":"2024-02-17T12:19:21.375551+0000","last_became_peered":"2024-02-17T12:19:21.375551+0000","last_unstale":"2024-02-17T12:19:23.537726+0000","last_undegraded":"2024-02-17T12:19:23.537726+0000","last_fullsized":"2024-02-17T12:19:23.537726+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:25.240966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537347+0000","last_change":"2024-02-17T12:19:04.726001+0000","last_active":"2024-02-17T12:19:23.537347+0000","last_peered":"2024-02-17T12:19:23.537347+0000","last_clean":"2024-02-17T12:19:23.537347+0000","last_became_active":"2024-02-17T12:19:04.725747+0000","last_became_peered":"2024-02-17T12:19:04.725747+0000","last_unstale":"2024-02-17T12:19:23.537347+0000","last_undegraded":"2024-02-17T12:19:23.537347+0000","last_fullsized":"2024-02-17T12:19:23.537347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:18:38.213214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536956+0000","last_change":"2024-02-17T12:19:03.712851+0000","last_active":"2024-02-17T12:19:23.536956+0000","last_peered":"2024-02-17T12:19:23.536956+0000","last_clean":"2024-02-17T12:19:23.536956+0000","last_became_active":"2024-02-17T12:19:03.712584+0000","last_became_peered":"2024-02-17T12:19:03.712584+0000","last_unstale":"2024-02-17T12:19:23.536956+0000","last_undegraded":"2024-02-17T12:19:23.536956+0000","last_fullsized":"2024-02-17T12:19:23.536956+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537449+0000","last_change":"2024-02-17T12:19:22.379237+0000","last_active":"2024-02-17T12:19:23.537449+0000","last_peered":"2024-02-17T12:19:23.537449+0000","last_clean":"2024-02-17T12:19:23.537449+0000","last_became_active":"2024-02-17T12:19:22.377019+0000","last_became_peered":"2024-02-17T12:19:22.377019+0000","last_unstale":"2024-02-17T12:19:23.537449+0000","last_undegraded":"2024-02-17T12:19:23.537449+0000","last_fullsized":"2024-02-17T12:19:23.537449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:53.311764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"71'6","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380677+0000","last_change":"2024-02-17T12:19:21.372337+0000","last_active":"2024-02-17T12:19:23.380677+0000","last_peered":"2024-02-17T12:19:23.380677+0000","last_clean":"2024-02-17T12:19:23.380677+0000","last_became_active":"2024-02-17T12:19:21.371919+0000","last_became_peered":"2024-02-17T12:19:21.371919+0000","last_unstale":"2024-02-17T12:19:23.380677+0000","last_undegraded":"2024-02-17T12:19:23.380677+0000","last_fullsized":"2024-02-17T12:19:23.380677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:11:12.798689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380196+0000","last_change":"2024-02-17T12:19:04.709578+0000","last_active":"2024-02-17T12:19:23.380196+0000","last_peered":"2024-02-17T12:19:23.380196+0000","last_clean":"2024-02-17T12:19:23.380196+0000","last_became_active":"2024-02-17T12:19:04.709173+0000","last_became_peered":"2024-02-17T12:19:04.709173+0000","last_unstale":"2024-02-17T12:19:23.380196+0000","last_undegraded":"2024-02-17T12:19:23.380196+0000","last_fullsized":"2024-02-17T12:19:23.380196+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537412+0000","last_change":"2024-02-17T12:19:03.707721+0000","last_active":"2024-02-17T12:19:23.537412+0000","last_peered":"2024-02-17T12:19:23.537412+0000","last_clean":"2024-02-17T12:19:23.537412+0000","last_became_active":"2024-02-17T12:19:03.707435+0000","last_became_peered":"2024-02-17T12:19:03.707435+0000","last_unstale":"2024-02-17T12:19:23.537412+0000","last_undegraded":"2024-02-17T12:19:23.537412+0000","last_fullsized":"2024-02-17T12:19:23.537412+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536703+0000","last_change":"2024-02-17T12:19:22.370538+0000","last_active":"2024-02-17T12:19:23.536703+0000","last_peered":"2024-02-17T12:19:23.536703+0000","last_clean":"2024-02-17T12:19:23.536703+0000","last_became_active":"2024-02-17T12:19:22.370270+0000","last_became_peered":"2024-02-17T12:19:22.370270+0000","last_unstale":"2024-02-17T12:19:23.536703+0000","last_undegraded":"2024-02-17T12:19:23.536703+0000","last_fullsized":"2024-02-17T12:19:23.536703+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:14.612133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375137+0000","last_change":"2024-02-17T12:19:21.368558+0000","last_active":"2024-02-17T12:19:23.375137+0000","last_peered":"2024-02-17T12:19:23.375137+0000","last_clean":"2024-02-17T12:19:23.375137+0000","last_became_active":"2024-02-17T12:19:21.368198+0000","last_became_peered":"2024-02-17T12:19:21.368198+0000","last_unstale":"2024-02-17T12:19:23.375137+0000","last_undegraded":"2024-02-17T12:19:23.375137+0000","last_fullsized":"2024-02-17T12:19:23.375137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:25.861028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537464+0000","last_change":"2024-02-17T12:19:04.716812+0000","last_active":"2024-02-17T12:19:23.537464+0000","last_peered":"2024-02-17T12:19:23.537464+0000","last_clean":"2024-02-17T12:19:23.537464+0000","last_became_active":"2024-02-17T12:19:04.716307+0000","last_became_peered":"2024-02-17T12:19:04.716307+0000","last_unstale":"2024-02-17T12:19:23.537464+0000","last_undegraded":"2024-02-17T12:19:23.537464+0000","last_fullsized":"2024-02-17T12:19:23.537464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:30.970580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536843+0000","last_change":"2024-02-17T12:19:03.710532+0000","last_active":"2024-02-17T12:19:23.536843+0000","last_peered":"2024-02-17T12:19:23.536843+0000","last_clean":"2024-02-17T12:19:23.536843+0000","last_became_active":"2024-02-17T12:19:03.710333+0000","last_became_peered":"2024-02-17T12:19:03.710333+0000","last_unstale":"2024-02-17T12:19:23.536843+0000","last_undegraded":"2024-02-17T12:19:23.536843+0000","last_fullsized":"2024-02-17T12:19:23.536843+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381122+0000","last_change":"2024-02-17T12:19:22.367647+0000","last_active":"2024-02-17T12:19:23.381122+0000","last_peered":"2024-02-17T12:19:23.381122+0000","last_clean":"2024-02-17T12:19:23.381122+0000","last_became_active":"2024-02-17T12:19:22.366850+0000","last_became_peered":"2024-02-17T12:19:22.366850+0000","last_unstale":"2024-02-17T12:19:23.381122+0000","last_undegraded":"2024-02-17T12:19:23.381122+0000","last_fullsized":"2024-02-17T12:19:23.381122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:21:05.316175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537200+0000","last_change":"2024-02-17T12:19:21.374376+0000","last_active":"2024-02-17T12:19:23.537200+0000","last_peered":"2024-02-17T12:19:23.537200+0000","last_clean":"2024-02-17T12:19:23.537200+0000","last_became_active":"2024-02-17T12:19:21.374115+0000","last_became_peered":"2024-02-17T12:19:21.374115+0000","last_unstale":"2024-02-17T12:19:23.537200+0000","last_undegraded":"2024-02-17T12:19:23.537200+0000","last_fullsized":"2024-02-17T12:19:23.537200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:02.834283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380757+0000","last_change":"2024-02-17T12:19:04.719297+0000","last_active":"2024-02-17T12:19:23.380757+0000","last_peered":"2024-02-17T12:19:23.380757+0000","last_clean":"2024-02-17T12:19:23.380757+0000","last_became_active":"2024-02-17T12:19:04.718586+0000","last_became_peered":"2024-02-17T12:19:04.718586+0000","last_unstale":"2024-02-17T12:19:23.380757+0000","last_undegraded":"2024-02-17T12:19:23.380757+0000","last_fullsized":"2024-02-17T12:19:23.380757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:05.970868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379671+0000","last_change":"2024-02-17T12:19:03.704237+0000","last_active":"2024-02-17T12:19:23.379671+0000","last_peered":"2024-02-17T12:19:23.379671+0000","last_clean":"2024-02-17T12:19:23.379671+0000","last_became_active":"2024-02-17T12:19:03.703964+0000","last_became_peered":"2024-02-17T12:19:03.703964+0000","last_unstale":"2024-02-17T12:19:23.379671+0000","last_undegraded":"2024-02-17T12:19:23.379671+0000","last_fullsized":"2024-02-17T12:19:23.379671+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:45.097730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379221+0000","last_change":"2024-02-17T12:19:22.366381+0000","last_active":"2024-02-17T12:19:23.379221+0000","last_peered":"2024-02-17T12:19:23.379221+0000","last_clean":"2024-02-17T12:19:23.379221+0000","last_became_active":"2024-02-17T12:19:22.366074+0000","last_became_peered":"2024-02-17T12:19:22.366074+0000","last_unstale":"2024-02-17T12:19:23.379221+0000","last_undegraded":"2024-02-17T12:19:23.379221+0000","last_fullsized":"2024-02-17T12:19:23.379221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:54.192462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380317+0000","last_change":"2024-02-17T12:19:21.358035+0000","last_active":"2024-02-17T12:19:23.380317+0000","last_peered":"2024-02-17T12:19:23.380317+0000","last_clean":"2024-02-17T12:19:23.380317+0000","last_became_active":"2024-02-17T12:19:21.357766+0000","last_became_peered":"2024-02-17T12:19:21.357766+0000","last_unstale":"2024-02-17T12:19:23.380317+0000","last_undegraded":"2024-02-17T12:19:23.380317+0000","last_fullsized":"2024-02-17T12:19:23.380317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:42.768921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536246+0000","last_change":"2024-02-17T12:19:04.702494+0000","last_active":"2024-02-17T12:19:23.536246+0000","last_peered":"2024-02-17T12:19:23.536246+0000","last_clean":"2024-02-17T12:19:23.536246+0000","last_became_active":"2024-02-17T12:19:04.702168+0000","last_became_peered":"2024-02-17T12:19:04.702168+0000","last_unstale":"2024-02-17T12:19:23.536246+0000","last_undegraded":"2024-02-17T12:19:23.536246+0000","last_fullsized":"2024-02-17T12:19:23.536246+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:53.989897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374642+0000","last_change":"2024-02-17T12:19:03.710630+0000","last_active":"2024-02-17T12:19:23.374642+0000","last_peered":"2024-02-17T12:19:23.374642+0000","last_clean":"2024-02-17T12:19:23.374642+0000","last_became_active":"2024-02-17T12:19:03.710185+0000","last_became_peered":"2024-02-17T12:19:03.710185+0000","last_unstale":"2024-02-17T12:19:23.374642+0000","last_undegraded":"2024-02-17T12:19:23.374642+0000","last_fullsized":"2024-02-17T12:19:23.374642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:07:16.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536196+0000","last_change":"2024-02-17T12:19:22.379291+0000","last_active":"2024-02-17T12:19:23.536196+0000","last_peered":"2024-02-17T12:19:23.536196+0000","last_clean":"2024-02-17T12:19:23.536196+0000","last_became_active":"2024-02-17T12:19:22.379052+0000","last_became_peered":"2024-02-17T12:19:22.379052+0000","last_unstale":"2024-02-17T12:19:23.536196+0000","last_undegraded":"2024-02-17T12:19:23.536196+0000","last_fullsized":"2024-02-17T12:19:23.536196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:30.791284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"71'8","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374214+0000","last_change":"2024-02-17T12:19:21.372742+0000","last_active":"2024-02-17T12:19:23.374214+0000","last_peered":"2024-02-17T12:19:23.374214+0000","last_clean":"2024-02-17T12:19:23.374214+0000","last_became_active":"2024-02-17T12:19:21.372447+0000","last_became_peered":"2024-02-17T12:19:21.372447+0000","last_unstale":"2024-02-17T12:19:23.374214+0000","last_undegraded":"2024-02-17T12:19:23.374214+0000","last_fullsized":"2024-02-17T12:19:23.374214+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:41.249178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536979+0000","last_change":"2024-02-17T12:19:04.716555+0000","last_active":"2024-02-17T12:19:23.536979+0000","last_peered":"2024-02-17T12:19:23.536979+0000","last_clean":"2024-02-17T12:19:23.536979+0000","last_became_active":"2024-02-17T12:19:04.715235+0000","last_became_peered":"2024-02-17T12:19:04.715235+0000","last_unstale":"2024-02-17T12:19:23.536979+0000","last_undegraded":"2024-02-17T12:19:23.536979+0000","last_fullsized":"2024-02-17T12:19:23.536979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:05.685656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537055+0000","last_change":"2024-02-17T12:19:03.712475+0000","last_active":"2024-02-17T12:19:23.537055+0000","last_peered":"2024-02-17T12:19:23.537055+0000","last_clean":"2024-02-17T12:19:23.537055+0000","last_became_active":"2024-02-17T12:19:03.712117+0000","last_became_peered":"2024-02-17T12:19:03.712117+0000","last_unstale":"2024-02-17T12:19:23.537055+0000","last_undegraded":"2024-02-17T12:19:23.537055+0000","last_fullsized":"2024-02-17T12:19:23.537055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:10.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536839+0000","last_change":"2024-02-17T12:19:22.369910+0000","last_active":"2024-02-17T12:19:23.536839+0000","last_peered":"2024-02-17T12:19:23.536839+0000","last_clean":"2024-02-17T12:19:23.536839+0000","last_became_active":"2024-02-17T12:19:22.369559+0000","last_became_peered":"2024-02-17T12:19:22.369559+0000","last_unstale":"2024-02-17T12:19:23.536839+0000","last_undegraded":"2024-02-17T12:19:23.536839+0000","last_fullsized":"2024-02-17T12:19:23.536839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:59:13.071369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538079+0000","last_change":"2024-02-17T12:19:21.362585+0000","last_active":"2024-02-17T12:19:23.538079+0000","last_peered":"2024-02-17T12:19:23.538079+0000","last_clean":"2024-02-17T12:19:23.538079+0000","last_became_active":"2024-02-17T12:19:21.361851+0000","last_became_peered":"2024-02-17T12:19:21.361851+0000","last_unstale":"2024-02-17T12:19:23.538079+0000","last_undegraded":"2024-02-17T12:19:23.538079+0000","last_fullsized":"2024-02-17T12:19:23.538079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:31.111070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374334+0000","last_change":"2024-02-17T12:19:04.727289+0000","last_active":"2024-02-17T12:19:23.374334+0000","last_peered":"2024-02-17T12:19:23.374334+0000","last_clean":"2024-02-17T12:19:23.374334+0000","last_became_active":"2024-02-17T12:19:04.727041+0000","last_became_peered":"2024-02-17T12:19:04.727041+0000","last_unstale":"2024-02-17T12:19:23.374334+0000","last_undegraded":"2024-02-17T12:19:23.374334+0000","last_fullsized":"2024-02-17T12:19:23.374334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:39:43.401328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380253+0000","last_change":"2024-02-17T12:19:03.699211+0000","last_active":"2024-02-17T12:19:23.380253+0000","last_peered":"2024-02-17T12:19:23.380253+0000","last_clean":"2024-02-17T12:19:23.380253+0000","last_became_active":"2024-02-17T12:19:03.698244+0000","last_became_peered":"2024-02-17T12:19:03.698244+0000","last_unstale":"2024-02-17T12:19:23.380253+0000","last_undegraded":"2024-02-17T12:19:23.380253+0000","last_fullsized":"2024-02-17T12:19:23.380253+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:42.702805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374580+0000","last_change":"2024-02-17T12:19:22.373727+0000","last_active":"2024-02-17T12:19:23.374580+0000","last_peered":"2024-02-17T12:19:23.374580+0000","last_clean":"2024-02-17T12:19:23.374580+0000","last_became_active":"2024-02-17T12:19:22.373484+0000","last_became_peered":"2024-02-17T12:19:22.373484+0000","last_unstale":"2024-02-17T12:19:23.374580+0000","last_undegraded":"2024-02-17T12:19:23.374580+0000","last_fullsized":"2024-02-17T12:19:23.374580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:16.518846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538270+0000","last_change":"2024-02-17T12:19:21.368493+0000","last_active":"2024-02-17T12:19:23.538270+0000","last_peered":"2024-02-17T12:19:23.538270+0000","last_clean":"2024-02-17T12:19:23.538270+0000","last_became_active":"2024-02-17T12:19:21.368162+0000","last_became_peered":"2024-02-17T12:19:21.368162+0000","last_unstale":"2024-02-17T12:19:23.538270+0000","last_undegraded":"2024-02-17T12:19:23.538270+0000","last_fullsized":"2024-02-17T12:19:23.538270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:38.213027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374169+0000","last_change":"2024-02-17T12:19:04.718529+0000","last_active":"2024-02-17T12:19:23.374169+0000","last_peered":"2024-02-17T12:19:23.374169+0000","last_clean":"2024-02-17T12:19:23.374169+0000","last_became_active":"2024-02-17T12:19:04.718251+0000","last_became_peered":"2024-02-17T12:19:04.718251+0000","last_unstale":"2024-02-17T12:19:23.374169+0000","last_undegraded":"2024-02-17T12:19:23.374169+0000","last_fullsized":"2024-02-17T12:19:23.374169+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:28.280713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535918+0000","last_change":"2024-02-17T12:19:03.706554+0000","last_active":"2024-02-17T12:19:23.535918+0000","last_peered":"2024-02-17T12:19:23.535918+0000","last_clean":"2024-02-17T12:19:23.535918+0000","last_became_active":"2024-02-17T12:19:03.706236+0000","last_became_peered":"2024-02-17T12:19:03.706236+0000","last_unstale":"2024-02-17T12:19:23.535918+0000","last_undegraded":"2024-02-17T12:19:23.535918+0000","last_fullsized":"2024-02-17T12:19:23.535918+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379764+0000","last_change":"2024-02-17T12:19:22.377796+0000","last_active":"2024-02-17T12:19:23.379764+0000","last_peered":"2024-02-17T12:19:23.379764+0000","last_clean":"2024-02-17T12:19:23.379764+0000","last_became_active":"2024-02-17T12:19:22.377532+0000","last_became_peered":"2024-02-17T12:19:22.377532+0000","last_unstale":"2024-02-17T12:19:23.379764+0000","last_undegraded":"2024-02-17T12:19:23.379764+0000","last_fullsized":"2024-02-17T12:19:23.379764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:56.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536582+0000","last_change":"2024-02-17T12:19:21.361720+0000","last_active":"2024-02-17T12:19:23.536582+0000","last_peered":"2024-02-17T12:19:23.536582+0000","last_clean":"2024-02-17T12:19:23.536582+0000","last_became_active":"2024-02-17T12:19:21.361071+0000","last_became_peered":"2024-02-17T12:19:21.361071+0000","last_unstale":"2024-02-17T12:19:23.536582+0000","last_undegraded":"2024-02-17T12:19:23.536582+0000","last_fullsized":"2024-02-17T12:19:23.536582+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:58.800423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537259+0000","last_change":"2024-02-17T12:19:04.715036+0000","last_active":"2024-02-17T12:19:23.537259+0000","last_peered":"2024-02-17T12:19:23.537259+0000","last_clean":"2024-02-17T12:19:23.537259+0000","last_became_active":"2024-02-17T12:19:04.714713+0000","last_became_peered":"2024-02-17T12:19:04.714713+0000","last_unstale":"2024-02-17T12:19:23.537259+0000","last_undegraded":"2024-02-17T12:19:23.537259+0000","last_fullsized":"2024-02-17T12:19:23.537259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:28:30.744698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537288+0000","last_change":"2024-02-17T12:19:03.705648+0000","last_active":"2024-02-17T12:19:23.537288+0000","last_peered":"2024-02-17T12:19:23.537288+0000","last_clean":"2024-02-17T12:19:23.537288+0000","last_became_active":"2024-02-17T12:19:03.705325+0000","last_became_peered":"2024-02-17T12:19:03.705325+0000","last_unstale":"2024-02-17T12:19:23.537288+0000","last_undegraded":"2024-02-17T12:19:23.537288+0000","last_fullsized":"2024-02-17T12:19:23.537288+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537452+0000","last_change":"2024-02-17T12:19:22.380167+0000","last_active":"2024-02-17T12:19:23.537452+0000","last_peered":"2024-02-17T12:19:23.537452+0000","last_clean":"2024-02-17T12:19:23.537452+0000","last_became_active":"2024-02-17T12:19:22.379704+0000","last_became_peered":"2024-02-17T12:19:22.379704+0000","last_unstale":"2024-02-17T12:19:23.537452+0000","last_undegraded":"2024-02-17T12:19:23.537452+0000","last_fullsized":"2024-02-17T12:19:23.537452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:28:11.111883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537403+0000","last_change":"2024-02-17T12:19:21.376463+0000","last_active":"2024-02-17T12:19:23.537403+0000","last_peered":"2024-02-17T12:19:23.537403+0000","last_clean":"2024-02-17T12:19:23.537403+0000","last_became_active":"2024-02-17T12:19:21.376199+0000","last_became_peered":"2024-02-17T12:19:21.376199+0000","last_unstale":"2024-02-17T12:19:23.537403+0000","last_undegraded":"2024-02-17T12:19:23.537403+0000","last_fullsized":"2024-02-17T12:19:23.537403+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:18:54.868580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536531+0000","last_change":"2024-02-17T12:19:04.719005+0000","last_active":"2024-02-17T12:19:23.536531+0000","last_peered":"2024-02-17T12:19:23.536531+0000","last_clean":"2024-02-17T12:19:23.536531+0000","last_became_active":"2024-02-17T12:19:04.717221+0000","last_became_peered":"2024-02-17T12:19:04.717221+0000","last_unstale":"2024-02-17T12:19:23.536531+0000","last_undegraded":"2024-02-17T12:19:23.536531+0000","last_fullsized":"2024-02-17T12:19:23.536531+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:50.535947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537209+0000","last_change":"2024-02-17T12:19:03.708463+0000","last_active":"2024-02-17T12:19:23.537209+0000","last_peered":"2024-02-17T12:19:23.537209+0000","last_clean":"2024-02-17T12:19:23.537209+0000","last_became_active":"2024-02-17T12:19:03.707739+0000","last_became_peered":"2024-02-17T12:19:03.707739+0000","last_unstale":"2024-02-17T12:19:23.537209+0000","last_undegraded":"2024-02-17T12:19:23.537209+0000","last_fullsized":"2024-02-17T12:19:23.537209+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536099+0000","last_change":"2024-02-17T12:19:22.380029+0000","last_active":"2024-02-17T12:19:23.536099+0000","last_peered":"2024-02-17T12:19:23.536099+0000","last_clean":"2024-02-17T12:19:23.536099+0000","last_became_active":"2024-02-17T12:19:22.379414+0000","last_became_peered":"2024-02-17T12:19:22.379414+0000","last_unstale":"2024-02-17T12:19:23.536099+0000","last_undegraded":"2024-02-17T12:19:23.536099+0000","last_fullsized":"2024-02-17T12:19:23.536099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:06:13.563565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380282+0000","last_change":"2024-02-17T12:19:21.361415+0000","last_active":"2024-02-17T12:19:23.380282+0000","last_peered":"2024-02-17T12:19:23.380282+0000","last_clean":"2024-02-17T12:19:23.380282+0000","last_became_active":"2024-02-17T12:19:21.360522+0000","last_became_peered":"2024-02-17T12:19:21.360522+0000","last_unstale":"2024-02-17T12:19:23.380282+0000","last_undegraded":"2024-02-17T12:19:23.380282+0000","last_fullsized":"2024-02-17T12:19:23.380282+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:19:01.561174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380889+0000","last_change":"2024-02-17T12:19:04.727161+0000","last_active":"2024-02-17T12:19:23.380889+0000","last_peered":"2024-02-17T12:19:23.380889+0000","last_clean":"2024-02-17T12:19:23.380889+0000","last_became_active":"2024-02-17T12:19:04.726871+0000","last_became_peered":"2024-02-17T12:19:04.726871+0000","last_unstale":"2024-02-17T12:19:23.380889+0000","last_undegraded":"2024-02-17T12:19:23.380889+0000","last_fullsized":"2024-02-17T12:19:23.380889+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:50.453267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537553+0000","last_change":"2024-02-17T12:19:03.700286+0000","last_active":"2024-02-17T12:19:23.537553+0000","last_peered":"2024-02-17T12:19:23.537553+0000","last_clean":"2024-02-17T12:19:23.537553+0000","last_became_active":"2024-02-17T12:19:03.700021+0000","last_became_peered":"2024-02-17T12:19:03.700021+0000","last_unstale":"2024-02-17T12:19:23.537553+0000","last_undegraded":"2024-02-17T12:19:23.537553+0000","last_fullsized":"2024-02-17T12:19:23.537553+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535774+0000","last_change":"2024-02-17T12:19:22.370952+0000","last_active":"2024-02-17T12:19:23.535774+0000","last_peered":"2024-02-17T12:19:23.535774+0000","last_clean":"2024-02-17T12:19:23.535774+0000","last_became_active":"2024-02-17T12:19:22.370205+0000","last_became_peered":"2024-02-17T12:19:22.370205+0000","last_unstale":"2024-02-17T12:19:23.535774+0000","last_undegraded":"2024-02-17T12:19:23.535774+0000","last_fullsized":"2024-02-17T12:19:23.535774+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:42:14.086969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379452+0000","last_change":"2024-02-17T12:19:21.374959+0000","last_active":"2024-02-17T12:19:23.379452+0000","last_peered":"2024-02-17T12:19:23.379452+0000","last_clean":"2024-02-17T12:19:23.379452+0000","last_became_active":"2024-02-17T12:19:21.374612+0000","last_became_peered":"2024-02-17T12:19:21.374612+0000","last_unstale":"2024-02-17T12:19:23.379452+0000","last_undegraded":"2024-02-17T12:19:23.379452+0000","last_fullsized":"2024-02-17T12:19:23.379452+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:56:33.199348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538438+0000","last_change":"2024-02-17T12:19:04.727215+0000","last_active":"2024-02-17T12:19:23.538438+0000","last_peered":"2024-02-17T12:19:23.538438+0000","last_clean":"2024-02-17T12:19:23.538438+0000","last_became_active":"2024-02-17T12:19:04.726960+0000","last_became_peered":"2024-02-17T12:19:04.726960+0000","last_unstale":"2024-02-17T12:19:23.538438+0000","last_undegraded":"2024-02-17T12:19:23.538438+0000","last_fullsized":"2024-02-17T12:19:23.538438+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:45.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538034+0000","last_change":"2024-02-17T12:19:03.709412+0000","last_active":"2024-02-17T12:19:23.538034+0000","last_peered":"2024-02-17T12:19:23.538034+0000","last_clean":"2024-02-17T12:19:23.538034+0000","last_became_active":"2024-02-17T12:19:03.709021+0000","last_became_peered":"2024-02-17T12:19:03.709021+0000","last_unstale":"2024-02-17T12:19:23.538034+0000","last_undegraded":"2024-02-17T12:19:23.538034+0000","last_fullsized":"2024-02-17T12:19:23.538034+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:44.049163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535925+0000","last_change":"2024-02-17T12:19:22.388507+0000","last_active":"2024-02-17T12:19:23.535925+0000","last_peered":"2024-02-17T12:19:23.535925+0000","last_clean":"2024-02-17T12:19:23.535925+0000","last_became_active":"2024-02-17T12:19:22.387331+0000","last_became_peered":"2024-02-17T12:19:22.387331+0000","last_unstale":"2024-02-17T12:19:23.535925+0000","last_undegraded":"2024-02-17T12:19:23.535925+0000","last_fullsized":"2024-02-17T12:19:23.535925+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:05.733697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535633+0000","last_change":"2024-02-17T12:19:21.378509+0000","last_active":"2024-02-17T12:19:23.535633+0000","last_peered":"2024-02-17T12:19:23.535633+0000","last_clean":"2024-02-17T12:19:23.535633+0000","last_became_active":"2024-02-17T12:19:21.378270+0000","last_became_peered":"2024-02-17T12:19:21.378270+0000","last_unstale":"2024-02-17T12:19:23.535633+0000","last_undegraded":"2024-02-17T12:19:23.535633+0000","last_fullsized":"2024-02-17T12:19:23.535633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:01:35.597527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379343+0000","last_change":"2024-02-17T12:19:04.712404+0000","last_active":"2024-02-17T12:19:23.379343+0000","last_peered":"2024-02-17T12:19:23.379343+0000","last_clean":"2024-02-17T12:19:23.379343+0000","last_became_active":"2024-02-17T12:19:04.711344+0000","last_became_peered":"2024-02-17T12:19:04.711344+0000","last_unstale":"2024-02-17T12:19:23.379343+0000","last_undegraded":"2024-02-17T12:19:23.379343+0000","last_fullsized":"2024-02-17T12:19:23.379343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:24.593812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538531+0000","last_change":"2024-02-17T12:19:03.706405+0000","last_active":"2024-02-17T12:19:23.538531+0000","last_peered":"2024-02-17T12:19:23.538531+0000","last_clean":"2024-02-17T12:19:23.538531+0000","last_became_active":"2024-02-17T12:19:03.706108+0000","last_became_peered":"2024-02-17T12:19:03.706108+0000","last_unstale":"2024-02-17T12:19:23.538531+0000","last_undegraded":"2024-02-17T12:19:23.538531+0000","last_fullsized":"2024-02-17T12:19:23.538531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.926513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538039+0000","last_change":"2024-02-17T12:19:22.389822+0000","last_active":"2024-02-17T12:19:23.538039+0000","last_peered":"2024-02-17T12:19:23.538039+0000","last_clean":"2024-02-17T12:19:23.538039+0000","last_became_active":"2024-02-17T12:19:22.389495+0000","last_became_peered":"2024-02-17T12:19:22.389495+0000","last_unstale":"2024-02-17T12:19:23.538039+0000","last_undegraded":"2024-02-17T12:19:23.538039+0000","last_fullsized":"2024-02-17T12:19:23.538039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:02:08.115974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536803+0000","last_change":"2024-02-17T12:19:21.378324+0000","last_active":"2024-02-17T12:19:23.536803+0000","last_peered":"2024-02-17T12:19:23.536803+0000","last_clean":"2024-02-17T12:19:23.536803+0000","last_became_active":"2024-02-17T12:19:21.378067+0000","last_became_peered":"2024-02-17T12:19:21.378067+0000","last_unstale":"2024-02-17T12:19:23.536803+0000","last_undegraded":"2024-02-17T12:19:23.536803+0000","last_fullsized":"2024-02-17T12:19:23.536803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:37:02.959762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536274+0000","last_change":"2024-02-17T12:19:04.712081+0000","last_active":"2024-02-17T12:19:23.536274+0000","last_peered":"2024-02-17T12:19:23.536274+0000","last_clean":"2024-02-17T12:19:23.536274+0000","last_became_active":"2024-02-17T12:19:04.711784+0000","last_became_peered":"2024-02-17T12:19:04.711784+0000","last_unstale":"2024-02-17T12:19:23.536274+0000","last_undegraded":"2024-02-17T12:19:23.536274+0000","last_fullsized":"2024-02-17T12:19:23.536274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:47:13.952609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536391+0000","last_change":"2024-02-17T12:19:03.701598+0000","last_active":"2024-02-17T12:19:23.536391+0000","last_peered":"2024-02-17T12:19:23.536391+0000","last_clean":"2024-02-17T12:19:23.536391+0000","last_became_active":"2024-02-17T12:19:03.701326+0000","last_became_peered":"2024-02-17T12:19:03.701326+0000","last_unstale":"2024-02-17T12:19:23.536391+0000","last_undegraded":"2024-02-17T12:19:23.536391+0000","last_fullsized":"2024-02-17T12:19:23.536391+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:47:22.021385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537974+0000","last_change":"2024-02-17T12:19:22.380952+0000","last_active":"2024-02-17T12:19:23.537974+0000","last_peered":"2024-02-17T12:19:23.537974+0000","last_clean":"2024-02-17T12:19:23.537974+0000","last_became_active":"2024-02-17T12:19:22.380493+0000","last_became_peered":"2024-02-17T12:19:22.380493+0000","last_unstale":"2024-02-17T12:19:23.537974+0000","last_undegraded":"2024-02-17T12:19:23.537974+0000","last_fullsized":"2024-02-17T12:19:23.537974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:54.242151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379843+0000","last_change":"2024-02-17T12:19:21.372743+0000","last_active":"2024-02-17T12:19:23.379843+0000","last_peered":"2024-02-17T12:19:23.379843+0000","last_clean":"2024-02-17T12:19:23.379843+0000","last_became_active":"2024-02-17T12:19:21.372341+0000","last_became_peered":"2024-02-17T12:19:21.372341+0000","last_unstale":"2024-02-17T12:19:23.379843+0000","last_undegraded":"2024-02-17T12:19:23.379843+0000","last_fullsized":"2024-02-17T12:19:23.379843+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:39.147194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379599+0000","last_change":"2024-02-17T12:19:04.702184+0000","last_active":"2024-02-17T12:19:23.379599+0000","last_peered":"2024-02-17T12:19:23.379599+0000","last_clean":"2024-02-17T12:19:23.379599+0000","last_became_active":"2024-02-17T12:19:04.701908+0000","last_became_peered":"2024-02-17T12:19:04.701908+0000","last_unstale":"2024-02-17T12:19:23.379599+0000","last_undegraded":"2024-02-17T12:19:23.379599+0000","last_fullsized":"2024-02-17T12:19:23.379599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:30.749868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535970+0000","last_change":"2024-02-17T12:19:03.702614+0000","last_active":"2024-02-17T12:19:23.535970+0000","last_peered":"2024-02-17T12:19:23.535970+0000","last_clean":"2024-02-17T12:19:23.535970+0000","last_became_active":"2024-02-17T12:19:03.702360+0000","last_became_peered":"2024-02-17T12:19:03.702360+0000","last_unstale":"2024-02-17T12:19:23.535970+0000","last_undegraded":"2024-02-17T12:19:23.535970+0000","last_fullsized":"2024-02-17T12:19:23.535970+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:37.418089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374781+0000","last_change":"2024-02-17T12:19:22.380431+0000","last_active":"2024-02-17T12:19:23.374781+0000","last_peered":"2024-02-17T12:19:23.374781+0000","last_clean":"2024-02-17T12:19:23.374781+0000","last_became_active":"2024-02-17T12:19:22.380158+0000","last_became_peered":"2024-02-17T12:19:22.380158+0000","last_unstale":"2024-02-17T12:19:23.374781+0000","last_undegraded":"2024-02-17T12:19:23.374781+0000","last_fullsized":"2024-02-17T12:19:23.374781+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:56:34.206689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536504+0000","last_change":"2024-02-17T12:19:21.377870+0000","last_active":"2024-02-17T12:19:23.536504+0000","last_peered":"2024-02-17T12:19:23.536504+0000","last_clean":"2024-02-17T12:19:23.536504+0000","last_became_active":"2024-02-17T12:19:21.376799+0000","last_became_peered":"2024-02-17T12:19:21.376799+0000","last_unstale":"2024-02-17T12:19:23.536504+0000","last_undegraded":"2024-02-17T12:19:23.536504+0000","last_fullsized":"2024-02-17T12:19:23.536504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:04.167124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380585+0000","last_change":"2024-02-17T12:19:04.697171+0000","last_active":"2024-02-17T12:19:23.380585+0000","last_peered":"2024-02-17T12:19:23.380585+0000","last_clean":"2024-02-17T12:19:23.380585+0000","last_became_active":"2024-02-17T12:19:04.696841+0000","last_became_peered":"2024-02-17T12:19:04.696841+0000","last_unstale":"2024-02-17T12:19:23.380585+0000","last_undegraded":"2024-02-17T12:19:23.380585+0000","last_fullsized":"2024-02-17T12:19:23.380585+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:04:51.114922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375209+0000","last_change":"2024-02-17T12:19:03.706098+0000","last_active":"2024-02-17T12:19:23.375209+0000","last_peered":"2024-02-17T12:19:23.375209+0000","last_clean":"2024-02-17T12:19:23.375209+0000","last_became_active":"2024-02-17T12:19:03.705787+0000","last_became_peered":"2024-02-17T12:19:03.705787+0000","last_unstale":"2024-02-17T12:19:23.375209+0000","last_undegraded":"2024-02-17T12:19:23.375209+0000","last_fullsized":"2024-02-17T12:19:23.375209+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:59.839484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536473+0000","last_change":"2024-02-17T12:19:22.390414+0000","last_active":"2024-02-17T12:19:23.536473+0000","last_peered":"2024-02-17T12:19:23.536473+0000","last_clean":"2024-02-17T12:19:23.536473+0000","last_became_active":"2024-02-17T12:19:22.390123+0000","last_became_peered":"2024-02-17T12:19:22.390123+0000","last_unstale":"2024-02-17T12:19:23.536473+0000","last_undegraded":"2024-02-17T12:19:23.536473+0000","last_fullsized":"2024-02-17T12:19:23.536473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:52:59.929878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536149+0000","last_change":"2024-02-17T12:19:21.370930+0000","last_active":"2024-02-17T12:19:23.536149+0000","last_peered":"2024-02-17T12:19:23.536149+0000","last_clean":"2024-02-17T12:19:23.536149+0000","last_became_active":"2024-02-17T12:19:21.370503+0000","last_became_peered":"2024-02-17T12:19:21.370503+0000","last_unstale":"2024-02-17T12:19:23.536149+0000","last_undegraded":"2024-02-17T12:19:23.536149+0000","last_fullsized":"2024-02-17T12:19:23.536149+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:41:10.100668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536855+0000","last_change":"2024-02-17T12:19:04.710601+0000","last_active":"2024-02-17T12:19:23.536855+0000","last_peered":"2024-02-17T12:19:23.536855+0000","last_clean":"2024-02-17T12:19:23.536855+0000","last_became_active":"2024-02-17T12:19:04.710296+0000","last_became_peered":"2024-02-17T12:19:04.710296+0000","last_unstale":"2024-02-17T12:19:23.536855+0000","last_undegraded":"2024-02-17T12:19:23.536855+0000","last_fullsized":"2024-02-17T12:19:23.536855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:17:06.226423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375119+0000","last_change":"2024-02-17T12:19:03.707121+0000","last_active":"2024-02-17T12:19:23.375119+0000","last_peered":"2024-02-17T12:19:23.375119+0000","last_clean":"2024-02-17T12:19:23.375119+0000","last_became_active":"2024-02-17T12:19:03.706873+0000","last_became_peered":"2024-02-17T12:19:03.706873+0000","last_unstale":"2024-02-17T12:19:23.375119+0000","last_undegraded":"2024-02-17T12:19:23.375119+0000","last_fullsized":"2024-02-17T12:19:23.375119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:24.015391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538323+0000","last_change":"2024-02-17T12:19:22.366705+0000","last_active":"2024-02-17T12:19:23.538323+0000","last_peered":"2024-02-17T12:19:23.538323+0000","last_clean":"2024-02-17T12:19:23.538323+0000","last_became_active":"2024-02-17T12:19:22.366194+0000","last_became_peered":"2024-02-17T12:19:22.366194+0000","last_unstale":"2024-02-17T12:19:23.538323+0000","last_undegraded":"2024-02-17T12:19:23.538323+0000","last_fullsized":"2024-02-17T12:19:23.538323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:59:13.071369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379981+0000","last_change":"2024-02-17T12:19:21.358468+0000","last_active":"2024-02-17T12:19:23.379981+0000","last_peered":"2024-02-17T12:19:23.379981+0000","last_clean":"2024-02-17T12:19:23.379981+0000","last_became_active":"2024-02-17T12:19:21.358160+0000","last_became_peered":"2024-02-17T12:19:21.358160+0000","last_unstale":"2024-02-17T12:19:23.379981+0000","last_undegraded":"2024-02-17T12:19:23.379981+0000","last_fullsized":"2024-02-17T12:19:23.379981+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:17:16.226206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537078+0000","last_change":"2024-02-17T12:19:04.718645+0000","last_active":"2024-02-17T12:19:23.537078+0000","last_peered":"2024-02-17T12:19:23.537078+0000","last_clean":"2024-02-17T12:19:23.537078+0000","last_became_active":"2024-02-17T12:19:04.715738+0000","last_became_peered":"2024-02-17T12:19:04.715738+0000","last_unstale":"2024-02-17T12:19:23.537078+0000","last_undegraded":"2024-02-17T12:19:23.537078+0000","last_fullsized":"2024-02-17T12:19:23.537078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:45.056164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536727+0000","last_change":"2024-02-17T12:19:03.705719+0000","last_active":"2024-02-17T12:19:23.536727+0000","last_peered":"2024-02-17T12:19:23.536727+0000","last_clean":"2024-02-17T12:19:23.536727+0000","last_became_active":"2024-02-17T12:19:03.705394+0000","last_became_peered":"2024-02-17T12:19:03.705394+0000","last_unstale":"2024-02-17T12:19:23.536727+0000","last_undegraded":"2024-02-17T12:19:23.536727+0000","last_fullsized":"2024-02-17T12:19:23.536727+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:18.432832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375201+0000","last_change":"2024-02-17T12:19:22.378876+0000","last_active":"2024-02-17T12:19:23.375201+0000","last_peered":"2024-02-17T12:19:23.375201+0000","last_clean":"2024-02-17T12:19:23.375201+0000","last_became_active":"2024-02-17T12:19:22.378636+0000","last_became_peered":"2024-02-17T12:19:22.378636+0000","last_unstale":"2024-02-17T12:19:23.375201+0000","last_undegraded":"2024-02-17T12:19:23.375201+0000","last_fullsized":"2024-02-17T12:19:23.375201+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:17:17.233548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536811+0000","last_change":"2024-02-17T12:19:21.376210+0000","last_active":"2024-02-17T12:19:23.536811+0000","last_peered":"2024-02-17T12:19:23.536811+0000","last_clean":"2024-02-17T12:19:23.536811+0000","last_became_active":"2024-02-17T12:19:21.375786+0000","last_became_peered":"2024-02-17T12:19:21.375786+0000","last_unstale":"2024-02-17T12:19:23.536811+0000","last_undegraded":"2024-02-17T12:19:23.536811+0000","last_fullsized":"2024-02-17T12:19:23.536811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:39:54.197618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380958+0000","last_change":"2024-02-17T12:19:04.719278+0000","last_active":"2024-02-17T12:19:23.380958+0000","last_peered":"2024-02-17T12:19:23.380958+0000","last_clean":"2024-02-17T12:19:23.380958+0000","last_became_active":"2024-02-17T12:19:04.718194+0000","last_became_peered":"2024-02-17T12:19:04.718194+0000","last_unstale":"2024-02-17T12:19:23.380958+0000","last_undegraded":"2024-02-17T12:19:23.380958+0000","last_fullsized":"2024-02-17T12:19:23.380958+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:11.081786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537110+0000","last_change":"2024-02-17T12:19:03.712607+0000","last_active":"2024-02-17T12:19:23.537110+0000","last_peered":"2024-02-17T12:19:23.537110+0000","last_clean":"2024-02-17T12:19:23.537110+0000","last_became_active":"2024-02-17T12:19:03.712328+0000","last_became_peered":"2024-02-17T12:19:03.712328+0000","last_unstale":"2024-02-17T12:19:23.537110+0000","last_undegraded":"2024-02-17T12:19:23.537110+0000","last_fullsized":"2024-02-17T12:19:23.537110+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535812+0000","last_change":"2024-02-17T12:19:22.379938+0000","last_active":"2024-02-17T12:19:23.535812+0000","last_peered":"2024-02-17T12:19:23.535812+0000","last_clean":"2024-02-17T12:19:23.535812+0000","last_became_active":"2024-02-17T12:19:22.379601+0000","last_became_peered":"2024-02-17T12:19:22.379601+0000","last_unstale":"2024-02-17T12:19:23.535812+0000","last_undegraded":"2024-02-17T12:19:23.535812+0000","last_fullsized":"2024-02-17T12:19:23.535812+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:24:23.237404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536226+0000","last_change":"2024-02-17T12:19:21.379926+0000","last_active":"2024-02-17T12:19:23.536226+0000","last_peered":"2024-02-17T12:19:23.536226+0000","last_clean":"2024-02-17T12:19:23.536226+0000","last_became_active":"2024-02-17T12:19:21.378997+0000","last_became_peered":"2024-02-17T12:19:21.378997+0000","last_unstale":"2024-02-17T12:19:23.536226+0000","last_undegraded":"2024-02-17T12:19:23.536226+0000","last_fullsized":"2024-02-17T12:19:23.536226+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:58:37.393789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380521+0000","last_change":"2024-02-17T12:19:04.711425+0000","last_active":"2024-02-17T12:19:23.380521+0000","last_peered":"2024-02-17T12:19:23.380521+0000","last_clean":"2024-02-17T12:19:23.380521+0000","last_became_active":"2024-02-17T12:19:04.711149+0000","last_became_peered":"2024-02-17T12:19:04.711149+0000","last_unstale":"2024-02-17T12:19:23.380521+0000","last_undegraded":"2024-02-17T12:19:23.380521+0000","last_fullsized":"2024-02-17T12:19:23.380521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536925+0000","last_change":"2024-02-17T12:19:03.708773+0000","last_active":"2024-02-17T12:19:23.536925+0000","last_peered":"2024-02-17T12:19:23.536925+0000","last_clean":"2024-02-17T12:19:23.536925+0000","last_became_active":"2024-02-17T12:19:03.707579+0000","last_became_peered":"2024-02-17T12:19:03.707579+0000","last_unstale":"2024-02-17T12:19:23.536925+0000","last_undegraded":"2024-02-17T12:19:23.536925+0000","last_fullsized":"2024-02-17T12:19:23.536925+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536310+0000","last_change":"2024-02-17T12:19:22.390591+0000","last_active":"2024-02-17T12:19:23.536310+0000","last_peered":"2024-02-17T12:19:23.536310+0000","last_clean":"2024-02-17T12:19:23.536310+0000","last_became_active":"2024-02-17T12:19:22.390097+0000","last_became_peered":"2024-02-17T12:19:22.390097+0000","last_unstale":"2024-02-17T12:19:23.536310+0000","last_undegraded":"2024-02-17T12:19:23.536310+0000","last_fullsized":"2024-02-17T12:19:23.536310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:35:45.209068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537328+0000","last_change":"2024-02-17T12:19:21.376109+0000","last_active":"2024-02-17T12:19:23.537328+0000","last_peered":"2024-02-17T12:19:23.537328+0000","last_clean":"2024-02-17T12:19:23.537328+0000","last_became_active":"2024-02-17T12:19:21.375805+0000","last_became_peered":"2024-02-17T12:19:21.375805+0000","last_unstale":"2024-02-17T12:19:23.537328+0000","last_undegraded":"2024-02-17T12:19:23.537328+0000","last_fullsized":"2024-02-17T12:19:23.537328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:31.884225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536511+0000","last_change":"2024-02-17T12:19:04.699129+0000","last_active":"2024-02-17T12:19:23.536511+0000","last_peered":"2024-02-17T12:19:23.536511+0000","last_clean":"2024-02-17T12:19:23.536511+0000","last_became_active":"2024-02-17T12:19:04.698800+0000","last_became_peered":"2024-02-17T12:19:04.698800+0000","last_unstale":"2024-02-17T12:19:23.536511+0000","last_undegraded":"2024-02-17T12:19:23.536511+0000","last_fullsized":"2024-02-17T12:19:23.536511+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:36:34.252865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380734+0000","last_change":"2024-02-17T12:19:03.705779+0000","last_active":"2024-02-17T12:19:23.380734+0000","last_peered":"2024-02-17T12:19:23.380734+0000","last_clean":"2024-02-17T12:19:23.380734+0000","last_became_active":"2024-02-17T12:19:03.705453+0000","last_became_peered":"2024-02-17T12:19:03.705453+0000","last_unstale":"2024-02-17T12:19:23.380734+0000","last_undegraded":"2024-02-17T12:19:23.380734+0000","last_fullsized":"2024-02-17T12:19:23.380734+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:20.550660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538181+0000","last_change":"2024-02-17T12:19:22.382589+0000","last_active":"2024-02-17T12:19:23.538181+0000","last_peered":"2024-02-17T12:19:23.538181+0000","last_clean":"2024-02-17T12:19:23.538181+0000","last_became_active":"2024-02-17T12:19:22.381978+0000","last_became_peered":"2024-02-17T12:19:22.381978+0000","last_unstale":"2024-02-17T12:19:23.538181+0000","last_undegraded":"2024-02-17T12:19:23.538181+0000","last_fullsized":"2024-02-17T12:19:23.538181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:28.744493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536272+0000","last_change":"2024-02-17T12:19:21.375339+0000","last_active":"2024-02-17T12:19:23.536272+0000","last_peered":"2024-02-17T12:19:23.536272+0000","last_clean":"2024-02-17T12:19:23.536272+0000","last_became_active":"2024-02-17T12:19:21.374436+0000","last_became_peered":"2024-02-17T12:19:21.374436+0000","last_unstale":"2024-02-17T12:19:23.536272+0000","last_undegraded":"2024-02-17T12:19:23.536272+0000","last_fullsized":"2024-02-17T12:19:23.536272+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:07.191313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535962+0000","last_change":"2024-02-17T12:19:04.717000+0000","last_active":"2024-02-17T12:19:23.535962+0000","last_peered":"2024-02-17T12:19:23.535962+0000","last_clean":"2024-02-17T12:19:23.535962+0000","last_became_active":"2024-02-17T12:19:04.716743+0000","last_became_peered":"2024-02-17T12:19:04.716743+0000","last_unstale":"2024-02-17T12:19:23.535962+0000","last_undegraded":"2024-02-17T12:19:23.535962+0000","last_fullsized":"2024-02-17T12:19:23.535962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:48:38.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536815+0000","last_change":"2024-02-17T12:19:03.710199+0000","last_active":"2024-02-17T12:19:23.536815+0000","last_peered":"2024-02-17T12:19:23.536815+0000","last_clean":"2024-02-17T12:19:23.536815+0000","last_became_active":"2024-02-17T12:19:03.709947+0000","last_became_peered":"2024-02-17T12:19:03.709947+0000","last_unstale":"2024-02-17T12:19:23.536815+0000","last_undegraded":"2024-02-17T12:19:23.536815+0000","last_fullsized":"2024-02-17T12:19:23.536815+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380107+0000","last_change":"2024-02-17T12:19:22.375575+0000","last_active":"2024-02-17T12:19:23.380107+0000","last_peered":"2024-02-17T12:19:23.380107+0000","last_clean":"2024-02-17T12:19:23.380107+0000","last_became_active":"2024-02-17T12:19:22.375217+0000","last_became_peered":"2024-02-17T12:19:22.375217+0000","last_unstale":"2024-02-17T12:19:23.380107+0000","last_undegraded":"2024-02-17T12:19:23.380107+0000","last_fullsized":"2024-02-17T12:19:23.380107+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:26.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535755+0000","last_change":"2024-02-17T12:19:21.368888+0000","last_active":"2024-02-17T12:19:23.535755+0000","last_peered":"2024-02-17T12:19:23.535755+0000","last_clean":"2024-02-17T12:19:23.535755+0000","last_became_active":"2024-02-17T12:19:21.368602+0000","last_became_peered":"2024-02-17T12:19:21.368602+0000","last_unstale":"2024-02-17T12:19:23.535755+0000","last_undegraded":"2024-02-17T12:19:23.535755+0000","last_fullsized":"2024-02-17T12:19:23.535755+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:43:57.615833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536701+0000","last_change":"2024-02-17T12:19:04.713606+0000","last_active":"2024-02-17T12:19:23.536701+0000","last_peered":"2024-02-17T12:19:23.536701+0000","last_clean":"2024-02-17T12:19:23.536701+0000","last_became_active":"2024-02-17T12:19:04.708088+0000","last_became_peered":"2024-02-17T12:19:04.708088+0000","last_unstale":"2024-02-17T12:19:23.536701+0000","last_undegraded":"2024-02-17T12:19:23.536701+0000","last_fullsized":"2024-02-17T12:19:23.536701+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:22.491827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379511+0000","last_change":"2024-02-17T12:19:03.701618+0000","last_active":"2024-02-17T12:19:23.379511+0000","last_peered":"2024-02-17T12:19:23.379511+0000","last_clean":"2024-02-17T12:19:23.379511+0000","last_became_active":"2024-02-17T12:19:03.701291+0000","last_became_peered":"2024-02-17T12:19:03.701291+0000","last_unstale":"2024-02-17T12:19:23.379511+0000","last_undegraded":"2024-02-17T12:19:23.379511+0000","last_fullsized":"2024-02-17T12:19:23.379511+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:13.448703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537887+0000","last_change":"2024-02-17T12:19:22.389793+0000","last_active":"2024-02-17T12:19:23.537887+0000","last_peered":"2024-02-17T12:19:23.537887+0000","last_clean":"2024-02-17T12:19:23.537887+0000","last_became_active":"2024-02-17T12:19:22.389415+0000","last_became_peered":"2024-02-17T12:19:22.389415+0000","last_unstale":"2024-02-17T12:19:23.537887+0000","last_undegraded":"2024-02-17T12:19:23.537887+0000","last_fullsized":"2024-02-17T12:19:23.537887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:26.992781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536720+0000","last_change":"2024-02-17T12:19:21.375230+0000","last_active":"2024-02-17T12:19:23.536720+0000","last_peered":"2024-02-17T12:19:23.536720+0000","last_clean":"2024-02-17T12:19:23.536720+0000","last_became_active":"2024-02-17T12:19:21.374933+0000","last_became_peered":"2024-02-17T12:19:21.374933+0000","last_unstale":"2024-02-17T12:19:23.536720+0000","last_undegraded":"2024-02-17T12:19:23.536720+0000","last_fullsized":"2024-02-17T12:19:23.536720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:09:40.208486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374855+0000","last_change":"2024-02-17T12:19:04.719250+0000","last_active":"2024-02-17T12:19:23.374855+0000","last_peered":"2024-02-17T12:19:23.374855+0000","last_clean":"2024-02-17T12:19:23.374855+0000","last_became_active":"2024-02-17T12:19:04.718856+0000","last_became_peered":"2024-02-17T12:19:04.718856+0000","last_unstale":"2024-02-17T12:19:23.374855+0000","last_undegraded":"2024-02-17T12:19:23.374855+0000","last_fullsized":"2024-02-17T12:19:23.374855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:43.814483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537757+0000","last_change":"2024-02-17T12:19:03.712148+0000","last_active":"2024-02-17T12:19:23.537757+0000","last_peered":"2024-02-17T12:19:23.537757+0000","last_clean":"2024-02-17T12:19:23.537757+0000","last_became_active":"2024-02-17T12:19:03.711771+0000","last_became_peered":"2024-02-17T12:19:03.711771+0000","last_unstale":"2024-02-17T12:19:23.537757+0000","last_undegraded":"2024-02-17T12:19:23.537757+0000","last_fullsized":"2024-02-17T12:19:23.537757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:53.868822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":265,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536127+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:19:23.536127+0000","last_peered":"2024-02-17T12:19:23.536127+0000","last_clean":"2024-02-17T12:19:23.536127+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:19:23.536127+0000","last_undegraded":"2024-02-17T12:19:23.536127+0000","last_fullsized":"2024-02-17T12:19:23.536127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":897024,"data_stored":390518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97299999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.115,"15min":1.115},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.143,"15min":1.143},"last":0.51200000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0640000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.623}]},{"osd":3,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":1.734,"15min":1.734},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.65600000000000003}]},{"osd":4,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.432},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0840000000000001,"5min":1.804,"15min":1.804},"last":0.46000000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.5,"15min":1.5},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.58499999999999996}]},{"osd":7,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1419999999999999,"5min":1.855,"15min":1.855},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.69799999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":897024,"data_stored":392379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68600000000000005,"15min":0.68700000000000006},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85099999999999998,"5min":1.103,"15min":1.103},"last":0.996}]},{"osd":1,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.84699999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89700000000000002,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92900000000000005,"5min":1.377,"15min":1.377},"last":1.113}]},{"osd":3,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.038,"5min":1.415,"15min":1.415},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80000000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.145}]},{"osd":4,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89000000000000001,"5min":1.52,"15min":1.52},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.73499999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.434,"15min":0.434},"max":{"1min":0.93300000000000005,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92000000000000004,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.77800000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":905216,"data_stored":393921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57599999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.30399999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54600000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.438},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.014,"5min":1.387,"15min":1.387},"last":0.49299999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0409999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.62}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.149,"5min":1.714,"15min":1.714},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1339999999999999,"5min":1.744,"15min":1.744},"last":0.67400000000000004}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0980000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0720000000000001,"5min":1.575,"15min":1.575},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95099999999999996,"5min":1.321,"15min":1.321},"last":0.60699999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":389366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":1.145,"15min":1.145},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60599999999999998,"15min":0.66600000000000004},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.439}]},{"osd":2,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.755},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.45600000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.626,"15min":0.66100000000000003},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":2.609,"15min":2.609},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.68200000000000005,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.375}]},{"osd":4,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.03,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.54700000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.012,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.042,"5min":1.095,"15min":1.095},"last":0.63400000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.96999999999999997,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.91600000000000004,"15min":0.98999999999999999},"min":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0549999999999999,"5min":5.375,"15min":5.375},"last":0.747}]},{"osd":7,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.92400000000000004,"15min":0.998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95099999999999996,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":1.629,"15min":1.629},"last":0.69999999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1478656,"data_stored":980156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.38}]},{"osd":2,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58799999999999997,"5min":1.046,"15min":1.046},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66700000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96699999999999997,"5min":1.139,"15min":1.139},"last":0.495},{"interface":"front","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.746,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.071,"15min":1.071},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.095,"15min":1.095},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.008,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.749},"min":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.55600000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1470464,"data_stored":972565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97399999999999998,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.50700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.502}]},{"osd":4,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61799999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98199999999999998,"5min":1.052,"15min":1.052},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.64300000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":390908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81699999999999995,"5min":1.264,"15min":1.264},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89200000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.749,"15min":0.755},"min":{"1min":0.61599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96699999999999997,"5min":1.198,"15min":1.198},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48999999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.171,"15min":1.171},"last":0.72499999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1040000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.999,"5min":1.522,"15min":1.522},"last":0.82299999999999995}]},{"osd":5,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.503},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60899999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":1.228,"15min":1.228},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":872448,"data_stored":382631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.376},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45600000000000002},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.439}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.179,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93200000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.59799999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.042,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.995,"5min":1.252,"15min":1.252},"last":0.71599999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0669999999999999,"5min":1.29,"15min":1.29},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1319999999999999,"5min":1.337,"15min":1.337},"last":0.82899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:19:30.988 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:19:31.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa46b000640 1 Processor -- start 2024-02-17T12:19:31.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa46b000640 1 -- start start 2024-02-17T12:19:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa46b000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4640c6460 0x7fa46406ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa46b000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa464154e30 0x7fa4640aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa46b000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa464155dd0 con 0x7fa464152540 2024-02-17T12:19:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa46b000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4641588c0 con 0x7fa464154e30 2024-02-17T12:19:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa46b000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa464155810 con 0x7fa4640c6460 2024-02-17T12:19:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa469000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa464154e30 0x7fa4640aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa469000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa464154e30 0x7fa4640aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35476/0 (socket says 172.21.15.114:35476) 2024-02-17T12:19:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa469000640 1 -- 172.21.15.114:0/2202720657 learned_addr learned my addr 172.21.15.114:0/2202720657 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa45be00640 1 --2- 172.21.15.114:0/2202720657 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4640c6460 0x7fa46406ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa469000640 1 -- 172.21.15.114:0/2202720657 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4640c6460 msgr2=0x7fa46406ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:31.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa469000640 1 --2- 172.21.15.114:0/2202720657 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4640c6460 0x7fa46406ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa469000640 1 -- 172.21.15.114:0/2202720657 >> v1:172.21.15.116:6789/0 conn(0x7fa464152540 legacy=0x7fa464158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.132+0000 7fa469000640 1 -- 172.21.15.114:0/2202720657 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464155af0 con 0x7fa464154e30 2024-02-17T12:19:31.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa469000640 1 --2- 172.21.15.114:0/2202720657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464154e30 0x7fa4640aa160 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009e50 tx=0x7fa45c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9a65597a7ecb79 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa463400640 1 -- 172.21.15.114:0/2202720657 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0a56e0 con 0x7fa464154e30 2024-02-17T12:19:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa463400640 1 -- 172.21.15.114:0/2202720657 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c0a5840 con 0x7fa464154e30 2024-02-17T12:19:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa463400640 1 -- 172.21.15.114:0/2202720657 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0a5bd0 con 0x7fa464154e30 2024-02-17T12:19:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa46b000640 1 -- 172.21.15.114:0/2202720657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464154e30 msgr2=0x7fa4640aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa46b000640 1 --2- 172.21.15.114:0/2202720657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464154e30 0x7fa4640aa160 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009e50 tx=0x7fa45c01c910 comp rx=0 tx=0).stop 2024-02-17T12:19:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa46b000640 1 -- 172.21.15.114:0/2202720657 shutdown_connections 2024-02-17T12:19:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa46b000640 1 --2- 172.21.15.114:0/2202720657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464154e30 0x7fa4640aa160 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa46b000640 1 --2- 172.21.15.114:0/2202720657 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa4640c6460 0x7fa46406ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa46b000640 1 -- 172.21.15.114:0/2202720657 >> 172.21.15.114:0/2202720657 conn(0x7fa4640c4f20 msgr2=0x7fa4640c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa46b000640 1 -- 172.21.15.114:0/2202720657 shutdown_connections 2024-02-17T12:19:31.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.136+0000 7fa46b000640 1 -- 172.21.15.114:0/2202720657 wait complete. 2024-02-17T12:19:31.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 Processor -- start 2024-02-17T12:19:31.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 -- start start 2024-02-17T12:19:31.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4640c6460 0x7fa46406c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464152540 0x7fa46406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa464154e30 0x7fa46414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4641507d0 con 0x7fa464152540 2024-02-17T12:19:31.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46406caa0 con 0x7fa4640c6460 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa464150a70 con 0x7fa464154e30 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa45be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464152540 0x7fa46406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa45be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464152540 0x7fa46406d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35486/0 (socket says 172.21.15.114:35486) 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa45be00640 1 -- 172.21.15.114:0/4065049102 learned_addr learned my addr 172.21.15.114:0/4065049102 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa463e00640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4640c6460 0x7fa46406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa469000640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa464154e30 0x7fa46414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa45be00640 1 -- 172.21.15.114:0/4065049102 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa464154e30 msgr2=0x7fa46414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa45be00640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa464154e30 0x7fa46414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa45be00640 1 -- 172.21.15.114:0/4065049102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4640c6460 msgr2=0x7fa46406c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa45be00640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4640c6460 0x7fa46406c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa45be00640 1 -- 172.21.15.114:0/4065049102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c009b30 con 0x7fa464152540 2024-02-17T12:19:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa463e00640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4640c6460 0x7fa46406c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa469000640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa464154e30 0x7fa46414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa45be00640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464152540 0x7fa46406d350 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00d800 tx=0x7fa44c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa460c00640 1 -- 172.21.15.114:0/4065049102 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c00b6c0 con 0x7fa464152540 2024-02-17T12:19:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa460c00640 1 -- 172.21.15.114:0/4065049102 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c00b820 con 0x7fa464152540 2024-02-17T12:19:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa460c00640 1 -- 172.21.15.114:0/4065049102 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c00bb90 con 0x7fa464152540 2024-02-17T12:19:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 -- 172.21.15.114:0/4065049102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa464149ed0 con 0x7fa464152540 2024-02-17T12:19:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 -- 172.21.15.114:0/4065049102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46406c790 con 0x7fa464152540 2024-02-17T12:19:31.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.140+0000 7fa46b000640 1 -- 172.21.15.114:0/4065049102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa464074840 con 0x7fa464152540 2024-02-17T12:19:31.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.144+0000 7fa460c00640 1 -- 172.21.15.114:0/4065049102 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa44c00bcf0 con 0x7fa464152540 2024-02-17T12:19:31.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.144+0000 7fa460c00640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa440066e40 0x7fa440069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.144+0000 7fa460c00640 1 -- 172.21.15.114:0/4065049102 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa44c085280 con 0x7fa464152540 2024-02-17T12:19:31.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.144+0000 7fa463e00640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa440066e40 0x7fa440069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.144+0000 7fa463e00640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa440066e40 0x7fa440069300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4640ae9a0 tx=0x7fa454009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:31.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.148+0000 7fa460c00640 1 -- 172.21.15.114:0/4065049102 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa44c051da0 con 0x7fa464152540 2024-02-17T12:19:31.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.300+0000 7fa46b000640 1 -- 172.21.15.114:0/4065049102 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa464067da0 con 0x7fa440066e40 2024-02-17T12:19:31.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.312+0000 7fa460c00640 1 -- 172.21.15.114:0/4065049102 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527745 (secure 0 0 0) 0x7fa464067da0 con 0x7fa440066e40 2024-02-17T12:19:31.323 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:31.327 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:19:31.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 -- 172.21.15.114:0/4065049102 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa440066e40 msgr2=0x7fa440069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa440066e40 0x7fa440069300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa4640ae9a0 tx=0x7fa454009040 comp rx=0 tx=0).stop 2024-02-17T12:19:31.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 -- 172.21.15.114:0/4065049102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464152540 msgr2=0x7fa46406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464152540 0x7fa46406d350 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00d800 tx=0x7fa44c00dcc0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 -- 172.21.15.114:0/4065049102 shutdown_connections 2024-02-17T12:19:31.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa464154e30 0x7fa46414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa440066e40 0x7fa440069300 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa464152540 0x7fa46406d350 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 --2- 172.21.15.114:0/4065049102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4640c6460 0x7fa46406c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 -- 172.21.15.114:0/4065049102 >> 172.21.15.114:0/4065049102 conn(0x7fa4640c4f20 msgr2=0x7fa4640c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 -- 172.21.15.114:0/4065049102 shutdown_connections 2024-02-17T12:19:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.320+0000 7fa46b000640 1 -- 172.21.15.114:0/4065049102 wait complete. 2024-02-17T12:19:31.342 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-02-17T12:19:31.256590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596691,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245128,"kb_used_data":8136,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754729592,"statfs":{"total":773094113280,"available":772843102208,"internally_reserved":0,"allocated":8331264,"data_stored":4306758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.904043"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374764+0000","last_change":"2024-02-17T12:19:22.372866+0000","last_active":"2024-02-17T12:19:23.374764+0000","last_peered":"2024-02-17T12:19:23.374764+0000","last_clean":"2024-02-17T12:19:23.374764+0000","last_became_active":"2024-02-17T12:19:22.367866+0000","last_became_peered":"2024-02-17T12:19:22.367866+0000","last_unstale":"2024-02-17T12:19:23.374764+0000","last_undegraded":"2024-02-17T12:19:23.374764+0000","last_fullsized":"2024-02-17T12:19:23.374764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:09:24.409975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536287+0000","last_change":"2024-02-17T12:19:04.712400+0000","last_active":"2024-02-17T12:19:23.536287+0000","last_peered":"2024-02-17T12:19:23.536287+0000","last_clean":"2024-02-17T12:19:23.536287+0000","last_became_active":"2024-02-17T12:19:04.711598+0000","last_became_peered":"2024-02-17T12:19:04.711598+0000","last_unstale":"2024-02-17T12:19:23.536287+0000","last_undegraded":"2024-02-17T12:19:23.536287+0000","last_fullsized":"2024-02-17T12:19:23.536287+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:54:02.628891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537250+0000","last_change":"2024-02-17T12:19:22.376081+0000","last_active":"2024-02-17T12:19:23.537250+0000","last_peered":"2024-02-17T12:19:23.537250+0000","last_clean":"2024-02-17T12:19:23.537250+0000","last_became_active":"2024-02-17T12:19:22.373107+0000","last_became_peered":"2024-02-17T12:19:22.373107+0000","last_unstale":"2024-02-17T12:19:23.537250+0000","last_undegraded":"2024-02-17T12:19:23.537250+0000","last_fullsized":"2024-02-17T12:19:23.537250+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:07:54.942290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375063+0000","last_change":"2024-02-17T12:19:04.723008+0000","last_active":"2024-02-17T12:19:23.375063+0000","last_peered":"2024-02-17T12:19:23.375063+0000","last_clean":"2024-02-17T12:19:23.375063+0000","last_became_active":"2024-02-17T12:19:04.722730+0000","last_became_peered":"2024-02-17T12:19:04.722730+0000","last_unstale":"2024-02-17T12:19:23.375063+0000","last_undegraded":"2024-02-17T12:19:23.375063+0000","last_fullsized":"2024-02-17T12:19:23.375063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:43.709806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375043+0000","last_change":"2024-02-17T12:19:22.376699+0000","last_active":"2024-02-17T12:19:23.375043+0000","last_peered":"2024-02-17T12:19:23.375043+0000","last_clean":"2024-02-17T12:19:23.375043+0000","last_became_active":"2024-02-17T12:19:22.375901+0000","last_became_peered":"2024-02-17T12:19:22.375901+0000","last_unstale":"2024-02-17T12:19:23.375043+0000","last_undegraded":"2024-02-17T12:19:23.375043+0000","last_fullsized":"2024-02-17T12:19:23.375043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:40.154535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537537+0000","last_change":"2024-02-17T12:19:04.710193+0000","last_active":"2024-02-17T12:19:23.537537+0000","last_peered":"2024-02-17T12:19:23.537537+0000","last_clean":"2024-02-17T12:19:23.537537+0000","last_became_active":"2024-02-17T12:19:04.709527+0000","last_became_peered":"2024-02-17T12:19:04.709527+0000","last_unstale":"2024-02-17T12:19:23.537537+0000","last_undegraded":"2024-02-17T12:19:23.537537+0000","last_fullsized":"2024-02-17T12:19:23.537537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:10:56.143323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536961+0000","last_change":"2024-02-17T12:19:22.361226+0000","last_active":"2024-02-17T12:19:23.536961+0000","last_peered":"2024-02-17T12:19:23.536961+0000","last_clean":"2024-02-17T12:19:23.536961+0000","last_became_active":"2024-02-17T12:19:22.360955+0000","last_became_peered":"2024-02-17T12:19:22.360955+0000","last_unstale":"2024-02-17T12:19:23.536961+0000","last_undegraded":"2024-02-17T12:19:23.536961+0000","last_fullsized":"2024-02-17T12:19:23.536961+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:16:00.710300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537666+0000","last_change":"2024-02-17T12:19:04.728530+0000","last_active":"2024-02-17T12:19:23.537666+0000","last_peered":"2024-02-17T12:19:23.537666+0000","last_clean":"2024-02-17T12:19:23.537666+0000","last_became_active":"2024-02-17T12:19:04.728245+0000","last_became_peered":"2024-02-17T12:19:04.728245+0000","last_unstale":"2024-02-17T12:19:23.537666+0000","last_undegraded":"2024-02-17T12:19:23.537666+0000","last_fullsized":"2024-02-17T12:19:23.537666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:24:22.116393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535753+0000","last_change":"2024-02-17T12:19:22.369693+0000","last_active":"2024-02-17T12:19:23.535753+0000","last_peered":"2024-02-17T12:19:23.535753+0000","last_clean":"2024-02-17T12:19:23.535753+0000","last_became_active":"2024-02-17T12:19:22.368141+0000","last_became_peered":"2024-02-17T12:19:22.368141+0000","last_unstale":"2024-02-17T12:19:23.535753+0000","last_undegraded":"2024-02-17T12:19:23.535753+0000","last_fullsized":"2024-02-17T12:19:23.535753+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:45:16.792200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380238+0000","last_change":"2024-02-17T12:19:04.727165+0000","last_active":"2024-02-17T12:19:23.380238+0000","last_peered":"2024-02-17T12:19:23.380238+0000","last_clean":"2024-02-17T12:19:23.380238+0000","last_became_active":"2024-02-17T12:19:04.726850+0000","last_became_peered":"2024-02-17T12:19:04.726850+0000","last_unstale":"2024-02-17T12:19:23.380238+0000","last_undegraded":"2024-02-17T12:19:23.380238+0000","last_fullsized":"2024-02-17T12:19:23.380238+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:54.875823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537084+0000","last_change":"2024-02-17T12:19:22.368525+0000","last_active":"2024-02-17T12:19:23.537084+0000","last_peered":"2024-02-17T12:19:23.537084+0000","last_clean":"2024-02-17T12:19:23.537084+0000","last_became_active":"2024-02-17T12:19:22.368202+0000","last_became_peered":"2024-02-17T12:19:22.368202+0000","last_unstale":"2024-02-17T12:19:23.537084+0000","last_undegraded":"2024-02-17T12:19:23.537084+0000","last_fullsized":"2024-02-17T12:19:23.537084+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:06:13.563565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379920+0000","last_change":"2024-02-17T12:19:04.713676+0000","last_active":"2024-02-17T12:19:23.379920+0000","last_peered":"2024-02-17T12:19:23.379920+0000","last_clean":"2024-02-17T12:19:23.379920+0000","last_became_active":"2024-02-17T12:19:04.710032+0000","last_became_peered":"2024-02-17T12:19:04.710032+0000","last_unstale":"2024-02-17T12:19:23.379920+0000","last_undegraded":"2024-02-17T12:19:23.379920+0000","last_fullsized":"2024-02-17T12:19:23.379920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:12:53.707932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536228+0000","last_change":"2024-02-17T12:19:22.388054+0000","last_active":"2024-02-17T12:19:23.536228+0000","last_peered":"2024-02-17T12:19:23.536228+0000","last_clean":"2024-02-17T12:19:23.536228+0000","last_became_active":"2024-02-17T12:19:22.387745+0000","last_became_peered":"2024-02-17T12:19:22.387745+0000","last_unstale":"2024-02-17T12:19:23.536228+0000","last_undegraded":"2024-02-17T12:19:23.536228+0000","last_fullsized":"2024-02-17T12:19:23.536228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:59:13.071369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536303+0000","last_change":"2024-02-17T12:19:04.714280+0000","last_active":"2024-02-17T12:19:23.536303+0000","last_peered":"2024-02-17T12:19:23.536303+0000","last_clean":"2024-02-17T12:19:23.536303+0000","last_became_active":"2024-02-17T12:19:04.714025+0000","last_became_peered":"2024-02-17T12:19:04.714025+0000","last_unstale":"2024-02-17T12:19:23.536303+0000","last_undegraded":"2024-02-17T12:19:23.536303+0000","last_fullsized":"2024-02-17T12:19:23.536303+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:04:31.444208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536568+0000","last_change":"2024-02-17T12:19:22.376606+0000","last_active":"2024-02-17T12:19:23.536568+0000","last_peered":"2024-02-17T12:19:23.536568+0000","last_clean":"2024-02-17T12:19:23.536568+0000","last_became_active":"2024-02-17T12:19:22.375794+0000","last_became_peered":"2024-02-17T12:19:22.375794+0000","last_unstale":"2024-02-17T12:19:23.536568+0000","last_undegraded":"2024-02-17T12:19:23.536568+0000","last_fullsized":"2024-02-17T12:19:23.536568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:41:26.244504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379190+0000","last_change":"2024-02-17T12:19:04.716344+0000","last_active":"2024-02-17T12:19:23.379190+0000","last_peered":"2024-02-17T12:19:23.379190+0000","last_clean":"2024-02-17T12:19:23.379190+0000","last_became_active":"2024-02-17T12:19:04.716003+0000","last_became_peered":"2024-02-17T12:19:04.716003+0000","last_unstale":"2024-02-17T12:19:23.379190+0000","last_undegraded":"2024-02-17T12:19:23.379190+0000","last_fullsized":"2024-02-17T12:19:23.379190+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:37.092834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537290+0000","last_change":"2024-02-17T12:19:22.380385+0000","last_active":"2024-02-17T12:19:23.537290+0000","last_peered":"2024-02-17T12:19:23.537290+0000","last_clean":"2024-02-17T12:19:23.537290+0000","last_became_active":"2024-02-17T12:19:22.380030+0000","last_became_peered":"2024-02-17T12:19:22.380030+0000","last_unstale":"2024-02-17T12:19:23.537290+0000","last_undegraded":"2024-02-17T12:19:23.537290+0000","last_fullsized":"2024-02-17T12:19:23.537290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:33:39.599699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380107+0000","last_change":"2024-02-17T12:19:04.705511+0000","last_active":"2024-02-17T12:19:23.380107+0000","last_peered":"2024-02-17T12:19:23.380107+0000","last_clean":"2024-02-17T12:19:23.380107+0000","last_became_active":"2024-02-17T12:19:04.705195+0000","last_became_peered":"2024-02-17T12:19:04.705195+0000","last_unstale":"2024-02-17T12:19:23.380107+0000","last_undegraded":"2024-02-17T12:19:23.380107+0000","last_fullsized":"2024-02-17T12:19:23.380107+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:38:45.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380515+0000","last_change":"2024-02-17T12:19:22.376957+0000","last_active":"2024-02-17T12:19:23.380515+0000","last_peered":"2024-02-17T12:19:23.380515+0000","last_clean":"2024-02-17T12:19:23.380515+0000","last_became_active":"2024-02-17T12:19:22.375810+0000","last_became_peered":"2024-02-17T12:19:22.375810+0000","last_unstale":"2024-02-17T12:19:23.380515+0000","last_undegraded":"2024-02-17T12:19:23.380515+0000","last_fullsized":"2024-02-17T12:19:23.380515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:06:06.364890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537313+0000","last_change":"2024-02-17T12:19:04.721693+0000","last_active":"2024-02-17T12:19:23.537313+0000","last_peered":"2024-02-17T12:19:23.537313+0000","last_clean":"2024-02-17T12:19:23.537313+0000","last_became_active":"2024-02-17T12:19:04.721343+0000","last_became_peered":"2024-02-17T12:19:04.721343+0000","last_unstale":"2024-02-17T12:19:23.537313+0000","last_undegraded":"2024-02-17T12:19:23.537313+0000","last_fullsized":"2024-02-17T12:19:23.537313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:38.425090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381058+0000","last_change":"2024-02-17T12:19:22.370504+0000","last_active":"2024-02-17T12:19:23.381058+0000","last_peered":"2024-02-17T12:19:23.381058+0000","last_clean":"2024-02-17T12:19:23.381058+0000","last_became_active":"2024-02-17T12:19:22.370262+0000","last_became_peered":"2024-02-17T12:19:22.370262+0000","last_unstale":"2024-02-17T12:19:23.381058+0000","last_undegraded":"2024-02-17T12:19:23.381058+0000","last_fullsized":"2024-02-17T12:19:23.381058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:43:12.017524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374854+0000","last_change":"2024-02-17T12:19:04.717487+0000","last_active":"2024-02-17T12:19:23.374854+0000","last_peered":"2024-02-17T12:19:23.374854+0000","last_clean":"2024-02-17T12:19:23.374854+0000","last_became_active":"2024-02-17T12:19:04.717208+0000","last_became_peered":"2024-02-17T12:19:04.717208+0000","last_unstale":"2024-02-17T12:19:23.374854+0000","last_undegraded":"2024-02-17T12:19:23.374854+0000","last_fullsized":"2024-02-17T12:19:23.374854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:36:18.116201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537182+0000","last_change":"2024-02-17T12:19:22.381136+0000","last_active":"2024-02-17T12:19:23.537182+0000","last_peered":"2024-02-17T12:19:23.537182+0000","last_clean":"2024-02-17T12:19:23.537182+0000","last_became_active":"2024-02-17T12:19:22.379997+0000","last_became_peered":"2024-02-17T12:19:22.379997+0000","last_unstale":"2024-02-17T12:19:23.537182+0000","last_undegraded":"2024-02-17T12:19:23.537182+0000","last_fullsized":"2024-02-17T12:19:23.537182+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:07:54.942290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536256+0000","last_change":"2024-02-17T12:19:04.720687+0000","last_active":"2024-02-17T12:19:23.536256+0000","last_peered":"2024-02-17T12:19:23.536256+0000","last_clean":"2024-02-17T12:19:23.536256+0000","last_became_active":"2024-02-17T12:19:04.720429+0000","last_became_peered":"2024-02-17T12:19:04.720429+0000","last_unstale":"2024-02-17T12:19:23.536256+0000","last_undegraded":"2024-02-17T12:19:23.536256+0000","last_fullsized":"2024-02-17T12:19:23.536256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-19T00:13:30.982744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536240+0000","last_change":"2024-02-17T12:19:22.368923+0000","last_active":"2024-02-17T12:19:23.536240+0000","last_peered":"2024-02-17T12:19:23.536240+0000","last_clean":"2024-02-17T12:19:23.536240+0000","last_became_active":"2024-02-17T12:19:22.368664+0000","last_became_peered":"2024-02-17T12:19:22.368664+0000","last_unstale":"2024-02-17T12:19:23.536240+0000","last_undegraded":"2024-02-17T12:19:23.536240+0000","last_fullsized":"2024-02-17T12:19:23.536240+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:05.733697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536857+0000","last_change":"2024-02-17T12:19:04.711936+0000","last_active":"2024-02-17T12:19:23.536857+0000","last_peered":"2024-02-17T12:19:23.536857+0000","last_clean":"2024-02-17T12:19:23.536857+0000","last_became_active":"2024-02-17T12:19:04.711624+0000","last_became_peered":"2024-02-17T12:19:04.711624+0000","last_unstale":"2024-02-17T12:19:23.536857+0000","last_undegraded":"2024-02-17T12:19:23.536857+0000","last_fullsized":"2024-02-17T12:19:23.536857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:03:55.448178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535626+0000","last_change":"2024-02-17T12:19:22.375472+0000","last_active":"2024-02-17T12:19:23.535626+0000","last_peered":"2024-02-17T12:19:23.535626+0000","last_clean":"2024-02-17T12:19:23.535626+0000","last_became_active":"2024-02-17T12:19:22.375196+0000","last_became_peered":"2024-02-17T12:19:22.375196+0000","last_unstale":"2024-02-17T12:19:23.535626+0000","last_undegraded":"2024-02-17T12:19:23.535626+0000","last_fullsized":"2024-02-17T12:19:23.535626+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:17.057488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538389+0000","last_change":"2024-02-17T12:19:04.728727+0000","last_active":"2024-02-17T12:19:23.538389+0000","last_peered":"2024-02-17T12:19:23.538389+0000","last_clean":"2024-02-17T12:19:23.538389+0000","last_became_active":"2024-02-17T12:19:04.728194+0000","last_became_peered":"2024-02-17T12:19:04.728194+0000","last_unstale":"2024-02-17T12:19:23.538389+0000","last_undegraded":"2024-02-17T12:19:23.538389+0000","last_fullsized":"2024-02-17T12:19:23.538389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:07:54.785092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537771+0000","last_change":"2024-02-17T12:19:22.385290+0000","last_active":"2024-02-17T12:19:23.537771+0000","last_peered":"2024-02-17T12:19:23.537771+0000","last_clean":"2024-02-17T12:19:23.537771+0000","last_became_active":"2024-02-17T12:19:22.385011+0000","last_became_peered":"2024-02-17T12:19:22.385011+0000","last_unstale":"2024-02-17T12:19:23.537771+0000","last_undegraded":"2024-02-17T12:19:23.537771+0000","last_fullsized":"2024-02-17T12:19:23.537771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:52:59.929878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536295+0000","last_change":"2024-02-17T12:19:04.710789+0000","last_active":"2024-02-17T12:19:23.536295+0000","last_peered":"2024-02-17T12:19:23.536295+0000","last_clean":"2024-02-17T12:19:23.536295+0000","last_became_active":"2024-02-17T12:19:04.710321+0000","last_became_peered":"2024-02-17T12:19:04.710321+0000","last_unstale":"2024-02-17T12:19:23.536295+0000","last_undegraded":"2024-02-17T12:19:23.536295+0000","last_fullsized":"2024-02-17T12:19:23.536295+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:20.439350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537575+0000","last_change":"2024-02-17T12:19:22.389161+0000","last_active":"2024-02-17T12:19:23.537575+0000","last_peered":"2024-02-17T12:19:23.537575+0000","last_clean":"2024-02-17T12:19:23.537575+0000","last_became_active":"2024-02-17T12:19:22.388885+0000","last_became_peered":"2024-02-17T12:19:22.388885+0000","last_unstale":"2024-02-17T12:19:23.537575+0000","last_undegraded":"2024-02-17T12:19:23.537575+0000","last_fullsized":"2024-02-17T12:19:23.537575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:32.525943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379396+0000","last_change":"2024-02-17T12:19:04.714567+0000","last_active":"2024-02-17T12:19:23.379396+0000","last_peered":"2024-02-17T12:19:23.379396+0000","last_clean":"2024-02-17T12:19:23.379396+0000","last_became_active":"2024-02-17T12:19:04.714283+0000","last_became_peered":"2024-02-17T12:19:04.714283+0000","last_unstale":"2024-02-17T12:19:23.379396+0000","last_undegraded":"2024-02-17T12:19:23.379396+0000","last_fullsized":"2024-02-17T12:19:23.379396+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:36.579443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537786+0000","last_change":"2024-02-17T12:19:22.388259+0000","last_active":"2024-02-17T12:19:23.537786+0000","last_peered":"2024-02-17T12:19:23.537786+0000","last_clean":"2024-02-17T12:19:23.537786+0000","last_became_active":"2024-02-17T12:19:22.387822+0000","last_became_peered":"2024-02-17T12:19:22.387822+0000","last_unstale":"2024-02-17T12:19:23.537786+0000","last_undegraded":"2024-02-17T12:19:23.537786+0000","last_fullsized":"2024-02-17T12:19:23.537786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:23.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381171+0000","last_change":"2024-02-17T12:19:04.707760+0000","last_active":"2024-02-17T12:19:23.381171+0000","last_peered":"2024-02-17T12:19:23.381171+0000","last_clean":"2024-02-17T12:19:23.381171+0000","last_became_active":"2024-02-17T12:19:04.707499+0000","last_became_peered":"2024-02-17T12:19:04.707499+0000","last_unstale":"2024-02-17T12:19:23.381171+0000","last_undegraded":"2024-02-17T12:19:23.381171+0000","last_fullsized":"2024-02-17T12:19:23.381171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:24:01.313056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380698+0000","last_change":"2024-02-17T12:19:22.378610+0000","last_active":"2024-02-17T12:19:23.380698+0000","last_peered":"2024-02-17T12:19:23.380698+0000","last_clean":"2024-02-17T12:19:23.380698+0000","last_became_active":"2024-02-17T12:19:22.377368+0000","last_became_peered":"2024-02-17T12:19:22.377368+0000","last_unstale":"2024-02-17T12:19:23.380698+0000","last_undegraded":"2024-02-17T12:19:23.380698+0000","last_fullsized":"2024-02-17T12:19:23.380698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:39:32.414191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538289+0000","last_change":"2024-02-17T12:19:04.710944+0000","last_active":"2024-02-17T12:19:23.538289+0000","last_peered":"2024-02-17T12:19:23.538289+0000","last_clean":"2024-02-17T12:19:23.538289+0000","last_became_active":"2024-02-17T12:19:04.710625+0000","last_became_peered":"2024-02-17T12:19:04.710625+0000","last_unstale":"2024-02-17T12:19:23.538289+0000","last_undegraded":"2024-02-17T12:19:23.538289+0000","last_fullsized":"2024-02-17T12:19:23.538289+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:22:57.157645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537050+0000","last_change":"2024-02-17T12:19:22.367671+0000","last_active":"2024-02-17T12:19:23.537050+0000","last_peered":"2024-02-17T12:19:23.537050+0000","last_clean":"2024-02-17T12:19:23.537050+0000","last_became_active":"2024-02-17T12:19:22.367444+0000","last_became_peered":"2024-02-17T12:19:22.367444+0000","last_unstale":"2024-02-17T12:19:23.537050+0000","last_undegraded":"2024-02-17T12:19:23.537050+0000","last_fullsized":"2024-02-17T12:19:23.537050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:05.733697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536778+0000","last_change":"2024-02-17T12:19:04.718758+0000","last_active":"2024-02-17T12:19:23.536778+0000","last_peered":"2024-02-17T12:19:23.536778+0000","last_clean":"2024-02-17T12:19:23.536778+0000","last_became_active":"2024-02-17T12:19:04.718486+0000","last_became_peered":"2024-02-17T12:19:04.718486+0000","last_unstale":"2024-02-17T12:19:23.536778+0000","last_undegraded":"2024-02-17T12:19:23.536778+0000","last_fullsized":"2024-02-17T12:19:23.536778+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.895909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537294+0000","last_change":"2024-02-17T12:19:22.385130+0000","last_active":"2024-02-17T12:19:23.537294+0000","last_peered":"2024-02-17T12:19:23.537294+0000","last_clean":"2024-02-17T12:19:23.537294+0000","last_became_active":"2024-02-17T12:19:22.384885+0000","last_became_peered":"2024-02-17T12:19:22.384885+0000","last_unstale":"2024-02-17T12:19:23.537294+0000","last_undegraded":"2024-02-17T12:19:23.537294+0000","last_fullsized":"2024-02-17T12:19:23.537294+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:35:45.209068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537775+0000","last_change":"2024-02-17T12:19:04.714461+0000","last_active":"2024-02-17T12:19:23.537775+0000","last_peered":"2024-02-17T12:19:23.537775+0000","last_clean":"2024-02-17T12:19:23.537775+0000","last_became_active":"2024-02-17T12:19:04.714208+0000","last_became_peered":"2024-02-17T12:19:04.714208+0000","last_unstale":"2024-02-17T12:19:23.537775+0000","last_undegraded":"2024-02-17T12:19:23.537775+0000","last_fullsized":"2024-02-17T12:19:23.537775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:58:45.424685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535652+0000","last_change":"2024-02-17T12:19:22.365696+0000","last_active":"2024-02-17T12:19:23.535652+0000","last_peered":"2024-02-17T12:19:23.535652+0000","last_clean":"2024-02-17T12:19:23.535652+0000","last_became_active":"2024-02-17T12:19:22.365394+0000","last_became_peered":"2024-02-17T12:19:22.365394+0000","last_unstale":"2024-02-17T12:19:23.535652+0000","last_undegraded":"2024-02-17T12:19:23.535652+0000","last_fullsized":"2024-02-17T12:19:23.535652+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:55:55.797745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538193+0000","last_change":"2024-02-17T12:19:04.722346+0000","last_active":"2024-02-17T12:19:23.538193+0000","last_peered":"2024-02-17T12:19:23.538193+0000","last_clean":"2024-02-17T12:19:23.538193+0000","last_became_active":"2024-02-17T12:19:04.722106+0000","last_became_peered":"2024-02-17T12:19:04.722106+0000","last_unstale":"2024-02-17T12:19:23.538193+0000","last_undegraded":"2024-02-17T12:19:23.538193+0000","last_fullsized":"2024-02-17T12:19:23.538193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:11.976571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535907+0000","last_change":"2024-02-17T12:19:22.372825+0000","last_active":"2024-02-17T12:19:23.535907+0000","last_peered":"2024-02-17T12:19:23.535907+0000","last_clean":"2024-02-17T12:19:23.535907+0000","last_became_active":"2024-02-17T12:19:22.372503+0000","last_became_peered":"2024-02-17T12:19:22.372503+0000","last_unstale":"2024-02-17T12:19:23.535907+0000","last_undegraded":"2024-02-17T12:19:23.535907+0000","last_fullsized":"2024-02-17T12:19:23.535907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:52:37.591482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374470+0000","last_change":"2024-02-17T12:19:04.720604+0000","last_active":"2024-02-17T12:19:23.374470+0000","last_peered":"2024-02-17T12:19:23.374470+0000","last_clean":"2024-02-17T12:19:23.374470+0000","last_became_active":"2024-02-17T12:19:04.720350+0000","last_became_peered":"2024-02-17T12:19:04.720350+0000","last_unstale":"2024-02-17T12:19:23.374470+0000","last_undegraded":"2024-02-17T12:19:23.374470+0000","last_fullsized":"2024-02-17T12:19:23.374470+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:00:21.365282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537757+0000","last_change":"2024-02-17T12:19:22.380747+0000","last_active":"2024-02-17T12:19:23.537757+0000","last_peered":"2024-02-17T12:19:23.537757+0000","last_clean":"2024-02-17T12:19:23.537757+0000","last_became_active":"2024-02-17T12:19:22.380112+0000","last_became_peered":"2024-02-17T12:19:22.380112+0000","last_unstale":"2024-02-17T12:19:23.537757+0000","last_undegraded":"2024-02-17T12:19:23.537757+0000","last_fullsized":"2024-02-17T12:19:23.537757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:49:12.538531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536587+0000","last_change":"2024-02-17T12:19:04.716818+0000","last_active":"2024-02-17T12:19:23.536587+0000","last_peered":"2024-02-17T12:19:23.536587+0000","last_clean":"2024-02-17T12:19:23.536587+0000","last_became_active":"2024-02-17T12:19:04.716507+0000","last_became_peered":"2024-02-17T12:19:04.716507+0000","last_unstale":"2024-02-17T12:19:23.536587+0000","last_undegraded":"2024-02-17T12:19:23.536587+0000","last_fullsized":"2024-02-17T12:19:23.536587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:56:16.543982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536058+0000","last_change":"2024-02-17T12:19:22.362093+0000","last_active":"2024-02-17T12:19:23.536058+0000","last_peered":"2024-02-17T12:19:23.536058+0000","last_clean":"2024-02-17T12:19:23.536058+0000","last_became_active":"2024-02-17T12:19:22.361819+0000","last_became_peered":"2024-02-17T12:19:22.361819+0000","last_unstale":"2024-02-17T12:19:23.536058+0000","last_undegraded":"2024-02-17T12:19:23.536058+0000","last_fullsized":"2024-02-17T12:19:23.536058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:18:04.816919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536132+0000","last_change":"2024-02-17T12:19:04.708458+0000","last_active":"2024-02-17T12:19:23.536132+0000","last_peered":"2024-02-17T12:19:23.536132+0000","last_clean":"2024-02-17T12:19:23.536132+0000","last_became_active":"2024-02-17T12:19:04.708170+0000","last_became_peered":"2024-02-17T12:19:04.708170+0000","last_unstale":"2024-02-17T12:19:23.536132+0000","last_undegraded":"2024-02-17T12:19:23.536132+0000","last_fullsized":"2024-02-17T12:19:23.536132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:24:57.714106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537653+0000","last_change":"2024-02-17T12:19:22.380274+0000","last_active":"2024-02-17T12:19:23.537653+0000","last_peered":"2024-02-17T12:19:23.537653+0000","last_clean":"2024-02-17T12:19:23.537653+0000","last_became_active":"2024-02-17T12:19:22.379913+0000","last_became_peered":"2024-02-17T12:19:22.379913+0000","last_unstale":"2024-02-17T12:19:23.537653+0000","last_undegraded":"2024-02-17T12:19:23.537653+0000","last_fullsized":"2024-02-17T12:19:23.537653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:33:02.035794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375166+0000","last_change":"2024-02-17T12:19:04.726126+0000","last_active":"2024-02-17T12:19:23.375166+0000","last_peered":"2024-02-17T12:19:23.375166+0000","last_clean":"2024-02-17T12:19:23.375166+0000","last_became_active":"2024-02-17T12:19:04.725344+0000","last_became_peered":"2024-02-17T12:19:04.725344+0000","last_unstale":"2024-02-17T12:19:23.375166+0000","last_undegraded":"2024-02-17T12:19:23.375166+0000","last_fullsized":"2024-02-17T12:19:23.375166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:08:29.699648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536909+0000","last_change":"2024-02-17T12:19:22.392188+0000","last_active":"2024-02-17T12:19:23.536909+0000","last_peered":"2024-02-17T12:19:23.536909+0000","last_clean":"2024-02-17T12:19:23.536909+0000","last_became_active":"2024-02-17T12:19:22.391851+0000","last_became_peered":"2024-02-17T12:19:22.391851+0000","last_unstale":"2024-02-17T12:19:23.536909+0000","last_undegraded":"2024-02-17T12:19:23.536909+0000","last_fullsized":"2024-02-17T12:19:23.536909+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:18:00.473789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537028+0000","last_change":"2024-02-17T12:19:04.725988+0000","last_active":"2024-02-17T12:19:23.537028+0000","last_peered":"2024-02-17T12:19:23.537028+0000","last_clean":"2024-02-17T12:19:23.537028+0000","last_became_active":"2024-02-17T12:19:04.725703+0000","last_became_peered":"2024-02-17T12:19:04.725703+0000","last_unstale":"2024-02-17T12:19:23.537028+0000","last_undegraded":"2024-02-17T12:19:23.537028+0000","last_fullsized":"2024-02-17T12:19:23.537028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:26.113554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536897+0000","last_change":"2024-02-17T12:19:22.386280+0000","last_active":"2024-02-17T12:19:23.536897+0000","last_peered":"2024-02-17T12:19:23.536897+0000","last_clean":"2024-02-17T12:19:23.536897+0000","last_became_active":"2024-02-17T12:19:22.385788+0000","last_became_peered":"2024-02-17T12:19:22.385788+0000","last_unstale":"2024-02-17T12:19:23.536897+0000","last_undegraded":"2024-02-17T12:19:23.536897+0000","last_fullsized":"2024-02-17T12:19:23.536897+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:30:52.083369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380518+0000","last_change":"2024-02-17T12:19:04.718744+0000","last_active":"2024-02-17T12:19:23.380518+0000","last_peered":"2024-02-17T12:19:23.380518+0000","last_clean":"2024-02-17T12:19:23.380518+0000","last_became_active":"2024-02-17T12:19:04.717669+0000","last_became_peered":"2024-02-17T12:19:04.717669+0000","last_unstale":"2024-02-17T12:19:23.380518+0000","last_undegraded":"2024-02-17T12:19:23.380518+0000","last_fullsized":"2024-02-17T12:19:23.380518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:15.849867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537162+0000","last_change":"2024-02-17T12:19:22.364774+0000","last_active":"2024-02-17T12:19:23.537162+0000","last_peered":"2024-02-17T12:19:23.537162+0000","last_clean":"2024-02-17T12:19:23.537162+0000","last_became_active":"2024-02-17T12:19:22.364508+0000","last_became_peered":"2024-02-17T12:19:22.364508+0000","last_unstale":"2024-02-17T12:19:23.537162+0000","last_undegraded":"2024-02-17T12:19:23.537162+0000","last_fullsized":"2024-02-17T12:19:23.537162+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:22:35.457951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536644+0000","last_change":"2024-02-17T12:19:04.713023+0000","last_active":"2024-02-17T12:19:23.536644+0000","last_peered":"2024-02-17T12:19:23.536644+0000","last_clean":"2024-02-17T12:19:23.536644+0000","last_became_active":"2024-02-17T12:19:04.712535+0000","last_became_peered":"2024-02-17T12:19:04.712535+0000","last_unstale":"2024-02-17T12:19:23.536644+0000","last_undegraded":"2024-02-17T12:19:23.536644+0000","last_fullsized":"2024-02-17T12:19:23.536644+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:16:59.570840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536474+0000","last_change":"2024-02-17T12:19:22.384348+0000","last_active":"2024-02-17T12:19:23.536474+0000","last_peered":"2024-02-17T12:19:23.536474+0000","last_clean":"2024-02-17T12:19:23.536474+0000","last_became_active":"2024-02-17T12:19:22.384089+0000","last_became_peered":"2024-02-17T12:19:22.384089+0000","last_unstale":"2024-02-17T12:19:23.536474+0000","last_undegraded":"2024-02-17T12:19:23.536474+0000","last_fullsized":"2024-02-17T12:19:23.536474+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:22:35.457951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374363+0000","last_change":"2024-02-17T12:19:04.721331+0000","last_active":"2024-02-17T12:19:23.374363+0000","last_peered":"2024-02-17T12:19:23.374363+0000","last_clean":"2024-02-17T12:19:23.374363+0000","last_became_active":"2024-02-17T12:19:04.721066+0000","last_became_peered":"2024-02-17T12:19:04.721066+0000","last_unstale":"2024-02-17T12:19:23.374363+0000","last_undegraded":"2024-02-17T12:19:23.374363+0000","last_fullsized":"2024-02-17T12:19:23.374363+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:49:57.305678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374098+0000","last_change":"2024-02-17T12:19:22.374576+0000","last_active":"2024-02-17T12:19:23.374098+0000","last_peered":"2024-02-17T12:19:23.374098+0000","last_clean":"2024-02-17T12:19:23.374098+0000","last_became_active":"2024-02-17T12:19:22.370327+0000","last_became_peered":"2024-02-17T12:19:22.370327+0000","last_unstale":"2024-02-17T12:19:23.374098+0000","last_undegraded":"2024-02-17T12:19:23.374098+0000","last_fullsized":"2024-02-17T12:19:23.374098+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:48:44.686107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374503+0000","last_change":"2024-02-17T12:19:04.726119+0000","last_active":"2024-02-17T12:19:23.374503+0000","last_peered":"2024-02-17T12:19:23.374503+0000","last_clean":"2024-02-17T12:19:23.374503+0000","last_became_active":"2024-02-17T12:19:04.725509+0000","last_became_peered":"2024-02-17T12:19:04.725509+0000","last_unstale":"2024-02-17T12:19:23.374503+0000","last_undegraded":"2024-02-17T12:19:23.374503+0000","last_fullsized":"2024-02-17T12:19:23.374503+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:26:56.501011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536690+0000","last_change":"2024-02-17T12:19:22.373666+0000","last_active":"2024-02-17T12:19:23.536690+0000","last_peered":"2024-02-17T12:19:23.536690+0000","last_clean":"2024-02-17T12:19:23.536690+0000","last_became_active":"2024-02-17T12:19:22.367569+0000","last_became_peered":"2024-02-17T12:19:22.367569+0000","last_unstale":"2024-02-17T12:19:23.536690+0000","last_undegraded":"2024-02-17T12:19:23.536690+0000","last_fullsized":"2024-02-17T12:19:23.536690+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:37:38.428413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380391+0000","last_change":"2024-02-17T12:19:04.706739+0000","last_active":"2024-02-17T12:19:23.380391+0000","last_peered":"2024-02-17T12:19:23.380391+0000","last_clean":"2024-02-17T12:19:23.380391+0000","last_became_active":"2024-02-17T12:19:04.706454+0000","last_became_peered":"2024-02-17T12:19:04.706454+0000","last_unstale":"2024-02-17T12:19:23.380391+0000","last_undegraded":"2024-02-17T12:19:23.380391+0000","last_fullsized":"2024-02-17T12:19:23.380391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:47:14.863236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538605+0000","last_change":"2024-02-17T12:19:22.382789+0000","last_active":"2024-02-17T12:19:23.538605+0000","last_peered":"2024-02-17T12:19:23.538605+0000","last_clean":"2024-02-17T12:19:23.538605+0000","last_became_active":"2024-02-17T12:19:22.382329+0000","last_became_peered":"2024-02-17T12:19:22.382329+0000","last_unstale":"2024-02-17T12:19:23.538605+0000","last_undegraded":"2024-02-17T12:19:23.538605+0000","last_fullsized":"2024-02-17T12:19:23.538605+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:32.472749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535528+0000","last_change":"2024-02-17T12:19:04.729805+0000","last_active":"2024-02-17T12:19:23.535528+0000","last_peered":"2024-02-17T12:19:23.535528+0000","last_clean":"2024-02-17T12:19:23.535528+0000","last_became_active":"2024-02-17T12:19:04.729388+0000","last_became_peered":"2024-02-17T12:19:04.729388+0000","last_unstale":"2024-02-17T12:19:23.535528+0000","last_undegraded":"2024-02-17T12:19:23.535528+0000","last_fullsized":"2024-02-17T12:19:23.535528+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:09:06.747268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374752+0000","last_change":"2024-02-17T12:19:22.379912+0000","last_active":"2024-02-17T12:19:23.374752+0000","last_peered":"2024-02-17T12:19:23.374752+0000","last_clean":"2024-02-17T12:19:23.374752+0000","last_became_active":"2024-02-17T12:19:22.379560+0000","last_became_peered":"2024-02-17T12:19:22.379560+0000","last_unstale":"2024-02-17T12:19:23.374752+0000","last_undegraded":"2024-02-17T12:19:23.374752+0000","last_fullsized":"2024-02-17T12:19:23.374752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:05:14.132326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536723+0000","last_change":"2024-02-17T12:19:21.376471+0000","last_active":"2024-02-17T12:19:23.536723+0000","last_peered":"2024-02-17T12:19:23.536723+0000","last_clean":"2024-02-17T12:19:23.536723+0000","last_became_active":"2024-02-17T12:19:21.375256+0000","last_became_peered":"2024-02-17T12:19:21.375256+0000","last_unstale":"2024-02-17T12:19:23.536723+0000","last_undegraded":"2024-02-17T12:19:23.536723+0000","last_fullsized":"2024-02-17T12:19:23.536723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:24:15.784953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380519+0000","last_change":"2024-02-17T12:19:04.710643+0000","last_active":"2024-02-17T12:19:23.380519+0000","last_peered":"2024-02-17T12:19:23.380519+0000","last_clean":"2024-02-17T12:19:23.380519+0000","last_became_active":"2024-02-17T12:19:04.709363+0000","last_became_peered":"2024-02-17T12:19:04.709363+0000","last_unstale":"2024-02-17T12:19:23.380519+0000","last_undegraded":"2024-02-17T12:19:23.380519+0000","last_fullsized":"2024-02-17T12:19:23.380519+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:43:14.810042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"67'4","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536656+0000","last_change":"2024-02-17T12:19:03.709066+0000","last_active":"2024-02-17T12:19:23.536656+0000","last_peered":"2024-02-17T12:19:23.536656+0000","last_clean":"2024-02-17T12:19:23.536656+0000","last_became_active":"2024-02-17T12:19:03.708888+0000","last_became_peered":"2024-02-17T12:19:03.708888+0000","last_unstale":"2024-02-17T12:19:23.536656+0000","last_undegraded":"2024-02-17T12:19:23.536656+0000","last_fullsized":"2024-02-17T12:19:23.536656+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380917+0000","last_change":"2024-02-17T12:19:22.369924+0000","last_active":"2024-02-17T12:19:23.380917+0000","last_peered":"2024-02-17T12:19:23.380917+0000","last_clean":"2024-02-17T12:19:23.380917+0000","last_became_active":"2024-02-17T12:19:22.369681+0000","last_became_peered":"2024-02-17T12:19:22.369681+0000","last_unstale":"2024-02-17T12:19:23.380917+0000","last_undegraded":"2024-02-17T12:19:23.380917+0000","last_fullsized":"2024-02-17T12:19:23.380917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:54:28.541757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537380+0000","last_change":"2024-02-17T12:19:21.377243+0000","last_active":"2024-02-17T12:19:23.537380+0000","last_peered":"2024-02-17T12:19:23.537380+0000","last_clean":"2024-02-17T12:19:23.537380+0000","last_became_active":"2024-02-17T12:19:21.376701+0000","last_became_peered":"2024-02-17T12:19:21.376701+0000","last_unstale":"2024-02-17T12:19:23.537380+0000","last_undegraded":"2024-02-17T12:19:23.537380+0000","last_fullsized":"2024-02-17T12:19:23.537380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:33:29.544346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536419+0000","last_change":"2024-02-17T12:19:04.718756+0000","last_active":"2024-02-17T12:19:23.536419+0000","last_peered":"2024-02-17T12:19:23.536419+0000","last_clean":"2024-02-17T12:19:23.536419+0000","last_became_active":"2024-02-17T12:19:04.716924+0000","last_became_peered":"2024-02-17T12:19:04.716924+0000","last_unstale":"2024-02-17T12:19:23.536419+0000","last_undegraded":"2024-02-17T12:19:23.536419+0000","last_fullsized":"2024-02-17T12:19:23.536419+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:11.015091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380711+0000","last_change":"2024-02-17T12:19:03.703800+0000","last_active":"2024-02-17T12:19:23.380711+0000","last_peered":"2024-02-17T12:19:23.380711+0000","last_clean":"2024-02-17T12:19:23.380711+0000","last_became_active":"2024-02-17T12:19:03.703402+0000","last_became_peered":"2024-02-17T12:19:03.703402+0000","last_unstale":"2024-02-17T12:19:23.380711+0000","last_undegraded":"2024-02-17T12:19:23.380711+0000","last_fullsized":"2024-02-17T12:19:23.380711+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:37:23.098316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537751+0000","last_change":"2024-02-17T12:19:22.373889+0000","last_active":"2024-02-17T12:19:23.537751+0000","last_peered":"2024-02-17T12:19:23.537751+0000","last_clean":"2024-02-17T12:19:23.537751+0000","last_became_active":"2024-02-17T12:19:22.372667+0000","last_became_peered":"2024-02-17T12:19:22.372667+0000","last_unstale":"2024-02-17T12:19:23.537751+0000","last_undegraded":"2024-02-17T12:19:23.537751+0000","last_fullsized":"2024-02-17T12:19:23.537751+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:52:33.512575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"71'4","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536818+0000","last_change":"2024-02-17T12:19:21.373647+0000","last_active":"2024-02-17T12:19:23.536818+0000","last_peered":"2024-02-17T12:19:23.536818+0000","last_clean":"2024-02-17T12:19:23.536818+0000","last_became_active":"2024-02-17T12:19:21.373244+0000","last_became_peered":"2024-02-17T12:19:21.373244+0000","last_unstale":"2024-02-17T12:19:23.536818+0000","last_undegraded":"2024-02-17T12:19:23.536818+0000","last_fullsized":"2024-02-17T12:19:23.536818+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:42:17.473904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536967+0000","last_change":"2024-02-17T12:19:04.730207+0000","last_active":"2024-02-17T12:19:23.536967+0000","last_peered":"2024-02-17T12:19:23.536967+0000","last_clean":"2024-02-17T12:19:23.536967+0000","last_became_active":"2024-02-17T12:19:04.729363+0000","last_became_peered":"2024-02-17T12:19:04.729363+0000","last_unstale":"2024-02-17T12:19:23.536967+0000","last_undegraded":"2024-02-17T12:19:23.536967+0000","last_fullsized":"2024-02-17T12:19:23.536967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:32:13.428555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536876+0000","last_change":"2024-02-17T12:19:03.704331+0000","last_active":"2024-02-17T12:19:23.536876+0000","last_peered":"2024-02-17T12:19:23.536876+0000","last_clean":"2024-02-17T12:19:23.536876+0000","last_became_active":"2024-02-17T12:19:03.704078+0000","last_became_peered":"2024-02-17T12:19:03.704078+0000","last_unstale":"2024-02-17T12:19:23.536876+0000","last_undegraded":"2024-02-17T12:19:23.536876+0000","last_fullsized":"2024-02-17T12:19:23.536876+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536306+0000","last_change":"2024-02-17T12:19:22.379113+0000","last_active":"2024-02-17T12:19:23.536306+0000","last_peered":"2024-02-17T12:19:23.536306+0000","last_clean":"2024-02-17T12:19:23.536306+0000","last_became_active":"2024-02-17T12:19:22.378722+0000","last_became_peered":"2024-02-17T12:19:22.378722+0000","last_unstale":"2024-02-17T12:19:23.536306+0000","last_undegraded":"2024-02-17T12:19:23.536306+0000","last_fullsized":"2024-02-17T12:19:23.536306+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:06:13.563565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537210+0000","last_change":"2024-02-17T12:19:21.377375+0000","last_active":"2024-02-17T12:19:23.537210+0000","last_peered":"2024-02-17T12:19:23.537210+0000","last_clean":"2024-02-17T12:19:23.537210+0000","last_became_active":"2024-02-17T12:19:21.377083+0000","last_became_peered":"2024-02-17T12:19:21.377083+0000","last_unstale":"2024-02-17T12:19:23.537210+0000","last_undegraded":"2024-02-17T12:19:23.537210+0000","last_fullsized":"2024-02-17T12:19:23.537210+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:53.185121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537641+0000","last_change":"2024-02-17T12:19:04.710438+0000","last_active":"2024-02-17T12:19:23.537641+0000","last_peered":"2024-02-17T12:19:23.537641+0000","last_clean":"2024-02-17T12:19:23.537641+0000","last_became_active":"2024-02-17T12:19:04.709894+0000","last_became_peered":"2024-02-17T12:19:04.709894+0000","last_unstale":"2024-02-17T12:19:23.537641+0000","last_undegraded":"2024-02-17T12:19:23.537641+0000","last_fullsized":"2024-02-17T12:19:23.537641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:44.905808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537500+0000","last_change":"2024-02-17T12:19:03.702411+0000","last_active":"2024-02-17T12:19:23.537500+0000","last_peered":"2024-02-17T12:19:23.537500+0000","last_clean":"2024-02-17T12:19:23.537500+0000","last_became_active":"2024-02-17T12:19:03.702166+0000","last_became_peered":"2024-02-17T12:19:03.702166+0000","last_unstale":"2024-02-17T12:19:23.537500+0000","last_undegraded":"2024-02-17T12:19:23.537500+0000","last_fullsized":"2024-02-17T12:19:23.537500+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535601+0000","last_change":"2024-02-17T12:19:22.375330+0000","last_active":"2024-02-17T12:19:23.535601+0000","last_peered":"2024-02-17T12:19:23.535601+0000","last_clean":"2024-02-17T12:19:23.535601+0000","last_became_active":"2024-02-17T12:19:22.375017+0000","last_became_peered":"2024-02-17T12:19:22.375017+0000","last_unstale":"2024-02-17T12:19:23.535601+0000","last_undegraded":"2024-02-17T12:19:23.535601+0000","last_fullsized":"2024-02-17T12:19:23.535601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:16:00.710300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536507+0000","last_change":"2024-02-17T12:19:21.366120+0000","last_active":"2024-02-17T12:19:23.536507+0000","last_peered":"2024-02-17T12:19:23.536507+0000","last_clean":"2024-02-17T12:19:23.536507+0000","last_became_active":"2024-02-17T12:19:21.365805+0000","last_became_peered":"2024-02-17T12:19:21.365805+0000","last_unstale":"2024-02-17T12:19:23.536507+0000","last_undegraded":"2024-02-17T12:19:23.536507+0000","last_fullsized":"2024-02-17T12:19:23.536507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:02.834283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374608+0000","last_change":"2024-02-17T12:19:04.726343+0000","last_active":"2024-02-17T12:19:23.374608+0000","last_peered":"2024-02-17T12:19:23.374608+0000","last_clean":"2024-02-17T12:19:23.374608+0000","last_became_active":"2024-02-17T12:19:04.725870+0000","last_became_peered":"2024-02-17T12:19:04.725870+0000","last_unstale":"2024-02-17T12:19:23.374608+0000","last_undegraded":"2024-02-17T12:19:23.374608+0000","last_fullsized":"2024-02-17T12:19:23.374608+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:27:42.531689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380548+0000","last_change":"2024-02-17T12:19:03.703159+0000","last_active":"2024-02-17T12:19:23.380548+0000","last_peered":"2024-02-17T12:19:23.380548+0000","last_clean":"2024-02-17T12:19:23.380548+0000","last_became_active":"2024-02-17T12:19:03.702811+0000","last_became_peered":"2024-02-17T12:19:03.702811+0000","last_unstale":"2024-02-17T12:19:23.380548+0000","last_undegraded":"2024-02-17T12:19:23.380548+0000","last_fullsized":"2024-02-17T12:19:23.380548+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:16.831548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379607+0000","last_change":"2024-02-17T12:19:22.368488+0000","last_active":"2024-02-17T12:19:23.379607+0000","last_peered":"2024-02-17T12:19:23.379607+0000","last_clean":"2024-02-17T12:19:23.379607+0000","last_became_active":"2024-02-17T12:19:22.368213+0000","last_became_peered":"2024-02-17T12:19:22.368213+0000","last_unstale":"2024-02-17T12:19:23.379607+0000","last_undegraded":"2024-02-17T12:19:23.379607+0000","last_fullsized":"2024-02-17T12:19:23.379607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:09:41.215827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374109+0000","last_change":"2024-02-17T12:19:21.375502+0000","last_active":"2024-02-17T12:19:23.374109+0000","last_peered":"2024-02-17T12:19:23.374109+0000","last_clean":"2024-02-17T12:19:23.374109+0000","last_became_active":"2024-02-17T12:19:21.375075+0000","last_became_peered":"2024-02-17T12:19:21.375075+0000","last_unstale":"2024-02-17T12:19:23.374109+0000","last_undegraded":"2024-02-17T12:19:23.374109+0000","last_fullsized":"2024-02-17T12:19:23.374109+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:53.748200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380350+0000","last_change":"2024-02-17T12:19:04.708618+0000","last_active":"2024-02-17T12:19:23.380350+0000","last_peered":"2024-02-17T12:19:23.380350+0000","last_clean":"2024-02-17T12:19:23.380350+0000","last_became_active":"2024-02-17T12:19:04.708351+0000","last_became_peered":"2024-02-17T12:19:04.708351+0000","last_unstale":"2024-02-17T12:19:23.380350+0000","last_undegraded":"2024-02-17T12:19:23.380350+0000","last_fullsized":"2024-02-17T12:19:23.380350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:09.330073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380335+0000","last_change":"2024-02-17T12:19:03.706093+0000","last_active":"2024-02-17T12:19:23.380335+0000","last_peered":"2024-02-17T12:19:23.380335+0000","last_clean":"2024-02-17T12:19:23.380335+0000","last_became_active":"2024-02-17T12:19:03.705445+0000","last_became_peered":"2024-02-17T12:19:03.705445+0000","last_unstale":"2024-02-17T12:19:23.380335+0000","last_undegraded":"2024-02-17T12:19:23.380335+0000","last_fullsized":"2024-02-17T12:19:23.380335+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:30:29.842261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379824+0000","last_change":"2024-02-17T12:19:22.376298+0000","last_active":"2024-02-17T12:19:23.379824+0000","last_peered":"2024-02-17T12:19:23.379824+0000","last_clean":"2024-02-17T12:19:23.379824+0000","last_became_active":"2024-02-17T12:19:22.375342+0000","last_became_peered":"2024-02-17T12:19:22.375342+0000","last_unstale":"2024-02-17T12:19:23.379824+0000","last_undegraded":"2024-02-17T12:19:23.379824+0000","last_fullsized":"2024-02-17T12:19:23.379824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:28.677798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374395+0000","last_change":"2024-02-17T12:19:21.370519+0000","last_active":"2024-02-17T12:19:23.374395+0000","last_peered":"2024-02-17T12:19:23.374395+0000","last_clean":"2024-02-17T12:19:23.374395+0000","last_became_active":"2024-02-17T12:19:21.369831+0000","last_became_peered":"2024-02-17T12:19:21.369831+0000","last_unstale":"2024-02-17T12:19:23.374395+0000","last_undegraded":"2024-02-17T12:19:23.374395+0000","last_fullsized":"2024-02-17T12:19:23.374395+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:13:10.363299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535697+0000","last_change":"2024-02-17T12:19:04.714305+0000","last_active":"2024-02-17T12:19:23.535697+0000","last_peered":"2024-02-17T12:19:23.535697+0000","last_clean":"2024-02-17T12:19:23.535697+0000","last_became_active":"2024-02-17T12:19:04.714041+0000","last_became_peered":"2024-02-17T12:19:04.714041+0000","last_unstale":"2024-02-17T12:19:23.535697+0000","last_undegraded":"2024-02-17T12:19:23.535697+0000","last_fullsized":"2024-02-17T12:19:23.535697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:45:12.864476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535908+0000","last_change":"2024-02-17T12:19:03.701055+0000","last_active":"2024-02-17T12:19:23.535908+0000","last_peered":"2024-02-17T12:19:23.535908+0000","last_clean":"2024-02-17T12:19:23.535908+0000","last_became_active":"2024-02-17T12:19:03.695988+0000","last_became_peered":"2024-02-17T12:19:03.695988+0000","last_unstale":"2024-02-17T12:19:23.535908+0000","last_undegraded":"2024-02-17T12:19:23.535908+0000","last_fullsized":"2024-02-17T12:19:23.535908+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536792+0000","last_change":"2024-02-17T12:19:22.379284+0000","last_active":"2024-02-17T12:19:23.536792+0000","last_peered":"2024-02-17T12:19:23.536792+0000","last_clean":"2024-02-17T12:19:23.536792+0000","last_became_active":"2024-02-17T12:19:22.378837+0000","last_became_peered":"2024-02-17T12:19:22.378837+0000","last_unstale":"2024-02-17T12:19:23.536792+0000","last_undegraded":"2024-02-17T12:19:23.536792+0000","last_fullsized":"2024-02-17T12:19:23.536792+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:30:08.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536153+0000","last_change":"2024-02-17T12:19:21.378185+0000","last_active":"2024-02-17T12:19:23.536153+0000","last_peered":"2024-02-17T12:19:23.536153+0000","last_clean":"2024-02-17T12:19:23.536153+0000","last_became_active":"2024-02-17T12:19:21.377907+0000","last_became_peered":"2024-02-17T12:19:21.377907+0000","last_unstale":"2024-02-17T12:19:23.536153+0000","last_undegraded":"2024-02-17T12:19:23.536153+0000","last_fullsized":"2024-02-17T12:19:23.536153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:09:37.094716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536582+0000","last_change":"2024-02-17T12:19:04.710559+0000","last_active":"2024-02-17T12:19:23.536582+0000","last_peered":"2024-02-17T12:19:23.536582+0000","last_clean":"2024-02-17T12:19:23.536582+0000","last_became_active":"2024-02-17T12:19:04.709979+0000","last_became_peered":"2024-02-17T12:19:04.709979+0000","last_unstale":"2024-02-17T12:19:23.536582+0000","last_undegraded":"2024-02-17T12:19:23.536582+0000","last_fullsized":"2024-02-17T12:19:23.536582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:33:12.888980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374414+0000","last_change":"2024-02-17T12:19:03.702309+0000","last_active":"2024-02-17T12:19:23.374414+0000","last_peered":"2024-02-17T12:19:23.374414+0000","last_clean":"2024-02-17T12:19:23.374414+0000","last_became_active":"2024-02-17T12:19:03.702051+0000","last_became_peered":"2024-02-17T12:19:03.702051+0000","last_unstale":"2024-02-17T12:19:23.374414+0000","last_undegraded":"2024-02-17T12:19:23.374414+0000","last_fullsized":"2024-02-17T12:19:23.374414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:48:58.978525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536166+0000","last_change":"2024-02-17T12:19:22.379801+0000","last_active":"2024-02-17T12:19:23.536166+0000","last_peered":"2024-02-17T12:19:23.536166+0000","last_clean":"2024-02-17T12:19:23.536166+0000","last_became_active":"2024-02-17T12:19:22.379377+0000","last_became_peered":"2024-02-17T12:19:22.379377+0000","last_unstale":"2024-02-17T12:19:23.536166+0000","last_undegraded":"2024-02-17T12:19:23.536166+0000","last_fullsized":"2024-02-17T12:19:23.536166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:22:35.457951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"71'3","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537726+0000","last_change":"2024-02-17T12:19:21.375965+0000","last_active":"2024-02-17T12:19:23.537726+0000","last_peered":"2024-02-17T12:19:23.537726+0000","last_clean":"2024-02-17T12:19:23.537726+0000","last_became_active":"2024-02-17T12:19:21.375551+0000","last_became_peered":"2024-02-17T12:19:21.375551+0000","last_unstale":"2024-02-17T12:19:23.537726+0000","last_undegraded":"2024-02-17T12:19:23.537726+0000","last_fullsized":"2024-02-17T12:19:23.537726+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:25.240966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537347+0000","last_change":"2024-02-17T12:19:04.726001+0000","last_active":"2024-02-17T12:19:23.537347+0000","last_peered":"2024-02-17T12:19:23.537347+0000","last_clean":"2024-02-17T12:19:23.537347+0000","last_became_active":"2024-02-17T12:19:04.725747+0000","last_became_peered":"2024-02-17T12:19:04.725747+0000","last_unstale":"2024-02-17T12:19:23.537347+0000","last_undegraded":"2024-02-17T12:19:23.537347+0000","last_fullsized":"2024-02-17T12:19:23.537347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:18:38.213214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536956+0000","last_change":"2024-02-17T12:19:03.712851+0000","last_active":"2024-02-17T12:19:23.536956+0000","last_peered":"2024-02-17T12:19:23.536956+0000","last_clean":"2024-02-17T12:19:23.536956+0000","last_became_active":"2024-02-17T12:19:03.712584+0000","last_became_peered":"2024-02-17T12:19:03.712584+0000","last_unstale":"2024-02-17T12:19:23.536956+0000","last_undegraded":"2024-02-17T12:19:23.536956+0000","last_fullsized":"2024-02-17T12:19:23.536956+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537449+0000","last_change":"2024-02-17T12:19:22.379237+0000","last_active":"2024-02-17T12:19:23.537449+0000","last_peered":"2024-02-17T12:19:23.537449+0000","last_clean":"2024-02-17T12:19:23.537449+0000","last_became_active":"2024-02-17T12:19:22.377019+0000","last_became_peered":"2024-02-17T12:19:22.377019+0000","last_unstale":"2024-02-17T12:19:23.537449+0000","last_undegraded":"2024-02-17T12:19:23.537449+0000","last_fullsized":"2024-02-17T12:19:23.537449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:50:53.311764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"71'6","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380677+0000","last_change":"2024-02-17T12:19:21.372337+0000","last_active":"2024-02-17T12:19:23.380677+0000","last_peered":"2024-02-17T12:19:23.380677+0000","last_clean":"2024-02-17T12:19:23.380677+0000","last_became_active":"2024-02-17T12:19:21.371919+0000","last_became_peered":"2024-02-17T12:19:21.371919+0000","last_unstale":"2024-02-17T12:19:23.380677+0000","last_undegraded":"2024-02-17T12:19:23.380677+0000","last_fullsized":"2024-02-17T12:19:23.380677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:11:12.798689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380196+0000","last_change":"2024-02-17T12:19:04.709578+0000","last_active":"2024-02-17T12:19:23.380196+0000","last_peered":"2024-02-17T12:19:23.380196+0000","last_clean":"2024-02-17T12:19:23.380196+0000","last_became_active":"2024-02-17T12:19:04.709173+0000","last_became_peered":"2024-02-17T12:19:04.709173+0000","last_unstale":"2024-02-17T12:19:23.380196+0000","last_undegraded":"2024-02-17T12:19:23.380196+0000","last_fullsized":"2024-02-17T12:19:23.380196+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:20:19.580489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537412+0000","last_change":"2024-02-17T12:19:03.707721+0000","last_active":"2024-02-17T12:19:23.537412+0000","last_peered":"2024-02-17T12:19:23.537412+0000","last_clean":"2024-02-17T12:19:23.537412+0000","last_became_active":"2024-02-17T12:19:03.707435+0000","last_became_peered":"2024-02-17T12:19:03.707435+0000","last_unstale":"2024-02-17T12:19:23.537412+0000","last_undegraded":"2024-02-17T12:19:23.537412+0000","last_fullsized":"2024-02-17T12:19:23.537412+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536703+0000","last_change":"2024-02-17T12:19:22.370538+0000","last_active":"2024-02-17T12:19:23.536703+0000","last_peered":"2024-02-17T12:19:23.536703+0000","last_clean":"2024-02-17T12:19:23.536703+0000","last_became_active":"2024-02-17T12:19:22.370270+0000","last_became_peered":"2024-02-17T12:19:22.370270+0000","last_unstale":"2024-02-17T12:19:23.536703+0000","last_undegraded":"2024-02-17T12:19:23.536703+0000","last_fullsized":"2024-02-17T12:19:23.536703+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:31:14.612133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375137+0000","last_change":"2024-02-17T12:19:21.368558+0000","last_active":"2024-02-17T12:19:23.375137+0000","last_peered":"2024-02-17T12:19:23.375137+0000","last_clean":"2024-02-17T12:19:23.375137+0000","last_became_active":"2024-02-17T12:19:21.368198+0000","last_became_peered":"2024-02-17T12:19:21.368198+0000","last_unstale":"2024-02-17T12:19:23.375137+0000","last_undegraded":"2024-02-17T12:19:23.375137+0000","last_fullsized":"2024-02-17T12:19:23.375137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:25.861028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537464+0000","last_change":"2024-02-17T12:19:04.716812+0000","last_active":"2024-02-17T12:19:23.537464+0000","last_peered":"2024-02-17T12:19:23.537464+0000","last_clean":"2024-02-17T12:19:23.537464+0000","last_became_active":"2024-02-17T12:19:04.716307+0000","last_became_peered":"2024-02-17T12:19:04.716307+0000","last_unstale":"2024-02-17T12:19:23.537464+0000","last_undegraded":"2024-02-17T12:19:23.537464+0000","last_fullsized":"2024-02-17T12:19:23.537464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:36:30.970580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"67'3","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536843+0000","last_change":"2024-02-17T12:19:03.710532+0000","last_active":"2024-02-17T12:19:23.536843+0000","last_peered":"2024-02-17T12:19:23.536843+0000","last_clean":"2024-02-17T12:19:23.536843+0000","last_became_active":"2024-02-17T12:19:03.710333+0000","last_became_peered":"2024-02-17T12:19:03.710333+0000","last_unstale":"2024-02-17T12:19:23.536843+0000","last_undegraded":"2024-02-17T12:19:23.536843+0000","last_fullsized":"2024-02-17T12:19:23.536843+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:15:32.573840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.381122+0000","last_change":"2024-02-17T12:19:22.367647+0000","last_active":"2024-02-17T12:19:23.381122+0000","last_peered":"2024-02-17T12:19:23.381122+0000","last_clean":"2024-02-17T12:19:23.381122+0000","last_became_active":"2024-02-17T12:19:22.366850+0000","last_became_peered":"2024-02-17T12:19:22.366850+0000","last_unstale":"2024-02-17T12:19:23.381122+0000","last_undegraded":"2024-02-17T12:19:23.381122+0000","last_fullsized":"2024-02-17T12:19:23.381122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:21:05.316175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537200+0000","last_change":"2024-02-17T12:19:21.374376+0000","last_active":"2024-02-17T12:19:23.537200+0000","last_peered":"2024-02-17T12:19:23.537200+0000","last_clean":"2024-02-17T12:19:23.537200+0000","last_became_active":"2024-02-17T12:19:21.374115+0000","last_became_peered":"2024-02-17T12:19:21.374115+0000","last_unstale":"2024-02-17T12:19:23.537200+0000","last_undegraded":"2024-02-17T12:19:23.537200+0000","last_fullsized":"2024-02-17T12:19:23.537200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:02.834283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380757+0000","last_change":"2024-02-17T12:19:04.719297+0000","last_active":"2024-02-17T12:19:23.380757+0000","last_peered":"2024-02-17T12:19:23.380757+0000","last_clean":"2024-02-17T12:19:23.380757+0000","last_became_active":"2024-02-17T12:19:04.718586+0000","last_became_peered":"2024-02-17T12:19:04.718586+0000","last_unstale":"2024-02-17T12:19:23.380757+0000","last_undegraded":"2024-02-17T12:19:23.380757+0000","last_fullsized":"2024-02-17T12:19:23.380757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:36:05.970868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'8","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379671+0000","last_change":"2024-02-17T12:19:03.704237+0000","last_active":"2024-02-17T12:19:23.379671+0000","last_peered":"2024-02-17T12:19:23.379671+0000","last_clean":"2024-02-17T12:19:23.379671+0000","last_became_active":"2024-02-17T12:19:03.703964+0000","last_became_peered":"2024-02-17T12:19:03.703964+0000","last_unstale":"2024-02-17T12:19:23.379671+0000","last_undegraded":"2024-02-17T12:19:23.379671+0000","last_fullsized":"2024-02-17T12:19:23.379671+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:45:45.097730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379221+0000","last_change":"2024-02-17T12:19:22.366381+0000","last_active":"2024-02-17T12:19:23.379221+0000","last_peered":"2024-02-17T12:19:23.379221+0000","last_clean":"2024-02-17T12:19:23.379221+0000","last_became_active":"2024-02-17T12:19:22.366074+0000","last_became_peered":"2024-02-17T12:19:22.366074+0000","last_unstale":"2024-02-17T12:19:23.379221+0000","last_undegraded":"2024-02-17T12:19:23.379221+0000","last_fullsized":"2024-02-17T12:19:23.379221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:54.192462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380317+0000","last_change":"2024-02-17T12:19:21.358035+0000","last_active":"2024-02-17T12:19:23.380317+0000","last_peered":"2024-02-17T12:19:23.380317+0000","last_clean":"2024-02-17T12:19:23.380317+0000","last_became_active":"2024-02-17T12:19:21.357766+0000","last_became_peered":"2024-02-17T12:19:21.357766+0000","last_unstale":"2024-02-17T12:19:23.380317+0000","last_undegraded":"2024-02-17T12:19:23.380317+0000","last_fullsized":"2024-02-17T12:19:23.380317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:18:42.768921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536246+0000","last_change":"2024-02-17T12:19:04.702494+0000","last_active":"2024-02-17T12:19:23.536246+0000","last_peered":"2024-02-17T12:19:23.536246+0000","last_clean":"2024-02-17T12:19:23.536246+0000","last_became_active":"2024-02-17T12:19:04.702168+0000","last_became_peered":"2024-02-17T12:19:04.702168+0000","last_unstale":"2024-02-17T12:19:23.536246+0000","last_undegraded":"2024-02-17T12:19:23.536246+0000","last_fullsized":"2024-02-17T12:19:23.536246+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:50:53.989897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374642+0000","last_change":"2024-02-17T12:19:03.710630+0000","last_active":"2024-02-17T12:19:23.374642+0000","last_peered":"2024-02-17T12:19:23.374642+0000","last_clean":"2024-02-17T12:19:23.374642+0000","last_became_active":"2024-02-17T12:19:03.710185+0000","last_became_peered":"2024-02-17T12:19:03.710185+0000","last_unstale":"2024-02-17T12:19:23.374642+0000","last_undegraded":"2024-02-17T12:19:23.374642+0000","last_fullsized":"2024-02-17T12:19:23.374642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:07:16.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536196+0000","last_change":"2024-02-17T12:19:22.379291+0000","last_active":"2024-02-17T12:19:23.536196+0000","last_peered":"2024-02-17T12:19:23.536196+0000","last_clean":"2024-02-17T12:19:23.536196+0000","last_became_active":"2024-02-17T12:19:22.379052+0000","last_became_peered":"2024-02-17T12:19:22.379052+0000","last_unstale":"2024-02-17T12:19:23.536196+0000","last_undegraded":"2024-02-17T12:19:23.536196+0000","last_fullsized":"2024-02-17T12:19:23.536196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:09:30.791284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"71'8","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374214+0000","last_change":"2024-02-17T12:19:21.372742+0000","last_active":"2024-02-17T12:19:23.374214+0000","last_peered":"2024-02-17T12:19:23.374214+0000","last_clean":"2024-02-17T12:19:23.374214+0000","last_became_active":"2024-02-17T12:19:21.372447+0000","last_became_peered":"2024-02-17T12:19:21.372447+0000","last_unstale":"2024-02-17T12:19:23.374214+0000","last_undegraded":"2024-02-17T12:19:23.374214+0000","last_fullsized":"2024-02-17T12:19:23.374214+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:41.249178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536979+0000","last_change":"2024-02-17T12:19:04.716555+0000","last_active":"2024-02-17T12:19:23.536979+0000","last_peered":"2024-02-17T12:19:23.536979+0000","last_clean":"2024-02-17T12:19:23.536979+0000","last_became_active":"2024-02-17T12:19:04.715235+0000","last_became_peered":"2024-02-17T12:19:04.715235+0000","last_unstale":"2024-02-17T12:19:23.536979+0000","last_undegraded":"2024-02-17T12:19:23.536979+0000","last_fullsized":"2024-02-17T12:19:23.536979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:00:05.685656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537055+0000","last_change":"2024-02-17T12:19:03.712475+0000","last_active":"2024-02-17T12:19:23.537055+0000","last_peered":"2024-02-17T12:19:23.537055+0000","last_clean":"2024-02-17T12:19:23.537055+0000","last_became_active":"2024-02-17T12:19:03.712117+0000","last_became_peered":"2024-02-17T12:19:03.712117+0000","last_unstale":"2024-02-17T12:19:23.537055+0000","last_undegraded":"2024-02-17T12:19:23.537055+0000","last_fullsized":"2024-02-17T12:19:23.537055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:10.008090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536839+0000","last_change":"2024-02-17T12:19:22.369910+0000","last_active":"2024-02-17T12:19:23.536839+0000","last_peered":"2024-02-17T12:19:23.536839+0000","last_clean":"2024-02-17T12:19:23.536839+0000","last_became_active":"2024-02-17T12:19:22.369559+0000","last_became_peered":"2024-02-17T12:19:22.369559+0000","last_unstale":"2024-02-17T12:19:23.536839+0000","last_undegraded":"2024-02-17T12:19:23.536839+0000","last_fullsized":"2024-02-17T12:19:23.536839+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:59:13.071369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538079+0000","last_change":"2024-02-17T12:19:21.362585+0000","last_active":"2024-02-17T12:19:23.538079+0000","last_peered":"2024-02-17T12:19:23.538079+0000","last_clean":"2024-02-17T12:19:23.538079+0000","last_became_active":"2024-02-17T12:19:21.361851+0000","last_became_peered":"2024-02-17T12:19:21.361851+0000","last_unstale":"2024-02-17T12:19:23.538079+0000","last_undegraded":"2024-02-17T12:19:23.538079+0000","last_fullsized":"2024-02-17T12:19:23.538079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:31.111070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374334+0000","last_change":"2024-02-17T12:19:04.727289+0000","last_active":"2024-02-17T12:19:23.374334+0000","last_peered":"2024-02-17T12:19:23.374334+0000","last_clean":"2024-02-17T12:19:23.374334+0000","last_became_active":"2024-02-17T12:19:04.727041+0000","last_became_peered":"2024-02-17T12:19:04.727041+0000","last_unstale":"2024-02-17T12:19:23.374334+0000","last_undegraded":"2024-02-17T12:19:23.374334+0000","last_fullsized":"2024-02-17T12:19:23.374334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:39:43.401328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380253+0000","last_change":"2024-02-17T12:19:03.699211+0000","last_active":"2024-02-17T12:19:23.380253+0000","last_peered":"2024-02-17T12:19:23.380253+0000","last_clean":"2024-02-17T12:19:23.380253+0000","last_became_active":"2024-02-17T12:19:03.698244+0000","last_became_peered":"2024-02-17T12:19:03.698244+0000","last_unstale":"2024-02-17T12:19:23.380253+0000","last_undegraded":"2024-02-17T12:19:23.380253+0000","last_fullsized":"2024-02-17T12:19:23.380253+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:51:42.702805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374580+0000","last_change":"2024-02-17T12:19:22.373727+0000","last_active":"2024-02-17T12:19:23.374580+0000","last_peered":"2024-02-17T12:19:23.374580+0000","last_clean":"2024-02-17T12:19:23.374580+0000","last_became_active":"2024-02-17T12:19:22.373484+0000","last_became_peered":"2024-02-17T12:19:22.373484+0000","last_unstale":"2024-02-17T12:19:23.374580+0000","last_undegraded":"2024-02-17T12:19:23.374580+0000","last_fullsized":"2024-02-17T12:19:23.374580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:15:16.518846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538270+0000","last_change":"2024-02-17T12:19:21.368493+0000","last_active":"2024-02-17T12:19:23.538270+0000","last_peered":"2024-02-17T12:19:23.538270+0000","last_clean":"2024-02-17T12:19:23.538270+0000","last_became_active":"2024-02-17T12:19:21.368162+0000","last_became_peered":"2024-02-17T12:19:21.368162+0000","last_unstale":"2024-02-17T12:19:23.538270+0000","last_undegraded":"2024-02-17T12:19:23.538270+0000","last_fullsized":"2024-02-17T12:19:23.538270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:38.213027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374169+0000","last_change":"2024-02-17T12:19:04.718529+0000","last_active":"2024-02-17T12:19:23.374169+0000","last_peered":"2024-02-17T12:19:23.374169+0000","last_clean":"2024-02-17T12:19:23.374169+0000","last_became_active":"2024-02-17T12:19:04.718251+0000","last_became_peered":"2024-02-17T12:19:04.718251+0000","last_unstale":"2024-02-17T12:19:23.374169+0000","last_undegraded":"2024-02-17T12:19:23.374169+0000","last_fullsized":"2024-02-17T12:19:23.374169+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:57:28.280713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"67'8","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535918+0000","last_change":"2024-02-17T12:19:03.706554+0000","last_active":"2024-02-17T12:19:23.535918+0000","last_peered":"2024-02-17T12:19:23.535918+0000","last_clean":"2024-02-17T12:19:23.535918+0000","last_became_active":"2024-02-17T12:19:03.706236+0000","last_became_peered":"2024-02-17T12:19:03.706236+0000","last_unstale":"2024-02-17T12:19:23.535918+0000","last_undegraded":"2024-02-17T12:19:23.535918+0000","last_fullsized":"2024-02-17T12:19:23.535918+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379764+0000","last_change":"2024-02-17T12:19:22.377796+0000","last_active":"2024-02-17T12:19:23.379764+0000","last_peered":"2024-02-17T12:19:23.379764+0000","last_clean":"2024-02-17T12:19:23.379764+0000","last_became_active":"2024-02-17T12:19:22.377532+0000","last_became_peered":"2024-02-17T12:19:22.377532+0000","last_unstale":"2024-02-17T12:19:23.379764+0000","last_undegraded":"2024-02-17T12:19:23.379764+0000","last_fullsized":"2024-02-17T12:19:23.379764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:56.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536582+0000","last_change":"2024-02-17T12:19:21.361720+0000","last_active":"2024-02-17T12:19:23.536582+0000","last_peered":"2024-02-17T12:19:23.536582+0000","last_clean":"2024-02-17T12:19:23.536582+0000","last_became_active":"2024-02-17T12:19:21.361071+0000","last_became_peered":"2024-02-17T12:19:21.361071+0000","last_unstale":"2024-02-17T12:19:23.536582+0000","last_undegraded":"2024-02-17T12:19:23.536582+0000","last_fullsized":"2024-02-17T12:19:23.536582+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:58.800423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537259+0000","last_change":"2024-02-17T12:19:04.715036+0000","last_active":"2024-02-17T12:19:23.537259+0000","last_peered":"2024-02-17T12:19:23.537259+0000","last_clean":"2024-02-17T12:19:23.537259+0000","last_became_active":"2024-02-17T12:19:04.714713+0000","last_became_peered":"2024-02-17T12:19:04.714713+0000","last_unstale":"2024-02-17T12:19:23.537259+0000","last_undegraded":"2024-02-17T12:19:23.537259+0000","last_fullsized":"2024-02-17T12:19:23.537259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:28:30.744698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537288+0000","last_change":"2024-02-17T12:19:03.705648+0000","last_active":"2024-02-17T12:19:23.537288+0000","last_peered":"2024-02-17T12:19:23.537288+0000","last_clean":"2024-02-17T12:19:23.537288+0000","last_became_active":"2024-02-17T12:19:03.705325+0000","last_became_peered":"2024-02-17T12:19:03.705325+0000","last_unstale":"2024-02-17T12:19:23.537288+0000","last_undegraded":"2024-02-17T12:19:23.537288+0000","last_fullsized":"2024-02-17T12:19:23.537288+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:23.586811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537452+0000","last_change":"2024-02-17T12:19:22.380167+0000","last_active":"2024-02-17T12:19:23.537452+0000","last_peered":"2024-02-17T12:19:23.537452+0000","last_clean":"2024-02-17T12:19:23.537452+0000","last_became_active":"2024-02-17T12:19:22.379704+0000","last_became_peered":"2024-02-17T12:19:22.379704+0000","last_unstale":"2024-02-17T12:19:23.537452+0000","last_undegraded":"2024-02-17T12:19:23.537452+0000","last_fullsized":"2024-02-17T12:19:23.537452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:28:11.111883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537403+0000","last_change":"2024-02-17T12:19:21.376463+0000","last_active":"2024-02-17T12:19:23.537403+0000","last_peered":"2024-02-17T12:19:23.537403+0000","last_clean":"2024-02-17T12:19:23.537403+0000","last_became_active":"2024-02-17T12:19:21.376199+0000","last_became_peered":"2024-02-17T12:19:21.376199+0000","last_unstale":"2024-02-17T12:19:23.537403+0000","last_undegraded":"2024-02-17T12:19:23.537403+0000","last_fullsized":"2024-02-17T12:19:23.537403+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:18:54.868580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536531+0000","last_change":"2024-02-17T12:19:04.719005+0000","last_active":"2024-02-17T12:19:23.536531+0000","last_peered":"2024-02-17T12:19:23.536531+0000","last_clean":"2024-02-17T12:19:23.536531+0000","last_became_active":"2024-02-17T12:19:04.717221+0000","last_became_peered":"2024-02-17T12:19:04.717221+0000","last_unstale":"2024-02-17T12:19:23.536531+0000","last_undegraded":"2024-02-17T12:19:23.536531+0000","last_fullsized":"2024-02-17T12:19:23.536531+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:12:50.535947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537209+0000","last_change":"2024-02-17T12:19:03.708463+0000","last_active":"2024-02-17T12:19:23.537209+0000","last_peered":"2024-02-17T12:19:23.537209+0000","last_clean":"2024-02-17T12:19:23.537209+0000","last_became_active":"2024-02-17T12:19:03.707739+0000","last_became_peered":"2024-02-17T12:19:03.707739+0000","last_unstale":"2024-02-17T12:19:23.537209+0000","last_undegraded":"2024-02-17T12:19:23.537209+0000","last_fullsized":"2024-02-17T12:19:23.537209+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:22:36.085833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536099+0000","last_change":"2024-02-17T12:19:22.380029+0000","last_active":"2024-02-17T12:19:23.536099+0000","last_peered":"2024-02-17T12:19:23.536099+0000","last_clean":"2024-02-17T12:19:23.536099+0000","last_became_active":"2024-02-17T12:19:22.379414+0000","last_became_peered":"2024-02-17T12:19:22.379414+0000","last_unstale":"2024-02-17T12:19:23.536099+0000","last_undegraded":"2024-02-17T12:19:23.536099+0000","last_fullsized":"2024-02-17T12:19:23.536099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:06:13.563565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380282+0000","last_change":"2024-02-17T12:19:21.361415+0000","last_active":"2024-02-17T12:19:23.380282+0000","last_peered":"2024-02-17T12:19:23.380282+0000","last_clean":"2024-02-17T12:19:23.380282+0000","last_became_active":"2024-02-17T12:19:21.360522+0000","last_became_peered":"2024-02-17T12:19:21.360522+0000","last_unstale":"2024-02-17T12:19:23.380282+0000","last_undegraded":"2024-02-17T12:19:23.380282+0000","last_fullsized":"2024-02-17T12:19:23.380282+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:19:01.561174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380889+0000","last_change":"2024-02-17T12:19:04.727161+0000","last_active":"2024-02-17T12:19:23.380889+0000","last_peered":"2024-02-17T12:19:23.380889+0000","last_clean":"2024-02-17T12:19:23.380889+0000","last_became_active":"2024-02-17T12:19:04.726871+0000","last_became_peered":"2024-02-17T12:19:04.726871+0000","last_unstale":"2024-02-17T12:19:23.380889+0000","last_undegraded":"2024-02-17T12:19:23.380889+0000","last_fullsized":"2024-02-17T12:19:23.380889+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:01:50.453267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537553+0000","last_change":"2024-02-17T12:19:03.700286+0000","last_active":"2024-02-17T12:19:23.537553+0000","last_peered":"2024-02-17T12:19:23.537553+0000","last_clean":"2024-02-17T12:19:23.537553+0000","last_became_active":"2024-02-17T12:19:03.700021+0000","last_became_peered":"2024-02-17T12:19:03.700021+0000","last_unstale":"2024-02-17T12:19:23.537553+0000","last_undegraded":"2024-02-17T12:19:23.537553+0000","last_fullsized":"2024-02-17T12:19:23.537553+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:36:21.941491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535774+0000","last_change":"2024-02-17T12:19:22.370952+0000","last_active":"2024-02-17T12:19:23.535774+0000","last_peered":"2024-02-17T12:19:23.535774+0000","last_clean":"2024-02-17T12:19:23.535774+0000","last_became_active":"2024-02-17T12:19:22.370205+0000","last_became_peered":"2024-02-17T12:19:22.370205+0000","last_unstale":"2024-02-17T12:19:23.535774+0000","last_undegraded":"2024-02-17T12:19:23.535774+0000","last_fullsized":"2024-02-17T12:19:23.535774+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:42:14.086969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379452+0000","last_change":"2024-02-17T12:19:21.374959+0000","last_active":"2024-02-17T12:19:23.379452+0000","last_peered":"2024-02-17T12:19:23.379452+0000","last_clean":"2024-02-17T12:19:23.379452+0000","last_became_active":"2024-02-17T12:19:21.374612+0000","last_became_peered":"2024-02-17T12:19:21.374612+0000","last_unstale":"2024-02-17T12:19:23.379452+0000","last_undegraded":"2024-02-17T12:19:23.379452+0000","last_fullsized":"2024-02-17T12:19:23.379452+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:56:33.199348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538438+0000","last_change":"2024-02-17T12:19:04.727215+0000","last_active":"2024-02-17T12:19:23.538438+0000","last_peered":"2024-02-17T12:19:23.538438+0000","last_clean":"2024-02-17T12:19:23.538438+0000","last_became_active":"2024-02-17T12:19:04.726960+0000","last_became_peered":"2024-02-17T12:19:04.726960+0000","last_unstale":"2024-02-17T12:19:23.538438+0000","last_undegraded":"2024-02-17T12:19:23.538438+0000","last_fullsized":"2024-02-17T12:19:23.538438+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:30:45.381080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538034+0000","last_change":"2024-02-17T12:19:03.709412+0000","last_active":"2024-02-17T12:19:23.538034+0000","last_peered":"2024-02-17T12:19:23.538034+0000","last_clean":"2024-02-17T12:19:23.538034+0000","last_became_active":"2024-02-17T12:19:03.709021+0000","last_became_peered":"2024-02-17T12:19:03.709021+0000","last_unstale":"2024-02-17T12:19:23.538034+0000","last_undegraded":"2024-02-17T12:19:23.538034+0000","last_fullsized":"2024-02-17T12:19:23.538034+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:44.049163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535925+0000","last_change":"2024-02-17T12:19:22.388507+0000","last_active":"2024-02-17T12:19:23.535925+0000","last_peered":"2024-02-17T12:19:23.535925+0000","last_clean":"2024-02-17T12:19:23.535925+0000","last_became_active":"2024-02-17T12:19:22.387331+0000","last_became_peered":"2024-02-17T12:19:22.387331+0000","last_unstale":"2024-02-17T12:19:23.535925+0000","last_undegraded":"2024-02-17T12:19:23.535925+0000","last_fullsized":"2024-02-17T12:19:23.535925+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:32:05.733697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535633+0000","last_change":"2024-02-17T12:19:21.378509+0000","last_active":"2024-02-17T12:19:23.535633+0000","last_peered":"2024-02-17T12:19:23.535633+0000","last_clean":"2024-02-17T12:19:23.535633+0000","last_became_active":"2024-02-17T12:19:21.378270+0000","last_became_peered":"2024-02-17T12:19:21.378270+0000","last_unstale":"2024-02-17T12:19:23.535633+0000","last_undegraded":"2024-02-17T12:19:23.535633+0000","last_fullsized":"2024-02-17T12:19:23.535633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T15:01:35.597527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379343+0000","last_change":"2024-02-17T12:19:04.712404+0000","last_active":"2024-02-17T12:19:23.379343+0000","last_peered":"2024-02-17T12:19:23.379343+0000","last_clean":"2024-02-17T12:19:23.379343+0000","last_became_active":"2024-02-17T12:19:04.711344+0000","last_became_peered":"2024-02-17T12:19:04.711344+0000","last_unstale":"2024-02-17T12:19:23.379343+0000","last_undegraded":"2024-02-17T12:19:23.379343+0000","last_fullsized":"2024-02-17T12:19:23.379343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:24:24.593812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538531+0000","last_change":"2024-02-17T12:19:03.706405+0000","last_active":"2024-02-17T12:19:23.538531+0000","last_peered":"2024-02-17T12:19:23.538531+0000","last_clean":"2024-02-17T12:19:23.538531+0000","last_became_active":"2024-02-17T12:19:03.706108+0000","last_became_peered":"2024-02-17T12:19:03.706108+0000","last_unstale":"2024-02-17T12:19:23.538531+0000","last_undegraded":"2024-02-17T12:19:23.538531+0000","last_fullsized":"2024-02-17T12:19:23.538531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:25:55.926513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538039+0000","last_change":"2024-02-17T12:19:22.389822+0000","last_active":"2024-02-17T12:19:23.538039+0000","last_peered":"2024-02-17T12:19:23.538039+0000","last_clean":"2024-02-17T12:19:23.538039+0000","last_became_active":"2024-02-17T12:19:22.389495+0000","last_became_peered":"2024-02-17T12:19:22.389495+0000","last_unstale":"2024-02-17T12:19:23.538039+0000","last_undegraded":"2024-02-17T12:19:23.538039+0000","last_fullsized":"2024-02-17T12:19:23.538039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:02:08.115974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536803+0000","last_change":"2024-02-17T12:19:21.378324+0000","last_active":"2024-02-17T12:19:23.536803+0000","last_peered":"2024-02-17T12:19:23.536803+0000","last_clean":"2024-02-17T12:19:23.536803+0000","last_became_active":"2024-02-17T12:19:21.378067+0000","last_became_peered":"2024-02-17T12:19:21.378067+0000","last_unstale":"2024-02-17T12:19:23.536803+0000","last_undegraded":"2024-02-17T12:19:23.536803+0000","last_fullsized":"2024-02-17T12:19:23.536803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:37:02.959762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536274+0000","last_change":"2024-02-17T12:19:04.712081+0000","last_active":"2024-02-17T12:19:23.536274+0000","last_peered":"2024-02-17T12:19:23.536274+0000","last_clean":"2024-02-17T12:19:23.536274+0000","last_became_active":"2024-02-17T12:19:04.711784+0000","last_became_peered":"2024-02-17T12:19:04.711784+0000","last_unstale":"2024-02-17T12:19:23.536274+0000","last_undegraded":"2024-02-17T12:19:23.536274+0000","last_fullsized":"2024-02-17T12:19:23.536274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:47:13.952609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536391+0000","last_change":"2024-02-17T12:19:03.701598+0000","last_active":"2024-02-17T12:19:23.536391+0000","last_peered":"2024-02-17T12:19:23.536391+0000","last_clean":"2024-02-17T12:19:23.536391+0000","last_became_active":"2024-02-17T12:19:03.701326+0000","last_became_peered":"2024-02-17T12:19:03.701326+0000","last_unstale":"2024-02-17T12:19:23.536391+0000","last_undegraded":"2024-02-17T12:19:23.536391+0000","last_fullsized":"2024-02-17T12:19:23.536391+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:47:22.021385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537974+0000","last_change":"2024-02-17T12:19:22.380952+0000","last_active":"2024-02-17T12:19:23.537974+0000","last_peered":"2024-02-17T12:19:23.537974+0000","last_clean":"2024-02-17T12:19:23.537974+0000","last_became_active":"2024-02-17T12:19:22.380493+0000","last_became_peered":"2024-02-17T12:19:22.380493+0000","last_unstale":"2024-02-17T12:19:23.537974+0000","last_undegraded":"2024-02-17T12:19:23.537974+0000","last_fullsized":"2024-02-17T12:19:23.537974+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:00:54.242151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379843+0000","last_change":"2024-02-17T12:19:21.372743+0000","last_active":"2024-02-17T12:19:23.379843+0000","last_peered":"2024-02-17T12:19:23.379843+0000","last_clean":"2024-02-17T12:19:23.379843+0000","last_became_active":"2024-02-17T12:19:21.372341+0000","last_became_peered":"2024-02-17T12:19:21.372341+0000","last_unstale":"2024-02-17T12:19:23.379843+0000","last_undegraded":"2024-02-17T12:19:23.379843+0000","last_fullsized":"2024-02-17T12:19:23.379843+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:39.147194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379599+0000","last_change":"2024-02-17T12:19:04.702184+0000","last_active":"2024-02-17T12:19:23.379599+0000","last_peered":"2024-02-17T12:19:23.379599+0000","last_clean":"2024-02-17T12:19:23.379599+0000","last_became_active":"2024-02-17T12:19:04.701908+0000","last_became_peered":"2024-02-17T12:19:04.701908+0000","last_unstale":"2024-02-17T12:19:23.379599+0000","last_undegraded":"2024-02-17T12:19:23.379599+0000","last_fullsized":"2024-02-17T12:19:23.379599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:30.749868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535970+0000","last_change":"2024-02-17T12:19:03.702614+0000","last_active":"2024-02-17T12:19:23.535970+0000","last_peered":"2024-02-17T12:19:23.535970+0000","last_clean":"2024-02-17T12:19:23.535970+0000","last_became_active":"2024-02-17T12:19:03.702360+0000","last_became_peered":"2024-02-17T12:19:03.702360+0000","last_unstale":"2024-02-17T12:19:23.535970+0000","last_undegraded":"2024-02-17T12:19:23.535970+0000","last_fullsized":"2024-02-17T12:19:23.535970+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:25:37.418089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374781+0000","last_change":"2024-02-17T12:19:22.380431+0000","last_active":"2024-02-17T12:19:23.374781+0000","last_peered":"2024-02-17T12:19:23.374781+0000","last_clean":"2024-02-17T12:19:23.374781+0000","last_became_active":"2024-02-17T12:19:22.380158+0000","last_became_peered":"2024-02-17T12:19:22.380158+0000","last_unstale":"2024-02-17T12:19:23.374781+0000","last_undegraded":"2024-02-17T12:19:23.374781+0000","last_fullsized":"2024-02-17T12:19:23.374781+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:56:34.206689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536504+0000","last_change":"2024-02-17T12:19:21.377870+0000","last_active":"2024-02-17T12:19:23.536504+0000","last_peered":"2024-02-17T12:19:23.536504+0000","last_clean":"2024-02-17T12:19:23.536504+0000","last_became_active":"2024-02-17T12:19:21.376799+0000","last_became_peered":"2024-02-17T12:19:21.376799+0000","last_unstale":"2024-02-17T12:19:23.536504+0000","last_undegraded":"2024-02-17T12:19:23.536504+0000","last_fullsized":"2024-02-17T12:19:23.536504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:46:04.167124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380585+0000","last_change":"2024-02-17T12:19:04.697171+0000","last_active":"2024-02-17T12:19:23.380585+0000","last_peered":"2024-02-17T12:19:23.380585+0000","last_clean":"2024-02-17T12:19:23.380585+0000","last_became_active":"2024-02-17T12:19:04.696841+0000","last_became_peered":"2024-02-17T12:19:04.696841+0000","last_unstale":"2024-02-17T12:19:23.380585+0000","last_undegraded":"2024-02-17T12:19:23.380585+0000","last_fullsized":"2024-02-17T12:19:23.380585+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T13:04:51.114922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"67'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375209+0000","last_change":"2024-02-17T12:19:03.706098+0000","last_active":"2024-02-17T12:19:23.375209+0000","last_peered":"2024-02-17T12:19:23.375209+0000","last_clean":"2024-02-17T12:19:23.375209+0000","last_became_active":"2024-02-17T12:19:03.705787+0000","last_became_peered":"2024-02-17T12:19:03.705787+0000","last_unstale":"2024-02-17T12:19:23.375209+0000","last_undegraded":"2024-02-17T12:19:23.375209+0000","last_fullsized":"2024-02-17T12:19:23.375209+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:58:59.839484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536473+0000","last_change":"2024-02-17T12:19:22.390414+0000","last_active":"2024-02-17T12:19:23.536473+0000","last_peered":"2024-02-17T12:19:23.536473+0000","last_clean":"2024-02-17T12:19:23.536473+0000","last_became_active":"2024-02-17T12:19:22.390123+0000","last_became_peered":"2024-02-17T12:19:22.390123+0000","last_unstale":"2024-02-17T12:19:23.536473+0000","last_undegraded":"2024-02-17T12:19:23.536473+0000","last_fullsized":"2024-02-17T12:19:23.536473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:52:59.929878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536149+0000","last_change":"2024-02-17T12:19:21.370930+0000","last_active":"2024-02-17T12:19:23.536149+0000","last_peered":"2024-02-17T12:19:23.536149+0000","last_clean":"2024-02-17T12:19:23.536149+0000","last_became_active":"2024-02-17T12:19:21.370503+0000","last_became_peered":"2024-02-17T12:19:21.370503+0000","last_unstale":"2024-02-17T12:19:23.536149+0000","last_undegraded":"2024-02-17T12:19:23.536149+0000","last_fullsized":"2024-02-17T12:19:23.536149+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:41:10.100668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536855+0000","last_change":"2024-02-17T12:19:04.710601+0000","last_active":"2024-02-17T12:19:23.536855+0000","last_peered":"2024-02-17T12:19:23.536855+0000","last_clean":"2024-02-17T12:19:23.536855+0000","last_became_active":"2024-02-17T12:19:04.710296+0000","last_became_peered":"2024-02-17T12:19:04.710296+0000","last_unstale":"2024-02-17T12:19:23.536855+0000","last_undegraded":"2024-02-17T12:19:23.536855+0000","last_fullsized":"2024-02-17T12:19:23.536855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:17:06.226423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"68'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375119+0000","last_change":"2024-02-17T12:19:03.707121+0000","last_active":"2024-02-17T12:19:23.375119+0000","last_peered":"2024-02-17T12:19:23.375119+0000","last_clean":"2024-02-17T12:19:23.375119+0000","last_became_active":"2024-02-17T12:19:03.706873+0000","last_became_peered":"2024-02-17T12:19:03.706873+0000","last_unstale":"2024-02-17T12:19:23.375119+0000","last_undegraded":"2024-02-17T12:19:23.375119+0000","last_fullsized":"2024-02-17T12:19:23.375119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:31:24.015391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538323+0000","last_change":"2024-02-17T12:19:22.366705+0000","last_active":"2024-02-17T12:19:23.538323+0000","last_peered":"2024-02-17T12:19:23.538323+0000","last_clean":"2024-02-17T12:19:23.538323+0000","last_became_active":"2024-02-17T12:19:22.366194+0000","last_became_peered":"2024-02-17T12:19:22.366194+0000","last_unstale":"2024-02-17T12:19:23.538323+0000","last_undegraded":"2024-02-17T12:19:23.538323+0000","last_fullsized":"2024-02-17T12:19:23.538323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:59:13.071369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"71'2","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379981+0000","last_change":"2024-02-17T12:19:21.358468+0000","last_active":"2024-02-17T12:19:23.379981+0000","last_peered":"2024-02-17T12:19:23.379981+0000","last_clean":"2024-02-17T12:19:23.379981+0000","last_became_active":"2024-02-17T12:19:21.358160+0000","last_became_peered":"2024-02-17T12:19:21.358160+0000","last_unstale":"2024-02-17T12:19:23.379981+0000","last_undegraded":"2024-02-17T12:19:23.379981+0000","last_fullsized":"2024-02-17T12:19:23.379981+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:17:16.226206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537078+0000","last_change":"2024-02-17T12:19:04.718645+0000","last_active":"2024-02-17T12:19:23.537078+0000","last_peered":"2024-02-17T12:19:23.537078+0000","last_clean":"2024-02-17T12:19:23.537078+0000","last_became_active":"2024-02-17T12:19:04.715738+0000","last_became_peered":"2024-02-17T12:19:04.715738+0000","last_unstale":"2024-02-17T12:19:23.537078+0000","last_undegraded":"2024-02-17T12:19:23.537078+0000","last_fullsized":"2024-02-17T12:19:23.537078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:20:45.056164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536727+0000","last_change":"2024-02-17T12:19:03.705719+0000","last_active":"2024-02-17T12:19:23.536727+0000","last_peered":"2024-02-17T12:19:23.536727+0000","last_clean":"2024-02-17T12:19:23.536727+0000","last_became_active":"2024-02-17T12:19:03.705394+0000","last_became_peered":"2024-02-17T12:19:03.705394+0000","last_unstale":"2024-02-17T12:19:23.536727+0000","last_undegraded":"2024-02-17T12:19:23.536727+0000","last_fullsized":"2024-02-17T12:19:23.536727+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:40:18.432832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.375201+0000","last_change":"2024-02-17T12:19:22.378876+0000","last_active":"2024-02-17T12:19:23.375201+0000","last_peered":"2024-02-17T12:19:23.375201+0000","last_clean":"2024-02-17T12:19:23.375201+0000","last_became_active":"2024-02-17T12:19:22.378636+0000","last_became_peered":"2024-02-17T12:19:22.378636+0000","last_unstale":"2024-02-17T12:19:23.375201+0000","last_undegraded":"2024-02-17T12:19:23.375201+0000","last_fullsized":"2024-02-17T12:19:23.375201+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:17:17.233548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536811+0000","last_change":"2024-02-17T12:19:21.376210+0000","last_active":"2024-02-17T12:19:23.536811+0000","last_peered":"2024-02-17T12:19:23.536811+0000","last_clean":"2024-02-17T12:19:23.536811+0000","last_became_active":"2024-02-17T12:19:21.375786+0000","last_became_peered":"2024-02-17T12:19:21.375786+0000","last_unstale":"2024-02-17T12:19:23.536811+0000","last_undegraded":"2024-02-17T12:19:23.536811+0000","last_fullsized":"2024-02-17T12:19:23.536811+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:39:54.197618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380958+0000","last_change":"2024-02-17T12:19:04.719278+0000","last_active":"2024-02-17T12:19:23.380958+0000","last_peered":"2024-02-17T12:19:23.380958+0000","last_clean":"2024-02-17T12:19:23.380958+0000","last_became_active":"2024-02-17T12:19:04.718194+0000","last_became_peered":"2024-02-17T12:19:04.718194+0000","last_unstale":"2024-02-17T12:19:23.380958+0000","last_undegraded":"2024-02-17T12:19:23.380958+0000","last_fullsized":"2024-02-17T12:19:23.380958+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:11.081786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537110+0000","last_change":"2024-02-17T12:19:03.712607+0000","last_active":"2024-02-17T12:19:23.537110+0000","last_peered":"2024-02-17T12:19:23.537110+0000","last_clean":"2024-02-17T12:19:23.537110+0000","last_became_active":"2024-02-17T12:19:03.712328+0000","last_became_peered":"2024-02-17T12:19:03.712328+0000","last_unstale":"2024-02-17T12:19:23.537110+0000","last_undegraded":"2024-02-17T12:19:23.537110+0000","last_fullsized":"2024-02-17T12:19:23.537110+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:48:08.184063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535812+0000","last_change":"2024-02-17T12:19:22.379938+0000","last_active":"2024-02-17T12:19:23.535812+0000","last_peered":"2024-02-17T12:19:23.535812+0000","last_clean":"2024-02-17T12:19:23.535812+0000","last_became_active":"2024-02-17T12:19:22.379601+0000","last_became_peered":"2024-02-17T12:19:22.379601+0000","last_unstale":"2024-02-17T12:19:23.535812+0000","last_undegraded":"2024-02-17T12:19:23.535812+0000","last_fullsized":"2024-02-17T12:19:23.535812+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:24:23.237404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536226+0000","last_change":"2024-02-17T12:19:21.379926+0000","last_active":"2024-02-17T12:19:23.536226+0000","last_peered":"2024-02-17T12:19:23.536226+0000","last_clean":"2024-02-17T12:19:23.536226+0000","last_became_active":"2024-02-17T12:19:21.378997+0000","last_became_peered":"2024-02-17T12:19:21.378997+0000","last_unstale":"2024-02-17T12:19:23.536226+0000","last_undegraded":"2024-02-17T12:19:23.536226+0000","last_fullsized":"2024-02-17T12:19:23.536226+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T12:58:37.393789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380521+0000","last_change":"2024-02-17T12:19:04.711425+0000","last_active":"2024-02-17T12:19:23.380521+0000","last_peered":"2024-02-17T12:19:23.380521+0000","last_clean":"2024-02-17T12:19:23.380521+0000","last_became_active":"2024-02-17T12:19:04.711149+0000","last_became_peered":"2024-02-17T12:19:04.711149+0000","last_unstale":"2024-02-17T12:19:23.380521+0000","last_undegraded":"2024-02-17T12:19:23.380521+0000","last_fullsized":"2024-02-17T12:19:23.380521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:57:09.205662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536925+0000","last_change":"2024-02-17T12:19:03.708773+0000","last_active":"2024-02-17T12:19:23.536925+0000","last_peered":"2024-02-17T12:19:23.536925+0000","last_clean":"2024-02-17T12:19:23.536925+0000","last_became_active":"2024-02-17T12:19:03.707579+0000","last_became_peered":"2024-02-17T12:19:03.707579+0000","last_unstale":"2024-02-17T12:19:23.536925+0000","last_undegraded":"2024-02-17T12:19:23.536925+0000","last_fullsized":"2024-02-17T12:19:23.536925+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:55:29.742866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536310+0000","last_change":"2024-02-17T12:19:22.390591+0000","last_active":"2024-02-17T12:19:23.536310+0000","last_peered":"2024-02-17T12:19:23.536310+0000","last_clean":"2024-02-17T12:19:23.536310+0000","last_became_active":"2024-02-17T12:19:22.390097+0000","last_became_peered":"2024-02-17T12:19:22.390097+0000","last_unstale":"2024-02-17T12:19:23.536310+0000","last_undegraded":"2024-02-17T12:19:23.536310+0000","last_fullsized":"2024-02-17T12:19:23.536310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:35:45.209068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537328+0000","last_change":"2024-02-17T12:19:21.376109+0000","last_active":"2024-02-17T12:19:23.537328+0000","last_peered":"2024-02-17T12:19:23.537328+0000","last_clean":"2024-02-17T12:19:23.537328+0000","last_became_active":"2024-02-17T12:19:21.375805+0000","last_became_peered":"2024-02-17T12:19:21.375805+0000","last_unstale":"2024-02-17T12:19:23.537328+0000","last_undegraded":"2024-02-17T12:19:23.537328+0000","last_fullsized":"2024-02-17T12:19:23.537328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:40:31.884225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536511+0000","last_change":"2024-02-17T12:19:04.699129+0000","last_active":"2024-02-17T12:19:23.536511+0000","last_peered":"2024-02-17T12:19:23.536511+0000","last_clean":"2024-02-17T12:19:23.536511+0000","last_became_active":"2024-02-17T12:19:04.698800+0000","last_became_peered":"2024-02-17T12:19:04.698800+0000","last_unstale":"2024-02-17T12:19:23.536511+0000","last_undegraded":"2024-02-17T12:19:23.536511+0000","last_fullsized":"2024-02-17T12:19:23.536511+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:36:34.252865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380734+0000","last_change":"2024-02-17T12:19:03.705779+0000","last_active":"2024-02-17T12:19:23.380734+0000","last_peered":"2024-02-17T12:19:23.380734+0000","last_clean":"2024-02-17T12:19:23.380734+0000","last_became_active":"2024-02-17T12:19:03.705453+0000","last_became_peered":"2024-02-17T12:19:03.705453+0000","last_unstale":"2024-02-17T12:19:23.380734+0000","last_undegraded":"2024-02-17T12:19:23.380734+0000","last_fullsized":"2024-02-17T12:19:23.380734+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:02:20.550660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.538181+0000","last_change":"2024-02-17T12:19:22.382589+0000","last_active":"2024-02-17T12:19:23.538181+0000","last_peered":"2024-02-17T12:19:23.538181+0000","last_clean":"2024-02-17T12:19:23.538181+0000","last_became_active":"2024-02-17T12:19:22.381978+0000","last_became_peered":"2024-02-17T12:19:22.381978+0000","last_unstale":"2024-02-17T12:19:23.538181+0000","last_undegraded":"2024-02-17T12:19:23.538181+0000","last_fullsized":"2024-02-17T12:19:23.538181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:46:28.744493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536272+0000","last_change":"2024-02-17T12:19:21.375339+0000","last_active":"2024-02-17T12:19:23.536272+0000","last_peered":"2024-02-17T12:19:23.536272+0000","last_clean":"2024-02-17T12:19:23.536272+0000","last_became_active":"2024-02-17T12:19:21.374436+0000","last_became_peered":"2024-02-17T12:19:21.374436+0000","last_unstale":"2024-02-17T12:19:23.536272+0000","last_undegraded":"2024-02-17T12:19:23.536272+0000","last_fullsized":"2024-02-17T12:19:23.536272+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T14:13:07.191313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535962+0000","last_change":"2024-02-17T12:19:04.717000+0000","last_active":"2024-02-17T12:19:23.535962+0000","last_peered":"2024-02-17T12:19:23.535962+0000","last_clean":"2024-02-17T12:19:23.535962+0000","last_became_active":"2024-02-17T12:19:04.716743+0000","last_became_peered":"2024-02-17T12:19:04.716743+0000","last_unstale":"2024-02-17T12:19:23.535962+0000","last_undegraded":"2024-02-17T12:19:23.535962+0000","last_fullsized":"2024-02-17T12:19:23.535962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:48:38.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536815+0000","last_change":"2024-02-17T12:19:03.710199+0000","last_active":"2024-02-17T12:19:23.536815+0000","last_peered":"2024-02-17T12:19:23.536815+0000","last_clean":"2024-02-17T12:19:23.536815+0000","last_became_active":"2024-02-17T12:19:03.709947+0000","last_became_peered":"2024-02-17T12:19:03.709947+0000","last_unstale":"2024-02-17T12:19:23.536815+0000","last_undegraded":"2024-02-17T12:19:23.536815+0000","last_fullsized":"2024-02-17T12:19:23.536815+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T20:10:14.740900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.380107+0000","last_change":"2024-02-17T12:19:22.375575+0000","last_active":"2024-02-17T12:19:23.380107+0000","last_peered":"2024-02-17T12:19:23.380107+0000","last_clean":"2024-02-17T12:19:23.380107+0000","last_became_active":"2024-02-17T12:19:22.375217+0000","last_became_peered":"2024-02-17T12:19:22.375217+0000","last_unstale":"2024-02-17T12:19:23.380107+0000","last_undegraded":"2024-02-17T12:19:23.380107+0000","last_fullsized":"2024-02-17T12:19:23.380107+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T22:37:26.248307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.535755+0000","last_change":"2024-02-17T12:19:21.368888+0000","last_active":"2024-02-17T12:19:23.535755+0000","last_peered":"2024-02-17T12:19:23.535755+0000","last_clean":"2024-02-17T12:19:23.535755+0000","last_became_active":"2024-02-17T12:19:21.368602+0000","last_became_peered":"2024-02-17T12:19:21.368602+0000","last_unstale":"2024-02-17T12:19:23.535755+0000","last_undegraded":"2024-02-17T12:19:23.535755+0000","last_fullsized":"2024-02-17T12:19:23.535755+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:43:57.615833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536701+0000","last_change":"2024-02-17T12:19:04.713606+0000","last_active":"2024-02-17T12:19:23.536701+0000","last_peered":"2024-02-17T12:19:23.536701+0000","last_clean":"2024-02-17T12:19:23.536701+0000","last_became_active":"2024-02-17T12:19:04.708088+0000","last_became_peered":"2024-02-17T12:19:04.708088+0000","last_unstale":"2024-02-17T12:19:23.536701+0000","last_undegraded":"2024-02-17T12:19:23.536701+0000","last_fullsized":"2024-02-17T12:19:23.536701+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:54:22.491827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.379511+0000","last_change":"2024-02-17T12:19:03.701618+0000","last_active":"2024-02-17T12:19:23.379511+0000","last_peered":"2024-02-17T12:19:23.379511+0000","last_clean":"2024-02-17T12:19:23.379511+0000","last_became_active":"2024-02-17T12:19:03.701291+0000","last_became_peered":"2024-02-17T12:19:03.701291+0000","last_unstale":"2024-02-17T12:19:23.379511+0000","last_undegraded":"2024-02-17T12:19:23.379511+0000","last_fullsized":"2024-02-17T12:19:23.379511+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:32:13.448703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537887+0000","last_change":"2024-02-17T12:19:22.389793+0000","last_active":"2024-02-17T12:19:23.537887+0000","last_peered":"2024-02-17T12:19:23.537887+0000","last_clean":"2024-02-17T12:19:23.537887+0000","last_became_active":"2024-02-17T12:19:22.389415+0000","last_became_peered":"2024-02-17T12:19:22.389415+0000","last_unstale":"2024-02-17T12:19:23.537887+0000","last_undegraded":"2024-02-17T12:19:23.537887+0000","last_fullsized":"2024-02-17T12:19:23.537887+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:21.340147+0000","last_clean_scrub_stamp":"2024-02-17T12:19:21.340147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T18:56:26.992781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"71'1","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536720+0000","last_change":"2024-02-17T12:19:21.375230+0000","last_active":"2024-02-17T12:19:23.536720+0000","last_peered":"2024-02-17T12:19:23.536720+0000","last_clean":"2024-02-17T12:19:23.536720+0000","last_became_active":"2024-02-17T12:19:21.374933+0000","last_became_peered":"2024-02-17T12:19:21.374933+0000","last_unstale":"2024-02-17T12:19:23.536720+0000","last_undegraded":"2024-02-17T12:19:23.536720+0000","last_fullsized":"2024-02-17T12:19:23.536720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:20.332805+0000","last_clean_scrub_stamp":"2024-02-17T12:19:20.332805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T16:09:40.208486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.374855+0000","last_change":"2024-02-17T12:19:04.719250+0000","last_active":"2024-02-17T12:19:23.374855+0000","last_peered":"2024-02-17T12:19:23.374855+0000","last_clean":"2024-02-17T12:19:23.374855+0000","last_became_active":"2024-02-17T12:19:04.718856+0000","last_became_peered":"2024-02-17T12:19:04.718856+0000","last_unstale":"2024-02-17T12:19:23.374855+0000","last_undegraded":"2024-02-17T12:19:23.374855+0000","last_fullsized":"2024-02-17T12:19:23.374855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:03.677439+0000","last_clean_scrub_stamp":"2024-02-17T12:19:03.677439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T17:18:43.814483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"67'1","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.537757+0000","last_change":"2024-02-17T12:19:03.712148+0000","last_active":"2024-02-17T12:19:23.537757+0000","last_peered":"2024-02-17T12:19:23.537757+0000","last_clean":"2024-02-17T12:19:23.537757+0000","last_became_active":"2024-02-17T12:19:03.711771+0000","last_became_peered":"2024-02-17T12:19:03.711771+0000","last_unstale":"2024-02-17T12:19:23.537757+0000","last_undegraded":"2024-02-17T12:19:23.537757+0000","last_fullsized":"2024-02-17T12:19:23.537757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:19:02.670438+0000","last_clean_scrub_stamp":"2024-02-17T12:19:02.670438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T23:48:53.868822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":265,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-17T12:19:23.536127+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:19:23.536127+0000","last_peered":"2024-02-17T12:19:23.536127+0000","last_clean":"2024-02-17T12:19:23.536127+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:19:23.536127+0000","last_undegraded":"2024-02-17T12:19:23.536127+0000","last_fullsized":"2024-02-17T12:19:23.536127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3913,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":897024,"data_stored":390518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97299999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71699999999999997}]},{"osd":1,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.115,"15min":1.115},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.143,"15min":1.143},"last":0.79700000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0640000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.73699999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":1.734,"15min":1.734},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.877},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0840000000000001,"5min":1.804,"15min":1.804},"last":0.77600000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.5,"15min":1.5},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.83999999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1419999999999999,"5min":1.855,"15min":1.855},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.85999999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":897024,"data_stored":392379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68600000000000005,"15min":0.68700000000000006},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85099999999999998,"5min":1.103,"15min":1.103},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.84699999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.622},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89700000000000002,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92900000000000005,"5min":1.377,"15min":1.377},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.038,"5min":1.415,"15min":1.415},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80000000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89000000000000001,"5min":1.52,"15min":1.52},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.434,"15min":0.434},"max":{"1min":0.93300000000000005,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92000000000000004,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.77400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":905216,"data_stored":393921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57599999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.503}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54600000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.42199999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.014,"5min":1.387,"15min":1.387},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.749},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0409999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.92600000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.149,"5min":1.714,"15min":1.714},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1339999999999999,"5min":1.744,"15min":1.744},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0980000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0720000000000001,"5min":1.575,"15min":1.575},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95099999999999996,"5min":1.321,"15min":1.321},"last":0.83599999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":389366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":1.145,"15min":1.145},"last":0.44},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60599999999999998,"15min":0.66600000000000004},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.375}]},{"osd":2,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.755},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.626,"15min":0.66100000000000003},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":2.609,"15min":2.609},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.68200000000000005,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.58299999999999996}]},{"osd":4,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.03,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.54700000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.012,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.042,"5min":1.095,"15min":1.095},"last":0.68000000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.96999999999999997,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.91600000000000004,"15min":0.98999999999999999},"min":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0549999999999999,"5min":5.375,"15min":5.375},"last":0.75800000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.92400000000000004,"15min":0.998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95099999999999996,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":1.629,"15min":1.629},"last":0.71199999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1478656,"data_stored":980156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58799999999999997,"5min":1.046,"15min":1.046},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.624}]},{"osd":3,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66700000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68700000000000006}]},{"osd":4,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96699999999999997,"5min":1.139,"15min":1.139},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.746,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.071,"15min":1.071},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.095,"15min":1.095},"last":0.71199999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.008,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81699999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.749},"min":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.76100000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1482752,"data_stored":979722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97399999999999998,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.61599999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.443},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.55000000000000004}]},{"osd":2,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.50700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.63}]},{"osd":4,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.504}]},{"osd":5,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98199999999999998,"5min":1.052,"15min":1.052},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.58599999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":897024,"data_stored":390908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81699999999999995,"5min":1.264,"15min":1.264},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89200000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.749,"15min":0.755},"min":{"1min":0.61599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96699999999999997,"5min":1.198,"15min":1.198},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48999999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.171,"15min":1.171},"last":0.66100000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.84999999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1040000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.999,"5min":1.522,"15min":1.522},"last":0.88200000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.86699999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":1.228,"15min":1.228},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.82499999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":884736,"data_stored":389788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45600000000000002},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36399999999999999}]},{"osd":3,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.436},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.42599999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.179,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93200000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.59799999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.628}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.042,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.995,"5min":1.252,"15min":1.252},"last":0.56200000000000006}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0669999999999999,"5min":1.29,"15min":1.29},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1319999999999999,"5min":1.337,"15min":1.337},"last":0.62}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:19:31.350 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-17T12:19:31.351 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-02-17T12:19:31.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff10a400640 1 Processor -- start 2024-02-17T12:19:31.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff10a400640 1 -- start start 2024-02-17T12:19:31.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff10a400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff1040c25a0 0x7ff10406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff10a400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff10406db50 0x7ff10414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff10a400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff104156270 con 0x7ff104150490 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff10a400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff104071630 con 0x7ff10406db50 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff10a400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff104156550 con 0x7ff1040c25a0 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff102a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff10406db50 0x7ff10414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff102a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff10406db50 0x7ff10414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35502/0 (socket says 172.21.15.114:35502) 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff102a00640 1 -- 172.21.15.114:0/362993773 learned_addr learned my addr 172.21.15.114:0/362993773 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff102a00640 1 -- 172.21.15.114:0/362993773 >> v2:172.21.15.116:3300/0 conn(0x7ff1040c25a0 msgr2=0x7ff10406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff103400640 1 --2- 172.21.15.114:0/362993773 >> v2:172.21.15.116:3300/0 conn(0x7ff1040c25a0 0x7ff10406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff102a00640 1 --2- 172.21.15.114:0/362993773 >> v2:172.21.15.116:3300/0 conn(0x7ff1040c25a0 0x7ff10406e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff102a00640 1 -- 172.21.15.114:0/362993773 >> v1:172.21.15.116:6789/0 conn(0x7ff104150490 legacy=0x7ff104152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.524+0000 7ff102a00640 1 -- 172.21.15.114:0/362993773 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104156830 con 0x7ff10406db50 2024-02-17T12:19:31.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff102a00640 1 --2- 172.21.15.114:0/362993773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff10406db50 0x7ff10414ff50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff1040ab930 tx=0x7ff0ec01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ac84c363cfc563 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:31.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff102000640 1 -- 172.21.15.114:0/362993773 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0ab600 con 0x7ff10406db50 2024-02-17T12:19:31.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff102000640 1 -- 172.21.15.114:0/362993773 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0a7050 con 0x7ff10406db50 2024-02-17T12:19:31.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff102000640 1 -- 172.21.15.114:0/362993773 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0ab980 con 0x7ff10406db50 2024-02-17T12:19:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff10a400640 1 -- 172.21.15.114:0/362993773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff10406db50 msgr2=0x7ff10414ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff10a400640 1 --2- 172.21.15.114:0/362993773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff10406db50 0x7ff10414ff50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff1040ab930 tx=0x7ff0ec01c3c0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff10a400640 1 -- 172.21.15.114:0/362993773 shutdown_connections 2024-02-17T12:19:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff10a400640 1 --2- 172.21.15.114:0/362993773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff10406db50 0x7ff10414ff50 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff10a400640 1 --2- 172.21.15.114:0/362993773 >> v2:172.21.15.116:3300/0 conn(0x7ff1040c25a0 0x7ff10406e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff10a400640 1 -- 172.21.15.114:0/362993773 >> 172.21.15.114:0/362993773 conn(0x7ff1040a8490 msgr2=0x7ff1040a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff10a400640 1 -- 172.21.15.114:0/362993773 shutdown_connections 2024-02-17T12:19:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff10a400640 1 -- 172.21.15.114:0/362993773 wait complete. 2024-02-17T12:19:31.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff10a400640 1 Processor -- start 2024-02-17T12:19:31.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.528+0000 7ff10a400640 1 -- start start 2024-02-17T12:19:31.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff10a400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff10406db50 0x7ff1040bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff10a400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1040c25a0 0x7ff1041f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff10a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104150490 0x7ff10413fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff10a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10414e0d0 con 0x7ff104150490 2024-02-17T12:19:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff10a400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1040c50b0 con 0x7ff1040c25a0 2024-02-17T12:19:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff10a400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1040c4aa0 con 0x7ff10406db50 2024-02-17T12:19:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff103e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104150490 0x7ff10413fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff103e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104150490 0x7ff10413fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35504/0 (socket says 172.21.15.114:35504) 2024-02-17T12:19:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff103e00640 1 -- 172.21.15.114:0/2676629069 learned_addr learned my addr 172.21.15.114:0/2676629069 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff103e00640 1 -- 172.21.15.114:0/2676629069 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff10406db50 msgr2=0x7ff1040bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff103e00640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff10406db50 0x7ff1040bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff103e00640 1 -- 172.21.15.114:0/2676629069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1040c25a0 msgr2=0x7ff1041f0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff103e00640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1040c25a0 0x7ff1041f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff103e00640 1 -- 172.21.15.114:0/2676629069 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0094d0 con 0x7ff104150490 2024-02-17T12:19:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff103e00640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104150490 0x7ff10413fa40 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00b440 tx=0x7ff0fc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff0fb400640 1 -- 172.21.15.114:0/2676629069 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc011830 con 0x7ff104150490 2024-02-17T12:19:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff0fb400640 1 -- 172.21.15.114:0/2676629069 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0119b0 con 0x7ff104150490 2024-02-17T12:19:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff10a400640 1 -- 172.21.15.114:0/2676629069 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10414db10 con 0x7ff104150490 2024-02-17T12:19:31.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff0fb400640 1 -- 172.21.15.114:0/2676629069 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc011d60 con 0x7ff104150490 2024-02-17T12:19:31.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff10a400640 1 -- 172.21.15.114:0/2676629069 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1040c4cd0 con 0x7ff104150490 2024-02-17T12:19:31.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff10a400640 1 -- 172.21.15.114:0/2676629069 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1040c51f0 con 0x7ff104150490 2024-02-17T12:19:31.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.532+0000 7ff0fb400640 1 -- 172.21.15.114:0/2676629069 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff0fc01a400 con 0x7ff104150490 2024-02-17T12:19:31.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.536+0000 7ff0fb400640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff0e0066e40 0x7ff0e0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.536+0000 7ff0fb400640 1 -- 172.21.15.114:0/2676629069 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff0fc084e40 con 0x7ff104150490 2024-02-17T12:19:31.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.536+0000 7ff103400640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff0e0066e40 0x7ff0e0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.536+0000 7ff103400640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff0e0066e40 0x7ff0e0069300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4007e60 tx=0x7ff0f4007390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:31.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.540+0000 7ff0fb400640 1 -- 172.21.15.114:0/2676629069 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff1040c51f0 con 0x7ff104150490 2024-02-17T12:19:31.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.748+0000 7ff10a400640 1 -- 172.21.15.114:0/2676629069 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7ff1040c51f0 con 0x7ff104150490 2024-02-17T12:19:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.748+0000 7ff0fb400640 1 -- 172.21.15.114:0/2676629069 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v18) v1 ==== 185+0+142 (secure 0 0 0) 0x7ff1040c51f0 con 0x7ff104150490 2024-02-17T12:19:31.754 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-02-17T12:19:31.754 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBSo9BlffPTGhAA6uMply4Nxw6KXsGwVHriZg== 2024-02-17T12:19:31.754 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-02-17T12:19:31.754 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-02-17T12:19:31.754 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-02-17T12:19:31.754 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.1 2024-02-17T12:19:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 -- 172.21.15.114:0/2676629069 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff0e0066e40 msgr2=0x7ff0e0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff0e0066e40 0x7ff0e0069300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4007e60 tx=0x7ff0f4007390 comp rx=0 tx=0).stop 2024-02-17T12:19:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 -- 172.21.15.114:0/2676629069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104150490 msgr2=0x7ff10413fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104150490 0x7ff10413fa40 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00b440 tx=0x7ff0fc00b900 comp rx=0 tx=0).stop 2024-02-17T12:19:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 -- 172.21.15.114:0/2676629069 shutdown_connections 2024-02-17T12:19:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff0e0066e40 0x7ff0e0069300 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff104150490 0x7ff10413fa40 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1040c25a0 0x7ff1041f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 --2- 172.21.15.114:0/2676629069 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff10406db50 0x7ff1040bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 -- 172.21.15.114:0/2676629069 >> 172.21.15.114:0/2676629069 conn(0x7ff1040a8490 msgr2=0x7ff104152c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 -- 172.21.15.114:0/2676629069 shutdown_connections 2024-02-17T12:19:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.752+0000 7ff10a400640 1 -- 172.21.15.114:0/2676629069 wait complete. 2024-02-17T12:19:31.775 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:31.775 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:31.786 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:31.786 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:31.838 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.968+0000 7f5da4e00640 1 Processor -- start 2024-02-17T12:19:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.968+0000 7f5da4e00640 1 -- start start 2024-02-17T12:19:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.968+0000 7f5da4e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5da006db50 0x7f5da014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.968+0000 7f5da4e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0150490 0x7f5da0152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.968+0000 7f5da4e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da0156270 con 0x7f5da00c25a0 2024-02-17T12:19:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.968+0000 7f5da4e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da006f090 con 0x7f5da006db50 2024-02-17T12:19:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.968+0000 7f5da4e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0071630 con 0x7f5da0150490 2024-02-17T12:19:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.968+0000 7f5d9de00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5da00c25a0 0x7f5da006e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56142/0 (socket says 172.21.15.114:56142) 2024-02-17T12:19:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.968+0000 7f5d9de00640 1 -- 172.21.15.114:0/2133544065 learned_addr learned my addr 172.21.15.114:0/2133544065 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9d400640 1 --2- 172.21.15.114:0/2133544065 >> v2:172.21.15.116:3300/0 conn(0x7f5da006db50 0x7f5da014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9e800640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0150490 0x7f5da0152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117233648 0 0) 0x7f5da0156270 con 0x7f5da00c25a0 2024-02-17T12:19:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d84003530 con 0x7f5da00c25a0 2024-02-17T12:19:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2377670654 0 0) 0x7f5d84003530 con 0x7f5da00c25a0 2024-02-17T12:19:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0150490 msgr2=0x7f5da0152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0150490 0x7f5da0152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 >> v2:172.21.15.116:3300/0 conn(0x7f5da006db50 msgr2=0x7f5da014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 --2- 172.21.15.114:0/2133544065 >> v2:172.21.15.116:3300/0 conn(0x7f5da006db50 0x7f5da014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da0156550 con 0x7f5da00c25a0 2024-02-17T12:19:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f5d90001a20 con 0x7f5da00c25a0 2024-02-17T12:19:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 >> v1:172.21.15.114:6789/0 conn(0x7f5da00c25a0 legacy=0x7f5da006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0150490 0x7f5d84003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 0x7f5d840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d84004d10 0x7f5d84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da006f090 con 0x7f5d84003f50 2024-02-17T12:19:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8400ba40 con 0x7f5d84004d10 2024-02-17T12:19:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8400bc00 con 0x7f5da0150490 2024-02-17T12:19:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9d400640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 0x7f5d840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9de00640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0150490 0x7f5d84003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9e800640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d84004d10 0x7f5d84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9d400640 1 -- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0150490 msgr2=0x7f5d84003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9d400640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0150490 0x7f5d84003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9d400640 1 -- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d84004d10 msgr2=0x7f5d84005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9d400640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d84004d10 0x7f5d84005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9d400640 1 -- 172.21.15.114:0/2133544065 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84003530 con 0x7f5d84003f50 2024-02-17T12:19:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.972+0000 7f5d9e800640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d84004d10 0x7f5d84005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5d9d400640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 0x7f5d840047d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009ae0 tx=0x7f5d8c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bedca8161822a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0a5560 con 0x7f5d84003f50 2024-02-17T12:19:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c0a56c0 con 0x7f5d84003f50 2024-02-17T12:19:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5d9ca00640 1 -- 172.21.15.114:0/2133544065 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0a5a70 con 0x7f5d84003f50 2024-02-17T12:19:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 -- 172.21.15.114:0/2133544065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 msgr2=0x7f5d840047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 --2- 172.21.15.114:0/2133544065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 0x7f5d840047d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009ae0 tx=0x7f5d8c01ca80 comp rx=0 tx=0).stop 2024-02-17T12:19:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5d9e800640 1 -- 172.21.15.114:0/2133544065 reap_dead start 2024-02-17T12:19:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 -- 172.21.15.114:0/2133544065 shutdown_connections 2024-02-17T12:19:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 -- 172.21.15.114:0/2133544065 >> 172.21.15.114:0/2133544065 conn(0x7f5da00a8490 msgr2=0x7f5da00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 -- 172.21.15.114:0/2133544065 shutdown_connections 2024-02-17T12:19:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 -- 172.21.15.114:0/2133544065 wait complete. 2024-02-17T12:19:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 Processor -- start 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 -- start start 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 0x7f5da0143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0147760 0x7f5da01ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5da01ed840 0x7f5da0153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da00aa380 con 0x7f5d84003f50 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da00a9c10 con 0x7f5da01ed840 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5da4e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da014dd90 con 0x7f5da0147760 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5d9de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 0x7f5da0143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5d9de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 0x7f5da0143e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35524/0 (socket says 172.21.15.114:35524) 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5d9de00640 1 -- 172.21.15.114:0/681925027 learned_addr learned my addr 172.21.15.114:0/681925027 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.976+0000 7f5d9d400640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0147760 0x7f5da01ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d9e800640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5da01ed840 0x7f5da0153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d9de00640 1 -- 172.21.15.114:0/681925027 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0147760 msgr2=0x7f5da01ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d9de00640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0147760 0x7f5da01ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d9de00640 1 -- 172.21.15.114:0/681925027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5da01ed840 msgr2=0x7f5da0153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d9de00640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5da01ed840 0x7f5da0153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d9de00640 1 -- 172.21.15.114:0/681925027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da014e070 con 0x7f5d84003f50 2024-02-17T12:19:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d9de00640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 0x7f5da0143e30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5d90007750 tx=0x7f5d90007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d96000640 1 -- 172.21.15.114:0/681925027 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000aca0 con 0x7f5d84003f50 2024-02-17T12:19:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d96000640 1 -- 172.21.15.114:0/681925027 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9000ae20 con 0x7f5d84003f50 2024-02-17T12:19:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d96000640 1 -- 172.21.15.114:0/681925027 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d90013630 con 0x7f5d84003f50 2024-02-17T12:19:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5da4e00640 1 -- 172.21.15.114:0/681925027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da01f1320 con 0x7f5d84003f50 2024-02-17T12:19:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5da4e00640 1 -- 172.21.15.114:0/681925027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da00a9e60 con 0x7f5d84003f50 2024-02-17T12:19:31.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5da4e00640 1 -- 172.21.15.114:0/681925027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da0074840 con 0x7f5d84003f50 2024-02-17T12:19:31.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d96000640 1 -- 172.21.15.114:0/681925027 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f5d90013790 con 0x7f5d84003f50 2024-02-17T12:19:31.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d96000640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d80066e40 0x7f5d80069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d96000640 1 -- 172.21.15.114:0/681925027 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5d90085a20 con 0x7f5d84003f50 2024-02-17T12:19:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.980+0000 7f5d9d400640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d80066e40 0x7f5d80069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.984+0000 7f5d9d400640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d80066e40 0x7f5d80069300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0af000 tx=0x7f5d8c0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:31.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:31.984+0000 7f5d96000640 1 -- 172.21.15.114:0/681925027 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5d90052410 con 0x7f5d84003f50 2024-02-17T12:19:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.140+0000 7f5da4e00640 1 -- 172.21.15.114:0/681925027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5da00aa020 con 0x7f5d84003f50 2024-02-17T12:19:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.140+0000 7f5d96000640 1 -- 172.21.15.114:0/681925027 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20392 (secure 0 0 0) 0x7f5d90017020 con 0x7f5d84003f50 2024-02-17T12:19:32.144 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:32.145 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:23.364663+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:32.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 -- 172.21.15.114:0/681925027 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d80066e40 msgr2=0x7f5d80069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d80066e40 0x7f5d80069300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0af000 tx=0x7f5d8c0046d0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 -- 172.21.15.114:0/681925027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 msgr2=0x7f5da0143e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 0x7f5da0143e30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5d90007750 tx=0x7f5d90007c10 comp rx=0 tx=0).stop 2024-02-17T12:19:32.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 -- 172.21.15.114:0/681925027 shutdown_connections 2024-02-17T12:19:32.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5da01ed840 0x7f5da0153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5da0147760 0x7f5da01ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5d80066e40 0x7f5d80069300 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 --2- 172.21.15.114:0/681925027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d84003f50 0x7f5da0143e30 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 -- 172.21.15.114:0/681925027 >> 172.21.15.114:0/681925027 conn(0x7f5da00a8490 msgr2=0x7f5da0149980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:32.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 -- 172.21.15.114:0/681925027 shutdown_connections 2024-02-17T12:19:32.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.144+0000 7f5da4e00640 1 -- 172.21.15.114:0/681925027 wait complete. 2024-02-17T12:19:32.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:19:01.796651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:19:03.070707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:19:19.573884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:19:20.731260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:19:32.166 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:19:32.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.300+0000 7f9e23c00640 1 Processor -- start 2024-02-17T12:19:32.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.300+0000 7f9e23c00640 1 -- start start 2024-02-17T12:19:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e23c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9e1c152c50 0x7f9e1c153070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e23c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e1c156270 con 0x7f9e1c0c25a0 2024-02-17T12:19:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e23c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e1c156550 con 0x7f9e1c06db50 2024-02-17T12:19:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e23c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1c06f090 con 0x7f9e1c152c50 2024-02-17T12:19:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e21200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9e1c0c25a0 0x7f9e1c06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56154/0 (socket says 172.21.15.114:56154) 2024-02-17T12:19:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e21200640 1 -- 172.21.15.114:0/2570452529 learned_addr learned my addr 172.21.15.114:0/2570452529 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e21c00640 1 --2- 172.21.15.114:0/2570452529 >> v2:172.21.15.116:3300/0 conn(0x7f9e1c152c50 0x7f9e1c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599844613 0 0) 0x7f9e1c156270 con 0x7f9e1c0c25a0 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e04003530 con 0x7f9e1c0c25a0 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3475551336 0 0) 0x7f9e04003530 con 0x7f9e1c0c25a0 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 >> v2:172.21.15.116:3300/0 conn(0x7f9e1c152c50 msgr2=0x7f9e1c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 --2- 172.21.15.114:0/2570452529 >> v2:172.21.15.116:3300/0 conn(0x7f9e1c152c50 0x7f9e1c153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 >> v1:172.21.15.116:6789/0 conn(0x7f9e1c06db50 legacy=0x7f9e1c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c156830 con 0x7f9e1c0c25a0 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f9e10001680 con 0x7f9e1c0c25a0 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 >> v1:172.21.15.114:6789/0 conn(0x7f9e1c0c25a0 legacy=0x7f9e1c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e04003980 0x7f9e04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e040047d0 0x7f9e04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c06f090 con 0x7f9e040052b0 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0400c180 con 0x7f9e040047d0 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0400c340 con 0x7f9e04003980 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e21c00640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e1be00640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e040047d0 0x7f9e04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e21200640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e04003980 0x7f9e04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e21c00640 1 -- 172.21.15.114:0/2570452529 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e04003980 msgr2=0x7f9e04003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e21c00640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e04003980 0x7f9e04003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e21c00640 1 -- 172.21.15.114:0/2570452529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e040047d0 msgr2=0x7f9e04004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e21c00640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e040047d0 0x7f9e04004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.304+0000 7f9e21c00640 1 -- 172.21.15.114:0/2570452529 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04003530 con 0x7f9e040052b0 2024-02-17T12:19:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e21c00640 1 -- 172.21.15.114:0/2570452529 reap_dead start 2024-02-17T12:19:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e21c00640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e0400b990 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009f90 tx=0x7f9e1401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640dfa45931d9777 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e14003ba0 con 0x7f9e040052b0 2024-02-17T12:19:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1400f040 con 0x7f9e040052b0 2024-02-17T12:19:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e1b400640 1 -- 172.21.15.114:0/2570452529 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e140a5870 con 0x7f9e040052b0 2024-02-17T12:19:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e23c00640 1 -- 172.21.15.114:0/2570452529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 msgr2=0x7f9e0400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e23c00640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e0400b990 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009f90 tx=0x7f9e1401cc80 comp rx=0 tx=0).stop 2024-02-17T12:19:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e23c00640 1 -- 172.21.15.114:0/2570452529 shutdown_connections 2024-02-17T12:19:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e23c00640 1 --2- 172.21.15.114:0/2570452529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e0400b990 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e23c00640 1 -- 172.21.15.114:0/2570452529 >> 172.21.15.114:0/2570452529 conn(0x7f9e1c0a8490 msgr2=0x7f9e1c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e23c00640 1 -- 172.21.15.114:0/2570452529 shutdown_connections 2024-02-17T12:19:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.308+0000 7f9e23c00640 1 -- 172.21.15.114:0/2570452529 wait complete. 2024-02-17T12:19:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 Processor -- start 2024-02-17T12:19:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 -- start start 2024-02-17T12:19:32.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e1c0a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e1c153ef0 0x7f9e1c0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e1c154370 0x7f9e1c13b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c0c1cd0 con 0x7f9e040052b0 2024-02-17T12:19:32.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c0aa700 con 0x7f9e1c154370 2024-02-17T12:19:32.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c0a9890 con 0x7f9e1c153ef0 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e1c0a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e1c0a9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35536/0 (socket says 172.21.15.114:35536) 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21200640 1 -- 172.21.15.114:0/3669876287 learned_addr learned my addr 172.21.15.114:0/3669876287 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e1be00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e1c153ef0 0x7f9e1c0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21c00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e1c154370 0x7f9e1c13b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21200640 1 -- 172.21.15.114:0/3669876287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e1c153ef0 msgr2=0x7f9e1c0bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21200640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e1c153ef0 0x7f9e1c0bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21200640 1 -- 172.21.15.114:0/3669876287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e1c154370 msgr2=0x7f9e1c13b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21200640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e1c154370 0x7f9e1c13b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21200640 1 -- 172.21.15.114:0/3669876287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c0ab170 con 0x7f9e040052b0 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e1be00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e1c153ef0 0x7f9e1c0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21c00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e1c154370 0x7f9e1c13b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e21200640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e1c0a9d20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000e700 tx=0x7f9e1000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:32.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e18c00640 1 -- 172.21.15.114:0/3669876287 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000c6c0 con 0x7f9e040052b0 2024-02-17T12:19:32.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e18c00640 1 -- 172.21.15.114:0/3669876287 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1000c820 con 0x7f9e040052b0 2024-02-17T12:19:32.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e18c00640 1 -- 172.21.15.114:0/3669876287 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000cb90 con 0x7f9e040052b0 2024-02-17T12:19:32.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 -- 172.21.15.114:0/3669876287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1c0ab450 con 0x7f9e040052b0 2024-02-17T12:19:32.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 -- 172.21.15.114:0/3669876287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1c13afd0 con 0x7f9e040052b0 2024-02-17T12:19:32.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.312+0000 7f9e23c00640 1 -- 172.21.15.114:0/3669876287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1c074840 con 0x7f9e040052b0 2024-02-17T12:19:32.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.316+0000 7f9e18c00640 1 -- 172.21.15.114:0/3669876287 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9e1000ccf0 con 0x7f9e040052b0 2024-02-17T12:19:32.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.316+0000 7f9e18c00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9dfc066e70 0x7f9dfc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.316+0000 7f9e18c00640 1 -- 172.21.15.114:0/3669876287 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9e10084cd0 con 0x7f9e040052b0 2024-02-17T12:19:32.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.316+0000 7f9e1be00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9dfc066e70 0x7f9dfc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.316+0000 7f9e1be00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9dfc066e70 0x7f9dfc069330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9e08000c10 tx=0x7f9e08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.320+0000 7f9e18c00640 1 -- 172.21.15.114:0/3669876287 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9e10051750 con 0x7f9e040052b0 2024-02-17T12:19:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 -- 172.21.15.114:0/3669876287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e1c14d590 con 0x7f9e040052b0 2024-02-17T12:19:32.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e18c00640 1 -- 172.21.15.114:0/3669876287 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e10054e10 con 0x7f9e040052b0 2024-02-17T12:19:32.479 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 -- 172.21.15.114:0/3669876287 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9dfc066e70 msgr2=0x7f9dfc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9dfc066e70 0x7f9dfc069330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9e08000c10 tx=0x7f9e08009040 comp rx=0 tx=0).stop 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 -- 172.21.15.114:0/3669876287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 msgr2=0x7f9e1c0a9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e1c0a9d20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000e700 tx=0x7f9e1000ebc0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 -- 172.21.15.114:0/3669876287 shutdown_connections 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e1c154370 0x7f9e1c13b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9e1c153ef0 0x7f9e1c0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9dfc066e70 0x7f9dfc069330 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 --2- 172.21.15.114:0/3669876287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e040052b0 0x7f9e1c0a9d20 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 -- 172.21.15.114:0/3669876287 >> 172.21.15.114:0/3669876287 conn(0x7f9e1c0a8490 msgr2=0x7f9e1c06e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 -- 172.21.15.114:0/3669876287 shutdown_connections 2024-02-17T12:19:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.476+0000 7f9e23c00640 1 -- 172.21.15.114:0/3669876287 wait complete. 2024-02-17T12:19:32.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:19:32.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.632+0000 7f5f31400640 1 Processor -- start 2024-02-17T12:19:32.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.632+0000 7f5f31400640 1 -- start start 2024-02-17T12:19:32.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f31400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f2c14cb50 0x7f5f2c06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f31400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5f2c06b150 0x7f5f2c06dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f31400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f2c06b740 0x7f5f2c06e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f31400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c0aa340 con 0x7f5f2c06b740 2024-02-17T12:19:32.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f31400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c1538c0 con 0x7f5f2c06b150 2024-02-17T12:19:32.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f31400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c0c0f20 con 0x7f5f2c14cb50 2024-02-17T12:19:32.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f30a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f2c06b740 0x7f5f2c06e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f30a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5f2c06b740 0x7f5f2c06e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35544/0 (socket says 172.21.15.114:35544) 2024-02-17T12:19:32.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f30a00640 1 -- 172.21.15.114:0/2620767112 learned_addr learned my addr 172.21.15.114:0/2620767112 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:32.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f2be00640 1 --2- 172.21.15.114:0/2620767112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f2c14cb50 0x7f5f2c06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f2b400640 1 --2- 172.21.15.114:0/2620767112 >> v2:172.21.15.116:3300/0 conn(0x7f5f2c06b150 0x7f5f2c06dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f30a00640 1 -- 172.21.15.114:0/2620767112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f2c14cb50 msgr2=0x7f5f2c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:32.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f30a00640 1 --2- 172.21.15.114:0/2620767112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f2c14cb50 0x7f5f2c06ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f30a00640 1 -- 172.21.15.114:0/2620767112 >> v2:172.21.15.116:3300/0 conn(0x7f5f2c06b150 msgr2=0x7f5f2c06dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:32.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f30a00640 1 --2- 172.21.15.114:0/2620767112 >> v2:172.21.15.116:3300/0 conn(0x7f5f2c06b150 0x7f5f2c06dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f30a00640 1 -- 172.21.15.114:0/2620767112 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c152cb0 con 0x7f5f2c06b740 2024-02-17T12:19:32.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f2b400640 1 --2- 172.21.15.114:0/2620767112 >> v2:172.21.15.116:3300/0 conn(0x7f5f2c06b150 0x7f5f2c06dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:32.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.636+0000 7f5f30a00640 1 --2- 172.21.15.114:0/2620767112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c06b740 0x7f5f2c06e100 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c073370 tx=0x7f5f2401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f777aeabc713174 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:32.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f2aa00640 1 -- 172.21.15.114:0/2620767112 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240a57b0 con 0x7f5f2c06b740 2024-02-17T12:19:32.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f2aa00640 1 -- 172.21.15.114:0/2620767112 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f240a5910 con 0x7f5f2c06b740 2024-02-17T12:19:32.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f2aa00640 1 -- 172.21.15.114:0/2620767112 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240a5ca0 con 0x7f5f2c06b740 2024-02-17T12:19:32.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 -- 172.21.15.114:0/2620767112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c06b740 msgr2=0x7f5f2c06e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 --2- 172.21.15.114:0/2620767112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c06b740 0x7f5f2c06e100 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c073370 tx=0x7f5f2401c930 comp rx=0 tx=0).stop 2024-02-17T12:19:32.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 -- 172.21.15.114:0/2620767112 shutdown_connections 2024-02-17T12:19:32.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 --2- 172.21.15.114:0/2620767112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c06b740 0x7f5f2c06e100 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 --2- 172.21.15.114:0/2620767112 >> v2:172.21.15.116:3300/0 conn(0x7f5f2c06b150 0x7f5f2c06dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 --2- 172.21.15.114:0/2620767112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f2c14cb50 0x7f5f2c06ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 -- 172.21.15.114:0/2620767112 >> 172.21.15.114:0/2620767112 conn(0x7f5f2c0c6300 msgr2=0x7f5f2c0c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:32.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 -- 172.21.15.114:0/2620767112 shutdown_connections 2024-02-17T12:19:32.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 -- 172.21.15.114:0/2620767112 wait complete. 2024-02-17T12:19:32.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 Processor -- start 2024-02-17T12:19:32.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 -- start start 2024-02-17T12:19:32.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f2c06b150 0x7f5f2c149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c06b740 0x7f5f2c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c14cb50 0x7f5f2c1f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c148260 con 0x7f5f2c14cb50 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c072210 con 0x7f5f2c06b740 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f31400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c147780 con 0x7f5f2c06b150 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f30a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c14cb50 0x7f5f2c1f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f30a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c14cb50 0x7f5f2c1f02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35558/0 (socket says 172.21.15.114:35558) 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f30a00640 1 -- 172.21.15.114:0/1705296934 learned_addr learned my addr 172.21.15.114:0/1705296934 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f2b400640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c06b740 0x7f5f2c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f2be00640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f2c06b150 0x7f5f2c149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f30a00640 1 -- 172.21.15.114:0/1705296934 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f2c06b150 msgr2=0x7f5f2c149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f30a00640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f2c06b150 0x7f5f2c149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f30a00640 1 -- 172.21.15.114:0/1705296934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c06b740 msgr2=0x7f5f2c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f30a00640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c06b740 0x7f5f2c0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f30a00640 1 -- 172.21.15.114:0/1705296934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24009b30 con 0x7f5f2c14cb50 2024-02-17T12:19:32.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.640+0000 7f5f2b400640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c06b740 0x7f5f2c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:32.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f30a00640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c14cb50 0x7f5f2c1f02a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5f240af040 tx=0x7f5f240196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:32.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f23e00640 1 -- 172.21.15.114:0/1705296934 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240b8670 con 0x7f5f2c14cb50 2024-02-17T12:19:32.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f23e00640 1 -- 172.21.15.114:0/1705296934 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f240b87d0 con 0x7f5f2c14cb50 2024-02-17T12:19:32.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f23e00640 1 -- 172.21.15.114:0/1705296934 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240b8b80 con 0x7f5f2c14cb50 2024-02-17T12:19:32.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f31400640 1 -- 172.21.15.114:0/1705296934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c071cb0 con 0x7f5f2c14cb50 2024-02-17T12:19:32.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f31400640 1 -- 172.21.15.114:0/1705296934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c1f07e0 con 0x7f5f2c14cb50 2024-02-17T12:19:32.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f31400640 1 -- 172.21.15.114:0/1705296934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c072be0 con 0x7f5f2c14cb50 2024-02-17T12:19:32.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f23e00640 1 -- 172.21.15.114:0/1705296934 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f5f240b8ce0 con 0x7f5f2c14cb50 2024-02-17T12:19:32.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f23e00640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5f0c066e70 0x7f5f0c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f23e00640 1 -- 172.21.15.114:0/1705296934 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5f24120250 con 0x7f5f2c14cb50 2024-02-17T12:19:32.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f2be00640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5f0c066e70 0x7f5f0c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.644+0000 7f5f2be00640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5f0c066e70 0x7f5f0c069330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00b9d0 tx=0x7f5f1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:32.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.648+0000 7f5f23e00640 1 -- 172.21.15.114:0/1705296934 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5f240ecdf0 con 0x7f5f2c14cb50 2024-02-17T12:19:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 -- 172.21.15.114:0/1705296934 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f2c0c0a70 con 0x7f5f2c14cb50 2024-02-17T12:19:32.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f23e00640 1 -- 172.21.15.114:0/1705296934 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f240f04b0 con 0x7f5f2c14cb50 2024-02-17T12:19:32.807 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:32.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 -- 172.21.15.114:0/1705296934 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5f0c066e70 msgr2=0x7f5f0c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5f0c066e70 0x7f5f0c069330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00b9d0 tx=0x7f5f1c008040 comp rx=0 tx=0).stop 2024-02-17T12:19:32.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 -- 172.21.15.114:0/1705296934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c14cb50 msgr2=0x7f5f2c1f02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c14cb50 0x7f5f2c1f02a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5f240af040 tx=0x7f5f240196d0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 -- 172.21.15.114:0/1705296934 shutdown_connections 2024-02-17T12:19:32.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5f0c066e70 0x7f5f0c069330 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f2c14cb50 0x7f5f2c1f02a0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5f2c06b740 0x7f5f2c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 --2- 172.21.15.114:0/1705296934 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5f2c06b150 0x7f5f2c149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 -- 172.21.15.114:0/1705296934 >> 172.21.15.114:0/1705296934 conn(0x7f5f2c0c6300 msgr2=0x7f5f2c0ab380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 -- 172.21.15.114:0/1705296934 shutdown_connections 2024-02-17T12:19:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.804+0000 7f5f31400640 1 -- 172.21.15.114:0/1705296934 wait complete. 2024-02-17T12:19:32.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:19:32.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.960+0000 7f41b8a00640 1 Processor -- start 2024-02-17T12:19:32.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.960+0000 7f41b8a00640 1 -- start start 2024-02-17T12:19:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b8a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 0x7f41b414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b8a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f41b4150490 0x7f41b4152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b8a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b4156270 con 0x7f41b40c25a0 2024-02-17T12:19:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b8a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b406f090 con 0x7f41b4150490 2024-02-17T12:19:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b8a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4071630 con 0x7f41b406db50 2024-02-17T12:19:32.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b2800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f41b4150490 0x7f41b4152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b1400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 0x7f41b414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b1400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 0x7f41b414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:44786/0 (socket says 172.21.15.114:44786) 2024-02-17T12:19:32.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b1e00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f41b40c25a0 0x7f41b406e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:35748/0 (socket says 172.21.15.114:35748) 2024-02-17T12:19:32.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b1400640 1 -- 172.21.15.114:0/2536593358 learned_addr learned my addr 172.21.15.114:0/2536593358 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:32.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b2800640 1 -- 172.21.15.114:0/2536593358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 msgr2=0x7f41b414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:32.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b2800640 1 --2- 172.21.15.114:0/2536593358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 0x7f41b414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b2800640 1 -- 172.21.15.114:0/2536593358 >> v1:172.21.15.116:6789/0 conn(0x7f41b40c25a0 legacy=0x7f41b406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.964+0000 7f41b2800640 1 -- 172.21.15.114:0/2536593358 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b4156550 con 0x7f41b4150490 2024-02-17T12:19:32.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b2800640 1 --2- 172.21.15.114:0/2536593358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b4150490 0x7f41b4152c50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009d90 tx=0x7f41ac01c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7980366fbb20dff server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b0a00640 1 -- 172.21.15.114:0/2536593358 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b41539a0 con 0x7f41b4150490 2024-02-17T12:19:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b0a00640 1 -- 172.21.15.114:0/2536593358 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac0a58e0 con 0x7f41b4150490 2024-02-17T12:19:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b0a00640 1 -- 172.21.15.114:0/2536593358 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0a5c70 con 0x7f41b4150490 2024-02-17T12:19:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b8a00640 1 -- 172.21.15.114:0/2536593358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b4150490 msgr2=0x7f41b4152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b8a00640 1 --2- 172.21.15.114:0/2536593358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b4150490 0x7f41b4152c50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009d90 tx=0x7f41ac01c820 comp rx=0 tx=0).stop 2024-02-17T12:19:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b8a00640 1 -- 172.21.15.114:0/2536593358 shutdown_connections 2024-02-17T12:19:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b8a00640 1 --2- 172.21.15.114:0/2536593358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b4150490 0x7f41b4152c50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b8a00640 1 --2- 172.21.15.114:0/2536593358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 0x7f41b414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b8a00640 1 -- 172.21.15.114:0/2536593358 >> 172.21.15.114:0/2536593358 conn(0x7f41b40a8490 msgr2=0x7f41b40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b8a00640 1 -- 172.21.15.114:0/2536593358 shutdown_connections 2024-02-17T12:19:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b8a00640 1 -- 172.21.15.114:0/2536593358 wait complete. 2024-02-17T12:19:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b8a00640 1 Processor -- start 2024-02-17T12:19:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.968+0000 7f41b8a00640 1 -- start start 2024-02-17T12:19:32.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b8a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 0x7f41b41ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b40c25a0 0x7f41b4149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b8a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b4150490 0x7f41b40aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b41f07b0 con 0x7f41b40c25a0 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b8a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b41ed300 con 0x7f41b4150490 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b8a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b41485e0 con 0x7f41b406db50 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b40c25a0 0x7f41b4149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b40c25a0 0x7f41b4149020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35570/0 (socket says 172.21.15.114:35570) 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1400640 1 -- 172.21.15.114:0/1083467116 learned_addr learned my addr 172.21.15.114:0/1083467116 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b2800640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b4150490 0x7f41b40aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1e00640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 0x7f41b41ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1400640 1 -- 172.21.15.114:0/1083467116 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 msgr2=0x7f41b41ecdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1400640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 0x7f41b41ecdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1400640 1 -- 172.21.15.114:0/1083467116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b4150490 msgr2=0x7f41b40aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1400640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b4150490 0x7f41b40aab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1400640 1 -- 172.21.15.114:0/1083467116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac009a70 con 0x7f41b40c25a0 2024-02-17T12:19:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1e00640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 0x7f41b41ecdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b1400640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b40c25a0 0x7f41b4149020 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f419c00e8c0 tx=0x7f419c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41aa000640 1 -- 172.21.15.114:0/1083467116 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c009620 con 0x7f41b40c25a0 2024-02-17T12:19:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41aa000640 1 -- 172.21.15.114:0/1083467116 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c00c940 con 0x7f41b40c25a0 2024-02-17T12:19:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41aa000640 1 -- 172.21.15.114:0/1083467116 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00ccf0 con 0x7f41b40c25a0 2024-02-17T12:19:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b8a00640 1 -- 172.21.15.114:0/1083467116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b41488c0 con 0x7f41b40c25a0 2024-02-17T12:19:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b8a00640 1 -- 172.21.15.114:0/1083467116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b4149560 con 0x7f41b40c25a0 2024-02-17T12:19:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.972+0000 7f41b8a00640 1 -- 172.21.15.114:0/1083467116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b41f08f0 con 0x7f41b40c25a0 2024-02-17T12:19:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.976+0000 7f41aa000640 1 -- 172.21.15.114:0/1083467116 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f419c013470 con 0x7f41b40c25a0 2024-02-17T12:19:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.976+0000 7f41aa000640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4190066e40 0x7f4190069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.976+0000 7f41aa000640 1 -- 172.21.15.114:0/1083467116 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f419c084de0 con 0x7f41b40c25a0 2024-02-17T12:19:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.976+0000 7f41b1e00640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4190066e40 0x7f4190069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.976+0000 7f41b1e00640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4190066e40 0x7f4190069300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f41b4147c80 tx=0x7f41a4007d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:32.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:32.980+0000 7f41aa000640 1 -- 172.21.15.114:0/1083467116 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f41b41f08f0 con 0x7f41b40c25a0 2024-02-17T12:19:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.132+0000 7f41b8a00640 1 -- 172.21.15.114:0/1083467116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41b41f08f0 con 0x7f41b40c25a0 2024-02-17T12:19:33.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41aa000640 1 -- 172.21.15.114:0/1083467116 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41b41f08f0 con 0x7f41b40c25a0 2024-02-17T12:19:33.138 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:33.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 -- 172.21.15.114:0/1083467116 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4190066e40 msgr2=0x7f4190069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4190066e40 0x7f4190069300 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f41b4147c80 tx=0x7f41a4007d90 comp rx=0 tx=0).stop 2024-02-17T12:19:33.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 -- 172.21.15.114:0/1083467116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b40c25a0 msgr2=0x7f41b4149020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b40c25a0 0x7f41b4149020 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f419c00e8c0 tx=0x7f419c00ed80 comp rx=0 tx=0).stop 2024-02-17T12:19:33.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 -- 172.21.15.114:0/1083467116 shutdown_connections 2024-02-17T12:19:33.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41b4150490 0x7f41b40aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4190066e40 0x7f4190069300 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41b40c25a0 0x7f41b4149020 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 --2- 172.21.15.114:0/1083467116 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f41b406db50 0x7f41b41ecdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 -- 172.21.15.114:0/1083467116 >> 172.21.15.114:0/1083467116 conn(0x7f41b40a8490 msgr2=0x7f41b40a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:33.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 -- 172.21.15.114:0/1083467116 shutdown_connections 2024-02-17T12:19:33.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.136+0000 7f41b8a00640 1 -- 172.21.15.114:0/1083467116 wait complete. 2024-02-17T12:19:33.159 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:19:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.292+0000 7f0a30600640 1 Processor -- start 2024-02-17T12:19:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.292+0000 7f0a30600640 1 -- start start 2024-02-17T12:19:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.292+0000 7f0a30600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a280c2580 0x7f0a280aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.292+0000 7f0a30600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a280c1eb0 0x7f0a2815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.292+0000 7f0a30600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a280a9420 con 0x7f0a2814f110 2024-02-17T12:19:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a30600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2814f4f0 con 0x7f0a280c2580 2024-02-17T12:19:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a30600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a280aae80 con 0x7f0a280c1eb0 2024-02-17T12:19:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a2d200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a280c2580 0x7f0a280aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a2d200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0a280c2580 0x7f0a280aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35582/0 (socket says 172.21.15.114:35582) 2024-02-17T12:19:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a2d200640 1 -- 172.21.15.114:0/4014092904 learned_addr learned my addr 172.21.15.114:0/4014092904 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a2dc00640 1 --1- 172.21.15.114:0/4014092904 >> v1:172.21.15.114:6789/0 conn(0x7f0a2814f110 0x7f0a280c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56162/0 (socket says 172.21.15.114:56162) 2024-02-17T12:19:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a2e600640 1 --2- 172.21.15.114:0/4014092904 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a280c1eb0 0x7f0a2815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a2d200640 1 -- 172.21.15.114:0/4014092904 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a280c1eb0 msgr2=0x7f0a2815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a2d200640 1 --2- 172.21.15.114:0/4014092904 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a280c1eb0 0x7f0a2815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a2d200640 1 -- 172.21.15.114:0/4014092904 >> v1:172.21.15.114:6789/0 conn(0x7f0a2814f110 legacy=0x7f0a280c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a2d200640 1 -- 172.21.15.114:0/4014092904 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a28152850 con 0x7f0a280c2580 2024-02-17T12:19:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a2d200640 1 --2- 172.21.15.114:0/4014092904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c2580 0x7f0a280aa150 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009870 tx=0x7f0a1401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65af030cf328394e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a27e00640 1 -- 172.21.15.114:0/4014092904 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a140a6040 con 0x7f0a280c2580 2024-02-17T12:19:33.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a27e00640 1 -- 172.21.15.114:0/4014092904 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a140aa600 con 0x7f0a280c2580 2024-02-17T12:19:33.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.296+0000 7f0a27e00640 1 -- 172.21.15.114:0/4014092904 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a140aa990 con 0x7f0a280c2580 2024-02-17T12:19:33.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 -- 172.21.15.114:0/4014092904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c2580 msgr2=0x7f0a280aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 --2- 172.21.15.114:0/4014092904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c2580 0x7f0a280aa150 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009870 tx=0x7f0a1401c4a0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 -- 172.21.15.114:0/4014092904 shutdown_connections 2024-02-17T12:19:33.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 --2- 172.21.15.114:0/4014092904 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a280c1eb0 0x7f0a2815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 --2- 172.21.15.114:0/4014092904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c2580 0x7f0a280aa150 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 -- 172.21.15.114:0/4014092904 >> 172.21.15.114:0/4014092904 conn(0x7f0a280a8490 msgr2=0x7f0a280a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:33.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 -- 172.21.15.114:0/4014092904 shutdown_connections 2024-02-17T12:19:33.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 -- 172.21.15.114:0/4014092904 wait complete. 2024-02-17T12:19:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 Processor -- start 2024-02-17T12:19:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 -- start start 2024-02-17T12:19:33.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c1eb0 0x7f0a2814d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a280c2580 0x7f0a2814da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a2814f110 0x7f0a2813f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a28145780 con 0x7f0a280c1eb0 2024-02-17T12:19:33.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a28141260 con 0x7f0a2814f110 2024-02-17T12:19:33.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a30600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2813db20 con 0x7f0a280c2580 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c1eb0 0x7f0a2814d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c1eb0 0x7f0a2814d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35598/0 (socket says 172.21.15.114:35598) 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2dc00640 1 -- 172.21.15.114:0/3396395893 learned_addr learned my addr 172.21.15.114:0/3396395893 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2d200640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a280c2580 0x7f0a2814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2e600640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a2814f110 0x7f0a2813f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2dc00640 1 -- 172.21.15.114:0/3396395893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a280c2580 msgr2=0x7f0a2814da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2dc00640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a280c2580 0x7f0a2814da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2dc00640 1 -- 172.21.15.114:0/3396395893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a2814f110 msgr2=0x7f0a2813f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2dc00640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a2814f110 0x7f0a2813f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2dc00640 1 -- 172.21.15.114:0/3396395893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a140094d0 con 0x7f0a280c1eb0 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2e600640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a2814f110 0x7f0a2813f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.300+0000 7f0a2dc00640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c1eb0 0x7f0a2814d4f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00c420 tx=0x7f0a1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a25600640 1 -- 172.21.15.114:0/3396395893 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c0074e0 con 0x7f0a280c1eb0 2024-02-17T12:19:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a25600640 1 -- 172.21.15.114:0/3396395893 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c007640 con 0x7f0a280c1eb0 2024-02-17T12:19:33.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a25600640 1 -- 172.21.15.114:0/3396395893 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c004a30 con 0x7f0a280c1eb0 2024-02-17T12:19:33.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a30600640 1 -- 172.21.15.114:0/3396395893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a281443c0 con 0x7f0a280c1eb0 2024-02-17T12:19:33.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a30600640 1 -- 172.21.15.114:0/3396395893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a28145410 con 0x7f0a280c1eb0 2024-02-17T12:19:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a30600640 1 -- 172.21.15.114:0/3396395893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a28140040 con 0x7f0a280c1eb0 2024-02-17T12:19:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a25600640 1 -- 172.21.15.114:0/3396395893 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0a1c004b90 con 0x7f0a280c1eb0 2024-02-17T12:19:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a25600640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a08066e40 0x7f0a08069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a25600640 1 -- 172.21.15.114:0/3396395893 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0a1c0848c0 con 0x7f0a280c1eb0 2024-02-17T12:19:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a2d200640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a08066e40 0x7f0a08069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.304+0000 7f0a2d200640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a08066e40 0x7f0a08069300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0a140ae000 tx=0x7f0a140a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:33.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.308+0000 7f0a25600640 1 -- 172.21.15.114:0/3396395893 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0a1c0512b0 con 0x7f0a280c1eb0 2024-02-17T12:19:33.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.464+0000 7f0a30600640 1 -- 172.21.15.114:0/3396395893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a28074840 con 0x7f0a280c1eb0 2024-02-17T12:19:33.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a25600640 1 -- 172.21.15.114:0/3396395893 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0a1c054970 con 0x7f0a280c1eb0 2024-02-17T12:19:33.470 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 -- 172.21.15.114:0/3396395893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a08066e40 msgr2=0x7f0a08069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a08066e40 0x7f0a08069300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0a140ae000 tx=0x7f0a140a7000 comp rx=0 tx=0).stop 2024-02-17T12:19:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 -- 172.21.15.114:0/3396395893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c1eb0 msgr2=0x7f0a2814d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c1eb0 0x7f0a2814d4f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00c420 tx=0x7f0a1c00c8e0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 -- 172.21.15.114:0/3396395893 shutdown_connections 2024-02-17T12:19:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a2814f110 0x7f0a2813f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a280c2580 0x7f0a2814da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0a08066e40 0x7f0a08069300 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 --2- 172.21.15.114:0/3396395893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280c1eb0 0x7f0a2814d4f0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 -- 172.21.15.114:0/3396395893 >> 172.21.15.114:0/3396395893 conn(0x7f0a280a8490 msgr2=0x7f0a280c36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 -- 172.21.15.114:0/3396395893 shutdown_connections 2024-02-17T12:19:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.468+0000 7f0a30600640 1 -- 172.21.15.114:0/3396395893 wait complete. 2024-02-17T12:19:33.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:19:33.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.624+0000 7f2c4b400640 1 Processor -- start 2024-02-17T12:19:33.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.624+0000 7f2c4b400640 1 -- start start 2024-02-17T12:19:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c4b400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c4414f110 0x7f2c440c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c4b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2c440c2580 0x7f2c440aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c4b400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c440a9420 con 0x7f2c440c1eb0 2024-02-17T12:19:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c4b400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4414f4f0 con 0x7f2c440c2580 2024-02-17T12:19:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c4b400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440aae80 con 0x7f2c4414f110 2024-02-17T12:19:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c43e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2c440c2580 0x7f2c440aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c49400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2c440c1eb0 0x7f2c44155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56174/0 (socket says 172.21.15.114:56174) 2024-02-17T12:19:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c49400640 1 -- 172.21.15.114:0/3540340734 learned_addr learned my addr 172.21.15.114:0/3540340734 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c48a00640 1 --2- 172.21.15.114:0/3540340734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c4414f110 0x7f2c440c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c43e00640 1 -- 172.21.15.114:0/3540340734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c4414f110 msgr2=0x7f2c440c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c43e00640 1 --2- 172.21.15.114:0/3540340734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c4414f110 0x7f2c440c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c43e00640 1 -- 172.21.15.114:0/3540340734 >> v1:172.21.15.114:6789/0 conn(0x7f2c440c1eb0 legacy=0x7f2c44155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c43400640 1 -- 172.21.15.114:0/3540340734 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905211888 0 0) 0x7f2c440a9420 con 0x7f2c440c1eb0 2024-02-17T12:19:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c43e00640 1 -- 172.21.15.114:0/3540340734 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c44152850 con 0x7f2c440c2580 2024-02-17T12:19:33.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.628+0000 7f2c48a00640 1 --2- 172.21.15.114:0/3540340734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c4414f110 0x7f2c440c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c43e00640 1 --2- 172.21.15.114:0/3540340734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c440c2580 0x7f2c440aa150 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2c300097c0 tx=0x7f2c3001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20437811da1d214 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c43400640 1 -- 172.21.15.114:0/3540340734 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300ac640 con 0x7f2c440c2580 2024-02-17T12:19:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c43400640 1 -- 172.21.15.114:0/3540340734 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c300ac7a0 con 0x7f2c440c2580 2024-02-17T12:19:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c43400640 1 -- 172.21.15.114:0/3540340734 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300acb30 con 0x7f2c440c2580 2024-02-17T12:19:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 -- 172.21.15.114:0/3540340734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c440c2580 msgr2=0x7f2c440aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 --2- 172.21.15.114:0/3540340734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c440c2580 0x7f2c440aa150 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2c300097c0 tx=0x7f2c3001c3e0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 -- 172.21.15.114:0/3540340734 shutdown_connections 2024-02-17T12:19:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 --2- 172.21.15.114:0/3540340734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c440c2580 0x7f2c440aa150 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 --2- 172.21.15.114:0/3540340734 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c4414f110 0x7f2c440c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 -- 172.21.15.114:0/3540340734 >> 172.21.15.114:0/3540340734 conn(0x7f2c440a8490 msgr2=0x7f2c440a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 -- 172.21.15.114:0/3540340734 shutdown_connections 2024-02-17T12:19:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 -- 172.21.15.114:0/3540340734 wait complete. 2024-02-17T12:19:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 Processor -- start 2024-02-17T12:19:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 -- start start 2024-02-17T12:19:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c440c1eb0 0x7f2c441f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c440c2580 0x7f2c440bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4414f110 0x7f2c440c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44154f90 con 0x7f2c4414f110 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c441f11a0 con 0x7f2c440c2580 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.632+0000 7f2c4b400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44151480 con 0x7f2c440c1eb0 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c49400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4414f110 0x7f2c440c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c49400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4414f110 0x7f2c440c3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35618/0 (socket says 172.21.15.114:35618) 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c49400640 1 -- 172.21.15.114:0/3709680219 learned_addr learned my addr 172.21.15.114:0/3709680219 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c48a00640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c440c1eb0 0x7f2c441f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c43e00640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c440c2580 0x7f2c440bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c49400640 1 -- 172.21.15.114:0/3709680219 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c440c1eb0 msgr2=0x7f2c441f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c49400640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c440c1eb0 0x7f2c441f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c49400640 1 -- 172.21.15.114:0/3709680219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c440c2580 msgr2=0x7f2c440bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c49400640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c440c2580 0x7f2c440bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c49400640 1 -- 172.21.15.114:0/3709680219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c30009420 con 0x7f2c4414f110 2024-02-17T12:19:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c49400640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4414f110 0x7f2c440c3f60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00c780 tx=0x7f2c3c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c40c00640 1 -- 172.21.15.114:0/3709680219 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c00ce90 con 0x7f2c4414f110 2024-02-17T12:19:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c40c00640 1 -- 172.21.15.114:0/3709680219 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c00a640 con 0x7f2c4414f110 2024-02-17T12:19:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c40c00640 1 -- 172.21.15.114:0/3709680219 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c00aa70 con 0x7f2c4414f110 2024-02-17T12:19:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c4b400640 1 -- 172.21.15.114:0/3709680219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c44151720 con 0x7f2c4414f110 2024-02-17T12:19:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c4b400640 1 -- 172.21.15.114:0/3709680219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c441f0e30 con 0x7f2c4414f110 2024-02-17T12:19:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c4b400640 1 -- 172.21.15.114:0/3709680219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c44074840 con 0x7f2c4414f110 2024-02-17T12:19:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c40c00640 1 -- 172.21.15.114:0/3709680219 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2c3c00abd0 con 0x7f2c4414f110 2024-02-17T12:19:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.636+0000 7f2c40c00640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2c24066e70 0x7f2c24069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.640+0000 7f2c40c00640 1 -- 172.21.15.114:0/3709680219 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2c3c084160 con 0x7f2c4414f110 2024-02-17T12:19:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.640+0000 7f2c48a00640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2c24066e70 0x7f2c24069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.640+0000 7f2c48a00640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2c24066e70 0x7f2c24069330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2c34006fd0 tx=0x7f2c34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.640+0000 7f2c40c00640 1 -- 172.21.15.114:0/3709680219 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2c3c050d10 con 0x7f2c4414f110 2024-02-17T12:19:33.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 -- 172.21.15.114:0/3709680219 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f2c441f12e0 con 0x7f2c4414f110 2024-02-17T12:19:33.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c40c00640 1 -- 172.21.15.114:0/3709680219 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f2c3c0543d0 con 0x7f2c4414f110 2024-02-17T12:19:33.799 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:33.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 -- 172.21.15.114:0/3709680219 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2c24066e70 msgr2=0x7f2c24069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2c24066e70 0x7f2c24069330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2c34006fd0 tx=0x7f2c34008040 comp rx=0 tx=0).stop 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 -- 172.21.15.114:0/3709680219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4414f110 msgr2=0x7f2c440c3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4414f110 0x7f2c440c3f60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00c780 tx=0x7f2c3c00cc40 comp rx=0 tx=0).stop 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 -- 172.21.15.114:0/3709680219 shutdown_connections 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2c24066e70 0x7f2c24069330 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c4414f110 0x7f2c440c3f60 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c440c2580 0x7f2c440bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 --2- 172.21.15.114:0/3709680219 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c440c1eb0 0x7f2c441f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 -- 172.21.15.114:0/3709680219 >> 172.21.15.114:0/3709680219 conn(0x7f2c440a8490 msgr2=0x7f2c4406e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 -- 172.21.15.114:0/3709680219 shutdown_connections 2024-02-17T12:19:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.796+0000 7f2c4b400640 1 -- 172.21.15.114:0/3709680219 wait complete. 2024-02-17T12:19:33.820 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:19:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff690600640 1 Processor -- start 2024-02-17T12:19:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff690600640 1 -- start start 2024-02-17T12:19:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff690600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff6880c2580 0x7ff6880aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff690600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6880c1eb0 0x7ff68815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff690600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6880a9420 con 0x7ff68814f110 2024-02-17T12:19:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff690600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68814f4f0 con 0x7ff6880c2580 2024-02-17T12:19:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff690600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6880aae80 con 0x7ff6880c1eb0 2024-02-17T12:19:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff68d200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff6880c2580 0x7ff6880aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff68dc00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff68814f110 0x7ff6880c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:35760/0 (socket says 172.21.15.114:35760) 2024-02-17T12:19:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff68dc00640 1 -- 172.21.15.114:0/612896928 learned_addr learned my addr 172.21.15.114:0/612896928 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff68e600640 1 --2- 172.21.15.114:0/612896928 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6880c1eb0 0x7ff68815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff68d200640 1 -- 172.21.15.114:0/612896928 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6880c1eb0 msgr2=0x7ff68815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff68d200640 1 --2- 172.21.15.114:0/612896928 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6880c1eb0 0x7ff68815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff68d200640 1 -- 172.21.15.114:0/612896928 >> v1:172.21.15.116:6789/0 conn(0x7ff68814f110 legacy=0x7ff6880c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.952+0000 7ff68d200640 1 -- 172.21.15.114:0/612896928 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688152850 con 0x7ff6880c2580 2024-02-17T12:19:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff68d200640 1 --2- 172.21.15.114:0/612896928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6880c2580 0x7ff6880aa150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6740097c0 tx=0x7ff67401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d3df36dc77b1e73 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:33.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff687e00640 1 -- 172.21.15.114:0/612896928 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6740ac640 con 0x7ff6880c2580 2024-02-17T12:19:33.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff687e00640 1 -- 172.21.15.114:0/612896928 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6740ac7a0 con 0x7ff6880c2580 2024-02-17T12:19:33.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff687e00640 1 -- 172.21.15.114:0/612896928 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6740acb30 con 0x7ff6880c2580 2024-02-17T12:19:33.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff690600640 1 -- 172.21.15.114:0/612896928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6880c2580 msgr2=0x7ff6880aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff690600640 1 --2- 172.21.15.114:0/612896928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6880c2580 0x7ff6880aa150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6740097c0 tx=0x7ff67401c3e0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff690600640 1 -- 172.21.15.114:0/612896928 shutdown_connections 2024-02-17T12:19:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff690600640 1 --2- 172.21.15.114:0/612896928 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6880c1eb0 0x7ff68815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff690600640 1 --2- 172.21.15.114:0/612896928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6880c2580 0x7ff6880aa150 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff690600640 1 -- 172.21.15.114:0/612896928 >> 172.21.15.114:0/612896928 conn(0x7ff6880a8490 msgr2=0x7ff6880a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff690600640 1 -- 172.21.15.114:0/612896928 shutdown_connections 2024-02-17T12:19:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.956+0000 7ff690600640 1 -- 172.21.15.114:0/612896928 wait complete. 2024-02-17T12:19:33.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 Processor -- start 2024-02-17T12:19:33.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 -- start start 2024-02-17T12:19:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6880c1eb0 0x7ff6881f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6880c2580 0x7ff6880bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68814f110 0x7ff68813be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6881454b0 con 0x7ff68814f110 2024-02-17T12:19:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff688145790 con 0x7ff6880c1eb0 2024-02-17T12:19:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6881f1040 con 0x7ff6880c2580 2024-02-17T12:19:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68814f110 0x7ff68813be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68814f110 0x7ff68813be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35630/0 (socket says 172.21.15.114:35630) 2024-02-17T12:19:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68e600640 1 -- 172.21.15.114:0/520926787 learned_addr learned my addr 172.21.15.114:0/520926787 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68dc00640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6880c1eb0 0x7ff6881f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68d200640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6880c2580 0x7ff6880bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68e600640 1 -- 172.21.15.114:0/520926787 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6880c2580 msgr2=0x7ff6880bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68e600640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6880c2580 0x7ff6880bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68e600640 1 -- 172.21.15.114:0/520926787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6880c1eb0 msgr2=0x7ff6881f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68e600640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6880c1eb0 0x7ff6881f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68e600640 1 -- 172.21.15.114:0/520926787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff674009420 con 0x7ff68814f110 2024-02-17T12:19:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff68e600640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68814f110 0x7ff68813be30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff68000efc0 tx=0x7ff68000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:33.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff685600640 1 -- 172.21.15.114:0/520926787 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680009b20 con 0x7ff68814f110 2024-02-17T12:19:33.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff685600640 1 -- 172.21.15.114:0/520926787 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68000f040 con 0x7ff68814f110 2024-02-17T12:19:33.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 -- 172.21.15.114:0/520926787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6881f1320 con 0x7ff68814f110 2024-02-17T12:19:33.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff685600640 1 -- 172.21.15.114:0/520926787 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6800146c0 con 0x7ff68814f110 2024-02-17T12:19:33.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 -- 172.21.15.114:0/520926787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68813aba0 con 0x7ff68814f110 2024-02-17T12:19:33.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.960+0000 7ff690600640 1 -- 172.21.15.114:0/520926787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6881f1840 con 0x7ff68814f110 2024-02-17T12:19:33.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.964+0000 7ff685600640 1 -- 172.21.15.114:0/520926787 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff680014820 con 0x7ff68814f110 2024-02-17T12:19:33.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.964+0000 7ff685600640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff668066e40 0x7ff668069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:33.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.964+0000 7ff685600640 1 -- 172.21.15.114:0/520926787 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff680085a30 con 0x7ff68814f110 2024-02-17T12:19:33.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.964+0000 7ff68dc00640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff668066e40 0x7ff668069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.964+0000 7ff68dc00640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff668066e40 0x7ff668069300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff67c000f70 tx=0x7ff67c007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:33.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:33.968+0000 7ff685600640 1 -- 172.21.15.114:0/520926787 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff6881f1840 con 0x7ff68814f110 2024-02-17T12:19:34.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 -- 172.21.15.114:0/520926787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff6881f1840 con 0x7ff68814f110 2024-02-17T12:19:34.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff685600640 1 -- 172.21.15.114:0/520926787 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff6881f1840 con 0x7ff68814f110 2024-02-17T12:19:34.143 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 -- 172.21.15.114:0/520926787 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff668066e40 msgr2=0x7ff668069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff668066e40 0x7ff668069300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff67c000f70 tx=0x7ff67c007e90 comp rx=0 tx=0).stop 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 -- 172.21.15.114:0/520926787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68814f110 msgr2=0x7ff68813be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68814f110 0x7ff68813be30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff68000efc0 tx=0x7ff68000c490 comp rx=0 tx=0).stop 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 -- 172.21.15.114:0/520926787 shutdown_connections 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff668066e40 0x7ff668069300 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff68814f110 0x7ff68813be30 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6880c2580 0x7ff6880bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 --2- 172.21.15.114:0/520926787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6880c1eb0 0x7ff6881f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 -- 172.21.15.114:0/520926787 >> 172.21.15.114:0/520926787 conn(0x7ff6880a8490 msgr2=0x7ff688151c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 -- 172.21.15.114:0/520926787 shutdown_connections 2024-02-17T12:19:34.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.140+0000 7ff690600640 1 -- 172.21.15.114:0/520926787 wait complete. 2024-02-17T12:19:34.164 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-17T12:19:34.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:34.164 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:34.193 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:19:34.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:34.193 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-17T12:19:34.247 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:34.248 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:34.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3897 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-02-17T12:19:34.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:19:34.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.432+0000 7f29a4600640 1 Processor -- start 2024-02-17T12:19:34.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.432+0000 7f29a4600640 1 -- start start 2024-02-17T12:19:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.432+0000 7f29a4600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c0c25a0 0x7f299c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.432+0000 7f29a4600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f299c06db50 0x7f299c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.432+0000 7f29a4600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c156270 con 0x7f299c150490 2024-02-17T12:19:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.432+0000 7f29a4600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c071630 con 0x7f299c06db50 2024-02-17T12:19:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.432+0000 7f29a4600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c156550 con 0x7f299c0c25a0 2024-02-17T12:19:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f29a1200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f299c06db50 0x7f299c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f29a2600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f299c150490 0x7f299c152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56188/0 (socket says 172.21.15.114:56188) 2024-02-17T12:19:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f29a1200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f299c06db50 0x7f299c14ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35632/0 (socket says 172.21.15.114:35632) 2024-02-17T12:19:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f29a2600640 1 -- 172.21.15.114:0/3234151110 learned_addr learned my addr 172.21.15.114:0/3234151110 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f29a1c00640 1 --2- 172.21.15.114:0/3234151110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c0c25a0 0x7f299c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:34.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f29a1200640 1 -- 172.21.15.114:0/3234151110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c0c25a0 msgr2=0x7f299c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:34.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f29a1200640 1 --2- 172.21.15.114:0/3234151110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c0c25a0 0x7f299c06e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f29a1200640 1 -- 172.21.15.114:0/3234151110 >> v1:172.21.15.114:6789/0 conn(0x7f299c150490 legacy=0x7f299c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:34.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f29a1200640 1 -- 172.21.15.114:0/3234151110 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c156830 con 0x7f299c06db50 2024-02-17T12:19:34.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f29a1200640 1 --2- 172.21.15.114:0/3234151110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c06db50 0x7f299c14ff50 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f29880097c0 tx=0x7f298801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a985a9f666a9002 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:34.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f299be00640 1 -- 172.21.15.114:0/3234151110 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880ab600 con 0x7f299c06db50 2024-02-17T12:19:34.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f299be00640 1 -- 172.21.15.114:0/3234151110 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29880a7050 con 0x7f299c06db50 2024-02-17T12:19:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.436+0000 7f299be00640 1 -- 172.21.15.114:0/3234151110 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880ab980 con 0x7f299c06db50 2024-02-17T12:19:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 -- 172.21.15.114:0/3234151110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c06db50 msgr2=0x7f299c14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 --2- 172.21.15.114:0/3234151110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c06db50 0x7f299c14ff50 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f29880097c0 tx=0x7f298801c350 comp rx=0 tx=0).stop 2024-02-17T12:19:34.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 -- 172.21.15.114:0/3234151110 shutdown_connections 2024-02-17T12:19:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 --2- 172.21.15.114:0/3234151110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c06db50 0x7f299c14ff50 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 --2- 172.21.15.114:0/3234151110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c0c25a0 0x7f299c06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 -- 172.21.15.114:0/3234151110 >> 172.21.15.114:0/3234151110 conn(0x7f299c0a8490 msgr2=0x7f299c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 -- 172.21.15.114:0/3234151110 shutdown_connections 2024-02-17T12:19:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 -- 172.21.15.114:0/3234151110 wait complete. 2024-02-17T12:19:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 Processor -- start 2024-02-17T12:19:34.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 -- start start 2024-02-17T12:19:34.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c06db50 0x7f299c13ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:34.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c0c25a0 0x7f299c1f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:34.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f299c150490 0x7f299c13c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:34.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c13c660 con 0x7f299c0c25a0 2024-02-17T12:19:34.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c141c80 con 0x7f299c150490 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c13f270 con 0x7f299c06db50 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c0c25a0 0x7f299c1f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c0c25a0 0x7f299c1f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35646/0 (socket says 172.21.15.114:35646) 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1200640 1 -- 172.21.15.114:0/2646039990 learned_addr learned my addr 172.21.15.114:0/2646039990 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1200640 1 -- 172.21.15.114:0/2646039990 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c06db50 msgr2=0x7f299c13ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1c00640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c06db50 0x7f299c13ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a2600640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f299c150490 0x7f299c13c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1200640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c06db50 0x7f299c13ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1200640 1 -- 172.21.15.114:0/2646039990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f299c150490 msgr2=0x7f299c13c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1200640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f299c150490 0x7f299c13c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1200640 1 -- 172.21.15.114:0/2646039990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988009420 con 0x7f299c0c25a0 2024-02-17T12:19:34.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1c00640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c06db50 0x7f299c13ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:34.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a2600640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f299c150490 0x7f299c13c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:34.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a1200640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c0c25a0 0x7f299c1f10a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f29880ae040 tx=0x7f29880190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:34.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f2999600640 1 -- 172.21.15.114:0/2646039990 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880b4840 con 0x7f299c0c25a0 2024-02-17T12:19:34.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f2999600640 1 -- 172.21.15.114:0/2646039990 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29880b49c0 con 0x7f299c0c25a0 2024-02-17T12:19:34.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f29a4600640 1 -- 172.21.15.114:0/2646039990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c13f550 con 0x7f299c0c25a0 2024-02-17T12:19:34.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.440+0000 7f2999600640 1 -- 172.21.15.114:0/2646039990 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880b4d70 con 0x7f299c0c25a0 2024-02-17T12:19:34.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.444+0000 7f29a4600640 1 -- 172.21.15.114:0/2646039990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c1f0b80 con 0x7f299c0c25a0 2024-02-17T12:19:34.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.444+0000 7f29a4600640 1 -- 172.21.15.114:0/2646039990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c074840 con 0x7f299c0c25a0 2024-02-17T12:19:34.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.444+0000 7f2999600640 1 -- 172.21.15.114:0/2646039990 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f29880b2040 con 0x7f299c0c25a0 2024-02-17T12:19:34.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.444+0000 7f2999600640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f297c066e70 0x7f297c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:34.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.444+0000 7f2999600640 1 -- 172.21.15.114:0/2646039990 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f298811eff0 con 0x7f299c0c25a0 2024-02-17T12:19:34.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.444+0000 7f29a1c00640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f297c066e70 0x7f297c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:34.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.444+0000 7f29a1c00640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f297c066e70 0x7f297c069330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2990009840 tx=0x7f2990008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:34.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.448+0000 7f2999600640 1 -- 172.21.15.114:0/2646039990 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f29880eba70 con 0x7f299c0c25a0 2024-02-17T12:19:34.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 -- 172.21.15.114:0/2646039990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f299c141ee0 con 0x7f299c0c25a0 2024-02-17T12:19:34.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f2999600640 1 -- 172.21.15.114:0/2646039990 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7f29880b0070 con 0x7f299c0c25a0 2024-02-17T12:19:34.640 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:19:34.640 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-02-17T12:19:34.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 -- 172.21.15.114:0/2646039990 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f297c066e70 msgr2=0x7f297c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:34.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f297c066e70 0x7f297c069330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2990009840 tx=0x7f2990008040 comp rx=0 tx=0).stop 2024-02-17T12:19:34.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 -- 172.21.15.114:0/2646039990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c0c25a0 msgr2=0x7f299c1f10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:34.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c0c25a0 0x7f299c1f10a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f29880ae040 tx=0x7f29880190f0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 -- 172.21.15.114:0/2646039990 shutdown_connections 2024-02-17T12:19:34.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f299c150490 0x7f299c13c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f297c066e70 0x7f297c069330 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f299c0c25a0 0x7f299c1f10a0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 --2- 172.21.15.114:0/2646039990 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299c06db50 0x7f299c13ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:34.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 -- 172.21.15.114:0/2646039990 >> 172.21.15.114:0/2646039990 conn(0x7f299c0a8490 msgr2=0x7f299c072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:34.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 -- 172.21.15.114:0/2646039990 shutdown_connections 2024-02-17T12:19:34.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:34.636+0000 7f29a4600640 1 -- 172.21.15.114:0/2646039990 wait complete. 2024-02-17T12:19:34.660 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-02-17T12:19:34.660 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:19:34.660 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-17T12:19:34.660 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-17T12:19:34.661 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:34.661 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-02-17T12:19:34.661 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:19:34.661 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-17T12:19:34.661 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:19:34.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:34.661 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:34.671 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42141sec preferred_lft 42141sec 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 02:42:58:59:74:79 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:34.672 INFO:teuthology.orchestra.run.smithi116.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:19:34.673 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:34.673 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:19:34.673 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:34.673 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:19:34.673 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:34.673 INFO:teuthology.orchestra.run.smithi116.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:19:34.673 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T12:19:34.673 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:19:34.673 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:34.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:34.674 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:19:34.737 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-17T12:19:34.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:34.740 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-17T12:19:34.793 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-17T12:19:34.793 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:19:34.793 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:19:34.793 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:19:34.794 INFO:teuthology.orchestra.run.smithi116.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:19:34.794 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:19:34.794 INFO:teuthology.orchestra.run.smithi116.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:34.794 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:34.794 INFO:teuthology.orchestra.run.smithi116.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:34.794 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:19:34.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:34.794 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:19:34.795 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:19:34.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:19:34.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:19:34.795 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:19:34.795 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:19:34.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:34.890 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-17T12:19:34.900 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-17T12:19:34.900 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:19:34.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:34.900 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-02-17T12:19:34.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:19:34.961 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:35.013 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:19:35.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:19:35.014 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:35.065 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:19:35.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:35.065 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:19:35.155 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:19:35.155 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-02-17T12:19:35.155 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:19:35.170 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:19:35.170 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-02-17T12:19:35.170 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:19:35.171 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:19:35.171 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:19:35.180 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2024-02-17T12:19:35.180 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2024-02-17T12:19:35.180 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:19:35.180 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:19:35.180 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:19:35.180 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:19:35.180 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:19:35.180 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:19:35.184 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:19:35.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:35.185 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:35.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:35.206 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:19:35.269 INFO:teuthology.orchestra.run.smithi116.stdout:client5921 2024-02-17T12:19:35.269 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:35.269 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:35.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:35.319 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2024-02-17T12:19:35.335 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:35.336 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2024-02-17T12:19:35.391 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:35.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:35.391 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2024-02-17T12:19:35.407 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:35.408 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2024-02-17T12:19:35.467 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:35.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2024-02-17T12:19:35.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.604+0000 7fe8ff800640 1 Processor -- start 2024-02-17T12:19:35.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.604+0000 7fe8ff800640 1 -- start start 2024-02-17T12:19:35.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8ff800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f80c58b0 0x7fe8f81583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8ff800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8f80c4b30 0x7fe8f806bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8ff800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f8155090 con 0x7fe8f806c160 2024-02-17T12:19:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8ff800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f80c6110 con 0x7fe8f80c4b30 2024-02-17T12:19:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8ff800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8159300 con 0x7fe8f80c58b0 2024-02-17T12:19:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8f7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8f80c4b30 0x7fe8f806bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8fd800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe8f806c160 0x7fe8f8155520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34022/0 (socket says 172.21.15.114:34022) 2024-02-17T12:19:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8fd800640 1 -- 172.21.15.114:0/3352637030 learned_addr learned my addr 172.21.15.114:0/3352637030 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:35.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8fce00640 1 --2- 172.21.15.114:0/3352637030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f80c58b0 0x7fe8f81583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:35.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8f7e00640 1 -- 172.21.15.114:0/3352637030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f80c58b0 msgr2=0x7fe8f81583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:35.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8f7e00640 1 --2- 172.21.15.114:0/3352637030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f80c58b0 0x7fe8f81583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:35.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8f7e00640 1 -- 172.21.15.114:0/3352637030 >> v1:172.21.15.114:6789/0 conn(0x7fe8f806c160 legacy=0x7fe8f8155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:35.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8f7e00640 1 -- 172.21.15.114:0/3352637030 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f8158a60 con 0x7fe8f80c4b30 2024-02-17T12:19:35.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8f7400640 1 -- 172.21.15.114:0/3352637030 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927353087 0 0) 0x7fe8f8155090 con 0x7fe8f806c160 2024-02-17T12:19:35.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.608+0000 7fe8fce00640 1 --2- 172.21.15.114:0/3352637030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f80c58b0 0x7fe8f81583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8f7e00640 1 --2- 172.21.15.114:0/3352637030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 0x7fe8f806bc20 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40097c0 tx=0x7fe8e401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef40c2fd4c97ddf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8f7400640 1 -- 172.21.15.114:0/3352637030 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e40ab670 con 0x7fe8f80c4b30 2024-02-17T12:19:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8f7400640 1 -- 172.21.15.114:0/3352637030 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e40ab7d0 con 0x7fe8f80c4b30 2024-02-17T12:19:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8f7400640 1 -- 172.21.15.114:0/3352637030 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e40abb60 con 0x7fe8f80c4b30 2024-02-17T12:19:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 -- 172.21.15.114:0/3352637030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 msgr2=0x7fe8f806bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 --2- 172.21.15.114:0/3352637030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 0x7fe8f806bc20 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40097c0 tx=0x7fe8e401c470 comp rx=0 tx=0).stop 2024-02-17T12:19:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 -- 172.21.15.114:0/3352637030 shutdown_connections 2024-02-17T12:19:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 --2- 172.21.15.114:0/3352637030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 0x7fe8f806bc20 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:35.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 --2- 172.21.15.114:0/3352637030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f80c58b0 0x7fe8f81583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:35.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 -- 172.21.15.114:0/3352637030 >> 172.21.15.114:0/3352637030 conn(0x7fe8f80c3730 msgr2=0x7fe8f80c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:35.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 -- 172.21.15.114:0/3352637030 shutdown_connections 2024-02-17T12:19:35.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 -- 172.21.15.114:0/3352637030 wait complete. 2024-02-17T12:19:35.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 Processor -- start 2024-02-17T12:19:35.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 -- start start 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f806c160 0x7fe8f81ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 0x7fe8f806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f80c58b0 0x7fe8f80a7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8157850 con 0x7fe8f80c4b30 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80c35e0 con 0x7fe8f80c58b0 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8ff800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80c3020 con 0x7fe8f806c160 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 0x7fe8f806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8fce00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f806c160 0x7fe8f81ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 0x7fe8f806ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60792/0 (socket says 172.21.15.114:60792) 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.612+0000 7fe8f7e00640 1 -- 172.21.15.114:0/2666510604 learned_addr learned my addr 172.21.15.114:0/2666510604 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8fd800640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f80c58b0 0x7fe8f80a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8f7e00640 1 -- 172.21.15.114:0/2666510604 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f806c160 msgr2=0x7fe8f81ed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8f7e00640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f806c160 0x7fe8f81ed0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8f7e00640 1 -- 172.21.15.114:0/2666510604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f80c58b0 msgr2=0x7fe8f80a7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8f7e00640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f80c58b0 0x7fe8f80a7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8f7e00640 1 -- 172.21.15.114:0/2666510604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e4009420 con 0x7fe8f80c4b30 2024-02-17T12:19:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8fd800640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f80c58b0 0x7fe8f80a7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8f7e00640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 0x7fe8f806ec50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe8e401ab20 tx=0x7fe8e401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8f4c00640 1 -- 172.21.15.114:0/2666510604 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4004230 con 0x7fe8f80c4b30 2024-02-17T12:19:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8f4c00640 1 -- 172.21.15.114:0/2666510604 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e40b9070 con 0x7fe8f80c4b30 2024-02-17T12:19:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8ff800640 1 -- 172.21.15.114:0/2666510604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f80c3300 con 0x7fe8f80c4b30 2024-02-17T12:19:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8f4c00640 1 -- 172.21.15.114:0/2666510604 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e40ab630 con 0x7fe8f80c4b30 2024-02-17T12:19:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8ff800640 1 -- 172.21.15.114:0/2666510604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f8154a50 con 0x7fe8f80c4b30 2024-02-17T12:19:35.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8ff800640 1 -- 172.21.15.114:0/2666510604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f8067170 con 0x7fe8f80c4b30 2024-02-17T12:19:35.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.616+0000 7fe8f4c00640 1 -- 172.21.15.114:0/2666510604 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fe8e4003620 con 0x7fe8f80c4b30 2024-02-17T12:19:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.620+0000 7fe8f4c00640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe8d8066e40 0x7fe8d8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.620+0000 7fe8f4c00640 1 -- 172.21.15.114:0/2666510604 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe8e40bb070 con 0x7fe8f80c4b30 2024-02-17T12:19:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.620+0000 7fe8fce00640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe8d8066e40 0x7fe8d8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.620+0000 7fe8fce00640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe8d8066e40 0x7fe8d8069300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8006fd0 tx=0x7fe8e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:35.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.624+0000 7fe8f4c00640 1 -- 172.21.15.114:0/2666510604 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe8e40ec5b0 con 0x7fe8f80c4b30 2024-02-17T12:19:35.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.836+0000 7fe8ff800640 1 -- 172.21.15.114:0/2666510604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7fe8f81f0660 con 0x7fe8f80c4b30 2024-02-17T12:19:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.836+0000 7fe8f4c00640 1 -- 172.21.15.114:0/2666510604 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v19) v1 ==== 272+0+0 (secure 0 0 0) 0x7fe8f81f0660 con 0x7fe8f80c4b30 2024-02-17T12:19:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:added key for client.testuser 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 -- 172.21.15.114:0/2666510604 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe8d8066e40 msgr2=0x7fe8d8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe8d8066e40 0x7fe8d8069300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8006fd0 tx=0x7fe8e8008040 comp rx=0 tx=0).stop 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 -- 172.21.15.114:0/2666510604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 msgr2=0x7fe8f806ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 0x7fe8f806ec50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fe8e401ab20 tx=0x7fe8e401acb0 comp rx=0 tx=0).stop 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 -- 172.21.15.114:0/2666510604 shutdown_connections 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8f80c58b0 0x7fe8f80a7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fe8d8066e40 0x7fe8d8069300 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80c4b30 0x7fe8f806ec50 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 --2- 172.21.15.114:0/2666510604 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f806c160 0x7fe8f81ed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 -- 172.21.15.114:0/2666510604 >> 172.21.15.114:0/2666510604 conn(0x7fe8f80c3730 msgr2=0x7fe8f80c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:35.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 -- 172.21.15.114:0/2666510604 shutdown_connections 2024-02-17T12:19:35.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.840+0000 7fe8ff800640 1 -- 172.21.15.114:0/2666510604 wait complete. 2024-02-17T12:19:35.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2024-02-17T12:19:35.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.992+0000 7f04c2600640 1 Processor -- start 2024-02-17T12:19:35.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.992+0000 7f04c2600640 1 -- start start 2024-02-17T12:19:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04c2600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc14f110 0x7f04bc0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04c2600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f04bc0c2580 0x7f04bc0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04c2600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc0a9420 con 0x7f04bc0c1eb0 2024-02-17T12:19:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04c2600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04bc14f4f0 con 0x7f04bc0c2580 2024-02-17T12:19:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04c2600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0aae80 con 0x7f04bc14f110 2024-02-17T12:19:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04bbe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f04bc0c1eb0 0x7f04bc155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34028/0 (socket says 172.21.15.114:34028) 2024-02-17T12:19:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04bbe00640 1 -- 172.21.15.114:0/2089124949 learned_addr learned my addr 172.21.15.114:0/2089124949 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:36.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04bb400640 1 --2- 172.21.15.114:0/2089124949 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc14f110 0x7f04bc0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04b2a00640 1 --2- 172.21.15.114:0/2089124949 >> v2:172.21.15.116:3300/0 conn(0x7f04bc0c2580 0x7f04bc0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04baa00640 1 -- 172.21.15.114:0/2089124949 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864748779 0 0) 0x7f04bc0a9420 con 0x7f04bc0c1eb0 2024-02-17T12:19:36.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04baa00640 1 -- 172.21.15.114:0/2089124949 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04a0003530 con 0x7f04bc0c1eb0 2024-02-17T12:19:36.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04bb400640 1 -- 172.21.15.114:0/2089124949 >> v2:172.21.15.116:3300/0 conn(0x7f04bc0c2580 msgr2=0x7f04bc0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:36.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04bb400640 1 --2- 172.21.15.114:0/2089124949 >> v2:172.21.15.116:3300/0 conn(0x7f04bc0c2580 0x7f04bc0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04bb400640 1 -- 172.21.15.114:0/2089124949 >> v1:172.21.15.114:6789/0 conn(0x7f04bc0c1eb0 legacy=0x7f04bc155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:35.996+0000 7f04bb400640 1 -- 172.21.15.114:0/2089124949 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc152850 con 0x7f04bc14f110 2024-02-17T12:19:36.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04bb400640 1 --2- 172.21.15.114:0/2089124949 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc14f110 0x7f04bc0c65a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0097c0 tx=0x7f04ac01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de1627d688cdfd72 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:36.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04baa00640 1 -- 172.21.15.114:0/2089124949 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0ac640 con 0x7f04bc14f110 2024-02-17T12:19:36.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04baa00640 1 -- 172.21.15.114:0/2089124949 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac0ac7a0 con 0x7f04bc14f110 2024-02-17T12:19:36.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04baa00640 1 -- 172.21.15.114:0/2089124949 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0acb30 con 0x7f04bc14f110 2024-02-17T12:19:36.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04c2600640 1 -- 172.21.15.114:0/2089124949 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc14f110 msgr2=0x7f04bc0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04c2600640 1 --2- 172.21.15.114:0/2089124949 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc14f110 0x7f04bc0c65a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0097c0 tx=0x7f04ac01c3e0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04c2600640 1 -- 172.21.15.114:0/2089124949 shutdown_connections 2024-02-17T12:19:36.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04c2600640 1 --2- 172.21.15.114:0/2089124949 >> v2:172.21.15.116:3300/0 conn(0x7f04bc0c2580 0x7f04bc0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04c2600640 1 --2- 172.21.15.114:0/2089124949 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc14f110 0x7f04bc0c65a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04c2600640 1 -- 172.21.15.114:0/2089124949 >> 172.21.15.114:0/2089124949 conn(0x7f04bc0a8490 msgr2=0x7f04bc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:36.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04c2600640 1 -- 172.21.15.114:0/2089124949 shutdown_connections 2024-02-17T12:19:36.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04c2600640 1 -- 172.21.15.114:0/2089124949 wait complete. 2024-02-17T12:19:36.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04c2600640 1 Processor -- start 2024-02-17T12:19:36.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.000+0000 7f04c2600640 1 -- start start 2024-02-17T12:19:36.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04c2600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc0c1eb0 0x7f04bc13fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04c2600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04bc0c2580 0x7f04bc153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04c2600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04bc14f110 0x7f04bc15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04c2600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc140390 con 0x7f04bc14f110 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04c2600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc1ed4d0 con 0x7f04bc0c2580 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04c2600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc1455e0 con 0x7f04bc0c1eb0 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04bbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04bc14f110 0x7f04bc15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04bbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04bc14f110 0x7f04bc15c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60802/0 (socket says 172.21.15.114:60802) 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04bbe00640 1 -- 172.21.15.114:0/1419906371 learned_addr learned my addr 172.21.15.114:0/1419906371 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04b2a00640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04bc0c2580 0x7f04bc153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04bb400640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc0c1eb0 0x7f04bc13fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04bbe00640 1 -- 172.21.15.114:0/1419906371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc0c1eb0 msgr2=0x7f04bc13fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04bbe00640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc0c1eb0 0x7f04bc13fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04bbe00640 1 -- 172.21.15.114:0/1419906371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04bc0c2580 msgr2=0x7f04bc153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04bbe00640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04bc0c2580 0x7f04bc153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04bbe00640 1 -- 172.21.15.114:0/1419906371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac009420 con 0x7f04bc14f110 2024-02-17T12:19:36.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04bbe00640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04bc14f110 0x7f04bc15c830 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f04b400cbb0 tx=0x7f04b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:36.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04b3e00640 1 -- 172.21.15.114:0/1419906371 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400ad40 con 0x7f04bc14f110 2024-02-17T12:19:36.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04b3e00640 1 -- 172.21.15.114:0/1419906371 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4012400 con 0x7f04bc14f110 2024-02-17T12:19:36.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04b3e00640 1 -- 172.21.15.114:0/1419906371 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400aea0 con 0x7f04bc14f110 2024-02-17T12:19:36.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04c2600640 1 -- 172.21.15.114:0/1419906371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc13e880 con 0x7f04bc14f110 2024-02-17T12:19:36.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04c2600640 1 -- 172.21.15.114:0/1419906371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc13ee40 con 0x7f04bc14f110 2024-02-17T12:19:36.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04c2600640 1 -- 172.21.15.114:0/1419906371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc13f060 con 0x7f04bc14f110 2024-02-17T12:19:36.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.004+0000 7f04b3e00640 1 -- 172.21.15.114:0/1419906371 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f04b4007070 con 0x7f04bc14f110 2024-02-17T12:19:36.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.008+0000 7f04b3e00640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0498066e40 0x7f0498069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.008+0000 7f04b3e00640 1 -- 172.21.15.114:0/1419906371 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f04b4084d20 con 0x7f04bc14f110 2024-02-17T12:19:36.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.008+0000 7f04bb400640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0498066e40 0x7f0498069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.008+0000 7f04bb400640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0498066e40 0x7f0498069300 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0ae000 tx=0x7f04ac0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:36.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.008+0000 7f04b3e00640 1 -- 172.21.15.114:0/1419906371 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f04b40517c0 con 0x7f04bc14f110 2024-02-17T12:19:36.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 -- 172.21.15.114:0/1419906371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f04bc074840 con 0x7f04bc14f110 2024-02-17T12:19:36.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04b3e00640 1 -- 172.21.15.114:0/1419906371 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v19) v1 ==== 85+0+226 (secure 0 0 0) 0x7f04b4017020 con 0x7f04bc14f110 2024-02-17T12:19:36.219 INFO:teuthology.orchestra.run.smithi114.stdout:[client.testuser] 2024-02-17T12:19:36.219 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg== 2024-02-17T12:19:36.219 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2024-02-17T12:19:36.220 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-02-17T12:19:36.220 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-02-17T12:19:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 -- 172.21.15.114:0/1419906371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0498066e40 msgr2=0x7f0498069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0498066e40 0x7f0498069300 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0ae000 tx=0x7f04ac0a7000 comp rx=0 tx=0).stop 2024-02-17T12:19:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 -- 172.21.15.114:0/1419906371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04bc14f110 msgr2=0x7f04bc15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04bc14f110 0x7f04bc15c830 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f04b400cbb0 tx=0x7f04b400a430 comp rx=0 tx=0).stop 2024-02-17T12:19:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 -- 172.21.15.114:0/1419906371 shutdown_connections 2024-02-17T12:19:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0498066e40 0x7f0498069300 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04bc14f110 0x7f04bc15c830 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04bc0c2580 0x7f04bc153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 --2- 172.21.15.114:0/1419906371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f04bc0c1eb0 0x7f04bc13fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 -- 172.21.15.114:0/1419906371 >> 172.21.15.114:0/1419906371 conn(0x7f04bc0a8490 msgr2=0x7f04bc06e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 -- 172.21.15.114:0/1419906371 shutdown_connections 2024-02-17T12:19:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.216+0000 7f04c2600640 1 -- 172.21.15.114:0/1419906371 wait complete. 2024-02-17T12:19:36.241 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-02-17T12:19:36.241 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-02-17T12:19:36.250 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.OGIPzJJoqU 2024-02-17T12:19:36.250 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:36.250 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/tmp/tmp.OGIPzJJoqU 2024-02-17T12:19:36.305 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:36.305 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:36.359 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:36.359 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:36.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:36.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ecc600640 1 Processor -- start 2024-02-17T12:19:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ecc600640 1 -- start start 2024-02-17T12:19:36.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ecc600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ec406db50 0x7f8ec414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ecc600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8ec4150490 0x7f8ec4152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ecc600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec4156270 con 0x7f8ec40c25a0 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ecc600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec406f090 con 0x7f8ec406db50 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ecc600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec4071630 con 0x7f8ec4150490 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ec9200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ec406db50 0x7f8ec414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ec9200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ec406db50 0x7f8ec414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60814/0 (socket says 172.21.15.114:60814) 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ec9200640 1 -- 172.21.15.114:0/593476274 learned_addr learned my addr 172.21.15.114:0/593476274 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ec9200640 1 -- 172.21.15.114:0/593476274 >> v2:172.21.15.116:3300/0 conn(0x7f8ec4150490 msgr2=0x7f8ec4152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8eca600640 1 --2- 172.21.15.114:0/593476274 >> v2:172.21.15.116:3300/0 conn(0x7f8ec4150490 0x7f8ec4152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ec9200640 1 --2- 172.21.15.114:0/593476274 >> v2:172.21.15.116:3300/0 conn(0x7f8ec4150490 0x7f8ec4152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ec9200640 1 -- 172.21.15.114:0/593476274 >> v1:172.21.15.116:6789/0 conn(0x7f8ec40c25a0 legacy=0x7f8ec406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8ec9200640 1 -- 172.21.15.114:0/593476274 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4156550 con 0x7f8ec406db50 2024-02-17T12:19:36.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.584+0000 7f8eca600640 1 --2- 172.21.15.114:0/593476274 >> v2:172.21.15.116:3300/0 conn(0x7f8ec4150490 0x7f8ec4152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ec9200640 1 --2- 172.21.15.114:0/593476274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec406db50 0x7f8ec414ff50 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4153cb0 tx=0x7f8eb001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5709337ae1d85c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ec3e00640 1 -- 172.21.15.114:0/593476274 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec41539a0 con 0x7f8ec406db50 2024-02-17T12:19:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ec3e00640 1 -- 172.21.15.114:0/593476274 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb00a7050 con 0x7f8ec406db50 2024-02-17T12:19:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ec3e00640 1 -- 172.21.15.114:0/593476274 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb00ab820 con 0x7f8ec406db50 2024-02-17T12:19:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ecc600640 1 -- 172.21.15.114:0/593476274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec406db50 msgr2=0x7f8ec414ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ecc600640 1 --2- 172.21.15.114:0/593476274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec406db50 0x7f8ec414ff50 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4153cb0 tx=0x7f8eb001c3c0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ecc600640 1 -- 172.21.15.114:0/593476274 shutdown_connections 2024-02-17T12:19:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ecc600640 1 --2- 172.21.15.114:0/593476274 >> v2:172.21.15.116:3300/0 conn(0x7f8ec4150490 0x7f8ec4152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ecc600640 1 --2- 172.21.15.114:0/593476274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec406db50 0x7f8ec414ff50 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ecc600640 1 -- 172.21.15.114:0/593476274 >> 172.21.15.114:0/593476274 conn(0x7f8ec40a8490 msgr2=0x7f8ec40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ecc600640 1 -- 172.21.15.114:0/593476274 shutdown_connections 2024-02-17T12:19:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.588+0000 7f8ecc600640 1 -- 172.21.15.114:0/593476274 wait complete. 2024-02-17T12:19:36.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ecc600640 1 Processor -- start 2024-02-17T12:19:36.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ecc600640 1 -- start start 2024-02-17T12:19:36.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ecc600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ec406db50 0x7f8ec41557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ecc600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ec40c25a0 0x7f8ec413bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ecc600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4150490 0x7f8ec413c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ecc600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4154410 con 0x7f8ec4150490 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ecc600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4144740 con 0x7f8ec40c25a0 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ecc600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec41ed080 con 0x7f8ec406db50 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8eca600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4150490 0x7f8ec413c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ec9200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ec40c25a0 0x7f8ec413bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8eca600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4150490 0x7f8ec413c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60828/0 (socket says 172.21.15.114:60828) 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8eca600640 1 -- 172.21.15.114:0/972490579 learned_addr learned my addr 172.21.15.114:0/972490579 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ec9c00640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ec406db50 0x7f8ec41557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8eca600640 1 -- 172.21.15.114:0/972490579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ec406db50 msgr2=0x7f8ec41557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8eca600640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ec406db50 0x7f8ec41557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8eca600640 1 -- 172.21.15.114:0/972490579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ec40c25a0 msgr2=0x7f8ec413bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8eca600640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ec40c25a0 0x7f8ec413bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8eca600640 1 -- 172.21.15.114:0/972490579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb00094d0 con 0x7f8ec4150490 2024-02-17T12:19:36.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8eca600640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4150490 0x7f8ec413c520 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00cd50 tx=0x7f8ebc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:36.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ec1600640 1 -- 172.21.15.114:0/972490579 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00f680 con 0x7f8ec4150490 2024-02-17T12:19:36.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ec1600640 1 -- 172.21.15.114:0/972490579 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc00f800 con 0x7f8ec4150490 2024-02-17T12:19:36.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ecc600640 1 -- 172.21.15.114:0/972490579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec413eb60 con 0x7f8ec4150490 2024-02-17T12:19:36.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ec1600640 1 -- 172.21.15.114:0/972490579 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00fbb0 con 0x7f8ec4150490 2024-02-17T12:19:36.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.592+0000 7f8ecc600640 1 -- 172.21.15.114:0/972490579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec4144c70 con 0x7f8ec4150490 2024-02-17T12:19:36.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.596+0000 7f8ecc600640 1 -- 172.21.15.114:0/972490579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec41ed2a0 con 0x7f8ec4150490 2024-02-17T12:19:36.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.596+0000 7f8ec1600640 1 -- 172.21.15.114:0/972490579 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8ebc00b040 con 0x7f8ec4150490 2024-02-17T12:19:36.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.596+0000 7f8ec1600640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ea4066e70 0x7f8ea4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.596+0000 7f8ec1600640 1 -- 172.21.15.114:0/972490579 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8ebc085610 con 0x7f8ec4150490 2024-02-17T12:19:36.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.596+0000 7f8ec9c00640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ea4066e70 0x7f8ea4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.596+0000 7f8ec9c00640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ea4066e70 0x7f8ea4069330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8007fd0 tx=0x7f8eb8007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:36.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.600+0000 7f8ec1600640 1 -- 172.21.15.114:0/972490579 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8ec41ed2a0 con 0x7f8ec4150490 2024-02-17T12:19:36.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.760+0000 7f8ecc600640 1 -- 172.21.15.114:0/972490579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ec41ed240 con 0x7f8ec4150490 2024-02-17T12:19:36.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.760+0000 7f8ec1600640 1 -- 172.21.15.114:0/972490579 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20392 (secure 0 0 0) 0x7f8ebc05ae60 con 0x7f8ec4150490 2024-02-17T12:19:36.765 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:36.765 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:23.364663+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:36.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 -- 172.21.15.114:0/972490579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ea4066e70 msgr2=0x7f8ea4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ea4066e70 0x7f8ea4069330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8007fd0 tx=0x7f8eb8007e40 comp rx=0 tx=0).stop 2024-02-17T12:19:36.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 -- 172.21.15.114:0/972490579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4150490 msgr2=0x7f8ec413c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4150490 0x7f8ec413c520 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00cd50 tx=0x7f8ebc00a650 comp rx=0 tx=0).stop 2024-02-17T12:19:36.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 -- 172.21.15.114:0/972490579 shutdown_connections 2024-02-17T12:19:36.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8ea4066e70 0x7f8ea4069330 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ec4150490 0x7f8ec413c520 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8ec40c25a0 0x7f8ec413bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 --2- 172.21.15.114:0/972490579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ec406db50 0x7f8ec41557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 -- 172.21.15.114:0/972490579 >> 172.21.15.114:0/972490579 conn(0x7f8ec40a8490 msgr2=0x7f8ec4072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:36.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 -- 172.21.15.114:0/972490579 shutdown_connections 2024-02-17T12:19:36.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.764+0000 7f8ecc600640 1 -- 172.21.15.114:0/972490579 wait complete. 2024-02-17T12:19:36.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:19:01.796651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:19:03.070707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:19:19.573884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:19:20.731260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:19:36.787 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:19:36.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.920+0000 7ffabe000640 1 Processor -- start 2024-02-17T12:19:36.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.920+0000 7ffabe000640 1 -- start start 2024-02-17T12:19:36.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffabe000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab80c7d60 0x7ffab80ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffabe000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab81545c0 con 0x7ffab8071430 2024-02-17T12:19:36.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffabe000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab80c6c30 con 0x7ffab814c120 2024-02-17T12:19:36.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffabe000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80c71b0 con 0x7ffab80c7d60 2024-02-17T12:19:36.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffabcc00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffab8071430 0x7ffab8153eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34032/0 (socket says 172.21.15.114:34032) 2024-02-17T12:19:36.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffabcc00640 1 -- 172.21.15.114:0/2258204327 learned_addr learned my addr 172.21.15.114:0/2258204327 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:36.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffaafe00640 1 --2- 172.21.15.114:0/2258204327 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab80c7d60 0x7ffab80ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffab7e00640 1 -- 172.21.15.114:0/2258204327 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578855601 0 0) 0x7ffab81545c0 con 0x7ffab8071430 2024-02-17T12:19:36.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffab7e00640 1 -- 172.21.15.114:0/2258204327 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa9c003530 con 0x7ffab8071430 2024-02-17T12:19:36.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffab7e00640 1 -- 172.21.15.114:0/2258204327 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317922618 0 0) 0x7ffab80c6c30 con 0x7ffab814c120 2024-02-17T12:19:36.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffab7e00640 1 -- 172.21.15.114:0/2258204327 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab81545c0 con 0x7ffab814c120 2024-02-17T12:19:36.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffaafe00640 1 -- 172.21.15.114:0/2258204327 >> v1:172.21.15.116:6789/0 conn(0x7ffab814c120 legacy=0x7ffab814c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffaafe00640 1 -- 172.21.15.114:0/2258204327 >> v1:172.21.15.114:6789/0 conn(0x7ffab8071430 legacy=0x7ffab8153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffab7e00640 1 -- 172.21.15.114:0/2258204327 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 117255044 0 0) 0x7ffa9c003530 con 0x7ffab8071430 2024-02-17T12:19:36.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.924+0000 7ffaafe00640 1 -- 172.21.15.114:0/2258204327 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80ab9f0 con 0x7ffab80c7d60 2024-02-17T12:19:36.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffaafe00640 1 --2- 172.21.15.114:0/2258204327 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab80c7d60 0x7ffab80ad2e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00097f0 tx=0x7ffaa001c2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6a77c55810c79c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:36.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffab7e00640 1 -- 172.21.15.114:0/2258204327 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8001680 con 0x7ffab80c7d60 2024-02-17T12:19:36.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffab7e00640 1 -- 172.21.15.114:0/2258204327 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa00a7050 con 0x7ffab80c7d60 2024-02-17T12:19:36.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffab7e00640 1 -- 172.21.15.114:0/2258204327 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00ab620 con 0x7ffab80c7d60 2024-02-17T12:19:36.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 -- 172.21.15.114:0/2258204327 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab80c7d60 msgr2=0x7ffab80ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 --2- 172.21.15.114:0/2258204327 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab80c7d60 0x7ffab80ad2e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00097f0 tx=0x7ffaa001c2b0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 -- 172.21.15.114:0/2258204327 shutdown_connections 2024-02-17T12:19:36.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 --2- 172.21.15.114:0/2258204327 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab80c7d60 0x7ffab80ad2e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 -- 172.21.15.114:0/2258204327 >> 172.21.15.114:0/2258204327 conn(0x7ffab80a9f70 msgr2=0x7ffab80aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:36.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 -- 172.21.15.114:0/2258204327 shutdown_connections 2024-02-17T12:19:36.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 -- 172.21.15.114:0/2258204327 wait complete. 2024-02-17T12:19:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 Processor -- start 2024-02-17T12:19:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 -- start start 2024-02-17T12:19:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8071430 0x7ffab815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffab80c7d60 0x7ffab814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab814c120 0x7ffab814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81f1470 con 0x7ffab8071430 2024-02-17T12:19:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81f0f40 con 0x7ffab80c7d60 2024-02-17T12:19:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.928+0000 7ffabe000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80c1790 con 0x7ffab814c120 2024-02-17T12:19:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8071430 0x7ffab815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8071430 0x7ffab815d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60842/0 (socket says 172.21.15.114:60842) 2024-02-17T12:19:36.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabcc00640 1 -- 172.21.15.114:0/1757151026 learned_addr learned my addr 172.21.15.114:0/1757151026 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:36.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffaafe00640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffab80c7d60 0x7ffab814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabd600640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab814c120 0x7ffab814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabcc00640 1 -- 172.21.15.114:0/1757151026 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab814c120 msgr2=0x7ffab814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabcc00640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab814c120 0x7ffab814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabcc00640 1 -- 172.21.15.114:0/1757151026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffab80c7d60 msgr2=0x7ffab814f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabcc00640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffab80c7d60 0x7ffab814f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabcc00640 1 -- 172.21.15.114:0/1757151026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009420 con 0x7ffab8071430 2024-02-17T12:19:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabcc00640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8071430 0x7ffab815d870 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800c730 tx=0x7ffaa800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffab5600640 1 -- 172.21.15.114:0/1757151026 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8005ae0 con 0x7ffab8071430 2024-02-17T12:19:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffab5600640 1 -- 172.21.15.114:0/1757151026 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa8005c40 con 0x7ffab8071430 2024-02-17T12:19:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabe000640 1 -- 172.21.15.114:0/1757151026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab81f1190 con 0x7ffab8071430 2024-02-17T12:19:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffab5600640 1 -- 172.21.15.114:0/1757151026 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8007070 con 0x7ffab8071430 2024-02-17T12:19:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabe000640 1 -- 172.21.15.114:0/1757151026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab80c2620 con 0x7ffab8071430 2024-02-17T12:19:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffabe000640 1 -- 172.21.15.114:0/1757151026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab80c15f0 con 0x7ffab8071430 2024-02-17T12:19:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffab5600640 1 -- 172.21.15.114:0/1757151026 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ffaa80071d0 con 0x7ffab8071430 2024-02-17T12:19:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffab5600640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa94066e40 0x7ffa94069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:36.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.932+0000 7ffab5600640 1 -- 172.21.15.114:0/1757151026 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffaa80843b0 con 0x7ffab8071430 2024-02-17T12:19:36.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.936+0000 7ffaafe00640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa94066e40 0x7ffa94069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:36.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.936+0000 7ffaafe00640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa94066e40 0x7ffa94069300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00ad000 tx=0x7ffaa00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:36.936+0000 7ffab5600640 1 -- 172.21.15.114:0/1757151026 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffab80c15f0 con 0x7ffab8071430 2024-02-17T12:19:37.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.092+0000 7ffabe000640 1 -- 172.21.15.114:0/1757151026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffab80c15f0 con 0x7ffab8071430 2024-02-17T12:19:37.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.092+0000 7ffab5600640 1 -- 172.21.15.114:0/1757151026 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffab80c15f0 con 0x7ffab8071430 2024-02-17T12:19:37.097 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:19:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 -- 172.21.15.114:0/1757151026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa94066e40 msgr2=0x7ffa94069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa94066e40 0x7ffa94069300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00ad000 tx=0x7ffaa00a6000 comp rx=0 tx=0).stop 2024-02-17T12:19:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 -- 172.21.15.114:0/1757151026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8071430 msgr2=0x7ffab815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8071430 0x7ffab815d870 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800c730 tx=0x7ffaa800cbf0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 -- 172.21.15.114:0/1757151026 shutdown_connections 2024-02-17T12:19:37.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffab814c120 0x7ffab814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffab80c7d60 0x7ffab814f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa94066e40 0x7ffa94069300 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 --2- 172.21.15.114:0/1757151026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffab8071430 0x7ffab815d870 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 -- 172.21.15.114:0/1757151026 >> 172.21.15.114:0/1757151026 conn(0x7ffab80a9f70 msgr2=0x7ffab80c2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 -- 172.21.15.114:0/1757151026 shutdown_connections 2024-02-17T12:19:37.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.096+0000 7ffabe000640 1 -- 172.21.15.114:0/1757151026 wait complete. 2024-02-17T12:19:37.118 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:19:37.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f0590000640 1 Processor -- start 2024-02-17T12:19:37.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f0590000640 1 -- start start 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f0590000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f058806db50 0x7f058814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f0590000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0588150490 0x7f0588152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f0590000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0588156270 con 0x7f05880c25a0 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f0590000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058806f090 con 0x7f0588150490 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f0590000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0588071630 con 0x7f058806db50 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f058e000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0588150490 0x7f0588152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f058cc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f058806db50 0x7f058814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f058e000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0588150490 0x7f0588152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:43946/0 (socket says 172.21.15.114:43946) 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f058e000640 1 -- 172.21.15.114:0/184668561 learned_addr learned my addr 172.21.15.114:0/184668561 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f058cc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f058806db50 0x7f058814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:37532/0 (socket says 172.21.15.114:37532) 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f058e000640 1 -- 172.21.15.114:0/184668561 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f058806db50 msgr2=0x7f058814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f058e000640 1 --2- 172.21.15.114:0/184668561 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f058806db50 0x7f058814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f058e000640 1 -- 172.21.15.114:0/184668561 >> v1:172.21.15.116:6789/0 conn(0x7f05880c25a0 legacy=0x7f058806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f058e000640 1 -- 172.21.15.114:0/184668561 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0588156550 con 0x7f0588150490 2024-02-17T12:19:37.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f058cc00640 1 --2- 172.21.15.114:0/184668561 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f058806db50 0x7f058814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:37.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.252+0000 7f0587e00640 1 -- 172.21.15.114:0/184668561 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810706629 0 0) 0x7f0588156270 con 0x7f05880c25a0 2024-02-17T12:19:37.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f058e000640 1 --2- 172.21.15.114:0/184668561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0588150490 0x7f0588152c50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0580009e50 tx=0x7f058001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e69e0dc50abf88a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:37.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0587e00640 1 -- 172.21.15.114:0/184668561 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05881539a0 con 0x7f0588150490 2024-02-17T12:19:37.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0587e00640 1 -- 172.21.15.114:0/184668561 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05800a57a0 con 0x7f0588150490 2024-02-17T12:19:37.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0587e00640 1 -- 172.21.15.114:0/184668561 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05800a5b30 con 0x7f0588150490 2024-02-17T12:19:37.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0590000640 1 -- 172.21.15.114:0/184668561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0588150490 msgr2=0x7f0588152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0590000640 1 --2- 172.21.15.114:0/184668561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0588150490 0x7f0588152c50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0580009e50 tx=0x7f058001c8e0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0590000640 1 -- 172.21.15.114:0/184668561 shutdown_connections 2024-02-17T12:19:37.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0590000640 1 --2- 172.21.15.114:0/184668561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0588150490 0x7f0588152c50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0590000640 1 --2- 172.21.15.114:0/184668561 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f058806db50 0x7f058814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0590000640 1 -- 172.21.15.114:0/184668561 >> 172.21.15.114:0/184668561 conn(0x7f05880a8490 msgr2=0x7f05880a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:37.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0590000640 1 -- 172.21.15.114:0/184668561 shutdown_connections 2024-02-17T12:19:37.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.256+0000 7f0590000640 1 -- 172.21.15.114:0/184668561 wait complete. 2024-02-17T12:19:37.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 Processor -- start 2024-02-17T12:19:37.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 -- start start 2024-02-17T12:19:37.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f058806db50 0x7f05880c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05880c25a0 0x7f058813e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0588150490 0x7f05881474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058813dba0 con 0x7f058806db50 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0588148f80 con 0x7f0588150490 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058813e570 con 0x7f05880c25a0 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f058806db50 0x7f05880c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f058806db50 0x7f05880c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60856/0 (socket says 172.21.15.114:60856) 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058d600640 1 -- 172.21.15.114:0/614063332 learned_addr learned my addr 172.21.15.114:0/614063332 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058e000640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0588150490 0x7f05881474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058cc00640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05880c25a0 0x7f058813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058d600640 1 -- 172.21.15.114:0/614063332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05880c25a0 msgr2=0x7f058813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058d600640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05880c25a0 0x7f058813e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058d600640 1 -- 172.21.15.114:0/614063332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0588150490 msgr2=0x7f05881474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058d600640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0588150490 0x7f05881474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058d600640 1 -- 172.21.15.114:0/614063332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574009420 con 0x7f058806db50 2024-02-17T12:19:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058e000640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0588150490 0x7f05881474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058cc00640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05880c25a0 0x7f058813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f058d600640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f058806db50 0x7f05880c5700 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c4d0 tx=0x7f057c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0585600640 1 -- 172.21.15.114:0/614063332 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c005480 con 0x7f058806db50 2024-02-17T12:19:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0585600640 1 -- 172.21.15.114:0/614063332 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c003600 con 0x7f058806db50 2024-02-17T12:19:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 -- 172.21.15.114:0/614063332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0580009b30 con 0x7f058806db50 2024-02-17T12:19:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0585600640 1 -- 172.21.15.114:0/614063332 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0039b0 con 0x7f058806db50 2024-02-17T12:19:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 -- 172.21.15.114:0/614063332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05881489c0 con 0x7f058806db50 2024-02-17T12:19:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.260+0000 7f0590000640 1 -- 172.21.15.114:0/614063332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0588074840 con 0x7f058806db50 2024-02-17T12:19:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.264+0000 7f0585600640 1 -- 172.21.15.114:0/614063332 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f057c003b10 con 0x7f058806db50 2024-02-17T12:19:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.264+0000 7f0585600640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0568066e40 0x7f0568069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.264+0000 7f0585600640 1 -- 172.21.15.114:0/614063332 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f057c084520 con 0x7f058806db50 2024-02-17T12:19:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.264+0000 7f058cc00640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0568066e40 0x7f0568069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.264+0000 7f058cc00640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0568066e40 0x7f0568069300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f05880c1960 tx=0x7f0574008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.268+0000 7f0585600640 1 -- 172.21.15.114:0/614063332 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f057c050f40 con 0x7f058806db50 2024-02-17T12:19:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.424+0000 7f0590000640 1 -- 172.21.15.114:0/614063332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0588153a60 con 0x7f058806db50 2024-02-17T12:19:37.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.424+0000 7f0585600640 1 -- 172.21.15.114:0/614063332 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0588153a60 con 0x7f058806db50 2024-02-17T12:19:37.429 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 -- 172.21.15.114:0/614063332 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0568066e40 msgr2=0x7f0568069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0568066e40 0x7f0568069300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f05880c1960 tx=0x7f0574008040 comp rx=0 tx=0).stop 2024-02-17T12:19:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 -- 172.21.15.114:0/614063332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f058806db50 msgr2=0x7f05880c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f058806db50 0x7f05880c5700 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c4d0 tx=0x7f057c00c990 comp rx=0 tx=0).stop 2024-02-17T12:19:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 -- 172.21.15.114:0/614063332 shutdown_connections 2024-02-17T12:19:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0588150490 0x7f05881474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f05880c25a0 0x7f058813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0568066e40 0x7f0568069300 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 --2- 172.21.15.114:0/614063332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f058806db50 0x7f05880c5700 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 -- 172.21.15.114:0/614063332 >> 172.21.15.114:0/614063332 conn(0x7f05880a8490 msgr2=0x7f05880721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 -- 172.21.15.114:0/614063332 shutdown_connections 2024-02-17T12:19:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.428+0000 7f0590000640 1 -- 172.21.15.114:0/614063332 wait complete. 2024-02-17T12:19:37.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:19:37.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f8523200640 1 Processor -- start 2024-02-17T12:19:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f8523200640 1 -- start start 2024-02-17T12:19:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f8523200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0c25a0 0x7f851c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f8523200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f851c06db50 0x7f851c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f8523200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f851c150490 0x7f851c152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f8523200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c071630 con 0x7f851c06db50 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f8523200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c156270 con 0x7f851c150490 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f8523200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c156550 con 0x7f851c0c25a0 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f851b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f851c06db50 0x7f851c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f851b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f851c06db50 0x7f851c14ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60858/0 (socket says 172.21.15.114:60858) 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f851b400640 1 -- 172.21.15.114:0/2286099127 learned_addr learned my addr 172.21.15.114:0/2286099127 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f851be00640 1 --2- 172.21.15.114:0/2286099127 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0c25a0 0x7f851c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f8521200640 1 --2- 172.21.15.114:0/2286099127 >> v2:172.21.15.116:3300/0 conn(0x7f851c150490 0x7f851c152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f851b400640 1 -- 172.21.15.114:0/2286099127 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0c25a0 msgr2=0x7f851c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f851b400640 1 --2- 172.21.15.114:0/2286099127 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0c25a0 0x7f851c06e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f851b400640 1 -- 172.21.15.114:0/2286099127 >> v2:172.21.15.116:3300/0 conn(0x7f851c150490 msgr2=0x7f851c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f851b400640 1 --2- 172.21.15.114:0/2286099127 >> v2:172.21.15.116:3300/0 conn(0x7f851c150490 0x7f851c152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f851b400640 1 -- 172.21.15.114:0/2286099127 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c156830 con 0x7f851c06db50 2024-02-17T12:19:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.584+0000 7f8521200640 1 --2- 172.21.15.114:0/2286099127 >> v2:172.21.15.116:3300/0 conn(0x7f851c150490 0x7f851c152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:37.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f851b400640 1 --2- 172.21.15.114:0/2286099127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c06db50 0x7f851c14ff50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f851c0c0780 tx=0x7f850401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4f34cab6ea88f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:37.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f851aa00640 1 -- 172.21.15.114:0/2286099127 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c1539a0 con 0x7f851c06db50 2024-02-17T12:19:37.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f851aa00640 1 -- 172.21.15.114:0/2286099127 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85040ac410 con 0x7f851c06db50 2024-02-17T12:19:37.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f851aa00640 1 -- 172.21.15.114:0/2286099127 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85040ac7a0 con 0x7f851c06db50 2024-02-17T12:19:37.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f8523200640 1 -- 172.21.15.114:0/2286099127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c06db50 msgr2=0x7f851c14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f8523200640 1 --2- 172.21.15.114:0/2286099127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c06db50 0x7f851c14ff50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f851c0c0780 tx=0x7f850401c3d0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f8523200640 1 -- 172.21.15.114:0/2286099127 shutdown_connections 2024-02-17T12:19:37.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f8523200640 1 --2- 172.21.15.114:0/2286099127 >> v2:172.21.15.116:3300/0 conn(0x7f851c150490 0x7f851c152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f8523200640 1 --2- 172.21.15.114:0/2286099127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c06db50 0x7f851c14ff50 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f8523200640 1 --2- 172.21.15.114:0/2286099127 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0c25a0 0x7f851c06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f8523200640 1 -- 172.21.15.114:0/2286099127 >> 172.21.15.114:0/2286099127 conn(0x7f851c0a8490 msgr2=0x7f851c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:37.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f8523200640 1 -- 172.21.15.114:0/2286099127 shutdown_connections 2024-02-17T12:19:37.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.588+0000 7f8523200640 1 -- 172.21.15.114:0/2286099127 wait complete. 2024-02-17T12:19:37.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8523200640 1 Processor -- start 2024-02-17T12:19:37.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8523200640 1 -- start start 2024-02-17T12:19:37.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8523200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f851c06db50 0x7f851c140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8523200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0c25a0 0x7f851c1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8523200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c150490 0x7f851c155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8523200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0c60b0 con 0x7f851c150490 2024-02-17T12:19:37.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8523200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0c4750 con 0x7f851c06db50 2024-02-17T12:19:37.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8523200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c1ee8a0 con 0x7f851c0c25a0 2024-02-17T12:19:37.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8521200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c150490 0x7f851c155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8521200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c150490 0x7f851c155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60874/0 (socket says 172.21.15.114:60874) 2024-02-17T12:19:37.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8521200640 1 -- 172.21.15.114:0/3968860476 learned_addr learned my addr 172.21.15.114:0/3968860476 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f851be00640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f851c06db50 0x7f851c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f851b400640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0c25a0 0x7f851c1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8521200640 1 -- 172.21.15.114:0/3968860476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0c25a0 msgr2=0x7f851c1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8521200640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0c25a0 0x7f851c1540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8521200640 1 -- 172.21.15.114:0/3968860476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f851c06db50 msgr2=0x7f851c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8521200640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f851c06db50 0x7f851c140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8521200640 1 -- 172.21.15.114:0/3968860476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040094d0 con 0x7f851c150490 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8521200640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c150490 0x7f851c155710 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f851400d860 tx=0x7f851400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8513e00640 1 -- 172.21.15.114:0/3968860476 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140096a0 con 0x7f851c150490 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8513e00640 1 -- 172.21.15.114:0/3968860476 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514009800 con 0x7f851c150490 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8513e00640 1 -- 172.21.15.114:0/3968860476 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514009bb0 con 0x7f851c150490 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8523200640 1 -- 172.21.15.114:0/3968860476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c1545f0 con 0x7f851c150490 2024-02-17T12:19:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.592+0000 7f8523200640 1 -- 172.21.15.114:0/3968860476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c0c49a0 con 0x7f851c150490 2024-02-17T12:19:37.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.596+0000 7f8523200640 1 -- 172.21.15.114:0/3968860476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c1eea30 con 0x7f851c150490 2024-02-17T12:19:37.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.596+0000 7f8513e00640 1 -- 172.21.15.114:0/3968860476 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f8514009d10 con 0x7f851c150490 2024-02-17T12:19:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.596+0000 7f8513e00640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84f8066e40 0x7f84f8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.596+0000 7f8513e00640 1 -- 172.21.15.114:0/3968860476 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8514085160 con 0x7f851c150490 2024-02-17T12:19:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.596+0000 7f851be00640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84f8066e40 0x7f84f8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.596+0000 7f851be00640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84f8066e40 0x7f84f8069300 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f851c073290 tx=0x7f850c00d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:37.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.600+0000 7f8513e00640 1 -- 172.21.15.114:0/3968860476 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8514051d10 con 0x7f851c150490 2024-02-17T12:19:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.752+0000 7f8523200640 1 -- 172.21.15.114:0/3968860476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f851c074840 con 0x7f851c150490 2024-02-17T12:19:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.752+0000 7f8513e00640 1 -- 172.21.15.114:0/3968860476 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85140553d0 con 0x7f851c150490 2024-02-17T12:19:37.757 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 -- 172.21.15.114:0/3968860476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84f8066e40 msgr2=0x7f84f8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84f8066e40 0x7f84f8069300 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f851c073290 tx=0x7f850c00d040 comp rx=0 tx=0).stop 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 -- 172.21.15.114:0/3968860476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c150490 msgr2=0x7f851c155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c150490 0x7f851c155710 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f851400d860 tx=0x7f851400dd20 comp rx=0 tx=0).stop 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 -- 172.21.15.114:0/3968860476 shutdown_connections 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f84f8066e40 0x7f84f8069300 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f851c150490 0x7f851c155710 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0c25a0 0x7f851c1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 --2- 172.21.15.114:0/3968860476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f851c06db50 0x7f851c140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 -- 172.21.15.114:0/3968860476 >> 172.21.15.114:0/3968860476 conn(0x7f851c0a8490 msgr2=0x7f851c06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 -- 172.21.15.114:0/3968860476 shutdown_connections 2024-02-17T12:19:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.756+0000 7f8523200640 1 -- 172.21.15.114:0/3968860476 wait complete. 2024-02-17T12:19:37.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:19:37.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.912+0000 7fbd8ca00640 1 Processor -- start 2024-02-17T12:19:37.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.912+0000 7fbd8ca00640 1 -- start start 2024-02-17T12:19:37.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd8ca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 0x7fbd881530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd8ca00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd88156270 con 0x7fbd8806db50 2024-02-17T12:19:37.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd8ca00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd88156550 con 0x7fbd880c25a0 2024-02-17T12:19:37.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd8ca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8806f090 con 0x7fbd88152c50 2024-02-17T12:19:37.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd85400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbd8806db50 0x7fbd8814ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34036/0 (socket says 172.21.15.114:34036) 2024-02-17T12:19:37.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd85400640 1 -- 172.21.15.114:0/2161703842 learned_addr learned my addr 172.21.15.114:0/2161703842 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:37.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd86800640 1 --2- 172.21.15.114:0/2161703842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 0x7fbd881530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd84a00640 1 -- 172.21.15.114:0/2161703842 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501867416 0 0) 0x7fbd88156270 con 0x7fbd8806db50 2024-02-17T12:19:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd84a00640 1 -- 172.21.15.114:0/2161703842 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd6c003530 con 0x7fbd8806db50 2024-02-17T12:19:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd84a00640 1 -- 172.21.15.114:0/2161703842 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128314361 0 0) 0x7fbd88156550 con 0x7fbd880c25a0 2024-02-17T12:19:37.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd84a00640 1 -- 172.21.15.114:0/2161703842 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd88156270 con 0x7fbd880c25a0 2024-02-17T12:19:37.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd86800640 1 -- 172.21.15.114:0/2161703842 >> v1:172.21.15.116:6789/0 conn(0x7fbd880c25a0 legacy=0x7fbd8806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd86800640 1 -- 172.21.15.114:0/2161703842 >> v1:172.21.15.114:6789/0 conn(0x7fbd8806db50 legacy=0x7fbd8814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd84a00640 1 -- 172.21.15.114:0/2161703842 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3181002724 0 0) 0x7fbd6c003530 con 0x7fbd8806db50 2024-02-17T12:19:37.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.916+0000 7fbd86800640 1 -- 172.21.15.114:0/2161703842 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd88156830 con 0x7fbd88152c50 2024-02-17T12:19:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd86800640 1 --2- 172.21.15.114:0/2161703842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 0x7fbd881530c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009dc0 tx=0x7fbd8001c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65fb771628a25f36 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd84a00640 1 -- 172.21.15.114:0/2161703842 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd740016a0 con 0x7fbd88152c50 2024-02-17T12:19:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd84a00640 1 -- 172.21.15.114:0/2161703842 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd800a64f0 con 0x7fbd88152c50 2024-02-17T12:19:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd84a00640 1 -- 172.21.15.114:0/2161703842 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800a6880 con 0x7fbd88152c50 2024-02-17T12:19:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd8ca00640 1 -- 172.21.15.114:0/2161703842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 msgr2=0x7fbd881530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd8ca00640 1 --2- 172.21.15.114:0/2161703842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 0x7fbd881530c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009dc0 tx=0x7fbd8001c790 comp rx=0 tx=0).stop 2024-02-17T12:19:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd8ca00640 1 -- 172.21.15.114:0/2161703842 shutdown_connections 2024-02-17T12:19:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd8ca00640 1 --2- 172.21.15.114:0/2161703842 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 0x7fbd881530c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd8ca00640 1 -- 172.21.15.114:0/2161703842 >> 172.21.15.114:0/2161703842 conn(0x7fbd880a8490 msgr2=0x7fbd880a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:37.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd8ca00640 1 -- 172.21.15.114:0/2161703842 shutdown_connections 2024-02-17T12:19:37.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd8ca00640 1 -- 172.21.15.114:0/2161703842 wait complete. 2024-02-17T12:19:37.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd8ca00640 1 Processor -- start 2024-02-17T12:19:37.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.920+0000 7fbd8ca00640 1 -- start start 2024-02-17T12:19:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd8ca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd8806db50 0x7fbd8813d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd8ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd880c25a0 0x7fbd881ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd8ca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 0x7fbd881549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd8ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8813f150 con 0x7fbd880c25a0 2024-02-17T12:19:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd8ca00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd881ec2d0 con 0x7fbd8806db50 2024-02-17T12:19:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd8ca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd88144010 con 0x7fbd88152c50 2024-02-17T12:19:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd880c25a0 0x7fbd881ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd880c25a0 0x7fbd881ebd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60888/0 (socket says 172.21.15.114:60888) 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85400640 1 -- 172.21.15.114:0/1054455861 learned_addr learned my addr 172.21.15.114:0/1054455861 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd86800640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 0x7fbd881549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85e00640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd8806db50 0x7fbd8813d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85400640 1 -- 172.21.15.114:0/1054455861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 msgr2=0x7fbd881549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85400640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 0x7fbd881549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85400640 1 -- 172.21.15.114:0/1054455861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd8806db50 msgr2=0x7fbd8813d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85400640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd8806db50 0x7fbd8813d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85400640 1 -- 172.21.15.114:0/1054455861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd80009a70 con 0x7fbd880c25a0 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85e00640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd8806db50 0x7fbd8813d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd85400640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd880c25a0 0x7fbd881ebd90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400c7b0 tx=0x7fbd7400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:37.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd7e000640 1 -- 172.21.15.114:0/1054455861 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd740072d0 con 0x7fbd880c25a0 2024-02-17T12:19:37.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd7e000640 1 -- 172.21.15.114:0/1054455861 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd74007430 con 0x7fbd880c25a0 2024-02-17T12:19:37.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd7e000640 1 -- 172.21.15.114:0/1054455861 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd740047f0 con 0x7fbd880c25a0 2024-02-17T12:19:37.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd8ca00640 1 -- 172.21.15.114:0/1054455861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd881442f0 con 0x7fbd880c25a0 2024-02-17T12:19:37.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd8ca00640 1 -- 172.21.15.114:0/1054455861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd88142b60 con 0x7fbd880c25a0 2024-02-17T12:19:37.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd8ca00640 1 -- 172.21.15.114:0/1054455861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd88145c20 con 0x7fbd880c25a0 2024-02-17T12:19:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.924+0000 7fbd7e000640 1 -- 172.21.15.114:0/1054455861 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbd74004950 con 0x7fbd880c25a0 2024-02-17T12:19:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.928+0000 7fbd7e000640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd68066e40 0x7fbd68069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.928+0000 7fbd7e000640 1 -- 172.21.15.114:0/1054455861 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbd740843c0 con 0x7fbd880c25a0 2024-02-17T12:19:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.928+0000 7fbd85e00640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd68066e40 0x7fbd68069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.928+0000 7fbd85e00640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd68066e40 0x7fbd68069300 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbd780011f0 tx=0x7fbd78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:37.932+0000 7fbd7e000640 1 -- 172.21.15.114:0/1054455861 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbd74050ef0 con 0x7fbd880c25a0 2024-02-17T12:19:38.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.084+0000 7fbd8ca00640 1 -- 172.21.15.114:0/1054455861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd88141870 con 0x7fbd880c25a0 2024-02-17T12:19:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd7e000640 1 -- 172.21.15.114:0/1054455861 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7fbd740545b0 con 0x7fbd880c25a0 2024-02-17T12:19:38.090 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 -- 172.21.15.114:0/1054455861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd68066e40 msgr2=0x7fbd68069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd68066e40 0x7fbd68069300 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbd780011f0 tx=0x7fbd78009040 comp rx=0 tx=0).stop 2024-02-17T12:19:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 -- 172.21.15.114:0/1054455861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd880c25a0 msgr2=0x7fbd881ebd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd880c25a0 0x7fbd881ebd90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400c7b0 tx=0x7fbd7400cc70 comp rx=0 tx=0).stop 2024-02-17T12:19:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 -- 172.21.15.114:0/1054455861 shutdown_connections 2024-02-17T12:19:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd88152c50 0x7fbd881549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbd68066e40 0x7fbd68069300 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd880c25a0 0x7fbd881ebd90 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 --2- 172.21.15.114:0/1054455861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd8806db50 0x7fbd8813d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 -- 172.21.15.114:0/1054455861 >> 172.21.15.114:0/1054455861 conn(0x7fbd880a8490 msgr2=0x7fbd88142070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 -- 172.21.15.114:0/1054455861 shutdown_connections 2024-02-17T12:19:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.088+0000 7fbd8ca00640 1 -- 172.21.15.114:0/1054455861 wait complete. 2024-02-17T12:19:38.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:19:38.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.244+0000 7f432fe00640 1 Processor -- start 2024-02-17T12:19:38.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.244+0000 7f432fe00640 1 -- start start 2024-02-17T12:19:38.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006e2d0 0x7f433015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43301538c0 con 0x7f433006b740 2024-02-17T12:19:38.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432fe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43300c0f20 con 0x7f433014cb50 2024-02-17T12:19:38.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43300aa340 con 0x7f433006e2d0 2024-02-17T12:19:38.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432e000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f433006b740 0x7f433006dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34046/0 (socket says 172.21.15.114:34046) 2024-02-17T12:19:38.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432e000640 1 -- 172.21.15.114:0/4073226899 learned_addr learned my addr 172.21.15.114:0/4073226899 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:38.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432f400640 1 --2- 172.21.15.114:0/4073226899 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006e2d0 0x7f433015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432d600640 1 -- 172.21.15.114:0/4073226899 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282409368 0 0) 0x7f43301538c0 con 0x7f433006b740 2024-02-17T12:19:38.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432d600640 1 -- 172.21.15.114:0/4073226899 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4314003530 con 0x7f433006b740 2024-02-17T12:19:38.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432d600640 1 -- 172.21.15.114:0/4073226899 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398991112 0 0) 0x7f43300c0f20 con 0x7f433014cb50 2024-02-17T12:19:38.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432f400640 1 -- 172.21.15.114:0/4073226899 >> v1:172.21.15.116:6789/0 conn(0x7f433014cb50 legacy=0x7f433006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432f400640 1 -- 172.21.15.114:0/4073226899 >> v1:172.21.15.114:6789/0 conn(0x7f433006b740 legacy=0x7f433006dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432f400640 1 -- 172.21.15.114:0/4073226899 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330152cb0 con 0x7f433006e2d0 2024-02-17T12:19:38.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.248+0000 7f432f400640 1 --2- 172.21.15.114:0/4073226899 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006e2d0 0x7f433015e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f43280097f0 tx=0x7f432801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4bd97d0838974e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:38.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432d600640 1 -- 172.21.15.114:0/4073226899 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280ab620 con 0x7f433006e2d0 2024-02-17T12:19:38.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432d600640 1 -- 172.21.15.114:0/4073226899 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280ab780 con 0x7f433006e2d0 2024-02-17T12:19:38.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432d600640 1 -- 172.21.15.114:0/4073226899 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280abaf0 con 0x7f433006e2d0 2024-02-17T12:19:38.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 -- 172.21.15.114:0/4073226899 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006e2d0 msgr2=0x7f433015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 --2- 172.21.15.114:0/4073226899 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006e2d0 0x7f433015e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f43280097f0 tx=0x7f432801c420 comp rx=0 tx=0).stop 2024-02-17T12:19:38.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 -- 172.21.15.114:0/4073226899 shutdown_connections 2024-02-17T12:19:38.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 --2- 172.21.15.114:0/4073226899 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006e2d0 0x7f433015e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 -- 172.21.15.114:0/4073226899 >> 172.21.15.114:0/4073226899 conn(0x7f43300c6300 msgr2=0x7f43300c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:38.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 -- 172.21.15.114:0/4073226899 shutdown_connections 2024-02-17T12:19:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 -- 172.21.15.114:0/4073226899 wait complete. 2024-02-17T12:19:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 Processor -- start 2024-02-17T12:19:38.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 -- start start 2024-02-17T12:19:38.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006b740 0x7f43301ee500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f433006e2d0 0x7f43300bf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f433014cb50 0x7f43301f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43301f08e0 con 0x7f433014cb50 2024-02-17T12:19:38.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433014ec90 con 0x7f433006e2d0 2024-02-17T12:19:38.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43301f0590 con 0x7f433006b740 2024-02-17T12:19:38.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f433014cb50 0x7f43301f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f433014cb50 0x7f43301f0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60890/0 (socket says 172.21.15.114:60890) 2024-02-17T12:19:38.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432f400640 1 -- 172.21.15.114:0/2845646055 learned_addr learned my addr 172.21.15.114:0/2845646055 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:38.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432e000640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f433006e2d0 0x7f43300bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.252+0000 7f432ea00640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006b740 0x7f43301ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432f400640 1 -- 172.21.15.114:0/2845646055 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006b740 msgr2=0x7f43301ee500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432f400640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006b740 0x7f43301ee500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432f400640 1 -- 172.21.15.114:0/2845646055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f433006e2d0 msgr2=0x7f43300bf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432f400640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f433006e2d0 0x7f43300bf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432f400640 1 -- 172.21.15.114:0/2845646055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4328009420 con 0x7f433014cb50 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432e000640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f433006e2d0 0x7f43300bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432f400640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f433014cb50 0x7f43301f0d70 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f4328019030 tx=0x7f432801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f4326a00640 1 -- 172.21.15.114:0/2845646055 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280abdc0 con 0x7f433014cb50 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f4326a00640 1 -- 172.21.15.114:0/2845646055 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280bf410 con 0x7f433014cb50 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432fe00640 1 -- 172.21.15.114:0/2845646055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433014eee0 con 0x7f433014cb50 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f4326a00640 1 -- 172.21.15.114:0/2845646055 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280bf780 con 0x7f433014cb50 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432fe00640 1 -- 172.21.15.114:0/2845646055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433014da00 con 0x7f433014cb50 2024-02-17T12:19:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432fe00640 1 -- 172.21.15.114:0/2845646055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43301f0a90 con 0x7f433014cb50 2024-02-17T12:19:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f4326a00640 1 -- 172.21.15.114:0/2845646055 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f43280bf8e0 con 0x7f433014cb50 2024-02-17T12:19:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f4326a00640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f430c066e70 0x7f430c069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f4326a00640 1 -- 172.21.15.114:0/2845646055 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f432811f6e0 con 0x7f433014cb50 2024-02-17T12:19:38.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.256+0000 7f432ea00640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f430c066e70 0x7f430c069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.260+0000 7f432ea00640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f430c066e70 0x7f430c069330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f43200012f0 tx=0x7f4320009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:38.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.260+0000 7f4326a00640 1 -- 172.21.15.114:0/2845646055 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f43301f0a90 con 0x7f433014cb50 2024-02-17T12:19:38.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 -- 172.21.15.114:0/2845646055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f43301f0a90 con 0x7f433014cb50 2024-02-17T12:19:38.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f4326a00640 1 -- 172.21.15.114:0/2845646055 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f43301f0a90 con 0x7f433014cb50 2024-02-17T12:19:38.427 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:38.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 -- 172.21.15.114:0/2845646055 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f430c066e70 msgr2=0x7f430c069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f430c066e70 0x7f430c069330 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f43200012f0 tx=0x7f4320009040 comp rx=0 tx=0).stop 2024-02-17T12:19:38.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 -- 172.21.15.114:0/2845646055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f433014cb50 msgr2=0x7f43301f0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f433014cb50 0x7f43301f0d70 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f4328019030 tx=0x7f432801ac60 comp rx=0 tx=0).stop 2024-02-17T12:19:38.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 -- 172.21.15.114:0/2845646055 shutdown_connections 2024-02-17T12:19:38.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f430c066e70 0x7f430c069330 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f433014cb50 0x7f43301f0d70 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f433006e2d0 0x7f43300bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 --2- 172.21.15.114:0/2845646055 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f433006b740 0x7f43301ee500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 -- 172.21.15.114:0/2845646055 >> 172.21.15.114:0/2845646055 conn(0x7f43300c6300 msgr2=0x7f433006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:38.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 -- 172.21.15.114:0/2845646055 shutdown_connections 2024-02-17T12:19:38.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.424+0000 7f432fe00640 1 -- 172.21.15.114:0/2845646055 wait complete. 2024-02-17T12:19:38.448 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:19:38.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffaa5600640 1 Processor -- start 2024-02-17T12:19:38.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffaa5600640 1 -- start start 2024-02-17T12:19:38.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffaa5600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ffaa00c25a0 0x7ffaa006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffaa5600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffaa0152c50 0x7ffaa0153070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffaa5600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa0156270 con 0x7ffaa006db50 2024-02-17T12:19:38.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffaa5600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa0071630 con 0x7ffaa0152c50 2024-02-17T12:19:38.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffaa5600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa0156550 con 0x7ffaa00c25a0 2024-02-17T12:19:38.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffa9f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffaa0152c50 0x7ffaa0153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffa9f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffaa0152c50 0x7ffaa0153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60898/0 (socket says 172.21.15.114:60898) 2024-02-17T12:19:38.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffa9f400640 1 -- 172.21.15.114:0/3294728018 learned_addr learned my addr 172.21.15.114:0/3294728018 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:38.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffa9ea00640 1 --2- 172.21.15.114:0/3294728018 >> v2:172.21.15.116:3300/0 conn(0x7ffaa00c25a0 0x7ffaa006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffa9f400640 1 -- 172.21.15.114:0/3294728018 >> v2:172.21.15.116:3300/0 conn(0x7ffaa00c25a0 msgr2=0x7ffaa006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:38.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffa9f400640 1 --2- 172.21.15.114:0/3294728018 >> v2:172.21.15.116:3300/0 conn(0x7ffaa00c25a0 0x7ffaa006e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffa9f400640 1 -- 172.21.15.114:0/3294728018 >> v1:172.21.15.114:6789/0 conn(0x7ffaa006db50 legacy=0x7ffaa014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffa9f400640 1 -- 172.21.15.114:0/3294728018 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0156830 con 0x7ffaa0152c50 2024-02-17T12:19:38.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.580+0000 7ffa9d600640 1 -- 172.21.15.114:0/3294728018 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255057700 0 0) 0x7ffaa0156270 con 0x7ffaa006db50 2024-02-17T12:19:38.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffa9f400640 1 --2- 172.21.15.114:0/3294728018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 0x7ffaa0153070 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00ab930 tx=0x7ffa9801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f90948f5bdc2b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:38.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffa9d600640 1 -- 172.21.15.114:0/3294728018 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980ab600 con 0x7ffaa0152c50 2024-02-17T12:19:38.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffa9d600640 1 -- 172.21.15.114:0/3294728018 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa980a7050 con 0x7ffaa0152c50 2024-02-17T12:19:38.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffa9d600640 1 -- 172.21.15.114:0/3294728018 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980ab980 con 0x7ffaa0152c50 2024-02-17T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffaa5600640 1 -- 172.21.15.114:0/3294728018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 msgr2=0x7ffaa0153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffaa5600640 1 --2- 172.21.15.114:0/3294728018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 0x7ffaa0153070 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00ab930 tx=0x7ffa9801c3d0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffaa5600640 1 -- 172.21.15.114:0/3294728018 shutdown_connections 2024-02-17T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffaa5600640 1 --2- 172.21.15.114:0/3294728018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 0x7ffaa0153070 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffaa5600640 1 --2- 172.21.15.114:0/3294728018 >> v2:172.21.15.116:3300/0 conn(0x7ffaa00c25a0 0x7ffaa006e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffaa5600640 1 -- 172.21.15.114:0/3294728018 >> 172.21.15.114:0/3294728018 conn(0x7ffaa00a8490 msgr2=0x7ffaa00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffaa5600640 1 -- 172.21.15.114:0/3294728018 shutdown_connections 2024-02-17T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.584+0000 7ffaa5600640 1 -- 172.21.15.114:0/3294728018 wait complete. 2024-02-17T12:19:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 Processor -- start 2024-02-17T12:19:38.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 -- start start 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffaa006db50 0x7ffaa0151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa00c25a0 0x7ffaa00aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 0x7ffaa01f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa014e000 con 0x7ffaa0152c50 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa014f9b0 con 0x7ffaa00c25a0 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa014f110 con 0x7ffaa006db50 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 0x7ffaa01f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 0x7ffaa01f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60906/0 (socket says 172.21.15.114:60906) 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9f400640 1 -- 172.21.15.114:0/540765162 learned_addr learned my addr 172.21.15.114:0/540765162 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9ea00640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffaa006db50 0x7ffaa0151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9e000640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa00c25a0 0x7ffaa00aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9f400640 1 -- 172.21.15.114:0/540765162 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffaa006db50 msgr2=0x7ffaa0151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9f400640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffaa006db50 0x7ffaa0151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9f400640 1 -- 172.21.15.114:0/540765162 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa00c25a0 msgr2=0x7ffaa00aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9f400640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa00c25a0 0x7ffaa00aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9f400640 1 -- 172.21.15.114:0/540765162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa980094d0 con 0x7ffaa0152c50 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa9f400640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 0x7ffaa01f1370 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ffa980ae040 tx=0x7ffa98019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa96a00640 1 -- 172.21.15.114:0/540765162 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980b4430 con 0x7ffaa0152c50 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa96a00640 1 -- 172.21.15.114:0/540765162 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa980b4590 con 0x7ffaa0152c50 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffa96a00640 1 -- 172.21.15.114:0/540765162 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980b4940 con 0x7ffaa0152c50 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 -- 172.21.15.114:0/540765162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa014f3f0 con 0x7ffaa0152c50 2024-02-17T12:19:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 -- 172.21.15.114:0/540765162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa01f0e50 con 0x7ffaa0152c50 2024-02-17T12:19:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.588+0000 7ffaa5600640 1 -- 172.21.15.114:0/540765162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa01f1040 con 0x7ffaa0152c50 2024-02-17T12:19:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.592+0000 7ffa96a00640 1 -- 172.21.15.114:0/540765162 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ffa980b2040 con 0x7ffaa0152c50 2024-02-17T12:19:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.592+0000 7ffa96a00640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa7c066e40 0x7ffa7c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.592+0000 7ffa96a00640 1 -- 172.21.15.114:0/540765162 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ffa9811ec00 con 0x7ffaa0152c50 2024-02-17T12:19:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.592+0000 7ffa9ea00640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa7c066e40 0x7ffa7c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:38.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.592+0000 7ffa9ea00640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa7c066e40 0x7ffa7c069300 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ffa90003fd0 tx=0x7ffa900039a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.596+0000 7ffa96a00640 1 -- 172.21.15.114:0/540765162 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa980eb680 con 0x7ffaa0152c50 2024-02-17T12:19:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 -- 172.21.15.114:0/540765162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffaa0074840 con 0x7ffaa0152c50 2024-02-17T12:19:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffa96a00640 1 -- 172.21.15.114:0/540765162 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffa980eed40 con 0x7ffaa0152c50 2024-02-17T12:19:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:19:38.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 -- 172.21.15.114:0/540765162 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa7c066e40 msgr2=0x7ffa7c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa7c066e40 0x7ffa7c069300 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ffa90003fd0 tx=0x7ffa900039a0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 -- 172.21.15.114:0/540765162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 msgr2=0x7ffaa01f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:38.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 0x7ffaa01f1370 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ffa980ae040 tx=0x7ffa98019170 comp rx=0 tx=0).stop 2024-02-17T12:19:38.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 -- 172.21.15.114:0/540765162 shutdown_connections 2024-02-17T12:19:38.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffa7c066e40 0x7ffa7c069300 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffaa0152c50 0x7ffaa01f1370 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa00c25a0 0x7ffaa00aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 --2- 172.21.15.114:0/540765162 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffaa006db50 0x7ffaa0151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:38.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 -- 172.21.15.114:0/540765162 >> 172.21.15.114:0/540765162 conn(0x7ffaa00a8490 msgr2=0x7ffaa0072960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:38.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 -- 172.21.15.114:0/540765162 shutdown_connections 2024-02-17T12:19:38.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:38.764+0000 7ffaa5600640 1 -- 172.21.15.114:0/540765162 wait complete. 2024-02-17T12:19:38.789 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-17T12:19:38.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:38.789 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:38.861 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:19:38.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:38.861 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-17T12:19:38.872 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:38.873 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:38.922 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354568k,nr_inodes=4088642,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2004 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-17T12:19:38.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:19:39.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.096+0000 7f5b29000640 1 Processor -- start 2024-02-17T12:19:39.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.096+0000 7f5b29000640 1 -- start start 2024-02-17T12:19:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b29000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b2414f110 0x7f5b240c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b29000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b240a9420 con 0x7f5b240c1eb0 2024-02-17T12:19:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b29000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b24152850 con 0x7f5b240c2580 2024-02-17T12:19:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b29000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2414f4f0 con 0x7f5b2414f110 2024-02-17T12:19:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b21e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b2414f110 0x7f5b240c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b22800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5b240c1eb0 0x7f5b2415c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34068/0 (socket says 172.21.15.114:34068) 2024-02-17T12:19:39.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b22800640 1 -- 172.21.15.114:0/654930240 learned_addr learned my addr 172.21.15.114:0/654930240 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:39.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b21e00640 1 -- 172.21.15.114:0/654930240 >> v1:172.21.15.116:6789/0 conn(0x7f5b240c2580 legacy=0x7f5b240aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:39.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b21e00640 1 -- 172.21.15.114:0/654930240 >> v1:172.21.15.114:6789/0 conn(0x7f5b240c1eb0 legacy=0x7f5b2415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:39.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b21e00640 1 -- 172.21.15.114:0/654930240 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b240a9670 con 0x7f5b2414f110 2024-02-17T12:19:39.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b21e00640 1 --2- 172.21.15.114:0/654930240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2414f110 0x7f5b240c65a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009d90 tx=0x7f5b1401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570c24696025e2e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:39.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b20a00640 1 -- 172.21.15.114:0/654930240 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140a5850 con 0x7f5b2414f110 2024-02-17T12:19:39.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b20a00640 1 -- 172.21.15.114:0/654930240 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b140a59b0 con 0x7f5b2414f110 2024-02-17T12:19:39.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.100+0000 7f5b20a00640 1 -- 172.21.15.114:0/654930240 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140a5d40 con 0x7f5b2414f110 2024-02-17T12:19:39.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 -- 172.21.15.114:0/654930240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2414f110 msgr2=0x7f5b240c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:39.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 --2- 172.21.15.114:0/654930240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2414f110 0x7f5b240c65a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009d90 tx=0x7f5b1401c8a0 comp rx=0 tx=0).stop 2024-02-17T12:19:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 -- 172.21.15.114:0/654930240 shutdown_connections 2024-02-17T12:19:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 --2- 172.21.15.114:0/654930240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b2414f110 0x7f5b240c65a0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 -- 172.21.15.114:0/654930240 >> 172.21.15.114:0/654930240 conn(0x7f5b240a8490 msgr2=0x7f5b240a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 -- 172.21.15.114:0/654930240 shutdown_connections 2024-02-17T12:19:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 -- 172.21.15.114:0/654930240 wait complete. 2024-02-17T12:19:39.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 Processor -- start 2024-02-17T12:19:39.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 -- start start 2024-02-17T12:19:39.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b240c1eb0 0x7f5b2413c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:39.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b240c2580 0x7f5b2414a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b2414f110 0x7f5b241ebca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b241efe60 con 0x7f5b240c2580 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2415d890 con 0x7f5b2414f110 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b29000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b241ec930 con 0x7f5b240c1eb0 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b21400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b240c2580 0x7f5b2414a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b21400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b240c2580 0x7f5b2414a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60932/0 (socket says 172.21.15.114:60932) 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b21400640 1 -- 172.21.15.114:0/3075187847 learned_addr learned my addr 172.21.15.114:0/3075187847 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b21e00640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b240c1eb0 0x7f5b2413c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b22800640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b2414f110 0x7f5b241ebca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b21400640 1 -- 172.21.15.114:0/3075187847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b240c1eb0 msgr2=0x7f5b2413c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b21400640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b240c1eb0 0x7f5b2413c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:39.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b21400640 1 -- 172.21.15.114:0/3075187847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b2414f110 msgr2=0x7f5b241ebca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:39.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b21400640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b2414f110 0x7f5b241ebca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:39.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.104+0000 7f5b21400640 1 -- 172.21.15.114:0/3075187847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14009a70 con 0x7f5b240c2580 2024-02-17T12:19:39.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b21400640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b240c2580 0x7f5b2414a640 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00b3e0 tx=0x7f5b0c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:39.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b1a000640 1 -- 172.21.15.114:0/3075187847 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c011830 con 0x7f5b240c2580 2024-02-17T12:19:39.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b1a000640 1 -- 172.21.15.114:0/3075187847 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c011990 con 0x7f5b240c2580 2024-02-17T12:19:39.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b1a000640 1 -- 172.21.15.114:0/3075187847 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c011d80 con 0x7f5b240c2580 2024-02-17T12:19:39.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b29000640 1 -- 172.21.15.114:0/3075187847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b241ef1e0 con 0x7f5b240c2580 2024-02-17T12:19:39.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b29000640 1 -- 172.21.15.114:0/3075187847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b241ef7a0 con 0x7f5b240c2580 2024-02-17T12:19:39.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b29000640 1 -- 172.21.15.114:0/3075187847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b241effa0 con 0x7f5b240c2580 2024-02-17T12:19:39.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b1a000640 1 -- 172.21.15.114:0/3075187847 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f5b0c01a400 con 0x7f5b240c2580 2024-02-17T12:19:39.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b1a000640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5b00066e40 0x7f5b00069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:39.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b1a000640 1 -- 172.21.15.114:0/3075187847 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5b0c084aa0 con 0x7f5b240c2580 2024-02-17T12:19:39.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b21e00640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5b00066e40 0x7f5b00069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:39.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.108+0000 7f5b21e00640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5b00066e40 0x7f5b00069300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5b140af000 tx=0x7f5b140a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:39.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.112+0000 7f5b1a000640 1 -- 172.21.15.114:0/3075187847 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5b0c0515d0 con 0x7f5b240c2580 2024-02-17T12:19:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 -- 172.21.15.114:0/3075187847 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5b24074840 con 0x7f5b240c2580 2024-02-17T12:19:39.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b1a000640 1 -- 172.21.15.114:0/3075187847 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7f5b0c015070 con 0x7f5b240c2580 2024-02-17T12:19:39.307 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:19:39.307 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-02-17T12:19:39.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 -- 172.21.15.114:0/3075187847 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5b00066e40 msgr2=0x7f5b00069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5b00066e40 0x7f5b00069300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5b140af000 tx=0x7f5b140a7070 comp rx=0 tx=0).stop 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 -- 172.21.15.114:0/3075187847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b240c2580 msgr2=0x7f5b2414a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b240c2580 0x7f5b2414a640 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00b3e0 tx=0x7f5b0c00b8a0 comp rx=0 tx=0).stop 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 -- 172.21.15.114:0/3075187847 shutdown_connections 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b2414f110 0x7f5b241ebca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5b00066e40 0x7f5b00069300 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b240c2580 0x7f5b2414a640 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 --2- 172.21.15.114:0/3075187847 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5b240c1eb0 0x7f5b2413c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 -- 172.21.15.114:0/3075187847 >> 172.21.15.114:0/3075187847 conn(0x7f5b240a8490 msgr2=0x7f5b240a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 -- 172.21.15.114:0/3075187847 shutdown_connections 2024-02-17T12:19:39.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:39.304+0000 7f5b29000640 1 -- 172.21.15.114:0/3075187847 wait complete. 2024-02-17T12:19:39.327 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-17T12:19:39.327 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:19:39.327 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-02-17T12:19:39.328 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-02-17T12:19:39.328 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:39.328 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-17T12:19:39.328 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:19:39.328 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.OGIPzJJoqU 2024-02-17T12:19:39.328 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-02-17T12:19:39.336 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.7iZ0m9tyI2 2024-02-17T12:19:39.337 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /tmp/tmp.OGIPzJJoqU /tmp/tmp.7iZ0m9tyI2 2024-02-17T12:19:39.401 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.7iZ0m9tyI2 2024-02-17T12:19:39.518 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.7iZ0m9tyI2 is 226B 2024-02-17T12:19:39.533 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.7iZ0m9tyI2 2024-02-17T12:19:39.541 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-02-17T12:19:39.541 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:19:39.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:39.542 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-02-17T12:19:39.589 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:19:39.589 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:19:39.590 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:19:39.590 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:39.590 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-02-17T12:19:39.590 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:39.590 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:39.590 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:39.590 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-02-17T12:19:39.590 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:39.590 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:39.591 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-02-17T12:19:39.591 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:39.591 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:39.591 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:19:39.591 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:39.591 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:19:39.591 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42307sec preferred_lft 42307sec 2024-02-17T12:19:39.591 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-02-17T12:19:39.591 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:39.592 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:19:39.592 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:a0:c1:dc:19 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:39.592 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:19:39.592 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:39.592 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:19:39.592 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:39.592 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:19:39.592 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:39.593 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:19:39.593 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:39.593 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:19:39.593 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:19:39.593 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:19:39.593 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:39.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:39.594 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:19:39.654 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-02-17T12:19:39.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:39.657 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-02-17T12:19:39.707 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-02-17T12:19:39.708 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:19:39.708 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:19:39.708 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:19:39.708 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:19:39.708 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:19:39.708 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:39.708 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:39.708 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:39.708 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:19:39.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:39.709 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-02-17T12:19:39.709 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-02-17T12:19:39.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:19:39.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:19:39.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:19:39.709 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-02-17T12:19:39.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:39.797 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-02-17T12:19:39.805 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T12:19:39.805 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:19:39.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:39.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-02-17T12:19:39.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:19:39.869 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:39.917 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-17T12:19:39.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:19:39.917 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:39.965 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:39.965 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/tmp/tmp.OGIPzJJoqU of=/dev/stdout 2024-02-17T12:19:40.013 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:19:40.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:40.013 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2024-02-17T12:19:40.101 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2024-02-17T12:19:40.102 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs". 2024-02-17T12:19:40.102 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:19:40.102 INFO:teuthology.orchestra.run.smithi114.stdout:keyring.get_secret failed 2024-02-17T12:19:40.117 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2024-02-17T12:19:40.117 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs". 2024-02-17T12:19:40.117 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:19:40.117 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:19:40.117 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:19:40.117 INFO:teuthology.orchestra.run.smithi114.stdout:keyring.get_secret failed 2024-02-17T12:19:40.127 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,secret=AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs 2024-02-17T12:19:40.127 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs". 2024-02-17T12:19:40.127 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-02-17T12:19:40.127 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:19:40.127 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:19:40.127 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:19:40.127 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:19:40.127 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs,key=testuser,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:19:40.131 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:19:40.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:40.131 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:40.148 INFO:teuthology.orchestra.run.smithi114.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2024-02-17T12:19:40.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:19:40.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:40.150 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:19:40.204 INFO:teuthology.orchestra.run.smithi114.stdout:client6945 2024-02-17T12:19:40.204 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:40.204 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:40.253 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-02-17T12:19:40.263 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.Cj2bMCofXE 2024-02-17T12:19:40.263 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:40.263 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/tmp/tmp.Cj2bMCofXE 2024-02-17T12:19:40.314 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:40.314 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:40.366 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:40.366 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:40.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:40.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.548+0000 7ff647000640 1 Processor -- start 2024-02-17T12:19:40.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.548+0000 7ff647000640 1 -- start start 2024-02-17T12:19:40.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff647000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff6400c25a0 0x7ff64006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff647000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff64006db50 0x7ff64014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff647000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff640156270 con 0x7ff640150490 2024-02-17T12:19:40.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff647000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff640071630 con 0x7ff6400c25a0 2024-02-17T12:19:40.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff647000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff640156550 con 0x7ff64006db50 2024-02-17T12:19:40.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff63fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff6400c25a0 0x7ff64006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff63fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff6400c25a0 0x7ff64006e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60936/0 (socket says 172.21.15.114:60936) 2024-02-17T12:19:40.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff63fe00640 1 -- 172.21.15.114:0/3209114626 learned_addr learned my addr 172.21.15.114:0/3209114626 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:40.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff63fe00640 1 -- 172.21.15.114:0/3209114626 >> v2:172.21.15.116:3300/0 conn(0x7ff64006db50 msgr2=0x7ff64014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:40.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff63fe00640 1 --2- 172.21.15.114:0/3209114626 >> v2:172.21.15.116:3300/0 conn(0x7ff64006db50 0x7ff64014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff63fe00640 1 -- 172.21.15.114:0/3209114626 >> v1:172.21.15.116:6789/0 conn(0x7ff640150490 legacy=0x7ff640152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:40.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.552+0000 7ff63fe00640 1 -- 172.21.15.114:0/3209114626 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff640156830 con 0x7ff6400c25a0 2024-02-17T12:19:40.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff63fe00640 1 --2- 172.21.15.114:0/3209114626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6400c25a0 0x7ff64006e980 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ff64006e260 tx=0x7ff63001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a050ffa94a40137c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:40.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff63ea00640 1 -- 172.21.15.114:0/3209114626 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300a5560 con 0x7ff6400c25a0 2024-02-17T12:19:40.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff63ea00640 1 -- 172.21.15.114:0/3209114626 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6300a56c0 con 0x7ff6400c25a0 2024-02-17T12:19:40.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff63ea00640 1 -- 172.21.15.114:0/3209114626 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300a5a50 con 0x7ff6400c25a0 2024-02-17T12:19:40.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 -- 172.21.15.114:0/3209114626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6400c25a0 msgr2=0x7ff64006e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:40.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 --2- 172.21.15.114:0/3209114626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6400c25a0 0x7ff64006e980 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ff64006e260 tx=0x7ff63001c890 comp rx=0 tx=0).stop 2024-02-17T12:19:40.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 -- 172.21.15.114:0/3209114626 shutdown_connections 2024-02-17T12:19:40.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 --2- 172.21.15.114:0/3209114626 >> v2:172.21.15.116:3300/0 conn(0x7ff64006db50 0x7ff64014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 --2- 172.21.15.114:0/3209114626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6400c25a0 0x7ff64006e980 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 -- 172.21.15.114:0/3209114626 >> 172.21.15.114:0/3209114626 conn(0x7ff6400a8490 msgr2=0x7ff6400a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:40.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 -- 172.21.15.114:0/3209114626 shutdown_connections 2024-02-17T12:19:40.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 -- 172.21.15.114:0/3209114626 wait complete. 2024-02-17T12:19:40.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 Processor -- start 2024-02-17T12:19:40.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 -- start start 2024-02-17T12:19:40.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64006db50 0x7ff64014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6400c25a0 0x7ff64013fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff640150490 0x7ff640140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400aae70 con 0x7ff640150490 2024-02-17T12:19:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400c4730 con 0x7ff64006db50 2024-02-17T12:19:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff647000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400ab060 con 0x7ff6400c25a0 2024-02-17T12:19:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff645000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff640150490 0x7ff640140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff645000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff640150490 0x7ff640140180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60942/0 (socket says 172.21.15.114:60942) 2024-02-17T12:19:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff645000640 1 -- 172.21.15.114:0/2651508640 learned_addr learned my addr 172.21.15.114:0/2651508640 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff63f400640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6400c25a0 0x7ff64013fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.556+0000 7ff63fe00640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64006db50 0x7ff64014ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff645000640 1 -- 172.21.15.114:0/2651508640 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6400c25a0 msgr2=0x7ff64013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff645000640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6400c25a0 0x7ff64013fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff645000640 1 -- 172.21.15.114:0/2651508640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64006db50 msgr2=0x7ff64014ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff645000640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64006db50 0x7ff64014ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff645000640 1 -- 172.21.15.114:0/2651508640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff630009b30 con 0x7ff640150490 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff645000640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff640150490 0x7ff640140180 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff63800b440 tx=0x7ff63800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff637e00640 1 -- 172.21.15.114:0/2651508640 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638011830 con 0x7ff640150490 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff637e00640 1 -- 172.21.15.114:0/2651508640 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6380119b0 con 0x7ff640150490 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff647000640 1 -- 172.21.15.114:0/2651508640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6400ab300 con 0x7ff640150490 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff637e00640 1 -- 172.21.15.114:0/2651508640 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff638011d60 con 0x7ff640150490 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff647000640 1 -- 172.21.15.114:0/2651508640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6400bfc20 con 0x7ff640150490 2024-02-17T12:19:40.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff647000640 1 -- 172.21.15.114:0/2651508640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6400bf7a0 con 0x7ff640150490 2024-02-17T12:19:40.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff637e00640 1 -- 172.21.15.114:0/2651508640 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff63801a400 con 0x7ff640150490 2024-02-17T12:19:40.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff637e00640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff61c066e40 0x7ff61c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff637e00640 1 -- 172.21.15.114:0/2651508640 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff638084d90 con 0x7ff640150490 2024-02-17T12:19:40.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.560+0000 7ff63fe00640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff61c066e40 0x7ff61c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.564+0000 7ff63fe00640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff61c066e40 0x7ff61c069300 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff6300ae000 tx=0x7ff6300a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:40.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.568+0000 7ff637e00640 1 -- 172.21.15.114:0/2651508640 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff6400bf7a0 con 0x7ff640150490 2024-02-17T12:19:40.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.720+0000 7ff647000640 1 -- 172.21.15.114:0/2651508640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6400bf7a0 con 0x7ff640150490 2024-02-17T12:19:40.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff637e00640 1 -- 172.21.15.114:0/2651508640 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20392 (secure 0 0 0) 0x7ff6400bf7a0 con 0x7ff640150490 2024-02-17T12:19:40.726 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:40.726 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:23.364663+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:40.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 -- 172.21.15.114:0/2651508640 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff61c066e40 msgr2=0x7ff61c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff61c066e40 0x7ff61c069300 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff6300ae000 tx=0x7ff6300a7070 comp rx=0 tx=0).stop 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 -- 172.21.15.114:0/2651508640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff640150490 msgr2=0x7ff640140180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff640150490 0x7ff640140180 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff63800b440 tx=0x7ff63800b900 comp rx=0 tx=0).stop 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 -- 172.21.15.114:0/2651508640 shutdown_connections 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff61c066e40 0x7ff61c069300 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff640150490 0x7ff640140180 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff6400c25a0 0x7ff64013fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 --2- 172.21.15.114:0/2651508640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff64006db50 0x7ff64014ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 -- 172.21.15.114:0/2651508640 >> 172.21.15.114:0/2651508640 conn(0x7ff6400a8490 msgr2=0x7ff6400a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 -- 172.21.15.114:0/2651508640 shutdown_connections 2024-02-17T12:19:40.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.724+0000 7ff647000640 1 -- 172.21.15.114:0/2651508640 wait complete. 2024-02-17T12:19:40.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:19:01.796651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:19:03.070707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:19:19.573884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:19:20.731260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:19:40.749 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:19:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5ba800640 1 Processor -- start 2024-02-17T12:19:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5ba800640 1 -- start start 2024-02-17T12:19:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5ba800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b40c25a0 0x7fa5b406e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5ba800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5b406db50 0x7fa5b414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5ba800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa5b4150490 0x7fa5b4152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5ba800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b4071630 con 0x7fa5b406db50 2024-02-17T12:19:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5ba800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b4156270 con 0x7fa5b4150490 2024-02-17T12:19:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5ba800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b4156550 con 0x7fa5b40c25a0 2024-02-17T12:19:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5abe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5b406db50 0x7fa5b414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5abe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5b406db50 0x7fa5b414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60944/0 (socket says 172.21.15.114:60944) 2024-02-17T12:19:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5abe00640 1 -- 172.21.15.114:0/3242488041 learned_addr learned my addr 172.21.15.114:0/3242488041 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5b3400640 1 --2- 172.21.15.114:0/3242488041 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b40c25a0 0x7fa5b406e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5b3e00640 1 --2- 172.21.15.114:0/3242488041 >> v2:172.21.15.116:3300/0 conn(0x7fa5b4150490 0x7fa5b4152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5abe00640 1 -- 172.21.15.114:0/3242488041 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b40c25a0 msgr2=0x7fa5b406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5abe00640 1 --2- 172.21.15.114:0/3242488041 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b40c25a0 0x7fa5b406e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5abe00640 1 -- 172.21.15.114:0/3242488041 >> v2:172.21.15.116:3300/0 conn(0x7fa5b4150490 msgr2=0x7fa5b4152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5abe00640 1 --2- 172.21.15.114:0/3242488041 >> v2:172.21.15.116:3300/0 conn(0x7fa5b4150490 0x7fa5b4152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5abe00640 1 -- 172.21.15.114:0/3242488041 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4156830 con 0x7fa5b406db50 2024-02-17T12:19:40.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.884+0000 7fa5b3400640 1 --2- 172.21.15.114:0/3242488041 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b40c25a0 0x7fa5b406e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5abe00640 1 --2- 172.21.15.114:0/3242488041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b406db50 0x7fa5b414ff50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40c0780 tx=0x7fa59c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523725e77c57c659 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5b2a00640 1 -- 172.21.15.114:0/3242488041 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b41539a0 con 0x7fa5b406db50 2024-02-17T12:19:40.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5b2a00640 1 -- 172.21.15.114:0/3242488041 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c0ac410 con 0x7fa5b406db50 2024-02-17T12:19:40.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5b2a00640 1 -- 172.21.15.114:0/3242488041 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0ac7a0 con 0x7fa5b406db50 2024-02-17T12:19:40.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5ba800640 1 -- 172.21.15.114:0/3242488041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b406db50 msgr2=0x7fa5b414ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:40.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5ba800640 1 --2- 172.21.15.114:0/3242488041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b406db50 0x7fa5b414ff50 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40c0780 tx=0x7fa59c01c3d0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5ba800640 1 -- 172.21.15.114:0/3242488041 shutdown_connections 2024-02-17T12:19:40.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5ba800640 1 --2- 172.21.15.114:0/3242488041 >> v2:172.21.15.116:3300/0 conn(0x7fa5b4150490 0x7fa5b4152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5ba800640 1 --2- 172.21.15.114:0/3242488041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b406db50 0x7fa5b414ff50 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5ba800640 1 --2- 172.21.15.114:0/3242488041 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b40c25a0 0x7fa5b406e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5ba800640 1 -- 172.21.15.114:0/3242488041 >> 172.21.15.114:0/3242488041 conn(0x7fa5b40a8490 msgr2=0x7fa5b40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:40.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5ba800640 1 -- 172.21.15.114:0/3242488041 shutdown_connections 2024-02-17T12:19:40.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.888+0000 7fa5ba800640 1 -- 172.21.15.114:0/3242488041 wait complete. 2024-02-17T12:19:40.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ba800640 1 Processor -- start 2024-02-17T12:19:40.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ba800640 1 -- start start 2024-02-17T12:19:40.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ba800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b406db50 0x7fa5b40c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ba800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5b40c25a0 0x7fa5b40bf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ba800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4150490 0x7fa5b40c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ba800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b41ee2e0 con 0x7fa5b4150490 2024-02-17T12:19:40.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ba800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b4151490 con 0x7fa5b40c25a0 2024-02-17T12:19:40.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ba800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b4151920 con 0x7fa5b406db50 2024-02-17T12:19:40.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5b3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4150490 0x7fa5b40c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5b3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4150490 0x7fa5b40c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60960/0 (socket says 172.21.15.114:60960) 2024-02-17T12:19:40.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5b3e00640 1 -- 172.21.15.114:0/1335066036 learned_addr learned my addr 172.21.15.114:0/1335066036 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:40.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5b3400640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b406db50 0x7fa5b40c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5abe00640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5b40c25a0 0x7fa5b40bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5b3e00640 1 -- 172.21.15.114:0/1335066036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b406db50 msgr2=0x7fa5b40c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:40.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5b3e00640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b406db50 0x7fa5b40c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5b3e00640 1 -- 172.21.15.114:0/1335066036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5b40c25a0 msgr2=0x7fa5b40bf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:40.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5b3e00640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5b40c25a0 0x7fa5b40bf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:40.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5b3e00640 1 -- 172.21.15.114:0/1335066036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c0094d0 con 0x7fa5b4150490 2024-02-17T12:19:40.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5abe00640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5b40c25a0 0x7fa5b40bf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:40.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5b3e00640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4150490 0x7fa5b40c4640 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac007e60 tx=0x7fa5ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:40.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ab400640 1 -- 172.21.15.114:0/1335066036 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac014420 con 0x7fa5b4150490 2024-02-17T12:19:40.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ab400640 1 -- 172.21.15.114:0/1335066036 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0145a0 con 0x7fa5b4150490 2024-02-17T12:19:40.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ab400640 1 -- 172.21.15.114:0/1335066036 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac014950 con 0x7fa5b4150490 2024-02-17T12:19:40.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ba800640 1 -- 172.21.15.114:0/1335066036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b4150b60 con 0x7fa5b4150490 2024-02-17T12:19:40.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.892+0000 7fa5ba800640 1 -- 172.21.15.114:0/1335066036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b4151120 con 0x7fa5b4150490 2024-02-17T12:19:40.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.896+0000 7fa5ba800640 1 -- 172.21.15.114:0/1335066036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b4151600 con 0x7fa5b4150490 2024-02-17T12:19:40.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.896+0000 7fa5ab400640 1 -- 172.21.15.114:0/1335066036 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa5ac014ab0 con 0x7fa5b4150490 2024-02-17T12:19:40.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.896+0000 7fa5ab400640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa590066e70 0x7fa590069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:40.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.896+0000 7fa5ab400640 1 -- 172.21.15.114:0/1335066036 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa5ac085690 con 0x7fa5b4150490 2024-02-17T12:19:40.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.896+0000 7fa5b3400640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa590066e70 0x7fa590069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:40.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.896+0000 7fa5b3400640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa590066e70 0x7fa590069330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa5b415d430 tx=0x7fa5a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:40.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:40.900+0000 7fa5ab400640 1 -- 172.21.15.114:0/1335066036 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa5ac052120 con 0x7fa5b4150490 2024-02-17T12:19:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.052+0000 7fa5ba800640 1 -- 172.21.15.114:0/1335066036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5b4074840 con 0x7fa5b4150490 2024-02-17T12:19:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.052+0000 7fa5ab400640 1 -- 172.21.15.114:0/1335066036 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5ac0557e0 con 0x7fa5b4150490 2024-02-17T12:19:41.057 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:19:41.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 -- 172.21.15.114:0/1335066036 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa590066e70 msgr2=0x7fa590069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa590066e70 0x7fa590069330 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa5b415d430 tx=0x7fa5a4008040 comp rx=0 tx=0).stop 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 -- 172.21.15.114:0/1335066036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4150490 msgr2=0x7fa5b40c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4150490 0x7fa5b40c4640 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac007e60 tx=0x7fa5ac00e4b0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 -- 172.21.15.114:0/1335066036 shutdown_connections 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa590066e70 0x7fa590069330 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5b4150490 0x7fa5b40c4640 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5b40c25a0 0x7fa5b40bf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 --2- 172.21.15.114:0/1335066036 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5b406db50 0x7fa5b40c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 -- 172.21.15.114:0/1335066036 >> 172.21.15.114:0/1335066036 conn(0x7fa5b40a8490 msgr2=0x7fa5b406e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 -- 172.21.15.114:0/1335066036 shutdown_connections 2024-02-17T12:19:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.056+0000 7fa5ba800640 1 -- 172.21.15.114:0/1335066036 wait complete. 2024-02-17T12:19:41.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:19:41.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f784f000640 1 Processor -- start 2024-02-17T12:19:41.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f784f000640 1 -- start start 2024-02-17T12:19:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f784f000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78480c25a0 0x7f784806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f784f000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f784806db50 0x7f784814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f784f000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7848150490 0x7f7848152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f784f000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7848071630 con 0x7f78480c25a0 2024-02-17T12:19:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f784f000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7848156270 con 0x7f784806db50 2024-02-17T12:19:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f784f000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7848156550 con 0x7f7848150490 2024-02-17T12:19:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f7847e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78480c25a0 0x7f784806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f7847e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78480c25a0 0x7f784806e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60970/0 (socket says 172.21.15.114:60970) 2024-02-17T12:19:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.212+0000 7f7847e00640 1 -- 172.21.15.114:0/1607353520 learned_addr learned my addr 172.21.15.114:0/1607353520 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f784d000640 1 --2- 172.21.15.114:0/1607353520 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7848150490 0x7f7848152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7847400640 1 --2- 172.21.15.114:0/1607353520 >> v2:172.21.15.116:3300/0 conn(0x7f784806db50 0x7f784814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7847e00640 1 -- 172.21.15.114:0/1607353520 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7848150490 msgr2=0x7f7848152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7847e00640 1 --2- 172.21.15.114:0/1607353520 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7848150490 0x7f7848152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7847e00640 1 -- 172.21.15.114:0/1607353520 >> v2:172.21.15.116:3300/0 conn(0x7f784806db50 msgr2=0x7f784814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7847e00640 1 --2- 172.21.15.114:0/1607353520 >> v2:172.21.15.116:3300/0 conn(0x7f784806db50 0x7f784814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7847e00640 1 -- 172.21.15.114:0/1607353520 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7848156830 con 0x7f78480c25a0 2024-02-17T12:19:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7847400640 1 --2- 172.21.15.114:0/1607353520 >> v2:172.21.15.116:3300/0 conn(0x7f784806db50 0x7f784814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f784d000640 1 --2- 172.21.15.114:0/1607353520 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7848150490 0x7f7848152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7847e00640 1 --2- 172.21.15.114:0/1607353520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78480c25a0 0x7f784806e980 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f784806e260 tx=0x7f783801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a315e3d35bd115 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7846a00640 1 -- 172.21.15.114:0/1607353520 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78481539a0 con 0x7f78480c25a0 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7846a00640 1 -- 172.21.15.114:0/1607353520 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78380a5740 con 0x7f78480c25a0 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f7846a00640 1 -- 172.21.15.114:0/1607353520 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380a5ad0 con 0x7f78480c25a0 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f784f000640 1 -- 172.21.15.114:0/1607353520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78480c25a0 msgr2=0x7f784806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f784f000640 1 --2- 172.21.15.114:0/1607353520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78480c25a0 0x7f784806e980 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f784806e260 tx=0x7f783801c8a0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f784f000640 1 -- 172.21.15.114:0/1607353520 shutdown_connections 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f784f000640 1 --2- 172.21.15.114:0/1607353520 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7848150490 0x7f7848152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f784f000640 1 --2- 172.21.15.114:0/1607353520 >> v2:172.21.15.116:3300/0 conn(0x7f784806db50 0x7f784814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f784f000640 1 --2- 172.21.15.114:0/1607353520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78480c25a0 0x7f784806e980 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.216+0000 7f784f000640 1 -- 172.21.15.114:0/1607353520 >> 172.21.15.114:0/1607353520 conn(0x7f78480a8490 msgr2=0x7f78480a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 -- 172.21.15.114:0/1607353520 shutdown_connections 2024-02-17T12:19:41.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 -- 172.21.15.114:0/1607353520 wait complete. 2024-02-17T12:19:41.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 Processor -- start 2024-02-17T12:19:41.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 -- start start 2024-02-17T12:19:41.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784806db50 0x7f78480bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78480c25a0 0x7f78480aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7848150490 0x7f78480aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848149a00 con 0x7f784806db50 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480aad40 con 0x7f78480c25a0 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7848151f20 con 0x7f7848150490 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f7847e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784806db50 0x7f78480bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f7847e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784806db50 0x7f78480bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60976/0 (socket says 172.21.15.114:60976) 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f7847e00640 1 -- 172.21.15.114:0/3014245262 learned_addr learned my addr 172.21.15.114:0/3014245262 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f7847e00640 1 -- 172.21.15.114:0/3014245262 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7848150490 msgr2=0x7f78480aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f7847e00640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7848150490 0x7f78480aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f7847e00640 1 -- 172.21.15.114:0/3014245262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78480c25a0 msgr2=0x7f78480aa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f7847e00640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78480c25a0 0x7f78480aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f7847e00640 1 -- 172.21.15.114:0/3014245262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7838009b30 con 0x7f784806db50 2024-02-17T12:19:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f7847e00640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784806db50 0x7f78480bfa00 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f78380af040 tx=0x7f7838019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f783fe00640 1 -- 172.21.15.114:0/3014245262 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380b8670 con 0x7f784806db50 2024-02-17T12:19:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f783fe00640 1 -- 172.21.15.114:0/3014245262 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78380b87d0 con 0x7f784806db50 2024-02-17T12:19:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f783fe00640 1 -- 172.21.15.114:0/3014245262 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380b8b80 con 0x7f784806db50 2024-02-17T12:19:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 -- 172.21.15.114:0/3014245262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78480a9520 con 0x7f784806db50 2024-02-17T12:19:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.220+0000 7f784f000640 1 -- 172.21.15.114:0/3014245262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78480a97e0 con 0x7f784806db50 2024-02-17T12:19:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.224+0000 7f784f000640 1 -- 172.21.15.114:0/3014245262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7848074840 con 0x7f784806db50 2024-02-17T12:19:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.224+0000 7f783fe00640 1 -- 172.21.15.114:0/3014245262 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f78380b8ce0 con 0x7f784806db50 2024-02-17T12:19:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.224+0000 7f783fe00640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7824066e70 0x7f7824069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.224+0000 7f783fe00640 1 -- 172.21.15.114:0/3014245262 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7838120110 con 0x7f784806db50 2024-02-17T12:19:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.224+0000 7f7847400640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7824066e70 0x7f7824069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.224+0000 7f7847400640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7824066e70 0x7f7824069330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7848072950 tx=0x7f7830008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:41.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.228+0000 7f783fe00640 1 -- 172.21.15.114:0/3014245262 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f78380ecc50 con 0x7f784806db50 2024-02-17T12:19:41.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.384+0000 7f784f000640 1 -- 172.21.15.114:0/3014245262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7848072e10 con 0x7f784806db50 2024-02-17T12:19:41.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.384+0000 7f783fe00640 1 -- 172.21.15.114:0/3014245262 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78380f0310 con 0x7f784806db50 2024-02-17T12:19:41.388 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:41.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 -- 172.21.15.114:0/3014245262 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7824066e70 msgr2=0x7f7824069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7824066e70 0x7f7824069330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7848072950 tx=0x7f7830008040 comp rx=0 tx=0).stop 2024-02-17T12:19:41.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 -- 172.21.15.114:0/3014245262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784806db50 msgr2=0x7f78480bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784806db50 0x7f78480bfa00 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f78380af040 tx=0x7f7838019640 comp rx=0 tx=0).stop 2024-02-17T12:19:41.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 -- 172.21.15.114:0/3014245262 shutdown_connections 2024-02-17T12:19:41.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7848150490 0x7f78480aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f78480c25a0 0x7f78480aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7824066e70 0x7f7824069330 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 --2- 172.21.15.114:0/3014245262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f784806db50 0x7f78480bfa00 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 -- 172.21.15.114:0/3014245262 >> 172.21.15.114:0/3014245262 conn(0x7f78480a8490 msgr2=0x7f784814e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:41.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 -- 172.21.15.114:0/3014245262 shutdown_connections 2024-02-17T12:19:41.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.388+0000 7f784f000640 1 -- 172.21.15.114:0/3014245262 wait complete. 2024-02-17T12:19:41.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:19:41.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32fe00640 1 Processor -- start 2024-02-17T12:19:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32fe00640 1 -- start start 2024-02-17T12:19:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32fe00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb3280714c0 0x7fb328156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb328152d30 0x7fb3281531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb328157270 con 0x7fb328150300 2024-02-17T12:19:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32fe00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3280c6900 con 0x7fb3280714c0 2024-02-17T12:19:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280c3580 con 0x7fb328152d30 2024-02-17T12:19:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32d400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb328150300 0x7fb3280aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34072/0 (socket says 172.21.15.114:34072) 2024-02-17T12:19:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32d400640 1 -- 172.21.15.114:0/750276461 learned_addr learned my addr 172.21.15.114:0/750276461 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32de00640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb328152d30 0x7fb3281531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275568566 0 0) 0x7fb328157270 con 0x7fb328150300 2024-02-17T12:19:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb32ca00640 1 --2- 172.21.15.114:0/750276461 >> v2:172.21.15.116:3300/0 conn(0x7fb3280714c0 0x7fb328156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb310003530 con 0x7fb328150300 2024-02-17T12:19:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1191926940 0 0) 0x7fb310003530 con 0x7fb328150300 2024-02-17T12:19:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb328152d30 msgr2=0x7fb3281531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb328152d30 0x7fb3281531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 >> v2:172.21.15.116:3300/0 conn(0x7fb3280714c0 msgr2=0x7fb328156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 --2- 172.21.15.114:0/750276461 >> v2:172.21.15.116:3300/0 conn(0x7fb3280714c0 0x7fb328156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3280c2fc0 con 0x7fb328150300 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fb31c001a00 con 0x7fb328150300 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 >> v1:172.21.15.114:6789/0 conn(0x7fb328150300 legacy=0x7fb3280aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 0x7fb310003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb328152d30 0x7fb3100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb310004d10 0x7fb310005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280c6900 con 0x7fb310003980 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280c3580 con 0x7fb310004d10 2024-02-17T12:19:41.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.544+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31000b990 con 0x7fb328152d30 2024-02-17T12:19:41.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb32d400640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 0x7fb310003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb32ca00640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb328152d30 0x7fb3100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb32de00640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb310004d10 0x7fb310005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb32d400640 1 -- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb328152d30 msgr2=0x7fb3100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:41.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb32d400640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb328152d30 0x7fb3100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb32d400640 1 -- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb310004d10 msgr2=0x7fb310005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:41.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb32d400640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb310004d10 0x7fb310005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb32d400640 1 -- 172.21.15.114:0/750276461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310003530 con 0x7fb310003980 2024-02-17T12:19:41.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb32d400640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 0x7fb310003da0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00a860 tx=0x7fb31c01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de3e34b012fd776 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:41.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0ad630 con 0x7fb310003980 2024-02-17T12:19:41.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0a8070 con 0x7fb310003980 2024-02-17T12:19:41.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.548+0000 7fb327e00640 1 -- 172.21.15.114:0/750276461 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0ad9f0 con 0x7fb310003980 2024-02-17T12:19:41.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 -- 172.21.15.114:0/750276461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 msgr2=0x7fb310003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 --2- 172.21.15.114:0/750276461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 0x7fb310003da0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00a860 tx=0x7fb31c01d380 comp rx=0 tx=0).stop 2024-02-17T12:19:41.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32de00640 1 -- 172.21.15.114:0/750276461 reap_dead start 2024-02-17T12:19:41.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 -- 172.21.15.114:0/750276461 shutdown_connections 2024-02-17T12:19:41.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 -- 172.21.15.114:0/750276461 >> 172.21.15.114:0/750276461 conn(0x7fb3280c4f20 msgr2=0x7fb3280c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:41.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 -- 172.21.15.114:0/750276461 shutdown_connections 2024-02-17T12:19:41.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 -- 172.21.15.114:0/750276461 wait complete. 2024-02-17T12:19:41.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 Processor -- start 2024-02-17T12:19:41.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 -- start start 2024-02-17T12:19:41.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 0x7fb3280a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3280c8290 0x7fb3280c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3280ac590 0x7fb3280aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281f0940 con 0x7fb310003980 2024-02-17T12:19:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281f0bc0 con 0x7fb3280c8290 2024-02-17T12:19:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3281f0ea0 con 0x7fb3280ac590 2024-02-17T12:19:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 0x7fb3280a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 0x7fb3280a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60980/0 (socket says 172.21.15.114:60980) 2024-02-17T12:19:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32d400640 1 -- 172.21.15.114:0/3254774216 learned_addr learned my addr 172.21.15.114:0/3254774216 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32ca00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3280c8290 0x7fb3280c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32de00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3280ac590 0x7fb3280aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32d400640 1 -- 172.21.15.114:0/3254774216 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3280ac590 msgr2=0x7fb3280aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32d400640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3280ac590 0x7fb3280aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32d400640 1 -- 172.21.15.114:0/3254774216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3280c8290 msgr2=0x7fb3280c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32d400640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3280c8290 0x7fb3280c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32d400640 1 -- 172.21.15.114:0/3254774216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3281f1180 con 0x7fb310003980 2024-02-17T12:19:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32de00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3280ac590 0x7fb3280aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32d400640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 0x7fb3280a9990 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00a860 tx=0x7fb310005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb325600640 1 -- 172.21.15.114:0/3254774216 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c001a40 con 0x7fb310003980 2024-02-17T12:19:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb325600640 1 -- 172.21.15.114:0/3254774216 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c004b70 con 0x7fb310003980 2024-02-17T12:19:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb325600640 1 -- 172.21.15.114:0/3254774216 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0b8470 con 0x7fb310003980 2024-02-17T12:19:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.552+0000 7fb32fe00640 1 -- 172.21.15.114:0/3254774216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3281f1460 con 0x7fb310003980 2024-02-17T12:19:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.556+0000 7fb32fe00640 1 -- 172.21.15.114:0/3254774216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3280c91b0 con 0x7fb310003980 2024-02-17T12:19:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.556+0000 7fb32fe00640 1 -- 172.21.15.114:0/3254774216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3281f1620 con 0x7fb310003980 2024-02-17T12:19:41.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.556+0000 7fb325600640 1 -- 172.21.15.114:0/3254774216 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb31c0aa030 con 0x7fb310003980 2024-02-17T12:19:41.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.556+0000 7fb325600640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb308066e70 0x7fb308069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.556+0000 7fb325600640 1 -- 172.21.15.114:0/3254774216 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb31c11efe0 con 0x7fb310003980 2024-02-17T12:19:41.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.556+0000 7fb32ca00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb308066e70 0x7fb308069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.556+0000 7fb32ca00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb308066e70 0x7fb308069330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb3280ae2c0 tx=0x7fb314009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:41.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.560+0000 7fb325600640 1 -- 172.21.15.114:0/3254774216 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb31c0eba80 con 0x7fb310003980 2024-02-17T12:19:41.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.712+0000 7fb32fe00640 1 -- 172.21.15.114:0/3254774216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb328074840 con 0x7fb310003980 2024-02-17T12:19:41.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb325600640 1 -- 172.21.15.114:0/3254774216 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb31c0bd070 con 0x7fb310003980 2024-02-17T12:19:41.718 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:41.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 -- 172.21.15.114:0/3254774216 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb308066e70 msgr2=0x7fb308069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb308066e70 0x7fb308069330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb3280ae2c0 tx=0x7fb314009190 comp rx=0 tx=0).stop 2024-02-17T12:19:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 -- 172.21.15.114:0/3254774216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 msgr2=0x7fb3280a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 0x7fb3280a9990 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00a860 tx=0x7fb310005800 comp rx=0 tx=0).stop 2024-02-17T12:19:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 -- 172.21.15.114:0/3254774216 shutdown_connections 2024-02-17T12:19:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3280ac590 0x7fb3280aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3280c8290 0x7fb3280c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb308066e70 0x7fb308069330 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 --2- 172.21.15.114:0/3254774216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb310003980 0x7fb3280a9990 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 -- 172.21.15.114:0/3254774216 >> 172.21.15.114:0/3254774216 conn(0x7fb3280c4f20 msgr2=0x7fb328150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 -- 172.21.15.114:0/3254774216 shutdown_connections 2024-02-17T12:19:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.716+0000 7fb32fe00640 1 -- 172.21.15.114:0/3254774216 wait complete. 2024-02-17T12:19:41.739 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:19:41.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.872+0000 7fccd3e00640 1 Processor -- start 2024-02-17T12:19:41.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.872+0000 7fccd3e00640 1 -- start start 2024-02-17T12:19:41.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd3e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fccd40c4e60 0x7fccd40709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fccd40c7d30 0x7fccd40c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd3e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd40c62d0 con 0x7fccd40c6760 2024-02-17T12:19:41.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd3e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd406ee00 con 0x7fccd40c7d30 2024-02-17T12:19:41.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd3e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd40c2dd0 con 0x7fccd40c4e60 2024-02-17T12:19:41.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd2000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fccd40c7d30 0x7fccd40c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd2000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fccd40c7d30 0x7fccd40c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60994/0 (socket says 172.21.15.114:60994) 2024-02-17T12:19:41.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd2000640 1 -- 172.21.15.114:0/930703437 learned_addr learned my addr 172.21.15.114:0/930703437 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:41.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd3400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fccd40c6760 0x7fccd40c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34082/0 (socket says 172.21.15.114:34082) 2024-02-17T12:19:41.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd2a00640 1 --2- 172.21.15.114:0/930703437 >> v2:172.21.15.116:3300/0 conn(0x7fccd40c4e60 0x7fccd40709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd2000640 1 -- 172.21.15.114:0/930703437 >> v2:172.21.15.116:3300/0 conn(0x7fccd40c4e60 msgr2=0x7fccd40709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:41.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd2000640 1 --2- 172.21.15.114:0/930703437 >> v2:172.21.15.116:3300/0 conn(0x7fccd40c4e60 0x7fccd40709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd2000640 1 -- 172.21.15.114:0/930703437 >> v1:172.21.15.114:6789/0 conn(0x7fccd40c6760 legacy=0x7fccd40c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd2000640 1 -- 172.21.15.114:0/930703437 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd41537f0 con 0x7fccd40c7d30 2024-02-17T12:19:41.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd1600640 1 -- 172.21.15.114:0/930703437 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662841809 0 0) 0x7fccd40c62d0 con 0x7fccd40c6760 2024-02-17T12:19:41.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.876+0000 7fccd2000640 1 --2- 172.21.15.114:0/930703437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c7d30 0x7fccd40c5240 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fccd40c7600 tx=0x7fccc001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65de3b03aa718a3f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:41.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd1600640 1 -- 172.21.15.114:0/930703437 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00ab600 con 0x7fccd40c7d30 2024-02-17T12:19:41.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd1600640 1 -- 172.21.15.114:0/930703437 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc00a7050 con 0x7fccd40c7d30 2024-02-17T12:19:41.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd1600640 1 -- 172.21.15.114:0/930703437 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00ab980 con 0x7fccd40c7d30 2024-02-17T12:19:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 -- 172.21.15.114:0/930703437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c7d30 msgr2=0x7fccd40c5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 --2- 172.21.15.114:0/930703437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c7d30 0x7fccd40c5240 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fccd40c7600 tx=0x7fccc001c490 comp rx=0 tx=0).stop 2024-02-17T12:19:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 -- 172.21.15.114:0/930703437 shutdown_connections 2024-02-17T12:19:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 --2- 172.21.15.114:0/930703437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c7d30 0x7fccd40c5240 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 --2- 172.21.15.114:0/930703437 >> v2:172.21.15.116:3300/0 conn(0x7fccd40c4e60 0x7fccd40709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 -- 172.21.15.114:0/930703437 >> 172.21.15.114:0/930703437 conn(0x7fccd40c83d0 msgr2=0x7fccd40c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 -- 172.21.15.114:0/930703437 shutdown_connections 2024-02-17T12:19:41.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 -- 172.21.15.114:0/930703437 wait complete. 2024-02-17T12:19:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 Processor -- start 2024-02-17T12:19:41.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 -- start start 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c4e60 0x7fccd40ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccd40c6760 0x7fccd4147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd40c7d30 0x7fccd41ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd4146640 con 0x7fccd40c4e60 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd41526d0 con 0x7fccd40c7d30 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd41eee70 con 0x7fccd40c6760 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c4e60 0x7fccd40ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c4e60 0x7fccd40ada50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32776/0 (socket says 172.21.15.114:32776) 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd2a00640 1 -- 172.21.15.114:0/4018369614 learned_addr learned my addr 172.21.15.114:0/4018369614 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd2000640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccd40c6760 0x7fccd4147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd2a00640 1 -- 172.21.15.114:0/4018369614 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccd40c6760 msgr2=0x7fccd4147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd2a00640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccd40c6760 0x7fccd4147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd3400640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd40c7d30 0x7fccd41ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.880+0000 7fccd2a00640 1 -- 172.21.15.114:0/4018369614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd40c7d30 msgr2=0x7fccd41ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fccd2a00640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd40c7d30 0x7fccd41ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fccd2a00640 1 -- 172.21.15.114:0/4018369614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00094d0 con 0x7fccd40c4e60 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fccd2000640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccd40c6760 0x7fccd4147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fccd3400640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd40c7d30 0x7fccd41ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fccd2a00640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c4e60 0x7fccd40ada50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fccc400d5f0 tx=0x7fccc400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fcccaa00640 1 -- 172.21.15.114:0/4018369614 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc40125f0 con 0x7fccd40c4e60 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fcccaa00640 1 -- 172.21.15.114:0/4018369614 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc4012750 con 0x7fccd40c4e60 2024-02-17T12:19:41.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fccd3e00640 1 -- 172.21.15.114:0/4018369614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd4150a60 con 0x7fccd40c4e60 2024-02-17T12:19:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fcccaa00640 1 -- 172.21.15.114:0/4018369614 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc4012ae0 con 0x7fccd40c4e60 2024-02-17T12:19:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fccd3e00640 1 -- 172.21.15.114:0/4018369614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd4152080 con 0x7fccd40c4e60 2024-02-17T12:19:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fccd3e00640 1 -- 172.21.15.114:0/4018369614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd404eef0 con 0x7fccd40c4e60 2024-02-17T12:19:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fcccaa00640 1 -- 172.21.15.114:0/4018369614 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fccc4012c40 con 0x7fccd40c4e60 2024-02-17T12:19:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fcccaa00640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fccb4066e40 0x7fccb4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fcccaa00640 1 -- 172.21.15.114:0/4018369614 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fccc4085340 con 0x7fccd40c4e60 2024-02-17T12:19:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.884+0000 7fccd2000640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fccb4066e40 0x7fccb4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.888+0000 7fccd2000640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fccb4066e40 0x7fccb4069300 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fccc00ad000 tx=0x7fccc00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:41.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:41.888+0000 7fcccaa00640 1 -- 172.21.15.114:0/4018369614 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fccc4051d30 con 0x7fccd40c4e60 2024-02-17T12:19:42.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.044+0000 7fccd3e00640 1 -- 172.21.15.114:0/4018369614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccd40ae160 con 0x7fccd40c4e60 2024-02-17T12:19:42.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.044+0000 7fcccaa00640 1 -- 172.21.15.114:0/4018369614 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7fccc40553f0 con 0x7fccd40c4e60 2024-02-17T12:19:42.049 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.044+0000 7fccd3e00640 1 -- 172.21.15.114:0/4018369614 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fccb4066e40 msgr2=0x7fccb4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.044+0000 7fccd3e00640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fccb4066e40 0x7fccb4069300 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fccc00ad000 tx=0x7fccc00a6000 comp rx=0 tx=0).stop 2024-02-17T12:19:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.044+0000 7fccd3e00640 1 -- 172.21.15.114:0/4018369614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c4e60 msgr2=0x7fccd40ada50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.044+0000 7fccd3e00640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c4e60 0x7fccd40ada50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fccc400d5f0 tx=0x7fccc400dab0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.048+0000 7fccd3e00640 1 -- 172.21.15.114:0/4018369614 shutdown_connections 2024-02-17T12:19:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.048+0000 7fccd3e00640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd40c7d30 0x7fccd41ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.048+0000 7fccd3e00640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccd40c6760 0x7fccd4147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.048+0000 7fccd3e00640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fccb4066e40 0x7fccb4069300 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.048+0000 7fccd3e00640 1 --2- 172.21.15.114:0/4018369614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd40c4e60 0x7fccd40ada50 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.048+0000 7fccd3e00640 1 -- 172.21.15.114:0/4018369614 >> 172.21.15.114:0/4018369614 conn(0x7fccd40c83d0 msgr2=0x7fccd40c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:42.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.048+0000 7fccd3e00640 1 -- 172.21.15.114:0/4018369614 shutdown_connections 2024-02-17T12:19:42.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.048+0000 7fccd3e00640 1 -- 172.21.15.114:0/4018369614 wait complete. 2024-02-17T12:19:42.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:19:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.200+0000 7ff87e200640 1 Processor -- start 2024-02-17T12:19:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.200+0000 7ff87e200640 1 -- start start 2024-02-17T12:19:42.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff87e200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff87814f110 0x7ff8780c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff87e200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8780a9420 con 0x7ff8780c2580 2024-02-17T12:19:42.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff87e200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff878152850 con 0x7ff8780c1eb0 2024-02-17T12:19:42.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff87e200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87814f4f0 con 0x7ff87814f110 2024-02-17T12:19:42.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff8780c2580 0x7ff8780aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34086/0 (socket says 172.21.15.114:34086) 2024-02-17T12:19:42.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876a00640 1 -- 172.21.15.114:0/3940466141 learned_addr learned my addr 172.21.15.114:0/3940466141 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff877400640 1 --2- 172.21.15.114:0/3940466141 >> v2:172.21.15.116:3300/0 conn(0x7ff87814f110 0x7ff8780c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088615761 0 0) 0x7ff8780a9420 con 0x7ff8780c2580 2024-02-17T12:19:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff85c003530 con 0x7ff8780c2580 2024-02-17T12:19:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3407437655 0 0) 0x7ff85c003530 con 0x7ff8780c2580 2024-02-17T12:19:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 >> v2:172.21.15.116:3300/0 conn(0x7ff87814f110 msgr2=0x7ff8780c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 --2- 172.21.15.114:0/3940466141 >> v2:172.21.15.116:3300/0 conn(0x7ff87814f110 0x7ff8780c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 >> v1:172.21.15.116:6789/0 conn(0x7ff8780c1eb0 legacy=0x7ff87815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8780a9670 con 0x7ff8780c2580 2024-02-17T12:19:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7ff864001680 con 0x7ff8780c2580 2024-02-17T12:19:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 >> v1:172.21.15.114:6789/0 conn(0x7ff8780c2580 legacy=0x7ff8780aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff85c003980 0x7ff85c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff85c0047d0 0x7ff85c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff85c005190 0x7ff85c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87814f4f0 con 0x7ff85c0047d0 2024-02-17T12:19:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c00c090 con 0x7ff85c003980 2024-02-17T12:19:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c00c250 con 0x7ff85c005190 2024-02-17T12:19:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876a00640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff85c0047d0 0x7ff85c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff877400640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff85c003980 0x7ff85c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff877e00640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff85c005190 0x7ff85c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876a00640 1 -- 172.21.15.114:0/3940466141 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff85c005190 msgr2=0x7ff85c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876a00640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff85c005190 0x7ff85c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876a00640 1 -- 172.21.15.114:0/3940466141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff85c003980 msgr2=0x7ff85c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876a00640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff85c003980 0x7ff85c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff876a00640 1 -- 172.21.15.114:0/3940466141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c003530 con 0x7ff85c0047d0 2024-02-17T12:19:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.204+0000 7ff877e00640 1 -- 172.21.15.114:0/3940466141 reap_dead start 2024-02-17T12:19:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff876a00640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff85c0047d0 0x7ff85c004c50 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c0e0 tx=0x7ff86401cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f758627eb9f74590 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864005ae0 con 0x7ff85c0047d0 2024-02-17T12:19:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff864005c40 con 0x7ff85c0047d0 2024-02-17T12:19:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff876000640 1 -- 172.21.15.114:0/3940466141 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640a5840 con 0x7ff85c0047d0 2024-02-17T12:19:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff87e200640 1 -- 172.21.15.114:0/3940466141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff85c0047d0 msgr2=0x7ff85c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff87e200640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff85c0047d0 0x7ff85c004c50 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c0e0 tx=0x7ff86401cb40 comp rx=0 tx=0).stop 2024-02-17T12:19:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff87e200640 1 -- 172.21.15.114:0/3940466141 shutdown_connections 2024-02-17T12:19:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff87e200640 1 --2- 172.21.15.114:0/3940466141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff85c0047d0 0x7ff85c004c50 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff87e200640 1 -- 172.21.15.114:0/3940466141 >> 172.21.15.114:0/3940466141 conn(0x7ff8780a8490 msgr2=0x7ff8780a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff87e200640 1 -- 172.21.15.114:0/3940466141 shutdown_connections 2024-02-17T12:19:42.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff87e200640 1 -- 172.21.15.114:0/3940466141 wait complete. 2024-02-17T12:19:42.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff87e200640 1 Processor -- start 2024-02-17T12:19:42.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.208+0000 7ff87e200640 1 -- start start 2024-02-17T12:19:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff87e200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff85c0047d0 0x7ff8781ec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff87e200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff878147300 0x7ff878150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff87e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87814f880 0x7ff87814fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff87e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87814e730 con 0x7ff87814f880 2024-02-17T12:19:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff87e200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87814db20 con 0x7ff85c0047d0 2024-02-17T12:19:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff87e200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87814de00 con 0x7ff878147300 2024-02-17T12:19:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff877e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87814f880 0x7ff87814fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff877e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87814f880 0x7ff87814fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32800/0 (socket says 172.21.15.114:32800) 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff877e00640 1 -- 172.21.15.114:0/1599846931 learned_addr learned my addr 172.21.15.114:0/1599846931 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff877400640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff85c0047d0 0x7ff8781ec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff876a00640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff878147300 0x7ff878150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff877e00640 1 -- 172.21.15.114:0/1599846931 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff878147300 msgr2=0x7ff878150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff877e00640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff878147300 0x7ff878150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff877e00640 1 -- 172.21.15.114:0/1599846931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff85c0047d0 msgr2=0x7ff8781ec0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff877e00640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff85c0047d0 0x7ff8781ec0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff877e00640 1 -- 172.21.15.114:0/1599846931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87814e0e0 con 0x7ff87814f880 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff877e00640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87814f880 0x7ff87814fd00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff8780ab110 tx=0x7ff870011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff86f400640 1 -- 172.21.15.114:0/1599846931 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87000fc90 con 0x7ff87814f880 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff86f400640 1 -- 172.21.15.114:0/1599846931 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87000fdf0 con 0x7ff87814f880 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff86f400640 1 -- 172.21.15.114:0/1599846931 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870015650 con 0x7ff87814f880 2024-02-17T12:19:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff87e200640 1 -- 172.21.15.114:0/1599846931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87814e3c0 con 0x7ff87814f880 2024-02-17T12:19:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff87e200640 1 -- 172.21.15.114:0/1599846931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff878151370 con 0x7ff87814f880 2024-02-17T12:19:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff87e200640 1 -- 172.21.15.114:0/1599846931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87814e8a0 con 0x7ff87814f880 2024-02-17T12:19:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.212+0000 7ff86f400640 1 -- 172.21.15.114:0/1599846931 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff8700157b0 con 0x7ff87814f880 2024-02-17T12:19:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.216+0000 7ff86f400640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff858066e40 0x7ff858069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.216+0000 7ff86f400640 1 -- 172.21.15.114:0/1599846931 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff870088220 con 0x7ff87814f880 2024-02-17T12:19:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.216+0000 7ff877400640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff858066e40 0x7ff858069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.216+0000 7ff877400640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff858066e40 0x7ff858069300 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff868009c60 tx=0x7ff868009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:42.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.220+0000 7ff86f400640 1 -- 172.21.15.114:0/1599846931 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff870054cb0 con 0x7ff87814f880 2024-02-17T12:19:42.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.372+0000 7ff87e200640 1 -- 172.21.15.114:0/1599846931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7ff878074840 con 0x7ff87814f880 2024-02-17T12:19:42.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.372+0000 7ff86f400640 1 -- 172.21.15.114:0/1599846931 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7ff870058370 con 0x7ff87814f880 2024-02-17T12:19:42.377 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 -- 172.21.15.114:0/1599846931 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff858066e40 msgr2=0x7ff858069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff858066e40 0x7ff858069300 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff868009c60 tx=0x7ff868009190 comp rx=0 tx=0).stop 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 -- 172.21.15.114:0/1599846931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87814f880 msgr2=0x7ff87814fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87814f880 0x7ff87814fd00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff8780ab110 tx=0x7ff870011f80 comp rx=0 tx=0).stop 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 -- 172.21.15.114:0/1599846931 shutdown_connections 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff858066e40 0x7ff858069300 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff87814f880 0x7ff87814fd00 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff878147300 0x7ff878150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 --2- 172.21.15.114:0/1599846931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff85c0047d0 0x7ff8781ec0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 -- 172.21.15.114:0/1599846931 >> 172.21.15.114:0/1599846931 conn(0x7ff8780a8490 msgr2=0x7ff87806e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:42.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 -- 172.21.15.114:0/1599846931 shutdown_connections 2024-02-17T12:19:42.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.376+0000 7ff87e200640 1 -- 172.21.15.114:0/1599846931 wait complete. 2024-02-17T12:19:42.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:19:42.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.528+0000 7efd4d600640 1 Processor -- start 2024-02-17T12:19:42.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.528+0000 7efd4d600640 1 -- start start 2024-02-17T12:19:42.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd4d600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efd480c2580 0x7efd480aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd4d600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd480c1eb0 0x7efd4815c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd4d600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd480a9420 con 0x7efd4814f110 2024-02-17T12:19:42.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd4d600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4814f4f0 con 0x7efd480c1eb0 2024-02-17T12:19:42.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd4d600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480aae80 con 0x7efd480c2580 2024-02-17T12:19:42.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd46a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efd4814f110 0x7efd480c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34100/0 (socket says 172.21.15.114:34100) 2024-02-17T12:19:42.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd46a00640 1 -- 172.21.15.114:0/3782311813 learned_addr learned my addr 172.21.15.114:0/3782311813 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:42.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd47400640 1 --2- 172.21.15.114:0/3782311813 >> v2:172.21.15.114:3300/0 conn(0x7efd480c1eb0 0x7efd4815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd46000640 1 --2- 172.21.15.114:0/3782311813 >> v2:172.21.15.116:3300/0 conn(0x7efd480c2580 0x7efd480aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd45600640 1 -- 172.21.15.114:0/3782311813 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286672021 0 0) 0x7efd480a9420 con 0x7efd4814f110 2024-02-17T12:19:42.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd45600640 1 -- 172.21.15.114:0/3782311813 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd2c003530 con 0x7efd4814f110 2024-02-17T12:19:42.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd47400640 1 -- 172.21.15.114:0/3782311813 >> v2:172.21.15.116:3300/0 conn(0x7efd480c2580 msgr2=0x7efd480aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:42.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd47400640 1 --2- 172.21.15.114:0/3782311813 >> v2:172.21.15.116:3300/0 conn(0x7efd480c2580 0x7efd480aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd47400640 1 -- 172.21.15.114:0/3782311813 >> v1:172.21.15.114:6789/0 conn(0x7efd4814f110 legacy=0x7efd480c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.532+0000 7efd47400640 1 -- 172.21.15.114:0/3782311813 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48152850 con 0x7efd480c1eb0 2024-02-17T12:19:42.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd47400640 1 --2- 172.21.15.114:0/3782311813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480c1eb0 0x7efd4815c390 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7efd4806f0d0 tx=0x7efd4001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585ddabd92119484 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:42.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd45600640 1 -- 172.21.15.114:0/3782311813 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400ac620 con 0x7efd480c1eb0 2024-02-17T12:19:42.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd45600640 1 -- 172.21.15.114:0/3782311813 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd400ac780 con 0x7efd480c1eb0 2024-02-17T12:19:42.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd45600640 1 -- 172.21.15.114:0/3782311813 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400acb10 con 0x7efd480c1eb0 2024-02-17T12:19:42.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 -- 172.21.15.114:0/3782311813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480c1eb0 msgr2=0x7efd4815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 --2- 172.21.15.114:0/3782311813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480c1eb0 0x7efd4815c390 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7efd4806f0d0 tx=0x7efd4001c3c0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 -- 172.21.15.114:0/3782311813 shutdown_connections 2024-02-17T12:19:42.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 --2- 172.21.15.114:0/3782311813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480c1eb0 0x7efd4815c390 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 --2- 172.21.15.114:0/3782311813 >> v2:172.21.15.116:3300/0 conn(0x7efd480c2580 0x7efd480aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 -- 172.21.15.114:0/3782311813 >> 172.21.15.114:0/3782311813 conn(0x7efd480a8490 msgr2=0x7efd480a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:42.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 -- 172.21.15.114:0/3782311813 shutdown_connections 2024-02-17T12:19:42.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 -- 172.21.15.114:0/3782311813 wait complete. 2024-02-17T12:19:42.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 Processor -- start 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 -- start start 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd480c1eb0 0x7efd480c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd480c2580 0x7efd480bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd4814f110 0x7efd481ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c4f10 con 0x7efd4814f110 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481f1620 con 0x7efd480c2580 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd4d600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd48151460 con 0x7efd480c1eb0 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd47400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd4814f110 0x7efd481ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd47400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd4814f110 0x7efd481ed930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32814/0 (socket says 172.21.15.114:32814) 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd47400640 1 -- 172.21.15.114:0/3848906428 learned_addr learned my addr 172.21.15.114:0/3848906428 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd46000640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd480c2580 0x7efd480bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.536+0000 7efd46a00640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd480c1eb0 0x7efd480c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd47400640 1 -- 172.21.15.114:0/3848906428 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd480c1eb0 msgr2=0x7efd480c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd47400640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd480c1eb0 0x7efd480c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd47400640 1 -- 172.21.15.114:0/3848906428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd480c2580 msgr2=0x7efd480bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd47400640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd480c2580 0x7efd480bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd47400640 1 -- 172.21.15.114:0/3848906428 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40009420 con 0x7efd4814f110 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd46000640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd480c2580 0x7efd480bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd46a00640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd480c1eb0 0x7efd480c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd47400640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd4814f110 0x7efd481ed930 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7efd400af040 tx=0x7efd40019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd3ea00640 1 -- 172.21.15.114:0/3848906428 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400ac620 con 0x7efd4814f110 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd3ea00640 1 -- 172.21.15.114:0/3848906428 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd400b5410 con 0x7efd4814f110 2024-02-17T12:19:42.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd3ea00640 1 -- 172.21.15.114:0/3848906428 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400b57a0 con 0x7efd4814f110 2024-02-17T12:19:42.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd4d600640 1 -- 172.21.15.114:0/3848906428 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd48151180 con 0x7efd4814f110 2024-02-17T12:19:42.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd4d600640 1 -- 172.21.15.114:0/3848906428 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd481f12b0 con 0x7efd4814f110 2024-02-17T12:19:42.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd4d600640 1 -- 172.21.15.114:0/3848906428 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd481f1790 con 0x7efd4814f110 2024-02-17T12:19:42.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd3ea00640 1 -- 172.21.15.114:0/3848906428 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7efd400b3040 con 0x7efd4814f110 2024-02-17T12:19:42.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd3ea00640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efd24066e40 0x7efd24069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:42.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd3ea00640 1 -- 172.21.15.114:0/3848906428 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efd4011eff0 con 0x7efd4814f110 2024-02-17T12:19:42.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.540+0000 7efd46a00640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efd24066e40 0x7efd24069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:42.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.544+0000 7efd46a00640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efd24066e40 0x7efd24069300 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efd38005c10 tx=0x7efd38009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:42.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.544+0000 7efd3ea00640 1 -- 172.21.15.114:0/3848906428 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efd400ebb90 con 0x7efd4814f110 2024-02-17T12:19:42.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 -- 172.21.15.114:0/3848906428 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efd48074840 con 0x7efd4814f110 2024-02-17T12:19:42.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd3ea00640 1 -- 172.21.15.114:0/3848906428 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7efd400ef250 con 0x7efd4814f110 2024-02-17T12:19:42.715 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 -- 172.21.15.114:0/3848906428 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efd24066e40 msgr2=0x7efd24069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efd24066e40 0x7efd24069300 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7efd38005c10 tx=0x7efd38009040 comp rx=0 tx=0).stop 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 -- 172.21.15.114:0/3848906428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd4814f110 msgr2=0x7efd481ed930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd4814f110 0x7efd481ed930 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7efd400af040 tx=0x7efd40019160 comp rx=0 tx=0).stop 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 -- 172.21.15.114:0/3848906428 shutdown_connections 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efd24066e40 0x7efd24069300 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd4814f110 0x7efd481ed930 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd480c2580 0x7efd480bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 --2- 172.21.15.114:0/3848906428 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efd480c1eb0 0x7efd480c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 -- 172.21.15.114:0/3848906428 >> 172.21.15.114:0/3848906428 conn(0x7efd480a8490 msgr2=0x7efd480a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:42.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 -- 172.21.15.114:0/3848906428 shutdown_connections 2024-02-17T12:19:42.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:42.712+0000 7efd4d600640 1 -- 172.21.15.114:0/3848906428 wait complete. 2024-02-17T12:19:42.736 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-17T12:19:42.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:42.736 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:42.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:19:42.780 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:19:42.788 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:19:42.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:42.788 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-17T12:19:42.809 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:42.809 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:42.901 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3897 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-02-17T12:19:42.902 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-17T12:19:43.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.032+0000 7f96f5200640 1 Processor -- start 2024-02-17T12:19:43.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.032+0000 7f96f5200640 1 -- start start 2024-02-17T12:19:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.032+0000 7f96f5200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 0x7f96f00c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.032+0000 7f96f5200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f96f006ef60 0x7f96f0158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.032+0000 7f96f5200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f006e890 con 0x7f96f00c0640 2024-02-17T12:19:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.032+0000 7f96f5200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f00c2670 con 0x7f96f006ef60 2024-02-17T12:19:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.032+0000 7f96f5200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0158370 con 0x7f96f0152510 2024-02-17T12:19:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96ede00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 0x7f96f00c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:43.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96ed400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f96f006ef60 0x7f96f0158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96ee800640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f96f00c0640 0x7f96f00c2d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:55224/0 (socket says 172.21.15.114:55224) 2024-02-17T12:19:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96ee800640 1 -- 172.21.15.114:0/862836533 learned_addr learned my addr 172.21.15.114:0/862836533 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96ede00640 1 -- 172.21.15.114:0/862836533 >> v2:172.21.15.116:3300/0 conn(0x7f96f006ef60 msgr2=0x7f96f0158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96ede00640 1 --2- 172.21.15.114:0/862836533 >> v2:172.21.15.116:3300/0 conn(0x7f96f006ef60 0x7f96f0158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96ede00640 1 -- 172.21.15.114:0/862836533 >> v1:172.21.15.116:6789/0 conn(0x7f96f00c0640 legacy=0x7f96f00c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96ede00640 1 -- 172.21.15.114:0/862836533 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f006e5b0 con 0x7f96f0152510 2024-02-17T12:19:43.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96ed400640 1 --2- 172.21.15.114:0/862836533 >> v2:172.21.15.116:3300/0 conn(0x7f96f006ef60 0x7f96f0158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:43.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96ede00640 1 --2- 172.21.15.114:0/862836533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 0x7f96f00c65a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f96e00097c0 tx=0x7f96e001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71da8aca3e337b11 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:43.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96eca00640 1 -- 172.21.15.114:0/862836533 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00ac640 con 0x7f96f0152510 2024-02-17T12:19:43.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96eca00640 1 -- 172.21.15.114:0/862836533 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e00ac7a0 con 0x7f96f0152510 2024-02-17T12:19:43.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.036+0000 7f96eca00640 1 -- 172.21.15.114:0/862836533 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00acb30 con 0x7f96f0152510 2024-02-17T12:19:43.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 -- 172.21.15.114:0/862836533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 msgr2=0x7f96f00c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:43.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 --2- 172.21.15.114:0/862836533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 0x7f96f00c65a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f96e00097c0 tx=0x7f96e001c3e0 comp rx=0 tx=0).stop 2024-02-17T12:19:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 -- 172.21.15.114:0/862836533 shutdown_connections 2024-02-17T12:19:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 --2- 172.21.15.114:0/862836533 >> v2:172.21.15.116:3300/0 conn(0x7f96f006ef60 0x7f96f0158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 --2- 172.21.15.114:0/862836533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 0x7f96f00c65a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 -- 172.21.15.114:0/862836533 >> 172.21.15.114:0/862836533 conn(0x7f96f00a8490 msgr2=0x7f96f00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 -- 172.21.15.114:0/862836533 shutdown_connections 2024-02-17T12:19:43.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 -- 172.21.15.114:0/862836533 wait complete. 2024-02-17T12:19:43.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 Processor -- start 2024-02-17T12:19:43.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 -- start start 2024-02-17T12:19:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f006ef60 0x7f96f006ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96f00c0640 0x7f96f01f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 0x7f96f01f11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00c5880 con 0x7f96f006ef60 2024-02-17T12:19:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f006b8c0 con 0x7f96f00c0640 2024-02-17T12:19:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96f5200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00c47c0 con 0x7f96f0152510 2024-02-17T12:19:43.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96ede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f006ef60 0x7f96f006ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96ede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f006ef60 0x7f96f006ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32830/0 (socket says 172.21.15.114:32830) 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96ede00640 1 -- 172.21.15.114:0/2922441342 learned_addr learned my addr 172.21.15.114:0/2922441342 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96ee800640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 0x7f96f01f11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96ed400640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96f00c0640 0x7f96f01f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96ede00640 1 -- 172.21.15.114:0/2922441342 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 msgr2=0x7f96f01f11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96ede00640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 0x7f96f01f11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96ede00640 1 -- 172.21.15.114:0/2922441342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96f00c0640 msgr2=0x7f96f01f0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96ede00640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96f00c0640 0x7f96f01f0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.040+0000 7f96ede00640 1 -- 172.21.15.114:0/2922441342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc009420 con 0x7f96f006ef60 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96ede00640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f006ef60 0x7f96f006ae70 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f96e001a010 tx=0x7f96e0019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96e6000640 1 -- 172.21.15.114:0/2922441342 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00b6670 con 0x7f96f006ef60 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96e6000640 1 -- 172.21.15.114:0/2922441342 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e00b67d0 con 0x7f96f006ef60 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96f5200640 1 -- 172.21.15.114:0/2922441342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e0009420 con 0x7f96f006ef60 2024-02-17T12:19:43.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96e6000640 1 -- 172.21.15.114:0/2922441342 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00b6b60 con 0x7f96f006ef60 2024-02-17T12:19:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96f5200640 1 -- 172.21.15.114:0/2922441342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f00c4a80 con 0x7f96f006ef60 2024-02-17T12:19:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96f5200640 1 -- 172.21.15.114:0/2922441342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f0074840 con 0x7f96f006ef60 2024-02-17T12:19:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96e6000640 1 -- 172.21.15.114:0/2922441342 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f96e00b3040 con 0x7f96f006ef60 2024-02-17T12:19:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96e6000640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f96d0066e40 0x7f96d0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96e6000640 1 -- 172.21.15.114:0/2922441342 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f96e011f640 con 0x7f96f006ef60 2024-02-17T12:19:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.044+0000 7f96ed400640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f96d0066e40 0x7f96d0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:43.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.048+0000 7f96ed400640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f96d0066e40 0x7f96d0069300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f96f00abac0 tx=0x7f96dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:43.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.052+0000 7f96e6000640 1 -- 172.21.15.114:0/2922441342 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96e00ec0c0 con 0x7f96f006ef60 2024-02-17T12:19:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.236+0000 7f96f5200640 1 -- 172.21.15.114:0/2922441342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f96f00c0420 con 0x7f96f006ef60 2024-02-17T12:19:43.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96e6000640 1 -- 172.21.15.114:0/2922441342 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7f96e00ef780 con 0x7f96f006ef60 2024-02-17T12:19:43.244 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-17T12:19:43.244 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-02-17T12:19:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 -- 172.21.15.114:0/2922441342 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f96d0066e40 msgr2=0x7f96d0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f96d0066e40 0x7f96d0069300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f96f00abac0 tx=0x7f96dc008040 comp rx=0 tx=0).stop 2024-02-17T12:19:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 -- 172.21.15.114:0/2922441342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f006ef60 msgr2=0x7f96f006ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f006ef60 0x7f96f006ae70 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f96e001a010 tx=0x7f96e0019180 comp rx=0 tx=0).stop 2024-02-17T12:19:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 -- 172.21.15.114:0/2922441342 shutdown_connections 2024-02-17T12:19:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f96f0152510 0x7f96f01f11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96f00c0640 0x7f96f01f0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f96d0066e40 0x7f96d0069300 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 --2- 172.21.15.114:0/2922441342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96f006ef60 0x7f96f006ae70 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 -- 172.21.15.114:0/2922441342 >> 172.21.15.114:0/2922441342 conn(0x7f96f00a8490 msgr2=0x7f96f006da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 -- 172.21.15.114:0/2922441342 shutdown_connections 2024-02-17T12:19:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:43.240+0000 7f96f5200640 1 -- 172.21.15.114:0/2922441342 wait complete. 2024-02-17T12:19:43.263 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-02-17T12:19:43.263 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-17T12:19:43.263 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi116.front.sepia.ceph.com 2024-02-17T12:19:43.263 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-02-17T12:19:43.263 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:43.263 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-02-17T12:19:43.263 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-17T12:19:43.263 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.Cj2bMCofXE 2024-02-17T12:19:43.263 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-02-17T12:19:43.274 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.32u4vviwLz 2024-02-17T12:19:43.275 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /tmp/tmp.Cj2bMCofXE /tmp/tmp.32u4vviwLz 2024-02-17T12:19:43.339 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.32u4vviwLz 2024-02-17T12:19:43.461 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.32u4vviwLz is 226B 2024-02-17T12:19:43.478 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.32u4vviwLz 2024-02-17T12:19:43.488 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-02-17T12:19:43.488 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:19:43.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:43.488 DEBUG:teuthology.orchestra.run.smithi116:> ip addr 2024-02-17T12:19:43.538 INFO:teuthology.orchestra.run.smithi116.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-17T12:19:43.538 INFO:teuthology.orchestra.run.smithi116.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout: inet 127.0.0.1/8 scope host lo 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 ::1/128 scope host 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:90 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f0 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:d8:cb:91 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout: altname enp7s0f1 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:66 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-17T12:19:43.539 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0c:c4:7a:8f:3f:67 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:43.540 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.21.15.116/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-02-17T12:19:43.540 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft 42132sec preferred_lft 42132sec 2024-02-17T12:19:43.540 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::ec4:7aff:fe8f:3f67/64 scope link 2024-02-17T12:19:43.540 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:43.540 INFO:teuthology.orchestra.run.smithi116.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-02-17T12:19:43.540 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 02:42:58:59:74:79 brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:43.540 INFO:teuthology.orchestra.run.smithi116.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-02-17T12:19:43.540 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:43.540 INFO:teuthology.orchestra.run.smithi116.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-17T12:19:43.540 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-02-17T12:19:43.541 INFO:teuthology.orchestra.run.smithi116.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-17T12:19:43.541 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:43.541 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-02-17T12:19:43.541 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:43.541 INFO:teuthology.orchestra.run.smithi116.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-17T12:19:43.541 INFO:teuthology.orchestra.run.smithi116.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T12:19:43.541 INFO:teuthology.orchestra.run.smithi116.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-02-17T12:19:43.541 INFO:teuthology.orchestra.run.smithi116.stdout: valid_lft forever preferred_lft forever 2024-02-17T12:19:43.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:43.542 DEBUG:teuthology.orchestra.run.smithi116:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-17T12:19:43.604 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-02-17T12:19:43.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:43.607 DEBUG:teuthology.orchestra.run.smithi116:> route 2024-02-17T12:19:43.661 INFO:teuthology.orchestra.run.smithi116.stdout:Kernel IP routing table 2024-02-17T12:19:43.661 INFO:teuthology.orchestra.run.smithi116.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-17T12:19:43.661 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-02-17T12:19:43.661 INFO:teuthology.orchestra.run.smithi116.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-17T12:19:43.661 INFO:teuthology.orchestra.run.smithi116.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-02-17T12:19:43.661 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-17T12:19:43.661 INFO:teuthology.orchestra.run.smithi116.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:43.661 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:43.661 INFO:teuthology.orchestra.run.smithi116.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-02-17T12:19:43.661 INFO:teuthology.orchestra.run.smithi116.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-17T12:19:43.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:43.662 DEBUG:teuthology.orchestra.run.smithi116:> (cd / && exec bash -c ' 2024-02-17T12:19:43.662 DEBUG:teuthology.orchestra.run.smithi116:> set -e 2024-02-17T12:19:43.662 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-17T12:19:43.662 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-17T12:19:43.662 DEBUG:teuthology.orchestra.run.smithi116:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-17T12:19:43.662 DEBUG:teuthology.orchestra.run.smithi116:> ') 2024-02-17T12:19:43.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:43.757 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-17T12:19:43.766 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-17T12:19:43.766 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:19:43.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:43.766 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link set brx.0 up 2024-02-17T12:19:43.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:19:43.830 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:43.882 INFO:teuthology.orchestra.run.smithi116.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-17T12:19:43.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-17T12:19:43.882 DEBUG:teuthology.orchestra.run.smithi116:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:43.933 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:43.933 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/tmp/tmp.Cj2bMCofXE of=/dev/stdout 2024-02-17T12:19:43.981 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-17T12:19:43.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:43.982 DEBUG:teuthology.orchestra.run.smithi116:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:19:44.075 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,secret=AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:19:44.076 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-02-17T12:19:44.076 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:19:44.076 INFO:teuthology.orchestra.run.smithi116.stdout:keyring.get_secret failed 2024-02-17T12:19:44.091 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,secret=AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:19:44.092 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-02-17T12:19:44.092 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:19:44.092 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:19:44.092 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:19:44.092 INFO:teuthology.orchestra.run.smithi116.stdout:keyring.get_secret failed 2024-02-17T12:19:44.100 INFO:teuthology.orchestra.run.smithi116.stdout:parsing options: rw,norequire_active_mds,secret=AQBXpNBlQ+76MRAAoYMSGuMI9LS5woEvz+rITg==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2024-02-17T12:19:44.101 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2024-02-17T12:19:44.101 INFO:teuthology.orchestra.run.smithi116.stdout:invalid new device string format 2024-02-17T12:19:44.101 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.116:3300,172.21.15.116:3301" 2024-02-17T12:19:44.101 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-17T12:19:44.101 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790" 2024-02-17T12:19:44.101 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.116:6789,172.21.15.116:6790:/ 2024-02-17T12:19:44.101 INFO:teuthology.orchestra.run.smithi116.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=718e3165-e11b-4138-adc9-584dcfeb6e24" will pass to kernel 2024-02-17T12:19:44.105 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-17T12:19:44.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:44.105 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:44.122 INFO:teuthology.orchestra.run.smithi116.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2024-02-17T12:19:44.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:19:44.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:44.124 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-17T12:19:44.176 INFO:teuthology.orchestra.run.smithi116.stdout:client6999 2024-02-17T12:19:44.177 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:44.177 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:44.225 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2024-02-17T12:19:44.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:44.225 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2024-02-17T12:19:44.235 INFO:teuthology.orchestra.run.smithi114.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2024-02-17T12:19:44.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:19:44.236 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:44.236 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:44.285 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:44.286 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:44.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:44.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.520+0000 7f257fe00640 1 Processor -- start 2024-02-17T12:19:44.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.520+0000 7f257fe00640 1 -- start start 2024-02-17T12:19:44.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.520+0000 7f257fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2578152c50 0x7f25781530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:44.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.520+0000 7f257fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2578156270 con 0x7f257806db50 2024-02-17T12:19:44.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.520+0000 7f257fe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2578156550 con 0x7f25780c25a0 2024-02-17T12:19:44.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f257fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257806f090 con 0x7f2578152c50 2024-02-17T12:19:44.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f257ca00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f257806db50 0x7f257814ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34116/0 (socket says 172.21.15.114:34116) 2024-02-17T12:19:44.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f257ca00640 1 -- 172.21.15.114:0/588640902 learned_addr learned my addr 172.21.15.114:0/588640902 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:44.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f257de00640 1 --2- 172.21.15.114:0/588640902 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2578152c50 0x7f25781530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:44.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f2577e00640 1 -- 172.21.15.114:0/588640902 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856611097 0 0) 0x7f2578156270 con 0x7f257806db50 2024-02-17T12:19:44.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f2577e00640 1 -- 172.21.15.114:0/588640902 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2560003530 con 0x7f257806db50 2024-02-17T12:19:44.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f2577e00640 1 -- 172.21.15.114:0/588640902 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173290001 0 0) 0x7f2578156550 con 0x7f25780c25a0 2024-02-17T12:19:44.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f2577e00640 1 -- 172.21.15.114:0/588640902 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2578156270 con 0x7f25780c25a0 2024-02-17T12:19:44.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f257de00640 1 -- 172.21.15.114:0/588640902 >> v1:172.21.15.116:6789/0 conn(0x7f25780c25a0 legacy=0x7f257806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f257de00640 1 -- 172.21.15.114:0/588640902 >> v1:172.21.15.114:6789/0 conn(0x7f257806db50 legacy=0x7f257814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f257de00640 1 -- 172.21.15.114:0/588640902 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578156830 con 0x7f2578152c50 2024-02-17T12:19:44.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.524+0000 7f257de00640 1 --2- 172.21.15.114:0/588640902 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2578152c50 0x7f25781530c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f25700097f0 tx=0x7f257001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6ff196e6fc3ae57 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:44.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f2577e00640 1 -- 172.21.15.114:0/588640902 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700ab600 con 0x7f2578152c50 2024-02-17T12:19:44.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f2577e00640 1 -- 172.21.15.114:0/588640902 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25700a7050 con 0x7f2578152c50 2024-02-17T12:19:44.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f2577e00640 1 -- 172.21.15.114:0/588640902 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700ab960 con 0x7f2578152c50 2024-02-17T12:19:44.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 -- 172.21.15.114:0/588640902 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2578152c50 msgr2=0x7f25781530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 --2- 172.21.15.114:0/588640902 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2578152c50 0x7f25781530c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f25700097f0 tx=0x7f257001c3c0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 -- 172.21.15.114:0/588640902 shutdown_connections 2024-02-17T12:19:44.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 --2- 172.21.15.114:0/588640902 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2578152c50 0x7f25781530c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 -- 172.21.15.114:0/588640902 >> 172.21.15.114:0/588640902 conn(0x7f25780a8490 msgr2=0x7f25780a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:44.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 -- 172.21.15.114:0/588640902 shutdown_connections 2024-02-17T12:19:44.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 -- 172.21.15.114:0/588640902 wait complete. 2024-02-17T12:19:44.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 Processor -- start 2024-02-17T12:19:44.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 -- start start 2024-02-17T12:19:44.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f257806db50 0x7f257813f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:44.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780c25a0 0x7f257806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:44.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2578152c50 0x7f25781ed400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:44.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257813fe90 con 0x7f25780c25a0 2024-02-17T12:19:44.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257814f9a0 con 0x7f2578152c50 2024-02-17T12:19:44.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257814dd40 con 0x7f257806db50 2024-02-17T12:19:44.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780c25a0 0x7f257806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780c25a0 0x7f257806ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32832/0 (socket says 172.21.15.114:32832) 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257ca00640 1 -- 172.21.15.114:0/1315198618 learned_addr learned my addr 172.21.15.114:0/1315198618 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257de00640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2578152c50 0x7f25781ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257d400640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f257806db50 0x7f257813f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257ca00640 1 -- 172.21.15.114:0/1315198618 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f257806db50 msgr2=0x7f257813f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257ca00640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f257806db50 0x7f257813f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257ca00640 1 -- 172.21.15.114:0/1315198618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2578152c50 msgr2=0x7f25781ed400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257ca00640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2578152c50 0x7f25781ed400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.528+0000 7f257ca00640 1 -- 172.21.15.114:0/1315198618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009420 con 0x7f25780c25a0 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f257ca00640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780c25a0 0x7f257806ac10 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f256400c530 tx=0x7f256400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f2575600640 1 -- 172.21.15.114:0/1315198618 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564005cf0 con 0x7f25780c25a0 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f2575600640 1 -- 172.21.15.114:0/1315198618 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2564005e50 con 0x7f25780c25a0 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f257fe00640 1 -- 172.21.15.114:0/1315198618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257814f510 con 0x7f25780c25a0 2024-02-17T12:19:44.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f2575600640 1 -- 172.21.15.114:0/1315198618 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564007290 con 0x7f25780c25a0 2024-02-17T12:19:44.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f257fe00640 1 -- 172.21.15.114:0/1315198618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25781f16b0 con 0x7f25780c25a0 2024-02-17T12:19:44.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f257fe00640 1 -- 172.21.15.114:0/1315198618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257814f6a0 con 0x7f25780c25a0 2024-02-17T12:19:44.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f2575600640 1 -- 172.21.15.114:0/1315198618 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f25640073f0 con 0x7f25780c25a0 2024-02-17T12:19:44.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f2575600640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2558066e40 0x7f2558069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:44.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f2575600640 1 -- 172.21.15.114:0/1315198618 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2564084350 con 0x7f25780c25a0 2024-02-17T12:19:44.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.532+0000 7f257d400640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2558066e40 0x7f2558069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:44.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.536+0000 7f257d400640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2558066e40 0x7f2558069300 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f256c007fd0 tx=0x7f256c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:44.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.536+0000 7f2575600640 1 -- 172.21.15.114:0/1315198618 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2564050df0 con 0x7f25780c25a0 2024-02-17T12:19:44.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.692+0000 7f257fe00640 1 -- 172.21.15.114:0/1315198618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2578074840 con 0x7f25780c25a0 2024-02-17T12:19:44.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f2575600640 1 -- 172.21.15.114:0/1315198618 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20392 (secure 0 0 0) 0x7f25640544b0 con 0x7f25780c25a0 2024-02-17T12:19:44.698 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:44.698 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:23.364663+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:44.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 -- 172.21.15.114:0/1315198618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2558066e40 msgr2=0x7f2558069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2558066e40 0x7f2558069300 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f256c007fd0 tx=0x7f256c009040 comp rx=0 tx=0).stop 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 -- 172.21.15.114:0/1315198618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780c25a0 msgr2=0x7f257806ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780c25a0 0x7f257806ac10 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f256400c530 tx=0x7f256400c9f0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 -- 172.21.15.114:0/1315198618 shutdown_connections 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2578152c50 0x7f25781ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2558066e40 0x7f2558069300 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25780c25a0 0x7f257806ac10 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 --2- 172.21.15.114:0/1315198618 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f257806db50 0x7f257813f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 -- 172.21.15.114:0/1315198618 >> 172.21.15.114:0/1315198618 conn(0x7f25780a8490 msgr2=0x7f25780c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 -- 172.21.15.114:0/1315198618 shutdown_connections 2024-02-17T12:19:44.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.696+0000 7f257fe00640 1 -- 172.21.15.114:0/1315198618 wait complete. 2024-02-17T12:19:44.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:19:01.796651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:19:03.070707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:19:19.573884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:19:20.731260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:19:44.722 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:19:44.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.856+0000 7fd6ec400640 1 Processor -- start 2024-02-17T12:19:44.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.856+0000 7fd6ec400640 1 -- start start 2024-02-17T12:19:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6ec400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 0x7fd6e40aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6ec400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e40a9420 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6ec400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e4152850 con 0x7fd6e414f110 2024-02-17T12:19:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6ec400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e414f4f0 con 0x7fd6e40c2580 2024-02-17T12:19:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6ea400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd6e40c1eb0 0x7fd6e415c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34126/0 (socket says 172.21.15.114:34126) 2024-02-17T12:19:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6ea400640 1 -- 172.21.15.114:0/2291150202 learned_addr learned my addr 172.21.15.114:0/2291150202 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6e9000640 1 --2- 172.21.15.114:0/2291150202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 0x7fd6e40aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6e3e00640 1 -- 172.21.15.114:0/2291150202 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102508313 0 0) 0x7fd6e40a9420 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6e3e00640 1 -- 172.21.15.114:0/2291150202 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6cc005740 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6e3e00640 1 -- 172.21.15.114:0/2291150202 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202791712 0 0) 0x7fd6e4152850 con 0x7fd6e414f110 2024-02-17T12:19:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6e3e00640 1 -- 172.21.15.114:0/2291150202 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e40a9420 con 0x7fd6e414f110 2024-02-17T12:19:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6e9000640 1 -- 172.21.15.114:0/2291150202 >> v1:172.21.15.116:6789/0 conn(0x7fd6e414f110 legacy=0x7fd6e40c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6e9000640 1 -- 172.21.15.114:0/2291150202 >> v1:172.21.15.114:6789/0 conn(0x7fd6e40c1eb0 legacy=0x7fd6e415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.860+0000 7fd6e9000640 1 -- 172.21.15.114:0/2291150202 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40a9670 con 0x7fd6e40c2580 2024-02-17T12:19:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6e9000640 1 --2- 172.21.15.114:0/2291150202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 0x7fd6e40aa150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00097f0 tx=0x7fd6d001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ecf6ef90dc22f11 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6e3e00640 1 -- 172.21.15.114:0/2291150202 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00ab600 con 0x7fd6e40c2580 2024-02-17T12:19:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6e3e00640 1 -- 172.21.15.114:0/2291150202 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d00a7050 con 0x7fd6e40c2580 2024-02-17T12:19:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6e3e00640 1 -- 172.21.15.114:0/2291150202 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00ab980 con 0x7fd6e40c2580 2024-02-17T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 -- 172.21.15.114:0/2291150202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 msgr2=0x7fd6e40aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 --2- 172.21.15.114:0/2291150202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 0x7fd6e40aa150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00097f0 tx=0x7fd6d001c450 comp rx=0 tx=0).stop 2024-02-17T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 -- 172.21.15.114:0/2291150202 shutdown_connections 2024-02-17T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 --2- 172.21.15.114:0/2291150202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 0x7fd6e40aa150 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 -- 172.21.15.114:0/2291150202 >> 172.21.15.114:0/2291150202 conn(0x7fd6e40a8490 msgr2=0x7fd6e40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 -- 172.21.15.114:0/2291150202 shutdown_connections 2024-02-17T12:19:44.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 -- 172.21.15.114:0/2291150202 wait complete. 2024-02-17T12:19:44.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 Processor -- start 2024-02-17T12:19:44.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 -- start start 2024-02-17T12:19:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e40c1eb0 0x7fd6e41f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 0x7fd6e414df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6e414f110 0x7fd6e41399e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e41f20d0 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e41edc50 con 0x7fd6e414f110 2024-02-17T12:19:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.864+0000 7fd6ec400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e41edf10 con 0x7fd6e40c2580 2024-02-17T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e40c1eb0 0x7fd6e41f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e40c1eb0 0x7fd6e41f1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:32840/0 (socket says 172.21.15.114:32840) 2024-02-17T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e9a00640 1 -- 172.21.15.114:0/2818807437 learned_addr learned my addr 172.21.15.114:0/2818807437 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6ea400640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6e414f110 0x7fd6e41399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e9000640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 0x7fd6e414df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e9a00640 1 -- 172.21.15.114:0/2818807437 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 msgr2=0x7fd6e414df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e9a00640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 0x7fd6e414df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e9a00640 1 -- 172.21.15.114:0/2818807437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6e414f110 msgr2=0x7fd6e41399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e9a00640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6e414f110 0x7fd6e41399e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e9a00640 1 -- 172.21.15.114:0/2818807437 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0009420 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e9a00640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e40c1eb0 0x7fd6e41f1b90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c770 tx=0x7fd6d800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:44.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e1600640 1 -- 172.21.15.114:0/2818807437 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8003b80 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e1600640 1 -- 172.21.15.114:0/2818807437 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d8003ce0 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6ec400640 1 -- 172.21.15.114:0/2818807437 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e41ee1f0 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e1600640 1 -- 172.21.15.114:0/2818807437 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800aa90 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6ec400640 1 -- 172.21.15.114:0/2818807437 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e41ee7b0 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6ec400640 1 -- 172.21.15.114:0/2818807437 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e4074840 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e1600640 1 -- 172.21.15.114:0/2818807437 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd6d800abf0 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.868+0000 7fd6e1600640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd6c4066e40 0x7fd6c4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:44.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.872+0000 7fd6e1600640 1 -- 172.21.15.114:0/2818807437 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd6d8084b40 con 0x7fd6e40c1eb0 2024-02-17T12:19:44.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.872+0000 7fd6e9000640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd6c4066e40 0x7fd6c4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:44.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.872+0000 7fd6e9000640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd6c4066e40 0x7fd6c4069300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00ad000 tx=0x7fd6d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:44.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:44.872+0000 7fd6e1600640 1 -- 172.21.15.114:0/2818807437 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd6d8051670 con 0x7fd6e40c1eb0 2024-02-17T12:19:45.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 -- 172.21.15.114:0/2818807437 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6e40c1380 con 0x7fd6e40c1eb0 2024-02-17T12:19:45.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6e1600640 1 -- 172.21.15.114:0/2818807437 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6d8054d30 con 0x7fd6e40c1eb0 2024-02-17T12:19:45.035 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:19:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 -- 172.21.15.114:0/2818807437 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd6c4066e40 msgr2=0x7fd6c4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd6c4066e40 0x7fd6c4069300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00ad000 tx=0x7fd6d0008040 comp rx=0 tx=0).stop 2024-02-17T12:19:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 -- 172.21.15.114:0/2818807437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e40c1eb0 msgr2=0x7fd6e41f1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e40c1eb0 0x7fd6e41f1b90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c770 tx=0x7fd6d800cc30 comp rx=0 tx=0).stop 2024-02-17T12:19:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 -- 172.21.15.114:0/2818807437 shutdown_connections 2024-02-17T12:19:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6e414f110 0x7fd6e41399e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd6e40c2580 0x7fd6e414df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd6c4066e40 0x7fd6c4069300 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 --2- 172.21.15.114:0/2818807437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e40c1eb0 0x7fd6e41f1b90 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 -- 172.21.15.114:0/2818807437 >> 172.21.15.114:0/2818807437 conn(0x7fd6e40a8490 msgr2=0x7fd6e40a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:45.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 -- 172.21.15.114:0/2818807437 shutdown_connections 2024-02-17T12:19:45.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.032+0000 7fd6ec400640 1 -- 172.21.15.114:0/2818807437 wait complete. 2024-02-17T12:19:45.056 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:19:45.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f867a600640 1 Processor -- start 2024-02-17T12:19:45.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f867a600640 1 -- start start 2024-02-17T12:19:45.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f867a600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8674158e00 0x7f86740c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f867a600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86740723b0 con 0x7f8674152560 2024-02-17T12:19:45.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f867a600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8674154dc0 con 0x7f8674072b20 2024-02-17T12:19:45.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f867a600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8674070000 con 0x7f8674158e00 2024-02-17T12:19:45.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8673400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8674152560 0x7f86740c4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37190/0 (socket says 172.21.15.114:37190) 2024-02-17T12:19:45.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8673400640 1 -- 172.21.15.114:0/3999562479 learned_addr learned my addr 172.21.15.114:0/3999562479 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:45.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578816036 0 0) 0x7f86740723b0 con 0x7f8674152560 2024-02-17T12:19:45.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8658003530 con 0x7f8674152560 2024-02-17T12:19:45.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8673e00640 1 --2- 172.21.15.114:0/3999562479 >> v2:172.21.15.116:3300/0 conn(0x7f8674158e00 0x7f86740c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1631367044 0 0) 0x7f8658003530 con 0x7f8674152560 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 >> v2:172.21.15.116:3300/0 conn(0x7f8674158e00 msgr2=0x7f86740c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 --2- 172.21.15.114:0/3999562479 >> v2:172.21.15.116:3300/0 conn(0x7f8674158e00 0x7f86740c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 >> v1:172.21.15.116:6789/0 conn(0x7f8674072b20 legacy=0x7f86741586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740728e0 con 0x7f8674152560 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f8664001a00 con 0x7f8674152560 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 >> v1:172.21.15.114:6789/0 conn(0x7f8674152560 legacy=0x7f86740c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86580039d0 0x7f8658003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86580047d0 0x7f8658004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86580052b0 0x7f865800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8674070000 con 0x7f86580052b0 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865800c1d0 con 0x7f86580047d0 2024-02-17T12:19:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865800c390 con 0x7f86580039d0 2024-02-17T12:19:45.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8673e00640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86580052b0 0x7f865800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8673400640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86580039d0 0x7f8658003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8672a00640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86580047d0 0x7f8658004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8673e00640 1 -- 172.21.15.114:0/3999562479 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86580039d0 msgr2=0x7f8658003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:45.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8673e00640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86580039d0 0x7f8658003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8673e00640 1 -- 172.21.15.114:0/3999562479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86580047d0 msgr2=0x7f8658004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:45.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8673e00640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86580047d0 0x7f8658004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.192+0000 7f8673e00640 1 -- 172.21.15.114:0/3999562479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658003530 con 0x7f86580052b0 2024-02-17T12:19:45.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f8673e00640 1 -- 172.21.15.114:0/3999562479 reap_dead start 2024-02-17T12:19:45.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f8673e00640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86580052b0 0x7f865800b990 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f866c00ba30 tx=0x7f866c01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b08993cf6ff1bd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c004220 con 0x7f86580052b0 2024-02-17T12:19:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c004380 con 0x7f86580052b0 2024-02-17T12:19:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f8672000640 1 -- 172.21.15.114:0/3999562479 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c003860 con 0x7f86580052b0 2024-02-17T12:19:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f867a600640 1 -- 172.21.15.114:0/3999562479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86580052b0 msgr2=0x7f865800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f867a600640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86580052b0 0x7f865800b990 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f866c00ba30 tx=0x7f866c01c680 comp rx=0 tx=0).stop 2024-02-17T12:19:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f867a600640 1 -- 172.21.15.114:0/3999562479 shutdown_connections 2024-02-17T12:19:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f867a600640 1 --2- 172.21.15.114:0/3999562479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86580052b0 0x7f865800b990 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f867a600640 1 -- 172.21.15.114:0/3999562479 >> 172.21.15.114:0/3999562479 conn(0x7f867406bef0 msgr2=0x7f867406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f867a600640 1 -- 172.21.15.114:0/3999562479 shutdown_connections 2024-02-17T12:19:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.196+0000 7f867a600640 1 -- 172.21.15.114:0/3999562479 wait complete. 2024-02-17T12:19:45.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 Processor -- start 2024-02-17T12:19:45.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 -- start start 2024-02-17T12:19:45.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86580052b0 0x7f86740c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86740c64b0 0x7f86740ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867414d4e0 0x7f867414d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86740c7a70 con 0x7f867414d4e0 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86740ac720 con 0x7f86740c64b0 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86740c5280 con 0x7f86580052b0 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867414d4e0 0x7f867414d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867414d4e0 0x7f867414d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35468/0 (socket says 172.21.15.114:35468) 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673e00640 1 -- 172.21.15.114:0/2005228881 learned_addr learned my addr 172.21.15.114:0/2005228881 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673400640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86580052b0 0x7f86740c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8672a00640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86740c64b0 0x7f86740ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673e00640 1 -- 172.21.15.114:0/2005228881 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86580052b0 msgr2=0x7f86740c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673e00640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86580052b0 0x7f86740c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673e00640 1 -- 172.21.15.114:0/2005228881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86740c64b0 msgr2=0x7f86740ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673e00640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86740c64b0 0x7f86740ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673e00640 1 -- 172.21.15.114:0/2005228881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740ac340 con 0x7f867414d4e0 2024-02-17T12:19:45.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8672a00640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86740c64b0 0x7f86740ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673400640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86580052b0 0x7f86740c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f8673e00640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867414d4e0 0x7f867414d940 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f866c01c4b0 tx=0x7f8658005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f866b400640 1 -- 172.21.15.114:0/2005228881 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c0a9e70 con 0x7f867414d4e0 2024-02-17T12:19:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f866b400640 1 -- 172.21.15.114:0/2005228881 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c0b4480 con 0x7f867414d4e0 2024-02-17T12:19:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f866b400640 1 -- 172.21.15.114:0/2005228881 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c0b47f0 con 0x7f867414d4e0 2024-02-17T12:19:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 -- 172.21.15.114:0/2005228881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86740abaf0 con 0x7f867414d4e0 2024-02-17T12:19:45.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 -- 172.21.15.114:0/2005228881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86740c5730 con 0x7f867414d4e0 2024-02-17T12:19:45.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.200+0000 7f867a600640 1 -- 172.21.15.114:0/2005228881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8674067370 con 0x7f867414d4e0 2024-02-17T12:19:45.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.204+0000 7f866b400640 1 -- 172.21.15.114:0/2005228881 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f866c0b4950 con 0x7f867414d4e0 2024-02-17T12:19:45.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.204+0000 7f866b400640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8654066e40 0x7f8654069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.204+0000 7f866b400640 1 -- 172.21.15.114:0/2005228881 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f866c11f580 con 0x7f867414d4e0 2024-02-17T12:19:45.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.204+0000 7f8673400640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8654066e40 0x7f8654069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.204+0000 7f8673400640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8654066e40 0x7f8654069300 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f86640013e0 tx=0x7f8664009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:45.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.208+0000 7f866b400640 1 -- 172.21.15.114:0/2005228881 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f866c0ec000 con 0x7f867414d4e0 2024-02-17T12:19:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 -- 172.21.15.114:0/2005228881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86740c53c0 con 0x7f867414d4e0 2024-02-17T12:19:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f866b400640 1 -- 172.21.15.114:0/2005228881 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86740c53c0 con 0x7f867414d4e0 2024-02-17T12:19:45.367 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:45.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 -- 172.21.15.114:0/2005228881 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8654066e40 msgr2=0x7f8654069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8654066e40 0x7f8654069300 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f86640013e0 tx=0x7f8664009040 comp rx=0 tx=0).stop 2024-02-17T12:19:45.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 -- 172.21.15.114:0/2005228881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867414d4e0 msgr2=0x7f867414d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867414d4e0 0x7f867414d940 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f866c01c4b0 tx=0x7f8658005800 comp rx=0 tx=0).stop 2024-02-17T12:19:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 -- 172.21.15.114:0/2005228881 shutdown_connections 2024-02-17T12:19:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f8654066e40 0x7f8654069300 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f867414d4e0 0x7f867414d940 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86740c64b0 0x7f86740ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 --2- 172.21.15.114:0/2005228881 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86580052b0 0x7f86740c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 -- 172.21.15.114:0/2005228881 >> 172.21.15.114:0/2005228881 conn(0x7f867406bef0 msgr2=0x7f8674151ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 -- 172.21.15.114:0/2005228881 shutdown_connections 2024-02-17T12:19:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.364+0000 7f867a600640 1 -- 172.21.15.114:0/2005228881 wait complete. 2024-02-17T12:19:45.389 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:19:45.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f0807600640 1 Processor -- start 2024-02-17T12:19:45.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f0807600640 1 -- start start 2024-02-17T12:19:45.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f0807600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f080006ef50 0x7f08000ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f0807600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08001519b0 0x7f080006dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f0807600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08000aa150 con 0x7f080014e9b0 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f0807600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080014ed90 con 0x7f080006ef50 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f0807600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08000c1e90 con 0x7f08001519b0 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f07ffe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f080006ef50 0x7f08000ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f07ffe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f080006ef50 0x7f08000ab5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35480/0 (socket says 172.21.15.114:35480) 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f07ffe00640 1 -- 172.21.15.114:0/1386183798 learned_addr learned my addr 172.21.15.114:0/1386183798 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f0805600640 1 --2- 172.21.15.114:0/1386183798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08001519b0 0x7f080006dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f07ffe00640 1 -- 172.21.15.114:0/1386183798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08001519b0 msgr2=0x7f080006dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f07ffe00640 1 --2- 172.21.15.114:0/1386183798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08001519b0 0x7f080006dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f07ffe00640 1 -- 172.21.15.114:0/1386183798 >> v1:172.21.15.116:6789/0 conn(0x7f080014e9b0 legacy=0x7f08001512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f07ffe00640 1 -- 172.21.15.114:0/1386183798 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800152000 con 0x7f080006ef50 2024-02-17T12:19:45.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.524+0000 7f0805600640 1 --2- 172.21.15.114:0/1386183798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08001519b0 0x7f080006dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:45.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f07ffe00640 1 --2- 172.21.15.114:0/1386183798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f080006ef50 0x7f08000ab5d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009870 tx=0x7f07ec01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a483b52373c63cb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:45.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f07ff400640 1 -- 172.21.15.114:0/1386183798 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0ab5f0 con 0x7f080006ef50 2024-02-17T12:19:45.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f07ff400640 1 -- 172.21.15.114:0/1386183798 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0ab750 con 0x7f080006ef50 2024-02-17T12:19:45.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f07ff400640 1 -- 172.21.15.114:0/1386183798 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0abae0 con 0x7f080006ef50 2024-02-17T12:19:45.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f0807600640 1 -- 172.21.15.114:0/1386183798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f080006ef50 msgr2=0x7f08000ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f0807600640 1 --2- 172.21.15.114:0/1386183798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f080006ef50 0x7f08000ab5d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009870 tx=0x7f07ec01c560 comp rx=0 tx=0).stop 2024-02-17T12:19:45.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f0807600640 1 -- 172.21.15.114:0/1386183798 shutdown_connections 2024-02-17T12:19:45.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f0807600640 1 --2- 172.21.15.114:0/1386183798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08001519b0 0x7f080006dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f0807600640 1 --2- 172.21.15.114:0/1386183798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f080006ef50 0x7f08000ab5d0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f0807600640 1 -- 172.21.15.114:0/1386183798 >> 172.21.15.114:0/1386183798 conn(0x7f08000a8490 msgr2=0x7f08000a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:45.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f0807600640 1 -- 172.21.15.114:0/1386183798 shutdown_connections 2024-02-17T12:19:45.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.528+0000 7f0807600640 1 -- 172.21.15.114:0/1386183798 wait complete. 2024-02-17T12:19:45.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 Processor -- start 2024-02-17T12:19:45.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 -- start start 2024-02-17T12:19:45.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f080014e9b0 0x7f080014fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08001519b0 0x7f080014b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0800150330 0x7f0800147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08001557b0 con 0x7f08001519b0 2024-02-17T12:19:45.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0800153ce0 con 0x7f0800150330 2024-02-17T12:19:45.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0800150190 con 0x7f080014e9b0 2024-02-17T12:19:45.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08001519b0 0x7f080014b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08001519b0 0x7f080014b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35496/0 (socket says 172.21.15.114:35496) 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07ffe00640 1 -- 172.21.15.114:0/1044655599 learned_addr learned my addr 172.21.15.114:0/1044655599 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0804c00640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f080014e9b0 0x7f080014fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0805600640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0800150330 0x7f0800147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07ffe00640 1 -- 172.21.15.114:0/1044655599 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f080014e9b0 msgr2=0x7f080014fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07ffe00640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f080014e9b0 0x7f080014fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07ffe00640 1 -- 172.21.15.114:0/1044655599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0800150330 msgr2=0x7f0800147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07ffe00640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0800150330 0x7f0800147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07ffe00640 1 -- 172.21.15.114:0/1044655599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0094d0 con 0x7f08001519b0 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0805600640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0800150330 0x7f0800147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07ffe00640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08001519b0 0x7f080014b650 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f07ec01ca40 tx=0x7f07ec01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07fcc00640 1 -- 172.21.15.114:0/1044655599 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0be5f0 con 0x7f08001519b0 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07fcc00640 1 -- 172.21.15.114:0/1044655599 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0be750 con 0x7f08001519b0 2024-02-17T12:19:45.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f07fcc00640 1 -- 172.21.15.114:0/1044655599 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0beb00 con 0x7f08001519b0 2024-02-17T12:19:45.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 -- 172.21.15.114:0/1044655599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0800150ff0 con 0x7f08001519b0 2024-02-17T12:19:45.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 -- 172.21.15.114:0/1044655599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0800155440 con 0x7f08001519b0 2024-02-17T12:19:45.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.532+0000 7f0807600640 1 -- 172.21.15.114:0/1044655599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0800074840 con 0x7f08001519b0 2024-02-17T12:19:45.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.536+0000 7f07fcc00640 1 -- 172.21.15.114:0/1044655599 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f07ec0b43f0 con 0x7f08001519b0 2024-02-17T12:19:45.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.536+0000 7f07fcc00640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07e0066e40 0x7f07e0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.536+0000 7f07fcc00640 1 -- 172.21.15.114:0/1044655599 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f07ec0a8050 con 0x7f08001519b0 2024-02-17T12:19:45.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.536+0000 7f0804c00640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07e0066e40 0x7f07e0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.536+0000 7f0804c00640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07e0066e40 0x7f07e0069300 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f07f4001650 tx=0x7f07f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:45.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.540+0000 7f07fcc00640 1 -- 172.21.15.114:0/1044655599 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f07ec0ec530 con 0x7f08001519b0 2024-02-17T12:19:45.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.692+0000 7f0807600640 1 -- 172.21.15.114:0/1044655599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f080015b9c0 con 0x7f08001519b0 2024-02-17T12:19:45.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f07fcc00640 1 -- 172.21.15.114:0/1044655599 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07ec0efbf0 con 0x7f08001519b0 2024-02-17T12:19:45.700 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:45.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 -- 172.21.15.114:0/1044655599 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07e0066e40 msgr2=0x7f07e0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07e0066e40 0x7f07e0069300 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f07f4001650 tx=0x7f07f4009040 comp rx=0 tx=0).stop 2024-02-17T12:19:45.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 -- 172.21.15.114:0/1044655599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08001519b0 msgr2=0x7f080014b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08001519b0 0x7f080014b650 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f07ec01ca40 tx=0x7f07ec01ada0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 -- 172.21.15.114:0/1044655599 shutdown_connections 2024-02-17T12:19:45.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0800150330 0x7f0800147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f07e0066e40 0x7f07e0069300 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08001519b0 0x7f080014b650 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 --2- 172.21.15.114:0/1044655599 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f080014e9b0 0x7f080014fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 -- 172.21.15.114:0/1044655599 >> 172.21.15.114:0/1044655599 conn(0x7f08000a8490 msgr2=0x7f08000aa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:45.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 -- 172.21.15.114:0/1044655599 shutdown_connections 2024-02-17T12:19:45.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.696+0000 7f0807600640 1 -- 172.21.15.114:0/1044655599 wait complete. 2024-02-17T12:19:45.718 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:19:45.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.852+0000 7f0a11a00640 1 Processor -- start 2024-02-17T12:19:45.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.852+0000 7f0a11a00640 1 -- start start 2024-02-17T12:19:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a11a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0a0c06db50 0x7f0a0c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a11a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c156270 con 0x7f0a0c150490 2024-02-17T12:19:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a11a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c156550 con 0x7f0a0c0c25a0 2024-02-17T12:19:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a11a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c06f090 con 0x7f0a0c06db50 2024-02-17T12:19:45.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a0b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0a0c150490 0x7f0a0c152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37206/0 (socket says 172.21.15.114:37206) 2024-02-17T12:19:45.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a0b400640 1 -- 172.21.15.114:0/2397979291 learned_addr learned my addr 172.21.15.114:0/2397979291 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:45.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a0a000640 1 --2- 172.21.15.114:0/2397979291 >> v2:172.21.15.116:3300/0 conn(0x7f0a0c06db50 0x7f0a0c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a09600640 1 -- 172.21.15.114:0/2397979291 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286295255 0 0) 0x7f0a0c156270 con 0x7f0a0c150490 2024-02-17T12:19:45.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a09600640 1 -- 172.21.15.114:0/2397979291 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f0003530 con 0x7f0a0c150490 2024-02-17T12:19:45.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a09600640 1 -- 172.21.15.114:0/2397979291 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988583164 0 0) 0x7f0a0c156550 con 0x7f0a0c0c25a0 2024-02-17T12:19:45.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a09600640 1 -- 172.21.15.114:0/2397979291 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a0c156270 con 0x7f0a0c0c25a0 2024-02-17T12:19:45.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a0a000640 1 -- 172.21.15.114:0/2397979291 >> v1:172.21.15.116:6789/0 conn(0x7f0a0c0c25a0 legacy=0x7f0a0c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a0a000640 1 -- 172.21.15.114:0/2397979291 >> v1:172.21.15.114:6789/0 conn(0x7f0a0c150490 legacy=0x7f0a0c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.856+0000 7f0a0a000640 1 -- 172.21.15.114:0/2397979291 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c156830 con 0x7f0a0c06db50 2024-02-17T12:19:45.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a0a000640 1 --2- 172.21.15.114:0/2397979291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a0c06db50 0x7f0a0c14ff50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f09f80097c0 tx=0x7f09f801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35c752688b04bfb server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a09600640 1 -- 172.21.15.114:0/2397979291 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80ab600 con 0x7f0a0c06db50 2024-02-17T12:19:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a09600640 1 -- 172.21.15.114:0/2397979291 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f80a7050 con 0x7f0a0c06db50 2024-02-17T12:19:45.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a09600640 1 -- 172.21.15.114:0/2397979291 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80ab980 con 0x7f0a0c06db50 2024-02-17T12:19:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a11a00640 1 -- 172.21.15.114:0/2397979291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a0c06db50 msgr2=0x7f0a0c14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a11a00640 1 --2- 172.21.15.114:0/2397979291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a0c06db50 0x7f0a0c14ff50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f09f80097c0 tx=0x7f09f801c380 comp rx=0 tx=0).stop 2024-02-17T12:19:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a11a00640 1 -- 172.21.15.114:0/2397979291 shutdown_connections 2024-02-17T12:19:45.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a11a00640 1 --2- 172.21.15.114:0/2397979291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a0c06db50 0x7f0a0c14ff50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a11a00640 1 -- 172.21.15.114:0/2397979291 >> 172.21.15.114:0/2397979291 conn(0x7f0a0c0a8490 msgr2=0x7f0a0c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:45.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a11a00640 1 -- 172.21.15.114:0/2397979291 shutdown_connections 2024-02-17T12:19:45.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a11a00640 1 -- 172.21.15.114:0/2397979291 wait complete. 2024-02-17T12:19:45.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a11a00640 1 Processor -- start 2024-02-17T12:19:45.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.860+0000 7f0a11a00640 1 -- start start 2024-02-17T12:19:45.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a11a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a0c06db50 0x7f0a0c13e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a11a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a0c0c25a0 0x7f0a0c145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a11a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a0c150490 0x7f0a0c13b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a11a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0c5220 con 0x7f0a0c150490 2024-02-17T12:19:45.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a11a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0c5a90 con 0x7f0a0c0c25a0 2024-02-17T12:19:45.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a11a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0c5d30 con 0x7f0a0c06db50 2024-02-17T12:19:45.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a0c150490 0x7f0a0c13b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a0c150490 0x7f0a0c13b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35506/0 (socket says 172.21.15.114:35506) 2024-02-17T12:19:45.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0b400640 1 -- 172.21.15.114:0/3815554293 learned_addr learned my addr 172.21.15.114:0/3815554293 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:45.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0a000640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a0c0c25a0 0x7f0a0c145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0aa00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a0c06db50 0x7f0a0c13e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0b400640 1 -- 172.21.15.114:0/3815554293 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a0c06db50 msgr2=0x7f0a0c13e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0b400640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a0c06db50 0x7f0a0c13e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0b400640 1 -- 172.21.15.114:0/3815554293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a0c0c25a0 msgr2=0x7f0a0c145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:45.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0b400640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a0c0c25a0 0x7f0a0c145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:45.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0b400640 1 -- 172.21.15.114:0/3815554293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f8009420 con 0x7f0a0c150490 2024-02-17T12:19:45.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0aa00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a0c06db50 0x7f0a0c13e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:45.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a0b400640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a0c150490 0x7f0a0c13b8e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400c3c0 tx=0x7f0a0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:45.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a02a00640 1 -- 172.21.15.114:0/3815554293 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04005db0 con 0x7f0a0c150490 2024-02-17T12:19:45.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a02a00640 1 -- 172.21.15.114:0/3815554293 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a040070d0 con 0x7f0a0c150490 2024-02-17T12:19:45.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a11a00640 1 -- 172.21.15.114:0/3815554293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c0c6010 con 0x7f0a0c150490 2024-02-17T12:19:45.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a02a00640 1 -- 172.21.15.114:0/3815554293 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04007480 con 0x7f0a0c150490 2024-02-17T12:19:45.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a11a00640 1 -- 172.21.15.114:0/3815554293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c145030 con 0x7f0a0c150490 2024-02-17T12:19:45.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a11a00640 1 -- 172.21.15.114:0/3815554293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c145280 con 0x7f0a0c150490 2024-02-17T12:19:45.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.864+0000 7f0a02a00640 1 -- 172.21.15.114:0/3815554293 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0a040075e0 con 0x7f0a0c150490 2024-02-17T12:19:45.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.868+0000 7f0a02a00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f09ec066e40 0x7f09ec069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:45.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.868+0000 7f0a02a00640 1 -- 172.21.15.114:0/3815554293 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0a040842d0 con 0x7f0a0c150490 2024-02-17T12:19:45.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.868+0000 7f0a0aa00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f09ec066e40 0x7f09ec069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:45.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.868+0000 7f0a0aa00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f09ec066e40 0x7f09ec069300 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f09fc007fd0 tx=0x7f09fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:45.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:45.872+0000 7f0a02a00640 1 -- 172.21.15.114:0/3815554293 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0a04050e00 con 0x7f0a0c150490 2024-02-17T12:19:46.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.024+0000 7f0a11a00640 1 -- 172.21.15.114:0/3815554293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a0c074840 con 0x7f0a0c150490 2024-02-17T12:19:46.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.024+0000 7f0a02a00640 1 -- 172.21.15.114:0/3815554293 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0a040544c0 con 0x7f0a0c150490 2024-02-17T12:19:46.030 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:46.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 -- 172.21.15.114:0/3815554293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f09ec066e40 msgr2=0x7f09ec069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f09ec066e40 0x7f09ec069300 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f09fc007fd0 tx=0x7f09fc009040 comp rx=0 tx=0).stop 2024-02-17T12:19:46.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 -- 172.21.15.114:0/3815554293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a0c150490 msgr2=0x7f0a0c13b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a0c150490 0x7f0a0c13b8e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400c3c0 tx=0x7f0a0400c880 comp rx=0 tx=0).stop 2024-02-17T12:19:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 -- 172.21.15.114:0/3815554293 shutdown_connections 2024-02-17T12:19:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f09ec066e40 0x7f09ec069300 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a0c150490 0x7f0a0c13b8e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0a0c0c25a0 0x7f0a0c145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 --2- 172.21.15.114:0/3815554293 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0a0c06db50 0x7f0a0c13e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 -- 172.21.15.114:0/3815554293 >> 172.21.15.114:0/3815554293 conn(0x7f0a0c0a8490 msgr2=0x7f0a0c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 -- 172.21.15.114:0/3815554293 shutdown_connections 2024-02-17T12:19:46.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.028+0000 7f0a11a00640 1 -- 172.21.15.114:0/3815554293 wait complete. 2024-02-17T12:19:46.050 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:19:46.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.184+0000 7f572b000640 1 Processor -- start 2024-02-17T12:19:46.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.184+0000 7f572b000640 1 -- start start 2024-02-17T12:19:46.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.184+0000 7f572b000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f572414f110 0x7f57240c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.184+0000 7f572b000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f57240c1eb0 0x7f572415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.184+0000 7f572b000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57240a9420 con 0x7f57240c2580 2024-02-17T12:19:46.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.184+0000 7f572b000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572414f4f0 con 0x7f572414f110 2024-02-17T12:19:46.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.184+0000 7f572b000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57240aae80 con 0x7f57240c1eb0 2024-02-17T12:19:46.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.184+0000 7f5723e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f572414f110 0x7f57240c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5723e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f572414f110 0x7f57240c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35512/0 (socket says 172.21.15.114:35512) 2024-02-17T12:19:46.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5723e00640 1 -- 172.21.15.114:0/3673118752 learned_addr learned my addr 172.21.15.114:0/3673118752 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:46.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5723400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f57240c2580 0x7f57240aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37212/0 (socket says 172.21.15.114:37212) 2024-02-17T12:19:46.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5723e00640 1 -- 172.21.15.114:0/3673118752 >> v2:172.21.15.116:3300/0 conn(0x7f57240c1eb0 msgr2=0x7f572415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:46.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5729000640 1 --2- 172.21.15.114:0/3673118752 >> v2:172.21.15.116:3300/0 conn(0x7f57240c1eb0 0x7f572415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5723e00640 1 --2- 172.21.15.114:0/3673118752 >> v2:172.21.15.116:3300/0 conn(0x7f57240c1eb0 0x7f572415c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5723e00640 1 -- 172.21.15.114:0/3673118752 >> v1:172.21.15.114:6789/0 conn(0x7f57240c2580 legacy=0x7f57240aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5722a00640 1 -- 172.21.15.114:0/3673118752 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118225942 0 0) 0x7f57240a9420 con 0x7f57240c2580 2024-02-17T12:19:46.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5723e00640 1 -- 172.21.15.114:0/3673118752 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5724152850 con 0x7f572414f110 2024-02-17T12:19:46.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5729000640 1 --2- 172.21.15.114:0/3673118752 >> v2:172.21.15.116:3300/0 conn(0x7f57240c1eb0 0x7f572415c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:46.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5723e00640 1 --2- 172.21.15.114:0/3673118752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 0x7f57240c65a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f572406ceb0 tx=0x7f571401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530e1416b65aef71 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:46.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5722a00640 1 -- 172.21.15.114:0/3673118752 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57140ab660 con 0x7f572414f110 2024-02-17T12:19:46.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5722a00640 1 -- 172.21.15.114:0/3673118752 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57140ab7c0 con 0x7f572414f110 2024-02-17T12:19:46.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f5722a00640 1 -- 172.21.15.114:0/3673118752 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57140abb50 con 0x7f572414f110 2024-02-17T12:19:46.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f572b000640 1 -- 172.21.15.114:0/3673118752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 msgr2=0x7f57240c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.188+0000 7f572b000640 1 --2- 172.21.15.114:0/3673118752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 0x7f57240c65a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f572406ceb0 tx=0x7f571401c460 comp rx=0 tx=0).stop 2024-02-17T12:19:46.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 -- 172.21.15.114:0/3673118752 shutdown_connections 2024-02-17T12:19:46.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 --2- 172.21.15.114:0/3673118752 >> v2:172.21.15.116:3300/0 conn(0x7f57240c1eb0 0x7f572415c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 --2- 172.21.15.114:0/3673118752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 0x7f57240c65a0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 -- 172.21.15.114:0/3673118752 >> 172.21.15.114:0/3673118752 conn(0x7f57240a8490 msgr2=0x7f57240a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:46.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 -- 172.21.15.114:0/3673118752 shutdown_connections 2024-02-17T12:19:46.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 -- 172.21.15.114:0/3673118752 wait complete. 2024-02-17T12:19:46.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 Processor -- start 2024-02-17T12:19:46.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 -- start start 2024-02-17T12:19:46.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57240c1eb0 0x7f57241f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57240c2580 0x7f57241434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 0x7f57241ed460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c4210 con 0x7f572414f110 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c6190 con 0x7f57240c1eb0 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57241f0980 con 0x7f57240c2580 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5729000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 0x7f57241ed460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5729000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 0x7f57241ed460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35520/0 (socket says 172.21.15.114:35520) 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5729000640 1 -- 172.21.15.114:0/2192013385 learned_addr learned my addr 172.21.15.114:0/2192013385 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5723e00640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57240c1eb0 0x7f57241f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5723400640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57240c2580 0x7f57241434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5729000640 1 -- 172.21.15.114:0/2192013385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57240c2580 msgr2=0x7f57241434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5729000640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57240c2580 0x7f57241434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5729000640 1 -- 172.21.15.114:0/2192013385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57240c1eb0 msgr2=0x7f57241f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5729000640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57240c1eb0 0x7f57241f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5729000640 1 -- 172.21.15.114:0/2192013385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140094d0 con 0x7f572414f110 2024-02-17T12:19:46.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5723400640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57240c2580 0x7f57241434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:46.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f5729000640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 0x7f57241ed460 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f571c00cef0 tx=0x7f571c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:46.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f571be00640 1 -- 172.21.15.114:0/2192013385 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c00d840 con 0x7f572414f110 2024-02-17T12:19:46.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f571be00640 1 -- 172.21.15.114:0/2192013385 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c00d9c0 con 0x7f572414f110 2024-02-17T12:19:46.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f571be00640 1 -- 172.21.15.114:0/2192013385 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c00dd70 con 0x7f572414f110 2024-02-17T12:19:46.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.192+0000 7f572b000640 1 -- 172.21.15.114:0/2192013385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57240c5bd0 con 0x7f572414f110 2024-02-17T12:19:46.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.196+0000 7f572b000640 1 -- 172.21.15.114:0/2192013385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57241f0b70 con 0x7f572414f110 2024-02-17T12:19:46.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.196+0000 7f572b000640 1 -- 172.21.15.114:0/2192013385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5724074840 con 0x7f572414f110 2024-02-17T12:19:46.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.196+0000 7f571be00640 1 -- 172.21.15.114:0/2192013385 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f571c01e3b0 con 0x7f572414f110 2024-02-17T12:19:46.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.196+0000 7f571be00640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5704066e40 0x7f5704069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.196+0000 7f571be00640 1 -- 172.21.15.114:0/2192013385 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f571c085770 con 0x7f572414f110 2024-02-17T12:19:46.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.196+0000 7f5723e00640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5704066e40 0x7f5704069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.196+0000 7f5723e00640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5704066e40 0x7f5704069300 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f57140af000 tx=0x7f57140b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:46.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.200+0000 7f571be00640 1 -- 172.21.15.114:0/2192013385 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f571c0522a0 con 0x7f572414f110 2024-02-17T12:19:46.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.352+0000 7f572b000640 1 -- 172.21.15.114:0/2192013385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f57240c1380 con 0x7f572414f110 2024-02-17T12:19:46.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.352+0000 7f571be00640 1 -- 172.21.15.114:0/2192013385 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f571c055960 con 0x7f572414f110 2024-02-17T12:19:46.358 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 -- 172.21.15.114:0/2192013385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5704066e40 msgr2=0x7f5704069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5704066e40 0x7f5704069300 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f57140af000 tx=0x7f57140b6040 comp rx=0 tx=0).stop 2024-02-17T12:19:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 -- 172.21.15.114:0/2192013385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 msgr2=0x7f57241ed460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 0x7f57241ed460 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f571c00cef0 tx=0x7f571c00a710 comp rx=0 tx=0).stop 2024-02-17T12:19:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 -- 172.21.15.114:0/2192013385 shutdown_connections 2024-02-17T12:19:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5704066e40 0x7f5704069300 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f572414f110 0x7f57241ed460 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57240c2580 0x7f57241434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 --2- 172.21.15.114:0/2192013385 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57240c1eb0 0x7f57241f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 -- 172.21.15.114:0/2192013385 >> 172.21.15.114:0/2192013385 conn(0x7f57240a8490 msgr2=0x7f5724072570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 -- 172.21.15.114:0/2192013385 shutdown_connections 2024-02-17T12:19:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.356+0000 7f572b000640 1 -- 172.21.15.114:0/2192013385 wait complete. 2024-02-17T12:19:46.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:19:46.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.512+0000 7f355bc00640 1 Processor -- start 2024-02-17T12:19:46.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.512+0000 7f355bc00640 1 -- start start 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f355bc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f355406db50 0x7f355414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f355bc00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3554150490 0x7f3554152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f355bc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3554156270 con 0x7f35540c25a0 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f355bc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355406f090 con 0x7f355406db50 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f355bc00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3554071630 con 0x7f3554150490 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f3553e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f355406db50 0x7f355414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f3553e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f355406db50 0x7f355414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35528/0 (socket says 172.21.15.114:35528) 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f3553e00640 1 -- 172.21.15.114:0/704462398 learned_addr learned my addr 172.21.15.114:0/704462398 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f3559c00640 1 --2- 172.21.15.114:0/704462398 >> v2:172.21.15.116:3300/0 conn(0x7f3554150490 0x7f3554152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f3553e00640 1 -- 172.21.15.114:0/704462398 >> v2:172.21.15.116:3300/0 conn(0x7f3554150490 msgr2=0x7f3554152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f3553e00640 1 --2- 172.21.15.114:0/704462398 >> v2:172.21.15.116:3300/0 conn(0x7f3554150490 0x7f3554152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f3553e00640 1 -- 172.21.15.114:0/704462398 >> v1:172.21.15.114:6789/0 conn(0x7f35540c25a0 legacy=0x7f355406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f3553e00640 1 -- 172.21.15.114:0/704462398 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554156550 con 0x7f355406db50 2024-02-17T12:19:46.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f3559c00640 1 --2- 172.21.15.114:0/704462398 >> v2:172.21.15.116:3300/0 conn(0x7f3554150490 0x7f3554152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:46.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.516+0000 7f3553e00640 1 --2- 172.21.15.114:0/704462398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f355406db50 0x7f355414ff50 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3554153cb0 tx=0x7f353c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87727076b6a6901 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:46.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553400640 1 -- 172.21.15.114:0/704462398 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35541539a0 con 0x7f355406db50 2024-02-17T12:19:46.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553400640 1 -- 172.21.15.114:0/704462398 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c0a7050 con 0x7f355406db50 2024-02-17T12:19:46.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553400640 1 -- 172.21.15.114:0/704462398 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0ab820 con 0x7f355406db50 2024-02-17T12:19:46.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 -- 172.21.15.114:0/704462398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f355406db50 msgr2=0x7f355414ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 --2- 172.21.15.114:0/704462398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f355406db50 0x7f355414ff50 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3554153cb0 tx=0x7f353c01c400 comp rx=0 tx=0).stop 2024-02-17T12:19:46.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 -- 172.21.15.114:0/704462398 shutdown_connections 2024-02-17T12:19:46.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 --2- 172.21.15.114:0/704462398 >> v2:172.21.15.116:3300/0 conn(0x7f3554150490 0x7f3554152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 --2- 172.21.15.114:0/704462398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f355406db50 0x7f355414ff50 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 -- 172.21.15.114:0/704462398 >> 172.21.15.114:0/704462398 conn(0x7f35540a8490 msgr2=0x7f35540a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:46.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 -- 172.21.15.114:0/704462398 shutdown_connections 2024-02-17T12:19:46.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 -- 172.21.15.114:0/704462398 wait complete. 2024-02-17T12:19:46.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 Processor -- start 2024-02-17T12:19:46.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 -- start start 2024-02-17T12:19:46.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f355406db50 0x7f35541554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35540c25a0 0x7f3554141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3554150490 0x7f355414dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35540a9e50 con 0x7f35540c25a0 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3554155bb0 con 0x7f3554150490 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f355bc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35540a9520 con 0x7f355406db50 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35540c25a0 0x7f3554141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35540c25a0 0x7f3554141ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35546/0 (socket says 172.21.15.114:35546) 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553e00640 1 -- 172.21.15.114:0/3659022426 learned_addr learned my addr 172.21.15.114:0/3659022426 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3559c00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3554150490 0x7f355414dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3559200640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f355406db50 0x7f35541554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553e00640 1 -- 172.21.15.114:0/3659022426 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f355406db50 msgr2=0x7f35541554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553e00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f355406db50 0x7f35541554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553e00640 1 -- 172.21.15.114:0/3659022426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3554150490 msgr2=0x7f355414dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553e00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3554150490 0x7f355414dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.520+0000 7f3553e00640 1 -- 172.21.15.114:0/3659022426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c0094d0 con 0x7f35540c25a0 2024-02-17T12:19:46.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f3553e00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35540c25a0 0x7f3554141ff0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f353c019010 tx=0x7f353c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:46.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f3550c00640 1 -- 172.21.15.114:0/3659022426 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0b4420 con 0x7f35540c25a0 2024-02-17T12:19:46.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f3550c00640 1 -- 172.21.15.114:0/3659022426 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c0b4580 con 0x7f35540c25a0 2024-02-17T12:19:46.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f355bc00640 1 -- 172.21.15.114:0/3659022426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35540a9800 con 0x7f35540c25a0 2024-02-17T12:19:46.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f3550c00640 1 -- 172.21.15.114:0/3659022426 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0b4910 con 0x7f35540c25a0 2024-02-17T12:19:46.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f355bc00640 1 -- 172.21.15.114:0/3659022426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35541428d0 con 0x7f35540c25a0 2024-02-17T12:19:46.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f355bc00640 1 -- 172.21.15.114:0/3659022426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3554074840 con 0x7f35540c25a0 2024-02-17T12:19:46.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f3550c00640 1 -- 172.21.15.114:0/3659022426 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f353c0b2070 con 0x7f35540c25a0 2024-02-17T12:19:46.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f3550c00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3530066e40 0x7f3530069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f3550c00640 1 -- 172.21.15.114:0/3659022426 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f353c11e9d0 con 0x7f35540c25a0 2024-02-17T12:19:46.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.524+0000 7f3559200640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3530066e40 0x7f3530069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.528+0000 7f3559200640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3530066e40 0x7f3530069300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3544001d50 tx=0x7f3544009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:46.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.528+0000 7f3550c00640 1 -- 172.21.15.114:0/3659022426 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f353c0eb460 con 0x7f35540c25a0 2024-02-17T12:19:46.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 -- 172.21.15.114:0/3659022426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f35540c3a60 con 0x7f35540c25a0 2024-02-17T12:19:46.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f3550c00640 1 -- 172.21.15.114:0/3659022426 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f353c0eeb20 con 0x7f35540c25a0 2024-02-17T12:19:46.700 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:19:46.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 -- 172.21.15.114:0/3659022426 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3530066e40 msgr2=0x7f3530069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3530066e40 0x7f3530069300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3544001d50 tx=0x7f3544009040 comp rx=0 tx=0).stop 2024-02-17T12:19:46.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 -- 172.21.15.114:0/3659022426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35540c25a0 msgr2=0x7f3554141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:46.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35540c25a0 0x7f3554141ff0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f353c019010 tx=0x7f353c0191a0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 -- 172.21.15.114:0/3659022426 shutdown_connections 2024-02-17T12:19:46.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3554150490 0x7f355414dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3530066e40 0x7f3530069300 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35540c25a0 0x7f3554141ff0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 --2- 172.21.15.114:0/3659022426 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f355406db50 0x7f35541554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:46.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.696+0000 7f355bc00640 1 -- 172.21.15.114:0/3659022426 >> 172.21.15.114:0/3659022426 conn(0x7f35540a8490 msgr2=0x7f355406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:46.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.700+0000 7f355bc00640 1 -- 172.21.15.114:0/3659022426 shutdown_connections 2024-02-17T12:19:46.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.700+0000 7f355bc00640 1 -- 172.21.15.114:0/3659022426 wait complete. 2024-02-17T12:19:46.721 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2024-02-17T12:19:46.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:46.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-17T12:19:46.746 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:19:46.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:46.746 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-17T12:19:46.802 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:46.802 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:46.812 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:46.812 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:46.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:46.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b2b600640 1 Processor -- start 2024-02-17T12:19:46.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b2b600640 1 -- start start 2024-02-17T12:19:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b2b600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1b2414f110 0x7f1b240c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b2b600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1b240c2580 0x7f1b240aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b2b600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1b240c1eb0 0x7f1b24155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b2b600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2414f4f0 con 0x7f1b240c1eb0 2024-02-17T12:19:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b2b600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b240aae80 con 0x7f1b240c2580 2024-02-17T12:19:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b2b600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240a9420 con 0x7f1b2414f110 2024-02-17T12:19:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b29600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1b240c1eb0 0x7f1b24155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b29600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1b240c1eb0 0x7f1b24155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35560/0 (socket says 172.21.15.114:35560) 2024-02-17T12:19:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b29600640 1 -- 172.21.15.114:0/2412036567 learned_addr learned my addr 172.21.15.114:0/2412036567 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b23e00640 1 --2- 172.21.15.114:0/2412036567 >> v2:172.21.15.116:3300/0 conn(0x7f1b240c2580 0x7f1b240aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.992+0000 7f1b28c00640 1 --2- 172.21.15.114:0/2412036567 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1b2414f110 0x7f1b240c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b29600640 1 -- 172.21.15.114:0/2412036567 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1b2414f110 msgr2=0x7f1b240c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:47.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b29600640 1 --2- 172.21.15.114:0/2412036567 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1b2414f110 0x7f1b240c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b29600640 1 -- 172.21.15.114:0/2412036567 >> v2:172.21.15.116:3300/0 conn(0x7f1b240c2580 msgr2=0x7f1b240aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:47.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b29600640 1 --2- 172.21.15.114:0/2412036567 >> v2:172.21.15.116:3300/0 conn(0x7f1b240c2580 0x7f1b240aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b29600640 1 -- 172.21.15.114:0/2412036567 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24152850 con 0x7f1b240c1eb0 2024-02-17T12:19:47.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b29600640 1 --2- 172.21.15.114:0/2412036567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b240c1eb0 0x7f1b24155000 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1b240a91c0 tx=0x7f1b1c01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b068761a72bac4c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:47.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b23400640 1 -- 172.21.15.114:0/2412036567 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0a79d0 con 0x7f1b240c1eb0 2024-02-17T12:19:47.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b23400640 1 -- 172.21.15.114:0/2412036567 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c0a7b30 con 0x7f1b240c1eb0 2024-02-17T12:19:47.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b23400640 1 -- 172.21.15.114:0/2412036567 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0af3f0 con 0x7f1b240c1eb0 2024-02-17T12:19:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b2b600640 1 -- 172.21.15.114:0/2412036567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b240c1eb0 msgr2=0x7f1b24155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:46.996+0000 7f1b2b600640 1 --2- 172.21.15.114:0/2412036567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b240c1eb0 0x7f1b24155000 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f1b240a91c0 tx=0x7f1b1c01eb40 comp rx=0 tx=0).stop 2024-02-17T12:19:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 -- 172.21.15.114:0/2412036567 shutdown_connections 2024-02-17T12:19:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 --2- 172.21.15.114:0/2412036567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b240c1eb0 0x7f1b24155000 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 --2- 172.21.15.114:0/2412036567 >> v2:172.21.15.116:3300/0 conn(0x7f1b240c2580 0x7f1b240aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 --2- 172.21.15.114:0/2412036567 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1b2414f110 0x7f1b240c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 -- 172.21.15.114:0/2412036567 >> 172.21.15.114:0/2412036567 conn(0x7f1b240a8490 msgr2=0x7f1b240a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 -- 172.21.15.114:0/2412036567 shutdown_connections 2024-02-17T12:19:47.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 -- 172.21.15.114:0/2412036567 wait complete. 2024-02-17T12:19:47.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 Processor -- start 2024-02-17T12:19:47.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 -- start start 2024-02-17T12:19:47.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1b240c1eb0 0x7f1b24154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b240c2580 0x7f1b241f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b2414f110 0x7f1b241f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b241ed4d0 con 0x7f1b2414f110 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240c5590 con 0x7f1b240c2580 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b241ed6e0 con 0x7f1b240c1eb0 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b29600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b2414f110 0x7f1b241f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b29600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b2414f110 0x7f1b241f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35564/0 (socket says 172.21.15.114:35564) 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b29600640 1 -- 172.21.15.114:0/91436229 learned_addr learned my addr 172.21.15.114:0/91436229 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b28c00640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1b240c1eb0 0x7f1b24154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b23e00640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b240c2580 0x7f1b241f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b29600640 1 -- 172.21.15.114:0/91436229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1b240c1eb0 msgr2=0x7f1b24154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b29600640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1b240c1eb0 0x7f1b24154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b29600640 1 -- 172.21.15.114:0/91436229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b240c2580 msgr2=0x7f1b241f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b29600640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b240c2580 0x7f1b241f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b29600640 1 -- 172.21.15.114:0/91436229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c009b30 con 0x7f1b2414f110 2024-02-17T12:19:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b29600640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b2414f110 0x7f1b241f0fa0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c01d1f0 tx=0x7f1b1c01b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b20c00640 1 -- 172.21.15.114:0/91436229 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0a79d0 con 0x7f1b2414f110 2024-02-17T12:19:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b20c00640 1 -- 172.21.15.114:0/91436229 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c00e150 con 0x7f1b2414f110 2024-02-17T12:19:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b20c00640 1 -- 172.21.15.114:0/91436229 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c007d20 con 0x7f1b2414f110 2024-02-17T12:19:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.000+0000 7f1b2b600640 1 -- 172.21.15.114:0/91436229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b241ed9c0 con 0x7f1b2414f110 2024-02-17T12:19:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.004+0000 7f1b2b600640 1 -- 172.21.15.114:0/91436229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b240c6710 con 0x7f1b2414f110 2024-02-17T12:19:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.004+0000 7f1b2b600640 1 -- 172.21.15.114:0/91436229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b241edee0 con 0x7f1b2414f110 2024-02-17T12:19:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.004+0000 7f1b20c00640 1 -- 172.21.15.114:0/91436229 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1b1c0af3f0 con 0x7f1b2414f110 2024-02-17T12:19:47.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.004+0000 7f1b20c00640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1b04066e40 0x7f1b04069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.004+0000 7f1b20c00640 1 -- 172.21.15.114:0/91436229 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1b1c11f0e0 con 0x7f1b2414f110 2024-02-17T12:19:47.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.004+0000 7f1b28c00640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1b04066e40 0x7f1b04069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.004+0000 7f1b28c00640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1b04066e40 0x7f1b04069300 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1b24150210 tx=0x7f1b14009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:47.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.008+0000 7f1b20c00640 1 -- 172.21.15.114:0/91436229 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1b241edee0 con 0x7f1b2414f110 2024-02-17T12:19:47.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.164+0000 7f1b2b600640 1 -- 172.21.15.114:0/91436229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b241edee0 con 0x7f1b2414f110 2024-02-17T12:19:47.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.164+0000 7f1b20c00640 1 -- 172.21.15.114:0/91436229 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20392 (secure 0 0 0) 0x7f1b241edee0 con 0x7f1b2414f110 2024-02-17T12:19:47.168 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:47.169 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:23.364663+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:47.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 -- 172.21.15.114:0/91436229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1b04066e40 msgr2=0x7f1b04069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1b04066e40 0x7f1b04069300 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1b24150210 tx=0x7f1b14009190 comp rx=0 tx=0).stop 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 -- 172.21.15.114:0/91436229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b2414f110 msgr2=0x7f1b241f0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b2414f110 0x7f1b241f0fa0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c01d1f0 tx=0x7f1b1c01b8e0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 -- 172.21.15.114:0/91436229 shutdown_connections 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1b04066e40 0x7f1b04069300 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b2414f110 0x7f1b241f0fa0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b240c2580 0x7f1b241f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 --2- 172.21.15.114:0/91436229 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1b240c1eb0 0x7f1b24154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 -- 172.21.15.114:0/91436229 >> 172.21.15.114:0/91436229 conn(0x7f1b240a8490 msgr2=0x7f1b240a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 -- 172.21.15.114:0/91436229 shutdown_connections 2024-02-17T12:19:47.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.168+0000 7f1b2b600640 1 -- 172.21.15.114:0/91436229 wait complete. 2024-02-17T12:19:47.191 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:19:01.796651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:19:03.070707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:19:19.573884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:19:20.731260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:19:47.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:19:47.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e54a00640 1 Processor -- start 2024-02-17T12:19:47.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e54a00640 1 -- start start 2024-02-17T12:19:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e54a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e500c1eb0 0x7f4e5015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e54a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e500a9420 con 0x7f4e500c2580 2024-02-17T12:19:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e54a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e50152850 con 0x7f4e5014f110 2024-02-17T12:19:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e54a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5014f4f0 con 0x7f4e500c1eb0 2024-02-17T12:19:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4d400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4e500c2580 0x7f4e500aa150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37224/0 (socket says 172.21.15.114:37224) 2024-02-17T12:19:47.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4d400640 1 -- 172.21.15.114:0/772709130 learned_addr learned my addr 172.21.15.114:0/772709130 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:47.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4e800640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e500c1eb0 0x7f4e5015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570866674 0 0) 0x7f4e500a9420 con 0x7f4e500c2580 2024-02-17T12:19:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e34003530 con 0x7f4e500c2580 2024-02-17T12:19:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137691441 0 0) 0x7f4e50152850 con 0x7f4e5014f110 2024-02-17T12:19:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e500a9420 con 0x7f4e5014f110 2024-02-17T12:19:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 527527275 0 0) 0x7f4e34003530 con 0x7f4e500c2580 2024-02-17T12:19:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e500c1eb0 msgr2=0x7f4e5015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e500c1eb0 0x7f4e5015d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 >> v1:172.21.15.116:6789/0 conn(0x7f4e5014f110 legacy=0x7f4e500c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e500a9670 con 0x7f4e500c2580 2024-02-17T12:19:47.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f4e3c001680 con 0x7f4e500c2580 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4e800640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e500c1eb0 0x7f4e5015d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 >> v1:172.21.15.114:6789/0 conn(0x7f4e500c2580 legacy=0x7f4e500aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e500c1eb0 0x7f4e34003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 0x7f4e340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e34004d10 0x7f4e34005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5014f4f0 con 0x7f4e340040d0 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3400bb50 con 0x7f4e34004d10 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3400bd10 con 0x7f4e500c1eb0 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4d400640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 0x7f4e340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.328+0000 7f4e4de00640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e500c1eb0 0x7f4e34003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4e800640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e34004d10 0x7f4e34005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4d400640 1 -- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e500c1eb0 msgr2=0x7f4e34003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:47.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4d400640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e500c1eb0 0x7f4e34003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4d400640 1 -- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e34004d10 msgr2=0x7f4e34005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:47.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4d400640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e34004d10 0x7f4e34005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4d400640 1 -- 172.21.15.114:0/772709130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48009a70 con 0x7f4e340040d0 2024-02-17T12:19:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4d400640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 0x7f4e340047d0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007f80 tx=0x7f4e3c01cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63042301bd1d90be server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c005ae0 con 0x7f4e340040d0 2024-02-17T12:19:47.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c005c40 con 0x7f4e340040d0 2024-02-17T12:19:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4ca00640 1 -- 172.21.15.114:0/772709130 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0072b0 con 0x7f4e340040d0 2024-02-17T12:19:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e54a00640 1 -- 172.21.15.114:0/772709130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 msgr2=0x7f4e340047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e54a00640 1 --2- 172.21.15.114:0/772709130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 0x7f4e340047d0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007f80 tx=0x7f4e3c01cb00 comp rx=0 tx=0).stop 2024-02-17T12:19:47.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e4e800640 1 -- 172.21.15.114:0/772709130 reap_dead start 2024-02-17T12:19:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e54a00640 1 -- 172.21.15.114:0/772709130 shutdown_connections 2024-02-17T12:19:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e54a00640 1 -- 172.21.15.114:0/772709130 >> 172.21.15.114:0/772709130 conn(0x7f4e500a8490 msgr2=0x7f4e500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e54a00640 1 -- 172.21.15.114:0/772709130 shutdown_connections 2024-02-17T12:19:47.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.332+0000 7f4e54a00640 1 -- 172.21.15.114:0/772709130 wait complete. 2024-02-17T12:19:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e54a00640 1 Processor -- start 2024-02-17T12:19:47.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e54a00640 1 -- start start 2024-02-17T12:19:47.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e54a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 0x7f4e50147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e54a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e5014ad70 0x7f4e5013e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e54a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e5013ed30 0x7f4e501eb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e54a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e501eb190 con 0x7f4e340040d0 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e54a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e50143280 con 0x7f4e5014ad70 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e54a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5013f430 con 0x7f4e5013ed30 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 0x7f4e50147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 0x7f4e50147a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35594/0 (socket says 172.21.15.114:35594) 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4de00640 1 -- 172.21.15.114:0/3490698544 learned_addr learned my addr 172.21.15.114:0/3490698544 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4e800640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e5013ed30 0x7f4e501eb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4d400640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e5014ad70 0x7f4e5013e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4de00640 1 -- 172.21.15.114:0/3490698544 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e5013ed30 msgr2=0x7f4e501eb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4de00640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e5013ed30 0x7f4e501eb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4de00640 1 -- 172.21.15.114:0/3490698544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e5014ad70 msgr2=0x7f4e5013e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4de00640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e5014ad70 0x7f4e5013e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4de00640 1 -- 172.21.15.114:0/3490698544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50149eb0 con 0x7f4e340040d0 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4d400640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e5014ad70 0x7f4e5013e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e4de00640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 0x7f4e50147a90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000f7e0 tx=0x7f4e4000fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e46000640 1 -- 172.21.15.114:0/3490698544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e400014f0 con 0x7f4e340040d0 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e46000640 1 -- 172.21.15.114:0/3490698544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e400052e0 con 0x7f4e340040d0 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e46000640 1 -- 172.21.15.114:0/3490698544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4000d950 con 0x7f4e340040d0 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e54a00640 1 -- 172.21.15.114:0/3490698544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e50144960 con 0x7f4e340040d0 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.336+0000 7f4e54a00640 1 -- 172.21.15.114:0/3490698544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e50144f20 con 0x7f4e340040d0 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.340+0000 7f4e54a00640 1 -- 172.21.15.114:0/3490698544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e500c3cf0 con 0x7f4e340040d0 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.340+0000 7f4e46000640 1 -- 172.21.15.114:0/3490698544 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f4e4000dab0 con 0x7f4e340040d0 2024-02-17T12:19:47.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.340+0000 7f4e46000640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e30066e40 0x7f4e30069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.340+0000 7f4e46000640 1 -- 172.21.15.114:0/3490698544 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4e40084e10 con 0x7f4e340040d0 2024-02-17T12:19:47.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.340+0000 7f4e4d400640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e30066e40 0x7f4e30069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.340+0000 7f4e4d400640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e30066e40 0x7f4e30069300 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e500c29a0 tx=0x7f4e3c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:47.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.344+0000 7f4e46000640 1 -- 172.21.15.114:0/3490698544 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4e40088030 con 0x7f4e340040d0 2024-02-17T12:19:47.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.500+0000 7f4e54a00640 1 -- 172.21.15.114:0/3490698544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e501eb2d0 con 0x7f4e340040d0 2024-02-17T12:19:47.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.500+0000 7f4e46000640 1 -- 172.21.15.114:0/3490698544 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e400553c0 con 0x7f4e340040d0 2024-02-17T12:19:47.504 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:19:47.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 -- 172.21.15.114:0/3490698544 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e30066e40 msgr2=0x7f4e30069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e30066e40 0x7f4e30069300 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e500c29a0 tx=0x7f4e3c0a7070 comp rx=0 tx=0).stop 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 -- 172.21.15.114:0/3490698544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 msgr2=0x7f4e50147a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 0x7f4e50147a90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000f7e0 tx=0x7f4e4000fca0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 -- 172.21.15.114:0/3490698544 shutdown_connections 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4e5013ed30 0x7f4e501eb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e5014ad70 0x7f4e5013e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4e30066e40 0x7f4e30069300 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 --2- 172.21.15.114:0/3490698544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e340040d0 0x7f4e50147a90 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 -- 172.21.15.114:0/3490698544 >> 172.21.15.114:0/3490698544 conn(0x7f4e500a8490 msgr2=0x7f4e5006e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 -- 172.21.15.114:0/3490698544 shutdown_connections 2024-02-17T12:19:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.504+0000 7f4e54a00640 1 -- 172.21.15.114:0/3490698544 wait complete. 2024-02-17T12:19:47.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:19:47.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae72200640 1 Processor -- start 2024-02-17T12:19:47.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae72200640 1 -- start start 2024-02-17T12:19:47.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae72200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c14f110 0x7fae6c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae72200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fae6c0c2580 0x7fae6c0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae72200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fae6c0c1eb0 0x7fae6c155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae72200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c14f4f0 con 0x7fae6c0c1eb0 2024-02-17T12:19:47.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae72200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c0aae80 con 0x7fae6c0c2580 2024-02-17T12:19:47.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae72200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0a9420 con 0x7fae6c14f110 2024-02-17T12:19:47.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae6be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fae6c0c1eb0 0x7fae6c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae6be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fae6c0c1eb0 0x7fae6c155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35600/0 (socket says 172.21.15.114:35600) 2024-02-17T12:19:47.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae6be00640 1 -- 172.21.15.114:0/3770686273 learned_addr learned my addr 172.21.15.114:0/3770686273 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:47.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae6b400640 1 --2- 172.21.15.114:0/3770686273 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c14f110 0x7fae6c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae63e00640 1 --2- 172.21.15.114:0/3770686273 >> v2:172.21.15.116:3300/0 conn(0x7fae6c0c2580 0x7fae6c0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae6be00640 1 -- 172.21.15.114:0/3770686273 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c14f110 msgr2=0x7fae6c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:47.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae6be00640 1 --2- 172.21.15.114:0/3770686273 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c14f110 0x7fae6c0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae6be00640 1 -- 172.21.15.114:0/3770686273 >> v2:172.21.15.116:3300/0 conn(0x7fae6c0c2580 msgr2=0x7fae6c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:47.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae6be00640 1 --2- 172.21.15.114:0/3770686273 >> v2:172.21.15.116:3300/0 conn(0x7fae6c0c2580 0x7fae6c0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae6be00640 1 -- 172.21.15.114:0/3770686273 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c152850 con 0x7fae6c0c1eb0 2024-02-17T12:19:47.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.660+0000 7fae63e00640 1 --2- 172.21.15.114:0/3770686273 >> v2:172.21.15.116:3300/0 conn(0x7fae6c0c2580 0x7fae6c0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:47.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae6be00640 1 --2- 172.21.15.114:0/3770686273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c0c1eb0 0x7fae6c155000 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0a91c0 tx=0x7fae6401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1cbf5b203d8fa7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:47.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae6aa00640 1 -- 172.21.15.114:0/3770686273 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae640a57b0 con 0x7fae6c0c1eb0 2024-02-17T12:19:47.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae6aa00640 1 -- 172.21.15.114:0/3770686273 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae640a5910 con 0x7fae6c0c1eb0 2024-02-17T12:19:47.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae6aa00640 1 -- 172.21.15.114:0/3770686273 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae640a5ca0 con 0x7fae6c0c1eb0 2024-02-17T12:19:47.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae72200640 1 -- 172.21.15.114:0/3770686273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c0c1eb0 msgr2=0x7fae6c155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae72200640 1 --2- 172.21.15.114:0/3770686273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c0c1eb0 0x7fae6c155000 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0a91c0 tx=0x7fae6401c930 comp rx=0 tx=0).stop 2024-02-17T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae72200640 1 -- 172.21.15.114:0/3770686273 shutdown_connections 2024-02-17T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae72200640 1 --2- 172.21.15.114:0/3770686273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c0c1eb0 0x7fae6c155000 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae72200640 1 --2- 172.21.15.114:0/3770686273 >> v2:172.21.15.116:3300/0 conn(0x7fae6c0c2580 0x7fae6c0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae72200640 1 --2- 172.21.15.114:0/3770686273 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c14f110 0x7fae6c0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae72200640 1 -- 172.21.15.114:0/3770686273 >> 172.21.15.114:0/3770686273 conn(0x7fae6c0a8490 msgr2=0x7fae6c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae72200640 1 -- 172.21.15.114:0/3770686273 shutdown_connections 2024-02-17T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.664+0000 7fae72200640 1 -- 172.21.15.114:0/3770686273 wait complete. 2024-02-17T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 Processor -- start 2024-02-17T12:19:47.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 -- start start 2024-02-17T12:19:47.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae6c0c1eb0 0x7fae6c156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c0c2580 0x7fae6c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c14f110 0x7fae6c147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c1eca80 con 0x7fae6c14f110 2024-02-17T12:19:47.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c1ec500 con 0x7fae6c0c1eb0 2024-02-17T12:19:47.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c1ec7a0 con 0x7fae6c0c2580 2024-02-17T12:19:47.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c14f110 0x7fae6c147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c14f110 0x7fae6c147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35602/0 (socket says 172.21.15.114:35602) 2024-02-17T12:19:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6be00640 1 -- 172.21.15.114:0/2398457627 learned_addr learned my addr 172.21.15.114:0/2398457627 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae63e00640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c0c2580 0x7fae6c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6b400640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae6c0c1eb0 0x7fae6c156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6be00640 1 -- 172.21.15.114:0/2398457627 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c0c2580 msgr2=0x7fae6c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6be00640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c0c2580 0x7fae6c14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6be00640 1 -- 172.21.15.114:0/2398457627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae6c0c1eb0 msgr2=0x7fae6c156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6be00640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae6c0c1eb0 0x7fae6c156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6be00640 1 -- 172.21.15.114:0/2398457627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64009b30 con 0x7fae6c14f110 2024-02-17T12:19:47.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6b400640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae6c0c1eb0 0x7fae6c156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:47.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae63e00640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c0c2580 0x7fae6c14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:47.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae6be00640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c14f110 0x7fae6c147c30 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fae6401afe0 tx=0x7fae640196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:47.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae63400640 1 -- 172.21.15.114:0/2398457627 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae640b8670 con 0x7fae6c14f110 2024-02-17T12:19:47.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae63400640 1 -- 172.21.15.114:0/2398457627 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae640b87d0 con 0x7fae6c14f110 2024-02-17T12:19:47.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 -- 172.21.15.114:0/2398457627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6c14a640 con 0x7fae6c14f110 2024-02-17T12:19:47.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae63400640 1 -- 172.21.15.114:0/2398457627 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae640b8b80 con 0x7fae6c14f110 2024-02-17T12:19:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 -- 172.21.15.114:0/2398457627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c14c490 con 0x7fae6c14f110 2024-02-17T12:19:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.668+0000 7fae72200640 1 -- 172.21.15.114:0/2398457627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c14ab60 con 0x7fae6c14f110 2024-02-17T12:19:47.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.672+0000 7fae63400640 1 -- 172.21.15.114:0/2398457627 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fae640b8ce0 con 0x7fae6c14f110 2024-02-17T12:19:47.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.672+0000 7fae63400640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fae48066e70 0x7fae48069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.672+0000 7fae63400640 1 -- 172.21.15.114:0/2398457627 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fae64120540 con 0x7fae6c14f110 2024-02-17T12:19:47.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.672+0000 7fae6b400640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fae48066e70 0x7fae48069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.672+0000 7fae6b400640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fae48066e70 0x7fae48069330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0097a0 tx=0x7fae5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:47.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.676+0000 7fae63400640 1 -- 172.21.15.114:0/2398457627 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fae6c14ab60 con 0x7fae6c14f110 2024-02-17T12:19:47.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.832+0000 7fae72200640 1 -- 172.21.15.114:0/2398457627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae6c14ab60 con 0x7fae6c14f110 2024-02-17T12:19:47.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.832+0000 7fae63400640 1 -- 172.21.15.114:0/2398457627 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae6c14ab60 con 0x7fae6c14f110 2024-02-17T12:19:47.837 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:47.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 -- 172.21.15.114:0/2398457627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fae48066e70 msgr2=0x7fae48069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fae48066e70 0x7fae48069330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0097a0 tx=0x7fae5c008040 comp rx=0 tx=0).stop 2024-02-17T12:19:47.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 -- 172.21.15.114:0/2398457627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c14f110 msgr2=0x7fae6c147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c14f110 0x7fae6c147c30 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fae6401afe0 tx=0x7fae640196d0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 -- 172.21.15.114:0/2398457627 shutdown_connections 2024-02-17T12:19:47.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fae48066e70 0x7fae48069330 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae6c14f110 0x7fae6c147c30 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae6c0c2580 0x7fae6c14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 --2- 172.21.15.114:0/2398457627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae6c0c1eb0 0x7fae6c156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 -- 172.21.15.114:0/2398457627 >> 172.21.15.114:0/2398457627 conn(0x7fae6c0a8490 msgr2=0x7fae6c148990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:47.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 -- 172.21.15.114:0/2398457627 shutdown_connections 2024-02-17T12:19:47.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.836+0000 7fae72200640 1 -- 172.21.15.114:0/2398457627 wait complete. 2024-02-17T12:19:47.857 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:19:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f356a400640 1 Processor -- start 2024-02-17T12:19:47.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f356a400640 1 -- start start 2024-02-17T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f356a400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35640c2580 0x7f35640aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f356a400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f35640c1eb0 0x7f356415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f356a400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35640a9420 con 0x7f356414f110 2024-02-17T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f356a400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356414f4f0 con 0x7f35640c2580 2024-02-17T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f356a400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35640aae80 con 0x7f35640c1eb0 2024-02-17T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f3562a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35640c2580 0x7f35640aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f3562a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35640c2580 0x7f35640aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35610/0 (socket says 172.21.15.114:35610) 2024-02-17T12:19:47.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f3562a00640 1 -- 172.21.15.114:0/900898605 learned_addr learned my addr 172.21.15.114:0/900898605 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:47.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f3563e00640 1 --2- 172.21.15.114:0/900898605 >> v2:172.21.15.116:3300/0 conn(0x7f35640c1eb0 0x7f356415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:47.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f3562a00640 1 -- 172.21.15.114:0/900898605 >> v2:172.21.15.116:3300/0 conn(0x7f35640c1eb0 msgr2=0x7f356415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:47.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f3562a00640 1 --2- 172.21.15.114:0/900898605 >> v2:172.21.15.116:3300/0 conn(0x7f35640c1eb0 0x7f356415c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:47.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f3562a00640 1 -- 172.21.15.114:0/900898605 >> v1:172.21.15.116:6789/0 conn(0x7f356414f110 legacy=0x7f35640c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:47.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.992+0000 7f3562a00640 1 -- 172.21.15.114:0/900898605 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564152850 con 0x7f35640c2580 2024-02-17T12:19:48.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f3562a00640 1 --2- 172.21.15.114:0/900898605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 0x7f35640aa150 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f356406ceb0 tx=0x7f355001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6fe67ca74b5660 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f3562000640 1 -- 172.21.15.114:0/900898605 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35500ab660 con 0x7f35640c2580 2024-02-17T12:19:48.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f3562000640 1 -- 172.21.15.114:0/900898605 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35500ab7c0 con 0x7f35640c2580 2024-02-17T12:19:48.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f3562000640 1 -- 172.21.15.114:0/900898605 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35500abb50 con 0x7f35640c2580 2024-02-17T12:19:48.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f356a400640 1 -- 172.21.15.114:0/900898605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 msgr2=0x7f35640aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f356a400640 1 --2- 172.21.15.114:0/900898605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 0x7f35640aa150 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f356406ceb0 tx=0x7f355001c460 comp rx=0 tx=0).stop 2024-02-17T12:19:48.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f356a400640 1 -- 172.21.15.114:0/900898605 shutdown_connections 2024-02-17T12:19:48.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f356a400640 1 --2- 172.21.15.114:0/900898605 >> v2:172.21.15.116:3300/0 conn(0x7f35640c1eb0 0x7f356415c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f356a400640 1 --2- 172.21.15.114:0/900898605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 0x7f35640aa150 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f356a400640 1 -- 172.21.15.114:0/900898605 >> 172.21.15.114:0/900898605 conn(0x7f35640a8490 msgr2=0x7f35640a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:48.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f356a400640 1 -- 172.21.15.114:0/900898605 shutdown_connections 2024-02-17T12:19:48.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f356a400640 1 -- 172.21.15.114:0/900898605 wait complete. 2024-02-17T12:19:48.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:47.996+0000 7f356a400640 1 Processor -- start 2024-02-17T12:19:48.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f356a400640 1 -- start start 2024-02-17T12:19:48.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f356a400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35640c1eb0 0x7f35641430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f356a400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c2580 0x7f3564150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f356a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 0x7f35640c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f356a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35641458f0 con 0x7f356414f110 2024-02-17T12:19:48.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f356a400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356413f010 con 0x7f35640c2580 2024-02-17T12:19:48.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f356a400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35640c6140 con 0x7f35640c1eb0 2024-02-17T12:19:48.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3563e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 0x7f35640c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3563e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 0x7f35640c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35620/0 (socket says 172.21.15.114:35620) 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3563e00640 1 -- 172.21.15.114:0/1971506735 learned_addr learned my addr 172.21.15.114:0/1971506735 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3563400640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35640c1eb0 0x7f35641430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3562a00640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c2580 0x7f3564150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3563e00640 1 -- 172.21.15.114:0/1971506735 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35640c1eb0 msgr2=0x7f35641430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3563e00640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35640c1eb0 0x7f35641430a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3563e00640 1 -- 172.21.15.114:0/1971506735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c2580 msgr2=0x7f3564150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3563e00640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c2580 0x7f3564150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3563e00640 1 -- 172.21.15.114:0/1971506735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35500094d0 con 0x7f356414f110 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3562a00640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c2580 0x7f3564150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f3563e00640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 0x7f35640c4890 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f355c007e40 tx=0x7f355c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f355b400640 1 -- 172.21.15.114:0/1971506735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c014620 con 0x7f356414f110 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f355b400640 1 -- 172.21.15.114:0/1971506735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c00ee90 con 0x7f356414f110 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f355b400640 1 -- 172.21.15.114:0/1971506735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0149e0 con 0x7f356414f110 2024-02-17T12:19:48.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f356a400640 1 -- 172.21.15.114:0/1971506735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35640c5e60 con 0x7f356414f110 2024-02-17T12:19:48.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f356a400640 1 -- 172.21.15.114:0/1971506735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35640c4370 con 0x7f356414f110 2024-02-17T12:19:48.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.000+0000 7f356a400640 1 -- 172.21.15.114:0/1971506735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35640c4560 con 0x7f356414f110 2024-02-17T12:19:48.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.004+0000 7f355b400640 1 -- 172.21.15.114:0/1971506735 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f355c014b40 con 0x7f356414f110 2024-02-17T12:19:48.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.004+0000 7f355b400640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3544066e40 0x7f3544069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.004+0000 7f355b400640 1 -- 172.21.15.114:0/1971506735 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f355c0856e0 con 0x7f356414f110 2024-02-17T12:19:48.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.004+0000 7f3563400640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3544066e40 0x7f3544069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.004+0000 7f3563400640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3544066e40 0x7f3544069300 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3554001770 tx=0x7f3554009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.008+0000 7f355b400640 1 -- 172.21.15.114:0/1971506735 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f355c052160 con 0x7f356414f110 2024-02-17T12:19:48.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.160+0000 7f356a400640 1 -- 172.21.15.114:0/1971506735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3564074840 con 0x7f356414f110 2024-02-17T12:19:48.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.160+0000 7f355b400640 1 -- 172.21.15.114:0/1971506735 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f355c055820 con 0x7f356414f110 2024-02-17T12:19:48.165 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 -- 172.21.15.114:0/1971506735 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3544066e40 msgr2=0x7f3544069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3544066e40 0x7f3544069300 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3554001770 tx=0x7f3554009040 comp rx=0 tx=0).stop 2024-02-17T12:19:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 -- 172.21.15.114:0/1971506735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 msgr2=0x7f35640c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 0x7f35640c4890 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f355c007e40 tx=0x7f355c00e4b0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 -- 172.21.15.114:0/1971506735 shutdown_connections 2024-02-17T12:19:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3544066e40 0x7f3544069300 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 0x7f35640c4890 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c2580 0x7f3564150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 --2- 172.21.15.114:0/1971506735 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f35640c1eb0 0x7f35641430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 -- 172.21.15.114:0/1971506735 >> 172.21.15.114:0/1971506735 conn(0x7f35640a8490 msgr2=0x7f35640a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 -- 172.21.15.114:0/1971506735 shutdown_connections 2024-02-17T12:19:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.164+0000 7f356a400640 1 -- 172.21.15.114:0/1971506735 wait complete. 2024-02-17T12:19:48.186 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:19:48.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de3c00640 1 Processor -- start 2024-02-17T12:19:48.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de3c00640 1 -- start start 2024-02-17T12:19:48.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de3c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7ddc0c25a0 0x7f7ddc06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de3c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ddc152c50 0x7f7ddc1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de3c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc156270 con 0x7f7ddc06db50 2024-02-17T12:19:48.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de3c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc071630 con 0x7f7ddc152c50 2024-02-17T12:19:48.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de3c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc156550 con 0x7f7ddc0c25a0 2024-02-17T12:19:48.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de1c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ddc152c50 0x7f7ddc1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de1c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ddc152c50 0x7f7ddc1530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35626/0 (socket says 172.21.15.114:35626) 2024-02-17T12:19:48.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de1c00640 1 -- 172.21.15.114:0/2422418630 learned_addr learned my addr 172.21.15.114:0/2422418630 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:48.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.320+0000 7f7de1200640 1 --2- 172.21.15.114:0/2422418630 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7ddc0c25a0 0x7f7ddc06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.324+0000 7f7de1c00640 1 -- 172.21.15.114:0/2422418630 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7ddc0c25a0 msgr2=0x7f7ddc06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:48.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.324+0000 7f7de1c00640 1 --2- 172.21.15.114:0/2422418630 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7ddc0c25a0 0x7f7ddc06e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.324+0000 7f7de1c00640 1 -- 172.21.15.114:0/2422418630 >> v1:172.21.15.116:6789/0 conn(0x7f7ddc06db50 legacy=0x7f7ddc14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.324+0000 7f7de1c00640 1 -- 172.21.15.114:0/2422418630 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc156830 con 0x7f7ddc152c50 2024-02-17T12:19:48.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.324+0000 7f7de1c00640 1 --2- 172.21.15.114:0/2422418630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc152c50 0x7f7ddc1530e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009e50 tx=0x7f7dd401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e15ebceea2d514 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.324+0000 7f7ddb400640 1 -- 172.21.15.114:0/2422418630 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40a56c0 con 0x7f7ddc152c50 2024-02-17T12:19:48.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.324+0000 7f7ddb400640 1 -- 172.21.15.114:0/2422418630 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd40a5820 con 0x7f7ddc152c50 2024-02-17T12:19:48.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.324+0000 7f7ddb400640 1 -- 172.21.15.114:0/2422418630 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40a5bb0 con 0x7f7ddc152c50 2024-02-17T12:19:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.324+0000 7f7de3c00640 1 -- 172.21.15.114:0/2422418630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc152c50 msgr2=0x7f7ddc1530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.324+0000 7f7de3c00640 1 --2- 172.21.15.114:0/2422418630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc152c50 0x7f7ddc1530e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009e50 tx=0x7f7dd401c8e0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 -- 172.21.15.114:0/2422418630 shutdown_connections 2024-02-17T12:19:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 --2- 172.21.15.114:0/2422418630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc152c50 0x7f7ddc1530e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 --2- 172.21.15.114:0/2422418630 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7ddc0c25a0 0x7f7ddc06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 -- 172.21.15.114:0/2422418630 >> 172.21.15.114:0/2422418630 conn(0x7f7ddc0a8490 msgr2=0x7f7ddc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 -- 172.21.15.114:0/2422418630 shutdown_connections 2024-02-17T12:19:48.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 -- 172.21.15.114:0/2422418630 wait complete. 2024-02-17T12:19:48.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 Processor -- start 2024-02-17T12:19:48.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 -- start start 2024-02-17T12:19:48.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ddc06db50 0x7f7ddc144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7ddc0c25a0 0x7f7ddc13eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc152c50 0x7f7ddc13efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc1ed240 con 0x7f7ddc152c50 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc153f10 con 0x7f7ddc06db50 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc1541f0 con 0x7f7ddc0c25a0 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de1200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ddc06db50 0x7f7ddc144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc152c50 0x7f7ddc13efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de1200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ddc06db50 0x7f7ddc144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:42438/0 (socket says 172.21.15.114:42438) 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de1200640 1 -- 172.21.15.114:0/4082775173 learned_addr learned my addr 172.21.15.114:0/4082775173 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7ddbe00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7ddc0c25a0 0x7f7ddc13eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de1c00640 1 -- 172.21.15.114:0/4082775173 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7ddc0c25a0 msgr2=0x7f7ddc13eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de1c00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7ddc0c25a0 0x7f7ddc13eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de1c00640 1 -- 172.21.15.114:0/4082775173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ddc06db50 msgr2=0x7f7ddc144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de1c00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ddc06db50 0x7f7ddc144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de1c00640 1 -- 172.21.15.114:0/4082775173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd4009b30 con 0x7f7ddc152c50 2024-02-17T12:19:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de1c00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc152c50 0x7f7ddc13efe0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ab000 tx=0x7f7dd4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7dd8c00640 1 -- 172.21.15.114:0/4082775173 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40b8670 con 0x7f7ddc152c50 2024-02-17T12:19:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7dd8c00640 1 -- 172.21.15.114:0/4082775173 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd40b87d0 con 0x7f7ddc152c50 2024-02-17T12:19:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.328+0000 7f7de3c00640 1 -- 172.21.15.114:0/4082775173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc1544d0 con 0x7f7ddc152c50 2024-02-17T12:19:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.332+0000 7f7dd8c00640 1 -- 172.21.15.114:0/4082775173 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40b8b60 con 0x7f7ddc152c50 2024-02-17T12:19:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.332+0000 7f7de3c00640 1 -- 172.21.15.114:0/4082775173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc151570 con 0x7f7ddc152c50 2024-02-17T12:19:48.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.332+0000 7f7de3c00640 1 -- 172.21.15.114:0/4082775173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc154710 con 0x7f7ddc152c50 2024-02-17T12:19:48.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.332+0000 7f7dd8c00640 1 -- 172.21.15.114:0/4082775173 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f7dd40b8cc0 con 0x7f7ddc152c50 2024-02-17T12:19:48.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.332+0000 7f7dd8c00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7dbc066e40 0x7f7dbc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.332+0000 7f7dd8c00640 1 -- 172.21.15.114:0/4082775173 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7dd411fff0 con 0x7f7ddc152c50 2024-02-17T12:19:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.332+0000 7f7de1200640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7dbc066e40 0x7f7dbc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.336+0000 7f7de1200640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7dbc066e40 0x7f7dbc069300 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0c1b00 tx=0x7f7dcc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.336+0000 7f7dd8c00640 1 -- 172.21.15.114:0/4082775173 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7ddc154710 con 0x7f7ddc152c50 2024-02-17T12:19:48.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 -- 172.21.15.114:0/4082775173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ddc1f0800 con 0x7f7ddc152c50 2024-02-17T12:19:48.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7dd8c00640 1 -- 172.21.15.114:0/4082775173 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f7ddc1f0800 con 0x7f7ddc152c50 2024-02-17T12:19:48.495 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:48.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 -- 172.21.15.114:0/4082775173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7dbc066e40 msgr2=0x7f7dbc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7dbc066e40 0x7f7dbc069300 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0c1b00 tx=0x7f7dcc009190 comp rx=0 tx=0).stop 2024-02-17T12:19:48.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 -- 172.21.15.114:0/4082775173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc152c50 msgr2=0x7f7ddc13efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc152c50 0x7f7ddc13efe0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ab000 tx=0x7f7dd4019680 comp rx=0 tx=0).stop 2024-02-17T12:19:48.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 -- 172.21.15.114:0/4082775173 shutdown_connections 2024-02-17T12:19:48.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7dbc066e40 0x7f7dbc069300 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ddc152c50 0x7f7ddc13efe0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7ddc0c25a0 0x7f7ddc13eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 --2- 172.21.15.114:0/4082775173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ddc06db50 0x7f7ddc144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 -- 172.21.15.114:0/4082775173 >> 172.21.15.114:0/4082775173 conn(0x7f7ddc0a8490 msgr2=0x7f7ddc141f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:48.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 -- 172.21.15.114:0/4082775173 shutdown_connections 2024-02-17T12:19:48.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.492+0000 7f7de3c00640 1 -- 172.21.15.114:0/4082775173 wait complete. 2024-02-17T12:19:48.516 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:19:48.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5336c00640 1 Processor -- start 2024-02-17T12:19:48.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5336c00640 1 -- start start 2024-02-17T12:19:48.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5336c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5330152510 0x7f53300c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5336c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f53300c0640 0x7f533015f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5336c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533006e890 con 0x7f533006ef60 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5336c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53300c2670 con 0x7f53300c0640 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5336c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5330158370 con 0x7f5330152510 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5334c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f53300c0640 0x7f533015f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5334c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f53300c0640 0x7f533015f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35644/0 (socket says 172.21.15.114:35644) 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5334c00640 1 -- 172.21.15.114:0/2040845891 learned_addr learned my addr 172.21.15.114:0/2040845891 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f532fe00640 1 --2- 172.21.15.114:0/2040845891 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5330152510 0x7f53300c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5334c00640 1 -- 172.21.15.114:0/2040845891 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5330152510 msgr2=0x7f53300c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5334c00640 1 --2- 172.21.15.114:0/2040845891 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5330152510 0x7f53300c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5334c00640 1 -- 172.21.15.114:0/2040845891 >> v1:172.21.15.116:6789/0 conn(0x7f533006ef60 legacy=0x7f5330158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.652+0000 7f5334c00640 1 -- 172.21.15.114:0/2040845891 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533006e5b0 con 0x7f53300c0640 2024-02-17T12:19:48.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f5334c00640 1 --2- 172.21.15.114:0/2040845891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53300c0640 0x7f533015f670 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f5328009870 tx=0x7f532801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882041925ae30160 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f532ea00640 1 -- 172.21.15.114:0/2040845891 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53280a6040 con 0x7f53300c0640 2024-02-17T12:19:48.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f532ea00640 1 -- 172.21.15.114:0/2040845891 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53280aa600 con 0x7f53300c0640 2024-02-17T12:19:48.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f532ea00640 1 -- 172.21.15.114:0/2040845891 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53280aa990 con 0x7f53300c0640 2024-02-17T12:19:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f5336c00640 1 -- 172.21.15.114:0/2040845891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53300c0640 msgr2=0x7f533015f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f5336c00640 1 --2- 172.21.15.114:0/2040845891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53300c0640 0x7f533015f670 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f5328009870 tx=0x7f532801c4a0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f5336c00640 1 -- 172.21.15.114:0/2040845891 shutdown_connections 2024-02-17T12:19:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f5336c00640 1 --2- 172.21.15.114:0/2040845891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53300c0640 0x7f533015f670 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f5336c00640 1 --2- 172.21.15.114:0/2040845891 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5330152510 0x7f53300c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f5336c00640 1 -- 172.21.15.114:0/2040845891 >> 172.21.15.114:0/2040845891 conn(0x7f53300a8490 msgr2=0x7f53300a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f5336c00640 1 -- 172.21.15.114:0/2040845891 shutdown_connections 2024-02-17T12:19:48.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.656+0000 7f5336c00640 1 -- 172.21.15.114:0/2040845891 wait complete. 2024-02-17T12:19:48.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 Processor -- start 2024-02-17T12:19:48.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 -- start start 2024-02-17T12:19:48.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f533006ef60 0x7f53300ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53300c0640 0x7f5330148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5330152510 0x7f5330149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533014d520 con 0x7f533006ef60 2024-02-17T12:19:48.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300731d0 con 0x7f53300c0640 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5330072760 con 0x7f5330152510 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f533006ef60 0x7f53300ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f533006ef60 0x7f53300ab0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35660/0 (socket says 172.21.15.114:35660) 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532fe00640 1 -- 172.21.15.114:0/3142652152 learned_addr learned my addr 172.21.15.114:0/3142652152 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5334c00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5330152510 0x7f5330149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532f400640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53300c0640 0x7f5330148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532fe00640 1 -- 172.21.15.114:0/3142652152 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5330152510 msgr2=0x7f5330149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532fe00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5330152510 0x7f5330149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532fe00640 1 -- 172.21.15.114:0/3142652152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53300c0640 msgr2=0x7f5330148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532fe00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53300c0640 0x7f5330148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532fe00640 1 -- 172.21.15.114:0/3142652152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53280094d0 con 0x7f533006ef60 2024-02-17T12:19:48.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532f400640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53300c0640 0x7f5330148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f532fe00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f533006ef60 0x7f53300ab0c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f5320007ef0 tx=0x7f532000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5327e00640 1 -- 172.21.15.114:0/3142652152 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320014620 con 0x7f533006ef60 2024-02-17T12:19:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5327e00640 1 -- 172.21.15.114:0/3142652152 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5320014780 con 0x7f533006ef60 2024-02-17T12:19:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 -- 172.21.15.114:0/3142652152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53300c3f60 con 0x7f533006ef60 2024-02-17T12:19:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5327e00640 1 -- 172.21.15.114:0/3142652152 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320014b30 con 0x7f533006ef60 2024-02-17T12:19:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 -- 172.21.15.114:0/3142652152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53300729d0 con 0x7f533006ef60 2024-02-17T12:19:48.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.660+0000 7f5336c00640 1 -- 172.21.15.114:0/3142652152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5330074840 con 0x7f533006ef60 2024-02-17T12:19:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.664+0000 7f5327e00640 1 -- 172.21.15.114:0/3142652152 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f5320014c90 con 0x7f533006ef60 2024-02-17T12:19:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.664+0000 7f5327e00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f530c066e40 0x7f530c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.664+0000 7f5327e00640 1 -- 172.21.15.114:0/3142652152 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5320085740 con 0x7f533006ef60 2024-02-17T12:19:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.664+0000 7f532f400640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f530c066e40 0x7f530c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.664+0000 7f532f400640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f530c066e40 0x7f530c069300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f53300c6340 tx=0x7f5318009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.668+0000 7f5327e00640 1 -- 172.21.15.114:0/3142652152 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53200521c0 con 0x7f533006ef60 2024-02-17T12:19:48.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.824+0000 7f5336c00640 1 -- 172.21.15.114:0/3142652152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f53300c0420 con 0x7f533006ef60 2024-02-17T12:19:48.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.824+0000 7f5327e00640 1 -- 172.21.15.114:0/3142652152 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7f5320055880 con 0x7f533006ef60 2024-02-17T12:19:48.828 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.824+0000 7f5336c00640 1 -- 172.21.15.114:0/3142652152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f530c066e40 msgr2=0x7f530c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.824+0000 7f5336c00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f530c066e40 0x7f530c069300 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f53300c6340 tx=0x7f5318009040 comp rx=0 tx=0).stop 2024-02-17T12:19:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.824+0000 7f5336c00640 1 -- 172.21.15.114:0/3142652152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f533006ef60 msgr2=0x7f53300ab0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.824+0000 7f5336c00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f533006ef60 0x7f53300ab0c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f5320007ef0 tx=0x7f532000e4b0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.828+0000 7f5336c00640 1 -- 172.21.15.114:0/3142652152 shutdown_connections 2024-02-17T12:19:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.828+0000 7f5336c00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5330152510 0x7f5330149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.828+0000 7f5336c00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53300c0640 0x7f5330148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.828+0000 7f5336c00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f530c066e40 0x7f530c069300 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.828+0000 7f5336c00640 1 --2- 172.21.15.114:0/3142652152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f533006ef60 0x7f53300ab0c0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.828+0000 7f5336c00640 1 -- 172.21.15.114:0/3142652152 >> 172.21.15.114:0/3142652152 conn(0x7f53300a8490 msgr2=0x7f53300a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:48.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.828+0000 7f5336c00640 1 -- 172.21.15.114:0/3142652152 shutdown_connections 2024-02-17T12:19:48.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.828+0000 7f5336c00640 1 -- 172.21.15.114:0/3142652152 wait complete. 2024-02-17T12:19:48.849 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-17T12:19:48.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.980+0000 7f07a9200640 1 Processor -- start 2024-02-17T12:19:48.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.980+0000 7f07a9200640 1 -- start start 2024-02-17T12:19:48.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.980+0000 7f07a9200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 0x7f07a414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.980+0000 7f07a9200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f07a4150490 0x7f07a4152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.980+0000 7f07a9200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a4156270 con 0x7f07a40c25a0 2024-02-17T12:19:48.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.980+0000 7f07a9200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a406f090 con 0x7f07a4150490 2024-02-17T12:19:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.980+0000 7f07a9200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a4071630 con 0x7f07a406db50 2024-02-17T12:19:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f07a4150490 0x7f07a4152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f07a4150490 0x7f07a4152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35662/0 (socket says 172.21.15.114:35662) 2024-02-17T12:19:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a2800640 1 -- 172.21.15.114:0/545099922 learned_addr learned my addr 172.21.15.114:0/545099922 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a1400640 1 --2- 172.21.15.114:0/545099922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 0x7f07a414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a2800640 1 -- 172.21.15.114:0/545099922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 msgr2=0x7f07a414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:48.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a2800640 1 --2- 172.21.15.114:0/545099922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 0x7f07a414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a2800640 1 -- 172.21.15.114:0/545099922 >> v1:172.21.15.114:6789/0 conn(0x7f07a40c25a0 legacy=0x7f07a406e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a2800640 1 -- 172.21.15.114:0/545099922 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4156550 con 0x7f07a4150490 2024-02-17T12:19:48.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a1400640 1 --2- 172.21.15.114:0/545099922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 0x7f07a414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a2800640 1 --2- 172.21.15.114:0/545099922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 0x7f07a4152c50 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f079c009870 tx=0x7f079c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c8eaeb484d302e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a0a00640 1 -- 172.21.15.114:0/545099922 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a41539a0 con 0x7f07a4150490 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a0a00640 1 -- 172.21.15.114:0/545099922 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c0ab610 con 0x7f07a4150490 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.984+0000 7f07a0a00640 1 -- 172.21.15.114:0/545099922 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c0ab9a0 con 0x7f07a4150490 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 -- 172.21.15.114:0/545099922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 msgr2=0x7f07a4152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 --2- 172.21.15.114:0/545099922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 0x7f07a4152c50 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f079c009870 tx=0x7f079c01c410 comp rx=0 tx=0).stop 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 -- 172.21.15.114:0/545099922 shutdown_connections 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 --2- 172.21.15.114:0/545099922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 0x7f07a4152c50 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 --2- 172.21.15.114:0/545099922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 0x7f07a414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 -- 172.21.15.114:0/545099922 >> 172.21.15.114:0/545099922 conn(0x7f07a40a8490 msgr2=0x7f07a40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:48.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 -- 172.21.15.114:0/545099922 shutdown_connections 2024-02-17T12:19:48.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 -- 172.21.15.114:0/545099922 wait complete. 2024-02-17T12:19:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 Processor -- start 2024-02-17T12:19:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 -- start start 2024-02-17T12:19:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 0x7f07a40c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07a40c25a0 0x7f07a4141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 0x7f07a41421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a4155f80 con 0x7f07a4150490 2024-02-17T12:19:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a4148450 con 0x7f07a40c25a0 2024-02-17T12:19:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a41559c0 con 0x7f07a406db50 2024-02-17T12:19:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 0x7f07a41421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 0x7f07a41421a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35668/0 (socket says 172.21.15.114:35668) 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a2800640 1 -- 172.21.15.114:0/1364176663 learned_addr learned my addr 172.21.15.114:0/1364176663 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a2800640 1 -- 172.21.15.114:0/1364176663 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 msgr2=0x7f07a40c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a1e00640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 0x7f07a40c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a1400640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07a40c25a0 0x7f07a4141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a2800640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 0x7f07a40c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a2800640 1 -- 172.21.15.114:0/1364176663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07a40c25a0 msgr2=0x7f07a4141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a2800640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07a40c25a0 0x7f07a4141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a2800640 1 -- 172.21.15.114:0/1364176663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c0094d0 con 0x7f07a4150490 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a1e00640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 0x7f07a40c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a1400640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07a40c25a0 0x7f07a4141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a2800640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 0x7f07a41421a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f079c0ad040 tx=0x7f079c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f079a000640 1 -- 172.21.15.114:0/1364176663 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c0b4800 con 0x7f07a4150490 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f079a000640 1 -- 172.21.15.114:0/1364176663 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c0b4980 con 0x7f07a4150490 2024-02-17T12:19:48.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f079a000640 1 -- 172.21.15.114:0/1364176663 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c0b4d30 con 0x7f07a4150490 2024-02-17T12:19:48.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.988+0000 7f07a9200640 1 -- 172.21.15.114:0/1364176663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a4155ca0 con 0x7f07a4150490 2024-02-17T12:19:48.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.992+0000 7f07a9200640 1 -- 172.21.15.114:0/1364176663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a4155120 con 0x7f07a4150490 2024-02-17T12:19:48.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.992+0000 7f07a9200640 1 -- 172.21.15.114:0/1364176663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a4074840 con 0x7f07a4150490 2024-02-17T12:19:48.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.992+0000 7f079a000640 1 -- 172.21.15.114:0/1364176663 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f079c0c7440 con 0x7f07a4150490 2024-02-17T12:19:48.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.992+0000 7f079a000640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0784066e40 0x7f0784069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:48.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.992+0000 7f079a000640 1 -- 172.21.15.114:0/1364176663 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f079c11f9f0 con 0x7f07a4150490 2024-02-17T12:19:48.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.992+0000 7f07a1e00640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0784066e40 0x7f0784069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:48.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.992+0000 7f07a1e00640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0784066e40 0x7f0784069300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0794007fd0 tx=0x7f0794009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:49.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:48.996+0000 7f079a000640 1 -- 172.21.15.114:0/1364176663 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f079c0ec470 con 0x7f07a4150490 2024-02-17T12:19:49.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.160+0000 7f07a9200640 1 -- 172.21.15.114:0/1364176663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f07a4154900 con 0x7f07a4150490 2024-02-17T12:19:49.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.160+0000 7f079a000640 1 -- 172.21.15.114:0/1364176663 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f079c0efb30 con 0x7f07a4150490 2024-02-17T12:19:49.165 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-02-17T12:19:49.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 -- 172.21.15.114:0/1364176663 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0784066e40 msgr2=0x7f0784069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:49.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0784066e40 0x7f0784069300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0794007fd0 tx=0x7f0794009040 comp rx=0 tx=0).stop 2024-02-17T12:19:49.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 -- 172.21.15.114:0/1364176663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 msgr2=0x7f07a41421a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:49.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 0x7f07a41421a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f079c0ad040 tx=0x7f079c01ac50 comp rx=0 tx=0).stop 2024-02-17T12:19:49.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 -- 172.21.15.114:0/1364176663 shutdown_connections 2024-02-17T12:19:49.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0784066e40 0x7f0784069300 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07a4150490 0x7f07a41421a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07a40c25a0 0x7f07a4141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 --2- 172.21.15.114:0/1364176663 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07a406db50 0x7f07a40c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 -- 172.21.15.114:0/1364176663 >> 172.21.15.114:0/1364176663 conn(0x7f07a40a8490 msgr2=0x7f07a4072c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:49.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 -- 172.21.15.114:0/1364176663 shutdown_connections 2024-02-17T12:19:49.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.164+0000 7f07a9200640 1 -- 172.21.15.114:0/1364176663 wait complete. 2024-02-17T12:19:49.187 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2024-02-17T12:19:49.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:49.187 DEBUG:teuthology.orchestra.run.smithi116:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-17T12:19:49.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:19:49.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:19:49.216 DEBUG:teuthology.orchestra.run.smithi116:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-17T12:19:49.267 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-17T12:19:49.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:19:49.348 DEBUG:teuthology.orchestra.run.smithi116:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-17T12:19:49.452 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-17T12:19:49.453 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:19:49.453 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:49.461 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354568k,nr_inodes=4088642,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2004 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-17T12:19:49.461 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:19:49.461 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:19:49.470 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3897 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-02-17T12:19:49.470 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:19:49.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5c3a00640 1 Processor -- start 2024-02-17T12:19:49.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5c3a00640 1 -- start start 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5c3a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc152560 0x7fa5bc0c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5c3a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5bc072b20 0x7fa5bc0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5c3a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0723b0 con 0x7fa5bc0c4760 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5c3a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc070000 con 0x7fa5bc072b20 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5c3a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc154dc0 con 0x7fa5bc152560 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5bbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5bc072b20 0x7fa5bc0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5bbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5bc072b20 0x7fa5bc0c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35680/0 (socket says 172.21.15.114:35680) 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5c1a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa5bc0c4760 0x7fa5bc1586f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37244/0 (socket says 172.21.15.114:37244) 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5bbe00640 1 -- 172.21.15.114:0/1806357531 learned_addr learned my addr 172.21.15.114:0/1806357531 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5c1000640 1 --2- 172.21.15.114:0/1806357531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc152560 0x7fa5bc0c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5bbe00640 1 -- 172.21.15.114:0/1806357531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc152560 msgr2=0x7fa5bc0c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5bbe00640 1 --2- 172.21.15.114:0/1806357531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc152560 0x7fa5bc0c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5bbe00640 1 -- 172.21.15.114:0/1806357531 >> v1:172.21.15.114:6789/0 conn(0x7fa5bc0c4760 legacy=0x7fa5bc1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:49.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5bbe00640 1 -- 172.21.15.114:0/1806357531 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0728e0 con 0x7fa5bc072b20 2024-02-17T12:19:49.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5c1000640 1 --2- 172.21.15.114:0/1806357531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc152560 0x7fa5bc0c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:49.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.636+0000 7fa5bb400640 1 -- 172.21.15.114:0/1806357531 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374489714 0 0) 0x7fa5bc0723b0 con 0x7fa5bc0c4760 2024-02-17T12:19:49.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5bbe00640 1 --2- 172.21.15.114:0/1806357531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 0x7fa5bc0c4220 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009e50 tx=0x7fa5a401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fae1d68a1702c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:49.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5bb400640 1 -- 172.21.15.114:0/1806357531 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40a5660 con 0x7fa5bc072b20 2024-02-17T12:19:49.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5bb400640 1 -- 172.21.15.114:0/1806357531 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a40a57c0 con 0x7fa5bc072b20 2024-02-17T12:19:49.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5bb400640 1 -- 172.21.15.114:0/1806357531 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40a5b50 con 0x7fa5bc072b20 2024-02-17T12:19:49.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5c3a00640 1 -- 172.21.15.114:0/1806357531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 msgr2=0x7fa5bc0c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:49.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5c3a00640 1 --2- 172.21.15.114:0/1806357531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 0x7fa5bc0c4220 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009e50 tx=0x7fa5a401c9a0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5c3a00640 1 -- 172.21.15.114:0/1806357531 shutdown_connections 2024-02-17T12:19:49.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5c3a00640 1 --2- 172.21.15.114:0/1806357531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 0x7fa5bc0c4220 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5c3a00640 1 --2- 172.21.15.114:0/1806357531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc152560 0x7fa5bc0c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5c3a00640 1 -- 172.21.15.114:0/1806357531 >> 172.21.15.114:0/1806357531 conn(0x7fa5bc06bef0 msgr2=0x7fa5bc06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:49.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5c3a00640 1 -- 172.21.15.114:0/1806357531 shutdown_connections 2024-02-17T12:19:49.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.640+0000 7fa5c3a00640 1 -- 172.21.15.114:0/1806357531 wait complete. 2024-02-17T12:19:49.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 Processor -- start 2024-02-17T12:19:49.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 -- start start 2024-02-17T12:19:49.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 0x7fa5bc0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:49.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc0c4760 0x7fa5bc14c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:49.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5bc152560 0x7fa5bc1eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:49.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1463d0 con 0x7fa5bc072b20 2024-02-17T12:19:49.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc14a340 con 0x7fa5bc152560 2024-02-17T12:19:49.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1f1e50 con 0x7fa5bc0c4760 2024-02-17T12:19:49.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 0x7fa5bc0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:49.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 0x7fa5bc0a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35684/0 (socket says 172.21.15.114:35684) 2024-02-17T12:19:49.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c1000640 1 -- 172.21.15.114:0/929115481 learned_addr learned my addr 172.21.15.114:0/929115481 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:49.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5bbe00640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc0c4760 0x7fa5bc14c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c1000640 1 -- 172.21.15.114:0/929115481 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc0c4760 msgr2=0x7fa5bc14c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c1000640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc0c4760 0x7fa5bc14c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c1000640 1 -- 172.21.15.114:0/929115481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5bc152560 msgr2=0x7fa5bc1eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c1000640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5bc152560 0x7fa5bc1eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c1000640 1 -- 172.21.15.114:0/929115481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4009b30 con 0x7fa5bc072b20 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c1000640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 0x7fa5bc0a98e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00e810 tx=0x7fa5ac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5b8c00640 1 -- 172.21.15.114:0/929115481 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00c8d0 con 0x7fa5bc072b20 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5b8c00640 1 -- 172.21.15.114:0/929115481 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac00ca30 con 0x7fa5bc072b20 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 -- 172.21.15.114:0/929115481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc1f1b70 con 0x7fa5bc072b20 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5b8c00640 1 -- 172.21.15.114:0/929115481 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00cde0 con 0x7fa5bc072b20 2024-02-17T12:19:49.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 -- 172.21.15.114:0/929115481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc14ae00 con 0x7fa5bc072b20 2024-02-17T12:19:49.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.644+0000 7fa5c3a00640 1 -- 172.21.15.114:0/929115481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc067370 con 0x7fa5bc072b20 2024-02-17T12:19:49.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.648+0000 7fa5b8c00640 1 -- 172.21.15.114:0/929115481 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa5ac013410 con 0x7fa5bc072b20 2024-02-17T12:19:49.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.648+0000 7fa5b8c00640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa598066e40 0x7fa598069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:49.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.648+0000 7fa5b8c00640 1 -- 172.21.15.114:0/929115481 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa5ac084cb0 con 0x7fa5bc072b20 2024-02-17T12:19:49.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.648+0000 7fa5bbe00640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa598066e40 0x7fa598069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:49.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.648+0000 7fa5bbe00640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa598066e40 0x7fa598069300 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40ae000 tx=0x7fa5a40a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:49.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.652+0000 7fa5b8c00640 1 -- 172.21.15.114:0/929115481 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa5ac051610 con 0x7fa5bc072b20 2024-02-17T12:19:49.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 -- 172.21.15.114:0/929115481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5bc074840 con 0x7fa5bc072b20 2024-02-17T12:19:49.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5b8c00640 1 -- 172.21.15.114:0/929115481 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6187 (secure 0 0 0) 0x7fa5ac021090 con 0x7fa5bc072b20 2024-02-17T12:19:49.843 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:49.843 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:04.061245+0000","modified":"2024-02-17T12:19:07.080013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/709959478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":709959478},{"type":"v1","addr":"172.21.15.114:6837","nonce":709959478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:21.726155+0000","modified":"2024-02-17T12:19:24.747374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1982789506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1982789506},{"type":"v1","addr":"172.21.15.114:6836","nonce":1982789506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-02-17T12:19:49.844 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 53 2024-02-17T12:19:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 -- 172.21.15.114:0/929115481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa598066e40 msgr2=0x7fa598069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa598066e40 0x7fa598069300 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40ae000 tx=0x7fa5a40a7070 comp rx=0 tx=0).stop 2024-02-17T12:19:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 -- 172.21.15.114:0/929115481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 msgr2=0x7fa5bc0a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:49.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 0x7fa5bc0a98e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00e810 tx=0x7fa5ac00ecd0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 -- 172.21.15.114:0/929115481 shutdown_connections 2024-02-17T12:19:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5bc152560 0x7fa5bc1eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa5bc0c4760 0x7fa5bc14c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa598066e40 0x7fa598069300 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 --2- 172.21.15.114:0/929115481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5bc072b20 0x7fa5bc0a98e0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 -- 172.21.15.114:0/929115481 >> 172.21.15.114:0/929115481 conn(0x7fa5bc06bef0 msgr2=0x7fa5bc1586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 -- 172.21.15.114:0/929115481 shutdown_connections 2024-02-17T12:19:49.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.840+0000 7fa5c3a00640 1 -- 172.21.15.114:0/929115481 wait complete. 2024-02-17T12:19:49.864 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:49.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdfe00640 1 Processor -- start 2024-02-17T12:19:49.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdfe00640 1 -- start start 2024-02-17T12:19:50.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdfe00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2fd80c25a0 0x7f2fd806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdfe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd8156270 con 0x7f2fd806db50 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdfe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd8156550 con 0x7f2fd8152c50 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdfe00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd8071630 con 0x7f2fd80c25a0 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdca00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2fd806db50 0x7f2fd814ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37248/0 (socket says 172.21.15.114:37248) 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdca00640 1 -- 172.21.15.114:0/1814941038 learned_addr learned my addr 172.21.15.114:0/1814941038 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdd400640 1 --2- 172.21.15.114:0/1814941038 >> v2:172.21.15.116:3300/0 conn(0x7f2fd80c25a0 0x7f2fd806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56055457 0 0) 0x7f2fd8156270 con 0x7f2fd806db50 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc0003530 con 0x7f2fd806db50 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412031912 0 0) 0x7f2fd8156550 con 0x7f2fd8152c50 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fd8156270 con 0x7f2fd8152c50 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838941550 0 0) 0x7f2fc0003530 con 0x7f2fd806db50 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 >> v2:172.21.15.116:3300/0 conn(0x7f2fd80c25a0 msgr2=0x7f2fd806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 --2- 172.21.15.114:0/1814941038 >> v2:172.21.15.116:3300/0 conn(0x7f2fd80c25a0 0x7f2fd806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 >> v1:172.21.15.116:6789/0 conn(0x7f2fd8152c50 legacy=0x7f2fd8153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8156830 con 0x7f2fd806db50 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f2fc4001680 con 0x7f2fd806db50 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 >> v1:172.21.15.114:6789/0 conn(0x7f2fd806db50 legacy=0x7f2fd814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 0x7f2fc0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2fc00047d0 0x7f2fc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fc0005200 0x7f2fc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc000c130 con 0x7f2fc0005200 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc000c2a0 con 0x7f2fc0003b10 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc000c460 con 0x7f2fc00047d0 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdd400640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 0x7f2fc0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdde00640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fc0005200 0x7f2fc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdca00640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2fc00047d0 0x7f2fc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdd400640 1 -- 172.21.15.114:0/1814941038 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2fc00047d0 msgr2=0x7f2fc0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:50.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdd400640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2fc00047d0 0x7f2fc0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdd400640 1 -- 172.21.15.114:0/1814941038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fc0005200 msgr2=0x7f2fc000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:50.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdd400640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fc0005200 0x7f2fc000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdd400640 1 -- 172.21.15.114:0/1814941038 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc0003530 con 0x7f2fc0003b10 2024-02-17T12:19:50.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdde00640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fc0005200 0x7f2fc000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:50.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:49.996+0000 7f2fdde00640 1 -- 172.21.15.114:0/1814941038 reap_dead start 2024-02-17T12:19:50.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fdd400640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 0x7f2fc0003f10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009ae0 tx=0x7f2fcc01ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aa25dfa4906b6e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:50.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0a55f0 con 0x7f2fc0003b10 2024-02-17T12:19:50.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc0a5750 con 0x7f2fc0003b10 2024-02-17T12:19:50.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fd7e00640 1 -- 172.21.15.114:0/1814941038 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0a5b00 con 0x7f2fc0003b10 2024-02-17T12:19:50.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fdfe00640 1 -- 172.21.15.114:0/1814941038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 msgr2=0x7f2fc0003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fdfe00640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 0x7f2fc0003f10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009ae0 tx=0x7f2fcc01ca00 comp rx=0 tx=0).stop 2024-02-17T12:19:50.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fdfe00640 1 -- 172.21.15.114:0/1814941038 shutdown_connections 2024-02-17T12:19:50.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fdfe00640 1 --2- 172.21.15.114:0/1814941038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 0x7f2fc0003f10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fdfe00640 1 -- 172.21.15.114:0/1814941038 >> 172.21.15.114:0/1814941038 conn(0x7f2fd80a8490 msgr2=0x7f2fd80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:50.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fdfe00640 1 -- 172.21.15.114:0/1814941038 shutdown_connections 2024-02-17T12:19:50.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.000+0000 7f2fdfe00640 1 -- 172.21.15.114:0/1814941038 wait complete. 2024-02-17T12:19:50.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdfe00640 1 Processor -- start 2024-02-17T12:19:50.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdfe00640 1 -- start start 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdfe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 0x7f2fd81440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fd80a9d90 0x7f2fd80bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdfe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2fd80bfce0 0x7f2fd81f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdfe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80aafc0 con 0x7f2fd80a9d90 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdfe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd81ecd00 con 0x7f2fc0003b10 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdfe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd81445e0 con 0x7f2fd80bfce0 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fd80a9d90 0x7f2fd80bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fd80a9d90 0x7f2fd80bf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35704/0 (socket says 172.21.15.114:35704) 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdca00640 1 -- 172.21.15.114:0/964001578 learned_addr learned my addr 172.21.15.114:0/964001578 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdd400640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 0x7f2fd81440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdde00640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2fd80bfce0 0x7f2fd81f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdca00640 1 -- 172.21.15.114:0/964001578 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2fd80bfce0 msgr2=0x7f2fd81f0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdca00640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2fd80bfce0 0x7f2fd81f0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdca00640 1 -- 172.21.15.114:0/964001578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 msgr2=0x7f2fd81440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdca00640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 0x7f2fd81440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdca00640 1 -- 172.21.15.114:0/964001578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8155760 con 0x7f2fd80a9d90 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdca00640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fd80a9d90 0x7f2fd80bf7a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4004fb0 tx=0x7f2fc40074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fd5600640 1 -- 172.21.15.114:0/964001578 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4007740 con 0x7f2fd80a9d90 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fd5600640 1 -- 172.21.15.114:0/964001578 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc400f9c0 con 0x7f2fd80a9d90 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdfe00640 1 -- 172.21.15.114:0/964001578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd814f680 con 0x7f2fd80a9d90 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fd5600640 1 -- 172.21.15.114:0/964001578 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc400fd30 con 0x7f2fd80a9d90 2024-02-17T12:19:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.004+0000 7f2fdfe00640 1 -- 172.21.15.114:0/964001578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd81553f0 con 0x7f2fd80a9d90 2024-02-17T12:19:50.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.008+0000 7f2fdfe00640 1 -- 172.21.15.114:0/964001578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd81555b0 con 0x7f2fd80a9d90 2024-02-17T12:19:50.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.008+0000 7f2fd5600640 1 -- 172.21.15.114:0/964001578 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2fc401f440 con 0x7f2fd80a9d90 2024-02-17T12:19:50.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.008+0000 7f2fd5600640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fb8066e40 0x7f2fb8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.008+0000 7f2fd5600640 1 -- 172.21.15.114:0/964001578 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2fc40848a0 con 0x7f2fd80a9d90 2024-02-17T12:19:50.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.008+0000 7f2fdd400640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fb8066e40 0x7f2fb8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.008+0000 7f2fdd400640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fb8066e40 0x7f2fb8069300 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0af000 tx=0x7f2fcc0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:50.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.012+0000 7f2fd5600640 1 -- 172.21.15.114:0/964001578 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2fc4051470 con 0x7f2fd80a9d90 2024-02-17T12:19:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.172+0000 7f2fdfe00640 1 -- 172.21.15.114:0/964001578 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fd8074840 con 0x7f2fd80a9d90 2024-02-17T12:19:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.172+0000 7f2fd5600640 1 -- 172.21.15.114:0/964001578 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20392 (secure 0 0 0) 0x7f2fc401a090 con 0x7f2fd80a9d90 2024-02-17T12:19:50.177 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:50.177 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:23.364663+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 -- 172.21.15.114:0/964001578 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fb8066e40 msgr2=0x7f2fb8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fb8066e40 0x7f2fb8069300 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0af000 tx=0x7f2fcc0046d0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 -- 172.21.15.114:0/964001578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fd80a9d90 msgr2=0x7f2fd80bf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fd80a9d90 0x7f2fd80bf7a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4004fb0 tx=0x7f2fc40074f0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 -- 172.21.15.114:0/964001578 shutdown_connections 2024-02-17T12:19:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2fd80bfce0 0x7f2fd81f0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2fb8066e40 0x7f2fb8069300 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2fd80a9d90 0x7f2fd80bf7a0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 --2- 172.21.15.114:0/964001578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fc0003b10 0x7f2fd81440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 -- 172.21.15.114:0/964001578 >> 172.21.15.114:0/964001578 conn(0x7f2fd80a8490 msgr2=0x7f2fd80a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 -- 172.21.15.114:0/964001578 shutdown_connections 2024-02-17T12:19:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.176+0000 7f2fdfe00640 1 -- 172.21.15.114:0/964001578 wait complete. 2024-02-17T12:19:50.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-17T12:19:01.796651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-02-17T12:19:03.070707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:19:19.573884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:19:20.731260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:19:50.199 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:19:50.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.336+0000 7f50f8800640 1 Processor -- start 2024-02-17T12:19:50.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.336+0000 7f50f8800640 1 -- start start 2024-02-17T12:19:50.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.336+0000 7f50f8800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f50f006db50 0x7f50f014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.336+0000 7f50f8800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f0150490 0x7f50f0152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f8800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f0156270 con 0x7f50f00c25a0 2024-02-17T12:19:50.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f8800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f006f090 con 0x7f50f006db50 2024-02-17T12:19:50.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f8800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f0071630 con 0x7f50f0150490 2024-02-17T12:19:50.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f5e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f50f00c25a0 0x7f50f006e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37250/0 (socket says 172.21.15.114:37250) 2024-02-17T12:19:50.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f5e00640 1 -- 172.21.15.114:0/2989366221 learned_addr learned my addr 172.21.15.114:0/2989366221 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:50.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f6800640 1 --2- 172.21.15.114:0/2989366221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f0150490 0x7f50f0152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f5400640 1 --2- 172.21.15.114:0/2989366221 >> v2:172.21.15.116:3300/0 conn(0x7f50f006db50 0x7f50f014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f6800640 1 -- 172.21.15.114:0/2989366221 >> v2:172.21.15.116:3300/0 conn(0x7f50f006db50 msgr2=0x7f50f014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:50.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f6800640 1 --2- 172.21.15.114:0/2989366221 >> v2:172.21.15.116:3300/0 conn(0x7f50f006db50 0x7f50f014ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f6800640 1 -- 172.21.15.114:0/2989366221 >> v1:172.21.15.114:6789/0 conn(0x7f50f00c25a0 legacy=0x7f50f006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f4a00640 1 -- 172.21.15.114:0/2989366221 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646023496 0 0) 0x7f50f0156270 con 0x7f50f00c25a0 2024-02-17T12:19:50.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f6800640 1 -- 172.21.15.114:0/2989366221 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f0156550 con 0x7f50f0150490 2024-02-17T12:19:50.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f6800640 1 --2- 172.21.15.114:0/2989366221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f0150490 0x7f50f0152c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009d90 tx=0x7f50ec01c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ebd043c9bcfd869 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:50.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f4a00640 1 -- 172.21.15.114:0/2989366221 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f01539a0 con 0x7f50f0150490 2024-02-17T12:19:50.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f4a00640 1 -- 172.21.15.114:0/2989366221 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec0a58e0 con 0x7f50f0150490 2024-02-17T12:19:50.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.340+0000 7f50f4a00640 1 -- 172.21.15.114:0/2989366221 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec0a5c70 con 0x7f50f0150490 2024-02-17T12:19:50.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 -- 172.21.15.114:0/2989366221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f0150490 msgr2=0x7f50f0152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 --2- 172.21.15.114:0/2989366221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f0150490 0x7f50f0152c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009d90 tx=0x7f50ec01c820 comp rx=0 tx=0).stop 2024-02-17T12:19:50.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 -- 172.21.15.114:0/2989366221 shutdown_connections 2024-02-17T12:19:50.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 --2- 172.21.15.114:0/2989366221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f0150490 0x7f50f0152c50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 --2- 172.21.15.114:0/2989366221 >> v2:172.21.15.116:3300/0 conn(0x7f50f006db50 0x7f50f014ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 -- 172.21.15.114:0/2989366221 >> 172.21.15.114:0/2989366221 conn(0x7f50f00a8490 msgr2=0x7f50f00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:50.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 -- 172.21.15.114:0/2989366221 shutdown_connections 2024-02-17T12:19:50.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 -- 172.21.15.114:0/2989366221 wait complete. 2024-02-17T12:19:50.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 Processor -- start 2024-02-17T12:19:50.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 -- start start 2024-02-17T12:19:50.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50f006db50 0x7f50f013e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f00c25a0 0x7f50f01420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f0150490 0x7f50f0140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f01eab20 con 0x7f50f0150490 2024-02-17T12:19:50.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f0140150 con 0x7f50f006db50 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f8800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f01eada0 con 0x7f50f00c25a0 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f0150490 0x7f50f0140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f0150490 0x7f50f0140a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35710/0 (socket says 172.21.15.114:35710) 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f6800640 1 -- 172.21.15.114:0/1192352974 learned_addr learned my addr 172.21.15.114:0/1192352974 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f5400640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f00c25a0 0x7f50f01420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f5e00640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50f006db50 0x7f50f013e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f6800640 1 -- 172.21.15.114:0/1192352974 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f00c25a0 msgr2=0x7f50f01420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f6800640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f00c25a0 0x7f50f01420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f6800640 1 -- 172.21.15.114:0/1192352974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50f006db50 msgr2=0x7f50f013e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f6800640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50f006db50 0x7f50f013e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f6800640 1 -- 172.21.15.114:0/1192352974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec009a70 con 0x7f50f0150490 2024-02-17T12:19:50.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.344+0000 7f50f6800640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f0150490 0x7f50f0140a30 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009d90 tx=0x7f50ec0195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:50.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.348+0000 7f50ea000640 1 -- 172.21.15.114:0/1192352974 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec003ba0 con 0x7f50f0150490 2024-02-17T12:19:50.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.348+0000 7f50ea000640 1 -- 172.21.15.114:0/1192352974 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec003d00 con 0x7f50f0150490 2024-02-17T12:19:50.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.348+0000 7f50ea000640 1 -- 172.21.15.114:0/1192352974 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec0b9860 con 0x7f50f0150490 2024-02-17T12:19:50.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.348+0000 7f50f8800640 1 -- 172.21.15.114:0/1192352974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f01eb080 con 0x7f50f0150490 2024-02-17T12:19:50.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.348+0000 7f50f8800640 1 -- 172.21.15.114:0/1192352974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f01eb640 con 0x7f50f0150490 2024-02-17T12:19:50.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.348+0000 7f50f8800640 1 -- 172.21.15.114:0/1192352974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f01eb830 con 0x7f50f0150490 2024-02-17T12:19:50.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.348+0000 7f50ea000640 1 -- 172.21.15.114:0/1192352974 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f50ec0b99c0 con 0x7f50f0150490 2024-02-17T12:19:50.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.348+0000 7f50ea000640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e40 0x7f50d4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.348+0000 7f50ea000640 1 -- 172.21.15.114:0/1192352974 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f50ec11fcb0 con 0x7f50f0150490 2024-02-17T12:19:50.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.348+0000 7f50f5e00640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e40 0x7f50d4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.352+0000 7f50f5e00640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e40 0x7f50d4069300 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f50e4007fd0 tx=0x7f50e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:50.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.352+0000 7f50ea000640 1 -- 172.21.15.114:0/1192352974 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f50ec0ec900 con 0x7f50f0150490 2024-02-17T12:19:50.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.508+0000 7f50f8800640 1 -- 172.21.15.114:0/1192352974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50f01eb830 con 0x7f50f0150490 2024-02-17T12:19:50.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.508+0000 7f50ea000640 1 -- 172.21.15.114:0/1192352974 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50ec0bd020 con 0x7f50f0150490 2024-02-17T12:19:50.513 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:19:50.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 -- 172.21.15.114:0/1192352974 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e40 msgr2=0x7f50d4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e40 0x7f50d4069300 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f50e4007fd0 tx=0x7f50e4009040 comp rx=0 tx=0).stop 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 -- 172.21.15.114:0/1192352974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f0150490 msgr2=0x7f50f0140a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f0150490 0x7f50f0140a30 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009d90 tx=0x7f50ec0195c0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 -- 172.21.15.114:0/1192352974 shutdown_connections 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f50d4066e40 0x7f50d4069300 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50f0150490 0x7f50f0140a30 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f50f00c25a0 0x7f50f01420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 --2- 172.21.15.114:0/1192352974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f50f006db50 0x7f50f013e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 -- 172.21.15.114:0/1192352974 >> 172.21.15.114:0/1192352974 conn(0x7f50f00a8490 msgr2=0x7f50f00c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 -- 172.21.15.114:0/1192352974 shutdown_connections 2024-02-17T12:19:50.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.512+0000 7f50f8800640 1 -- 172.21.15.114:0/1192352974 wait complete. 2024-02-17T12:19:50.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-17T12:19:50.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6ada00640 1 Processor -- start 2024-02-17T12:19:50.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6ada00640 1 -- start start 2024-02-17T12:19:50.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6ada00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb6a814e9b0 0x7fb6a80ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6ada00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a80aa150 con 0x7fb6a806ef50 2024-02-17T12:19:50.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6ada00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a80c1e90 con 0x7fb6a81519b0 2024-02-17T12:19:50.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6ada00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a814ed90 con 0x7fb6a814e9b0 2024-02-17T12:19:50.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a6000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb6a806ef50 0x7fb6a81512a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37260/0 (socket says 172.21.15.114:37260) 2024-02-17T12:19:50.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a6000640 1 -- 172.21.15.114:0/1064651523 learned_addr learned my addr 172.21.15.114:0/1064651523 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:50.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205631020 0 0) 0x7fb6a80aa150 con 0x7fb6a806ef50 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a6a00640 1 --2- 172.21.15.114:0/1064651523 >> v2:172.21.15.116:3300/0 conn(0x7fb6a814e9b0 0x7fb6a80ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb68c003530 con 0x7fb6a806ef50 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4187580542 0 0) 0x7fb68c003530 con 0x7fb6a806ef50 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 >> v2:172.21.15.116:3300/0 conn(0x7fb6a814e9b0 msgr2=0x7fb6a80ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 --2- 172.21.15.114:0/1064651523 >> v2:172.21.15.116:3300/0 conn(0x7fb6a814e9b0 0x7fb6a80ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 >> v1:172.21.15.116:6789/0 conn(0x7fb6a81519b0 legacy=0x7fb6a806dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a8152000 con 0x7fb6a806ef50 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fb694001680 con 0x7fb6a806ef50 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 >> v1:172.21.15.114:6789/0 conn(0x7fb6a806ef50 legacy=0x7fb6a81512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c003980 0x7fb68c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c004380 0x7fb68c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68c005050 0x7fb68c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a814ed90 con 0x7fb68c005050 2024-02-17T12:19:50.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c00bfb0 con 0x7fb68c003980 2024-02-17T12:19:50.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c00e380 con 0x7fb68c004380 2024-02-17T12:19:50.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a7400640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68c005050 0x7fb68c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a6000640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c004380 0x7fb68c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a6a00640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c003980 0x7fb68c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a7400640 1 -- 172.21.15.114:0/1064651523 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c004380 msgr2=0x7fb68c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:50.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a7400640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c004380 0x7fb68c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a7400640 1 -- 172.21.15.114:0/1064651523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c003980 msgr2=0x7fb68c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:50.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a7400640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb68c003980 0x7fb68c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.668+0000 7fb6a7400640 1 -- 172.21.15.114:0/1064651523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c003530 con 0x7fb68c005050 2024-02-17T12:19:50.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6a7400640 1 -- 172.21.15.114:0/1064651523 reap_dead start 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6a7400640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68c005050 0x7fb68c00b990 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0001f60 tx=0x7fb6a001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9291b6e96ebabde2 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00a6670 con 0x7fb68c005050 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a00a67d0 con 0x7fb68c005050 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6a5600640 1 -- 172.21.15.114:0/1064651523 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00a6b60 con 0x7fb68c005050 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6ada00640 1 -- 172.21.15.114:0/1064651523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68c005050 msgr2=0x7fb68c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6ada00640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68c005050 0x7fb68c00b990 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0001f60 tx=0x7fb6a001c880 comp rx=0 tx=0).stop 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6ada00640 1 -- 172.21.15.114:0/1064651523 shutdown_connections 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6ada00640 1 --2- 172.21.15.114:0/1064651523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb68c005050 0x7fb68c00b990 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6ada00640 1 -- 172.21.15.114:0/1064651523 >> 172.21.15.114:0/1064651523 conn(0x7fb6a80a8490 msgr2=0x7fb6a80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6ada00640 1 -- 172.21.15.114:0/1064651523 shutdown_connections 2024-02-17T12:19:50.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.672+0000 7fb6ada00640 1 -- 172.21.15.114:0/1064651523 wait complete. 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 Processor -- start 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 -- start start 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c005050 0x7fb6a8070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6a80729f0 0x7fb6a8143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a8152cf0 0x7fb6a80bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8153870 con 0x7fb6a8152cf0 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8150ec0 con 0x7fb6a80729f0 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8153490 con 0x7fb68c005050 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a8152cf0 0x7fb6a80bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a8152cf0 0x7fb6a80bfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35730/0 (socket says 172.21.15.114:35730) 2024-02-17T12:19:50.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a7400640 1 -- 172.21.15.114:0/1134335012 learned_addr learned my addr 172.21.15.114:0/1134335012 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a6a00640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c005050 0x7fb6a8070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a6000640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6a80729f0 0x7fb6a8143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a7400640 1 -- 172.21.15.114:0/1134335012 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c005050 msgr2=0x7fb6a8070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a7400640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c005050 0x7fb6a8070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a7400640 1 -- 172.21.15.114:0/1134335012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6a80729f0 msgr2=0x7fb6a8143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a7400640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6a80729f0 0x7fb6a8143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a7400640 1 -- 172.21.15.114:0/1134335012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a8152480 con 0x7fb6a8152cf0 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a6000640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6a80729f0 0x7fb6a8143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6a7400640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a8152cf0 0x7fb6a80bfd60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0007fd0 tx=0x7fb6a0019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb69ea00640 1 -- 172.21.15.114:0/1134335012 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0003b80 con 0x7fb6a8152cf0 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb69ea00640 1 -- 172.21.15.114:0/1134335012 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a0003ce0 con 0x7fb6a8152cf0 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb69ea00640 1 -- 172.21.15.114:0/1134335012 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0005270 con 0x7fb6a8152cf0 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 -- 172.21.15.114:0/1134335012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a8152760 con 0x7fb6a8152cf0 2024-02-17T12:19:50.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 -- 172.21.15.114:0/1134335012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a8153170 con 0x7fb6a8152cf0 2024-02-17T12:19:50.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.676+0000 7fb6ada00640 1 -- 172.21.15.114:0/1134335012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a8074840 con 0x7fb6a8152cf0 2024-02-17T12:19:50.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.680+0000 7fb69ea00640 1 -- 172.21.15.114:0/1134335012 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb6a00053d0 con 0x7fb6a8152cf0 2024-02-17T12:19:50.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.680+0000 7fb69ea00640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb688066e40 0x7fb688069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:50.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.680+0000 7fb69ea00640 1 -- 172.21.15.114:0/1134335012 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb6a011e360 con 0x7fb6a8152cf0 2024-02-17T12:19:50.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.680+0000 7fb6a6a00640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb688066e40 0x7fb688069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:50.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.680+0000 7fb6a6a00640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb688066e40 0x7fb688069300 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb698009aa0 tx=0x7fb698008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:50.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.684+0000 7fb69ea00640 1 -- 172.21.15.114:0/1134335012 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb6a00eae90 con 0x7fb6a8152cf0 2024-02-17T12:19:50.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.840+0000 7fb6ada00640 1 -- 172.21.15.114:0/1134335012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6a8072230 con 0x7fb6a8152cf0 2024-02-17T12:19:50.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.840+0000 7fb69ea00640 1 -- 172.21.15.114:0/1134335012 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6a00ee550 con 0x7fb6a8152cf0 2024-02-17T12:19:50.845 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 -- 172.21.15.114:0/1134335012 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb688066e40 msgr2=0x7fb688069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb688066e40 0x7fb688069300 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb698009aa0 tx=0x7fb698008040 comp rx=0 tx=0).stop 2024-02-17T12:19:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 -- 172.21.15.114:0/1134335012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a8152cf0 msgr2=0x7fb6a80bfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a8152cf0 0x7fb6a80bfd60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0007fd0 tx=0x7fb6a0019620 comp rx=0 tx=0).stop 2024-02-17T12:19:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 -- 172.21.15.114:0/1134335012 shutdown_connections 2024-02-17T12:19:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb688066e40 0x7fb688069300 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a8152cf0 0x7fb6a80bfd60 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6a80729f0 0x7fb6a8143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 --2- 172.21.15.114:0/1134335012 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c005050 0x7fb6a8070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:50.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 -- 172.21.15.114:0/1134335012 >> 172.21.15.114:0/1134335012 conn(0x7fb6a80a8490 msgr2=0x7fb6a80a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:50.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 -- 172.21.15.114:0/1134335012 shutdown_connections 2024-02-17T12:19:50.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:50.844+0000 7fb6ada00640 1 -- 172.21.15.114:0/1134335012 wait complete. 2024-02-17T12:19:50.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-17T12:19:51.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16c5000640 1 Processor -- start 2024-02-17T12:19:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16c5000640 1 -- start start 2024-02-17T12:19:51.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16c5000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16c0152540 0x7f16c006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16c5000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f16c00c6460 0x7f16c0158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16c5000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c0155dd0 con 0x7f16c0154e30 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16c5000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c01588c0 con 0x7f16c00c6460 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16c5000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0155810 con 0x7f16c0152540 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16bd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f16c00c6460 0x7f16c0158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16bd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f16c00c6460 0x7f16c0158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35734/0 (socket says 172.21.15.114:35734) 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16bd400640 1 -- 172.21.15.114:0/1870680732 learned_addr learned my addr 172.21.15.114:0/1870680732 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16bde00640 1 --2- 172.21.15.114:0/1870680732 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16c0152540 0x7f16c006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16bd400640 1 -- 172.21.15.114:0/1870680732 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16c0152540 msgr2=0x7f16c006ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16bd400640 1 --2- 172.21.15.114:0/1870680732 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16c0152540 0x7f16c006ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16bd400640 1 -- 172.21.15.114:0/1870680732 >> v1:172.21.15.116:6789/0 conn(0x7f16c0154e30 legacy=0x7f16c00aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.000+0000 7f16bd400640 1 -- 172.21.15.114:0/1870680732 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0155af0 con 0x7f16c00c6460 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16bd400640 1 --2- 172.21.15.114:0/1870680732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c00c6460 0x7f16c0158d50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009e50 tx=0x7f16a801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb63cdf31d40a4d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16bca00640 1 -- 172.21.15.114:0/1870680732 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a80a56e0 con 0x7f16c00c6460 2024-02-17T12:19:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16bca00640 1 -- 172.21.15.114:0/1870680732 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a80a5840 con 0x7f16c00c6460 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16bca00640 1 -- 172.21.15.114:0/1870680732 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a80a5bd0 con 0x7f16c00c6460 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16c5000640 1 -- 172.21.15.114:0/1870680732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c00c6460 msgr2=0x7f16c0158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16c5000640 1 --2- 172.21.15.114:0/1870680732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c00c6460 0x7f16c0158d50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009e50 tx=0x7f16a801c910 comp rx=0 tx=0).stop 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16c5000640 1 -- 172.21.15.114:0/1870680732 shutdown_connections 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16c5000640 1 --2- 172.21.15.114:0/1870680732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c00c6460 0x7f16c0158d50 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16c5000640 1 --2- 172.21.15.114:0/1870680732 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16c0152540 0x7f16c006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16c5000640 1 -- 172.21.15.114:0/1870680732 >> 172.21.15.114:0/1870680732 conn(0x7f16c00c4f20 msgr2=0x7f16c00c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16c5000640 1 -- 172.21.15.114:0/1870680732 shutdown_connections 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.004+0000 7f16c5000640 1 -- 172.21.15.114:0/1870680732 wait complete. 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 Processor -- start 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 -- start start 2024-02-17T12:19:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16c00c6460 0x7f16c0156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16c0152540 0x7f16c0157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c0154e30 0x7f16c01450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0156fe0 con 0x7f16c0154e30 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c006be60 con 0x7f16c00c6460 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0158170 con 0x7f16c0152540 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16be800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c0154e30 0x7f16c01450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16bd400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16c0152540 0x7f16c0157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16be800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c0154e30 0x7f16c01450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35740/0 (socket says 172.21.15.114:35740) 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16be800640 1 -- 172.21.15.114:0/1440633798 learned_addr learned my addr 172.21.15.114:0/1440633798 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16bde00640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16c00c6460 0x7f16c0156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16be800640 1 -- 172.21.15.114:0/1440633798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16c0152540 msgr2=0x7f16c0157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16be800640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16c0152540 0x7f16c0157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16be800640 1 -- 172.21.15.114:0/1440633798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16c00c6460 msgr2=0x7f16c0156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16be800640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16c00c6460 0x7f16c0156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16be800640 1 -- 172.21.15.114:0/1440633798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a8009b30 con 0x7f16c0154e30 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16be800640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c0154e30 0x7f16c01450a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f16b800c340 tx=0x7f16b800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16b6000640 1 -- 172.21.15.114:0/1440633798 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8005220 con 0x7f16c0154e30 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16b6000640 1 -- 172.21.15.114:0/1440633798 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b8005380 con 0x7f16c0154e30 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 -- 172.21.15.114:0/1440633798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c01f1c70 con 0x7f16c0154e30 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16b6000640 1 -- 172.21.15.114:0/1440633798 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8007270 con 0x7f16c0154e30 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 -- 172.21.15.114:0/1440633798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c01ee380 con 0x7f16c0154e30 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.008+0000 7f16c5000640 1 -- 172.21.15.114:0/1440633798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c0068180 con 0x7f16c0154e30 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.012+0000 7f16b6000640 1 -- 172.21.15.114:0/1440633798 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f16b80073d0 con 0x7f16c0154e30 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.012+0000 7f16b6000640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f169c066e40 0x7f169c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.012+0000 7f16b6000640 1 -- 172.21.15.114:0/1440633798 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f16b80841a0 con 0x7f16c0154e30 2024-02-17T12:19:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.012+0000 7f16bde00640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f169c066e40 0x7f169c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.012+0000 7f16bde00640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f169c066e40 0x7f169c069300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f16b0007a60 tx=0x7f16b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:51.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.016+0000 7f16b6000640 1 -- 172.21.15.114:0/1440633798 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f16b8050cd0 con 0x7f16c0154e30 2024-02-17T12:19:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.168+0000 7f16c5000640 1 -- 172.21.15.114:0/1440633798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16c0074840 con 0x7f16c0154e30 2024-02-17T12:19:51.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16b6000640 1 -- 172.21.15.114:0/1440633798 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f16b8054390 con 0x7f16c0154e30 2024-02-17T12:19:51.174 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:51.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 -- 172.21.15.114:0/1440633798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f169c066e40 msgr2=0x7f169c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f169c066e40 0x7f169c069300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f16b0007a60 tx=0x7f16b0008040 comp rx=0 tx=0).stop 2024-02-17T12:19:51.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 -- 172.21.15.114:0/1440633798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c0154e30 msgr2=0x7f16c01450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c0154e30 0x7f16c01450a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f16b800c340 tx=0x7f16b800c800 comp rx=0 tx=0).stop 2024-02-17T12:19:51.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 -- 172.21.15.114:0/1440633798 shutdown_connections 2024-02-17T12:19:51.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f169c066e40 0x7f169c069300 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c0154e30 0x7f16c01450a0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f16c0152540 0x7f16c0157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 --2- 172.21.15.114:0/1440633798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f16c00c6460 0x7f16c0156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 -- 172.21.15.114:0/1440633798 >> 172.21.15.114:0/1440633798 conn(0x7f16c00c4f20 msgr2=0x7f16c014a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:51.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 -- 172.21.15.114:0/1440633798 shutdown_connections 2024-02-17T12:19:51.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.172+0000 7f16c5000640 1 -- 172.21.15.114:0/1440633798 wait complete. 2024-02-17T12:19:51.195 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:19:51.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fad200640 1 Processor -- start 2024-02-17T12:19:51.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fad200640 1 -- start start 2024-02-17T12:19:51.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fad200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa80c25a0 0x7f1fa806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fad200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1fa806db50 0x7f1fa814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fad200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1fa8150490 0x7f1fa8152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fad200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa8071630 con 0x7f1fa806db50 2024-02-17T12:19:51.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fad200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa8156270 con 0x7f1fa8150490 2024-02-17T12:19:51.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fad200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8156550 con 0x7f1fa80c25a0 2024-02-17T12:19:51.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa5400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1fa806db50 0x7f1fa814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa5400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1fa806db50 0x7f1fa814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35748/0 (socket says 172.21.15.114:35748) 2024-02-17T12:19:51.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa5400640 1 -- 172.21.15.114:0/326284996 learned_addr learned my addr 172.21.15.114:0/326284996 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:51.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa5e00640 1 --2- 172.21.15.114:0/326284996 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa80c25a0 0x7f1fa806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa6800640 1 --2- 172.21.15.114:0/326284996 >> v2:172.21.15.116:3300/0 conn(0x7f1fa8150490 0x7f1fa8152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa5400640 1 -- 172.21.15.114:0/326284996 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa80c25a0 msgr2=0x7f1fa806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:51.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa5400640 1 --2- 172.21.15.114:0/326284996 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa80c25a0 0x7f1fa806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa5400640 1 -- 172.21.15.114:0/326284996 >> v2:172.21.15.116:3300/0 conn(0x7f1fa8150490 msgr2=0x7f1fa8152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:51.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa5400640 1 --2- 172.21.15.114:0/326284996 >> v2:172.21.15.116:3300/0 conn(0x7f1fa8150490 0x7f1fa8152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa5400640 1 -- 172.21.15.114:0/326284996 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8156830 con 0x7f1fa806db50 2024-02-17T12:19:51.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.332+0000 7f1fa6800640 1 --2- 172.21.15.114:0/326284996 >> v2:172.21.15.116:3300/0 conn(0x7f1fa8150490 0x7f1fa8152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:51.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fa5400640 1 --2- 172.21.15.114:0/326284996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa806db50 0x7f1fa814ff50 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80c0780 tx=0x7f1f9001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61664e2781bc887 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:51.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fa4a00640 1 -- 172.21.15.114:0/326284996 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa81539a0 con 0x7f1fa806db50 2024-02-17T12:19:51.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fa4a00640 1 -- 172.21.15.114:0/326284996 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f900ac410 con 0x7f1fa806db50 2024-02-17T12:19:51.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fa4a00640 1 -- 172.21.15.114:0/326284996 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900ac7a0 con 0x7f1fa806db50 2024-02-17T12:19:51.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fad200640 1 -- 172.21.15.114:0/326284996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa806db50 msgr2=0x7f1fa814ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fad200640 1 --2- 172.21.15.114:0/326284996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa806db50 0x7f1fa814ff50 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80c0780 tx=0x7f1f9001c3d0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fad200640 1 -- 172.21.15.114:0/326284996 shutdown_connections 2024-02-17T12:19:51.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fad200640 1 --2- 172.21.15.114:0/326284996 >> v2:172.21.15.116:3300/0 conn(0x7f1fa8150490 0x7f1fa8152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fad200640 1 --2- 172.21.15.114:0/326284996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa806db50 0x7f1fa814ff50 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fad200640 1 --2- 172.21.15.114:0/326284996 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa80c25a0 0x7f1fa806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fad200640 1 -- 172.21.15.114:0/326284996 >> 172.21.15.114:0/326284996 conn(0x7f1fa80a8490 msgr2=0x7f1fa80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:51.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fad200640 1 -- 172.21.15.114:0/326284996 shutdown_connections 2024-02-17T12:19:51.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.336+0000 7f1fad200640 1 -- 172.21.15.114:0/326284996 wait complete. 2024-02-17T12:19:51.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 Processor -- start 2024-02-17T12:19:51.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 -- start start 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa806db50 0x7f1fa8141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fa80c25a0 0x7f1fa81455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa8150490 0x7f1fa81ed380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81f08f0 con 0x7f1fa8150490 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81f1470 con 0x7f1fa80c25a0 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81f0b40 con 0x7f1fa806db50 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa8150490 0x7f1fa81ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa8150490 0x7f1fa81ed380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35754/0 (socket says 172.21.15.114:35754) 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa6800640 1 -- 172.21.15.114:0/1289109336 learned_addr learned my addr 172.21.15.114:0/1289109336 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa5e00640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa806db50 0x7f1fa8141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa5400640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fa80c25a0 0x7f1fa81455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa5e00640 1 -- 172.21.15.114:0/1289109336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fa80c25a0 msgr2=0x7f1fa81455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa5e00640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fa80c25a0 0x7f1fa81455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa5e00640 1 -- 172.21.15.114:0/1289109336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa8150490 msgr2=0x7f1fa81ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa5e00640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa8150490 0x7f1fa81ed380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa5e00640 1 -- 172.21.15.114:0/1289109336 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f900094d0 con 0x7f1fa806db50 2024-02-17T12:19:51.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa6800640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa8150490 0x7f1fa81ed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:51.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fa5e00640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa806db50 0x7f1fa8141fe0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800ef00 tx=0x7f1f9800b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:51.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1f9e000640 1 -- 172.21.15.114:0/1289109336 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98010040 con 0x7f1fa806db50 2024-02-17T12:19:51.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1f9e000640 1 -- 172.21.15.114:0/1289109336 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f98009e80 con 0x7f1fa806db50 2024-02-17T12:19:51.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 -- 172.21.15.114:0/1289109336 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa81f0e20 con 0x7f1fa806db50 2024-02-17T12:19:51.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1f9e000640 1 -- 172.21.15.114:0/1289109336 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98014620 con 0x7f1fa806db50 2024-02-17T12:19:51.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 -- 172.21.15.114:0/1289109336 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa8142520 con 0x7f1fa806db50 2024-02-17T12:19:51.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.340+0000 7f1fad200640 1 -- 172.21.15.114:0/1289109336 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa8074840 con 0x7f1fa806db50 2024-02-17T12:19:51.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.344+0000 7f1f9e000640 1 -- 172.21.15.114:0/1289109336 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f1f98014780 con 0x7f1fa806db50 2024-02-17T12:19:51.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.344+0000 7f1f9e000640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f84066e40 0x7f1f84069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.344+0000 7f1f9e000640 1 -- 172.21.15.114:0/1289109336 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1f98085af0 con 0x7f1fa806db50 2024-02-17T12:19:51.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.344+0000 7f1fa5400640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f84066e40 0x7f1f84069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.344+0000 7f1fa5400640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f84066e40 0x7f1f84069300 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1f900ae000 tx=0x7f1f90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:51.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.348+0000 7f1f9e000640 1 -- 172.21.15.114:0/1289109336 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1f98052610 con 0x7f1fa806db50 2024-02-17T12:19:51.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.500+0000 7f1fad200640 1 -- 172.21.15.114:0/1289109336 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fa80c3420 con 0x7f1fa806db50 2024-02-17T12:19:51.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.500+0000 7f1f9e000640 1 -- 172.21.15.114:0/1289109336 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v72) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1f98055cd0 con 0x7f1fa806db50 2024-02-17T12:19:51.505 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 -- 172.21.15.114:0/1289109336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f84066e40 msgr2=0x7f1f84069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f84066e40 0x7f1f84069300 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1f900ae000 tx=0x7f1f90009040 comp rx=0 tx=0).stop 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 -- 172.21.15.114:0/1289109336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa806db50 msgr2=0x7f1fa8141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa806db50 0x7f1fa8141fe0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800ef00 tx=0x7f1f9800b480 comp rx=0 tx=0).stop 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 -- 172.21.15.114:0/1289109336 shutdown_connections 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f1f84066e40 0x7f1f84069300 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fa8150490 0x7f1fa81ed380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fa80c25a0 0x7f1fa81455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 --2- 172.21.15.114:0/1289109336 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1fa806db50 0x7f1fa8141fe0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 -- 172.21.15.114:0/1289109336 >> 172.21.15.114:0/1289109336 conn(0x7f1fa80a8490 msgr2=0x7f1fa8149c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:51.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 -- 172.21.15.114:0/1289109336 shutdown_connections 2024-02-17T12:19:51.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.504+0000 7f1fad200640 1 -- 172.21.15.114:0/1289109336 wait complete. 2024-02-17T12:19:51.526 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:19:51.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa647e00640 1 Processor -- start 2024-02-17T12:19:51.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa647e00640 1 -- start start 2024-02-17T12:19:51.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa647e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa6400c25a0 0x7fa64006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa647e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa64006db50 0x7fa64014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa647e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa640156270 con 0x7fa640150490 2024-02-17T12:19:51.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa647e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa640071630 con 0x7fa64006db50 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa647e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa640156550 con 0x7fa6400c25a0 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa644a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa64006db50 0x7fa64014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa645e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa640150490 0x7fa640152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37272/0 (socket says 172.21.15.114:37272) 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa645e00640 1 -- 172.21.15.114:0/2356324310 learned_addr learned my addr 172.21.15.114:0/2356324310 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa645400640 1 --2- 172.21.15.114:0/2356324310 >> v2:172.21.15.116:3300/0 conn(0x7fa6400c25a0 0x7fa64006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa63fe00640 1 -- 172.21.15.114:0/2356324310 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761498184 0 0) 0x7fa640156270 con 0x7fa640150490 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa644a00640 1 -- 172.21.15.114:0/2356324310 >> v2:172.21.15.116:3300/0 conn(0x7fa6400c25a0 msgr2=0x7fa64006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa644a00640 1 --2- 172.21.15.114:0/2356324310 >> v2:172.21.15.116:3300/0 conn(0x7fa6400c25a0 0x7fa64006e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa644a00640 1 -- 172.21.15.114:0/2356324310 >> v1:172.21.15.114:6789/0 conn(0x7fa640150490 legacy=0x7fa640152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa644a00640 1 -- 172.21.15.114:0/2356324310 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa640156830 con 0x7fa64006db50 2024-02-17T12:19:51.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.660+0000 7fa645400640 1 --2- 172.21.15.114:0/2356324310 >> v2:172.21.15.116:3300/0 conn(0x7fa6400c25a0 0x7fa64006e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:51.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa644a00640 1 --2- 172.21.15.114:0/2356324310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa64006db50 0x7fa64014ff50 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa6400ab930 tx=0x7fa62c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301ac4d29a7550fd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:51.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa63fe00640 1 -- 172.21.15.114:0/2356324310 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c0ab400 con 0x7fa64006db50 2024-02-17T12:19:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa63fe00640 1 -- 172.21.15.114:0/2356324310 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c0a7050 con 0x7fa64006db50 2024-02-17T12:19:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa63fe00640 1 -- 172.21.15.114:0/2356324310 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c0ab780 con 0x7fa64006db50 2024-02-17T12:19:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa647e00640 1 -- 172.21.15.114:0/2356324310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa64006db50 msgr2=0x7fa64014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa647e00640 1 --2- 172.21.15.114:0/2356324310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa64006db50 0x7fa64014ff50 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa6400ab930 tx=0x7fa62c01c360 comp rx=0 tx=0).stop 2024-02-17T12:19:51.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa647e00640 1 -- 172.21.15.114:0/2356324310 shutdown_connections 2024-02-17T12:19:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa647e00640 1 --2- 172.21.15.114:0/2356324310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa64006db50 0x7fa64014ff50 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa647e00640 1 --2- 172.21.15.114:0/2356324310 >> v2:172.21.15.116:3300/0 conn(0x7fa6400c25a0 0x7fa64006e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa647e00640 1 -- 172.21.15.114:0/2356324310 >> 172.21.15.114:0/2356324310 conn(0x7fa6400a8490 msgr2=0x7fa6400a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa647e00640 1 -- 172.21.15.114:0/2356324310 shutdown_connections 2024-02-17T12:19:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.664+0000 7fa647e00640 1 -- 172.21.15.114:0/2356324310 wait complete. 2024-02-17T12:19:51.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa647e00640 1 Processor -- start 2024-02-17T12:19:51.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa647e00640 1 -- start start 2024-02-17T12:19:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa647e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa64006db50 0x7fa64013c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa647e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6400c25a0 0x7fa6400bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa647e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640150490 0x7fa6401ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa647e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa640155300 con 0x7fa6400c25a0 2024-02-17T12:19:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa647e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400aafa0 con 0x7fa640150490 2024-02-17T12:19:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa647e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa640155680 con 0x7fa64006db50 2024-02-17T12:19:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa644a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6400c25a0 0x7fa6400bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa644a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6400c25a0 0x7fa6400bf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35774/0 (socket says 172.21.15.114:35774) 2024-02-17T12:19:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa644a00640 1 -- 172.21.15.114:0/2191080477 learned_addr learned my addr 172.21.15.114:0/2191080477 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:51.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa645400640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa64006db50 0x7fa64013c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa645e00640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640150490 0x7fa6401ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa644a00640 1 -- 172.21.15.114:0/2191080477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa64006db50 msgr2=0x7fa64013c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa644a00640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa64006db50 0x7fa64013c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa644a00640 1 -- 172.21.15.114:0/2191080477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640150490 msgr2=0x7fa6401ed7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa644a00640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640150490 0x7fa6401ed7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa644a00640 1 -- 172.21.15.114:0/2191080477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c009420 con 0x7fa6400c25a0 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa644a00640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6400c25a0 0x7fa6400bf7a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0ae040 tx=0x7fa62c019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa63d600640 1 -- 172.21.15.114:0/2191080477 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c0abe60 con 0x7fa6400c25a0 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa63d600640 1 -- 172.21.15.114:0/2191080477 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c0b4410 con 0x7fa6400c25a0 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa63d600640 1 -- 172.21.15.114:0/2191080477 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c0b47c0 con 0x7fa6400c25a0 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa647e00640 1 -- 172.21.15.114:0/2191080477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6400c5970 con 0x7fa6400c25a0 2024-02-17T12:19:51.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.668+0000 7fa647e00640 1 -- 172.21.15.114:0/2191080477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa640155c20 con 0x7fa6400c25a0 2024-02-17T12:19:51.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.672+0000 7fa647e00640 1 -- 172.21.15.114:0/2191080477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6401ed4c0 con 0x7fa6400c25a0 2024-02-17T12:19:51.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.672+0000 7fa63d600640 1 -- 172.21.15.114:0/2191080477 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa62c0b2040 con 0x7fa6400c25a0 2024-02-17T12:19:51.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.672+0000 7fa63d600640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa620066e40 0x7fa620069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.672+0000 7fa63d600640 1 -- 172.21.15.114:0/2191080477 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa62c11ede0 con 0x7fa6400c25a0 2024-02-17T12:19:51.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.672+0000 7fa645400640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa620066e40 0x7fa620069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.672+0000 7fa645400640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa620066e40 0x7fa620069300 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa634009950 tx=0x7fa634008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:51.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.676+0000 7fa63d600640 1 -- 172.21.15.114:0/2191080477 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa62c0eb860 con 0x7fa6400c25a0 2024-02-17T12:19:51.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 -- 172.21.15.114:0/2191080477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa640074840 con 0x7fa6400c25a0 2024-02-17T12:19:51.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa63d600640 1 -- 172.21.15.114:0/2191080477 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v72) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa62c0b00a0 con 0x7fa6400c25a0 2024-02-17T12:19:51.838 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:51.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 -- 172.21.15.114:0/2191080477 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa620066e40 msgr2=0x7fa620069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa620066e40 0x7fa620069300 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa634009950 tx=0x7fa634008040 comp rx=0 tx=0).stop 2024-02-17T12:19:51.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 -- 172.21.15.114:0/2191080477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6400c25a0 msgr2=0x7fa6400bf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6400c25a0 0x7fa6400bf7a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0ae040 tx=0x7fa62c019100 comp rx=0 tx=0).stop 2024-02-17T12:19:51.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 -- 172.21.15.114:0/2191080477 shutdown_connections 2024-02-17T12:19:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640150490 0x7fa6401ed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa620066e40 0x7fa620069300 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6400c25a0 0x7fa6400bf7a0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 --2- 172.21.15.114:0/2191080477 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa64006db50 0x7fa64013c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 -- 172.21.15.114:0/2191080477 >> 172.21.15.114:0/2191080477 conn(0x7fa6400a8490 msgr2=0x7fa6400c19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 -- 172.21.15.114:0/2191080477 shutdown_connections 2024-02-17T12:19:51.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.836+0000 7fa647e00640 1 -- 172.21.15.114:0/2191080477 wait complete. 2024-02-17T12:19:51.860 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:19:51.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f0512200640 1 Processor -- start 2024-02-17T12:19:51.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f0512200640 1 -- start start 2024-02-17T12:19:51.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f0512200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 0x7f050c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:51.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f0512200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c0a9420 con 0x7f050c0c1eb0 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f0512200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c152850 con 0x7f050c0c2580 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f0512200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c14f4f0 con 0x7f050c14f110 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f050be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f050c0c1eb0 0x7f050c15c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37286/0 (socket says 172.21.15.114:37286) 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f050be00640 1 -- 172.21.15.114:0/245121139 learned_addr learned my addr 172.21.15.114:0/245121139 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f050b400640 1 --2- 172.21.15.114:0/245121139 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 0x7f050c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f050a000640 1 -- 172.21.15.114:0/245121139 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104666649 0 0) 0x7f050c0a9420 con 0x7f050c0c1eb0 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f050a000640 1 -- 172.21.15.114:0/245121139 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f0003530 con 0x7f050c0c1eb0 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f050a000640 1 -- 172.21.15.114:0/245121139 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041628708 0 0) 0x7f050c152850 con 0x7f050c0c2580 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f050a000640 1 -- 172.21.15.114:0/245121139 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f050c0a9420 con 0x7f050c0c2580 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f050b400640 1 -- 172.21.15.114:0/245121139 >> v1:172.21.15.116:6789/0 conn(0x7f050c0c2580 legacy=0x7f050c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f050b400640 1 -- 172.21.15.114:0/245121139 >> v1:172.21.15.114:6789/0 conn(0x7f050c0c1eb0 legacy=0x7f050c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:51.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.992+0000 7f050b400640 1 -- 172.21.15.114:0/245121139 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c0a9670 con 0x7f050c14f110 2024-02-17T12:19:51.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f050b400640 1 --2- 172.21.15.114:0/245121139 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 0x7f050c0c65a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0097f0 tx=0x7f04fc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4611eedc6e6b2fb6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f050a000640 1 -- 172.21.15.114:0/245121139 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0ab600 con 0x7f050c14f110 2024-02-17T12:19:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f050a000640 1 -- 172.21.15.114:0/245121139 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc0a7050 con 0x7f050c14f110 2024-02-17T12:19:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f050a000640 1 -- 172.21.15.114:0/245121139 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0ab960 con 0x7f050c14f110 2024-02-17T12:19:52.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f0512200640 1 -- 172.21.15.114:0/245121139 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 msgr2=0x7f050c0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f0512200640 1 --2- 172.21.15.114:0/245121139 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 0x7f050c0c65a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0097f0 tx=0x7f04fc01c450 comp rx=0 tx=0).stop 2024-02-17T12:19:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f0512200640 1 -- 172.21.15.114:0/245121139 shutdown_connections 2024-02-17T12:19:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f0512200640 1 --2- 172.21.15.114:0/245121139 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 0x7f050c0c65a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f0512200640 1 -- 172.21.15.114:0/245121139 >> 172.21.15.114:0/245121139 conn(0x7f050c0a8490 msgr2=0x7f050c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f0512200640 1 -- 172.21.15.114:0/245121139 shutdown_connections 2024-02-17T12:19:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:51.996+0000 7f0512200640 1 -- 172.21.15.114:0/245121139 wait complete. 2024-02-17T12:19:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 Processor -- start 2024-02-17T12:19:52.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 -- start start 2024-02-17T12:19:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f050c0c1eb0 0x7f050c154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f050c0c2580 0x7f050c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 0x7f050c1ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c1edc60 con 0x7f050c0c2580 2024-02-17T12:19:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0c4e10 con 0x7f050c0c1eb0 2024-02-17T12:19:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c154880 con 0x7f050c14f110 2024-02-17T12:19:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f050c0c2580 0x7f050c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f050c0c2580 0x7f050c0c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35782/0 (socket says 172.21.15.114:35782) 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050aa00640 1 -- 172.21.15.114:0/1358141713 learned_addr learned my addr 172.21.15.114:0/1358141713 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050b400640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f050c0c1eb0 0x7f050c154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050be00640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 0x7f050c1ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050aa00640 1 -- 172.21.15.114:0/1358141713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 msgr2=0x7f050c1ecf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050aa00640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 0x7f050c1ecf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050aa00640 1 -- 172.21.15.114:0/1358141713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f050c0c1eb0 msgr2=0x7f050c154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050aa00640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f050c0c1eb0 0x7f050c154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050aa00640 1 -- 172.21.15.114:0/1358141713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc009420 con 0x7f050c0c2580 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f050aa00640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f050c0c2580 0x7f050c0c52a0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c440 tx=0x7f04f800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0503400640 1 -- 172.21.15.114:0/1358141713 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80052d0 con 0x7f050c0c2580 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0503400640 1 -- 172.21.15.114:0/1358141713 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8005430 con 0x7f050c0c2580 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 -- 172.21.15.114:0/1358141713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c1ed980 con 0x7f050c0c2580 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0503400640 1 -- 172.21.15.114:0/1358141713 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8012870 con 0x7f050c0c2580 2024-02-17T12:19:52.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 -- 172.21.15.114:0/1358141713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c0c57e0 con 0x7f050c0c2580 2024-02-17T12:19:52.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.000+0000 7f0512200640 1 -- 172.21.15.114:0/1358141713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c0c3cf0 con 0x7f050c0c2580 2024-02-17T12:19:52.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.004+0000 7f0503400640 1 -- 172.21.15.114:0/1358141713 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f04f80129d0 con 0x7f050c0c2580 2024-02-17T12:19:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.004+0000 7f0503400640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f04ec066e40 0x7f04ec069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.004+0000 7f0503400640 1 -- 172.21.15.114:0/1358141713 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f04f80847d0 con 0x7f050c0c2580 2024-02-17T12:19:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.004+0000 7f050b400640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f04ec066e40 0x7f04ec069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.004+0000 7f050b400640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f04ec066e40 0x7f04ec069300 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0ad000 tx=0x7f04fc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:52.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.008+0000 7f0503400640 1 -- 172.21.15.114:0/1358141713 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f04f8051300 con 0x7f050c0c2580 2024-02-17T12:19:52.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.192+0000 7f0512200640 1 -- 172.21.15.114:0/1358141713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f050c074840 con 0x7f050c0c2580 2024-02-17T12:19:52.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.192+0000 7f0503400640 1 -- 172.21.15.114:0/1358141713 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6187 (secure 0 0 0) 0x7f04f80549c0 con 0x7f050c0c2580 2024-02-17T12:19:52.197 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:52.197 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:04.061245+0000","modified":"2024-02-17T12:19:07.080013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/709959478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":709959478},{"type":"v1","addr":"172.21.15.114:6837","nonce":709959478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:21.726155+0000","modified":"2024-02-17T12:19:24.747374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1982789506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1982789506},{"type":"v1","addr":"172.21.15.114:6836","nonce":1982789506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-02-17T12:19:52.198 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 53 2024-02-17T12:19:52.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 -- 172.21.15.114:0/1358141713 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f04ec066e40 msgr2=0x7f04ec069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f04ec066e40 0x7f04ec069300 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0ad000 tx=0x7f04fc0a6000 comp rx=0 tx=0).stop 2024-02-17T12:19:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 -- 172.21.15.114:0/1358141713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f050c0c2580 msgr2=0x7f050c0c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f050c0c2580 0x7f050c0c52a0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c440 tx=0x7f04f800c900 comp rx=0 tx=0).stop 2024-02-17T12:19:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 -- 172.21.15.114:0/1358141713 shutdown_connections 2024-02-17T12:19:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f050c14f110 0x7f050c1ecf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f04ec066e40 0x7f04ec069300 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f050c0c2580 0x7f050c0c52a0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 --2- 172.21.15.114:0/1358141713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f050c0c1eb0 0x7f050c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 -- 172.21.15.114:0/1358141713 >> 172.21.15.114:0/1358141713 conn(0x7f050c0a8490 msgr2=0x7f050c0aa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 -- 172.21.15.114:0/1358141713 shutdown_connections 2024-02-17T12:19:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.196+0000 7f0512200640 1 -- 172.21.15.114:0/1358141713 wait complete. 2024-02-17T12:19:52.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:52.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.348+0000 7ff5ef200640 1 Processor -- start 2024-02-17T12:19:52.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ef200640 1 -- start start 2024-02-17T12:19:52.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ef200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff5e814ff90 0x7ff5e80c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ef200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80708c0 0x7ff5e80c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ef200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e81537c0 con 0x7ff5e80c5330 2024-02-17T12:19:52.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ef200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e80c68e0 con 0x7ff5e814ff90 2024-02-17T12:19:52.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ef200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80c2d60 con 0x7ff5e80708c0 2024-02-17T12:19:52.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ee800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff5e80c5330 0x7ff5e80c86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37298/0 (socket says 172.21.15.114:37298) 2024-02-17T12:19:52.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ee800640 1 -- 172.21.15.114:0/2918538988 learned_addr learned my addr 172.21.15.114:0/2918538988 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:52.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ed400640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80708c0 0x7ff5e80c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ede00640 1 --2- 172.21.15.114:0/2918538988 >> v2:172.21.15.116:3300/0 conn(0x7ff5e814ff90 0x7ff5e80c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103909278 0 0) 0x7ff5e81537c0 con 0x7ff5e80c5330 2024-02-17T12:19:52.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d0003530 con 0x7ff5e80c5330 2024-02-17T12:19:52.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3857187379 0 0) 0x7ff5d0003530 con 0x7ff5e80c5330 2024-02-17T12:19:52.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80708c0 msgr2=0x7ff5e80c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80708c0 0x7ff5e80c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 >> v2:172.21.15.116:3300/0 conn(0x7ff5e814ff90 msgr2=0x7ff5e80c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 --2- 172.21.15.114:0/2918538988 >> v2:172.21.15.116:3300/0 conn(0x7ff5e814ff90 0x7ff5e80c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e80c2f70 con 0x7ff5e80c5330 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7ff5e4001680 con 0x7ff5e80c5330 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 >> v1:172.21.15.114:6789/0 conn(0x7ff5e80c5330 legacy=0x7ff5e80c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80708c0 0x7ff5d0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5d0003f00 0x7ff5d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d0004d10 0x7ff5d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80c2d60 con 0x7ff5d0004d10 2024-02-17T12:19:52.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d000b9f0 con 0x7ff5d0003f00 2024-02-17T12:19:52.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d000bbb0 con 0x7ff5e80708c0 2024-02-17T12:19:52.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ee800640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d0004d10 0x7ff5d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ede00640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80708c0 0x7ff5d0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ed400640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5d0003f00 0x7ff5d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ee800640 1 -- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80708c0 msgr2=0x7ff5d0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:52.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ee800640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80708c0 0x7ff5d0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ee800640 1 -- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5d0003f00 msgr2=0x7ff5d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:52.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ee800640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5d0003f00 0x7ff5d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.352+0000 7ff5ee800640 1 -- 172.21.15.114:0/2918538988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0003530 con 0x7ff5d0004d10 2024-02-17T12:19:52.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5ee800640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d0004d10 0x7ff5d0005190 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400c240 tx=0x7ff5e401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e42c62beab83a99 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40058e0 con 0x7ff5d0004d10 2024-02-17T12:19:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4005a40 con 0x7ff5d0004d10 2024-02-17T12:19:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5eca00640 1 -- 172.21.15.114:0/2918538988 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4005e50 con 0x7ff5d0004d10 2024-02-17T12:19:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5ef200640 1 -- 172.21.15.114:0/2918538988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d0004d10 msgr2=0x7ff5d0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5ef200640 1 --2- 172.21.15.114:0/2918538988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d0004d10 0x7ff5d0005190 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400c240 tx=0x7ff5e401cc80 comp rx=0 tx=0).stop 2024-02-17T12:19:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5ee800640 1 -- 172.21.15.114:0/2918538988 reap_dead start 2024-02-17T12:19:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5ef200640 1 -- 172.21.15.114:0/2918538988 shutdown_connections 2024-02-17T12:19:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5ef200640 1 -- 172.21.15.114:0/2918538988 >> 172.21.15.114:0/2918538988 conn(0x7ff5e8066960 msgr2=0x7ff5e8066d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5ef200640 1 -- 172.21.15.114:0/2918538988 shutdown_connections 2024-02-17T12:19:52.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.356+0000 7ff5ef200640 1 -- 172.21.15.114:0/2918538988 wait complete. 2024-02-17T12:19:52.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 Processor -- start 2024-02-17T12:19:52.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 -- start start 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e81eeb90 0x7ff5e814f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80ab1a0 0x7ff5e8148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8148b80 0x7ff5e80ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8149030 con 0x7ff5e8148b80 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80abe10 con 0x7ff5e81eeb90 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80abbe0 con 0x7ff5e80ab1a0 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ee800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8148b80 0x7ff5e80ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ee800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8148b80 0x7ff5e80ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35806/0 (socket says 172.21.15.114:35806) 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ee800640 1 -- 172.21.15.114:0/876285322 learned_addr learned my addr 172.21.15.114:0/876285322 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ede00640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e81eeb90 0x7ff5e814f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ed400640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80ab1a0 0x7ff5e8148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ee800640 1 -- 172.21.15.114:0/876285322 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80ab1a0 msgr2=0x7ff5e8148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ee800640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80ab1a0 0x7ff5e8148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ee800640 1 -- 172.21.15.114:0/876285322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e81eeb90 msgr2=0x7ff5e814f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ee800640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e81eeb90 0x7ff5e814f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ee800640 1 -- 172.21.15.114:0/876285322 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e81ef3e0 con 0x7ff5e8148b80 2024-02-17T12:19:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ee800640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8148b80 0x7ff5e80ac880 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40ab040 tx=0x7ff5d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5e2000640 1 -- 172.21.15.114:0/876285322 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4001640 con 0x7ff5e8148b80 2024-02-17T12:19:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5e2000640 1 -- 172.21.15.114:0/876285322 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4001c60 con 0x7ff5e8148b80 2024-02-17T12:19:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5e2000640 1 -- 172.21.15.114:0/876285322 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4004ab0 con 0x7ff5e8148b80 2024-02-17T12:19:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 -- 172.21.15.114:0/876285322 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e81ef680 con 0x7ff5e8148b80 2024-02-17T12:19:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 -- 172.21.15.114:0/876285322 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e80ac360 con 0x7ff5e8148b80 2024-02-17T12:19:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.360+0000 7ff5ef200640 1 -- 172.21.15.114:0/876285322 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e80ac550 con 0x7ff5e8148b80 2024-02-17T12:19:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.364+0000 7ff5e2000640 1 -- 172.21.15.114:0/876285322 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff5e4004c10 con 0x7ff5e8148b80 2024-02-17T12:19:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.364+0000 7ff5e2000640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff5cc066e70 0x7ff5cc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.364+0000 7ff5e2000640 1 -- 172.21.15.114:0/876285322 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff5e411dca0 con 0x7ff5e8148b80 2024-02-17T12:19:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.364+0000 7ff5ede00640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff5cc066e70 0x7ff5cc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.364+0000 7ff5ede00640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff5cc066e70 0x7ff5cc069330 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc007520 tx=0x7ff5dc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:52.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.368+0000 7ff5e2000640 1 -- 172.21.15.114:0/876285322 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff5e40ea570 con 0x7ff5e8148b80 2024-02-17T12:19:52.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.524+0000 7ff5ef200640 1 -- 172.21.15.114:0/876285322 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5e804eef0 con 0x7ff5e8148b80 2024-02-17T12:19:52.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5e2000640 1 -- 172.21.15.114:0/876285322 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20392 (secure 0 0 0) 0x7ff5e40ec4a0 con 0x7ff5e8148b80 2024-02-17T12:19:52.530 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:52.530 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:23.364663+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:52.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 -- 172.21.15.114:0/876285322 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff5cc066e70 msgr2=0x7ff5cc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff5cc066e70 0x7ff5cc069330 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc007520 tx=0x7ff5dc00b040 comp rx=0 tx=0).stop 2024-02-17T12:19:52.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 -- 172.21.15.114:0/876285322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8148b80 msgr2=0x7ff5e80ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8148b80 0x7ff5e80ac880 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40ab040 tx=0x7ff5d0005800 comp rx=0 tx=0).stop 2024-02-17T12:19:52.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 -- 172.21.15.114:0/876285322 shutdown_connections 2024-02-17T12:19:52.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff5cc066e70 0x7ff5cc069330 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e8148b80 0x7ff5e80ac880 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5e80ab1a0 0x7ff5e8148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 --2- 172.21.15.114:0/876285322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e81eeb90 0x7ff5e814f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 -- 172.21.15.114:0/876285322 >> 172.21.15.114:0/876285322 conn(0x7ff5e8066960 msgr2=0x7ff5e814b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:52.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 -- 172.21.15.114:0/876285322 shutdown_connections 2024-02-17T12:19:52.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.528+0000 7ff5ef200640 1 -- 172.21.15.114:0/876285322 wait complete. 2024-02-17T12:19:52.552 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-17T12:19:52.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:19:52.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0eac600640 1 Processor -- start 2024-02-17T12:19:52.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0eac600640 1 -- start start 2024-02-17T12:19:52.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0eac600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0ea4072b20 0x7f0ea40c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0eac600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea41586f0 0x7f0ea4158b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0eac600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea40723b0 con 0x7f0ea4152560 2024-02-17T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0eac600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea4070000 con 0x7f0ea4072b20 2024-02-17T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0eac600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea4154dc0 con 0x7f0ea41586f0 2024-02-17T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0eaa600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea41586f0 0x7f0ea4158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0eaa600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea41586f0 0x7f0ea4158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:57602/0 (socket says 172.21.15.114:57602) 2024-02-17T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0ea9200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0ea4072b20 0x7f0ea40c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0eaa600640 1 -- 172.21.15.114:0/3135930871 learned_addr learned my addr 172.21.15.114:0/3135930871 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0ea9c00640 1 --1- 172.21.15.114:0/3135930871 >> v1:172.21.15.116:6789/0 conn(0x7f0ea4152560 0x7f0ea40c4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:51300/0 (socket says 172.21.15.114:51300) 2024-02-17T12:19:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0ea3e00640 1 -- 172.21.15.114:0/3135930871 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190439255 0 0) 0x7f0ea40723b0 con 0x7f0ea4152560 2024-02-17T12:19:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0ea9200640 1 -- 172.21.15.114:0/3135930871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea41586f0 msgr2=0x7f0ea4158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0ea9200640 1 --2- 172.21.15.114:0/3135930871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea41586f0 0x7f0ea4158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0ea9200640 1 -- 172.21.15.114:0/3135930871 >> v1:172.21.15.116:6789/0 conn(0x7f0ea4152560 legacy=0x7f0ea40c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.684+0000 7f0ea9200640 1 -- 172.21.15.114:0/3135930871 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea40728e0 con 0x7f0ea4072b20 2024-02-17T12:19:52.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0ea9200640 1 --2- 172.21.15.114:0/3135930871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ea4072b20 0x7f0ea40c17c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0e940097c0 tx=0x7f0e9401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b756834844567ae server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:52.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0ea3e00640 1 -- 172.21.15.114:0/3135930871 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940ab600 con 0x7f0ea4072b20 2024-02-17T12:19:52.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0ea3e00640 1 -- 172.21.15.114:0/3135930871 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e940a7050 con 0x7f0ea4072b20 2024-02-17T12:19:52.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0ea3e00640 1 -- 172.21.15.114:0/3135930871 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940ab980 con 0x7f0ea4072b20 2024-02-17T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0eac600640 1 -- 172.21.15.114:0/3135930871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ea4072b20 msgr2=0x7f0ea40c17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0eac600640 1 --2- 172.21.15.114:0/3135930871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ea4072b20 0x7f0ea40c17c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0e940097c0 tx=0x7f0e9401c410 comp rx=0 tx=0).stop 2024-02-17T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0eac600640 1 -- 172.21.15.114:0/3135930871 shutdown_connections 2024-02-17T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0eac600640 1 --2- 172.21.15.114:0/3135930871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea41586f0 0x7f0ea4158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0eac600640 1 --2- 172.21.15.114:0/3135930871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ea4072b20 0x7f0ea40c17c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0eac600640 1 -- 172.21.15.114:0/3135930871 >> 172.21.15.114:0/3135930871 conn(0x7f0ea406bef0 msgr2=0x7f0ea406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0eac600640 1 -- 172.21.15.114:0/3135930871 shutdown_connections 2024-02-17T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.688+0000 7f0eac600640 1 -- 172.21.15.114:0/3135930871 wait complete. 2024-02-17T12:19:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 Processor -- start 2024-02-17T12:19:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 -- start start 2024-02-17T12:19:52.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea4072b20 0x7f0ea41f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea4152560 0x7f0ea40c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ea41586f0 0x7f0ea40ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40c62b0 con 0x7f0ea4152560 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea41f0730 con 0x7f0ea41586f0 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea41f0cf0 con 0x7f0ea4072b20 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea4152560 0x7f0ea40c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea4152560 0x7f0ea40c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35808/0 (socket says 172.21.15.114:35808) 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea9200640 1 -- 172.21.15.114:0/254398658 learned_addr learned my addr 172.21.15.114:0/254398658 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eaa600640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ea41586f0 0x7f0ea40ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea9c00640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea4072b20 0x7f0ea41f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea9200640 1 -- 172.21.15.114:0/254398658 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea4072b20 msgr2=0x7f0ea41f1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea9200640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea4072b20 0x7f0ea41f1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea9200640 1 -- 172.21.15.114:0/254398658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ea41586f0 msgr2=0x7f0ea40ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea9200640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ea41586f0 0x7f0ea40ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea9200640 1 -- 172.21.15.114:0/254398658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94009420 con 0x7f0ea4152560 2024-02-17T12:19:52.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea9200640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea4152560 0x7f0ea40c55f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0e940ae040 tx=0x7f0e9401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:52.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea1600640 1 -- 172.21.15.114:0/254398658 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940b7450 con 0x7f0ea4152560 2024-02-17T12:19:52.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea1600640 1 -- 172.21.15.114:0/254398658 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e940b75b0 con 0x7f0ea4152560 2024-02-17T12:19:52.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0ea1600640 1 -- 172.21.15.114:0/254398658 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940b7960 con 0x7f0ea4152560 2024-02-17T12:19:52.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 -- 172.21.15.114:0/254398658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea40c5cf0 con 0x7f0ea4152560 2024-02-17T12:19:52.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 -- 172.21.15.114:0/254398658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea41f0980 con 0x7f0ea4152560 2024-02-17T12:19:52.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.692+0000 7f0eac600640 1 -- 172.21.15.114:0/254398658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea4067370 con 0x7f0ea4152560 2024-02-17T12:19:52.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.696+0000 7f0ea1600640 1 -- 172.21.15.114:0/254398658 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0e940b7ac0 con 0x7f0ea4152560 2024-02-17T12:19:52.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.696+0000 7f0ea1600640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e88066e40 0x7f0e88069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:52.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.696+0000 7f0ea1600640 1 -- 172.21.15.114:0/254398658 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0e9411f460 con 0x7f0ea4152560 2024-02-17T12:19:52.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.696+0000 7f0ea9c00640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e88066e40 0x7f0e88069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:52.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.696+0000 7f0ea9c00640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e88066e40 0x7f0e88069300 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0e98000f70 tx=0x7f0e98007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:52.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.700+0000 7f0ea1600640 1 -- 172.21.15.114:0/254398658 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e940ebf90 con 0x7f0ea4152560 2024-02-17T12:19:52.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 -- 172.21.15.114:0/254398658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ea406ccd0 con 0x7f0ea4152560 2024-02-17T12:19:52.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0ea1600640 1 -- 172.21.15.114:0/254398658 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6187 (secure 0 0 0) 0x7f0e940ef650 con 0x7f0ea4152560 2024-02-17T12:19:52.894 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:52.894 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:04.061245+0000","modified":"2024-02-17T12:19:07.080013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/709959478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":709959478},{"type":"v1","addr":"172.21.15.114:6837","nonce":709959478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:21.726155+0000","modified":"2024-02-17T12:19:24.747374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1982789506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1982789506},{"type":"v1","addr":"172.21.15.114:6836","nonce":1982789506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-02-17T12:19:52.895 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 53 2024-02-17T12:19:52.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 -- 172.21.15.114:0/254398658 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e88066e40 msgr2=0x7f0e88069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e88066e40 0x7f0e88069300 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0e98000f70 tx=0x7f0e98007240 comp rx=0 tx=0).stop 2024-02-17T12:19:52.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 -- 172.21.15.114:0/254398658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea4152560 msgr2=0x7f0ea40c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:52.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea4152560 0x7f0ea40c55f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0e940ae040 tx=0x7f0e9401ac50 comp rx=0 tx=0).stop 2024-02-17T12:19:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 -- 172.21.15.114:0/254398658 shutdown_connections 2024-02-17T12:19:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ea41586f0 0x7f0ea40ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e88066e40 0x7f0e88069300 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ea4152560 0x7f0ea40c55f0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 --2- 172.21.15.114:0/254398658 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0ea4072b20 0x7f0ea41f1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 -- 172.21.15.114:0/254398658 >> 172.21.15.114:0/254398658 conn(0x7f0ea406bef0 msgr2=0x7f0ea4157e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 -- 172.21.15.114:0/254398658 shutdown_connections 2024-02-17T12:19:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:52.892+0000 7f0eac600640 1 -- 172.21.15.114:0/254398658 wait complete. 2024-02-17T12:19:52.916 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:19:53.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9fdc00640 1 Processor -- start 2024-02-17T12:19:53.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9fdc00640 1 -- start start 2024-02-17T12:19:53.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9fdc00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc9f80c6460 0x7fc9f806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9fdc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f8155dd0 con 0x7fc9f8152540 2024-02-17T12:19:53.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9fdc00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f81588c0 con 0x7fc9f8154e30 2024-02-17T12:19:53.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9fdc00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f8155810 con 0x7fc9f80c6460 2024-02-17T12:19:53.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f6a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc9f8152540 0x7fc9f8158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37306/0 (socket says 172.21.15.114:37306) 2024-02-17T12:19:53.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f6a00640 1 -- 172.21.15.114:0/4037838542 learned_addr learned my addr 172.21.15.114:0/4037838542 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:53.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f6000640 1 --2- 172.21.15.114:0/4037838542 >> v2:172.21.15.116:3300/0 conn(0x7fc9f80c6460 0x7fc9f806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703329579 0 0) 0x7fc9f8155dd0 con 0x7fc9f8152540 2024-02-17T12:19:53.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9dc003530 con 0x7fc9f8152540 2024-02-17T12:19:53.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609970687 0 0) 0x7fc9dc003530 con 0x7fc9f8152540 2024-02-17T12:19:53.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 >> v2:172.21.15.116:3300/0 conn(0x7fc9f80c6460 msgr2=0x7fc9f806ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:53.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 --2- 172.21.15.114:0/4037838542 >> v2:172.21.15.116:3300/0 conn(0x7fc9f80c6460 0x7fc9f806ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 >> v1:172.21.15.116:6789/0 conn(0x7fc9f8154e30 legacy=0x7fc9f80aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8155af0 con 0x7fc9f8152540 2024-02-17T12:19:53.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fc9e8001a00 con 0x7fc9f8152540 2024-02-17T12:19:53.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 >> v1:172.21.15.114:6789/0 conn(0x7fc9f8152540 legacy=0x7fc9f8158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc003980 0x7fc9dc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9dc0047d0 0x7fc9dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9dc005190 0x7fc9dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f8155810 con 0x7fc9dc003980 2024-02-17T12:19:53.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc00c0e0 con 0x7fc9dc0047d0 2024-02-17T12:19:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc00c2a0 con 0x7fc9dc005190 2024-02-17T12:19:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f6a00640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc003980 0x7fc9dc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f6000640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9dc0047d0 0x7fc9dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f7400640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9dc005190 0x7fc9dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f6a00640 1 -- 172.21.15.114:0/4037838542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9dc005190 msgr2=0x7fc9dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f6a00640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9dc005190 0x7fc9dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f6a00640 1 -- 172.21.15.114:0/4037838542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9dc0047d0 msgr2=0x7fc9dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f6a00640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9dc0047d0 0x7fc9dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f6a00640 1 -- 172.21.15.114:0/4037838542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc003530 con 0x7fc9dc003980 2024-02-17T12:19:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.048+0000 7fc9f7400640 1 -- 172.21.15.114:0/4037838542 reap_dead start 2024-02-17T12:19:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9f6a00640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc003980 0x7fc9dc003d60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800a830 tx=0x7fc9e801d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d58acc55c0c67f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e80ad630 con 0x7fc9dc003980 2024-02-17T12:19:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e80a8070 con 0x7fc9dc003980 2024-02-17T12:19:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9f5600640 1 -- 172.21.15.114:0/4037838542 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e80ada30 con 0x7fc9dc003980 2024-02-17T12:19:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9fdc00640 1 -- 172.21.15.114:0/4037838542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc003980 msgr2=0x7fc9dc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9fdc00640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc003980 0x7fc9dc003d60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800a830 tx=0x7fc9e801d380 comp rx=0 tx=0).stop 2024-02-17T12:19:53.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9fdc00640 1 -- 172.21.15.114:0/4037838542 shutdown_connections 2024-02-17T12:19:53.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9fdc00640 1 --2- 172.21.15.114:0/4037838542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9dc003980 0x7fc9dc003d60 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9fdc00640 1 -- 172.21.15.114:0/4037838542 >> 172.21.15.114:0/4037838542 conn(0x7fc9f80c4f20 msgr2=0x7fc9f80c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:53.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9fdc00640 1 -- 172.21.15.114:0/4037838542 shutdown_connections 2024-02-17T12:19:53.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.052+0000 7fc9fdc00640 1 -- 172.21.15.114:0/4037838542 wait complete. 2024-02-17T12:19:53.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9fdc00640 1 Processor -- start 2024-02-17T12:19:53.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9fdc00640 1 -- start start 2024-02-17T12:19:53.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9fdc00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9dc003980 0x7fc9f806d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9fdc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f80ab8a0 0x7fc9f814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9fdc00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9f814d060 0x7fc9f81574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9fdc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f814d4e0 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9fdc00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f80ae160 con 0x7fc9dc003980 2024-02-17T12:19:53.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9fdc00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f80ae440 con 0x7fc9f814d060 2024-02-17T12:19:53.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f80ab8a0 0x7fc9f814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f80ab8a0 0x7fc9f814cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35824/0 (socket says 172.21.15.114:35824) 2024-02-17T12:19:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f6000640 1 -- 172.21.15.114:0/3305878227 learned_addr learned my addr 172.21.15.114:0/3305878227 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f6a00640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9dc003980 0x7fc9f806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f7400640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9f814d060 0x7fc9f81574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f6000640 1 -- 172.21.15.114:0/3305878227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9f814d060 msgr2=0x7fc9f81574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f6000640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9f814d060 0x7fc9f81574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f6000640 1 -- 172.21.15.114:0/3305878227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9dc003980 msgr2=0x7fc9f806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f6000640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9dc003980 0x7fc9f806d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f6000640 1 -- 172.21.15.114:0/3305878227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8156880 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9f6000640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f80ab8a0 0x7fc9f814cb20 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0011900 tx=0x7fc9e0011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9eea00640 1 -- 172.21.15.114:0/3305878227 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00095b0 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9eea00640 1 -- 172.21.15.114:0/3305878227 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0004240 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9eea00640 1 -- 172.21.15.114:0/3305878227 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e000f8e0 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9fdc00640 1 -- 172.21.15.114:0/3305878227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f8156b60 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.056+0000 7fc9fdc00640 1 -- 172.21.15.114:0/3305878227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f806d570 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.060+0000 7fc9fdc00640 1 -- 172.21.15.114:0/3305878227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f8074840 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.060+0000 7fc9eea00640 1 -- 172.21.15.114:0/3305878227 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fc9e000fa40 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.060+0000 7fc9eea00640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc9d4066e70 0x7fc9d4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.060+0000 7fc9eea00640 1 -- 172.21.15.114:0/3305878227 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc9e0085250 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.060+0000 7fc9f6a00640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc9d4066e70 0x7fc9d4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.060+0000 7fc9f6a00640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc9d4066e70 0x7fc9d4069330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80ad000 tx=0x7fc9e80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:53.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.064+0000 7fc9eea00640 1 -- 172.21.15.114:0/3305878227 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc9e0051d80 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.248+0000 7fc9fdc00640 1 -- 172.21.15.114:0/3305878227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9f80a88a0 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.248+0000 7fc9eea00640 1 -- 172.21.15.114:0/3305878227 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6187 (secure 0 0 0) 0x7fc9e000fcf0 con 0x7fc9f80ab8a0 2024-02-17T12:19:53.253 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:53.253 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:04.061245+0000","modified":"2024-02-17T12:19:07.080013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6504},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6504":{"gid":6504,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6837/709959478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":709959478},{"type":"v1","addr":"172.21.15.114:6837","nonce":709959478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:21.726155+0000","modified":"2024-02-17T12:19:24.747374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1982789506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1982789506},{"type":"v1","addr":"172.21.15.114:6836","nonce":1982789506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-02-17T12:19:53.253 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 53 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 -- 172.21.15.114:0/3305878227 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc9d4066e70 msgr2=0x7fc9d4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc9d4066e70 0x7fc9d4069330 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80ad000 tx=0x7fc9e80a7000 comp rx=0 tx=0).stop 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 -- 172.21.15.114:0/3305878227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f80ab8a0 msgr2=0x7fc9f814cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f80ab8a0 0x7fc9f814cb20 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0011900 tx=0x7fc9e0011dc0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 -- 172.21.15.114:0/3305878227 shutdown_connections 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc9f814d060 0x7fc9f81574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc9d4066e70 0x7fc9d4069330 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f80ab8a0 0x7fc9f814cb20 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 --2- 172.21.15.114:0/3305878227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc9dc003980 0x7fc9f806d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 -- 172.21.15.114:0/3305878227 >> 172.21.15.114:0/3305878227 conn(0x7fc9f80c4f20 msgr2=0x7fc9f80707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:53.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 -- 172.21.15.114:0/3305878227 shutdown_connections 2024-02-17T12:19:53.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.252+0000 7fc9fdc00640 1 -- 172.21.15.114:0/3305878227 wait complete. 2024-02-17T12:19:53.274 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:53.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3683e00640 1 Processor -- start 2024-02-17T12:19:53.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3683e00640 1 -- start start 2024-02-17T12:19:53.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3683e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 0x7f367c06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3683e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c155dd0 con 0x7f367c152540 2024-02-17T12:19:53.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3683e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c1588c0 con 0x7f367c154e30 2024-02-17T12:19:53.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3683e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c155810 con 0x7f367c0c6460 2024-02-17T12:19:53.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3681400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f367c152540 0x7f367c158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37314/0 (socket says 172.21.15.114:37314) 2024-02-17T12:19:53.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3681400640 1 -- 172.21.15.114:0/2467441976 learned_addr learned my addr 172.21.15.114:0/2467441976 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:53.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3680a00640 1 --2- 172.21.15.114:0/2467441976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 0x7f367c06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f367be00640 1 -- 172.21.15.114:0/2467441976 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850709103 0 0) 0x7f367c155dd0 con 0x7f367c152540 2024-02-17T12:19:53.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f367be00640 1 -- 172.21.15.114:0/2467441976 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3664003530 con 0x7f367c152540 2024-02-17T12:19:53.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f367be00640 1 -- 172.21.15.114:0/2467441976 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607129144 0 0) 0x7f367c1588c0 con 0x7f367c154e30 2024-02-17T12:19:53.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f367be00640 1 -- 172.21.15.114:0/2467441976 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f367c155dd0 con 0x7f367c154e30 2024-02-17T12:19:53.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f367be00640 1 -- 172.21.15.114:0/2467441976 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2438515365 0 0) 0x7f3664003530 con 0x7f367c152540 2024-02-17T12:19:53.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3680a00640 1 -- 172.21.15.114:0/2467441976 >> v1:172.21.15.116:6789/0 conn(0x7f367c154e30 legacy=0x7f367c0aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3680a00640 1 -- 172.21.15.114:0/2467441976 >> v1:172.21.15.114:6789/0 conn(0x7f367c152540 legacy=0x7f367c158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.408+0000 7f3680a00640 1 -- 172.21.15.114:0/2467441976 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c155af0 con 0x7f367c0c6460 2024-02-17T12:19:53.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f3680a00640 1 --2- 172.21.15.114:0/2467441976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 0x7f367c06ff80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f36680097f0 tx=0x7f366801c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=857f26802776f57a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:53.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f367be00640 1 -- 172.21.15.114:0/2467441976 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670001680 con 0x7f367c0c6460 2024-02-17T12:19:53.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f367be00640 1 -- 172.21.15.114:0/2467441976 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36680a7050 con 0x7f367c0c6460 2024-02-17T12:19:53.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f367be00640 1 -- 172.21.15.114:0/2467441976 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36680ab400 con 0x7f367c0c6460 2024-02-17T12:19:53.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f3683e00640 1 -- 172.21.15.114:0/2467441976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 msgr2=0x7f367c06ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f3683e00640 1 --2- 172.21.15.114:0/2467441976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 0x7f367c06ff80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f36680097f0 tx=0x7f366801c2e0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f3683e00640 1 -- 172.21.15.114:0/2467441976 shutdown_connections 2024-02-17T12:19:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f3683e00640 1 --2- 172.21.15.114:0/2467441976 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 0x7f367c06ff80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f3683e00640 1 -- 172.21.15.114:0/2467441976 >> 172.21.15.114:0/2467441976 conn(0x7f367c0c4f20 msgr2=0x7f367c0c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f3683e00640 1 -- 172.21.15.114:0/2467441976 shutdown_connections 2024-02-17T12:19:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.412+0000 7f3683e00640 1 -- 172.21.15.114:0/2467441976 wait complete. 2024-02-17T12:19:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3683e00640 1 Processor -- start 2024-02-17T12:19:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3683e00640 1 -- start start 2024-02-17T12:19:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3683e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 0x7f367c1ee250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3683e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f367c152540 0x7f367c1574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3683e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367c154e30 0x7f367c1436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3683e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c1ee790 con 0x7f367c154e30 2024-02-17T12:19:53.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3683e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c147050 con 0x7f367c152540 2024-02-17T12:19:53.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3683e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c145c10 con 0x7f367c0c6460 2024-02-17T12:19:53.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3681e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367c154e30 0x7f367c1436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3681e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367c154e30 0x7f367c1436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35840/0 (socket says 172.21.15.114:35840) 2024-02-17T12:19:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3681e00640 1 -- 172.21.15.114:0/1587844076 learned_addr learned my addr 172.21.15.114:0/1587844076 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3681400640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 0x7f367c1ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3680a00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f367c152540 0x7f367c1574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3681e00640 1 -- 172.21.15.114:0/1587844076 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 msgr2=0x7f367c1ee250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3681e00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 0x7f367c1ee250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3681e00640 1 -- 172.21.15.114:0/1587844076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f367c152540 msgr2=0x7f367c1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3681e00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f367c152540 0x7f367c1574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3681e00640 1 -- 172.21.15.114:0/1587844076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668009420 con 0x7f367c154e30 2024-02-17T12:19:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3680a00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f367c152540 0x7f367c1574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3681e00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367c154e30 0x7f367c1436d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f367400c730 tx=0x7f367400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3679600640 1 -- 172.21.15.114:0/1587844076 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674003b80 con 0x7f367c154e30 2024-02-17T12:19:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3679600640 1 -- 172.21.15.114:0/1587844076 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674003ce0 con 0x7f367c154e30 2024-02-17T12:19:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3683e00640 1 -- 172.21.15.114:0/1587844076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f367c145ef0 con 0x7f367c154e30 2024-02-17T12:19:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3679600640 1 -- 172.21.15.114:0/1587844076 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400aa90 con 0x7f367c154e30 2024-02-17T12:19:53.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.416+0000 7f3683e00640 1 -- 172.21.15.114:0/1587844076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367c1464b0 con 0x7f367c154e30 2024-02-17T12:19:53.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.420+0000 7f3683e00640 1 -- 172.21.15.114:0/1587844076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367c147680 con 0x7f367c154e30 2024-02-17T12:19:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.420+0000 7f3679600640 1 -- 172.21.15.114:0/1587844076 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f367400abf0 con 0x7f367c154e30 2024-02-17T12:19:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.420+0000 7f3679600640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f365c066e40 0x7f365c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.420+0000 7f3679600640 1 -- 172.21.15.114:0/1587844076 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3674084bf0 con 0x7f367c154e30 2024-02-17T12:19:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.420+0000 7f3681400640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f365c066e40 0x7f365c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.420+0000 7f3681400640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f365c066e40 0x7f365c069300 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f36700011f0 tx=0x7f3670009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.424+0000 7f3679600640 1 -- 172.21.15.114:0/1587844076 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f367c147680 con 0x7f367c154e30 2024-02-17T12:19:53.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.580+0000 7f3683e00640 1 -- 172.21.15.114:0/1587844076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f367c147680 con 0x7f367c154e30 2024-02-17T12:19:53.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.580+0000 7f3679600640 1 -- 172.21.15.114:0/1587844076 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20392 (secure 0 0 0) 0x7f367c147680 con 0x7f367c154e30 2024-02-17T12:19:53.584 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:53.584 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:23.364663+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-02-17T12:19:01.796651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-02-17T12:19:03.070707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.580+0000 7f3683e00640 1 -- 172.21.15.114:0/1587844076 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f365c066e40 msgr2=0x7f365c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.580+0000 7f3683e00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f365c066e40 0x7f365c069300 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f36700011f0 tx=0x7f3670009040 comp rx=0 tx=0).stop 2024-02-17T12:19:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.580+0000 7f3683e00640 1 -- 172.21.15.114:0/1587844076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367c154e30 msgr2=0x7f367c1436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.580+0000 7f3683e00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367c154e30 0x7f367c1436d0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f367400c730 tx=0x7f367400cbf0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.584+0000 7f3683e00640 1 -- 172.21.15.114:0/1587844076 shutdown_connections 2024-02-17T12:19:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.584+0000 7f3683e00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f365c066e40 0x7f365c069300 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.584+0000 7f3683e00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f367c154e30 0x7f367c1436d0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.584+0000 7f3683e00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f367c152540 0x7f367c1574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.584+0000 7f3683e00640 1 --2- 172.21.15.114:0/1587844076 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f367c0c6460 0x7f367c1ee250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.584+0000 7f3683e00640 1 -- 172.21.15.114:0/1587844076 >> 172.21.15.114:0/1587844076 conn(0x7f367c0c4f20 msgr2=0x7f367c152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.584+0000 7f3683e00640 1 -- 172.21.15.114:0/1587844076 shutdown_connections 2024-02-17T12:19:53.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.584+0000 7f3683e00640 1 -- 172.21.15.114:0/1587844076 wait complete. 2024-02-17T12:19:53.605 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-17T12:19:53.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.736+0000 7fb267a00640 1 Processor -- start 2024-02-17T12:19:53.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.736+0000 7fb267a00640 1 -- start start 2024-02-17T12:19:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb267a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb26014f110 0x7fb2600c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb267a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2600a9420 con 0x7fb2600c1eb0 2024-02-17T12:19:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb267a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb260152850 con 0x7fb2600c2580 2024-02-17T12:19:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb267a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26014f4f0 con 0x7fb26014f110 2024-02-17T12:19:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb265a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb2600c1eb0 0x7fb26015c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37322/0 (socket says 172.21.15.114:37322) 2024-02-17T12:19:53.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb265a00640 1 -- 172.21.15.114:0/305208942 learned_addr learned my addr 172.21.15.114:0/305208942 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:53.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb265000640 1 --2- 172.21.15.114:0/305208942 >> v2:172.21.15.116:3300/0 conn(0x7fb26014f110 0x7fb2600c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb25f400640 1 -- 172.21.15.114:0/305208942 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966886298 0 0) 0x7fb2600a9420 con 0x7fb2600c1eb0 2024-02-17T12:19:53.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb25f400640 1 -- 172.21.15.114:0/305208942 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb244003530 con 0x7fb2600c1eb0 2024-02-17T12:19:53.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb25f400640 1 -- 172.21.15.114:0/305208942 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921851492 0 0) 0x7fb260152850 con 0x7fb2600c2580 2024-02-17T12:19:53.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb25f400640 1 -- 172.21.15.114:0/305208942 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2600a9420 con 0x7fb2600c2580 2024-02-17T12:19:53.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb25f400640 1 -- 172.21.15.114:0/305208942 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578941564 0 0) 0x7fb244003530 con 0x7fb2600c1eb0 2024-02-17T12:19:53.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb265000640 1 -- 172.21.15.114:0/305208942 >> v1:172.21.15.116:6789/0 conn(0x7fb2600c2580 legacy=0x7fb2600aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb265000640 1 -- 172.21.15.114:0/305208942 >> v1:172.21.15.114:6789/0 conn(0x7fb2600c1eb0 legacy=0x7fb26015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.740+0000 7fb265000640 1 -- 172.21.15.114:0/305208942 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2600a9670 con 0x7fb26014f110 2024-02-17T12:19:53.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb265000640 1 --2- 172.21.15.114:0/305208942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb26014f110 0x7fb2600c65a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb2500097c0 tx=0x7fb25001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5353d0c3fa1000ba server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:53.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb25f400640 1 -- 172.21.15.114:0/305208942 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258001a00 con 0x7fb26014f110 2024-02-17T12:19:53.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb25f400640 1 -- 172.21.15.114:0/305208942 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2500a7050 con 0x7fb26014f110 2024-02-17T12:19:53.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb25f400640 1 -- 172.21.15.114:0/305208942 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2500ab620 con 0x7fb26014f110 2024-02-17T12:19:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 -- 172.21.15.114:0/305208942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb26014f110 msgr2=0x7fb2600c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 --2- 172.21.15.114:0/305208942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb26014f110 0x7fb2600c65a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb2500097c0 tx=0x7fb25001c330 comp rx=0 tx=0).stop 2024-02-17T12:19:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 -- 172.21.15.114:0/305208942 shutdown_connections 2024-02-17T12:19:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 --2- 172.21.15.114:0/305208942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb26014f110 0x7fb2600c65a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 -- 172.21.15.114:0/305208942 >> 172.21.15.114:0/305208942 conn(0x7fb2600a8490 msgr2=0x7fb2600a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 -- 172.21.15.114:0/305208942 shutdown_connections 2024-02-17T12:19:53.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 -- 172.21.15.114:0/305208942 wait complete. 2024-02-17T12:19:53.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 Processor -- start 2024-02-17T12:19:53.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 -- start start 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2600c1eb0 0x7fb260155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2600c2580 0x7fb260144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb26014f110 0x7fb260153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb260154280 con 0x7fb2600c2580 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600c46a0 con 0x7fb2600c1eb0 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.744+0000 7fb267a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb260155990 con 0x7fb26014f110 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2600c2580 0x7fb260144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2600c2580 0x7fb260144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35848/0 (socket says 172.21.15.114:35848) 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25fe00640 1 -- 172.21.15.114:0/287432142 learned_addr learned my addr 172.21.15.114:0/287432142 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb265a00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb26014f110 0x7fb260153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb265000640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2600c1eb0 0x7fb260155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25fe00640 1 -- 172.21.15.114:0/287432142 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb26014f110 msgr2=0x7fb260153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25fe00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb26014f110 0x7fb260153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25fe00640 1 -- 172.21.15.114:0/287432142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2600c1eb0 msgr2=0x7fb260155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25fe00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2600c1eb0 0x7fb260155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25fe00640 1 -- 172.21.15.114:0/287432142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250009420 con 0x7fb2600c2580 2024-02-17T12:19:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25fe00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2600c2580 0x7fb260144d30 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00c3c0 tx=0x7fb24c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25cc00640 1 -- 172.21.15.114:0/287432142 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0052d0 con 0x7fb2600c2580 2024-02-17T12:19:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25cc00640 1 -- 172.21.15.114:0/287432142 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c005430 con 0x7fb2600c2580 2024-02-17T12:19:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25cc00640 1 -- 172.21.15.114:0/287432142 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c003840 con 0x7fb2600c2580 2024-02-17T12:19:53.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb267a00640 1 -- 172.21.15.114:0/287432142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2600c56f0 con 0x7fb2600c2580 2024-02-17T12:19:53.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb267a00640 1 -- 172.21.15.114:0/287432142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2600c5cb0 con 0x7fb2600c2580 2024-02-17T12:19:53.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb267a00640 1 -- 172.21.15.114:0/287432142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2600c4850 con 0x7fb2600c2580 2024-02-17T12:19:53.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.748+0000 7fb25cc00640 1 -- 172.21.15.114:0/287432142 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb24c0039a0 con 0x7fb2600c2580 2024-02-17T12:19:53.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.752+0000 7fb25cc00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb240066e40 0x7fb240069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:53.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.752+0000 7fb25cc00640 1 -- 172.21.15.114:0/287432142 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb24c084220 con 0x7fb2600c2580 2024-02-17T12:19:53.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.752+0000 7fb265000640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb240066e40 0x7fb240069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:53.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.752+0000 7fb265000640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb240066e40 0x7fb240069300 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb2500ad000 tx=0x7fb2500a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:53.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.756+0000 7fb25cc00640 1 -- 172.21.15.114:0/287432142 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb2600c4850 con 0x7fb2600c2580 2024-02-17T12:19:53.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.940+0000 7fb267a00640 1 -- 172.21.15.114:0/287432142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb2600c4810 con 0x7fb2600c2580 2024-02-17T12:19:53.945 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-02-17T12:19:53.940+0000 7f5091a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-17T12:19:53.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.944+0000 7fb25cc00640 1 -- 172.21.15.114:0/287432142 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb24c050d50 con 0x7fb2600c2580 2024-02-17T12:19:53.947 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-17T12:19:53.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 -- 172.21.15.114:0/287432142 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb240066e40 msgr2=0x7fb240069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb240066e40 0x7fb240069300 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb2500ad000 tx=0x7fb2500a6000 comp rx=0 tx=0).stop 2024-02-17T12:19:53.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 -- 172.21.15.114:0/287432142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2600c2580 msgr2=0x7fb260144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:53.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2600c2580 0x7fb260144d30 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00c3c0 tx=0x7fb24c00c880 comp rx=0 tx=0).stop 2024-02-17T12:19:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 -- 172.21.15.114:0/287432142 shutdown_connections 2024-02-17T12:19:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb26014f110 0x7fb260153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb240066e40 0x7fb240069300 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2600c2580 0x7fb260144d30 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 --2- 172.21.15.114:0/287432142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2600c1eb0 0x7fb260155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 -- 172.21.15.114:0/287432142 >> 172.21.15.114:0/287432142 conn(0x7fb2600a8490 msgr2=0x7fb260151cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 -- 172.21.15.114:0/287432142 shutdown_connections 2024-02-17T12:19:53.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:53.948+0000 7fb267a00640 1 -- 172.21.15.114:0/287432142 wait complete. 2024-02-17T12:19:53.961 INFO:tasks.ceph.mds.c.smithi114.stderr: -5673> 2024-02-17T12:19:10.664+0000 7fecf2600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:19:53.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-17T12:19:54.010 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-02-17T12:19:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.108+0000 7f4066800640 1 Processor -- start 2024-02-17T12:19:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.108+0000 7f4066800640 1 -- start start 2024-02-17T12:19:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.108+0000 7f4066800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f406006db50 0x7f406014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.108+0000 7f4066800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4060156270 con 0x7f40600c25a0 2024-02-17T12:19:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.108+0000 7f4066800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4060156550 con 0x7f4060150490 2024-02-17T12:19:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.108+0000 7f4066800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406006f090 con 0x7f406006db50 2024-02-17T12:19:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.108+0000 7f405f400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f40600c25a0 0x7f406006e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37338/0 (socket says 172.21.15.114:37338) 2024-02-17T12:19:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.108+0000 7f405f400640 1 -- 172.21.15.114:0/3994710990 learned_addr learned my addr 172.21.15.114:0/3994710990 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.108+0000 7f405ea00640 1 --2- 172.21.15.114:0/3994710990 >> v2:172.21.15.114:3300/0 conn(0x7f406006db50 0x7f406014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f405e000640 1 -- 172.21.15.114:0/3994710990 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095132708 0 0) 0x7f4060156270 con 0x7f40600c25a0 2024-02-17T12:19:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f405e000640 1 -- 172.21.15.114:0/3994710990 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4044003530 con 0x7f40600c25a0 2024-02-17T12:19:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f405ea00640 1 -- 172.21.15.114:0/3994710990 >> v1:172.21.15.116:6789/0 conn(0x7f4060150490 legacy=0x7f4060152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:54.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f405ea00640 1 -- 172.21.15.114:0/3994710990 >> v1:172.21.15.114:6789/0 conn(0x7f40600c25a0 legacy=0x7f406006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:54.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f405ea00640 1 -- 172.21.15.114:0/3994710990 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4060156830 con 0x7f406006db50 2024-02-17T12:19:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f405ea00640 1 --2- 172.21.15.114:0/3994710990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406006db50 0x7f406014ff50 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f404c0097c0 tx=0x7f404c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d32e5e3fc6cf64 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f405e000640 1 -- 172.21.15.114:0/3994710990 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0ab600 con 0x7f406006db50 2024-02-17T12:19:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f405e000640 1 -- 172.21.15.114:0/3994710990 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c0a7050 con 0x7f406006db50 2024-02-17T12:19:54.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f405e000640 1 -- 172.21.15.114:0/3994710990 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0ab980 con 0x7f406006db50 2024-02-17T12:19:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f4066800640 1 -- 172.21.15.114:0/3994710990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406006db50 msgr2=0x7f406014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.112+0000 7f4066800640 1 --2- 172.21.15.114:0/3994710990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406006db50 0x7f406014ff50 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f404c0097c0 tx=0x7f404c01c380 comp rx=0 tx=0).stop 2024-02-17T12:19:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 -- 172.21.15.114:0/3994710990 shutdown_connections 2024-02-17T12:19:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 --2- 172.21.15.114:0/3994710990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406006db50 0x7f406014ff50 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 -- 172.21.15.114:0/3994710990 >> 172.21.15.114:0/3994710990 conn(0x7f40600a8490 msgr2=0x7f40600a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 -- 172.21.15.114:0/3994710990 shutdown_connections 2024-02-17T12:19:54.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 -- 172.21.15.114:0/3994710990 wait complete. 2024-02-17T12:19:54.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 Processor -- start 2024-02-17T12:19:54.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 -- start start 2024-02-17T12:19:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f406006db50 0x7f4060139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:54.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40600c25a0 0x7f4060138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4060150490 0x7f4060151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060155fd0 con 0x7f40600c25a0 2024-02-17T12:19:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060150e00 con 0x7f4060150490 2024-02-17T12:19:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4060155730 con 0x7f406006db50 2024-02-17T12:19:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40600c25a0 0x7f4060138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40600c25a0 0x7f4060138f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35880/0 (socket says 172.21.15.114:35880) 2024-02-17T12:19:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405ea00640 1 -- 172.21.15.114:0/2730015642 learned_addr learned my addr 172.21.15.114:0/2730015642 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405f400640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f406006db50 0x7f4060139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405fe00640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4060150490 0x7f4060151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405ea00640 1 -- 172.21.15.114:0/2730015642 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f406006db50 msgr2=0x7f4060139d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405ea00640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f406006db50 0x7f4060139d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405ea00640 1 -- 172.21.15.114:0/2730015642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4060150490 msgr2=0x7f4060151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405ea00640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4060150490 0x7f4060151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405ea00640 1 -- 172.21.15.114:0/2730015642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c009420 con 0x7f40600c25a0 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405f400640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f406006db50 0x7f4060139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405fe00640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4060150490 0x7f4060151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f405ea00640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40600c25a0 0x7f4060138f70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f404c018f90 tx=0x7f404c019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4057400640 1 -- 172.21.15.114:0/2730015642 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0b4410 con 0x7f40600c25a0 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4057400640 1 -- 172.21.15.114:0/2730015642 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c0b4570 con 0x7f40600c25a0 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4057400640 1 -- 172.21.15.114:0/2730015642 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0b4920 con 0x7f40600c25a0 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 -- 172.21.15.114:0/2730015642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4060155a10 con 0x7f40600c25a0 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.116+0000 7f4066800640 1 -- 172.21.15.114:0/2730015642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4060152830 con 0x7f40600c25a0 2024-02-17T12:19:54.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.120+0000 7f4066800640 1 -- 172.21.15.114:0/2730015642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4060150f70 con 0x7f40600c25a0 2024-02-17T12:19:54.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.120+0000 7f4057400640 1 -- 172.21.15.114:0/2730015642 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f404c0b2040 con 0x7f40600c25a0 2024-02-17T12:19:54.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.120+0000 7f4057400640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4040066e40 0x7f4040069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:54.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.120+0000 7f4057400640 1 -- 172.21.15.114:0/2730015642 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f404c11ee90 con 0x7f40600c25a0 2024-02-17T12:19:54.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.120+0000 7f405f400640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4040066e40 0x7f4040069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:54.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.120+0000 7f405f400640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4040066e40 0x7f4040069300 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f40500011f0 tx=0x7f4050009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:54.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.124+0000 7f4057400640 1 -- 172.21.15.114:0/2730015642 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f404c0eb8c0 con 0x7f40600c25a0 2024-02-17T12:19:54.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.312+0000 7f4066800640 1 -- 172.21.15.114:0/2730015642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4060074840 con 0x7f40600c25a0 2024-02-17T12:19:54.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.944+0000 7f4057400640 1 -- 172.21.15.114:0/2730015642 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7f404c0c20a0 con 0x7f40600c25a0 2024-02-17T12:19:54.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 -- 172.21.15.114:0/2730015642 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4040066e40 msgr2=0x7f4040069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:54.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4040066e40 0x7f4040069300 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f40500011f0 tx=0x7f4050009040 comp rx=0 tx=0).stop 2024-02-17T12:19:54.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 -- 172.21.15.114:0/2730015642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40600c25a0 msgr2=0x7f4060138f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:54.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40600c25a0 0x7f4060138f70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f404c018f90 tx=0x7f404c019120 comp rx=0 tx=0).stop 2024-02-17T12:19:54.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 -- 172.21.15.114:0/2730015642 shutdown_connections 2024-02-17T12:19:54.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4060150490 0x7f4060151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:54.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f4040066e40 0x7f4040069300 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:54.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40600c25a0 0x7f4060138f70 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:54.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 --2- 172.21.15.114:0/2730015642 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f406006db50 0x7f4060139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:54.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 -- 172.21.15.114:0/2730015642 >> 172.21.15.114:0/2730015642 conn(0x7f40600a8490 msgr2=0x7f40600c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:54.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 -- 172.21.15.114:0/2730015642 shutdown_connections 2024-02-17T12:19:54.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:54.948+0000 7f4066800640 1 -- 172.21.15.114:0/2730015642 wait complete. 2024-02-17T12:19:54.975 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-17T12:19:55.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff27c000640 1 Processor -- start 2024-02-17T12:19:55.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff27c000640 1 -- start start 2024-02-17T12:19:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff27c000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff27414f310 0x7ff2741524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff27c000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff2740a7dd0 0x7ff2740c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff27c000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2740c2e00 con 0x7ff2740c2530 2024-02-17T12:19:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff27c000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2740a6980 con 0x7ff27414f310 2024-02-17T12:19:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff27c000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2740c30e0 con 0x7ff2740a7dd0 2024-02-17T12:19:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff279600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff27414f310 0x7ff2741524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff27a000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff2740c2530 0x7ff2740c3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47092/0 (socket says 172.21.15.114:47092) 2024-02-17T12:19:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff27a000640 1 -- 172.21.15.114:0/3478351334 learned_addr learned my addr 172.21.15.114:0/3478351334 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff278c00640 1 --2- 172.21.15.114:0/3478351334 >> v2:172.21.15.116:3300/0 conn(0x7ff2740a7dd0 0x7ff2740c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff279600640 1 -- 172.21.15.114:0/3478351334 >> v2:172.21.15.116:3300/0 conn(0x7ff2740a7dd0 msgr2=0x7ff2740c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:55.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff279600640 1 --2- 172.21.15.114:0/3478351334 >> v2:172.21.15.116:3300/0 conn(0x7ff2740a7dd0 0x7ff2740c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:55.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff279600640 1 -- 172.21.15.114:0/3478351334 >> v1:172.21.15.114:6789/0 conn(0x7ff2740c2530 legacy=0x7ff2740c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:55.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff279600640 1 -- 172.21.15.114:0/3478351334 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27414f6f0 con 0x7ff27414f310 2024-02-17T12:19:55.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff278c00640 1 --2- 172.21.15.114:0/3478351334 >> v2:172.21.15.116:3300/0 conn(0x7ff2740a7dd0 0x7ff2740c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:55.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.160+0000 7ff273e00640 1 -- 172.21.15.114:0/3478351334 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171701896 0 0) 0x7ff2740c2e00 con 0x7ff2740c2530 2024-02-17T12:19:55.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff279600640 1 --2- 172.21.15.114:0/3478351334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff27414f310 0x7ff2741524d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff2740a5e10 tx=0x7ff26801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc78eacafb1d21e8 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:55.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff273e00640 1 -- 172.21.15.114:0/3478351334 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680ab600 con 0x7ff27414f310 2024-02-17T12:19:55.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff273e00640 1 -- 172.21.15.114:0/3478351334 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2680a7050 con 0x7ff27414f310 2024-02-17T12:19:55.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff273e00640 1 -- 172.21.15.114:0/3478351334 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680ab980 con 0x7ff27414f310 2024-02-17T12:19:55.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff27c000640 1 -- 172.21.15.114:0/3478351334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff27414f310 msgr2=0x7ff2741524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:55.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff27c000640 1 --2- 172.21.15.114:0/3478351334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff27414f310 0x7ff2741524d0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff2740a5e10 tx=0x7ff26801c480 comp rx=0 tx=0).stop 2024-02-17T12:19:55.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff27c000640 1 -- 172.21.15.114:0/3478351334 shutdown_connections 2024-02-17T12:19:55.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff27c000640 1 --2- 172.21.15.114:0/3478351334 >> v2:172.21.15.116:3300/0 conn(0x7ff2740a7dd0 0x7ff2740c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:55.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff27c000640 1 --2- 172.21.15.114:0/3478351334 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff27414f310 0x7ff2741524d0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:55.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff27c000640 1 -- 172.21.15.114:0/3478351334 >> 172.21.15.114:0/3478351334 conn(0x7ff27406b210 msgr2=0x7ff27406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:55.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff27c000640 1 -- 172.21.15.114:0/3478351334 shutdown_connections 2024-02-17T12:19:55.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff27c000640 1 -- 172.21.15.114:0/3478351334 wait complete. 2024-02-17T12:19:55.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff27c000640 1 Processor -- start 2024-02-17T12:19:55.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.164+0000 7ff27c000640 1 -- start start 2024-02-17T12:19:55.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27c000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2740a7dd0 0x7ff27414f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:55.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27c000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2740c2530 0x7ff274141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:55.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27c000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27414f310 0x7ff27414d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:55.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27c000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff274141b80 con 0x7ff2740c2530 2024-02-17T12:19:55.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27c000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2741417e0 con 0x7ff2740a7dd0 2024-02-17T12:19:55.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27c000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff274151690 con 0x7ff27414f310 2024-02-17T12:19:55.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff278c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2740c2530 0x7ff274141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:55.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff278c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2740c2530 0x7ff274141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51580/0 (socket says 172.21.15.114:51580) 2024-02-17T12:19:55.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff278c00640 1 -- 172.21.15.114:0/264001110 learned_addr learned my addr 172.21.15.114:0/264001110 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:55.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27a000640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27414f310 0x7ff27414d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:55.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff278c00640 1 -- 172.21.15.114:0/264001110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27414f310 msgr2=0x7ff27414d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:55.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff279600640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2740a7dd0 0x7ff27414f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:55.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff278c00640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27414f310 0x7ff27414d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:55.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff278c00640 1 -- 172.21.15.114:0/264001110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2740a7dd0 msgr2=0x7ff27414f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:55.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff278c00640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2740a7dd0 0x7ff27414f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:55.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff278c00640 1 -- 172.21.15.114:0/264001110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff268009420 con 0x7ff2740c2530 2024-02-17T12:19:55.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27a000640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27414f310 0x7ff27414d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:55.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff279600640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2740a7dd0 0x7ff27414f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:55.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff278c00640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2740c2530 0x7ff274141fa0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c7c0 tx=0x7ff26000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:55.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff271600640 1 -- 172.21.15.114:0/264001110 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260007a30 con 0x7ff2740c2530 2024-02-17T12:19:55.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff271600640 1 -- 172.21.15.114:0/264001110 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff260007b90 con 0x7ff2740c2530 2024-02-17T12:19:55.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff271600640 1 -- 172.21.15.114:0/264001110 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26000ce70 con 0x7ff2740c2530 2024-02-17T12:19:55.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27c000640 1 -- 172.21.15.114:0/264001110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff274151970 con 0x7ff2740c2530 2024-02-17T12:19:55.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27c000640 1 -- 172.21.15.114:0/264001110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2740c0910 con 0x7ff2740c2530 2024-02-17T12:19:55.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff27c000640 1 -- 172.21.15.114:0/264001110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff274141cc0 con 0x7ff2740c2530 2024-02-17T12:19:55.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.168+0000 7ff271600640 1 -- 172.21.15.114:0/264001110 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff2600113f0 con 0x7ff2740c2530 2024-02-17T12:19:55.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.172+0000 7ff271600640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff254066e70 0x7ff254069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:55.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.172+0000 7ff271600640 1 -- 172.21.15.114:0/264001110 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6651+0+0 (secure 0 0 0) 0x7ff260085240 con 0x7ff2740c2530 2024-02-17T12:19:55.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.172+0000 7ff279600640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff254066e70 0x7ff254069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:55.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.172+0000 7ff279600640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff254066e70 0x7ff254069330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff2680ad000 tx=0x7ff268008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:55.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.176+0000 7ff271600640 1 -- 172.21.15.114:0/264001110 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff274141cc0 con 0x7ff2740c2530 2024-02-17T12:19:55.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.332+0000 7ff27c000640 1 -- 172.21.15.114:0/264001110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff274141cc0 con 0x7ff2740c2530 2024-02-17T12:19:55.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.952+0000 7ff271600640 1 -- 172.21.15.114:0/264001110 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff274141cc0 con 0x7ff2740c2530 2024-02-17T12:19:55.957 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-02-17T12:19:55.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 -- 172.21.15.114:0/264001110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff254066e70 msgr2=0x7ff254069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:55.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff254066e70 0x7ff254069330 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff2680ad000 tx=0x7ff268008040 comp rx=0 tx=0).stop 2024-02-17T12:19:55.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 -- 172.21.15.114:0/264001110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2740c2530 msgr2=0x7ff274141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2740c2530 0x7ff274141fa0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c7c0 tx=0x7ff26000cc80 comp rx=0 tx=0).stop 2024-02-17T12:19:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 -- 172.21.15.114:0/264001110 shutdown_connections 2024-02-17T12:19:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff27414f310 0x7ff27414d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff254066e70 0x7ff254069330 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2740c2530 0x7ff274141fa0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 --2- 172.21.15.114:0/264001110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2740a7dd0 0x7ff27414f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 -- 172.21.15.114:0/264001110 >> 172.21.15.114:0/264001110 conn(0x7ff27406b210 msgr2=0x7ff27414e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 -- 172.21.15.114:0/264001110 shutdown_connections 2024-02-17T12:19:55.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:55.956+0000 7ff27c000640 1 -- 172.21.15.114:0/264001110 wait complete. 2024-02-17T12:19:55.985 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-17T12:19:56.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf5e000640 1 Processor -- start 2024-02-17T12:19:56.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf5e000640 1 -- start start 2024-02-17T12:19:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf5e000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdf580c3390 0x7fdf580c0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf5e000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf58155790 con 0x7fdf58158b80 2024-02-17T12:19:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf5e000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf58154e80 con 0x7fdf580c0270 2024-02-17T12:19:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf5e000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf580c37c0 con 0x7fdf580c3390 2024-02-17T12:19:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf4ea00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdf58158b80 0x7fdf5815d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47096/0 (socket says 172.21.15.114:47096) 2024-02-17T12:19:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf4ea00640 1 -- 172.21.15.114:0/4086958544 learned_addr learned my addr 172.21.15.114:0/4086958544 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001619351 0 0) 0x7fdf58155790 con 0x7fdf58158b80 2024-02-17T12:19:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf57e00640 1 --2- 172.21.15.114:0/4086958544 >> v2:172.21.15.116:3300/0 conn(0x7fdf580c3390 0x7fdf580c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:56.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf3c003530 con 0x7fdf58158b80 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 263305767 0 0) 0x7fdf3c003530 con 0x7fdf58158b80 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 >> v2:172.21.15.116:3300/0 conn(0x7fdf580c3390 msgr2=0x7fdf580c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 --2- 172.21.15.114:0/4086958544 >> v2:172.21.15.116:3300/0 conn(0x7fdf580c3390 0x7fdf580c0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 >> v1:172.21.15.116:6789/0 conn(0x7fdf580c0270 legacy=0x7fdf58158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5806c260 con 0x7fdf58158b80 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fdf40001680 con 0x7fdf58158b80 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 >> v1:172.21.15.114:6789/0 conn(0x7fdf58158b80 legacy=0x7fdf5815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf3c003980 0x7fdf3c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c0047d0 0x7fdf3c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf3c005190 0x7fdf3c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c00c100 con 0x7fdf3c0047d0 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c00c270 con 0x7fdf3c005190 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3c00c430 con 0x7fdf3c003980 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf4ea00640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c0047d0 0x7fdf3c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf57e00640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf3c005190 0x7fdf3c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf57400640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf3c003980 0x7fdf3c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf4ea00640 1 -- 172.21.15.114:0/4086958544 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf3c003980 msgr2=0x7fdf3c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf4ea00640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf3c003980 0x7fdf3c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf4ea00640 1 -- 172.21.15.114:0/4086958544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf3c005190 msgr2=0x7fdf3c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf4ea00640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf3c005190 0x7fdf3c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf4ea00640 1 -- 172.21.15.114:0/4086958544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c003530 con 0x7fdf3c0047d0 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf57e00640 1 -- 172.21.15.114:0/4086958544 reap_dead start 2024-02-17T12:19:56.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.124+0000 7fdf57400640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf3c003980 0x7fdf3c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf4ea00640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c0047d0 0x7fdf3c004c50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000c1c0 tx=0x7fdf4001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9f2800ab7d3613 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40005ae0 con 0x7fdf3c0047d0 2024-02-17T12:19:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf40005c40 con 0x7fdf3c0047d0 2024-02-17T12:19:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf56a00640 1 -- 172.21.15.114:0/4086958544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf400a5b00 con 0x7fdf3c0047d0 2024-02-17T12:19:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf5e000640 1 -- 172.21.15.114:0/4086958544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c0047d0 msgr2=0x7fdf3c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf5e000640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c0047d0 0x7fdf3c004c50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000c1c0 tx=0x7fdf4001cbc0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf5e000640 1 -- 172.21.15.114:0/4086958544 shutdown_connections 2024-02-17T12:19:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf5e000640 1 --2- 172.21.15.114:0/4086958544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf3c0047d0 0x7fdf3c004c50 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf5e000640 1 -- 172.21.15.114:0/4086958544 >> 172.21.15.114:0/4086958544 conn(0x7fdf580c7520 msgr2=0x7fdf580c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:56.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf5e000640 1 -- 172.21.15.114:0/4086958544 shutdown_connections 2024-02-17T12:19:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.128+0000 7fdf5e000640 1 -- 172.21.15.114:0/4086958544 wait complete. 2024-02-17T12:19:56.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf5e000640 1 Processor -- start 2024-02-17T12:19:56.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf5e000640 1 -- start start 2024-02-17T12:19:56.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf5e000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf3c0047d0 0x7fdf581f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:56.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf5e000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5814c170 0x7fdf581e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:56.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf5e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581e2a20 0x7fdf581e2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:56.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf5e000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58149950 con 0x7fdf581e2a20 2024-02-17T12:19:56.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf5e000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf581f2760 con 0x7fdf5814c170 2024-02-17T12:19:56.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf5e000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58149600 con 0x7fdf3c0047d0 2024-02-17T12:19:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581e2a20 0x7fdf581e2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:56.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581e2a20 0x7fdf581e2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51602/0 (socket says 172.21.15.114:51602) 2024-02-17T12:19:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf57e00640 1 -- 172.21.15.114:0/2893044293 learned_addr learned my addr 172.21.15.114:0/2893044293 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf4ea00640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5814c170 0x7fdf581e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf57400640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf3c0047d0 0x7fdf581f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf57e00640 1 -- 172.21.15.114:0/2893044293 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf3c0047d0 msgr2=0x7fdf581f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:56.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf57e00640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf3c0047d0 0x7fdf581f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf57e00640 1 -- 172.21.15.114:0/2893044293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5814c170 msgr2=0x7fdf581e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:56.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf57e00640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5814c170 0x7fdf581e3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf57e00640 1 -- 172.21.15.114:0/2893044293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5814f290 con 0x7fdf581e2a20 2024-02-17T12:19:56.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf4ea00640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5814c170 0x7fdf581e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:56.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf57e00640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581e2a20 0x7fdf581e2ea0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fdf580c2310 tx=0x7fdf5000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:56.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf4fe00640 1 -- 172.21.15.114:0/2893044293 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5000e040 con 0x7fdf581e2a20 2024-02-17T12:19:56.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf4fe00640 1 -- 172.21.15.114:0/2893044293 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5000f040 con 0x7fdf581e2a20 2024-02-17T12:19:56.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf4fe00640 1 -- 172.21.15.114:0/2893044293 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50015430 con 0x7fdf581e2a20 2024-02-17T12:19:56.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf5e000640 1 -- 172.21.15.114:0/2893044293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5814f570 con 0x7fdf581e2a20 2024-02-17T12:19:56.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.132+0000 7fdf5e000640 1 -- 172.21.15.114:0/2893044293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf581e33e0 con 0x7fdf581e2a20 2024-02-17T12:19:56.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.136+0000 7fdf5e000640 1 -- 172.21.15.114:0/2893044293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf58149b00 con 0x7fdf581e2a20 2024-02-17T12:19:56.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.136+0000 7fdf4fe00640 1 -- 172.21.15.114:0/2893044293 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fdf50015590 con 0x7fdf581e2a20 2024-02-17T12:19:56.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.136+0000 7fdf4fe00640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdf34066ec0 0x7fdf34069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:56.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.136+0000 7fdf4fe00640 1 -- 172.21.15.114:0/2893044293 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6213+0+0 (secure 0 0 0) 0x7fdf50085b80 con 0x7fdf581e2a20 2024-02-17T12:19:56.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.136+0000 7fdf57400640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdf34066ec0 0x7fdf34069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:56.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.136+0000 7fdf57400640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdf34066ec0 0x7fdf34069380 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdf58050830 tx=0x7fdf48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:56.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.140+0000 7fdf4fe00640 1 -- 172.21.15.114:0/2893044293 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdf58149b00 con 0x7fdf581e2a20 2024-02-17T12:19:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.304+0000 7fdf5e000640 1 -- 172.21.15.114:0/2893044293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdf58149b00 con 0x7fdf581e2a20 2024-02-17T12:19:56.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.956+0000 7fdf4fe00640 1 -- 172.21.15.114:0/2893044293 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdf58149b00 con 0x7fdf581e2a20 2024-02-17T12:19:56.961 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-02-17T12:19:56.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 -- 172.21.15.114:0/2893044293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdf34066ec0 msgr2=0x7fdf34069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:56.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdf34066ec0 0x7fdf34069380 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdf58050830 tx=0x7fdf48009040 comp rx=0 tx=0).stop 2024-02-17T12:19:56.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 -- 172.21.15.114:0/2893044293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581e2a20 msgr2=0x7fdf581e2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:56.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581e2a20 0x7fdf581e2ea0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fdf580c2310 tx=0x7fdf5000f580 comp rx=0 tx=0).stop 2024-02-17T12:19:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 -- 172.21.15.114:0/2893044293 shutdown_connections 2024-02-17T12:19:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fdf34066ec0 0x7fdf34069380 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdf581e2a20 0x7fdf581e2ea0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf5814c170 0x7fdf581e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 --2- 172.21.15.114:0/2893044293 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdf3c0047d0 0x7fdf581f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:56.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 -- 172.21.15.114:0/2893044293 >> 172.21.15.114:0/2893044293 conn(0x7fdf580c7520 msgr2=0x7fdf5806e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:56.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 -- 172.21.15.114:0/2893044293 shutdown_connections 2024-02-17T12:19:56.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:56.960+0000 7fdf5e000640 1 -- 172.21.15.114:0/2893044293 wait complete. 2024-02-17T12:19:56.990 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:57.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.124+0000 7fccf6400640 1 Processor -- start 2024-02-17T12:19:57.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.124+0000 7fccf6400640 1 -- start start 2024-02-17T12:19:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccf6400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf00c2580 0x7fccf00aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccf6400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf00a9420 con 0x7fccf014f110 2024-02-17T12:19:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccf6400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf0152850 con 0x7fccf00c1eb0 2024-02-17T12:19:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccf6400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf014f4f0 con 0x7fccf00c2580 2024-02-17T12:19:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccef400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fccf014f110 0x7fccf00c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47112/0 (socket says 172.21.15.114:47112) 2024-02-17T12:19:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccef400640 1 -- 172.21.15.114:0/1565439608 learned_addr learned my addr 172.21.15.114:0/1565439608 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcce7e00640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf00c2580 0x7fccf00aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924787842 0 0) 0x7fccf00a9420 con 0x7fccf014f110 2024-02-17T12:19:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd4003530 con 0x7fccf014f110 2024-02-17T12:19:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602945146 0 0) 0x7fccf0152850 con 0x7fccf00c1eb0 2024-02-17T12:19:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccf00a9420 con 0x7fccf00c1eb0 2024-02-17T12:19:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2045845300 0 0) 0x7fccd4003530 con 0x7fccf014f110 2024-02-17T12:19:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf00c2580 msgr2=0x7fccf00aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf00c2580 0x7fccf00aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 >> v1:172.21.15.116:6789/0 conn(0x7fccf00c1eb0 legacy=0x7fccf015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00a9670 con 0x7fccf014f110 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fcce0001680 con 0x7fccf014f110 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 >> v1:172.21.15.114:6789/0 conn(0x7fccf014f110 legacy=0x7fccf00c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd4003b40 0x7fccd4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf00c2580 0x7fccd40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd4004d10 0x7fccd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf014f4f0 con 0x7fccd4003b40 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd400ffa0 con 0x7fccd4004d10 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40100e0 con 0x7fccf00c2580 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccef400640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd4003b40 0x7fccd4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcce7e00640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf00c2580 0x7fccd40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccefe00640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd4004d10 0x7fccd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccef400640 1 -- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf00c2580 msgr2=0x7fccd40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccef400640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf00c2580 0x7fccd40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccef400640 1 -- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd4004d10 msgr2=0x7fccd4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:57.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccef400640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd4004d10 0x7fccd4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccef400640 1 -- 172.21.15.114:0/1565439608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4003530 con 0x7fccd4003b40 2024-02-17T12:19:57.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fcce7e00640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf00c2580 0x7fccd40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:57.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.128+0000 7fccefe00640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd4004d10 0x7fccd4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fccef400640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd4003b40 0x7fccd4003f40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c160 tx=0x7fcce001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a3c5a4677aa2cc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce00058e0 con 0x7fccd4003b40 2024-02-17T12:19:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce0005a60 con 0x7fccd4003b40 2024-02-17T12:19:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fcceea00640 1 -- 172.21.15.114:0/1565439608 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0005e10 con 0x7fccd4003b40 2024-02-17T12:19:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fccf6400640 1 -- 172.21.15.114:0/1565439608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd4003b40 msgr2=0x7fccd4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fccf6400640 1 --2- 172.21.15.114:0/1565439608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd4003b40 0x7fccd4003f40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c160 tx=0x7fcce001cbe0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fccefe00640 1 -- 172.21.15.114:0/1565439608 reap_dead start 2024-02-17T12:19:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fccf6400640 1 -- 172.21.15.114:0/1565439608 shutdown_connections 2024-02-17T12:19:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fccf6400640 1 -- 172.21.15.114:0/1565439608 >> 172.21.15.114:0/1565439608 conn(0x7fccf00a8490 msgr2=0x7fccf00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fccf6400640 1 -- 172.21.15.114:0/1565439608 shutdown_connections 2024-02-17T12:19:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fccf6400640 1 -- 172.21.15.114:0/1565439608 wait complete. 2024-02-17T12:19:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fccf6400640 1 Processor -- start 2024-02-17T12:19:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.132+0000 7fccf6400640 1 -- start start 2024-02-17T12:19:57.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccf6400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd4003b40 0x7fccf0144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccf6400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf01e94b0 0x7fccf014e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccf6400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccf014b000 0x7fccf0143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccf6400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf01ecb50 con 0x7fccf014b000 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccf6400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf0144cb0 con 0x7fccd4003b40 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccf6400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf01449d0 con 0x7fccf01e94b0 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccefe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccf014b000 0x7fccf0143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccefe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccf014b000 0x7fccf0143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51616/0 (socket says 172.21.15.114:51616) 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccefe00640 1 -- 172.21.15.114:0/1720632632 learned_addr learned my addr 172.21.15.114:0/1720632632 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fcce7e00640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf01e94b0 0x7fccf014e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccef400640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd4003b40 0x7fccf0144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccefe00640 1 -- 172.21.15.114:0/1720632632 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf01e94b0 msgr2=0x7fccf014e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccefe00640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf01e94b0 0x7fccf014e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccefe00640 1 -- 172.21.15.114:0/1720632632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd4003b40 msgr2=0x7fccf0144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccefe00640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd4003b40 0x7fccf0144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccefe00640 1 -- 172.21.15.114:0/1720632632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00c46f0 con 0x7fccf014b000 2024-02-17T12:19:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccefe00640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccf014b000 0x7fccf0143e90 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fcce8001340 tx=0x7fcce800ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fcce7400640 1 -- 172.21.15.114:0/1720632632 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8006b60 con 0x7fccf014b000 2024-02-17T12:19:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fcce7400640 1 -- 172.21.15.114:0/1720632632 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8006cc0 con 0x7fccf014b000 2024-02-17T12:19:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fcce7400640 1 -- 172.21.15.114:0/1720632632 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8003bc0 con 0x7fccf014b000 2024-02-17T12:19:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccf6400640 1 -- 172.21.15.114:0/1720632632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf00c49d0 con 0x7fccf014b000 2024-02-17T12:19:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccf6400640 1 -- 172.21.15.114:0/1720632632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf014e7f0 con 0x7fccf014b000 2024-02-17T12:19:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fccf6400640 1 -- 172.21.15.114:0/1720632632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf0074840 con 0x7fccf014b000 2024-02-17T12:19:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.136+0000 7fcce7400640 1 -- 172.21.15.114:0/1720632632 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fcce8003d20 con 0x7fccf014b000 2024-02-17T12:19:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.140+0000 7fcce7400640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcccc066e40 0x7fcccc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.140+0000 7fcce7400640 1 -- 172.21.15.114:0/1720632632 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fcce80850c0 con 0x7fccf014b000 2024-02-17T12:19:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.140+0000 7fccef400640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcccc066e40 0x7fcccc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.140+0000 7fccef400640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcccc066e40 0x7fcccc069300 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcce00aa000 tx=0x7fcce0001a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:57.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.140+0000 7fcce7400640 1 -- 172.21.15.114:0/1720632632 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcce8051ec0 con 0x7fccf014b000 2024-02-17T12:19:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.308+0000 7fccf6400640 1 -- 172.21.15.114:0/1720632632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccf01ecc90 con 0x7fccf014b000 2024-02-17T12:19:57.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.308+0000 7fcce7400640 1 -- 172.21.15.114:0/1720632632 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16753 (secure 0 0 0) 0x7fcce8055580 con 0x7fccf014b000 2024-02-17T12:19:57.313 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:57.313 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":75,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:56.956421+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/709959478":"2024-02-18T12:19:53.944751+0000","172.21.15.114:6835/709959478":"2024-02-18T12:19:53.944751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 -- 172.21.15.114:0/1720632632 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcccc066e40 msgr2=0x7fcccc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcccc066e40 0x7fcccc069300 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcce00aa000 tx=0x7fcce0001a00 comp rx=0 tx=0).stop 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 -- 172.21.15.114:0/1720632632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccf014b000 msgr2=0x7fccf0143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccf014b000 0x7fccf0143e90 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fcce8001340 tx=0x7fcce800ebe0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 -- 172.21.15.114:0/1720632632 shutdown_connections 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fcccc066e40 0x7fcccc069300 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccf014b000 0x7fccf0143e90 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fccf01e94b0 0x7fccf014e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 --2- 172.21.15.114:0/1720632632 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccd4003b40 0x7fccf0144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 -- 172.21.15.114:0/1720632632 >> 172.21.15.114:0/1720632632 conn(0x7fccf00a8490 msgr2=0x7fccf006e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 -- 172.21.15.114:0/1720632632 shutdown_connections 2024-02-17T12:19:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.312+0000 7fccf6400640 1 -- 172.21.15.114:0/1720632632 wait complete. 2024-02-17T12:19:57.335 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-17T12:16:09.276215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-02-17T12:19:19.573884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-02-17T12:19:20.731260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-17T12:19:57.336 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-17T12:19:57.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb97200640 1 Processor -- start 2024-02-17T12:19:57.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb97200640 1 -- start start 2024-02-17T12:19:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb97200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb98155d80 0x7fbb98158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb97200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb980c66c0 0x7fbb98158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb97200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980c5380 con 0x7fbb980c3760 2024-02-17T12:19:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb97200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb980c4b10 con 0x7fbb98155d80 2024-02-17T12:19:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb97200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980c2ca0 con 0x7fbb980c66c0 2024-02-17T12:19:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb8fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb98155d80 0x7fbb98158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb95e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbb980c3760 0x7fbb98155670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47118/0 (socket says 172.21.15.114:47118) 2024-02-17T12:19:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb95e00640 1 -- 172.21.15.114:0/1885228272 learned_addr learned my addr 172.21.15.114:0/1885228272 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb96800640 1 --2- 172.21.15.114:0/1885228272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb980c66c0 0x7fbb98158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb95400640 1 -- 172.21.15.114:0/1885228272 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992168124 0 0) 0x7fbb980c5380 con 0x7fbb980c3760 2024-02-17T12:19:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb95400640 1 -- 172.21.15.114:0/1885228272 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c003530 con 0x7fbb980c3760 2024-02-17T12:19:57.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb8fe00640 1 -- 172.21.15.114:0/1885228272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb980c66c0 msgr2=0x7fbb98158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:57.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb8fe00640 1 --2- 172.21.15.114:0/1885228272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb980c66c0 0x7fbb98158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb8fe00640 1 -- 172.21.15.114:0/1885228272 >> v1:172.21.15.114:6789/0 conn(0x7fbb980c3760 legacy=0x7fbb98155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.472+0000 7fbb8fe00640 1 -- 172.21.15.114:0/1885228272 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980c2f80 con 0x7fbb98155d80 2024-02-17T12:19:57.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb8fe00640 1 --2- 172.21.15.114:0/1885228272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb98155d80 0x7fbb98158350 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fbb800097c0 tx=0x7fbb8001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192a361bdfe4538f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:57.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb95400640 1 -- 172.21.15.114:0/1885228272 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800ab610 con 0x7fbb98155d80 2024-02-17T12:19:57.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb95400640 1 -- 172.21.15.114:0/1885228272 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb800ab770 con 0x7fbb98155d80 2024-02-17T12:19:57.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb95400640 1 -- 172.21.15.114:0/1885228272 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800abb00 con 0x7fbb98155d80 2024-02-17T12:19:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb97200640 1 -- 172.21.15.114:0/1885228272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb98155d80 msgr2=0x7fbb98158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb97200640 1 --2- 172.21.15.114:0/1885228272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb98155d80 0x7fbb98158350 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fbb800097c0 tx=0x7fbb8001c410 comp rx=0 tx=0).stop 2024-02-17T12:19:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb97200640 1 -- 172.21.15.114:0/1885228272 shutdown_connections 2024-02-17T12:19:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb97200640 1 --2- 172.21.15.114:0/1885228272 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb980c66c0 0x7fbb98158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb97200640 1 --2- 172.21.15.114:0/1885228272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb98155d80 0x7fbb98158350 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb97200640 1 -- 172.21.15.114:0/1885228272 >> 172.21.15.114:0/1885228272 conn(0x7fbb980a9f70 msgr2=0x7fbb980aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb97200640 1 -- 172.21.15.114:0/1885228272 shutdown_connections 2024-02-17T12:19:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.476+0000 7fbb97200640 1 -- 172.21.15.114:0/1885228272 wait complete. 2024-02-17T12:19:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 Processor -- start 2024-02-17T12:19:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 -- start start 2024-02-17T12:19:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980c3760 0x7fbb9806e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb980c66c0 0x7fbb98157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb98155d80 0x7fbb98147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98156a60 con 0x7fbb980c3760 2024-02-17T12:19:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb981ee470 con 0x7fbb98155d80 2024-02-17T12:19:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98156cb0 con 0x7fbb980c66c0 2024-02-17T12:19:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb95e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980c3760 0x7fbb9806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb95e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980c3760 0x7fbb9806e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51648/0 (socket says 172.21.15.114:51648) 2024-02-17T12:19:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb95e00640 1 -- 172.21.15.114:0/1163218675 learned_addr learned my addr 172.21.15.114:0/1163218675 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb8fe00640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb980c66c0 0x7fbb98157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb96800640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb98155d80 0x7fbb98147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb95e00640 1 -- 172.21.15.114:0/1163218675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb980c66c0 msgr2=0x7fbb98157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb95e00640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb980c66c0 0x7fbb98157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb95e00640 1 -- 172.21.15.114:0/1163218675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb98155d80 msgr2=0x7fbb98147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb95e00640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb98155d80 0x7fbb98147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb95e00640 1 -- 172.21.15.114:0/1163218675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009420 con 0x7fbb980c3760 2024-02-17T12:19:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb95e00640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980c3760 0x7fbb9806e910 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c3c0 tx=0x7fbb8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb8e000640 1 -- 172.21.15.114:0/1163218675 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88005cf0 con 0x7fbb980c3760 2024-02-17T12:19:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb8e000640 1 -- 172.21.15.114:0/1163218675 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88005e50 con 0x7fbb980c3760 2024-02-17T12:19:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb8e000640 1 -- 172.21.15.114:0/1163218675 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880072f0 con 0x7fbb980c3760 2024-02-17T12:19:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 -- 172.21.15.114:0/1163218675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb98156f90 con 0x7fbb980c3760 2024-02-17T12:19:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 -- 172.21.15.114:0/1163218675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb981ee0d0 con 0x7fbb980c3760 2024-02-17T12:19:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.480+0000 7fbb97200640 1 -- 172.21.15.114:0/1163218675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9804eef0 con 0x7fbb980c3760 2024-02-17T12:19:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.484+0000 7fbb8e000640 1 -- 172.21.15.114:0/1163218675 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbb88007450 con 0x7fbb980c3760 2024-02-17T12:19:57.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.484+0000 7fbb8e000640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb74066e40 0x7fbb74069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.484+0000 7fbb8e000640 1 -- 172.21.15.114:0/1163218675 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fbb88083fe0 con 0x7fbb980c3760 2024-02-17T12:19:57.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.484+0000 7fbb8fe00640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb74066e40 0x7fbb74069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.484+0000 7fbb8fe00640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb74066e40 0x7fbb74069300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbb800af000 tx=0x7fbb800a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:57.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.488+0000 7fbb8e000640 1 -- 172.21.15.114:0/1163218675 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb88050e50 con 0x7fbb980c3760 2024-02-17T12:19:57.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 -- 172.21.15.114:0/1163218675 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb980c7fe0 con 0x7fbb980c3760 2024-02-17T12:19:57.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb8e000640 1 -- 172.21.15.114:0/1163218675 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb88054510 con 0x7fbb980c3760 2024-02-17T12:19:57.647 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 -- 172.21.15.114:0/1163218675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb74066e40 msgr2=0x7fbb74069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb74066e40 0x7fbb74069300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbb800af000 tx=0x7fbb800a7000 comp rx=0 tx=0).stop 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 -- 172.21.15.114:0/1163218675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980c3760 msgr2=0x7fbb9806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980c3760 0x7fbb9806e910 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c3c0 tx=0x7fbb8800c880 comp rx=0 tx=0).stop 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 -- 172.21.15.114:0/1163218675 shutdown_connections 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb98155d80 0x7fbb98147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbb980c66c0 0x7fbb98157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbb74066e40 0x7fbb74069300 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 --2- 172.21.15.114:0/1163218675 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980c3760 0x7fbb9806e910 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 -- 172.21.15.114:0/1163218675 >> 172.21.15.114:0/1163218675 conn(0x7fbb980a9f70 msgr2=0x7fbb98155620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 -- 172.21.15.114:0/1163218675 shutdown_connections 2024-02-17T12:19:57.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.644+0000 7fbb97200640 1 -- 172.21.15.114:0/1163218675 wait complete. 2024-02-17T12:19:57.668 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-02-17T12:19:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.800+0000 7f6b91000640 1 Processor -- start 2024-02-17T12:19:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.800+0000 7f6b91000640 1 -- start start 2024-02-17T12:19:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b91000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c152390 0x7f6b8c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b91000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8c0c0d00 con 0x7f6b8c06ae70 2024-02-17T12:19:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b91000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8c0c1880 con 0x7f6b8c14f150 2024-02-17T12:19:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b91000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c1527d0 con 0x7f6b8c152390 2024-02-17T12:19:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6b8c06ae70 0x7f6b8c0c20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47128/0 (socket says 172.21.15.114:47128) 2024-02-17T12:19:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8b400640 1 -- 172.21.15.114:0/1283294706 learned_addr learned my addr 172.21.15.114:0/1283294706 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8aa00640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c152390 0x7f6b8c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137220336 0 0) 0x7f6b8c0c0d00 con 0x7f6b8c06ae70 2024-02-17T12:19:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b70003530 con 0x7f6b8c06ae70 2024-02-17T12:19:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3041376592 0 0) 0x7f6b70003530 con 0x7f6b8c06ae70 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c152390 msgr2=0x7f6b8c14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c152390 0x7f6b8c14ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 >> v1:172.21.15.116:6789/0 conn(0x7f6b8c14f150 legacy=0x7f6b8c152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c0c0f50 con 0x7f6b8c06ae70 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f6b7c001680 con 0x7f6b8c06ae70 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 >> v1:172.21.15.114:6789/0 conn(0x7f6b8c06ae70 legacy=0x7f6b8c0c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c152390 0x7f6b700039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 0x7f6b700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70004d10 0x7f6b70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c1527d0 con 0x7f6b70003ef0 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7000bb50 con 0x7f6b70004d10 2024-02-17T12:19:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7000bd10 con 0x7f6b8c152390 2024-02-17T12:19:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8aa00640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 0x7f6b700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8b400640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c152390 0x7f6b700039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8be00640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70004d10 0x7f6b70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8aa00640 1 -- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c152390 msgr2=0x7f6b700039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8aa00640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c152390 0x7f6b700039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8aa00640 1 -- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70004d10 msgr2=0x7f6b70005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8aa00640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b70004d10 0x7f6b70005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.804+0000 7f6b8aa00640 1 -- 172.21.15.114:0/1283294706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70003530 con 0x7f6b70003ef0 2024-02-17T12:19:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b8aa00640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 0x7f6b700047d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009ae0 tx=0x7f6b7401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2c8c7644c5149c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740a5520 con 0x7f6b70003ef0 2024-02-17T12:19:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b740a5680 con 0x7f6b70003ef0 2024-02-17T12:19:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b8a000640 1 -- 172.21.15.114:0/1283294706 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b740a5a30 con 0x7f6b70003ef0 2024-02-17T12:19:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b91000640 1 -- 172.21.15.114:0/1283294706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 msgr2=0x7f6b700047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b91000640 1 --2- 172.21.15.114:0/1283294706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 0x7f6b700047d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009ae0 tx=0x7f6b7401ca40 comp rx=0 tx=0).stop 2024-02-17T12:19:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b8be00640 1 -- 172.21.15.114:0/1283294706 reap_dead start 2024-02-17T12:19:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b91000640 1 -- 172.21.15.114:0/1283294706 shutdown_connections 2024-02-17T12:19:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b91000640 1 -- 172.21.15.114:0/1283294706 >> 172.21.15.114:0/1283294706 conn(0x7f6b8c0c6300 msgr2=0x7f6b8c0c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b91000640 1 -- 172.21.15.114:0/1283294706 shutdown_connections 2024-02-17T12:19:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b91000640 1 -- 172.21.15.114:0/1283294706 wait complete. 2024-02-17T12:19:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b91000640 1 Processor -- start 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.808+0000 7f6b91000640 1 -- start start 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b91000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 0x7f6b8c070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b91000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c0c3ef0 0x7f6b8c0c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b91000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b8c1eee10 0x7f6b8c0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b91000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c0c4830 con 0x7f6b70003ef0 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b91000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c1ee6a0 con 0x7f6b8c1eee10 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b91000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c147cf0 con 0x7f6b8c0c3ef0 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 0x7f6b8c070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 0x7f6b8c070d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51660/0 (socket says 172.21.15.114:51660) 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8b400640 1 -- 172.21.15.114:0/3192560649 learned_addr learned my addr 172.21.15.114:0/3192560649 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8aa00640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c0c3ef0 0x7f6b8c0c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8be00640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b8c1eee10 0x7f6b8c0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8b400640 1 -- 172.21.15.114:0/3192560649 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c0c3ef0 msgr2=0x7f6b8c0c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8b400640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c0c3ef0 0x7f6b8c0c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8b400640 1 -- 172.21.15.114:0/3192560649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b8c1eee10 msgr2=0x7f6b8c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8b400640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b8c1eee10 0x7f6b8c0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8b400640 1 -- 172.21.15.114:0/3192560649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c146d20 con 0x7f6b70003ef0 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b8b400640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 0x7f6b8c070d90 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0072c0 tx=0x7f6b7c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b83400640 1 -- 172.21.15.114:0/3192560649 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00f960 con 0x7f6b70003ef0 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b83400640 1 -- 172.21.15.114:0/3192560649 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c00fae0 con 0x7f6b70003ef0 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b83400640 1 -- 172.21.15.114:0/3192560649 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00fe90 con 0x7f6b70003ef0 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b91000640 1 -- 172.21.15.114:0/3192560649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8c147000 con 0x7f6b70003ef0 2024-02-17T12:19:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b91000640 1 -- 172.21.15.114:0/3192560649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8c1ee8f0 con 0x7f6b70003ef0 2024-02-17T12:19:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b91000640 1 -- 172.21.15.114:0/3192560649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8c1eeae0 con 0x7f6b70003ef0 2024-02-17T12:19:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.812+0000 7f6b83400640 1 -- 172.21.15.114:0/3192560649 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6b7c01c410 con 0x7f6b70003ef0 2024-02-17T12:19:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.816+0000 7f6b83400640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 0x7f6b68069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.816+0000 7f6b83400640 1 -- 172.21.15.114:0/3192560649 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f6b7c0847b0 con 0x7f6b70003ef0 2024-02-17T12:19:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.816+0000 7f6b8aa00640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 0x7f6b68069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.816+0000 7f6b8aa00640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 0x7f6b68069330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6b740af000 tx=0x7f6b740046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:57.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.820+0000 7f6b83400640 1 -- 172.21.15.114:0/3192560649 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6b7c051530 con 0x7f6b70003ef0 2024-02-17T12:19:57.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.972+0000 7f6b91000640 1 -- 172.21.15.114:0/3192560649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b8c04eef0 con 0x7f6b70003ef0 2024-02-17T12:19:57.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.972+0000 7f6b83400640 1 -- 172.21.15.114:0/3192560649 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v75) v1 ==== 105+0+11 (secure 0 0 0) 0x7f6b7c054bf0 con 0x7f6b70003ef0 2024-02-17T12:19:57.978 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 -- 172.21.15.114:0/3192560649 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 msgr2=0x7f6b68069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 0x7f6b68069330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6b740af000 tx=0x7f6b740046d0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 -- 172.21.15.114:0/3192560649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 msgr2=0x7f6b8c070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 0x7f6b8c070d90 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0072c0 tx=0x7f6b7c007780 comp rx=0 tx=0).stop 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 -- 172.21.15.114:0/3192560649 shutdown_connections 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6b8c1eee10 0x7f6b8c0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6b8c0c3ef0 0x7f6b8c0c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6b68066e70 0x7f6b68069330 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 --2- 172.21.15.114:0/3192560649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b70003ef0 0x7f6b8c070d90 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 -- 172.21.15.114:0/3192560649 >> 172.21.15.114:0/3192560649 conn(0x7f6b8c0c6300 msgr2=0x7f6b8c148790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 -- 172.21.15.114:0/3192560649 shutdown_connections 2024-02-17T12:19:57.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:57.976+0000 7f6b91000640 1 -- 172.21.15.114:0/3192560649 wait complete. 2024-02-17T12:19:57.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-02-17T12:19:58.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f5382200640 1 Processor -- start 2024-02-17T12:19:58.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f5382200640 1 -- start start 2024-02-17T12:19:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f5382200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f537c06db50 0x7f537c14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f5382200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c150490 0x7f537c152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f5382200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c156270 con 0x7f537c0c25a0 2024-02-17T12:19:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f5382200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c06f090 con 0x7f537c06db50 2024-02-17T12:19:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f5382200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c071630 con 0x7f537c150490 2024-02-17T12:19:58.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f537c0c25a0 0x7f537c06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47140/0 (socket says 172.21.15.114:47140) 2024-02-17T12:19:58.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537b400640 1 -- 172.21.15.114:0/1316623587 learned_addr learned my addr 172.21.15.114:0/1316623587 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:58.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662856728 0 0) 0x7f537c156270 con 0x7f537c0c25a0 2024-02-17T12:19:58.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5360003530 con 0x7f537c0c25a0 2024-02-17T12:19:58.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537be00640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c150490 0x7f537c152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537aa00640 1 --2- 172.21.15.114:0/1316623587 >> v2:172.21.15.116:3300/0 conn(0x7f537c06db50 0x7f537c14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4292980143 0 0) 0x7f5360003530 con 0x7f537c0c25a0 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c150490 msgr2=0x7f537c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c150490 0x7f537c152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 >> v2:172.21.15.116:3300/0 conn(0x7f537c06db50 msgr2=0x7f537c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 --2- 172.21.15.114:0/1316623587 >> v2:172.21.15.116:3300/0 conn(0x7f537c06db50 0x7f537c14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c156550 con 0x7f537c0c25a0 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f536c001a20 con 0x7f537c0c25a0 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 >> v1:172.21.15.114:6789/0 conn(0x7f537c0c25a0 legacy=0x7f537c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c150490 0x7f5360003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5360003fb0 0x7f53600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360004d10 0x7f5360005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c06f090 con 0x7f5360003fb0 2024-02-17T12:19:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536000bb80 con 0x7f5360004d10 2024-02-17T12:19:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.132+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536000bd40 con 0x7f537c150490 2024-02-17T12:19:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537aa00640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5360003fb0 0x7f53600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537b400640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c150490 0x7f5360003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537be00640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360004d10 0x7f5360005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537aa00640 1 -- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c150490 msgr2=0x7f5360003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537aa00640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c150490 0x7f5360003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537aa00640 1 -- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360004d10 msgr2=0x7f5360005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537aa00640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360004d10 0x7f5360005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537aa00640 1 -- 172.21.15.114:0/1316623587 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360003530 con 0x7f5360003fb0 2024-02-17T12:19:58.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537aa00640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5360003fb0 0x7f53600047d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f536400ba30 tx=0x7f536401c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b67a67c963f581 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:58.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640ac650 con 0x7f5360003fb0 2024-02-17T12:19:58.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53640ac7b0 con 0x7f5360003fb0 2024-02-17T12:19:58.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.136+0000 7f537a000640 1 -- 172.21.15.114:0/1316623587 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640acb60 con 0x7f5360003fb0 2024-02-17T12:19:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 -- 172.21.15.114:0/1316623587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5360003fb0 msgr2=0x7f53600047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 --2- 172.21.15.114:0/1316623587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5360003fb0 0x7f53600047d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f536400ba30 tx=0x7f536401c6b0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537be00640 1 -- 172.21.15.114:0/1316623587 reap_dead start 2024-02-17T12:19:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 -- 172.21.15.114:0/1316623587 shutdown_connections 2024-02-17T12:19:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 -- 172.21.15.114:0/1316623587 >> 172.21.15.114:0/1316623587 conn(0x7f537c0a8490 msgr2=0x7f537c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 -- 172.21.15.114:0/1316623587 shutdown_connections 2024-02-17T12:19:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 -- 172.21.15.114:0/1316623587 wait complete. 2024-02-17T12:19:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 Processor -- start 2024-02-17T12:19:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 -- start start 2024-02-17T12:19:58.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360003fb0 0x7f537c13f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f537c13eb40 0x7f537c13de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c13bb90 0x7f537c13c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c0a9680 con 0x7f537c13eb40 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c13c550 con 0x7f5360003fb0 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5382200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c13f830 con 0x7f537c13bb90 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f537c13eb40 0x7f537c13de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f537c13eb40 0x7f537c13de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51690/0 (socket says 172.21.15.114:51690) 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537aa00640 1 -- 172.21.15.114:0/233350173 learned_addr learned my addr 172.21.15.114:0/233350173 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537be00640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c13bb90 0x7f537c13c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537b400640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360003fb0 0x7f537c13f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537aa00640 1 -- 172.21.15.114:0/233350173 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c13bb90 msgr2=0x7f537c13c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537aa00640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c13bb90 0x7f537c13c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537aa00640 1 -- 172.21.15.114:0/233350173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360003fb0 msgr2=0x7f537c13f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537aa00640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360003fb0 0x7f537c13f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537aa00640 1 -- 172.21.15.114:0/233350173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c0aa940 con 0x7f537c13eb40 2024-02-17T12:19:58.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537be00640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c13bb90 0x7f537c13c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537b400640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360003fb0 0x7f537c13f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f537aa00640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f537c13eb40 0x7f537c13de40 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f53640ae040 tx=0x7f5360005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.140+0000 7f5373400640 1 -- 172.21.15.114:0/233350173 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364004220 con 0x7f537c13eb40 2024-02-17T12:19:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.144+0000 7f5373400640 1 -- 172.21.15.114:0/233350173 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53640b9070 con 0x7f537c13eb40 2024-02-17T12:19:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.144+0000 7f5373400640 1 -- 172.21.15.114:0/233350173 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640ac920 con 0x7f537c13eb40 2024-02-17T12:19:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.144+0000 7f5382200640 1 -- 172.21.15.114:0/233350173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c0aac20 con 0x7f537c13eb40 2024-02-17T12:19:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.144+0000 7f5382200640 1 -- 172.21.15.114:0/233350173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c0ab1e0 con 0x7f537c13eb40 2024-02-17T12:19:58.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.144+0000 7f5382200640 1 -- 172.21.15.114:0/233350173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c0ab3a0 con 0x7f537c13eb40 2024-02-17T12:19:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.144+0000 7f5373400640 1 -- 172.21.15.114:0/233350173 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f53640a8030 con 0x7f537c13eb40 2024-02-17T12:19:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.144+0000 7f5373400640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5358066e40 0x7f5358069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.144+0000 7f5373400640 1 -- 172.21.15.114:0/233350173 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f536411ee20 con 0x7f537c13eb40 2024-02-17T12:19:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.144+0000 7f537b400640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5358066e40 0x7f5358069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.144+0000 7f537b400640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5358066e40 0x7f5358069300 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f536c000f90 tx=0x7f536c006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.148+0000 7f5373400640 1 -- 172.21.15.114:0/233350173 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53640ebba0 con 0x7f537c13eb40 2024-02-17T12:19:58.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.300+0000 7f5382200640 1 -- 172.21.15.114:0/233350173 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f537c074840 con 0x7f537c13eb40 2024-02-17T12:19:58.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5373400640 1 -- 172.21.15.114:0/233350173 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v75) v1 ==== 101+0+11 (secure 0 0 0) 0x7f53640ef260 con 0x7f537c13eb40 2024-02-17T12:19:58.306 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-02-17T12:19:58.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 -- 172.21.15.114:0/233350173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5358066e40 msgr2=0x7f5358069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5358066e40 0x7f5358069300 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f536c000f90 tx=0x7f536c006040 comp rx=0 tx=0).stop 2024-02-17T12:19:58.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 -- 172.21.15.114:0/233350173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f537c13eb40 msgr2=0x7f537c13de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f537c13eb40 0x7f537c13de40 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f53640ae040 tx=0x7f5360005800 comp rx=0 tx=0).stop 2024-02-17T12:19:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 -- 172.21.15.114:0/233350173 shutdown_connections 2024-02-17T12:19:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f537c13bb90 0x7f537c13c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5358066e40 0x7f5358069300 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f537c13eb40 0x7f537c13de40 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 --2- 172.21.15.114:0/233350173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5360003fb0 0x7f537c13f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 -- 172.21.15.114:0/233350173 >> 172.21.15.114:0/233350173 conn(0x7f537c0a8490 msgr2=0x7f537c142190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 -- 172.21.15.114:0/233350173 shutdown_connections 2024-02-17T12:19:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.304+0000 7f5382200640 1 -- 172.21.15.114:0/233350173 wait complete. 2024-02-17T12:19:58.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:19:58.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba77e00640 1 Processor -- start 2024-02-17T12:19:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba77e00640 1 -- start start 2024-02-17T12:19:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba77e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba700c6460 0x7fba7006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba77e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba70155dd0 con 0x7fba70152540 2024-02-17T12:19:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba77e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba701588c0 con 0x7fba70154e30 2024-02-17T12:19:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba77e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba70155810 con 0x7fba700c6460 2024-02-17T12:19:58.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba74a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba700c6460 0x7fba7006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba75400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fba70152540 0x7fba70158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47152/0 (socket says 172.21.15.114:47152) 2024-02-17T12:19:58.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba75400640 1 -- 172.21.15.114:0/2318052033 learned_addr learned my addr 172.21.15.114:0/2318052033 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba6fe00640 1 -- 172.21.15.114:0/2318052033 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514722202 0 0) 0x7fba70155dd0 con 0x7fba70152540 2024-02-17T12:19:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba6fe00640 1 -- 172.21.15.114:0/2318052033 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba58003530 con 0x7fba70152540 2024-02-17T12:19:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba74a00640 1 -- 172.21.15.114:0/2318052033 >> v1:172.21.15.116:6789/0 conn(0x7fba70154e30 legacy=0x7fba700aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba74a00640 1 -- 172.21.15.114:0/2318052033 >> v1:172.21.15.114:6789/0 conn(0x7fba70152540 legacy=0x7fba70158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.460+0000 7fba74a00640 1 -- 172.21.15.114:0/2318052033 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba70155af0 con 0x7fba700c6460 2024-02-17T12:19:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba74a00640 1 --2- 172.21.15.114:0/2318052033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba700c6460 0x7fba7006ff80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0097c0 tx=0x7fba5c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f1830d8de0749f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba6fe00640 1 -- 172.21.15.114:0/2318052033 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0ab600 con 0x7fba700c6460 2024-02-17T12:19:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba6fe00640 1 -- 172.21.15.114:0/2318052033 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c0a7050 con 0x7fba700c6460 2024-02-17T12:19:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba6fe00640 1 -- 172.21.15.114:0/2318052033 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0ab980 con 0x7fba700c6460 2024-02-17T12:19:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba77e00640 1 -- 172.21.15.114:0/2318052033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba700c6460 msgr2=0x7fba7006ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba77e00640 1 --2- 172.21.15.114:0/2318052033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba700c6460 0x7fba7006ff80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0097c0 tx=0x7fba5c01c380 comp rx=0 tx=0).stop 2024-02-17T12:19:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba77e00640 1 -- 172.21.15.114:0/2318052033 shutdown_connections 2024-02-17T12:19:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba77e00640 1 --2- 172.21.15.114:0/2318052033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba700c6460 0x7fba7006ff80 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba77e00640 1 -- 172.21.15.114:0/2318052033 >> 172.21.15.114:0/2318052033 conn(0x7fba700c4f20 msgr2=0x7fba700c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:58.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba77e00640 1 -- 172.21.15.114:0/2318052033 shutdown_connections 2024-02-17T12:19:58.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba77e00640 1 -- 172.21.15.114:0/2318052033 wait complete. 2024-02-17T12:19:58.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.464+0000 7fba77e00640 1 Processor -- start 2024-02-17T12:19:58.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba77e00640 1 -- start start 2024-02-17T12:19:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba77e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba700c6460 0x7fba701ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba77e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba70152540 0x7fba701564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba77e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fba70154e30 0x7fba7006c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba77e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba701412d0 con 0x7fba70152540 2024-02-17T12:19:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba77e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba70142130 con 0x7fba700c6460 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba77e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7006db30 con 0x7fba70154e30 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba74a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba70152540 0x7fba701564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba74a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba70152540 0x7fba701564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51714/0 (socket says 172.21.15.114:51714) 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba74a00640 1 -- 172.21.15.114:0/3658804414 learned_addr learned my addr 172.21.15.114:0/3658804414 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba75400640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba700c6460 0x7fba701ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba75e00640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fba70154e30 0x7fba7006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba74a00640 1 -- 172.21.15.114:0/3658804414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fba70154e30 msgr2=0x7fba7006c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba74a00640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fba70154e30 0x7fba7006c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba74a00640 1 -- 172.21.15.114:0/3658804414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba700c6460 msgr2=0x7fba701ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba74a00640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba700c6460 0x7fba701ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba74a00640 1 -- 172.21.15.114:0/3658804414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c009420 con 0x7fba70152540 2024-02-17T12:19:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba74a00640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba70152540 0x7fba701564b0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0097c0 tx=0x7fba5c019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba6d600640 1 -- 172.21.15.114:0/3658804414 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0b4430 con 0x7fba70152540 2024-02-17T12:19:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba6d600640 1 -- 172.21.15.114:0/3658804414 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c0b4590 con 0x7fba70152540 2024-02-17T12:19:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba6d600640 1 -- 172.21.15.114:0/3658804414 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0b4940 con 0x7fba70152540 2024-02-17T12:19:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba77e00640 1 -- 172.21.15.114:0/3658804414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba70141520 con 0x7fba70152540 2024-02-17T12:19:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba77e00640 1 -- 172.21.15.114:0/3658804414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba70141ae0 con 0x7fba70152540 2024-02-17T12:19:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.468+0000 7fba77e00640 1 -- 172.21.15.114:0/3658804414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba70074840 con 0x7fba70152540 2024-02-17T12:19:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.472+0000 7fba6d600640 1 -- 172.21.15.114:0/3658804414 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fba5c0b2040 con 0x7fba70152540 2024-02-17T12:19:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.472+0000 7fba6d600640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fba50066e40 0x7fba50069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.472+0000 7fba6d600640 1 -- 172.21.15.114:0/3658804414 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fba5c11e920 con 0x7fba70152540 2024-02-17T12:19:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.472+0000 7fba75400640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fba50066e40 0x7fba50069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.472+0000 7fba75400640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fba50066e40 0x7fba50069300 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fba64001570 tx=0x7fba64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:58.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.476+0000 7fba6d600640 1 -- 172.21.15.114:0/3658804414 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fba5c0eb6a0 con 0x7fba70152540 2024-02-17T12:19:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 -- 172.21.15.114:0/3658804414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba7014a690 con 0x7fba70152540 2024-02-17T12:19:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba6d600640 1 -- 172.21.15.114:0/3658804414 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4945 (secure 0 0 0) 0x7fba5c11e090 con 0x7fba70152540 2024-02-17T12:19:58.667 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:58.667 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7176,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/770464983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":770464983},{"type":"v1","addr":"172.21.15.114:6837","nonce":770464983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:21.726155+0000","modified":"2024-02-17T12:19:24.747374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1982789506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1982789506},{"type":"v1","addr":"172.21.15.114:6836","nonce":1982789506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-02-17T12:19:58.668 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 55 2024-02-17T12:19:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 -- 172.21.15.114:0/3658804414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fba50066e40 msgr2=0x7fba50069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fba50066e40 0x7fba50069300 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fba64001570 tx=0x7fba64009040 comp rx=0 tx=0).stop 2024-02-17T12:19:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 -- 172.21.15.114:0/3658804414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba70152540 msgr2=0x7fba701564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba70152540 0x7fba701564b0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0097c0 tx=0x7fba5c019120 comp rx=0 tx=0).stop 2024-02-17T12:19:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 -- 172.21.15.114:0/3658804414 shutdown_connections 2024-02-17T12:19:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fba70154e30 0x7fba7006c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fba50066e40 0x7fba50069300 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba70152540 0x7fba701564b0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 --2- 172.21.15.114:0/3658804414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba700c6460 0x7fba701ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.664+0000 7fba77e00640 1 -- 172.21.15.114:0/3658804414 >> 172.21.15.114:0/3658804414 conn(0x7fba700c4f20 msgr2=0x7fba700c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:58.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.668+0000 7fba77e00640 1 -- 172.21.15.114:0/3658804414 shutdown_connections 2024-02-17T12:19:58.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.668+0000 7fba77e00640 1 -- 172.21.15.114:0/3658804414 wait complete. 2024-02-17T12:19:58.690 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:58.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee14e00640 1 Processor -- start 2024-02-17T12:19:58.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee14e00640 1 -- start start 2024-02-17T12:19:58.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee14e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee1014e9b0 0x7fee100ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee14e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fee1006ef50 0x7fee101512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee14e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee100aa150 con 0x7fee101517e0 2024-02-17T12:19:58.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee14e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1014ed90 con 0x7fee1006ef50 2024-02-17T12:19:58.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee14e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee100c1e90 con 0x7fee1014e9b0 2024-02-17T12:19:58.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee0e800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fee101517e0 0x7fee1006dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47160/0 (socket says 172.21.15.114:47160) 2024-02-17T12:19:58.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee0d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fee1006ef50 0x7fee101512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee0e800640 1 -- 172.21.15.114:0/1337237256 learned_addr learned my addr 172.21.15.114:0/1337237256 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:58.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.820+0000 7fee0de00640 1 --2- 172.21.15.114:0/1337237256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee1014e9b0 0x7fee100ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee0d400640 1 -- 172.21.15.114:0/1337237256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee1014e9b0 msgr2=0x7fee100ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:58.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee0d400640 1 --2- 172.21.15.114:0/1337237256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee1014e9b0 0x7fee100ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee0d400640 1 -- 172.21.15.114:0/1337237256 >> v1:172.21.15.114:6789/0 conn(0x7fee101517e0 legacy=0x7fee1006dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee0ca00640 1 -- 172.21.15.114:0/1337237256 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460908418 0 0) 0x7fee100aa150 con 0x7fee101517e0 2024-02-17T12:19:58.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee0d400640 1 -- 172.21.15.114:0/1337237256 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10152000 con 0x7fee1006ef50 2024-02-17T12:19:58.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee0de00640 1 --2- 172.21.15.114:0/1337237256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee1014e9b0 0x7fee100ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:58.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee0d400640 1 --2- 172.21.15.114:0/1337237256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1006ef50 0x7fee101512a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0097c0 tx=0x7fedfc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b2ffc312a17093 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:58.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee0ca00640 1 -- 172.21.15.114:0/1337237256 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0ab640 con 0x7fee1006ef50 2024-02-17T12:19:58.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee0ca00640 1 -- 172.21.15.114:0/1337237256 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc0a7070 con 0x7fee1006ef50 2024-02-17T12:19:58.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee0ca00640 1 -- 172.21.15.114:0/1337237256 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0ab9c0 con 0x7fee1006ef50 2024-02-17T12:19:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee14e00640 1 -- 172.21.15.114:0/1337237256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1006ef50 msgr2=0x7fee101512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee14e00640 1 --2- 172.21.15.114:0/1337237256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1006ef50 0x7fee101512a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0097c0 tx=0x7fedfc01c4a0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee14e00640 1 -- 172.21.15.114:0/1337237256 shutdown_connections 2024-02-17T12:19:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee14e00640 1 --2- 172.21.15.114:0/1337237256 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1006ef50 0x7fee101512a0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee14e00640 1 --2- 172.21.15.114:0/1337237256 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee1014e9b0 0x7fee100ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.824+0000 7fee14e00640 1 -- 172.21.15.114:0/1337237256 >> 172.21.15.114:0/1337237256 conn(0x7fee100a8490 msgr2=0x7fee100a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 -- 172.21.15.114:0/1337237256 shutdown_connections 2024-02-17T12:19:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 -- 172.21.15.114:0/1337237256 wait complete. 2024-02-17T12:19:58.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 Processor -- start 2024-02-17T12:19:58.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 -- start start 2024-02-17T12:19:58.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee1006ef50 0x7fee1014cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1014e9b0 0x7fee100c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee101517e0 0x7fee100c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1014a710 con 0x7fee1014e9b0 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee100c4040 con 0x7fee1006ef50 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee100724a0 con 0x7fee101517e0 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1014e9b0 0x7fee100c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1014e9b0 0x7fee100c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51720/0 (socket says 172.21.15.114:51720) 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0d400640 1 -- 172.21.15.114:0/198873358 learned_addr learned my addr 172.21.15.114:0/198873358 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0e800640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee101517e0 0x7fee100c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0de00640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee1006ef50 0x7fee1014cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0d400640 1 -- 172.21.15.114:0/198873358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee101517e0 msgr2=0x7fee100c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0d400640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee101517e0 0x7fee100c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0d400640 1 -- 172.21.15.114:0/198873358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee1006ef50 msgr2=0x7fee1014cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0d400640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee1006ef50 0x7fee1014cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0d400640 1 -- 172.21.15.114:0/198873358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0000a5c0 con 0x7fee1014e9b0 2024-02-17T12:19:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0de00640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee1006ef50 0x7fee1014cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:19:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee0d400640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1014e9b0 0x7fee100c5560 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0ad040 tx=0x7fedfc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee06000640 1 -- 172.21.15.114:0/198873358 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0bf410 con 0x7fee1014e9b0 2024-02-17T12:19:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee06000640 1 -- 172.21.15.114:0/198873358 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc0bf590 con 0x7fee1014e9b0 2024-02-17T12:19:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 -- 172.21.15.114:0/198873358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc009420 con 0x7fee1014e9b0 2024-02-17T12:19:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee06000640 1 -- 172.21.15.114:0/198873358 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0bf940 con 0x7fee1014e9b0 2024-02-17T12:19:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.828+0000 7fee14e00640 1 -- 172.21.15.114:0/198873358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1014a3a0 con 0x7fee1014e9b0 2024-02-17T12:19:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.832+0000 7fee14e00640 1 -- 172.21.15.114:0/198873358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee10074840 con 0x7fee1014e9b0 2024-02-17T12:19:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.832+0000 7fee06000640 1 -- 172.21.15.114:0/198873358 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fedfc0b5400 con 0x7fee1014e9b0 2024-02-17T12:19:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.832+0000 7fee06000640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fedf0066e40 0x7fedf0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:58.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.832+0000 7fee06000640 1 -- 172.21.15.114:0/198873358 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fedfc11f310 con 0x7fee1014e9b0 2024-02-17T12:19:58.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.832+0000 7fee0de00640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fedf0066e40 0x7fedf0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:58.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.832+0000 7fee0de00640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fedf0066e40 0x7fedf0069300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fee0000ad70 tx=0x7fee00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:58.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.836+0000 7fee06000640 1 -- 172.21.15.114:0/198873358 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fedfc0ec250 con 0x7fee1014e9b0 2024-02-17T12:19:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.992+0000 7fee14e00640 1 -- 172.21.15.114:0/198873358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee100c0d70 con 0x7fee1014e9b0 2024-02-17T12:19:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.992+0000 7fee06000640 1 -- 172.21.15.114:0/198873358 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16753 (secure 0 0 0) 0x7fedfc0ef910 con 0x7fee1014e9b0 2024-02-17T12:19:58.997 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:58.997 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":75,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:56.956421+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/709959478":"2024-02-18T12:19:53.944751+0000","172.21.15.114:6835/709959478":"2024-02-18T12:19:53.944751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:19:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 -- 172.21.15.114:0/198873358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fedf0066e40 msgr2=0x7fedf0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fedf0066e40 0x7fedf0069300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fee0000ad70 tx=0x7fee00008040 comp rx=0 tx=0).stop 2024-02-17T12:19:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 -- 172.21.15.114:0/198873358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1014e9b0 msgr2=0x7fee100c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1014e9b0 0x7fee100c5560 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0ad040 tx=0x7fedfc01ace0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 -- 172.21.15.114:0/198873358 shutdown_connections 2024-02-17T12:19:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee101517e0 0x7fee100c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fedf0066e40 0x7fedf0069300 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1014e9b0 0x7fee100c5560 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 --2- 172.21.15.114:0/198873358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee1006ef50 0x7fee1014cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 -- 172.21.15.114:0/198873358 >> 172.21.15.114:0/198873358 conn(0x7fee100a8490 msgr2=0x7fee100a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 -- 172.21.15.114:0/198873358 shutdown_connections 2024-02-17T12:19:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:58.996+0000 7fee14e00640 1 -- 172.21.15.114:0/198873358 wait complete. 2024-02-17T12:19:59.019 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-02-17T12:19:59.019 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:19:59.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c8800640 1 Processor -- start 2024-02-17T12:19:59.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c8800640 1 -- start start 2024-02-17T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c8800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f27c0152540 0x7f27c006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c8800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c0154e30 0x7f27c00aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c8800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c0155dd0 con 0x7f27c00c6460 2024-02-17T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c8800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c01588c0 con 0x7f27c0152540 2024-02-17T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c8800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c0155810 con 0x7f27c0154e30 2024-02-17T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c5400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f27c00c6460 0x7f27c0158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47176/0 (socket says 172.21.15.114:47176) 2024-02-17T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c5400640 1 -- 172.21.15.114:0/2601646452 learned_addr learned my addr 172.21.15.114:0/2601646452 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c5e00640 1 --2- 172.21.15.114:0/2601646452 >> v2:172.21.15.116:3300/0 conn(0x7f27c0152540 0x7f27c006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.152+0000 7f27c6800640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c0154e30 0x7f27c00aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968881582 0 0) 0x7f27c0155dd0 con 0x7f27c00c6460 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a8003530 con 0x7f27c00c6460 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1287821207 0 0) 0x7f27a8003530 con 0x7f27c00c6460 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c0154e30 msgr2=0x7f27c00aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c0154e30 0x7f27c00aa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 >> v2:172.21.15.116:3300/0 conn(0x7f27c0152540 msgr2=0x7f27c006ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 --2- 172.21.15.114:0/2601646452 >> v2:172.21.15.116:3300/0 conn(0x7f27c0152540 0x7f27c006ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c0155af0 con 0x7f27c00c6460 2024-02-17T12:19:59.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f27b0001680 con 0x7f27c00c6460 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 >> v1:172.21.15.114:6789/0 conn(0x7f27c00c6460 legacy=0x7f27c0158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27a8003980 0x7f27a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c0154e30 0x7f27a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27a8004d10 0x7f27a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c01588c0 con 0x7f27a8004d10 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c0155810 con 0x7f27a8003980 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a800ba60 con 0x7f27c0154e30 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c5e00640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27a8003980 0x7f27a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c6800640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27a8004d10 0x7f27a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c5400640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c0154e30 0x7f27a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c5e00640 1 -- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c0154e30 msgr2=0x7f27a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c5e00640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27c0154e30 0x7f27a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c5e00640 1 -- 172.21.15.114:0/2601646452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27a8004d10 msgr2=0x7f27a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:59.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c5e00640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27a8004d10 0x7f27a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c5e00640 1 -- 172.21.15.114:0/2601646452 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8003530 con 0x7f27a8003980 2024-02-17T12:19:59.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.156+0000 7f27c6800640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27a8004d10 0x7f27a8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:19:59.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c5e00640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27a8003980 0x7f27a8003da0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009ae0 tx=0x7f27b401cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbaa23c2ef7e80c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:59.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40a5590 con 0x7f27a8003980 2024-02-17T12:19:59.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40a56f0 con 0x7f27a8003980 2024-02-17T12:19:59.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c4a00640 1 -- 172.21.15.114:0/2601646452 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40a58e0 con 0x7f27a8003980 2024-02-17T12:19:59.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 -- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27a8003980 msgr2=0x7f27a8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 --2- 172.21.15.114:0/2601646452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27a8003980 0x7f27a8003da0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009ae0 tx=0x7f27b401cab0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c6800640 1 -- 172.21.15.114:0/2601646452 reap_dead start 2024-02-17T12:19:59.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 -- 172.21.15.114:0/2601646452 shutdown_connections 2024-02-17T12:19:59.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 -- 172.21.15.114:0/2601646452 >> 172.21.15.114:0/2601646452 conn(0x7f27c00c4f20 msgr2=0x7f27c00c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:59.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 -- 172.21.15.114:0/2601646452 shutdown_connections 2024-02-17T12:19:59.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 -- 172.21.15.114:0/2601646452 wait complete. 2024-02-17T12:19:59.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 Processor -- start 2024-02-17T12:19:59.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 -- start start 2024-02-17T12:19:59.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27a8003980 0x7f27c014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00ab4d0 0x7f27c014cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27c0146450 0x7f27c01468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c014e320 con 0x7f27c0146450 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c014bbd0 con 0x7f27c00ab4d0 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c8800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c014f9f0 con 0x7f27a8003980 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.160+0000 7f27c6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27c0146450 0x7f27c01468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27c0146450 0x7f27c01468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51744/0 (socket says 172.21.15.114:51744) 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c6800640 1 -- 172.21.15.114:0/3390025773 learned_addr learned my addr 172.21.15.114:0/3390025773 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c5e00640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27a8003980 0x7f27c014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c5400640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00ab4d0 0x7f27c014cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c6800640 1 -- 172.21.15.114:0/3390025773 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27a8003980 msgr2=0x7f27c014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c6800640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27a8003980 0x7f27c014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c6800640 1 -- 172.21.15.114:0/3390025773 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00ab4d0 msgr2=0x7f27c014cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c6800640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00ab4d0 0x7f27c014cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c6800640 1 -- 172.21.15.114:0/3390025773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c014b610 con 0x7f27c0146450 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c5400640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00ab4d0 0x7f27c014cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c6800640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27c0146450 0x7f27c01468d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f27c0072d90 tx=0x7f27bc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27ba000640 1 -- 172.21.15.114:0/3390025773 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc01c070 con 0x7f27c0146450 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27ba000640 1 -- 172.21.15.114:0/3390025773 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc00f040 con 0x7f27c0146450 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27ba000640 1 -- 172.21.15.114:0/3390025773 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00e040 con 0x7f27c0146450 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c8800640 1 -- 172.21.15.114:0/3390025773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c014b8f0 con 0x7f27c0146450 2024-02-17T12:19:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c8800640 1 -- 172.21.15.114:0/3390025773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c014f680 con 0x7f27c0146450 2024-02-17T12:19:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27c8800640 1 -- 172.21.15.114:0/3390025773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c014f200 con 0x7f27c0146450 2024-02-17T12:19:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.164+0000 7f27ba000640 1 -- 172.21.15.114:0/3390025773 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f27bc015430 con 0x7f27c0146450 2024-02-17T12:19:59.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.168+0000 7f27ba000640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27a4066e40 0x7f27a4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.168+0000 7f27ba000640 1 -- 172.21.15.114:0/3390025773 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f27bc084950 con 0x7f27c0146450 2024-02-17T12:19:59.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.168+0000 7f27c5e00640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27a4066e40 0x7f27a4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.168+0000 7f27c5e00640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27a4066e40 0x7f27a4069300 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f27b40af000 tx=0x7f27b40046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:59.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.172+0000 7f27ba000640 1 -- 172.21.15.114:0/3390025773 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f27c014f200 con 0x7f27c0146450 2024-02-17T12:19:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.360+0000 7f27c8800640 1 -- 172.21.15.114:0/3390025773 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27c014fba0 con 0x7f27c0146450 2024-02-17T12:19:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.360+0000 7f27ba000640 1 -- 172.21.15.114:0/3390025773 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f27c014fba0 con 0x7f27c0146450 2024-02-17T12:19:59.365 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7176,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/770464983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":770464983},{"type":"v1","addr":"172.21.15.114:6837","nonce":770464983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:21.726155+0000","modified":"2024-02-17T12:19:24.747374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1982789506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1982789506},{"type":"v1","addr":"172.21.15.114:6836","nonce":1982789506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-02-17T12:19:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 55 2024-02-17T12:19:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 -- 172.21.15.114:0/3390025773 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27a4066e40 msgr2=0x7f27a4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27a4066e40 0x7f27a4069300 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f27b40af000 tx=0x7f27b40046d0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 -- 172.21.15.114:0/3390025773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27c0146450 msgr2=0x7f27c01468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27c0146450 0x7f27c01468d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f27c0072d90 tx=0x7f27bc00f580 comp rx=0 tx=0).stop 2024-02-17T12:19:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 -- 172.21.15.114:0/3390025773 shutdown_connections 2024-02-17T12:19:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f27a4066e40 0x7f27a4069300 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27c0146450 0x7f27c01468d0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27c00ab4d0 0x7f27c014cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 --2- 172.21.15.114:0/3390025773 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27a8003980 0x7f27c014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 -- 172.21.15.114:0/3390025773 >> 172.21.15.114:0/3390025773 conn(0x7f27c00c4f20 msgr2=0x7f27c0157790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 -- 172.21.15.114:0/3390025773 shutdown_connections 2024-02-17T12:19:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.364+0000 7f27c8800640 1 -- 172.21.15.114:0/3390025773 wait complete. 2024-02-17T12:19:59.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:19:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.516+0000 7fb2bca00640 1 Processor -- start 2024-02-17T12:19:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.516+0000 7fb2bca00640 1 -- start start 2024-02-17T12:19:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.516+0000 7fb2bca00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2b814f110 0x7fb2b80c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.516+0000 7fb2bca00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2b80c2580 0x7fb2b80aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.516+0000 7fb2bca00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b80a9420 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.516+0000 7fb2bca00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b814f4f0 con 0x7fb2b80c2580 2024-02-17T12:19:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.516+0000 7fb2bca00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b80aae80 con 0x7fb2b814f110 2024-02-17T12:19:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b6800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb2b80c1eb0 0x7fb2b8155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47182/0 (socket says 172.21.15.114:47182) 2024-02-17T12:19:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b6800640 1 -- 172.21.15.114:0/3627369296 learned_addr learned my addr 172.21.15.114:0/3627369296 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b5400640 1 --2- 172.21.15.114:0/3627369296 >> v2:172.21.15.114:3300/0 conn(0x7fb2b80c2580 0x7fb2b80aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b5e00640 1 --2- 172.21.15.114:0/3627369296 >> v2:172.21.15.116:3300/0 conn(0x7fb2b814f110 0x7fb2b80c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b4a00640 1 -- 172.21.15.114:0/3627369296 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955106384 0 0) 0x7fb2b80a9420 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b4a00640 1 -- 172.21.15.114:0/3627369296 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb29c003530 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b5400640 1 -- 172.21.15.114:0/3627369296 >> v2:172.21.15.116:3300/0 conn(0x7fb2b814f110 msgr2=0x7fb2b80c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:19:59.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b5400640 1 --2- 172.21.15.114:0/3627369296 >> v2:172.21.15.116:3300/0 conn(0x7fb2b814f110 0x7fb2b80c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b5400640 1 -- 172.21.15.114:0/3627369296 >> v1:172.21.15.114:6789/0 conn(0x7fb2b80c1eb0 legacy=0x7fb2b8155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b5400640 1 -- 172.21.15.114:0/3627369296 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b8152850 con 0x7fb2b80c2580 2024-02-17T12:19:59.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b5e00640 1 --2- 172.21.15.114:0/3627369296 >> v2:172.21.15.116:3300/0 conn(0x7fb2b814f110 0x7fb2b80c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:59.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b5400640 1 --2- 172.21.15.114:0/3627369296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c2580 0x7fb2b80aa150 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fb2b806dc70 tx=0x7fb2a401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d769f315fc07f3cf server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:59.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b4a00640 1 -- 172.21.15.114:0/3627369296 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40ac620 con 0x7fb2b80c2580 2024-02-17T12:19:59.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b4a00640 1 -- 172.21.15.114:0/3627369296 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a40ac780 con 0x7fb2b80c2580 2024-02-17T12:19:59.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.520+0000 7fb2b4a00640 1 -- 172.21.15.114:0/3627369296 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40acb10 con 0x7fb2b80c2580 2024-02-17T12:19:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 -- 172.21.15.114:0/3627369296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c2580 msgr2=0x7fb2b80aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 --2- 172.21.15.114:0/3627369296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c2580 0x7fb2b80aa150 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fb2b806dc70 tx=0x7fb2a401c3c0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 -- 172.21.15.114:0/3627369296 shutdown_connections 2024-02-17T12:19:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 --2- 172.21.15.114:0/3627369296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c2580 0x7fb2b80aa150 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 --2- 172.21.15.114:0/3627369296 >> v2:172.21.15.116:3300/0 conn(0x7fb2b814f110 0x7fb2b80c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 -- 172.21.15.114:0/3627369296 >> 172.21.15.114:0/3627369296 conn(0x7fb2b80a8490 msgr2=0x7fb2b80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 -- 172.21.15.114:0/3627369296 shutdown_connections 2024-02-17T12:19:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 -- 172.21.15.114:0/3627369296 wait complete. 2024-02-17T12:19:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 Processor -- start 2024-02-17T12:19:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 -- start start 2024-02-17T12:19:59.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c1eb0 0x7fb2b81485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2b80c2580 0x7fb2b80c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b814f110 0x7fb2b80c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b814d270 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b81ef750 con 0x7fb2b814f110 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8149550 con 0x7fb2b80c2580 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c1eb0 0x7fb2b81485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c1eb0 0x7fb2b81485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51760/0 (socket says 172.21.15.114:51760) 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5e00640 1 -- 172.21.15.114:0/671716380 learned_addr learned my addr 172.21.15.114:0/671716380 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5400640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2b80c2580 0x7fb2b80c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b6800640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b814f110 0x7fb2b80c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5e00640 1 -- 172.21.15.114:0/671716380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2b80c2580 msgr2=0x7fb2b80c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5e00640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2b80c2580 0x7fb2b80c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5e00640 1 -- 172.21.15.114:0/671716380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b814f110 msgr2=0x7fb2b80c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5e00640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b814f110 0x7fb2b80c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5e00640 1 -- 172.21.15.114:0/671716380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4009420 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5400640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2b80c2580 0x7fb2b80c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b6800640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b814f110 0x7fb2b80c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2b5e00640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c1eb0 0x7fb2b81485f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800d800 tx=0x7fb2a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2ae000640 1 -- 172.21.15.114:0/671716380 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80096c0 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2ae000640 1 -- 172.21.15.114:0/671716380 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8009820 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2ae000640 1 -- 172.21.15.114:0/671716380 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8009bd0 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.524+0000 7fb2bca00640 1 -- 172.21.15.114:0/671716380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b81efbe0 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.528+0000 7fb2bca00640 1 -- 172.21.15.114:0/671716380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b81eee20 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.528+0000 7fb2bca00640 1 -- 172.21.15.114:0/671716380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b8074840 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.528+0000 7fb2ae000640 1 -- 172.21.15.114:0/671716380 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb2a8009d30 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.528+0000 7fb2ae000640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb298066e70 0x7fb298069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.528+0000 7fb2ae000640 1 -- 172.21.15.114:0/671716380 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fb2a8085110 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.528+0000 7fb2b5400640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb298066e70 0x7fb298069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.528+0000 7fb2b5400640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb298066e70 0x7fb298069330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40ae000 tx=0x7fb2a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.532+0000 7fb2ae000640 1 -- 172.21.15.114:0/671716380 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb2a8051f30 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.716+0000 7fb2bca00640 1 -- 172.21.15.114:0/671716380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2b8072f40 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2ae000640 1 -- 172.21.15.114:0/671716380 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4945 (secure 0 0 0) 0x7fb2a80555f0 con 0x7fb2b80c1eb0 2024-02-17T12:19:59.722 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:19:59.722 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7176,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/770464983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":770464983},{"type":"v1","addr":"172.21.15.114:6837","nonce":770464983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-17T12:19:21.726155+0000","modified":"2024-02-17T12:19:24.747374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6501},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6501":{"gid":6501,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":7,"addr":"172.21.15.114:6836/1982789506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1982789506},{"type":"v1","addr":"172.21.15.114:6836","nonce":1982789506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-02-17T12:19:59.722 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 55 2024-02-17T12:19:59.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 -- 172.21.15.114:0/671716380 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb298066e70 msgr2=0x7fb298069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb298066e70 0x7fb298069330 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40ae000 tx=0x7fb2a4008040 comp rx=0 tx=0).stop 2024-02-17T12:19:59.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 -- 172.21.15.114:0/671716380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c1eb0 msgr2=0x7fb2b81485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c1eb0 0x7fb2b81485f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800d800 tx=0x7fb2a800dcc0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 -- 172.21.15.114:0/671716380 shutdown_connections 2024-02-17T12:19:59.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b814f110 0x7fb2b80c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2b80c2580 0x7fb2b80c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb298066e70 0x7fb298069330 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 --2- 172.21.15.114:0/671716380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2b80c1eb0 0x7fb2b81485f0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 -- 172.21.15.114:0/671716380 >> 172.21.15.114:0/671716380 conn(0x7fb2b80a8490 msgr2=0x7fb2b80c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:59.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 -- 172.21.15.114:0/671716380 shutdown_connections 2024-02-17T12:19:59.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.720+0000 7fb2bca00640 1 -- 172.21.15.114:0/671716380 wait complete. 2024-02-17T12:19:59.743 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:19:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.872+0000 7f57dce00640 1 Processor -- start 2024-02-17T12:19:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.872+0000 7f57dce00640 1 -- start start 2024-02-17T12:19:59.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57dce00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d806db50 0x7f57d814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57dce00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d8156270 con 0x7f57d8150490 2024-02-17T12:19:59.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57dce00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d8156550 con 0x7f57d80c25a0 2024-02-17T12:19:59.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57dce00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d806f090 con 0x7f57d806db50 2024-02-17T12:19:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57d6800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f57d8150490 0x7f57d8152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47184/0 (socket says 172.21.15.114:47184) 2024-02-17T12:19:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57d6800640 1 -- 172.21.15.114:0/2089382625 learned_addr learned my addr 172.21.15.114:0/2089382625 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:19:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57d5400640 1 --2- 172.21.15.114:0/2089382625 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d806db50 0x7f57d814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57d4a00640 1 -- 172.21.15.114:0/2089382625 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722575297 0 0) 0x7f57d8156270 con 0x7f57d8150490 2024-02-17T12:19:59.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57d4a00640 1 -- 172.21.15.114:0/2089382625 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57bc003530 con 0x7f57d8150490 2024-02-17T12:19:59.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57d4a00640 1 -- 172.21.15.114:0/2089382625 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581727232 0 0) 0x7f57d8156550 con 0x7f57d80c25a0 2024-02-17T12:19:59.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57d4a00640 1 -- 172.21.15.114:0/2089382625 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57d8156270 con 0x7f57d80c25a0 2024-02-17T12:19:59.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57d5400640 1 -- 172.21.15.114:0/2089382625 >> v1:172.21.15.116:6789/0 conn(0x7f57d80c25a0 legacy=0x7f57d806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57d5400640 1 -- 172.21.15.114:0/2089382625 >> v1:172.21.15.114:6789/0 conn(0x7f57d8150490 legacy=0x7f57d8152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.876+0000 7f57d5400640 1 -- 172.21.15.114:0/2089382625 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d8156830 con 0x7f57d806db50 2024-02-17T12:19:59.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57d5400640 1 --2- 172.21.15.114:0/2089382625 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d806db50 0x7f57d814ff50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f57c40097f0 tx=0x7f57c401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=538de0ecc11da7d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:59.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57d4a00640 1 -- 172.21.15.114:0/2089382625 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40ab600 con 0x7f57d806db50 2024-02-17T12:19:59.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57d4a00640 1 -- 172.21.15.114:0/2089382625 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c40a7050 con 0x7f57d806db50 2024-02-17T12:19:59.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57d4a00640 1 -- 172.21.15.114:0/2089382625 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40ab980 con 0x7f57d806db50 2024-02-17T12:19:59.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 -- 172.21.15.114:0/2089382625 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d806db50 msgr2=0x7f57d814ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 --2- 172.21.15.114:0/2089382625 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d806db50 0x7f57d814ff50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f57c40097f0 tx=0x7f57c401c3c0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 -- 172.21.15.114:0/2089382625 shutdown_connections 2024-02-17T12:19:59.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 --2- 172.21.15.114:0/2089382625 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d806db50 0x7f57d814ff50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 -- 172.21.15.114:0/2089382625 >> 172.21.15.114:0/2089382625 conn(0x7f57d80a8490 msgr2=0x7f57d80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:19:59.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 -- 172.21.15.114:0/2089382625 shutdown_connections 2024-02-17T12:19:59.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 -- 172.21.15.114:0/2089382625 wait complete. 2024-02-17T12:19:59.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 Processor -- start 2024-02-17T12:19:59.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 -- start start 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d806db50 0x7f57d80c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.880+0000 7f57dce00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d80c25a0 0x7f57d80bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57dce00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57d8150490 0x7f57d80aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57dce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d81410e0 con 0x7f57d806db50 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57dce00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80c4b10 con 0x7f57d8150490 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57dce00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80c4db0 con 0x7f57d80c25a0 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d806db50 0x7f57d80c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d806db50 0x7f57d80c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51772/0 (socket says 172.21.15.114:51772) 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d5e00640 1 -- 172.21.15.114:0/4237747118 learned_addr learned my addr 172.21.15.114:0/4237747118 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d5400640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d80c25a0 0x7f57d80bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d6800640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57d8150490 0x7f57d80aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d5e00640 1 -- 172.21.15.114:0/4237747118 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d80c25a0 msgr2=0x7f57d80bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d5e00640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d80c25a0 0x7f57d80bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d5e00640 1 -- 172.21.15.114:0/4237747118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57d8150490 msgr2=0x7f57d80aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d5e00640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57d8150490 0x7f57d80aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d5e00640 1 -- 172.21.15.114:0/4237747118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4009420 con 0x7f57d806db50 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d6800640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57d8150490 0x7f57d80aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57d5e00640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d806db50 0x7f57d80c5ce0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c500 tx=0x7f57c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57ce000640 1 -- 172.21.15.114:0/4237747118 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c80052d0 con 0x7f57d806db50 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57ce000640 1 -- 172.21.15.114:0/4237747118 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8005450 con 0x7f57d806db50 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57ce000640 1 -- 172.21.15.114:0/4237747118 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8012870 con 0x7f57d806db50 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57dce00640 1 -- 172.21.15.114:0/4237747118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d80a99b0 con 0x7f57d806db50 2024-02-17T12:19:59.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57dce00640 1 -- 172.21.15.114:0/4237747118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d80bff40 con 0x7f57d806db50 2024-02-17T12:19:59.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57dce00640 1 -- 172.21.15.114:0/4237747118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d8074840 con 0x7f57d806db50 2024-02-17T12:19:59.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.884+0000 7f57ce000640 1 -- 172.21.15.114:0/4237747118 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f57c80129d0 con 0x7f57d806db50 2024-02-17T12:19:59.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.888+0000 7f57ce000640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f57b8066e40 0x7f57b8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:19:59.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.888+0000 7f57ce000640 1 -- 172.21.15.114:0/4237747118 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f57c80846b0 con 0x7f57d806db50 2024-02-17T12:19:59.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.888+0000 7f57d5400640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f57b8066e40 0x7f57b8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:19:59.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.888+0000 7f57d5400640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f57b8066e40 0x7f57b8069300 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f57c40ad000 tx=0x7f57c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:19:59.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:19:59.892+0000 7f57ce000640 1 -- 172.21.15.114:0/4237747118 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f57c80513b0 con 0x7f57d806db50 2024-02-17T12:20:00.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 -- 172.21.15.114:0/4237747118 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57d80a9e60 con 0x7f57d806db50 2024-02-17T12:20:00.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57ce000640 1 -- 172.21.15.114:0/4237747118 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16753 (secure 0 0 0) 0x7f57c8054a70 con 0x7f57d806db50 2024-02-17T12:20:00.051 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:20:00.051 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":75,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:19:56.956421+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-02-17T12:19:19.573884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-02-17T12:19:20.731260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6837/709959478":"2024-02-18T12:19:53.944751+0000","172.21.15.114:6835/709959478":"2024-02-18T12:19:53.944751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:20:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 -- 172.21.15.114:0/4237747118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f57b8066e40 msgr2=0x7f57b8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f57b8066e40 0x7f57b8069300 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f57c40ad000 tx=0x7f57c4008040 comp rx=0 tx=0).stop 2024-02-17T12:20:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 -- 172.21.15.114:0/4237747118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d806db50 msgr2=0x7f57d80c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d806db50 0x7f57d80c5ce0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c500 tx=0x7f57c800c9c0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 -- 172.21.15.114:0/4237747118 shutdown_connections 2024-02-17T12:20:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57d8150490 0x7f57d80aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57d80c25a0 0x7f57d80bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f57b8066e40 0x7f57b8069300 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 --2- 172.21.15.114:0/4237747118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57d806db50 0x7f57d80c5ce0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 -- 172.21.15.114:0/4237747118 >> 172.21.15.114:0/4237747118 conn(0x7f57d80a8490 msgr2=0x7f57d80c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:00.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 -- 172.21.15.114:0/4237747118 shutdown_connections 2024-02-17T12:20:00.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.048+0000 7f57dce00640 1 -- 172.21.15.114:0/4237747118 wait complete. 2024-02-17T12:20:00.072 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-02-17T12:20:00.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.204+0000 7fad3d200640 1 Processor -- start 2024-02-17T12:20:00.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.204+0000 7fad3d200640 1 -- start start 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.204+0000 7fad3d200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad3806db50 0x7fad3814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.204+0000 7fad3d200640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fad38150490 0x7fad38152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.204+0000 7fad3d200640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad38156270 con 0x7fad380c25a0 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.204+0000 7fad3d200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3806f090 con 0x7fad3806db50 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.204+0000 7fad3d200640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad38071630 con 0x7fad38150490 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.204+0000 7fad35400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad3806db50 0x7fad3814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad35400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad3806db50 0x7fad3814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51782/0 (socket says 172.21.15.114:51782) 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad35400640 1 -- 172.21.15.114:0/241963379 learned_addr learned my addr 172.21.15.114:0/241963379 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad36800640 1 --2- 172.21.15.114:0/241963379 >> v2:172.21.15.116:3300/0 conn(0x7fad38150490 0x7fad38152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad35400640 1 -- 172.21.15.114:0/241963379 >> v2:172.21.15.116:3300/0 conn(0x7fad38150490 msgr2=0x7fad38152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:00.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad35400640 1 --2- 172.21.15.114:0/241963379 >> v2:172.21.15.116:3300/0 conn(0x7fad38150490 0x7fad38152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad35400640 1 -- 172.21.15.114:0/241963379 >> v1:172.21.15.116:6789/0 conn(0x7fad380c25a0 legacy=0x7fad3806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad35400640 1 -- 172.21.15.114:0/241963379 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38156550 con 0x7fad3806db50 2024-02-17T12:20:00.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad36800640 1 --2- 172.21.15.114:0/241963379 >> v2:172.21.15.116:3300/0 conn(0x7fad38150490 0x7fad38152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:20:00.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad35400640 1 --2- 172.21.15.114:0/241963379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 0x7fad3814ff50 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fad38153cb0 tx=0x7fad2001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d758d4f8b879da server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:00.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad34a00640 1 -- 172.21.15.114:0/241963379 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad381539a0 con 0x7fad3806db50 2024-02-17T12:20:00.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad34a00640 1 -- 172.21.15.114:0/241963379 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad200a7050 con 0x7fad3806db50 2024-02-17T12:20:00.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.208+0000 7fad34a00640 1 -- 172.21.15.114:0/241963379 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200ab820 con 0x7fad3806db50 2024-02-17T12:20:00.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 -- 172.21.15.114:0/241963379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 msgr2=0x7fad3814ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 --2- 172.21.15.114:0/241963379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 0x7fad3814ff50 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fad38153cb0 tx=0x7fad2001c400 comp rx=0 tx=0).stop 2024-02-17T12:20:00.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 -- 172.21.15.114:0/241963379 shutdown_connections 2024-02-17T12:20:00.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 --2- 172.21.15.114:0/241963379 >> v2:172.21.15.116:3300/0 conn(0x7fad38150490 0x7fad38152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 --2- 172.21.15.114:0/241963379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 0x7fad3814ff50 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 -- 172.21.15.114:0/241963379 >> 172.21.15.114:0/241963379 conn(0x7fad380a8490 msgr2=0x7fad380a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:00.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 -- 172.21.15.114:0/241963379 shutdown_connections 2024-02-17T12:20:00.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 -- 172.21.15.114:0/241963379 wait complete. 2024-02-17T12:20:00.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 Processor -- start 2024-02-17T12:20:00.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 -- start start 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 0x7fad380c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad380c25a0 0x7fad38141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad38150490 0x7fad38154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad38154470 con 0x7fad3806db50 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad380c5bb0 con 0x7fad380c25a0 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad380c5e90 con 0x7fad38150490 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad35e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 0x7fad380c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad35e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 0x7fad380c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51786/0 (socket says 172.21.15.114:51786) 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad35e00640 1 -- 172.21.15.114:0/270206595 learned_addr learned my addr 172.21.15.114:0/270206595 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad35400640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad380c25a0 0x7fad38141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad36800640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad38150490 0x7fad38154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad35e00640 1 -- 172.21.15.114:0/270206595 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad38150490 msgr2=0x7fad38154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad35e00640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad38150490 0x7fad38154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad35e00640 1 -- 172.21.15.114:0/270206595 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad380c25a0 msgr2=0x7fad38141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad35e00640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad380c25a0 0x7fad38141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad35e00640 1 -- 172.21.15.114:0/270206595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200094d0 con 0x7fad3806db50 2024-02-17T12:20:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad36800640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad38150490 0x7fad38154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:20:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad35e00640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 0x7fad380c5380 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fad2800c790 tx=0x7fad2800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad2e000640 1 -- 172.21.15.114:0/270206595 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2800cea0 con 0x7fad3806db50 2024-02-17T12:20:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad2e000640 1 -- 172.21.15.114:0/270206595 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad28006d60 con 0x7fad3806db50 2024-02-17T12:20:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad2e000640 1 -- 172.21.15.114:0/270206595 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28003bc0 con 0x7fad3806db50 2024-02-17T12:20:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.212+0000 7fad3d200640 1 -- 172.21.15.114:0/270206595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad38154100 con 0x7fad3806db50 2024-02-17T12:20:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.216+0000 7fad3d200640 1 -- 172.21.15.114:0/270206595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad381422d0 con 0x7fad3806db50 2024-02-17T12:20:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.216+0000 7fad3d200640 1 -- 172.21.15.114:0/270206595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad38153f40 con 0x7fad3806db50 2024-02-17T12:20:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.216+0000 7fad2e000640 1 -- 172.21.15.114:0/270206595 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fad28003d20 con 0x7fad3806db50 2024-02-17T12:20:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.216+0000 7fad2e000640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad14066e40 0x7fad14069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.216+0000 7fad2e000640 1 -- 172.21.15.114:0/270206595 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fad280845c0 con 0x7fad3806db50 2024-02-17T12:20:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.216+0000 7fad35400640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad14066e40 0x7fad14069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.216+0000 7fad35400640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad14066e40 0x7fad14069300 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fad200ad000 tx=0x7fad20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:00.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.220+0000 7fad2e000640 1 -- 172.21.15.114:0/270206595 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fad28054f10 con 0x7fad3806db50 2024-02-17T12:20:00.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.404+0000 7fad3d200640 1 -- 172.21.15.114:0/270206595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fad38074840 con 0x7fad3806db50 2024-02-17T12:20:00.409 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-02-17T12:20:00.408+0000 7f5091a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-17T12:20:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.408+0000 7fad2e000640 1 -- 172.21.15.114:0/270206595 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 163+0+0 (secure 0 0 0) 0x7fad28054aa0 con 0x7fad3806db50 2024-02-17T12:20:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-17T12:20:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 -- 172.21.15.114:0/270206595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad14066e40 msgr2=0x7fad14069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad14066e40 0x7fad14069300 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fad200ad000 tx=0x7fad20008040 comp rx=0 tx=0).stop 2024-02-17T12:20:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 -- 172.21.15.114:0/270206595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 msgr2=0x7fad380c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 0x7fad380c5380 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fad2800c790 tx=0x7fad2800cc50 comp rx=0 tx=0).stop 2024-02-17T12:20:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 -- 172.21.15.114:0/270206595 shutdown_connections 2024-02-17T12:20:00.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fad38150490 0x7fad38154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad380c25a0 0x7fad38141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fad14066e40 0x7fad14069300 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 --2- 172.21.15.114:0/270206595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad3806db50 0x7fad380c5380 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 -- 172.21.15.114:0/270206595 >> 172.21.15.114:0/270206595 conn(0x7fad380a8490 msgr2=0x7fad3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:00.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 -- 172.21.15.114:0/270206595 shutdown_connections 2024-02-17T12:20:00.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.412+0000 7fad3d200640 1 -- 172.21.15.114:0/270206595 wait complete. 2024-02-17T12:20:00.424 INFO:tasks.ceph.mds.a.smithi114.stderr: -4825> 2024-02-17T12:19:24.660+0000 7f7b5d000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-17T12:20:00.435 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-02-17T12:20:00.473 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-02-17T12:20:00.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.572+0000 7fc5f4000640 1 Processor -- start 2024-02-17T12:20:00.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.572+0000 7fc5f4000640 1 -- start start 2024-02-17T12:20:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f4000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc5ec06db50 0x7fc5ec14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f4000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5ec150490 0x7fc5ec152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f4000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ec156270 con 0x7fc5ec0c25a0 2024-02-17T12:20:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f4000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ec06f090 con 0x7fc5ec06db50 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f4000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec071630 con 0x7fc5ec150490 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f1600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc5ec0c25a0 0x7fc5ec06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47202/0 (socket says 172.21.15.114:47202) 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f1600640 1 -- 172.21.15.114:0/4051129656 learned_addr learned my addr 172.21.15.114:0/4051129656 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f0c00640 1 --2- 172.21.15.114:0/4051129656 >> v2:172.21.15.116:3300/0 conn(0x7fc5ec06db50 0x7fc5ec14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f2000640 1 --2- 172.21.15.114:0/4051129656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5ec150490 0x7fc5ec152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5ebe00640 1 -- 172.21.15.114:0/4051129656 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906433764 0 0) 0x7fc5ec156270 con 0x7fc5ec0c25a0 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5ebe00640 1 -- 172.21.15.114:0/4051129656 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5d4003530 con 0x7fc5ec0c25a0 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f0c00640 1 -- 172.21.15.114:0/4051129656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5ec150490 msgr2=0x7fc5ec152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f0c00640 1 --2- 172.21.15.114:0/4051129656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5ec150490 0x7fc5ec152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f0c00640 1 -- 172.21.15.114:0/4051129656 >> v1:172.21.15.114:6789/0 conn(0x7fc5ec0c25a0 legacy=0x7fc5ec06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f0c00640 1 -- 172.21.15.114:0/4051129656 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec156550 con 0x7fc5ec06db50 2024-02-17T12:20:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.576+0000 7fc5f0c00640 1 --2- 172.21.15.114:0/4051129656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5ec06db50 0x7fc5ec14ff50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80097c0 tx=0x7fc5d801c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24190b63c011dd96 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:00.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5ebe00640 1 -- 172.21.15.114:0/4051129656 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec1539a0 con 0x7fc5ec06db50 2024-02-17T12:20:00.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5ebe00640 1 -- 172.21.15.114:0/4051129656 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d80a7050 con 0x7fc5ec06db50 2024-02-17T12:20:00.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5ebe00640 1 -- 172.21.15.114:0/4051129656 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80ab800 con 0x7fc5ec06db50 2024-02-17T12:20:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 -- 172.21.15.114:0/4051129656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5ec06db50 msgr2=0x7fc5ec14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 --2- 172.21.15.114:0/4051129656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5ec06db50 0x7fc5ec14ff50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80097c0 tx=0x7fc5d801c350 comp rx=0 tx=0).stop 2024-02-17T12:20:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 -- 172.21.15.114:0/4051129656 shutdown_connections 2024-02-17T12:20:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 --2- 172.21.15.114:0/4051129656 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5ec150490 0x7fc5ec152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 --2- 172.21.15.114:0/4051129656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5ec06db50 0x7fc5ec14ff50 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 -- 172.21.15.114:0/4051129656 >> 172.21.15.114:0/4051129656 conn(0x7fc5ec0a8490 msgr2=0x7fc5ec0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 -- 172.21.15.114:0/4051129656 shutdown_connections 2024-02-17T12:20:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 -- 172.21.15.114:0/4051129656 wait complete. 2024-02-17T12:20:00.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 Processor -- start 2024-02-17T12:20:00.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 -- start start 2024-02-17T12:20:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ec06db50 0x7fc5ec06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5ec0c25a0 0x7fc5ec1ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5ec150490 0x7fc5ec1ed370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec1f0cb0 con 0x7fc5ec06db50 2024-02-17T12:20:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec1f03a0 con 0x7fc5ec0c25a0 2024-02-17T12:20:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f4000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec14f160 con 0x7fc5ec150490 2024-02-17T12:20:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ec06db50 0x7fc5ec06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ec06db50 0x7fc5ec06ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51808/0 (socket says 172.21.15.114:51808) 2024-02-17T12:20:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f1600640 1 -- 172.21.15.114:0/2568334533 learned_addr learned my addr 172.21.15.114:0/2568334533 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f0c00640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5ec0c25a0 0x7fc5ec1ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f2000640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5ec150490 0x7fc5ec1ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f1600640 1 -- 172.21.15.114:0/2568334533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5ec150490 msgr2=0x7fc5ec1ed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f1600640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5ec150490 0x7fc5ec1ed370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f1600640 1 -- 172.21.15.114:0/2568334533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5ec0c25a0 msgr2=0x7fc5ec1ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f1600640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5ec0c25a0 0x7fc5ec1ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.580+0000 7fc5f1600640 1 -- 172.21.15.114:0/2568334533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d8009420 con 0x7fc5ec06db50 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5f1600640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ec06db50 0x7fc5ec06ac10 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00010f0 tx=0x7fc5e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5e9600640 1 -- 172.21.15.114:0/2568334533 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0005cf0 con 0x7fc5ec06db50 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5e9600640 1 -- 172.21.15.114:0/2568334533 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e0005e70 con 0x7fc5ec06db50 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5e9600640 1 -- 172.21.15.114:0/2568334533 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e00072d0 con 0x7fc5ec06db50 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5f4000640 1 -- 172.21.15.114:0/2568334533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ec1f05f0 con 0x7fc5ec06db50 2024-02-17T12:20:00.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5f4000640 1 -- 172.21.15.114:0/2568334533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ec1f10d0 con 0x7fc5ec06db50 2024-02-17T12:20:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5f4000640 1 -- 172.21.15.114:0/2568334533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ec1f0f20 con 0x7fc5ec06db50 2024-02-17T12:20:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5e9600640 1 -- 172.21.15.114:0/2568334533 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fc5e0007430 con 0x7fc5ec06db50 2024-02-17T12:20:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5e9600640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc5cc066e40 0x7fc5cc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5e9600640 1 -- 172.21.15.114:0/2568334533 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fc5e0084010 con 0x7fc5ec06db50 2024-02-17T12:20:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.584+0000 7fc5f0c00640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc5cc066e40 0x7fc5cc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.588+0000 7fc5f0c00640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc5cc066e40 0x7fc5cc069300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80ad000 tx=0x7fc5d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.588+0000 7fc5e9600640 1 -- 172.21.15.114:0/2568334533 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc5e0050e90 con 0x7fc5ec06db50 2024-02-17T12:20:00.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:00.776+0000 7fc5f4000640 1 -- 172.21.15.114:0/2568334533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc5ec1f12c0 con 0x7fc5ec06db50 2024-02-17T12:20:01.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5e9600640 1 -- 172.21.15.114:0/2568334533 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc5e0054550 con 0x7fc5ec06db50 2024-02-17T12:20:01.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 -- 172.21.15.114:0/2568334533 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc5cc066e40 msgr2=0x7fc5cc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:01.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc5cc066e40 0x7fc5cc069300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80ad000 tx=0x7fc5d8008040 comp rx=0 tx=0).stop 2024-02-17T12:20:01.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 -- 172.21.15.114:0/2568334533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ec06db50 msgr2=0x7fc5ec06ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:01.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ec06db50 0x7fc5ec06ac10 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00010f0 tx=0x7fc5e000c8f0 comp rx=0 tx=0).stop 2024-02-17T12:20:01.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 -- 172.21.15.114:0/2568334533 shutdown_connections 2024-02-17T12:20:01.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5ec150490 0x7fc5ec1ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:01.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5ec0c25a0 0x7fc5ec1ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:01.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fc5cc066e40 0x7fc5cc069300 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:01.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 --2- 172.21.15.114:0/2568334533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5ec06db50 0x7fc5ec06ac10 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:01.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 -- 172.21.15.114:0/2568334533 >> 172.21.15.114:0/2568334533 conn(0x7fc5ec0a8490 msgr2=0x7fc5ec0c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:01.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 -- 172.21.15.114:0/2568334533 shutdown_connections 2024-02-17T12:20:01.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.412+0000 7fc5f4000640 1 -- 172.21.15.114:0/2568334533 wait complete. 2024-02-17T12:20:01.438 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-02-17T12:20:01.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.616+0000 7fb9c1e00640 1 Processor -- start 2024-02-17T12:20:01.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.616+0000 7fb9c1e00640 1 -- start start 2024-02-17T12:20:01.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9c1e00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb9bc14f310 0x7fb9bc1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:01.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9c1e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9bc0a7dd0 0x7fb9bc0c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:01.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9c1e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9bc0c2e00 con 0x7fb9bc0c2530 2024-02-17T12:20:01.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9c1e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9bc0a6980 con 0x7fb9bc0a7dd0 2024-02-17T12:20:01.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9c1e00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9bc0c30e0 con 0x7fb9bc14f310 2024-02-17T12:20:01.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9bb400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb9bc0c2530 0x7fb9bc0c3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47216/0 (socket says 172.21.15.114:47216) 2024-02-17T12:20:01.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9bb400640 1 -- 172.21.15.114:0/3178813017 learned_addr learned my addr 172.21.15.114:0/3178813017 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:01.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9ba000640 1 --2- 172.21.15.114:0/3178813017 >> v2:172.21.15.114:3300/0 conn(0x7fb9bc0a7dd0 0x7fb9bc0c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:01.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9baa00640 1 --2- 172.21.15.114:0/3178813017 >> v2:172.21.15.116:3300/0 conn(0x7fb9bc14f310 0x7fb9bc1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:01.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9b9600640 1 -- 172.21.15.114:0/3178813017 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162545128 0 0) 0x7fb9bc0c2e00 con 0x7fb9bc0c2530 2024-02-17T12:20:01.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9b9600640 1 -- 172.21.15.114:0/3178813017 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a0003530 con 0x7fb9bc0c2530 2024-02-17T12:20:01.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9ba000640 1 -- 172.21.15.114:0/3178813017 >> v2:172.21.15.116:3300/0 conn(0x7fb9bc14f310 msgr2=0x7fb9bc1524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:01.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9ba000640 1 --2- 172.21.15.114:0/3178813017 >> v2:172.21.15.116:3300/0 conn(0x7fb9bc14f310 0x7fb9bc1524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:01.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9ba000640 1 -- 172.21.15.114:0/3178813017 >> v1:172.21.15.114:6789/0 conn(0x7fb9bc0c2530 legacy=0x7fb9bc0c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:01.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9ba000640 1 -- 172.21.15.114:0/3178813017 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc14f6f0 con 0x7fb9bc0a7dd0 2024-02-17T12:20:01.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.620+0000 7fb9ba000640 1 --2- 172.21.15.114:0/3178813017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0a7dd0 0x7fb9bc0c1ff0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0c3ff0 tx=0x7fb9a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2194bbfa512fea02 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:01.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9b9600640 1 -- 172.21.15.114:0/3178813017 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40ab600 con 0x7fb9bc0a7dd0 2024-02-17T12:20:01.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9b9600640 1 -- 172.21.15.114:0/3178813017 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a40a7050 con 0x7fb9bc0a7dd0 2024-02-17T12:20:01.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9b9600640 1 -- 172.21.15.114:0/3178813017 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40ab960 con 0x7fb9bc0a7dd0 2024-02-17T12:20:01.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 -- 172.21.15.114:0/3178813017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0a7dd0 msgr2=0x7fb9bc0c1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:01.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 --2- 172.21.15.114:0/3178813017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0a7dd0 0x7fb9bc0c1ff0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0c3ff0 tx=0x7fb9a401c480 comp rx=0 tx=0).stop 2024-02-17T12:20:01.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 -- 172.21.15.114:0/3178813017 shutdown_connections 2024-02-17T12:20:01.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 --2- 172.21.15.114:0/3178813017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0a7dd0 0x7fb9bc0c1ff0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:01.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 --2- 172.21.15.114:0/3178813017 >> v2:172.21.15.116:3300/0 conn(0x7fb9bc14f310 0x7fb9bc1524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:01.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 -- 172.21.15.114:0/3178813017 >> 172.21.15.114:0/3178813017 conn(0x7fb9bc06b210 msgr2=0x7fb9bc06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:01.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 -- 172.21.15.114:0/3178813017 shutdown_connections 2024-02-17T12:20:01.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 -- 172.21.15.114:0/3178813017 wait complete. 2024-02-17T12:20:01.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 Processor -- start 2024-02-17T12:20:01.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 -- start start 2024-02-17T12:20:01.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9bc0a7dd0 0x7fb9bc146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:01.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0c2530 0x7fb9bc1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:01.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9bc14f310 0x7fb9bc0c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc1f1990 con 0x7fb9bc0c2530 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc1f1460 con 0x7fb9bc14f310 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9c1e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc149760 con 0x7fb9bc0a7dd0 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9ba000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0c2530 0x7fb9bc1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9ba000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0c2530 0x7fb9bc1469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51836/0 (socket says 172.21.15.114:51836) 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9ba000640 1 -- 172.21.15.114:0/1853725198 learned_addr learned my addr 172.21.15.114:0/1853725198 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9baa00640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9bc0a7dd0 0x7fb9bc146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9bb400640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9bc14f310 0x7fb9bc0c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9ba000640 1 -- 172.21.15.114:0/1853725198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9bc0a7dd0 msgr2=0x7fb9bc146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9ba000640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9bc0a7dd0 0x7fb9bc146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9ba000640 1 -- 172.21.15.114:0/1853725198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9bc14f310 msgr2=0x7fb9bc0c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9ba000640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9bc14f310 0x7fb9bc0c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:01.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9ba000640 1 -- 172.21.15.114:0/1853725198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4009420 con 0x7fb9bc0c2530 2024-02-17T12:20:01.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9baa00640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9bc0a7dd0 0x7fb9bc146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:20:01.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.624+0000 7fb9bb400640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9bc14f310 0x7fb9bc0c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:20:01.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9ba000640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0c2530 0x7fb9bc1469b0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40ae040 tx=0x7fb9a4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:01.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9b3400640 1 -- 172.21.15.114:0/1853725198 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40b4430 con 0x7fb9bc0c2530 2024-02-17T12:20:01.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9b3400640 1 -- 172.21.15.114:0/1853725198 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a40b4590 con 0x7fb9bc0c2530 2024-02-17T12:20:01.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9c1e00640 1 -- 172.21.15.114:0/1853725198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9bc1f16b0 con 0x7fb9bc0c2530 2024-02-17T12:20:01.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9b3400640 1 -- 172.21.15.114:0/1853725198 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40b4900 con 0x7fb9bc0c2530 2024-02-17T12:20:01.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9c1e00640 1 -- 172.21.15.114:0/1853725198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9bc0a9590 con 0x7fb9bc0c2530 2024-02-17T12:20:01.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9c1e00640 1 -- 172.21.15.114:0/1853725198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9bc1495c0 con 0x7fb9bc0c2530 2024-02-17T12:20:01.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9b3400640 1 -- 172.21.15.114:0/1853725198 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb9a40b2040 con 0x7fb9bc0c2530 2024-02-17T12:20:01.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9b3400640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb998066e40 0x7fb998069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:01.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9b3400640 1 -- 172.21.15.114:0/1853725198 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fb9a411ea90 con 0x7fb9bc0c2530 2024-02-17T12:20:01.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.628+0000 7fb9baa00640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb998066e40 0x7fb998069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:01.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.632+0000 7fb9baa00640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb998066e40 0x7fb998069300 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac003fd0 tx=0x7fb9ac0039e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:01.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.632+0000 7fb9b3400640 1 -- 172.21.15.114:0/1853725198 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb9bc1495c0 con 0x7fb9bc0c2530 2024-02-17T12:20:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:01.788+0000 7fb9c1e00640 1 -- 172.21.15.114:0/1853725198 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9bc1495c0 con 0x7fb9bc0c2530 2024-02-17T12:20:02.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9b3400640 1 -- 172.21.15.114:0/1853725198 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v77) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb9bc1495c0 con 0x7fb9bc0c2530 2024-02-17T12:20:02.416 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_metadata' removed 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9c1e00640 1 -- 172.21.15.114:0/1853725198 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb998066e40 msgr2=0x7fb998069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9c1e00640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb998066e40 0x7fb998069300 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac003fd0 tx=0x7fb9ac0039e0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9c1e00640 1 -- 172.21.15.114:0/1853725198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0c2530 msgr2=0x7fb9bc1469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9c1e00640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0c2530 0x7fb9bc1469b0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fb9a40ae040 tx=0x7fb9a4019220 comp rx=0 tx=0).stop 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9c1e00640 1 -- 172.21.15.114:0/1853725198 shutdown_connections 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9c1e00640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9bc14f310 0x7fb9bc0c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9c1e00640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb998066e40 0x7fb998069300 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9c1e00640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9bc0c2530 0x7fb9bc1469b0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9c1e00640 1 --2- 172.21.15.114:0/1853725198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9bc0a7dd0 0x7fb9bc146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.412+0000 7fb9c1e00640 1 -- 172.21.15.114:0/1853725198 >> 172.21.15.114:0/1853725198 conn(0x7fb9bc06b210 msgr2=0x7fb9bc0c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.416+0000 7fb9c1e00640 1 -- 172.21.15.114:0/1853725198 shutdown_connections 2024-02-17T12:20:02.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.416+0000 7fb9c1e00640 1 -- 172.21.15.114:0/1853725198 wait complete. 2024-02-17T12:20:02.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-02-17T12:20:02.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9cb600640 1 Processor -- start 2024-02-17T12:20:02.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9cb600640 1 -- start start 2024-02-17T12:20:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9cb600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 0x7fb9c4158d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9cb600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9c4072dd0 0x7fb9c41557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9cb600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb9c40c60f0 0x7fb9c406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9cb600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c4158320 con 0x7fb9c4072dd0 2024-02-17T12:20:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9cb600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c41588e0 con 0x7fb9c40c60f0 2024-02-17T12:20:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9cb600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41592b0 con 0x7fb9c4152300 2024-02-17T12:20:02.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9c4072dd0 0x7fb9c41557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9c4072dd0 0x7fb9c41557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51848/0 (socket says 172.21.15.114:51848) 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c3e00640 1 -- 172.21.15.114:0/2947632370 learned_addr learned my addr 172.21.15.114:0/2947632370 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c8c00640 1 --2- 172.21.15.114:0/2947632370 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 0x7fb9c4158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c9600640 1 --2- 172.21.15.114:0/2947632370 >> v2:172.21.15.116:3300/0 conn(0x7fb9c40c60f0 0x7fb9c406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c3e00640 1 -- 172.21.15.114:0/2947632370 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 msgr2=0x7fb9c4158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c3e00640 1 --2- 172.21.15.114:0/2947632370 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 0x7fb9c4158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c3e00640 1 -- 172.21.15.114:0/2947632370 >> v2:172.21.15.116:3300/0 conn(0x7fb9c40c60f0 msgr2=0x7fb9c406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c3e00640 1 --2- 172.21.15.114:0/2947632370 >> v2:172.21.15.116:3300/0 conn(0x7fb9c40c60f0 0x7fb9c406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c3e00640 1 -- 172.21.15.114:0/2947632370 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c4155cf0 con 0x7fb9c4072dd0 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c8c00640 1 --2- 172.21.15.114:0/2947632370 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 0x7fb9c4158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:02.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.584+0000 7fb9c9600640 1 --2- 172.21.15.114:0/2947632370 >> v2:172.21.15.116:3300/0 conn(0x7fb9c40c60f0 0x7fb9c406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:02.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9c3e00640 1 --2- 172.21.15.114:0/2947632370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 0x7fb9c41557b0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40709c0 tx=0x7fb9b001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4b6a160f189ae5 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9c3400640 1 -- 172.21.15.114:0/2947632370 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00ad640 con 0x7fb9c4072dd0 2024-02-17T12:20:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9c3400640 1 -- 172.21.15.114:0/2947632370 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b00ad7a0 con 0x7fb9c4072dd0 2024-02-17T12:20:02.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9c3400640 1 -- 172.21.15.114:0/2947632370 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00adb30 con 0x7fb9c4072dd0 2024-02-17T12:20:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9cb600640 1 -- 172.21.15.114:0/2947632370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 msgr2=0x7fb9c41557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9cb600640 1 --2- 172.21.15.114:0/2947632370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 0x7fb9c41557b0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40709c0 tx=0x7fb9b001c3d0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9cb600640 1 -- 172.21.15.114:0/2947632370 shutdown_connections 2024-02-17T12:20:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9cb600640 1 --2- 172.21.15.114:0/2947632370 >> v2:172.21.15.116:3300/0 conn(0x7fb9c40c60f0 0x7fb9c406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9cb600640 1 --2- 172.21.15.114:0/2947632370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 0x7fb9c41557b0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9cb600640 1 --2- 172.21.15.114:0/2947632370 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 0x7fb9c4158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9cb600640 1 -- 172.21.15.114:0/2947632370 >> 172.21.15.114:0/2947632370 conn(0x7fb9c40c7600 msgr2=0x7fb9c40c7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9cb600640 1 -- 172.21.15.114:0/2947632370 shutdown_connections 2024-02-17T12:20:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.588+0000 7fb9cb600640 1 -- 172.21.15.114:0/2947632370 wait complete. 2024-02-17T12:20:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9cb600640 1 Processor -- start 2024-02-17T12:20:02.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9cb600640 1 -- start start 2024-02-17T12:20:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9cb600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 0x7fb9c414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9cb600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c40c60f0 0x7fb9c41f1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9cb600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 0x7fb9c406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9cb600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c4155110 con 0x7fb9c4072dd0 2024-02-17T12:20:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9cb600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c414f8d0 con 0x7fb9c40c60f0 2024-02-17T12:20:02.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9cb600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41f1990 con 0x7fb9c4152300 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 0x7fb9c414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 0x7fb9c414b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51854/0 (socket says 172.21.15.114:51854) 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c8c00640 1 -- 172.21.15.114:0/766913961 learned_addr learned my addr 172.21.15.114:0/766913961 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c3e00640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c40c60f0 0x7fb9c41f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c9600640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 0x7fb9c406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c8c00640 1 -- 172.21.15.114:0/766913961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 msgr2=0x7fb9c406ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c8c00640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 0x7fb9c406ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c8c00640 1 -- 172.21.15.114:0/766913961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c40c60f0 msgr2=0x7fb9c41f1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c8c00640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c40c60f0 0x7fb9c41f1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c8c00640 1 -- 172.21.15.114:0/766913961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b00094d0 con 0x7fb9c4072dd0 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c3e00640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c40c60f0 0x7fb9c41f1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c9600640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 0x7fb9c406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:02.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c8c00640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 0x7fb9c414b090 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400ce00 tx=0x7fb9b400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c0c00640 1 -- 172.21.15.114:0/766913961 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400f680 con 0x7fb9c4072dd0 2024-02-17T12:20:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c0c00640 1 -- 172.21.15.114:0/766913961 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b400f7e0 con 0x7fb9c4072dd0 2024-02-17T12:20:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9c0c00640 1 -- 172.21.15.114:0/766913961 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400fbb0 con 0x7fb9c4072dd0 2024-02-17T12:20:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9cb600640 1 -- 172.21.15.114:0/766913961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c4154b50 con 0x7fb9c4072dd0 2024-02-17T12:20:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.592+0000 7fb9cb600640 1 -- 172.21.15.114:0/766913961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c41f0c50 con 0x7fb9c4072dd0 2024-02-17T12:20:02.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.596+0000 7fb9cb600640 1 -- 172.21.15.114:0/766913961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c41f0ab0 con 0x7fb9c4072dd0 2024-02-17T12:20:02.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.596+0000 7fb9c0c00640 1 -- 172.21.15.114:0/766913961 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fb9b400b040 con 0x7fb9c4072dd0 2024-02-17T12:20:02.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.596+0000 7fb9c0c00640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9a4066e40 0x7fb9a4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:02.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.596+0000 7fb9c0c00640 1 -- 172.21.15.114:0/766913961 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5445+0+0 (secure 0 0 0) 0x7fb9b40852d0 con 0x7fb9c4072dd0 2024-02-17T12:20:02.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.596+0000 7fb9c3e00640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9a4066e40 0x7fb9a4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:02.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.596+0000 7fb9c3e00640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9a4066e40 0x7fb9a4069300 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00af000 tx=0x7fb9b00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:02.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.600+0000 7fb9c0c00640 1 -- 172.21.15.114:0/766913961 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb9c41f0ab0 con 0x7fb9c4072dd0 2024-02-17T12:20:02.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:02.756+0000 7fb9cb600640 1 -- 172.21.15.114:0/766913961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9c41f0ab0 con 0x7fb9c4072dd0 2024-02-17T12:20:03.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.420+0000 7fb9c0c00640 1 -- 172.21.15.114:0/766913961 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v78) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb9c41f0ab0 con 0x7fb9c4072dd0 2024-02-17T12:20:03.425 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs2_data' removed 2024-02-17T12:20:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 -- 172.21.15.114:0/766913961 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9a4066e40 msgr2=0x7fb9a4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9a4066e40 0x7fb9a4069300 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00af000 tx=0x7fb9b00a7070 comp rx=0 tx=0).stop 2024-02-17T12:20:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 -- 172.21.15.114:0/766913961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 msgr2=0x7fb9c414b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 0x7fb9c414b090 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400ce00 tx=0x7fb9b400a650 comp rx=0 tx=0).stop 2024-02-17T12:20:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 -- 172.21.15.114:0/766913961 shutdown_connections 2024-02-17T12:20:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9c4152300 0x7fb9c406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9c40c60f0 0x7fb9c41f1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fb9a4066e40 0x7fb9a4069300 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 --2- 172.21.15.114:0/766913961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9c4072dd0 0x7fb9c414b090 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 -- 172.21.15.114:0/766913961 >> 172.21.15.114:0/766913961 conn(0x7fb9c40c7600 msgr2=0x7fb9c4151610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:03.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 -- 172.21.15.114:0/766913961 shutdown_connections 2024-02-17T12:20:03.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.424+0000 7fb9cb600640 1 -- 172.21.15.114:0/766913961 wait complete. 2024-02-17T12:20:03.452 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-02-17T12:20:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.584+0000 7f3569a00640 1 Processor -- start 2024-02-17T12:20:03.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.584+0000 7f3569a00640 1 -- start start 2024-02-17T12:20:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3569a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f356414f110 0x7f35640c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3569a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f35640c2580 0x7f35640aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3569a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35640a9420 con 0x7f35640c1eb0 2024-02-17T12:20:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3569a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356414f4f0 con 0x7f356414f110 2024-02-17T12:20:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3569a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35640aae80 con 0x7f35640c2580 2024-02-17T12:20:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3562a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f356414f110 0x7f35640c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3562a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f356414f110 0x7f35640c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51864/0 (socket says 172.21.15.114:51864) 2024-02-17T12:20:03.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3562a00640 1 -- 172.21.15.114:0/250738090 learned_addr learned my addr 172.21.15.114:0/250738090 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3562000640 1 --2- 172.21.15.114:0/250738090 >> v2:172.21.15.116:3300/0 conn(0x7f35640c2580 0x7f35640aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3562a00640 1 -- 172.21.15.114:0/250738090 >> v2:172.21.15.116:3300/0 conn(0x7f35640c2580 msgr2=0x7f35640aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3562a00640 1 --2- 172.21.15.114:0/250738090 >> v2:172.21.15.116:3300/0 conn(0x7f35640c2580 0x7f35640aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3562a00640 1 -- 172.21.15.114:0/250738090 >> v1:172.21.15.116:6789/0 conn(0x7f35640c1eb0 legacy=0x7f3564155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:03.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.588+0000 7f3562a00640 1 -- 172.21.15.114:0/250738090 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3564152850 con 0x7f356414f110 2024-02-17T12:20:03.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3562a00640 1 --2- 172.21.15.114:0/250738090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 0x7f35640c65a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f356406f0d0 tx=0x7f355401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c99c50d544a3393 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:03.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3561600640 1 -- 172.21.15.114:0/250738090 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540a57b0 con 0x7f356414f110 2024-02-17T12:20:03.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3561600640 1 -- 172.21.15.114:0/250738090 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35540a5910 con 0x7f356414f110 2024-02-17T12:20:03.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3561600640 1 -- 172.21.15.114:0/250738090 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540a5ca0 con 0x7f356414f110 2024-02-17T12:20:03.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 -- 172.21.15.114:0/250738090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 msgr2=0x7f35640c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 --2- 172.21.15.114:0/250738090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 0x7f35640c65a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f356406f0d0 tx=0x7f355401c8f0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 -- 172.21.15.114:0/250738090 shutdown_connections 2024-02-17T12:20:03.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 --2- 172.21.15.114:0/250738090 >> v2:172.21.15.116:3300/0 conn(0x7f35640c2580 0x7f35640aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 --2- 172.21.15.114:0/250738090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f356414f110 0x7f35640c65a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 -- 172.21.15.114:0/250738090 >> 172.21.15.114:0/250738090 conn(0x7f35640a8490 msgr2=0x7f35640a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:03.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 -- 172.21.15.114:0/250738090 shutdown_connections 2024-02-17T12:20:03.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 -- 172.21.15.114:0/250738090 wait complete. 2024-02-17T12:20:03.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 Processor -- start 2024-02-17T12:20:03.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 -- start start 2024-02-17T12:20:03.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c1eb0 0x7f3564145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 0x7f3564142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f356414f110 0x7f35640c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35640c4af0 con 0x7f35640c2580 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35640c5bd0 con 0x7f35640c1eb0 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.592+0000 7f3569a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356414e580 con 0x7f356414f110 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 0x7f3564142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 0x7f3564142720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51872/0 (socket says 172.21.15.114:51872) 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562000640 1 -- 172.21.15.114:0/2127161187 learned_addr learned my addr 172.21.15.114:0/2127161187 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562a00640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c1eb0 0x7f3564145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3563400640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f356414f110 0x7f35640c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562000640 1 -- 172.21.15.114:0/2127161187 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f356414f110 msgr2=0x7f35640c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562000640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f356414f110 0x7f35640c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562000640 1 -- 172.21.15.114:0/2127161187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c1eb0 msgr2=0x7f3564145550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562000640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c1eb0 0x7f3564145550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562000640 1 -- 172.21.15.114:0/2127161187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554009b30 con 0x7f35640c2580 2024-02-17T12:20:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562000640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 0x7f3564142720 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f354c00d800 tx=0x7f354c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f355aa00640 1 -- 172.21.15.114:0/2127161187 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c00b6c0 con 0x7f35640c2580 2024-02-17T12:20:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f355aa00640 1 -- 172.21.15.114:0/2127161187 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c00b820 con 0x7f35640c2580 2024-02-17T12:20:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3569a00640 1 -- 172.21.15.114:0/2127161187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356406f250 con 0x7f35640c2580 2024-02-17T12:20:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f355aa00640 1 -- 172.21.15.114:0/2127161187 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c00bbd0 con 0x7f35640c2580 2024-02-17T12:20:03.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3569a00640 1 -- 172.21.15.114:0/2127161187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35640c60a0 con 0x7f35640c2580 2024-02-17T12:20:03.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3569a00640 1 -- 172.21.15.114:0/2127161187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3564074840 con 0x7f35640c2580 2024-02-17T12:20:03.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f355aa00640 1 -- 172.21.15.114:0/2127161187 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f354c00bd30 con 0x7f35640c2580 2024-02-17T12:20:03.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f355aa00640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3540066e40 0x7f3540069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f355aa00640 1 -- 172.21.15.114:0/2127161187 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f354c084c50 con 0x7f35640c2580 2024-02-17T12:20:03.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.596+0000 7f3562a00640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3540066e40 0x7f3540069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.600+0000 7f3562a00640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3540066e40 0x7f3540069300 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f35540ae000 tx=0x7f35540a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:03.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.604+0000 7f355aa00640 1 -- 172.21.15.114:0/2127161187 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f354c051cd0 con 0x7f35640c2580 2024-02-17T12:20:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.760+0000 7f3569a00640 1 -- 172.21.15.114:0/2127161187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f356414e6c0 con 0x7f35640c2580 2024-02-17T12:20:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f355aa00640 1 -- 172.21.15.114:0/2127161187 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f354c055390 con 0x7f35640c2580 2024-02-17T12:20:03.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 -- 172.21.15.114:0/2127161187 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3540066e40 msgr2=0x7f3540069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3540066e40 0x7f3540069300 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f35540ae000 tx=0x7f35540a7070 comp rx=0 tx=0).stop 2024-02-17T12:20:03.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 -- 172.21.15.114:0/2127161187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 msgr2=0x7f3564142720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 0x7f3564142720 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f354c00d800 tx=0x7f354c00dcc0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 -- 172.21.15.114:0/2127161187 shutdown_connections 2024-02-17T12:20:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f356414f110 0x7f35640c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f3540066e40 0x7f3540069300 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35640c2580 0x7f3564142720 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 --2- 172.21.15.114:0/2127161187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f35640c1eb0 0x7f3564145550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 -- 172.21.15.114:0/2127161187 >> 172.21.15.114:0/2127161187 conn(0x7f35640a8490 msgr2=0x7f35640c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 -- 172.21.15.114:0/2127161187 shutdown_connections 2024-02-17T12:20:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.764+0000 7f3569a00640 1 -- 172.21.15.114:0/2127161187 wait complete. 2024-02-17T12:20:03.788 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2024-02-17T12:20:03.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b0de00640 1 Processor -- start 2024-02-17T12:20:03.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b0de00640 1 -- start start 2024-02-17T12:20:03.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b0de00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9b080c25a0 0x7f9b0806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b0de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b08152c50 0x7f9b081530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b0de00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b08156270 con 0x7f9b0806db50 2024-02-17T12:20:03.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b0de00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b08071630 con 0x7f9b080c25a0 2024-02-17T12:20:03.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b0de00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08156550 con 0x7f9b08152c50 2024-02-17T12:20:03.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b07400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b08152c50 0x7f9b081530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b07400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b08152c50 0x7f9b081530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:39180/0 (socket says 172.21.15.114:39180) 2024-02-17T12:20:03.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b07400640 1 -- 172.21.15.114:0/429066960 learned_addr learned my addr 172.21.15.114:0/429066960 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:03.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b06000640 1 --1- 172.21.15.114:0/429066960 >> v1:172.21.15.116:6789/0 conn(0x7f9b0806db50 0x7f9b0814ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:42476/0 (socket says 172.21.15.114:42476) 2024-02-17T12:20:03.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.920+0000 7f9b06a00640 1 --2- 172.21.15.114:0/429066960 >> v2:172.21.15.116:3300/0 conn(0x7f9b080c25a0 0x7f9b0806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b06a00640 1 -- 172.21.15.114:0/429066960 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b08152c50 msgr2=0x7f9b081530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:03.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b06a00640 1 --2- 172.21.15.114:0/429066960 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b08152c50 0x7f9b081530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b06a00640 1 -- 172.21.15.114:0/429066960 >> v1:172.21.15.116:6789/0 conn(0x7f9b0806db50 legacy=0x7f9b0814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b06a00640 1 -- 172.21.15.114:0/429066960 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08156830 con 0x7f9b080c25a0 2024-02-17T12:20:03.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b05600640 1 -- 172.21.15.114:0/429066960 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266910117 0 0) 0x7f9b08156270 con 0x7f9b0806db50 2024-02-17T12:20:03.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b06a00640 1 --2- 172.21.15.114:0/429066960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b080c25a0 0x7f9b0806e980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9af80097c0 tx=0x7f9af801c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea5bf4aa4ccb79ab server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:03.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b05600640 1 -- 172.21.15.114:0/429066960 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80ab600 con 0x7f9b080c25a0 2024-02-17T12:20:03.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b05600640 1 -- 172.21.15.114:0/429066960 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af80a7050 con 0x7f9b080c25a0 2024-02-17T12:20:03.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b05600640 1 -- 172.21.15.114:0/429066960 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80ab980 con 0x7f9b080c25a0 2024-02-17T12:20:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b0de00640 1 -- 172.21.15.114:0/429066960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b080c25a0 msgr2=0x7f9b0806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b0de00640 1 --2- 172.21.15.114:0/429066960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b080c25a0 0x7f9b0806e980 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9af80097c0 tx=0x7f9af801c350 comp rx=0 tx=0).stop 2024-02-17T12:20:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b0de00640 1 -- 172.21.15.114:0/429066960 shutdown_connections 2024-02-17T12:20:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b0de00640 1 --2- 172.21.15.114:0/429066960 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b08152c50 0x7f9b081530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b0de00640 1 --2- 172.21.15.114:0/429066960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b080c25a0 0x7f9b0806e980 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b0de00640 1 -- 172.21.15.114:0/429066960 >> 172.21.15.114:0/429066960 conn(0x7f9b080a8490 msgr2=0x7f9b080a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:03.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.924+0000 7f9b0de00640 1 -- 172.21.15.114:0/429066960 shutdown_connections 2024-02-17T12:20:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 -- 172.21.15.114:0/429066960 wait complete. 2024-02-17T12:20:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 Processor -- start 2024-02-17T12:20:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 -- start start 2024-02-17T12:20:03.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b0806db50 0x7f9b080aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b080c25a0 0x7f9b080bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b08152c50 0x7f9b081ed370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0814a090 con 0x7f9b08152c50 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08147690 con 0x7f9b080c25a0 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b080ab4f0 con 0x7f9b0806db50 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b07400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b08152c50 0x7f9b081ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b07400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b08152c50 0x7f9b081ed370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51878/0 (socket says 172.21.15.114:51878) 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b07400640 1 -- 172.21.15.114:0/2764299942 learned_addr learned my addr 172.21.15.114:0/2764299942 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b06000640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b080c25a0 0x7f9b080bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b06a00640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b0806db50 0x7f9b080aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b07400640 1 -- 172.21.15.114:0/2764299942 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b0806db50 msgr2=0x7f9b080aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b07400640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b0806db50 0x7f9b080aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b07400640 1 -- 172.21.15.114:0/2764299942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b080c25a0 msgr2=0x7f9b080bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b07400640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b080c25a0 0x7f9b080bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b07400640 1 -- 172.21.15.114:0/2764299942 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8009420 con 0x7f9b08152c50 2024-02-17T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b07400640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b08152c50 0x7f9b081ed370 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000efc0 tx=0x7f9b0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9aff400640 1 -- 172.21.15.114:0/2764299942 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00009b60 con 0x7f9b08152c50 2024-02-17T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9aff400640 1 -- 172.21.15.114:0/2764299942 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0000f040 con 0x7f9b08152c50 2024-02-17T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 -- 172.21.15.114:0/2764299942 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b080ab270 con 0x7f9b08152c50 2024-02-17T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9aff400640 1 -- 172.21.15.114:0/2764299942 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000039a0 con 0x7f9b08152c50 2024-02-17T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.928+0000 7f9b0de00640 1 -- 172.21.15.114:0/2764299942 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b081f09f0 con 0x7f9b08152c50 2024-02-17T12:20:03.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.932+0000 7f9b0de00640 1 -- 172.21.15.114:0/2764299942 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b08074840 con 0x7f9b08152c50 2024-02-17T12:20:03.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.932+0000 7f9aff400640 1 -- 172.21.15.114:0/2764299942 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f9b00003b00 con 0x7f9b08152c50 2024-02-17T12:20:03.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.932+0000 7f9aff400640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ae8066e40 0x7f9ae8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:03.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.932+0000 7f9aff400640 1 -- 172.21.15.114:0/2764299942 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9b00084d70 con 0x7f9b08152c50 2024-02-17T12:20:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.932+0000 7f9b06a00640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ae8066e40 0x7f9ae8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.932+0000 7f9b06a00640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ae8066e40 0x7f9ae8069300 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9af80ad000 tx=0x7f9af8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:03.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:03.936+0000 7f9aff400640 1 -- 172.21.15.114:0/2764299942 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9b00051df0 con 0x7f9b08152c50 2024-02-17T12:20:04.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.144+0000 7f9b0de00640 1 -- 172.21.15.114:0/2764299942 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f9b080a8bf0 con 0x7f9b08152c50 2024-02-17T12:20:04.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9aff400640 1 -- 172.21.15.114:0/2764299942 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v233) v1 ==== 159+0+0 (secure 0 0 0) 0x7f9b00003db0 con 0x7f9b08152c50 2024-02-17T12:20:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 -- 172.21.15.114:0/2764299942 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ae8066e40 msgr2=0x7f9ae8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ae8066e40 0x7f9ae8069300 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9af80ad000 tx=0x7f9af8008040 comp rx=0 tx=0).stop 2024-02-17T12:20:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 -- 172.21.15.114:0/2764299942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b08152c50 msgr2=0x7f9b081ed370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b08152c50 0x7f9b081ed370 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000efc0 tx=0x7f9b0000c490 comp rx=0 tx=0).stop 2024-02-17T12:20:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 -- 172.21.15.114:0/2764299942 shutdown_connections 2024-02-17T12:20:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9ae8066e40 0x7f9ae8069300 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b08152c50 0x7f9b081ed370 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b080c25a0 0x7f9b080bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 --2- 172.21.15.114:0/2764299942 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9b0806db50 0x7f9b080aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 -- 172.21.15.114:0/2764299942 >> 172.21.15.114:0/2764299942 conn(0x7f9b080a8490 msgr2=0x7f9b0806b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 -- 172.21.15.114:0/2764299942 shutdown_connections 2024-02-17T12:20:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:04.424+0000 7f9b0de00640 1 -- 172.21.15.114:0/2764299942 wait complete. 2024-02-17T12:20:04.451 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner: 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2024-02-17T12:20:04.452 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs/mount.py", line 749, in read_file 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs/mount.py", line 784, in run_shell 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: r.wait() 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner: 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-17T12:20:04.453 INFO:tasks.cephfs_test_runner:Ran 3 tests in 198.788s 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner: 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner: 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2024-02-17T12:20:04.454 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs/mount.py", line 749, in read_file 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs/mount.py", line 784, in run_shell 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: r.wait() 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi114 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2024-02-17T12:20:04.455 INFO:tasks.cephfs_test_runner: 2024-02-17T12:20:04.456 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-02-17T12:20:04.673 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=eca273c69c4b4179b5d39c8c5420ef07 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_6822c7b54e949006be7a0802650d01723d834d1d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-02-17T12:20:04.674 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-02-17T12:20:04.685 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-17T12:20:04.694 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-17T12:20:04.694 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-02-17T12:20:04.694 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:20:04.718 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354568k,nr_inodes=4088642,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2004 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-17T12:20:04.719 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-02-17T12:20:04.719 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-17T12:20:04.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3897 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-02-17T12:20:04.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:20:04.729 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-02-17T12:20:04.770 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-17T12:20:04.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:20:04.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-17T12:20:04.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:20:04.834 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-02-17T12:20:05.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:20:05.020 DEBUG:teuthology.orchestra.run.smithi116:> ip netns list 2024-02-17T12:20:05.029 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-17T12:20:05.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:20:05.030 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-17T12:20:05.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-17T12:20:05.101 DEBUG:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2024-02-17T12:20:05.312 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-17T12:20:05.321 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-17T12:20:05.322 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:20:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efce1400640 1 Processor -- start 2024-02-17T12:20:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efce1400640 1 -- start start 2024-02-17T12:20:05.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efce1400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc06db50 0x7efcdc14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efce1400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc156270 con 0x7efcdc150490 2024-02-17T12:20:05.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efce1400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc156550 con 0x7efcdc0c25a0 2024-02-17T12:20:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efce1400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc06f090 con 0x7efcdc06db50 2024-02-17T12:20:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcdb200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efcdc150490 0x7efcdc152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48200/0 (socket says 172.21.15.114:48200) 2024-02-17T12:20:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcdb200640 1 -- 172.21.15.114:0/1341474703 learned_addr learned my addr 172.21.15.114:0/1341474703 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9e00640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc06db50 0x7efcdc14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945262495 0 0) 0x7efcdc156270 con 0x7efcdc150490 2024-02-17T12:20:05.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc0003530 con 0x7efcdc150490 2024-02-17T12:20:05.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173634969 0 0) 0x7efcdc156550 con 0x7efcdc0c25a0 2024-02-17T12:20:05.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcdc156270 con 0x7efcdc0c25a0 2024-02-17T12:20:05.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2993693578 0 0) 0x7efcc0003530 con 0x7efcdc150490 2024-02-17T12:20:05.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc06db50 msgr2=0x7efcdc14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:05.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc06db50 0x7efcdc14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 >> v1:172.21.15.116:6789/0 conn(0x7efcdc0c25a0 legacy=0x7efcdc06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc156830 con 0x7efcdc150490 2024-02-17T12:20:05.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7efcd4001680 con 0x7efcdc150490 2024-02-17T12:20:05.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 >> v1:172.21.15.114:6789/0 conn(0x7efcdc150490 legacy=0x7efcdc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc0003b40 0x7efcc0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc06db50 0x7efcc00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc0004d10 0x7efcc0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc06f090 con 0x7efcc0004d10 2024-02-17T12:20:05.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc000bba0 con 0x7efcc0003b40 2024-02-17T12:20:05.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc000bd60 con 0x7efcdc06db50 2024-02-17T12:20:05.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcda800640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc0003b40 0x7efcc0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcd9e00640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc06db50 0x7efcc00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.460+0000 7efcdb200640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc0004d10 0x7efcc0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcd9e00640 1 -- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc0003b40 msgr2=0x7efcc0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:05.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcd9e00640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc0003b40 0x7efcc0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcd9e00640 1 -- 172.21.15.114:0/1341474703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc0004d10 msgr2=0x7efcc0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:05.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcd9e00640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcc0004d10 0x7efcc0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcd9e00640 1 -- 172.21.15.114:0/1341474703 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0003530 con 0x7efcdc06db50 2024-02-17T12:20:05.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcda800640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcc0003b40 0x7efcc0003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:20:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcd9e00640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc06db50 0x7efcc00047d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009ae0 tx=0x7efcc401cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f471f3c6f8b31966 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40a5590 con 0x7efcdc06db50 2024-02-17T12:20:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc40a56f0 con 0x7efcdc06db50 2024-02-17T12:20:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcd9400640 1 -- 172.21.15.114:0/1341474703 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40a5aa0 con 0x7efcdc06db50 2024-02-17T12:20:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efce1400640 1 -- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc06db50 msgr2=0x7efcc00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efce1400640 1 --2- 172.21.15.114:0/1341474703 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc06db50 0x7efcc00047d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009ae0 tx=0x7efcc401cab0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efcdb200640 1 -- 172.21.15.114:0/1341474703 reap_dead start 2024-02-17T12:20:05.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efce1400640 1 -- 172.21.15.114:0/1341474703 shutdown_connections 2024-02-17T12:20:05.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efce1400640 1 -- 172.21.15.114:0/1341474703 >> 172.21.15.114:0/1341474703 conn(0x7efcdc0a8490 msgr2=0x7efcdc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:05.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efce1400640 1 -- 172.21.15.114:0/1341474703 shutdown_connections 2024-02-17T12:20:05.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.464+0000 7efce1400640 1 -- 172.21.15.114:0/1341474703 wait complete. 2024-02-17T12:20:05.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efce1400640 1 Processor -- start 2024-02-17T12:20:05.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efce1400640 1 -- start start 2024-02-17T12:20:05.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efce1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc06db50 0x7efcdc1552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efce1400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcdc14f540 0x7efcdc1eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efce1400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc146920 0x7efcdc1ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efce1400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc1eba10 con 0x7efcdc06db50 2024-02-17T12:20:05.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efce1400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc14f9c0 con 0x7efcdc14f540 2024-02-17T12:20:05.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efce1400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc155ee0 con 0x7efcdc146920 2024-02-17T12:20:05.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcda800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc06db50 0x7efcdc1552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcda800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc06db50 0x7efcdc1552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50212/0 (socket says 172.21.15.114:50212) 2024-02-17T12:20:05.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcda800640 1 -- 172.21.15.114:0/3576829151 learned_addr learned my addr 172.21.15.114:0/3576829151 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:05.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcdb200640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc146920 0x7efcdc1ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcd9e00640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcdc14f540 0x7efcdc1eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcda800640 1 -- 172.21.15.114:0/3576829151 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc146920 msgr2=0x7efcdc1ebea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcda800640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc146920 0x7efcdc1ebea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcda800640 1 -- 172.21.15.114:0/3576829151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcdc14f540 msgr2=0x7efcdc1eeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcda800640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcdc14f540 0x7efcdc1eeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcda800640 1 -- 172.21.15.114:0/3576829151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc155920 con 0x7efcdc06db50 2024-02-17T12:20:05.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcda800640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc06db50 0x7efcdc1552d0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7efccc007d30 tx=0x7efccc00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:05.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcd2a00640 1 -- 172.21.15.114:0/3576829151 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc00dc30 con 0x7efcdc06db50 2024-02-17T12:20:05.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcd2a00640 1 -- 172.21.15.114:0/3576829151 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc00dd90 con 0x7efcdc06db50 2024-02-17T12:20:05.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efce1400640 1 -- 172.21.15.114:0/3576829151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc155c00 con 0x7efcdc06db50 2024-02-17T12:20:05.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efcd2a00640 1 -- 172.21.15.114:0/3576829151 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc003ba0 con 0x7efcdc06db50 2024-02-17T12:20:05.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.468+0000 7efce1400640 1 -- 172.21.15.114:0/3576829151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc146da0 con 0x7efcdc06db50 2024-02-17T12:20:05.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.472+0000 7efce1400640 1 -- 172.21.15.114:0/3576829151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc074840 con 0x7efcdc06db50 2024-02-17T12:20:05.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.472+0000 7efcd2a00640 1 -- 172.21.15.114:0/3576829151 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7efccc003d00 con 0x7efcdc06db50 2024-02-17T12:20:05.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.472+0000 7efcd2a00640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcb8066e70 0x7efcb8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.472+0000 7efcd2a00640 1 -- 172.21.15.114:0/3576829151 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7efccc084b30 con 0x7efcdc06db50 2024-02-17T12:20:05.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.472+0000 7efcd9e00640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcb8066e70 0x7efcb8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.472+0000 7efcd9e00640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcb8066e70 0x7efcb8069330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efcc40af000 tx=0x7efcc40046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:05.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.476+0000 7efcd2a00640 1 -- 172.21.15.114:0/3576829151 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efccc051c60 con 0x7efcdc06db50 2024-02-17T12:20:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.632+0000 7efce1400640 1 -- 172.21.15.114:0/3576829151 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efcdc1eb870 con 0x7efcb8066e70 2024-02-17T12:20:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efcd2a00640 1 -- 172.21.15.114:0/3576829151 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50701 (secure 0 0 0) 0x7efcc400f000 con 0x7efcb8066e70 2024-02-17T12:20:05.639 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:20:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:20:05.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 -- 172.21.15.114:0/3576829151 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcb8066e70 msgr2=0x7efcb8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcb8066e70 0x7efcb8069330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efcc40af000 tx=0x7efcc40046d0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 -- 172.21.15.114:0/3576829151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc06db50 msgr2=0x7efcdc1552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc06db50 0x7efcdc1552d0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7efccc007d30 tx=0x7efccc00d520 comp rx=0 tx=0).stop 2024-02-17T12:20:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 -- 172.21.15.114:0/3576829151 shutdown_connections 2024-02-17T12:20:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efcdc146920 0x7efcdc1ebea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efcdc14f540 0x7efcdc1eeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7efcb8066e70 0x7efcb8069330 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 --2- 172.21.15.114:0/3576829151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcdc06db50 0x7efcdc1552d0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 -- 172.21.15.114:0/3576829151 >> 172.21.15.114:0/3576829151 conn(0x7efcdc0a8490 msgr2=0x7efcdc0c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 -- 172.21.15.114:0/3576829151 shutdown_connections 2024-02-17T12:20:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.636+0000 7efce1400640 1 -- 172.21.15.114:0/3576829151 wait complete. 2024-02-17T12:20:05.660 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-02-17T12:20:05.264716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":209,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":253800,"kb_used_data":8508,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720920,"statfs":{"total":773094113280,"available":772834222080,"internally_reserved":0,"allocated":8712192,"data_stored":4511046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12087,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001075"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":275,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-02-17T12:20:02.486123+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:20:02.486123+0000","last_peered":"2024-02-17T12:20:02.486123+0000","last_clean":"2024-02-17T12:20:02.486123+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:20:02.486123+0000","last_undegraded":"2024-02-17T12:20:02.486123+0000","last_fullsized":"2024-02-17T12:20:02.486123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":929792,"data_stored":410041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.627},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97299999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.115,"15min":1.115},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.143,"15min":1.143},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0640000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66800000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":1.734,"15min":1.734},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0840000000000001,"5min":1.804,"15min":1.804},"last":0.433}]},{"osd":5,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.5,"15min":1.5},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1419999999999999,"5min":1.855,"15min":1.855},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.57899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":925696,"data_stored":409459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68600000000000005,"15min":0.68700000000000006},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85099999999999998,"5min":1.103,"15min":1.103},"last":0.69399999999999995}]},{"osd":1,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.84699999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.038}]},{"osd":2,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89700000000000002,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92900000000000005,"5min":1.377,"15min":1.377},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.038,"5min":1.415,"15min":1.415},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80000000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.81799999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89000000000000001,"5min":1.52,"15min":1.52},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.47099999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.84799999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.434,"15min":0.434},"max":{"1min":0.93300000000000005,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92000000000000004,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.004}]}]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57599999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.47899999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54600000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.376},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.014,"5min":1.387,"15min":1.387},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0409999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.502}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.149,"5min":1.714,"15min":1.714},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1339999999999999,"5min":1.744,"15min":1.744},"last":0.66900000000000004}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0980000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.52600000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0720000000000001,"5min":1.575,"15min":1.575},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95099999999999996,"5min":1.321,"15min":1.321},"last":0.75800000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":925696,"data_stored":409527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":1.145,"15min":1.145},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60599999999999998,"15min":0.66600000000000004},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.755},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.626,"15min":0.66100000000000003},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":2.609,"15min":2.609},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.68200000000000005,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.03,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.54700000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.012,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.042,"5min":1.095,"15min":1.095},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.96999999999999997,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.91600000000000004,"15min":0.98999999999999999},"min":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0549999999999999,"5min":5.375,"15min":5.375},"last":0.57399999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.92400000000000004,"15min":0.998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95099999999999996,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":1.629,"15min":1.629},"last":0.59399999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509490,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1519616,"data_stored":1000339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.37},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.434}]},{"osd":2,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58799999999999997,"5min":1.046,"15min":1.046},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66700000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96699999999999997,"5min":1.139,"15min":1.139},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.746,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.071,"15min":1.071},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.095,"15min":1.095},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.008,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.749},"min":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.61799999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542193,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1544192,"data_stored":1012021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97399999999999998,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.80100000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.747}]},{"osd":2,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.50700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.874}]},{"osd":4,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98199999999999998,"5min":1.052,"15min":1.052},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.53800000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81699999999999995,"5min":1.264,"15min":1.264},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89200000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.83499999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.749,"15min":0.755},"min":{"1min":0.61599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96699999999999997,"5min":1.198,"15min":1.198},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48999999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.171,"15min":1.171},"last":0.879}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.621},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1040000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.999,"5min":1.522,"15min":1.522},"last":0.79600000000000004}]},{"osd":5,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.81299999999999994}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":1.228,"15min":1.228},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76700000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":421791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45600000000000002},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.60499999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.179,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.871},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93200000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.59799999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.89100000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.042,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.995,"5min":1.252,"15min":1.252},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0669999999999999,"5min":1.29,"15min":1.29},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1319999999999999,"5min":1.337,"15min":1.337},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:20:05.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:20:05.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.792+0000 7f0627a00640 1 Processor -- start 2024-02-17T12:20:05.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.792+0000 7f0627a00640 1 -- start start 2024-02-17T12:20:05.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.792+0000 7f0627a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06200c25a0 0x7f062006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.792+0000 7f0627a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0620156270 con 0x7f062006db50 2024-02-17T12:20:05.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f0627a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0620156550 con 0x7f0620152c50 2024-02-17T12:20:05.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f0627a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0620071630 con 0x7f06200c25a0 2024-02-17T12:20:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f0625000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06200c25a0 0x7f062006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f061fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f062006db50 0x7f062014ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48210/0 (socket says 172.21.15.114:48210) 2024-02-17T12:20:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f061fe00640 1 -- 172.21.15.114:0/3815702048 learned_addr learned my addr 172.21.15.114:0/3815702048 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f0625000640 1 -- 172.21.15.114:0/3815702048 >> v1:172.21.15.116:6789/0 conn(0x7f0620152c50 legacy=0x7f0620153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f0625000640 1 -- 172.21.15.114:0/3815702048 >> v1:172.21.15.114:6789/0 conn(0x7f062006db50 legacy=0x7f062014ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f0625000640 1 -- 172.21.15.114:0/3815702048 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620156830 con 0x7f06200c25a0 2024-02-17T12:20:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f061f400640 1 -- 172.21.15.114:0/3815702048 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73198271 0 0) 0x7f0620156270 con 0x7f062006db50 2024-02-17T12:20:05.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f0625000640 1 --2- 172.21.15.114:0/3815702048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 0x7f062006e980 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0610009d90 tx=0x7f061001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f7d35bd2ce9caa server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:05.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f061f400640 1 -- 172.21.15.114:0/3815702048 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100a5800 con 0x7f06200c25a0 2024-02-17T12:20:05.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f061f400640 1 -- 172.21.15.114:0/3815702048 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06100a5960 con 0x7f06200c25a0 2024-02-17T12:20:05.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.796+0000 7f061f400640 1 -- 172.21.15.114:0/3815702048 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100a5cf0 con 0x7f06200c25a0 2024-02-17T12:20:05.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 -- 172.21.15.114:0/3815702048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 msgr2=0x7f062006e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 --2- 172.21.15.114:0/3815702048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 0x7f062006e980 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0610009d90 tx=0x7f061001c820 comp rx=0 tx=0).stop 2024-02-17T12:20:05.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 -- 172.21.15.114:0/3815702048 shutdown_connections 2024-02-17T12:20:05.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 --2- 172.21.15.114:0/3815702048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 0x7f062006e980 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 -- 172.21.15.114:0/3815702048 >> 172.21.15.114:0/3815702048 conn(0x7f06200a8490 msgr2=0x7f06200a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:05.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 -- 172.21.15.114:0/3815702048 shutdown_connections 2024-02-17T12:20:05.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 -- 172.21.15.114:0/3815702048 wait complete. 2024-02-17T12:20:05.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 Processor -- start 2024-02-17T12:20:05.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 -- start start 2024-02-17T12:20:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f062006db50 0x7f06200c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 0x7f0620140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0620152c50 0x7f06201509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200c4b10 con 0x7f06200c25a0 2024-02-17T12:20:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06201387a0 con 0x7f062006db50 2024-02-17T12:20:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0627a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0620152990 con 0x7f0620152c50 2024-02-17T12:20:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f061fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 0x7f0620140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f061fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 0x7f0620140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50222/0 (socket says 172.21.15.114:50222) 2024-02-17T12:20:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0625000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f062006db50 0x7f06200c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f061fe00640 1 -- 172.21.15.114:0/2865700028 learned_addr learned my addr 172.21.15.114:0/2865700028 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f0625a00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0620152c50 0x7f06201509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f061fe00640 1 -- 172.21.15.114:0/2865700028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0620152c50 msgr2=0x7f06201509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f061fe00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0620152c50 0x7f06201509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f061fe00640 1 -- 172.21.15.114:0/2865700028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f062006db50 msgr2=0x7f06200c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f061fe00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f062006db50 0x7f06200c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f061fe00640 1 -- 172.21.15.114:0/2865700028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0610009a70 con 0x7f06200c25a0 2024-02-17T12:20:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.800+0000 7f061fe00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 0x7f0620140a80 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f060800c4a0 tx=0x7f060800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f061cc00640 1 -- 172.21.15.114:0/2865700028 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06080074e0 con 0x7f06200c25a0 2024-02-17T12:20:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f061cc00640 1 -- 172.21.15.114:0/2865700028 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0608007640 con 0x7f06200c25a0 2024-02-17T12:20:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f061cc00640 1 -- 172.21.15.114:0/2865700028 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608004a30 con 0x7f06200c25a0 2024-02-17T12:20:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f0627a00640 1 -- 172.21.15.114:0/2865700028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06201526b0 con 0x7f06200c25a0 2024-02-17T12:20:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f0627a00640 1 -- 172.21.15.114:0/2865700028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06201ebd50 con 0x7f06200c25a0 2024-02-17T12:20:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f0627a00640 1 -- 172.21.15.114:0/2865700028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0620074840 con 0x7f06200c25a0 2024-02-17T12:20:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f061cc00640 1 -- 172.21.15.114:0/2865700028 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0608004b90 con 0x7f06200c25a0 2024-02-17T12:20:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f061cc00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05fc066e40 0x7f05fc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f061cc00640 1 -- 172.21.15.114:0/2865700028 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0608083c70 con 0x7f06200c25a0 2024-02-17T12:20:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f0625000640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05fc066e40 0x7f05fc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.804+0000 7f0625000640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05fc066e40 0x7f05fc069300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f06100af000 tx=0x7f06100a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.808+0000 7f061cc00640 1 -- 172.21.15.114:0/2865700028 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0608050da0 con 0x7f06200c25a0 2024-02-17T12:20:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.960+0000 7f0627a00640 1 -- 172.21.15.114:0/2865700028 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06200c2980 con 0x7f05fc066e40 2024-02-17T12:20:05.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.960+0000 7f061cc00640 1 -- 172.21.15.114:0/2865700028 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50701 (secure 0 0 0) 0x7f06100a5720 con 0x7f05fc066e40 2024-02-17T12:20:05.965 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:20:05.965 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:20:05.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 -- 172.21.15.114:0/2865700028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05fc066e40 msgr2=0x7f05fc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05fc066e40 0x7f05fc069300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f06100af000 tx=0x7f06100a7070 comp rx=0 tx=0).stop 2024-02-17T12:20:05.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 -- 172.21.15.114:0/2865700028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 msgr2=0x7f0620140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:05.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 0x7f0620140a80 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f060800c4a0 tx=0x7f060800c960 comp rx=0 tx=0).stop 2024-02-17T12:20:05.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 -- 172.21.15.114:0/2865700028 shutdown_connections 2024-02-17T12:20:05.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0620152c50 0x7f06201509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f05fc066e40 0x7f05fc069300 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06200c25a0 0x7f0620140a80 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 --2- 172.21.15.114:0/2865700028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f062006db50 0x7f06200c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:05.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 -- 172.21.15.114:0/2865700028 >> 172.21.15.114:0/2865700028 conn(0x7f06200a8490 msgr2=0x7f06200a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:05.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 -- 172.21.15.114:0/2865700028 shutdown_connections 2024-02-17T12:20:05.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:05.964+0000 7f0627a00640 1 -- 172.21.15.114:0/2865700028 wait complete. 2024-02-17T12:20:05.985 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-02-17T12:20:05.264716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":209,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":253800,"kb_used_data":8508,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720920,"statfs":{"total":773094113280,"available":772834222080,"internally_reserved":0,"allocated":8712192,"data_stored":4511046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12087,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001075"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":275,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-02-17T12:20:02.486123+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:20:02.486123+0000","last_peered":"2024-02-17T12:20:02.486123+0000","last_clean":"2024-02-17T12:20:02.486123+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:20:02.486123+0000","last_undegraded":"2024-02-17T12:20:02.486123+0000","last_fullsized":"2024-02-17T12:20:02.486123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":929792,"data_stored":410041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.627},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97299999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.115,"15min":1.115},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.143,"15min":1.143},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0640000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66800000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":1.734,"15min":1.734},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0840000000000001,"5min":1.804,"15min":1.804},"last":0.433}]},{"osd":5,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.5,"15min":1.5},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1419999999999999,"5min":1.855,"15min":1.855},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.57899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":925696,"data_stored":409459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68600000000000005,"15min":0.68700000000000006},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85099999999999998,"5min":1.103,"15min":1.103},"last":0.69399999999999995}]},{"osd":1,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.84699999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.038}]},{"osd":2,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89700000000000002,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92900000000000005,"5min":1.377,"15min":1.377},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.038,"5min":1.415,"15min":1.415},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80000000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.81799999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89000000000000001,"5min":1.52,"15min":1.52},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.47099999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.84799999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.434,"15min":0.434},"max":{"1min":0.93300000000000005,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92000000000000004,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.004}]}]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57599999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.47899999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54600000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.376},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.014,"5min":1.387,"15min":1.387},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0409999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.502}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.149,"5min":1.714,"15min":1.714},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1339999999999999,"5min":1.744,"15min":1.744},"last":0.66900000000000004}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0980000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.52600000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0720000000000001,"5min":1.575,"15min":1.575},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95099999999999996,"5min":1.321,"15min":1.321},"last":0.75800000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":925696,"data_stored":409527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":1.145,"15min":1.145},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60599999999999998,"15min":0.66600000000000004},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.755},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.626,"15min":0.66100000000000003},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":2.609,"15min":2.609},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.68200000000000005,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.03,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.54700000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.012,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.042,"5min":1.095,"15min":1.095},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.96999999999999997,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.91600000000000004,"15min":0.98999999999999999},"min":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0549999999999999,"5min":5.375,"15min":5.375},"last":0.57399999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.92400000000000004,"15min":0.998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95099999999999996,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":1.629,"15min":1.629},"last":0.59399999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509490,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1519616,"data_stored":1000339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.37},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.434}]},{"osd":2,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58799999999999997,"5min":1.046,"15min":1.046},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66700000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96699999999999997,"5min":1.139,"15min":1.139},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.746,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.071,"15min":1.071},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.095,"15min":1.095},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.008,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.749},"min":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.61799999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542193,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1544192,"data_stored":1012021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97399999999999998,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.80100000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.747}]},{"osd":2,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.50700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.874}]},{"osd":4,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98199999999999998,"5min":1.052,"15min":1.052},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.53800000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81699999999999995,"5min":1.264,"15min":1.264},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89200000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.83499999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.749,"15min":0.755},"min":{"1min":0.61599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96699999999999997,"5min":1.198,"15min":1.198},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48999999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.171,"15min":1.171},"last":0.879}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.621},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1040000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.999,"5min":1.522,"15min":1.522},"last":0.79600000000000004}]},{"osd":5,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.81299999999999994}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":1.228,"15min":1.228},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76700000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":421791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45600000000000002},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.60499999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.179,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.871},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93200000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.59799999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.89100000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.042,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.995,"5min":1.252,"15min":1.252},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0669999999999999,"5min":1.29,"15min":1.29},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1319999999999999,"5min":1.337,"15min":1.337},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:20:05.987 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-17T12:20:05.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:20:06.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f653b400640 1 Processor -- start 2024-02-17T12:20:06.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f653b400640 1 -- start start 2024-02-17T12:20:06.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f653b400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f65340c6460 0x7f653406ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f653b400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6534154e30 0x7f65340aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f653b400640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6534155dd0 con 0x7f6534152540 2024-02-17T12:20:06.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f653b400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65341588c0 con 0x7f6534154e30 2024-02-17T12:20:06.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f653b400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6534155810 con 0x7f65340c6460 2024-02-17T12:20:06.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f6539400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6534154e30 0x7f65340aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f6538a00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f6534152540 0x7f6534158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:35256/0 (socket says 172.21.15.114:35256) 2024-02-17T12:20:06.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f6539400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6534154e30 0x7f65340aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50228/0 (socket says 172.21.15.114:50228) 2024-02-17T12:20:06.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f6538a00640 1 -- 172.21.15.114:0/1909473969 learned_addr learned my addr 172.21.15.114:0/1909473969 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:06.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f6533e00640 1 --2- 172.21.15.114:0/1909473969 >> v2:172.21.15.116:3300/0 conn(0x7f65340c6460 0x7f653406ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f6539400640 1 -- 172.21.15.114:0/1909473969 >> v2:172.21.15.116:3300/0 conn(0x7f65340c6460 msgr2=0x7f653406ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:06.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f6539400640 1 --2- 172.21.15.114:0/1909473969 >> v2:172.21.15.116:3300/0 conn(0x7f65340c6460 0x7f653406ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f6539400640 1 -- 172.21.15.114:0/1909473969 >> v1:172.21.15.116:6789/0 conn(0x7f6534152540 legacy=0x7f6534158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f6539400640 1 -- 172.21.15.114:0/1909473969 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6534155af0 con 0x7f6534154e30 2024-02-17T12:20:06.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.120+0000 7f6533400640 1 -- 172.21.15.114:0/1909473969 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607644435 0 0) 0x7f6534155dd0 con 0x7f6534152540 2024-02-17T12:20:06.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f6539400640 1 --2- 172.21.15.114:0/1909473969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 0x7f65340aa160 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f65340ae790 tx=0x7f652c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9331ce2688e5ad28 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:06.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f6533400640 1 -- 172.21.15.114:0/1909473969 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c0ab600 con 0x7f6534154e30 2024-02-17T12:20:06.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f6533400640 1 -- 172.21.15.114:0/1909473969 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c0a7050 con 0x7f6534154e30 2024-02-17T12:20:06.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f6533400640 1 -- 172.21.15.114:0/1909473969 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c0ab980 con 0x7f6534154e30 2024-02-17T12:20:06.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f653b400640 1 -- 172.21.15.114:0/1909473969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 msgr2=0x7f65340aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f653b400640 1 --2- 172.21.15.114:0/1909473969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 0x7f65340aa160 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f65340ae790 tx=0x7f652c01c360 comp rx=0 tx=0).stop 2024-02-17T12:20:06.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f653b400640 1 -- 172.21.15.114:0/1909473969 shutdown_connections 2024-02-17T12:20:06.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f653b400640 1 --2- 172.21.15.114:0/1909473969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 0x7f65340aa160 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f653b400640 1 --2- 172.21.15.114:0/1909473969 >> v2:172.21.15.116:3300/0 conn(0x7f65340c6460 0x7f653406ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f653b400640 1 -- 172.21.15.114:0/1909473969 >> 172.21.15.114:0/1909473969 conn(0x7f65340c4f20 msgr2=0x7f65340c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:06.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f653b400640 1 -- 172.21.15.114:0/1909473969 shutdown_connections 2024-02-17T12:20:06.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.124+0000 7f653b400640 1 -- 172.21.15.114:0/1909473969 wait complete. 2024-02-17T12:20:06.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 Processor -- start 2024-02-17T12:20:06.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 -- start start 2024-02-17T12:20:06.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65340c6460 0x7f6534157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6534152540 0x7f65341457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 0x7f653406bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6534156f60 con 0x7f6534154e30 2024-02-17T12:20:06.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6534156020 con 0x7f65340c6460 2024-02-17T12:20:06.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65341ee790 con 0x7f6534152540 2024-02-17T12:20:06.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6539400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 0x7f653406bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6538a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65340c6460 0x7f6534157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6533e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6534152540 0x7f65341457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6539400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 0x7f653406bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50242/0 (socket says 172.21.15.114:50242) 2024-02-17T12:20:06.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6538a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65340c6460 0x7f6534157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:45508/0 (socket says 172.21.15.114:45508) 2024-02-17T12:20:06.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6538a00640 1 -- 172.21.15.114:0/2272173528 learned_addr learned my addr 172.21.15.114:0/2272173528 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:06.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6539400640 1 -- 172.21.15.114:0/2272173528 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6534152540 msgr2=0x7f65341457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6539400640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6534152540 0x7f65341457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6539400640 1 -- 172.21.15.114:0/2272173528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65340c6460 msgr2=0x7f6534157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6539400640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65340c6460 0x7f6534157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6539400640 1 -- 172.21.15.114:0/2272173528 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c009420 con 0x7f6534154e30 2024-02-17T12:20:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6538a00640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65340c6460 0x7f6534157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:20:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6539400640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 0x7f653406bc50 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f652c0ab000 tx=0x7f652c019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6530c00640 1 -- 172.21.15.114:0/2272173528 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c0b4410 con 0x7f6534154e30 2024-02-17T12:20:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6530c00640 1 -- 172.21.15.114:0/2272173528 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c0b4570 con 0x7f6534154e30 2024-02-17T12:20:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f6530c00640 1 -- 172.21.15.114:0/2272173528 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c0b4920 con 0x7f6534154e30 2024-02-17T12:20:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 -- 172.21.15.114:0/2272173528 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653406d560 con 0x7f6534154e30 2024-02-17T12:20:06.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 -- 172.21.15.114:0/2272173528 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653406db20 con 0x7f6534154e30 2024-02-17T12:20:06.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.128+0000 7f653b400640 1 -- 172.21.15.114:0/2272173528 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65341561d0 con 0x7f6534154e30 2024-02-17T12:20:06.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.132+0000 7f6530c00640 1 -- 172.21.15.114:0/2272173528 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f652c0b2040 con 0x7f6534154e30 2024-02-17T12:20:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.132+0000 7f6530c00640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6510066e70 0x7f6510069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.132+0000 7f6530c00640 1 -- 172.21.15.114:0/2272173528 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f652c11e530 con 0x7f6534154e30 2024-02-17T12:20:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.132+0000 7f6538a00640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6510066e70 0x7f6510069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.132+0000 7f6538a00640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6510066e70 0x7f6510069330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f65240012f0 tx=0x7f65240017f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:06.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.136+0000 7f6530c00640 1 -- 172.21.15.114:0/2272173528 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f65341561d0 con 0x7f6534154e30 2024-02-17T12:20:06.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.288+0000 7f653b400640 1 -- 172.21.15.114:0/2272173528 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f653406dd10 con 0x7f6510066e70 2024-02-17T12:20:06.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.288+0000 7f6530c00640 1 -- 172.21.15.114:0/2272173528 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50701 (secure 0 0 0) 0x7f653406dd10 con 0x7f6510066e70 2024-02-17T12:20:06.293 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:20:06.293 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:20:06.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 -- 172.21.15.114:0/2272173528 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6510066e70 msgr2=0x7f6510069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6510066e70 0x7f6510069330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f65240012f0 tx=0x7f65240017f0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 -- 172.21.15.114:0/2272173528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 msgr2=0x7f653406bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 0x7f653406bc50 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f652c0ab000 tx=0x7f652c019100 comp rx=0 tx=0).stop 2024-02-17T12:20:06.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 -- 172.21.15.114:0/2272173528 shutdown_connections 2024-02-17T12:20:06.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6510066e70 0x7f6510069330 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6534154e30 0x7f653406bc50 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6534152540 0x7f65341457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 --2- 172.21.15.114:0/2272173528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65340c6460 0x7f6534157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 -- 172.21.15.114:0/2272173528 >> 172.21.15.114:0/2272173528 conn(0x7f65340c4f20 msgr2=0x7f65340c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:06.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 -- 172.21.15.114:0/2272173528 shutdown_connections 2024-02-17T12:20:06.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.292+0000 7f653b400640 1 -- 172.21.15.114:0/2272173528 wait complete. 2024-02-17T12:20:06.314 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-02-17T12:20:05.264716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":209,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":253800,"kb_used_data":8508,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720920,"statfs":{"total":773094113280,"available":772834222080,"internally_reserved":0,"allocated":8712192,"data_stored":4511046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12087,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001075"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":275,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-02-17T12:20:02.486123+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:20:02.486123+0000","last_peered":"2024-02-17T12:20:02.486123+0000","last_clean":"2024-02-17T12:20:02.486123+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:20:02.486123+0000","last_undegraded":"2024-02-17T12:20:02.486123+0000","last_fullsized":"2024-02-17T12:20:02.486123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":929792,"data_stored":410041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.627},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97299999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.115,"15min":1.115},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.143,"15min":1.143},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0640000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66800000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":1.734,"15min":1.734},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.64900000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0840000000000001,"5min":1.804,"15min":1.804},"last":0.433}]},{"osd":5,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.5,"15min":1.5},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1419999999999999,"5min":1.855,"15min":1.855},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.57899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":925696,"data_stored":409459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68600000000000005,"15min":0.68700000000000006},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85099999999999998,"5min":1.103,"15min":1.103},"last":0.69399999999999995}]},{"osd":1,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.84699999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.038}]},{"osd":2,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89700000000000002,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92900000000000005,"5min":1.377,"15min":1.377},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.038,"5min":1.415,"15min":1.415},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80000000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.81799999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89000000000000001,"5min":1.52,"15min":1.52},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.47099999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.84799999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.434,"15min":0.434},"max":{"1min":0.93300000000000005,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92000000000000004,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.004}]}]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":420562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57599999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.47899999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54600000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.376},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.014,"5min":1.387,"15min":1.387},"last":0.51200000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0409999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.502}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.149,"5min":1.714,"15min":1.714},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1339999999999999,"5min":1.744,"15min":1.744},"last":0.66900000000000004}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0980000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.52600000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0720000000000001,"5min":1.575,"15min":1.575},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95099999999999996,"5min":1.321,"15min":1.321},"last":0.75800000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":925696,"data_stored":409527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":1.145,"15min":1.145},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60599999999999998,"15min":0.66600000000000004},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.755},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.626,"15min":0.66100000000000003},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":2.609,"15min":2.609},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.68200000000000005,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.03,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.54700000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.012,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.042,"5min":1.095,"15min":1.095},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.96999999999999997,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.91600000000000004,"15min":0.98999999999999999},"min":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0549999999999999,"5min":5.375,"15min":5.375},"last":0.57399999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.92400000000000004,"15min":0.998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95099999999999996,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":1.629,"15min":1.629},"last":0.59399999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509490,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1519616,"data_stored":1000339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.37},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.434}]},{"osd":2,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58799999999999997,"5min":1.046,"15min":1.046},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66700000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96699999999999997,"5min":1.139,"15min":1.139},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.746,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.071,"15min":1.071},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.095,"15min":1.095},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.008,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.749},"min":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.61799999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542193,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1544192,"data_stored":1012021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97399999999999998,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.80100000000000005}]},{"osd":1,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.747}]},{"osd":2,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.50700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.874}]},{"osd":4,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98199999999999998,"5min":1.052,"15min":1.052},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.53800000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81699999999999995,"5min":1.264,"15min":1.264},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89200000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.83499999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.749,"15min":0.755},"min":{"1min":0.61599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96699999999999997,"5min":1.198,"15min":1.198},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48999999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.171,"15min":1.171},"last":0.879}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.621},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1040000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.999,"5min":1.522,"15min":1.522},"last":0.79600000000000004}]},{"osd":5,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.81299999999999994}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":1.228,"15min":1.228},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76700000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":421791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45600000000000002},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.60499999999999998}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.179,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.871},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93200000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.59799999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.89100000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.042,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.995,"5min":1.252,"15min":1.252},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0669999999999999,"5min":1.29,"15min":1.29},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1319999999999999,"5min":1.337,"15min":1.337},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:20:06.315 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-17T12:20:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca5e000640 1 Processor -- start 2024-02-17T12:20:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca5e000640 1 -- start start 2024-02-17T12:20:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca5e000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca58150300 0x7fca58156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca5e000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fca58152d30 0x7fca58153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca5e000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca58157270 con 0x7fca580714c0 2024-02-17T12:20:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca5e000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580c6900 con 0x7fca58150300 2024-02-17T12:20:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca5e000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca580c3580 con 0x7fca58152d30 2024-02-17T12:20:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca57400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca58150300 0x7fca58156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca57400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca58150300 0x7fca58156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50250/0 (socket says 172.21.15.114:50250) 2024-02-17T12:20:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca57400640 1 -- 172.21.15.114:0/593788515 learned_addr learned my addr 172.21.15.114:0/593788515 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:06.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca57e00640 1 --2- 172.21.15.114:0/593788515 >> v2:172.21.15.116:3300/0 conn(0x7fca58152d30 0x7fca58153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca57400640 1 -- 172.21.15.114:0/593788515 >> v2:172.21.15.116:3300/0 conn(0x7fca58152d30 msgr2=0x7fca58153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:06.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca57400640 1 --2- 172.21.15.114:0/593788515 >> v2:172.21.15.116:3300/0 conn(0x7fca58152d30 0x7fca58153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca57400640 1 -- 172.21.15.114:0/593788515 >> v1:172.21.15.116:6789/0 conn(0x7fca580714c0 legacy=0x7fca580aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.448+0000 7fca57400640 1 -- 172.21.15.114:0/593788515 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca580c2fc0 con 0x7fca58150300 2024-02-17T12:20:06.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca57400640 1 --2- 172.21.15.114:0/593788515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58150300 0x7fca58156d30 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fca5806e050 tx=0x7fca4001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af48874ac841098 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:06.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca56000640 1 -- 172.21.15.114:0/593788515 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca400ab600 con 0x7fca58150300 2024-02-17T12:20:06.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca56000640 1 -- 172.21.15.114:0/593788515 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca400a7050 con 0x7fca58150300 2024-02-17T12:20:06.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca56000640 1 -- 172.21.15.114:0/593788515 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca400ab980 con 0x7fca58150300 2024-02-17T12:20:06.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca5e000640 1 -- 172.21.15.114:0/593788515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58150300 msgr2=0x7fca58156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca5e000640 1 --2- 172.21.15.114:0/593788515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58150300 0x7fca58156d30 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fca5806e050 tx=0x7fca4001c490 comp rx=0 tx=0).stop 2024-02-17T12:20:06.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca5e000640 1 -- 172.21.15.114:0/593788515 shutdown_connections 2024-02-17T12:20:06.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca5e000640 1 --2- 172.21.15.114:0/593788515 >> v2:172.21.15.116:3300/0 conn(0x7fca58152d30 0x7fca58153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca5e000640 1 --2- 172.21.15.114:0/593788515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58150300 0x7fca58156d30 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca5e000640 1 -- 172.21.15.114:0/593788515 >> 172.21.15.114:0/593788515 conn(0x7fca580c4f20 msgr2=0x7fca580c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:06.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca5e000640 1 -- 172.21.15.114:0/593788515 shutdown_connections 2024-02-17T12:20:06.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.452+0000 7fca5e000640 1 -- 172.21.15.114:0/593788515 wait complete. 2024-02-17T12:20:06.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 Processor -- start 2024-02-17T12:20:06.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 -- start start 2024-02-17T12:20:06.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fca580714c0 0x7fca58157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58150300 0x7fca58149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58152d30 0x7fca581f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca58149c80 con 0x7fca58152d30 2024-02-17T12:20:06.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca581ee720 con 0x7fca58150300 2024-02-17T12:20:06.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5806dd20 con 0x7fca580714c0 2024-02-17T12:20:06.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58152d30 0x7fca581f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fca580714c0 0x7fca58157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca56a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58150300 0x7fca58149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58152d30 0x7fca581f0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50264/0 (socket says 172.21.15.114:50264) 2024-02-17T12:20:06.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca56a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58150300 0x7fca58149250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.114:45536/0 (socket says 172.21.15.114:45536) 2024-02-17T12:20:06.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57e00640 1 -- 172.21.15.114:0/1462596740 learned_addr learned my addr 172.21.15.114:0/1462596740 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:06.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57e00640 1 -- 172.21.15.114:0/1462596740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fca580714c0 msgr2=0x7fca58157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57e00640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fca580714c0 0x7fca58157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57e00640 1 -- 172.21.15.114:0/1462596740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58150300 msgr2=0x7fca58149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57e00640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58150300 0x7fca58149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57e00640 1 -- 172.21.15.114:0/1462596740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400094d0 con 0x7fca58152d30 2024-02-17T12:20:06.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57400640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fca580714c0 0x7fca58157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:20:06.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca57e00640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58152d30 0x7fca581f0820 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fca50007e40 tx=0x7fca5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:06.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca4f400640 1 -- 172.21.15.114:0/1462596740 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50014620 con 0x7fca58152d30 2024-02-17T12:20:06.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca4f400640 1 -- 172.21.15.114:0/1462596740 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5000ee90 con 0x7fca58152d30 2024-02-17T12:20:06.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 -- 172.21.15.114:0/1462596740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca58149e90 con 0x7fca58152d30 2024-02-17T12:20:06.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca4f400640 1 -- 172.21.15.114:0/1462596740 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500149e0 con 0x7fca58152d30 2024-02-17T12:20:06.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 -- 172.21.15.114:0/1462596740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca581ee930 con 0x7fca58152d30 2024-02-17T12:20:06.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.456+0000 7fca5e000640 1 -- 172.21.15.114:0/1462596740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca58074840 con 0x7fca58152d30 2024-02-17T12:20:06.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.460+0000 7fca4f400640 1 -- 172.21.15.114:0/1462596740 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fca50014b40 con 0x7fca58152d30 2024-02-17T12:20:06.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.460+0000 7fca4f400640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fca34066e40 0x7fca34069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:06.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.460+0000 7fca4f400640 1 -- 172.21.15.114:0/1462596740 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fca50084fc0 con 0x7fca58152d30 2024-02-17T12:20:06.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.460+0000 7fca57400640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fca34066e40 0x7fca34069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:06.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.460+0000 7fca57400640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fca34066e40 0x7fca34069300 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fca400ad000 tx=0x7fca40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:06.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.464+0000 7fca4f400640 1 -- 172.21.15.114:0/1462596740 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fca500b6cb0 con 0x7fca58152d30 2024-02-17T12:20:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.616+0000 7fca5e000640 1 -- 172.21.15.114:0/1462596740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca580712a0 con 0x7fca58152d30 2024-02-17T12:20:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca4f400640 1 -- 172.21.15.114:0/1462596740 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+13165 (secure 0 0 0) 0x7fca50052100 con 0x7fca58152d30 2024-02-17T12:20:06.623 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:20:06.623 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":78,"fsid":"718e3165-e11b-4138-adc9-584dcfeb6e24","created":"2024-02-17T12:15:58.038697+0000","modified":"2024-02-17T12:20:03.415606+0000","last_up_change":"2024-02-17T12:16:09.743511+0000","last_in_change":"2024-02-17T12:16:00.728982+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-17T12:16:09.276215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27755643-ee85-4399-8ad6-962e7c2a630d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6825","nonce":1061952801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6827","nonce":1061952801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6831","nonce":1061952801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1061952801},{"type":"v1","addr":"172.21.15.114:6829","nonce":1061952801}]},"public_addr":"172.21.15.114:6825/1061952801","cluster_addr":"172.21.15.114:6827/1061952801","heartbeat_back_addr":"172.21.15.114:6831/1061952801","heartbeat_front_addr":"172.21.15.114:6829/1061952801","state":["exists","up"]},{"osd":1,"uuid":"0d073445-0602-4622-93b7-a9c40a747000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6811","nonce":290668090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6816","nonce":290668090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6823","nonce":290668090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":290668090},{"type":"v1","addr":"172.21.15.114:6820","nonce":290668090}]},"public_addr":"172.21.15.114:6811/290668090","cluster_addr":"172.21.15.114:6816/290668090","heartbeat_back_addr":"172.21.15.114:6823/290668090","heartbeat_front_addr":"172.21.15.114:6820/290668090","state":["exists","up"]},{"osd":2,"uuid":"86e246bd-29a9-4fc1-bc3f-8e23a2a8e8f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6801","nonce":419916160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6803","nonce":419916160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6807","nonce":419916160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":419916160},{"type":"v1","addr":"172.21.15.114:6805","nonce":419916160}]},"public_addr":"172.21.15.114:6801/419916160","cluster_addr":"172.21.15.114:6803/419916160","heartbeat_back_addr":"172.21.15.114:6807/419916160","heartbeat_front_addr":"172.21.15.114:6805/419916160","state":["exists","up"]},{"osd":3,"uuid":"2691c517-9b74-4289-81a4-1ac089d4b349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6809","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6810","nonce":3161691811}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6814","nonce":3161691811}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6821","nonce":3161691811}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6815","nonce":3161691811},{"type":"v1","addr":"172.21.15.114:6817","nonce":3161691811}]},"public_addr":"172.21.15.114:6810/3161691811","cluster_addr":"172.21.15.114:6814/3161691811","heartbeat_back_addr":"172.21.15.114:6821/3161691811","heartbeat_front_addr":"172.21.15.114:6817/3161691811","state":["exists","up"]},{"osd":4,"uuid":"c9e2ca17-5905-4400-aae4-b89546d5aa11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6801","nonce":621414064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6803","nonce":621414064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6807","nonce":621414064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":621414064},{"type":"v1","addr":"172.21.15.116:6805","nonce":621414064}]},"public_addr":"172.21.15.116:6801/621414064","cluster_addr":"172.21.15.116:6803/621414064","heartbeat_back_addr":"172.21.15.116:6807/621414064","heartbeat_front_addr":"172.21.15.116:6805/621414064","state":["exists","up"]},{"osd":5,"uuid":"231b988c-4494-4ba2-91a4-a2d229b0fccc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6825","nonce":3672471702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6827","nonce":3672471702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6831","nonce":3672471702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3672471702},{"type":"v1","addr":"172.21.15.116:6829","nonce":3672471702}]},"public_addr":"172.21.15.116:6825/3672471702","cluster_addr":"172.21.15.116:6827/3672471702","heartbeat_back_addr":"172.21.15.116:6831/3672471702","heartbeat_front_addr":"172.21.15.116:6829/3672471702","state":["exists","up"]},{"osd":6,"uuid":"44a29cad-292d-4cf5-9cbc-88bfe692ecff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6812","nonce":616119485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6816","nonce":616119485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6823","nonce":616119485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":616119485},{"type":"v1","addr":"172.21.15.116:6820","nonce":616119485}]},"public_addr":"172.21.15.116:6812/616119485","cluster_addr":"172.21.15.116:6816/616119485","heartbeat_back_addr":"172.21.15.116:6823/616119485","heartbeat_front_addr":"172.21.15.116:6820/616119485","state":["exists","up"]},{"osd":7,"uuid":"8bb2e00e-2e38-4a78-a55c-27e65b334c9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6809","nonce":2799570166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6813","nonce":2799570166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6821","nonce":2799570166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":2799570166},{"type":"v1","addr":"172.21.15.116:6817","nonce":2799570166}]},"public_addr":"172.21.15.116:6809/2799570166","cluster_addr":"172.21.15.116:6813/2799570166","heartbeat_back_addr":"172.21.15.116:6821/2799570166","heartbeat_front_addr":"172.21.15.116:6817/2799570166","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.410181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.389860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.252677+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.369303+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.199086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.409255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:06.387626+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T12:16:07.878630+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6836/1982789506":"2024-02-18T12:20:00.409237+0000","172.21.15.114:6834/1982789506":"2024-02-18T12:20:00.409237+0000","172.21.15.114:6837/709959478":"2024-02-18T12:19:53.944751+0000","172.21.15.114:6835/709959478":"2024-02-18T12:19:53.944751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-17T12:20:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 -- 172.21.15.114:0/1462596740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fca34066e40 msgr2=0x7fca34069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fca34066e40 0x7fca34069300 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fca400ad000 tx=0x7fca40008040 comp rx=0 tx=0).stop 2024-02-17T12:20:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 -- 172.21.15.114:0/1462596740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58152d30 msgr2=0x7fca581f0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58152d30 0x7fca581f0820 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fca50007e40 tx=0x7fca5000e4b0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 -- 172.21.15.114:0/1462596740 shutdown_connections 2024-02-17T12:20:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fca34066e40 0x7fca34069300 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca58152d30 0x7fca581f0820 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca58150300 0x7fca58149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 --2- 172.21.15.114:0/1462596740 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fca580714c0 0x7fca58157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 -- 172.21.15.114:0/1462596740 >> 172.21.15.114:0/1462596740 conn(0x7fca580c4f20 msgr2=0x7fca580a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 -- 172.21.15.114:0/1462596740 shutdown_connections 2024-02-17T12:20:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:06.620+0000 7fca5e000640 1 -- 172.21.15.114:0/1462596740 wait complete. 2024-02-17T12:20:07.643 INFO:tasks.ceph:Scrubbing osd.0 2024-02-17T12:20:07.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-17T12:20:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5fe00640 1 Processor -- start 2024-02-17T12:20:07.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5fe00640 1 -- start start 2024-02-17T12:20:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e58156dc0 0x7f0e5815e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580abc70 con 0x7f0e580c4a90 2024-02-17T12:20:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5fe00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580c7900 con 0x7f0e580c7d80 2024-02-17T12:20:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5fe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580ac060 con 0x7f0e58156dc0 2024-02-17T12:20:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e58156dc0 0x7f0e5815e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5d400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0e580c4a90 0x7f0e580c4fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48216/0 (socket says 172.21.15.114:48216) 2024-02-17T12:20:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5d400640 1 -- 172.21.15.114:0/3081043542 learned_addr learned my addr 172.21.15.114:0/3081043542 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5de00640 1 -- 172.21.15.114:0/3081043542 >> v1:172.21.15.116:6789/0 conn(0x7f0e580c7d80 legacy=0x7f0e58152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5de00640 1 -- 172.21.15.114:0/3081043542 >> v1:172.21.15.114:6789/0 conn(0x7f0e580c4a90 legacy=0x7f0e580c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e5de00640 1 -- 172.21.15.114:0/3081043542 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580c2f20 con 0x7f0e58156dc0 2024-02-17T12:20:07.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.792+0000 7f0e57e00640 1 -- 172.21.15.114:0/3081043542 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650429653 0 0) 0x7f0e580abc70 con 0x7f0e580c4a90 2024-02-17T12:20:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e5de00640 1 --2- 172.21.15.114:0/3081043542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e58156dc0 0x7f0e5815e4e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009d90 tx=0x7f0e5001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb3a46c03143f1e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:07.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e57e00640 1 -- 172.21.15.114:0/3081043542 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500a5890 con 0x7f0e58156dc0 2024-02-17T12:20:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e57e00640 1 -- 172.21.15.114:0/3081043542 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e500a59f0 con 0x7f0e58156dc0 2024-02-17T12:20:07.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e57e00640 1 -- 172.21.15.114:0/3081043542 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500a5d80 con 0x7f0e58156dc0 2024-02-17T12:20:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e5fe00640 1 -- 172.21.15.114:0/3081043542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e58156dc0 msgr2=0x7f0e5815e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e5fe00640 1 --2- 172.21.15.114:0/3081043542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e58156dc0 0x7f0e5815e4e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009d90 tx=0x7f0e5001c8e0 comp rx=0 tx=0).stop 2024-02-17T12:20:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e5fe00640 1 -- 172.21.15.114:0/3081043542 shutdown_connections 2024-02-17T12:20:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e5fe00640 1 --2- 172.21.15.114:0/3081043542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e58156dc0 0x7f0e5815e4e0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:07.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e5fe00640 1 -- 172.21.15.114:0/3081043542 >> 172.21.15.114:0/3081043542 conn(0x7f0e580c8520 msgr2=0x7f0e580c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e5fe00640 1 -- 172.21.15.114:0/3081043542 shutdown_connections 2024-02-17T12:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e5fe00640 1 -- 172.21.15.114:0/3081043542 wait complete. 2024-02-17T12:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e5fe00640 1 Processor -- start 2024-02-17T12:20:07.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.796+0000 7f0e5fe00640 1 -- start start 2024-02-17T12:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5fe00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e580c4a90 0x7f0e58145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5fe00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0e580c7d80 0x7f0e5814a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e58156dc0 0x7f0e58141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58149f90 con 0x7f0e58156dc0 2024-02-17T12:20:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5fe00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581499b0 con 0x7f0e580c4a90 2024-02-17T12:20:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5fe00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58147d10 con 0x7f0e580c7d80 2024-02-17T12:20:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e58156dc0 0x7f0e58141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e58156dc0 0x7f0e58141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50288/0 (socket says 172.21.15.114:50288) 2024-02-17T12:20:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5de00640 1 -- 172.21.15.114:0/979295896 learned_addr learned my addr 172.21.15.114:0/979295896 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5ca00640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0e580c7d80 0x7f0e5814a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5d400640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e580c4a90 0x7f0e58145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5de00640 1 -- 172.21.15.114:0/979295896 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0e580c7d80 msgr2=0x7f0e5814a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5de00640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0e580c7d80 0x7f0e5814a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5de00640 1 -- 172.21.15.114:0/979295896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e580c4a90 msgr2=0x7f0e58145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5de00640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e580c4a90 0x7f0e58145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5de00640 1 -- 172.21.15.114:0/979295896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50009a70 con 0x7f0e58156dc0 2024-02-17T12:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5de00640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e58156dc0 0x7f0e58141030 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f0e500b0040 tx=0x7f0e50019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e55600640 1 -- 172.21.15.114:0/979295896 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500ad850 con 0x7f0e58156dc0 2024-02-17T12:20:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e55600640 1 -- 172.21.15.114:0/979295896 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e500ad9b0 con 0x7f0e58156dc0 2024-02-17T12:20:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e58147ff0 con 0x7f0e58156dc0 2024-02-17T12:20:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e55600640 1 -- 172.21.15.114:0/979295896 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500add20 con 0x7f0e58156dc0 2024-02-17T12:20:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e58141570 con 0x7f0e58156dc0 2024-02-17T12:20:07.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e580ac700 con 0x7f0e58156dc0 2024-02-17T12:20:07.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.800+0000 7f0e55600640 1 -- 172.21.15.114:0/979295896 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f0e500b4050 con 0x7f0e58156dc0 2024-02-17T12:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.804+0000 7f0e55600640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e38066e40 0x7f0e38069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.804+0000 7f0e55600640 1 -- 172.21.15.114:0/979295896 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0e5011fe40 con 0x7f0e58156dc0 2024-02-17T12:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.804+0000 7f0e55600640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] conn(0x7f0e3806cda0 0x7f0e3806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.804+0000 7f0e5d400640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e38066e40 0x7f0e38069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.804+0000 7f0e55600640 1 -- 172.21.15.114:0/979295896 --> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e3806f870 con 0x7f0e3806cda0 2024-02-17T12:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.804+0000 7f0e55600640 1 -- 172.21.15.114:0/979295896 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e501201b0 con 0x7f0e58156dc0 2024-02-17T12:20:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.804+0000 7f0e5ca00640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] conn(0x7f0e3806cda0 0x7f0e3806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.804+0000 7f0e5d400640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e38066e40 0x7f0e38069300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000f70 tx=0x7f0e4c007240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.804+0000 7f0e5ca00640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] conn(0x7f0e3806cda0 0x7f0e3806f1c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.804+0000 7f0e55600640 1 -- 172.21.15.114:0/979295896 <== osd.0 v2:172.21.15.114:6824/1061952801 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0e3806f870 con 0x7f0e3806cda0 2024-02-17T12:20:07.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.816+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 --> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0e581568a0 con 0x7f0e3806cda0 2024-02-17T12:20:07.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.816+0000 7f0e55600640 1 -- 172.21.15.114:0/979295896 <== osd.0 v2:172.21.15.114:6824/1061952801 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0e440014f0 con 0x7f0e3806cda0 2024-02-17T12:20:07.825 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:20:07.825 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T12:20:07.826 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.816+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] conn(0x7f0e3806cda0 msgr2=0x7f0e3806f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.816+0000 7f0e5fe00640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:6824/1061952801,v1:172.21.15.114:6825/1061952801] conn(0x7f0e3806cda0 0x7f0e3806f1c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.820+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e38066e40 msgr2=0x7f0e38069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.820+0000 7f0e5fe00640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f0e38066e40 0x7f0e38069300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000f70 tx=0x7f0e4c007240 comp rx=0 tx=0).stop 2024-02-17T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.820+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e58156dc0 msgr2=0x7f0e58141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.820+0000 7f0e5fe00640 1 --2- 172.21.15.114:0/979295896 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e58156dc0 0x7f0e58141030 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f0e500b0040 tx=0x7f0e50019680 comp rx=0 tx=0).stop 2024-02-17T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.820+0000 7f0e5de00640 1 -- 172.21.15.114:0/979295896 reap_dead start 2024-02-17T12:20:07.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.820+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 shutdown_connections 2024-02-17T12:20:07.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.820+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 >> 172.21.15.114:0/979295896 conn(0x7f0e580c8520 msgr2=0x7f0e580c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:07.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.820+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 shutdown_connections 2024-02-17T12:20:07.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.820+0000 7f0e5fe00640 1 -- 172.21.15.114:0/979295896 wait complete. 2024-02-17T12:20:07.840 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-17T12:20:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa91a600640 1 Processor -- start 2024-02-17T12:20:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa91a600640 1 -- start start 2024-02-17T12:20:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa91a600640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa9140c32f0 0x7fa9140a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa91a600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9140c1920 con 0x7fa91414eaa0 2024-02-17T12:20:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa91a600640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9140a98f0 con 0x7fa9141522c0 2024-02-17T12:20:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa91a600640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9140aaf30 con 0x7fa9140c32f0 2024-02-17T12:20:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa919c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa91414eaa0 0x7fa91415c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48232/0 (socket says 172.21.15.114:48232) 2024-02-17T12:20:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa919c00640 1 -- 172.21.15.114:0/1207228045 learned_addr learned my addr 172.21.15.114:0/1207228045 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa919200640 1 --2- 172.21.15.114:0/1207228045 >> v2:172.21.15.116:3300/0 conn(0x7fa9140c32f0 0x7fa9140a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa913e00640 1 -- 172.21.15.114:0/1207228045 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143703855 0 0) 0x7fa9140c1920 con 0x7fa91414eaa0 2024-02-17T12:20:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa913e00640 1 -- 172.21.15.114:0/1207228045 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8f8003530 con 0x7fa91414eaa0 2024-02-17T12:20:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa919200640 1 -- 172.21.15.114:0/1207228045 >> v1:172.21.15.116:6789/0 conn(0x7fa9141522c0 legacy=0x7fa9141557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa913e00640 1 -- 172.21.15.114:0/1207228045 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1343406290 0 0) 0x7fa8f8003530 con 0x7fa91414eaa0 2024-02-17T12:20:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa919200640 1 -- 172.21.15.114:0/1207228045 >> v1:172.21.15.114:6789/0 conn(0x7fa91414eaa0 legacy=0x7fa91415c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.972+0000 7fa919200640 1 -- 172.21.15.114:0/1207228045 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914155020 con 0x7fa9140c32f0 2024-02-17T12:20:07.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa919200640 1 --2- 172.21.15.114:0/1207228045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9140c32f0 0x7fa9140a93b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa9040097c0 tx=0x7fa90401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1f833b474381a03 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:07.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa913e00640 1 -- 172.21.15.114:0/1207228045 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c001a00 con 0x7fa9140c32f0 2024-02-17T12:20:07.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa913e00640 1 -- 172.21.15.114:0/1207228045 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9040a7050 con 0x7fa9140c32f0 2024-02-17T12:20:07.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa913e00640 1 -- 172.21.15.114:0/1207228045 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9040ab620 con 0x7fa9140c32f0 2024-02-17T12:20:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa91a600640 1 -- 172.21.15.114:0/1207228045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9140c32f0 msgr2=0x7fa9140a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa91a600640 1 --2- 172.21.15.114:0/1207228045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9140c32f0 0x7fa9140a93b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa9040097c0 tx=0x7fa90401c330 comp rx=0 tx=0).stop 2024-02-17T12:20:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa91a600640 1 -- 172.21.15.114:0/1207228045 shutdown_connections 2024-02-17T12:20:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa91a600640 1 --2- 172.21.15.114:0/1207228045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9140c32f0 0x7fa9140a93b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa91a600640 1 -- 172.21.15.114:0/1207228045 >> 172.21.15.114:0/1207228045 conn(0x7fa9140a8660 msgr2=0x7fa9140a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:07.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa91a600640 1 -- 172.21.15.114:0/1207228045 shutdown_connections 2024-02-17T12:20:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.976+0000 7fa91a600640 1 -- 172.21.15.114:0/1207228045 wait complete. 2024-02-17T12:20:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 Processor -- start 2024-02-17T12:20:07.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 -- start start 2024-02-17T12:20:07.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9140c32f0 0x7fa914150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa91414eaa0 0x7fa9141506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9141522c0 0x7fa914153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140c4be0 con 0x7fa91414eaa0 2024-02-17T12:20:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140c4e10 con 0x7fa9140c32f0 2024-02-17T12:20:07.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140c50f0 con 0x7fa9141522c0 2024-02-17T12:20:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa90be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa91414eaa0 0x7fa9141506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa90be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa91414eaa0 0x7fa9141506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50300/0 (socket says 172.21.15.114:50300) 2024-02-17T12:20:07.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa90be00640 1 -- 172.21.15.114:0/2945216144 learned_addr learned my addr 172.21.15.114:0/2945216144 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa919200640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9140c32f0 0x7fa914150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa919c00640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9141522c0 0x7fa914153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa90be00640 1 -- 172.21.15.114:0/2945216144 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9141522c0 msgr2=0x7fa914153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa90be00640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9141522c0 0x7fa914153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:07.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa90be00640 1 -- 172.21.15.114:0/2945216144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9140c32f0 msgr2=0x7fa914150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa90be00640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9140c32f0 0x7fa914150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa90be00640 1 -- 172.21.15.114:0/2945216144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904009420 con 0x7fa91414eaa0 2024-02-17T12:20:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa919c00640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9141522c0 0x7fa914153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa90be00640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa91414eaa0 0x7fa9141506f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c390 tx=0x7fa8fc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa911600640 1 -- 172.21.15.114:0/2945216144 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0052d0 con 0x7fa91414eaa0 2024-02-17T12:20:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa911600640 1 -- 172.21.15.114:0/2945216144 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc005450 con 0x7fa91414eaa0 2024-02-17T12:20:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 -- 172.21.15.114:0/2945216144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9140c53d0 con 0x7fa91414eaa0 2024-02-17T12:20:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa911600640 1 -- 172.21.15.114:0/2945216144 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc003840 con 0x7fa91414eaa0 2024-02-17T12:20:07.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 -- 172.21.15.114:0/2945216144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa914151450 con 0x7fa91414eaa0 2024-02-17T12:20:07.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.980+0000 7fa91a600640 1 -- 172.21.15.114:0/2945216144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9140c58f0 con 0x7fa91414eaa0 2024-02-17T12:20:07.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.984+0000 7fa911600640 1 -- 172.21.15.114:0/2945216144 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fa8fc0039a0 con 0x7fa91414eaa0 2024-02-17T12:20:07.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.984+0000 7fa911600640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8f0066e40 0x7fa8f0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:07.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.984+0000 7fa911600640 1 -- 172.21.15.114:0/2945216144 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa8fc083d20 con 0x7fa91414eaa0 2024-02-17T12:20:07.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.984+0000 7fa919200640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8f0066e40 0x7fa8f0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:07.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.984+0000 7fa919200640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8f0066e40 0x7fa8f0069300 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa9040ad000 tx=0x7fa9040a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:07.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:07.988+0000 7fa911600640 1 -- 172.21.15.114:0/2945216144 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa9140c58f0 con 0x7fa91414eaa0 2024-02-17T12:20:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 -- 172.21.15.114:0/2945216144 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9140c2100 con 0x7fa8f0066e40 2024-02-17T12:20:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa911600640 1 -- 172.21.15.114:0/2945216144 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa9040ab740 con 0x7fa8f0066e40 2024-02-17T12:20:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 0 to deep-scrub 2024-02-17T12:20:08.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 -- 172.21.15.114:0/2945216144 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8f0066e40 msgr2=0x7fa8f0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8f0066e40 0x7fa8f0069300 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa9040ad000 tx=0x7fa9040a6000 comp rx=0 tx=0).stop 2024-02-17T12:20:08.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 -- 172.21.15.114:0/2945216144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa91414eaa0 msgr2=0x7fa9141506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa91414eaa0 0x7fa9141506f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c390 tx=0x7fa8fc00c850 comp rx=0 tx=0).stop 2024-02-17T12:20:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 -- 172.21.15.114:0/2945216144 shutdown_connections 2024-02-17T12:20:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa9141522c0 0x7fa914153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fa8f0066e40 0x7fa8f0069300 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa91414eaa0 0x7fa9141506f0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 --2- 172.21.15.114:0/2945216144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9140c32f0 0x7fa914150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 -- 172.21.15.114:0/2945216144 >> 172.21.15.114:0/2945216144 conn(0x7fa9140a8660 msgr2=0x7fa914147a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 -- 172.21.15.114:0/2945216144 shutdown_connections 2024-02-17T12:20:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.144+0000 7fa91a600640 1 -- 172.21.15.114:0/2945216144 wait complete. 2024-02-17T12:20:08.166 INFO:tasks.ceph:Scrubbing osd.1 2024-02-17T12:20:08.166 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-17T12:20:08.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.300+0000 7eff54c00640 1 Processor -- start 2024-02-17T12:20:08.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.300+0000 7eff54c00640 1 -- start start 2024-02-17T12:20:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff54c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7eff500c38e0 0x7eff5006e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff54c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 0x7eff500a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff54c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff50153640 con 0x7eff500a7020 2024-02-17T12:20:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff54c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff500c3cc0 con 0x7eff500c38e0 2024-02-17T12:20:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff54c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff501506a0 con 0x7eff500a6590 2024-02-17T12:20:08.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff4e800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7eff500a7020 0x7eff501543a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48236/0 (socket says 172.21.15.114:48236) 2024-02-17T12:20:08.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff4e800640 1 -- 172.21.15.114:0/4254752620 learned_addr learned my addr 172.21.15.114:0/4254752620 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:08.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff4d400640 1 --2- 172.21.15.114:0/4254752620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 0x7eff500a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff4de00640 1 --2- 172.21.15.114:0/4254752620 >> v2:172.21.15.116:3300/0 conn(0x7eff500c38e0 0x7eff5006e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff4ca00640 1 -- 172.21.15.114:0/4254752620 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238029021 0 0) 0x7eff50153640 con 0x7eff500a7020 2024-02-17T12:20:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff4ca00640 1 -- 172.21.15.114:0/4254752620 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff34003530 con 0x7eff500a7020 2024-02-17T12:20:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff4d400640 1 -- 172.21.15.114:0/4254752620 >> v2:172.21.15.116:3300/0 conn(0x7eff500c38e0 msgr2=0x7eff5006e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff4d400640 1 --2- 172.21.15.114:0/4254752620 >> v2:172.21.15.116:3300/0 conn(0x7eff500c38e0 0x7eff5006e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff4d400640 1 -- 172.21.15.114:0/4254752620 >> v1:172.21.15.114:6789/0 conn(0x7eff500a7020 legacy=0x7eff501543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.304+0000 7eff4d400640 1 -- 172.21.15.114:0/4254752620 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50153b70 con 0x7eff500a6590 2024-02-17T12:20:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff4d400640 1 --2- 172.21.15.114:0/4254752620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 0x7eff500a6ae0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0097c0 tx=0x7eff3c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2d6fe5836509a50 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff4ca00640 1 -- 172.21.15.114:0/4254752620 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c0ab600 con 0x7eff500a6590 2024-02-17T12:20:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff4ca00640 1 -- 172.21.15.114:0/4254752620 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c0a7050 con 0x7eff500a6590 2024-02-17T12:20:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff4ca00640 1 -- 172.21.15.114:0/4254752620 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c0ab980 con 0x7eff500a6590 2024-02-17T12:20:08.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 -- 172.21.15.114:0/4254752620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 msgr2=0x7eff500a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 --2- 172.21.15.114:0/4254752620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 0x7eff500a6ae0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0097c0 tx=0x7eff3c01c380 comp rx=0 tx=0).stop 2024-02-17T12:20:08.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 -- 172.21.15.114:0/4254752620 shutdown_connections 2024-02-17T12:20:08.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 --2- 172.21.15.114:0/4254752620 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 0x7eff500a6ae0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 --2- 172.21.15.114:0/4254752620 >> v2:172.21.15.116:3300/0 conn(0x7eff500c38e0 0x7eff5006e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 -- 172.21.15.114:0/4254752620 >> 172.21.15.114:0/4254752620 conn(0x7eff5006b210 msgr2=0x7eff5006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:08.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 -- 172.21.15.114:0/4254752620 shutdown_connections 2024-02-17T12:20:08.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 -- 172.21.15.114:0/4254752620 wait complete. 2024-02-17T12:20:08.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 Processor -- start 2024-02-17T12:20:08.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 -- start start 2024-02-17T12:20:08.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 0x7eff500abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500a7020 0x7eff500ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff500c38e0 0x7eff500a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff50146600 con 0x7eff500a7020 2024-02-17T12:20:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5014be70 con 0x7eff500c38e0 2024-02-17T12:20:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff54c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff50071a60 con 0x7eff500a6590 2024-02-17T12:20:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff4d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500a7020 0x7eff500ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff4d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500a7020 0x7eff500ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50310/0 (socket says 172.21.15.114:50310) 2024-02-17T12:20:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.308+0000 7eff4d400640 1 -- 172.21.15.114:0/1514648597 learned_addr learned my addr 172.21.15.114:0/1514648597 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4de00640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 0x7eff500abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4d400640 1 -- 172.21.15.114:0/1514648597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 msgr2=0x7eff500abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4e800640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff500c38e0 0x7eff500a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4d400640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 0x7eff500abbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4d400640 1 -- 172.21.15.114:0/1514648597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff500c38e0 msgr2=0x7eff500a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4d400640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff500c38e0 0x7eff500a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4d400640 1 -- 172.21.15.114:0/1514648597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c009420 con 0x7eff500a7020 2024-02-17T12:20:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4e800640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff500c38e0 0x7eff500a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4de00640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7eff500a6590 0x7eff500abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4d400640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500a7020 0x7eff500ac110 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0ae040 tx=0x7eff3c019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff46000640 1 -- 172.21.15.114:0/1514648597 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c0b4410 con 0x7eff500a7020 2024-02-17T12:20:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff46000640 1 -- 172.21.15.114:0/1514648597 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c0b4570 con 0x7eff500a7020 2024-02-17T12:20:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff501ed1f0 con 0x7eff500a7020 2024-02-17T12:20:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff46000640 1 -- 172.21.15.114:0/1514648597 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c0b4920 con 0x7eff500a7020 2024-02-17T12:20:08.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff50072940 con 0x7eff500a7020 2024-02-17T12:20:08.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff500c0b40 con 0x7eff500a7020 2024-02-17T12:20:08.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff46000640 1 -- 172.21.15.114:0/1514648597 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7eff3c0b2040 con 0x7eff500a7020 2024-02-17T12:20:08.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff46000640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7eff30066e40 0x7eff30069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff46000640 1 -- 172.21.15.114:0/1514648597 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7eff3c11ece0 con 0x7eff500a7020 2024-02-17T12:20:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff4de00640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7eff30066e40 0x7eff30069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff46000640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] conn(0x7eff3006cda0 0x7eff3006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff46000640 1 -- 172.21.15.114:0/1514648597 --> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff3006f870 con 0x7eff3006cda0 2024-02-17T12:20:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.312+0000 7eff46000640 1 -- 172.21.15.114:0/1514648597 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff3c11f050 con 0x7eff500a7020 2024-02-17T12:20:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.316+0000 7eff4e800640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] conn(0x7eff3006cda0 0x7eff3006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.316+0000 7eff4de00640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7eff30066e40 0x7eff30069300 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7eff40009ae0 tx=0x7eff40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.316+0000 7eff4e800640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] conn(0x7eff3006cda0 0x7eff3006f1c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.316+0000 7eff46000640 1 -- 172.21.15.114:0/1514648597 <== osd.1 v2:172.21.15.114:6808/290668090 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7eff3006f870 con 0x7eff3006cda0 2024-02-17T12:20:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 --> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7eff50074840 con 0x7eff3006cda0 2024-02-17T12:20:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff46000640 1 -- 172.21.15.114:0/1514648597 <== osd.1 v2:172.21.15.114:6808/290668090 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7eff50074840 con 0x7eff3006cda0 2024-02-17T12:20:08.332 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:20:08.333 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T12:20:08.333 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:20:08.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] conn(0x7eff3006cda0 msgr2=0x7eff3006f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:6808/290668090,v1:172.21.15.114:6811/290668090] conn(0x7eff3006cda0 0x7eff3006f1c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7eff30066e40 msgr2=0x7eff30069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7eff30066e40 0x7eff30069300 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7eff40009ae0 tx=0x7eff40008040 comp rx=0 tx=0).stop 2024-02-17T12:20:08.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500a7020 msgr2=0x7eff500ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 --2- 172.21.15.114:0/1514648597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff500a7020 0x7eff500ac110 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0ae040 tx=0x7eff3c019120 comp rx=0 tx=0).stop 2024-02-17T12:20:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff4e800640 1 -- 172.21.15.114:0/1514648597 reap_dead start 2024-02-17T12:20:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 shutdown_connections 2024-02-17T12:20:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 >> 172.21.15.114:0/1514648597 conn(0x7eff5006b210 msgr2=0x7eff5014fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 shutdown_connections 2024-02-17T12:20:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.328+0000 7eff54c00640 1 -- 172.21.15.114:0/1514648597 wait complete. 2024-02-17T12:20:08.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-17T12:20:08.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c8c00640 1 Processor -- start 2024-02-17T12:20:08.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c8c00640 1 -- start start 2024-02-17T12:20:08.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c8c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f26c406f700 0x7f26c40ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c8c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c4072640 0x7f26c40c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c8c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c414f540 con 0x7f26c414f160 2024-02-17T12:20:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c8c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c4071e80 con 0x7f26c406f700 2024-02-17T12:20:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c8c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c406fce0 con 0x7f26c4072640 2024-02-17T12:20:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c1e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f26c414f160 0x7f26c4152540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48248/0 (socket says 172.21.15.114:48248) 2024-02-17T12:20:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c1e00640 1 -- 172.21.15.114:0/584598325 learned_addr learned my addr 172.21.15.114:0/584598325 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c1400640 1 --2- 172.21.15.114:0/584598325 >> v2:172.21.15.114:3300/0 conn(0x7f26c406f700 0x7f26c40ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c2800640 1 --2- 172.21.15.114:0/584598325 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c4072640 0x7f26c40c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c0a00640 1 -- 172.21.15.114:0/584598325 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697221508 0 0) 0x7f26c414f540 con 0x7f26c414f160 2024-02-17T12:20:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c0a00640 1 -- 172.21.15.114:0/584598325 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a8003530 con 0x7f26c414f160 2024-02-17T12:20:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c1400640 1 -- 172.21.15.114:0/584598325 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c4072640 msgr2=0x7f26c40c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c1400640 1 --2- 172.21.15.114:0/584598325 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c4072640 0x7f26c40c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c1400640 1 -- 172.21.15.114:0/584598325 >> v1:172.21.15.114:6789/0 conn(0x7f26c414f160 legacy=0x7f26c4152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.484+0000 7f26c1400640 1 -- 172.21.15.114:0/584598325 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c406ffc0 con 0x7f26c406f700 2024-02-17T12:20:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c1400640 1 --2- 172.21.15.114:0/584598325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c406f700 0x7f26c40ab5b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009d90 tx=0x7f26ac01d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fbfabed8269ec6 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c0a00640 1 -- 172.21.15.114:0/584598325 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0a5990 con 0x7f26c406f700 2024-02-17T12:20:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c0a00640 1 -- 172.21.15.114:0/584598325 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac0a5af0 con 0x7f26c406f700 2024-02-17T12:20:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c0a00640 1 -- 172.21.15.114:0/584598325 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac0a5e80 con 0x7f26c406f700 2024-02-17T12:20:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c8c00640 1 -- 172.21.15.114:0/584598325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c406f700 msgr2=0x7f26c40ab5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c8c00640 1 --2- 172.21.15.114:0/584598325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c406f700 0x7f26c40ab5b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009d90 tx=0x7f26ac01d310 comp rx=0 tx=0).stop 2024-02-17T12:20:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c8c00640 1 -- 172.21.15.114:0/584598325 shutdown_connections 2024-02-17T12:20:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c8c00640 1 --2- 172.21.15.114:0/584598325 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c4072640 0x7f26c40c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c8c00640 1 --2- 172.21.15.114:0/584598325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c406f700 0x7f26c40ab5b0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c8c00640 1 -- 172.21.15.114:0/584598325 >> 172.21.15.114:0/584598325 conn(0x7f26c406bef0 msgr2=0x7f26c406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c8c00640 1 -- 172.21.15.114:0/584598325 shutdown_connections 2024-02-17T12:20:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.488+0000 7f26c8c00640 1 -- 172.21.15.114:0/584598325 wait complete. 2024-02-17T12:20:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 Processor -- start 2024-02-17T12:20:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 -- start start 2024-02-17T12:20:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c406f700 0x7f26c4146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c4072640 0x7f26c4146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c414f160 0x7f26c41f1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40c67d0 con 0x7f26c414f160 2024-02-17T12:20:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40c38a0 con 0x7f26c4072640 2024-02-17T12:20:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40c5b90 con 0x7f26c406f700 2024-02-17T12:20:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c414f160 0x7f26c41f1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c414f160 0x7f26c41f1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50326/0 (socket says 172.21.15.114:50326) 2024-02-17T12:20:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c2800640 1 -- 172.21.15.114:0/3016448320 learned_addr learned my addr 172.21.15.114:0/3016448320 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c1e00640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c406f700 0x7f26c4146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c1400640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c4072640 0x7f26c4146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c2800640 1 -- 172.21.15.114:0/3016448320 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c406f700 msgr2=0x7f26c4146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c2800640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c406f700 0x7f26c4146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c2800640 1 -- 172.21.15.114:0/3016448320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c4072640 msgr2=0x7f26c4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c2800640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c4072640 0x7f26c4146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c2800640 1 -- 172.21.15.114:0/3016448320 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac009a70 con 0x7f26c414f160 2024-02-17T12:20:08.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c1400640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c4072640 0x7f26c4146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:20:08.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c1e00640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c406f700 0x7f26c4146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:20:08.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c2800640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c414f160 0x7f26c41f1190 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e930 tx=0x7f26bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26ba000640 1 -- 172.21.15.114:0/3016448320 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0096b0 con 0x7f26c414f160 2024-02-17T12:20:08.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26ba000640 1 -- 172.21.15.114:0/3016448320 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc00c9a0 con 0x7f26c414f160 2024-02-17T12:20:08.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26ba000640 1 -- 172.21.15.114:0/3016448320 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00cd30 con 0x7f26c414f160 2024-02-17T12:20:08.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 -- 172.21.15.114:0/3016448320 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c40c5e30 con 0x7f26c414f160 2024-02-17T12:20:08.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 -- 172.21.15.114:0/3016448320 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c40c63f0 con 0x7f26c414f160 2024-02-17T12:20:08.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.492+0000 7f26c8c00640 1 -- 172.21.15.114:0/3016448320 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c4067370 con 0x7f26c414f160 2024-02-17T12:20:08.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.496+0000 7f26ba000640 1 -- 172.21.15.114:0/3016448320 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f26bc013470 con 0x7f26c414f160 2024-02-17T12:20:08.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.496+0000 7f26ba000640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f26a0066e40 0x7f26a0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.496+0000 7f26ba000640 1 -- 172.21.15.114:0/3016448320 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f26bc084d50 con 0x7f26c414f160 2024-02-17T12:20:08.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.496+0000 7f26c1e00640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f26a0066e40 0x7f26a0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.496+0000 7f26c1e00640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f26a0066e40 0x7f26a0069300 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f26b4005890 tx=0x7f26b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.500+0000 7f26ba000640 1 -- 172.21.15.114:0/3016448320 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f26bc088030 con 0x7f26c414f160 2024-02-17T12:20:08.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 -- 172.21.15.114:0/3016448320 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f26c40c6910 con 0x7f26a0066e40 2024-02-17T12:20:08.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26ba000640 1 -- 172.21.15.114:0/3016448320 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f26c40c6910 con 0x7f26a0066e40 2024-02-17T12:20:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 1 to deep-scrub 2024-02-17T12:20:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 -- 172.21.15.114:0/3016448320 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f26a0066e40 msgr2=0x7f26a0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f26a0066e40 0x7f26a0069300 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f26b4005890 tx=0x7f26b4009040 comp rx=0 tx=0).stop 2024-02-17T12:20:08.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 -- 172.21.15.114:0/3016448320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c414f160 msgr2=0x7f26c41f1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c414f160 0x7f26c41f1190 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e930 tx=0x7f26bc00edf0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 -- 172.21.15.114:0/3016448320 shutdown_connections 2024-02-17T12:20:08.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f26a0066e40 0x7f26a0069300 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c414f160 0x7f26c41f1190 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f26c4072640 0x7f26c4146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 --2- 172.21.15.114:0/3016448320 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f26c406f700 0x7f26c4146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 -- 172.21.15.114:0/3016448320 >> 172.21.15.114:0/3016448320 conn(0x7f26c406bef0 msgr2=0x7f26c406c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 -- 172.21.15.114:0/3016448320 shutdown_connections 2024-02-17T12:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.652+0000 7f26c8c00640 1 -- 172.21.15.114:0/3016448320 wait complete. 2024-02-17T12:20:08.674 INFO:tasks.ceph:Scrubbing osd.2 2024-02-17T12:20:08.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-17T12:20:08.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.808+0000 7ffb21000640 1 Processor -- start 2024-02-17T12:20:08.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.808+0000 7ffb21000640 1 -- start start 2024-02-17T12:20:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb21000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ffb1c06e860 0x7ffb1c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb21000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c153640 con 0x7ffb1c0c38e0 2024-02-17T12:20:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb21000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c153b70 con 0x7ffb1c0a6590 2024-02-17T12:20:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb21000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1c0c3cc0 con 0x7ffb1c06e860 2024-02-17T12:20:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb19e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffb1c0c38e0 0x7ffb1c0a6ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48264/0 (socket says 172.21.15.114:48264) 2024-02-17T12:20:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb19e00640 1 -- 172.21.15.114:0/2626824147 learned_addr learned my addr 172.21.15.114:0/2626824147 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb1a800640 1 --2- 172.21.15.114:0/2626824147 >> v2:172.21.15.116:3300/0 conn(0x7ffb1c06e860 0x7ffb1c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880843356 0 0) 0x7ffb1c153640 con 0x7ffb1c0c38e0 2024-02-17T12:20:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb00003530 con 0x7ffb1c0c38e0 2024-02-17T12:20:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4009862853 0 0) 0x7ffb00003530 con 0x7ffb1c0c38e0 2024-02-17T12:20:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 >> v2:172.21.15.116:3300/0 conn(0x7ffb1c06e860 msgr2=0x7ffb1c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:08.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 --2- 172.21.15.114:0/2626824147 >> v2:172.21.15.116:3300/0 conn(0x7ffb1c06e860 0x7ffb1c154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 >> v1:172.21.15.116:6789/0 conn(0x7ffb1c0a6590 legacy=0x7ffb1c1543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0a7590 con 0x7ffb1c0c38e0 2024-02-17T12:20:08.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7ffb0c001680 con 0x7ffb1c0c38e0 2024-02-17T12:20:08.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 >> v1:172.21.15.114:6789/0 conn(0x7ffb1c0c38e0 legacy=0x7ffb1c0a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb00003980 0x7ffb00003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb000047d0 0x7ffb00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb00005190 0x7ffb0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0000c0b0 con 0x7ffb000047d0 2024-02-17T12:20:08.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0000c220 con 0x7ffb00003980 2024-02-17T12:20:08.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0000c3e0 con 0x7ffb00005190 2024-02-17T12:20:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb19400640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb000047d0 0x7ffb00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb19e00640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb00003980 0x7ffb00003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb1a800640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb00005190 0x7ffb0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb19400640 1 -- 172.21.15.114:0/2626824147 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb00005190 msgr2=0x7ffb0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb19400640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb00005190 0x7ffb0000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb19400640 1 -- 172.21.15.114:0/2626824147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb00003980 msgr2=0x7ffb00003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb19400640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb00003980 0x7ffb00003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb19400640 1 -- 172.21.15.114:0/2626824147 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb00003530 con 0x7ffb000047d0 2024-02-17T12:20:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.812+0000 7ffb1a800640 1 -- 172.21.15.114:0/2626824147 reap_dead start 2024-02-17T12:20:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb19400640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb000047d0 0x7ffb00004c50 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ffb08001860 tx=0x7ffb0801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ffa2d62e39df2e server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb080ab400 con 0x7ffb000047d0 2024-02-17T12:20:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb080a7050 con 0x7ffb000047d0 2024-02-17T12:20:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb18a00640 1 -- 172.21.15.114:0/2626824147 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb080ab7e0 con 0x7ffb000047d0 2024-02-17T12:20:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb21000640 1 -- 172.21.15.114:0/2626824147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb000047d0 msgr2=0x7ffb00004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb21000640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb000047d0 0x7ffb00004c50 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ffb08001860 tx=0x7ffb0801c4e0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb21000640 1 -- 172.21.15.114:0/2626824147 shutdown_connections 2024-02-17T12:20:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb21000640 1 --2- 172.21.15.114:0/2626824147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb000047d0 0x7ffb00004c50 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb21000640 1 -- 172.21.15.114:0/2626824147 >> 172.21.15.114:0/2626824147 conn(0x7ffb1c06b210 msgr2=0x7ffb1c06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb21000640 1 -- 172.21.15.114:0/2626824147 shutdown_connections 2024-02-17T12:20:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb21000640 1 -- 172.21.15.114:0/2626824147 wait complete. 2024-02-17T12:20:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb21000640 1 Processor -- start 2024-02-17T12:20:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.816+0000 7ffb21000640 1 -- start start 2024-02-17T12:20:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb21000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb000047d0 0x7ffb1c0c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb21000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb1c0ab0e0 0x7ffb1c144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb21000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1c1e0c60 0x7ffb1c144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb21000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0a9910 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb21000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0ab9e0 con 0x7ffb000047d0 2024-02-17T12:20:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb21000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0ac540 con 0x7ffb1c0ab0e0 2024-02-17T12:20:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb1a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1c1e0c60 0x7ffb1c144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb1a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1c1e0c60 0x7ffb1c144ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50330/0 (socket says 172.21.15.114:50330) 2024-02-17T12:20:08.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb1a800640 1 -- 172.21.15.114:0/880460548 learned_addr learned my addr 172.21.15.114:0/880460548 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:08.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb19400640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb1c0ab0e0 0x7ffb1c144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb19e00640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb000047d0 0x7ffb1c0c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb1a800640 1 -- 172.21.15.114:0/880460548 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb1c0ab0e0 msgr2=0x7ffb1c144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb1a800640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffb1c0ab0e0 0x7ffb1c144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb1a800640 1 -- 172.21.15.114:0/880460548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb000047d0 msgr2=0x7ffb1c0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb1a800640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffb000047d0 0x7ffb1c0c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb1a800640 1 -- 172.21.15.114:0/880460548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0abc10 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb1a800640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1c1e0c60 0x7ffb1c144ab0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c073380 tx=0x7ffb1400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb12000640 1 -- 172.21.15.114:0/880460548 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400e040 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb12000640 1 -- 172.21.15.114:0/880460548 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1400f040 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb12000640 1 -- 172.21.15.114:0/880460548 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14015430 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c0abef0 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c1458f0 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb1c1506a0 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.820+0000 7ffb12000640 1 -- 172.21.15.114:0/880460548 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ffb14015590 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.824+0000 7ffb12000640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffafc066e70 0x7ffafc069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.824+0000 7ffb12000640 1 -- 172.21.15.114:0/880460548 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ffb14085270 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.824+0000 7ffb19e00640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffafc066e70 0x7ffafc069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.824+0000 7ffb12000640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] conn(0x7ffafc06cdd0 0x7ffafc06f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.824+0000 7ffb12000640 1 -- 172.21.15.114:0/880460548 --> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffafc06f8a0 con 0x7ffafc06cdd0 2024-02-17T12:20:08.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.824+0000 7ffb12000640 1 -- 172.21.15.114:0/880460548 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb140877f0 con 0x7ffb1c1e0c60 2024-02-17T12:20:08.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.824+0000 7ffb19400640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] conn(0x7ffafc06cdd0 0x7ffafc06f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.824+0000 7ffb19e00640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffafc066e70 0x7ffafc069330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c050830 tx=0x7ffb0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.824+0000 7ffb19400640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] conn(0x7ffafc06cdd0 0x7ffafc06f1f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:08.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.824+0000 7ffb12000640 1 -- 172.21.15.114:0/880460548 <== osd.2 v2:172.21.15.114:6800/419916160 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ffafc06f8a0 con 0x7ffafc06cdd0 2024-02-17T12:20:08.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.836+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 --> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffb1c0ac680 con 0x7ffafc06cdd0 2024-02-17T12:20:08.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.836+0000 7ffb12000640 1 -- 172.21.15.114:0/880460548 <== osd.2 v2:172.21.15.114:6800/419916160 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffb080a4e90 con 0x7ffafc06cdd0 2024-02-17T12:20:08.841 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:20:08.842 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T12:20:08.842 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:20:08.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] conn(0x7ffafc06cdd0 msgr2=0x7ffafc06f1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb21000640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:6800/419916160,v1:172.21.15.114:6801/419916160] conn(0x7ffafc06cdd0 0x7ffafc06f1f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:08.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffafc066e70 msgr2=0x7ffafc069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb21000640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ffafc066e70 0x7ffafc069330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c050830 tx=0x7ffb0c009040 comp rx=0 tx=0).stop 2024-02-17T12:20:08.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1c1e0c60 msgr2=0x7ffb1c144ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:08.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb21000640 1 --2- 172.21.15.114:0/880460548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1c1e0c60 0x7ffb1c144ab0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c073380 tx=0x7ffb1400f580 comp rx=0 tx=0).stop 2024-02-17T12:20:08.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb1a800640 1 -- 172.21.15.114:0/880460548 reap_dead start 2024-02-17T12:20:08.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 shutdown_connections 2024-02-17T12:20:08.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 >> 172.21.15.114:0/880460548 conn(0x7ffb1c06b210 msgr2=0x7ffb1c156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:08.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 shutdown_connections 2024-02-17T12:20:08.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.840+0000 7ffb21000640 1 -- 172.21.15.114:0/880460548 wait complete. 2024-02-17T12:20:08.860 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-17T12:20:08.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.992+0000 7f03f3400640 1 Processor -- start 2024-02-17T12:20:08.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.992+0000 7f03f3400640 1 -- start start 2024-02-17T12:20:08.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f3400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03ec14f110 0x7f03ec0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f3400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f03ec0c2580 0x7f03ec0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f3400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03ec0c1eb0 0x7f03ec155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:08.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f3400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec14f4f0 con 0x7f03ec0c1eb0 2024-02-17T12:20:08.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f3400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec0aae80 con 0x7f03ec0c2580 2024-02-17T12:20:08.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f3400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0a9420 con 0x7f03ec14f110 2024-02-17T12:20:08.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f1400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03ec0c1eb0 0x7f03ec155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:08.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f1400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f03ec0c1eb0 0x7f03ec155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50336/0 (socket says 172.21.15.114:50336) 2024-02-17T12:20:08.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f1400640 1 -- 172.21.15.114:0/1560766206 learned_addr learned my addr 172.21.15.114:0/1560766206 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:09.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f1400640 1 -- 172.21.15.114:0/1560766206 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03ec14f110 msgr2=0x7f03ec0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:09.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f1400640 1 --2- 172.21.15.114:0/1560766206 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03ec14f110 0x7f03ec0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f1400640 1 -- 172.21.15.114:0/1560766206 >> v2:172.21.15.116:3300/0 conn(0x7f03ec0c2580 msgr2=0x7f03ec0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:09.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f1400640 1 --2- 172.21.15.114:0/1560766206 >> v2:172.21.15.116:3300/0 conn(0x7f03ec0c2580 0x7f03ec0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f1400640 1 -- 172.21.15.114:0/1560766206 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec152850 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03f1400640 1 --2- 172.21.15.114:0/1560766206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 0x7f03ec155000 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0a91c0 tx=0x7f03e401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eaa08e7ffb5fe3a server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03eb400640 1 -- 172.21.15.114:0/1560766206 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e40a57b0 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03eb400640 1 -- 172.21.15.114:0/1560766206 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e40a5910 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:08.996+0000 7f03eb400640 1 -- 172.21.15.114:0/1560766206 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e40a5ca0 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 -- 172.21.15.114:0/1560766206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 msgr2=0x7f03ec155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 --2- 172.21.15.114:0/1560766206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 0x7f03ec155000 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0a91c0 tx=0x7f03e401c930 comp rx=0 tx=0).stop 2024-02-17T12:20:09.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 -- 172.21.15.114:0/1560766206 shutdown_connections 2024-02-17T12:20:09.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 --2- 172.21.15.114:0/1560766206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 0x7f03ec155000 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 --2- 172.21.15.114:0/1560766206 >> v2:172.21.15.116:3300/0 conn(0x7f03ec0c2580 0x7f03ec0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 --2- 172.21.15.114:0/1560766206 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03ec14f110 0x7f03ec0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 -- 172.21.15.114:0/1560766206 >> 172.21.15.114:0/1560766206 conn(0x7f03ec0a8490 msgr2=0x7f03ec0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:09.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 -- 172.21.15.114:0/1560766206 shutdown_connections 2024-02-17T12:20:09.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 -- 172.21.15.114:0/1560766206 wait complete. 2024-02-17T12:20:09.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 Processor -- start 2024-02-17T12:20:09.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 -- start start 2024-02-17T12:20:09.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 0x7f03ec072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec0c2580 0x7f03ec0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03ec14f110 0x7f03ec1543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0c4200 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0c60d0 con 0x7f03ec0c2580 2024-02-17T12:20:09.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f3400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec150f40 con 0x7f03ec14f110 2024-02-17T12:20:09.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 0x7f03ec072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 0x7f03ec072450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50348/0 (socket says 172.21.15.114:50348) 2024-02-17T12:20:09.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f0a00640 1 -- 172.21.15.114:0/1335025673 learned_addr learned my addr 172.21.15.114:0/1335025673 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:09.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f1400640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03ec14f110 0x7f03ec1543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03ebe00640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec0c2580 0x7f03ec0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f0a00640 1 -- 172.21.15.114:0/1335025673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03ec14f110 msgr2=0x7f03ec1543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f0a00640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03ec14f110 0x7f03ec1543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f0a00640 1 -- 172.21.15.114:0/1335025673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec0c2580 msgr2=0x7f03ec0c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f0a00640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec0c2580 0x7f03ec0c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.000+0000 7f03f0a00640 1 -- 172.21.15.114:0/1335025673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e4009b30 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03f0a00640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 0x7f03ec072450 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f03e000b550 tx=0x7f03e000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03e8c00640 1 -- 172.21.15.114:0/1335025673 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0010870 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03e8c00640 1 -- 172.21.15.114:0/1335025673 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e00109f0 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03e8c00640 1 -- 172.21.15.114:0/1335025673 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0010da0 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03f3400640 1 -- 172.21.15.114:0/1335025673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec151220 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03f3400640 1 -- 172.21.15.114:0/1335025673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec1517e0 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03f3400640 1 -- 172.21.15.114:0/1335025673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec074840 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03e8c00640 1 -- 172.21.15.114:0/1335025673 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f03e000f3c0 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03e8c00640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f03cc066e40 0x7f03cc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03e8c00640 1 -- 172.21.15.114:0/1335025673 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f03e00846f0 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.004+0000 7f03ebe00640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f03cc066e40 0x7f03cc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.008+0000 7f03ebe00640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f03cc066e40 0x7f03cc069300 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f03d8006fd0 tx=0x7f03d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.008+0000 7f03e8c00640 1 -- 172.21.15.114:0/1335025673 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f03e0051830 con 0x7f03ec0c1eb0 2024-02-17T12:20:09.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 -- 172.21.15.114:0/1335025673 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f03ec155d50 con 0x7f03cc066e40 2024-02-17T12:20:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03e8c00640 1 -- 172.21.15.114:0/1335025673 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f03d8009e20 con 0x7f03cc066e40 2024-02-17T12:20:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 2 to deep-scrub 2024-02-17T12:20:09.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 -- 172.21.15.114:0/1335025673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f03cc066e40 msgr2=0x7f03cc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f03cc066e40 0x7f03cc069300 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f03d8006fd0 tx=0x7f03d8008040 comp rx=0 tx=0).stop 2024-02-17T12:20:09.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 -- 172.21.15.114:0/1335025673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 msgr2=0x7f03ec072450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 0x7f03ec072450 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f03e000b550 tx=0x7f03e000ba10 comp rx=0 tx=0).stop 2024-02-17T12:20:09.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 -- 172.21.15.114:0/1335025673 shutdown_connections 2024-02-17T12:20:09.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03ec14f110 0x7f03ec1543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03ec0c2580 0x7f03ec0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f03cc066e40 0x7f03cc069300 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 --2- 172.21.15.114:0/1335025673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03ec0c1eb0 0x7f03ec072450 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 -- 172.21.15.114:0/1335025673 >> 172.21.15.114:0/1335025673 conn(0x7f03ec0a8490 msgr2=0x7f03ec142c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 -- 172.21.15.114:0/1335025673 shutdown_connections 2024-02-17T12:20:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.164+0000 7f03f3400640 1 -- 172.21.15.114:0/1335025673 wait complete. 2024-02-17T12:20:09.188 INFO:tasks.ceph:Scrubbing osd.3 2024-02-17T12:20:09.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-17T12:20:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac7e00640 1 Processor -- start 2024-02-17T12:20:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac7e00640 1 -- start start 2024-02-17T12:20:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbac00a7dd0 0x7fbac00c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac7e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac00c2e00 con 0x7fbac00c2530 2024-02-17T12:20:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac7e00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac00c30e0 con 0x7fbac014f310 2024-02-17T12:20:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac7e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac00a6980 con 0x7fbac00a7dd0 2024-02-17T12:20:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac5e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbac00c2530 0x7fbac00c3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48274/0 (socket says 172.21.15.114:48274) 2024-02-17T12:20:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac4a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbac00a7dd0 0x7fbac00c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac5e00640 1 -- 172.21.15.114:0/455495619 learned_addr learned my addr 172.21.15.114:0/455495619 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac4a00640 1 -- 172.21.15.114:0/455495619 >> v1:172.21.15.116:6789/0 conn(0x7fbac014f310 legacy=0x7fbac01524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac4a00640 1 -- 172.21.15.114:0/455495619 >> v1:172.21.15.114:6789/0 conn(0x7fbac00c2530 legacy=0x7fbac00c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.324+0000 7fbac4a00640 1 -- 172.21.15.114:0/455495619 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac014f6f0 con 0x7fbac00a7dd0 2024-02-17T12:20:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbac4a00640 1 --2- 172.21.15.114:0/455495619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00a7dd0 0x7fbac00c1ff0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0097c0 tx=0x7fbaac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0173a36e9840cc7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbabfe00640 1 -- 172.21.15.114:0/455495619 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0a8050 con 0x7fbac00a7dd0 2024-02-17T12:20:09.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbabfe00640 1 -- 172.21.15.114:0/455495619 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac0ac5f0 con 0x7fbac00a7dd0 2024-02-17T12:20:09.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbabfe00640 1 -- 172.21.15.114:0/455495619 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0ac980 con 0x7fbac00a7dd0 2024-02-17T12:20:09.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbac7e00640 1 -- 172.21.15.114:0/455495619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00a7dd0 msgr2=0x7fbac00c1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbac7e00640 1 --2- 172.21.15.114:0/455495619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00a7dd0 0x7fbac00c1ff0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0097c0 tx=0x7fbaac01c4a0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbac7e00640 1 -- 172.21.15.114:0/455495619 shutdown_connections 2024-02-17T12:20:09.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbac7e00640 1 --2- 172.21.15.114:0/455495619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00a7dd0 0x7fbac00c1ff0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbac7e00640 1 -- 172.21.15.114:0/455495619 >> 172.21.15.114:0/455495619 conn(0x7fbac006b210 msgr2=0x7fbac006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:09.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbac7e00640 1 -- 172.21.15.114:0/455495619 shutdown_connections 2024-02-17T12:20:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.328+0000 7fbac7e00640 1 -- 172.21.15.114:0/455495619 wait complete. 2024-02-17T12:20:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 Processor -- start 2024-02-17T12:20:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 -- start start 2024-02-17T12:20:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbac00a7dd0 0x7fbac01ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00c2530 0x7fbac00a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbac014f310 0x7fbac01edd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01ef850 con 0x7fbac00c2530 2024-02-17T12:20:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00ab700 con 0x7fbac00a7dd0 2024-02-17T12:20:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00ab9e0 con 0x7fbac014f310 2024-02-17T12:20:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00c2530 0x7fbac00a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00c2530 0x7fbac00a97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50364/0 (socket says 172.21.15.114:50364) 2024-02-17T12:20:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac4a00640 1 -- 172.21.15.114:0/900416631 learned_addr learned my addr 172.21.15.114:0/900416631 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac5e00640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbac014f310 0x7fbac01edd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac5400640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbac00a7dd0 0x7fbac01ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac4a00640 1 -- 172.21.15.114:0/900416631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbac014f310 msgr2=0x7fbac01edd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac4a00640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbac014f310 0x7fbac01edd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac4a00640 1 -- 172.21.15.114:0/900416631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbac00a7dd0 msgr2=0x7fbac01ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac4a00640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbac00a7dd0 0x7fbac01ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac4a00640 1 -- 172.21.15.114:0/900416631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac009420 con 0x7fbac00c2530 2024-02-17T12:20:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac4a00640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00c2530 0x7fbac00a97f0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0af040 tx=0x7fbaac019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbabd600640 1 -- 172.21.15.114:0/900416631 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0b5620 con 0x7fbac00c2530 2024-02-17T12:20:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbabd600640 1 -- 172.21.15.114:0/900416631 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac0b5780 con 0x7fbac00c2530 2024-02-17T12:20:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbabd600640 1 -- 172.21.15.114:0/900416631 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0b5b30 con 0x7fbac00c2530 2024-02-17T12:20:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac00abcc0 con 0x7fbac00c2530 2024-02-17T12:20:09.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac00a9d30 con 0x7fbac00c2530 2024-02-17T12:20:09.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.332+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbac0142e30 con 0x7fbac00c2530 2024-02-17T12:20:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbabd600640 1 -- 172.21.15.114:0/900416631 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbaac0b3040 con 0x7fbac00c2530 2024-02-17T12:20:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbabd600640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbaa0066e40 0x7fbaa0069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbabd600640 1 -- 172.21.15.114:0/900416631 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbaac11e610 con 0x7fbac00c2530 2024-02-17T12:20:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbac5400640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbaa0066e40 0x7fbaa0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbabd600640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] conn(0x7fbaa006cda0 0x7fbaa006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbabd600640 1 -- 172.21.15.114:0/900416631 --> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbaa006f870 con 0x7fbaa006cda0 2024-02-17T12:20:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbabd600640 1 -- 172.21.15.114:0/900416631 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaac0a8020 con 0x7fbac00c2530 2024-02-17T12:20:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbac5e00640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] conn(0x7fbaa006cda0 0x7fbaa006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbac5400640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbaa0066e40 0x7fbaa0069300 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000f70 tx=0x7fbab4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbac5e00640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] conn(0x7fbaa006cda0 0x7fbaa006f1c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.336+0000 7fbabd600640 1 -- 172.21.15.114:0/900416631 <== osd.3 v2:172.21.15.114:6809/3161691811 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbaa006f870 con 0x7fbaa006cda0 2024-02-17T12:20:09.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 --> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbac015fc50 con 0x7fbaa006cda0 2024-02-17T12:20:09.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbabd600640 1 -- 172.21.15.114:0/900416631 <== osd.3 v2:172.21.15.114:6809/3161691811 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbab80070e0 con 0x7fbaa006cda0 2024-02-17T12:20:09.354 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:20:09.354 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T12:20:09.355 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:20:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] conn(0x7fbaa006cda0 msgr2=0x7fbaa006f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:6809/3161691811,v1:172.21.15.114:6810/3161691811] conn(0x7fbaa006cda0 0x7fbaa006f1c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbaa0066e40 msgr2=0x7fbaa0069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbaa0066e40 0x7fbaa0069300 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000f70 tx=0x7fbab4009040 comp rx=0 tx=0).stop 2024-02-17T12:20:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00c2530 msgr2=0x7fbac00a97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 --2- 172.21.15.114:0/900416631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac00c2530 0x7fbac00a97f0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0af040 tx=0x7fbaac019240 comp rx=0 tx=0).stop 2024-02-17T12:20:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac5e00640 1 -- 172.21.15.114:0/900416631 reap_dead start 2024-02-17T12:20:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 shutdown_connections 2024-02-17T12:20:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 >> 172.21.15.114:0/900416631 conn(0x7fbac006b210 msgr2=0x7fbac01551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 shutdown_connections 2024-02-17T12:20:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.352+0000 7fbac7e00640 1 -- 172.21.15.114:0/900416631 wait complete. 2024-02-17T12:20:09.373 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-17T12:20:09.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f9502c00640 1 Processor -- start 2024-02-17T12:20:09.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f9502c00640 1 -- start start 2024-02-17T12:20:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f9502c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f94fc06db50 0x7f94fc14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f9502c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94fc150490 0x7f94fc152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f9502c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94fc156270 con 0x7f94fc0c25a0 2024-02-17T12:20:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f9502c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94fc06f090 con 0x7f94fc06db50 2024-02-17T12:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f9502c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc071630 con 0x7f94fc150490 2024-02-17T12:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f94fbe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f94fc0c25a0 0x7f94fc06e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48276/0 (socket says 172.21.15.114:48276) 2024-02-17T12:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f94fbe00640 1 -- 172.21.15.114:0/2081079183 learned_addr learned my addr 172.21.15.114:0/2081079183 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f94fb400640 1 --2- 172.21.15.114:0/2081079183 >> v2:172.21.15.116:3300/0 conn(0x7f94fc06db50 0x7f94fc14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f9500c00640 1 --2- 172.21.15.114:0/2081079183 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94fc150490 0x7f94fc152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f94fb400640 1 -- 172.21.15.114:0/2081079183 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94fc150490 msgr2=0x7f94fc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f94fb400640 1 --2- 172.21.15.114:0/2081079183 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94fc150490 0x7f94fc152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f94fb400640 1 -- 172.21.15.114:0/2081079183 >> v1:172.21.15.114:6789/0 conn(0x7f94fc0c25a0 legacy=0x7f94fc06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.508+0000 7f94fb400640 1 -- 172.21.15.114:0/2081079183 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc156550 con 0x7f94fc06db50 2024-02-17T12:20:09.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f94fb400640 1 --2- 172.21.15.114:0/2081079183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94fc06db50 0x7f94fc14ff50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94e80097c0 tx=0x7f94e801c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e1fc7ca386d230f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f94faa00640 1 -- 172.21.15.114:0/2081079183 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc1539a0 con 0x7f94fc06db50 2024-02-17T12:20:09.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f94faa00640 1 -- 172.21.15.114:0/2081079183 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e80a7050 con 0x7f94fc06db50 2024-02-17T12:20:09.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f94faa00640 1 -- 172.21.15.114:0/2081079183 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80ab820 con 0x7f94fc06db50 2024-02-17T12:20:09.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f9502c00640 1 -- 172.21.15.114:0/2081079183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94fc06db50 msgr2=0x7f94fc14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f9502c00640 1 --2- 172.21.15.114:0/2081079183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94fc06db50 0x7f94fc14ff50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94e80097c0 tx=0x7f94e801c350 comp rx=0 tx=0).stop 2024-02-17T12:20:09.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f9502c00640 1 -- 172.21.15.114:0/2081079183 shutdown_connections 2024-02-17T12:20:09.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f9502c00640 1 --2- 172.21.15.114:0/2081079183 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94fc150490 0x7f94fc152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f9502c00640 1 --2- 172.21.15.114:0/2081079183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94fc06db50 0x7f94fc14ff50 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f9502c00640 1 -- 172.21.15.114:0/2081079183 >> 172.21.15.114:0/2081079183 conn(0x7f94fc0a8490 msgr2=0x7f94fc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:09.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f9502c00640 1 -- 172.21.15.114:0/2081079183 shutdown_connections 2024-02-17T12:20:09.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f9502c00640 1 -- 172.21.15.114:0/2081079183 wait complete. 2024-02-17T12:20:09.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.512+0000 7f9502c00640 1 Processor -- start 2024-02-17T12:20:09.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9502c00640 1 -- start start 2024-02-17T12:20:09.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9502c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94fc06db50 0x7f94fc140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9502c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94fc0c25a0 0x7f94fc1eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9502c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94fc150490 0x7f94fc1552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9502c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc142a80 con 0x7f94fc0c25a0 2024-02-17T12:20:09.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9502c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc142270 con 0x7f94fc06db50 2024-02-17T12:20:09.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9502c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc144240 con 0x7f94fc150490 2024-02-17T12:20:09.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94fb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94fc0c25a0 0x7f94fc1eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94fb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94fc0c25a0 0x7f94fc1eedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50370/0 (socket says 172.21.15.114:50370) 2024-02-17T12:20:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94fb400640 1 -- 172.21.15.114:0/2159546074 learned_addr learned my addr 172.21.15.114:0/2159546074 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94fbe00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94fc06db50 0x7f94fc140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9500c00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94fc150490 0x7f94fc1552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94fb400640 1 -- 172.21.15.114:0/2159546074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94fc150490 msgr2=0x7f94fc1552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94fb400640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94fc150490 0x7f94fc1552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94fb400640 1 -- 172.21.15.114:0/2159546074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94fc06db50 msgr2=0x7f94fc140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94fb400640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94fc06db50 0x7f94fc140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94fb400640 1 -- 172.21.15.114:0/2159546074 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e8009420 con 0x7f94fc0c25a0 2024-02-17T12:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94fb400640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94fc0c25a0 0x7f94fc1eedd0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f94e80ae040 tx=0x7f94e80190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94f3e00640 1 -- 172.21.15.114:0/2159546074 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80b4430 con 0x7f94fc0c25a0 2024-02-17T12:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94f3e00640 1 -- 172.21.15.114:0/2159546074 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e80b4590 con 0x7f94fc0c25a0 2024-02-17T12:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9502c00640 1 -- 172.21.15.114:0/2159546074 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94fc1424c0 con 0x7f94fc0c25a0 2024-02-17T12:20:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f94f3e00640 1 -- 172.21.15.114:0/2159546074 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80b4940 con 0x7f94fc0c25a0 2024-02-17T12:20:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9502c00640 1 -- 172.21.15.114:0/2159546074 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94fc1ee5d0 con 0x7f94fc0c25a0 2024-02-17T12:20:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.516+0000 7f9502c00640 1 -- 172.21.15.114:0/2159546074 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94fc1ee430 con 0x7f94fc0c25a0 2024-02-17T12:20:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.520+0000 7f94f3e00640 1 -- 172.21.15.114:0/2159546074 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f94e80b2040 con 0x7f94fc0c25a0 2024-02-17T12:20:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.520+0000 7f94f3e00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e40 0x7f94dc069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.520+0000 7f94f3e00640 1 -- 172.21.15.114:0/2159546074 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f94e811e670 con 0x7f94fc0c25a0 2024-02-17T12:20:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.520+0000 7f94fbe00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e40 0x7f94dc069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.520+0000 7f94fbe00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e40 0x7f94dc069300 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f94ec000f70 tx=0x7f94ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.524+0000 7f94f3e00640 1 -- 172.21.15.114:0/2159546074 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94fc1ee430 con 0x7f94fc0c25a0 2024-02-17T12:20:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.676+0000 7f9502c00640 1 -- 172.21.15.114:0/2159546074 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f94fc1ee430 con 0x7f94dc066e40 2024-02-17T12:20:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.676+0000 7f94f3e00640 1 -- 172.21.15.114:0/2159546074 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f94fc1ee430 con 0x7f94dc066e40 2024-02-17T12:20:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 3 to deep-scrub 2024-02-17T12:20:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.676+0000 7f9502c00640 1 -- 172.21.15.114:0/2159546074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e40 msgr2=0x7f94dc069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.676+0000 7f9502c00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e40 0x7f94dc069300 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f94ec000f70 tx=0x7f94ec009040 comp rx=0 tx=0).stop 2024-02-17T12:20:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.676+0000 7f9502c00640 1 -- 172.21.15.114:0/2159546074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94fc0c25a0 msgr2=0x7f94fc1eedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.676+0000 7f9502c00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94fc0c25a0 0x7f94fc1eedd0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f94e80ae040 tx=0x7f94e80190f0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.680+0000 7f9502c00640 1 -- 172.21.15.114:0/2159546074 shutdown_connections 2024-02-17T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.680+0000 7f9502c00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f94fc150490 0x7f94fc1552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.680+0000 7f9502c00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f94dc066e40 0x7f94dc069300 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.680+0000 7f9502c00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94fc0c25a0 0x7f94fc1eedd0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.680+0000 7f9502c00640 1 --2- 172.21.15.114:0/2159546074 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94fc06db50 0x7f94fc140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.680+0000 7f9502c00640 1 -- 172.21.15.114:0/2159546074 >> 172.21.15.114:0/2159546074 conn(0x7f94fc0a8490 msgr2=0x7f94fc1509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.680+0000 7f9502c00640 1 -- 172.21.15.114:0/2159546074 shutdown_connections 2024-02-17T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.680+0000 7f9502c00640 1 -- 172.21.15.114:0/2159546074 wait complete. 2024-02-17T12:20:09.701 INFO:tasks.ceph:Scrubbing osd.4 2024-02-17T12:20:09.701 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-17T12:20:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbeba00640 1 Processor -- start 2024-02-17T12:20:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbeba00640 1 -- start start 2024-02-17T12:20:09.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbeba00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbbe40c66c0 0x7fbbe40c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbeba00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c71d0 0x7fbbe41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbeba00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40c7690 con 0x7fbbe4158d10 2024-02-17T12:20:09.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbeba00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe406c2e0 con 0x7fbbe40c66c0 2024-02-17T12:20:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbeba00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40c78e0 con 0x7fbbe40c71d0 2024-02-17T12:20:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbe3e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c71d0 0x7fbbe41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbe9a00640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fbbe4158d10 0x7fbbe40c1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:35298/0 (socket says 172.21.15.114:35298) 2024-02-17T12:20:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbe3e00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c71d0 0x7fbbe41587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:43176/0 (socket says 172.21.15.114:43176) 2024-02-17T12:20:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbe3e00640 1 -- 172.21.15.114:0/2709796994 learned_addr learned my addr 172.21.15.114:0/2709796994 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbe9000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbbe40c66c0 0x7fbbe40c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbe3e00640 1 -- 172.21.15.114:0/2709796994 >> v2:172.21.15.116:3300/0 conn(0x7fbbe40c66c0 msgr2=0x7fbbe40c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbe3e00640 1 --2- 172.21.15.114:0/2709796994 >> v2:172.21.15.116:3300/0 conn(0x7fbbe40c66c0 0x7fbbe40c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbe3e00640 1 -- 172.21.15.114:0/2709796994 >> v1:172.21.15.116:6789/0 conn(0x7fbbe4158d10 legacy=0x7fbbe40c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbe3e00640 1 -- 172.21.15.114:0/2709796994 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40c7bc0 con 0x7fbbe40c71d0 2024-02-17T12:20:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.836+0000 7fbbe3400640 1 -- 172.21.15.114:0/2709796994 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9282502 0 0) 0x7fbbe40c7690 con 0x7fbbe4158d10 2024-02-17T12:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbe3e00640 1 --2- 172.21.15.114:0/2709796994 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c71d0 0x7fbbe41587d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009870 tx=0x7fbbd001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79a0f26c84bcdbc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbe3400640 1 -- 172.21.15.114:0/2709796994 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00ac620 con 0x7fbbe40c71d0 2024-02-17T12:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbe3400640 1 -- 172.21.15.114:0/2709796994 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd00ac780 con 0x7fbbe40c71d0 2024-02-17T12:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbe3400640 1 -- 172.21.15.114:0/2709796994 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00acb10 con 0x7fbbe40c71d0 2024-02-17T12:20:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbeba00640 1 -- 172.21.15.114:0/2709796994 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c71d0 msgr2=0x7fbbe41587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbeba00640 1 --2- 172.21.15.114:0/2709796994 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c71d0 0x7fbbe41587d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009870 tx=0x7fbbd001c4d0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbeba00640 1 -- 172.21.15.114:0/2709796994 shutdown_connections 2024-02-17T12:20:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbeba00640 1 --2- 172.21.15.114:0/2709796994 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c71d0 0x7fbbe41587d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbeba00640 1 --2- 172.21.15.114:0/2709796994 >> v2:172.21.15.116:3300/0 conn(0x7fbbe40c66c0 0x7fbbe40c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbeba00640 1 -- 172.21.15.114:0/2709796994 >> 172.21.15.114:0/2709796994 conn(0x7fbbe40c8520 msgr2=0x7fbbe40c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbeba00640 1 -- 172.21.15.114:0/2709796994 shutdown_connections 2024-02-17T12:20:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.840+0000 7fbbeba00640 1 -- 172.21.15.114:0/2709796994 wait complete. 2024-02-17T12:20:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbeba00640 1 Processor -- start 2024-02-17T12:20:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbeba00640 1 -- start start 2024-02-17T12:20:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbeba00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c66c0 0x7fbbe40abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbeba00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe40c71d0 0x7fbbe414bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbeba00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbbe4158d10 0x7fbbe414c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbeba00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4154630 con 0x7fbbe40c71d0 2024-02-17T12:20:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbeba00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4156180 con 0x7fbbe4158d10 2024-02-17T12:20:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbeba00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe414d8d0 con 0x7fbbe40c66c0 2024-02-17T12:20:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe40c71d0 0x7fbbe414bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe40c71d0 0x7fbbe414bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50374/0 (socket says 172.21.15.114:50374) 2024-02-17T12:20:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe3e00640 1 -- 172.21.15.114:0/525225268 learned_addr learned my addr 172.21.15.114:0/525225268 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe9000640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c66c0 0x7fbbe40abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe9a00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbbe4158d10 0x7fbbe414c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe3e00640 1 -- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c66c0 msgr2=0x7fbbe40abcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe3e00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbbe40c66c0 0x7fbbe40abcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe3e00640 1 -- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbbe4158d10 msgr2=0x7fbbe414c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe3e00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbbe4158d10 0x7fbbe414c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe3e00640 1 -- 172.21.15.114:0/525225268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd00094d0 con 0x7fbbe40c71d0 2024-02-17T12:20:09.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe9a00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbbe4158d10 0x7fbbe414c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:20:09.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe3e00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe40c71d0 0x7fbbe414bd50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00af040 tx=0x7fbbd0019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe0c00640 1 -- 172.21.15.114:0/525225268 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00b7470 con 0x7fbbe40c71d0 2024-02-17T12:20:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe0c00640 1 -- 172.21.15.114:0/525225268 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd00b75d0 con 0x7fbbe40c71d0 2024-02-17T12:20:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbe0c00640 1 -- 172.21.15.114:0/525225268 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00b7960 con 0x7fbbe40c71d0 2024-02-17T12:20:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe414dbb0 con 0x7fbbe40c71d0 2024-02-17T12:20:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.844+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe4155e10 con 0x7fbbe40c71d0 2024-02-17T12:20:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbe4161a40 con 0x7fbbe40c71d0 2024-02-17T12:20:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbe0c00640 1 -- 172.21.15.114:0/525225268 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fbbd00b3070 con 0x7fbbe40c71d0 2024-02-17T12:20:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbe0c00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbbc4066e40 0x7fbbc4069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbe0c00640 1 -- 172.21.15.114:0/525225268 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fbbd011ee60 con 0x7fbbe40c71d0 2024-02-17T12:20:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbe9000640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbbc4066e40 0x7fbbc4069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbe0c00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] conn(0x7fbbc406cda0 0x7fbbc406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbe0c00640 1 -- 172.21.15.114:0/525225268 --> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbbc406f870 con 0x7fbbc406cda0 2024-02-17T12:20:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbe0c00640 1 -- 172.21.15.114:0/525225268 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbd0121440 con 0x7fbbe40c71d0 2024-02-17T12:20:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbe9a00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] conn(0x7fbbc406cda0 0x7fbbc406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbe9000640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbbc4066e40 0x7fbbc4069300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbbe414a8c0 tx=0x7fbbd400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.848+0000 7fbbe9a00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] conn(0x7fbbc406cda0 0x7fbbc406f1c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.852+0000 7fbbe0c00640 1 -- 172.21.15.114:0/525225268 <== osd.4 v2:172.21.15.116:6800/621414064 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbbc406f870 con 0x7fbbc406cda0 2024-02-17T12:20:09.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 --> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbbe41562f0 con 0x7fbbc406cda0 2024-02-17T12:20:09.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbe0c00640 1 -- 172.21.15.114:0/525225268 <== osd.4 v2:172.21.15.116:6800/621414064 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbbe41562f0 con 0x7fbbc406cda0 2024-02-17T12:20:09.871 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:20:09.871 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T12:20:09.871 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:20:09.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] conn(0x7fbbc406cda0 msgr2=0x7fbbc406f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.116:6800/621414064,v1:172.21.15.116:6801/621414064] conn(0x7fbbc406cda0 0x7fbbc406f1c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbbc4066e40 msgr2=0x7fbbc4069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fbbc4066e40 0x7fbbc4069300 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbbe414a8c0 tx=0x7fbbd400b040 comp rx=0 tx=0).stop 2024-02-17T12:20:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe40c71d0 msgr2=0x7fbbe414bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 --2- 172.21.15.114:0/525225268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbe40c71d0 0x7fbbe414bd50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00af040 tx=0x7fbbd0019270 comp rx=0 tx=0).stop 2024-02-17T12:20:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbe9a00640 1 -- 172.21.15.114:0/525225268 reap_dead start 2024-02-17T12:20:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 shutdown_connections 2024-02-17T12:20:09.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 >> 172.21.15.114:0/525225268 conn(0x7fbbe40c8520 msgr2=0x7fbbe406cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:09.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 shutdown_connections 2024-02-17T12:20:09.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:09.864+0000 7fbbeba00640 1 -- 172.21.15.114:0/525225268 wait complete. 2024-02-17T12:20:09.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-17T12:20:10.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97b0000640 1 Processor -- start 2024-02-17T12:20:10.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97b0000640 1 -- start start 2024-02-17T12:20:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97b0000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f97a80c25a0 0x7f97a806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97b0000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f97a806db50 0x7f97a814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97b0000640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a8156270 con 0x7f97a8150490 2024-02-17T12:20:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97b0000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a8071630 con 0x7f97a806db50 2024-02-17T12:20:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97b0000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a8156550 con 0x7f97a80c25a0 2024-02-17T12:20:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97acc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f97a806db50 0x7f97a814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97acc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f97a806db50 0x7f97a814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50376/0 (socket says 172.21.15.114:50376) 2024-02-17T12:20:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97acc00640 1 -- 172.21.15.114:0/471220243 learned_addr learned my addr 172.21.15.114:0/471220243 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97ad600640 1 --2- 172.21.15.114:0/471220243 >> v2:172.21.15.116:3300/0 conn(0x7f97a80c25a0 0x7f97a806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97acc00640 1 -- 172.21.15.114:0/471220243 >> v2:172.21.15.116:3300/0 conn(0x7f97a80c25a0 msgr2=0x7f97a806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97acc00640 1 --2- 172.21.15.114:0/471220243 >> v2:172.21.15.116:3300/0 conn(0x7f97a80c25a0 0x7f97a806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97acc00640 1 -- 172.21.15.114:0/471220243 >> v1:172.21.15.116:6789/0 conn(0x7f97a8150490 legacy=0x7f97a8152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.020+0000 7f97acc00640 1 -- 172.21.15.114:0/471220243 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8156830 con 0x7f97a806db50 2024-02-17T12:20:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97acc00640 1 --2- 172.21.15.114:0/471220243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a806db50 0x7f97a814ff50 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f97a80ab930 tx=0x7f979401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1580cae91f103a0f server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97a7e00640 1 -- 172.21.15.114:0/471220243 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940ab600 con 0x7f97a806db50 2024-02-17T12:20:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97a7e00640 1 -- 172.21.15.114:0/471220243 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97940a7050 con 0x7f97a806db50 2024-02-17T12:20:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97a7e00640 1 -- 172.21.15.114:0/471220243 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940ab980 con 0x7f97a806db50 2024-02-17T12:20:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97b0000640 1 -- 172.21.15.114:0/471220243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a806db50 msgr2=0x7f97a814ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97b0000640 1 --2- 172.21.15.114:0/471220243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a806db50 0x7f97a814ff50 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f97a80ab930 tx=0x7f979401c3c0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97b0000640 1 -- 172.21.15.114:0/471220243 shutdown_connections 2024-02-17T12:20:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97b0000640 1 --2- 172.21.15.114:0/471220243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a806db50 0x7f97a814ff50 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97b0000640 1 --2- 172.21.15.114:0/471220243 >> v2:172.21.15.116:3300/0 conn(0x7f97a80c25a0 0x7f97a806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97b0000640 1 -- 172.21.15.114:0/471220243 >> 172.21.15.114:0/471220243 conn(0x7f97a80a8490 msgr2=0x7f97a80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97b0000640 1 -- 172.21.15.114:0/471220243 shutdown_connections 2024-02-17T12:20:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97b0000640 1 -- 172.21.15.114:0/471220243 wait complete. 2024-02-17T12:20:10.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97b0000640 1 Processor -- start 2024-02-17T12:20:10.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.024+0000 7f97b0000640 1 -- start start 2024-02-17T12:20:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97b0000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97a806db50 0x7f97a8141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97b0000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80c25a0 0x7f97a813d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97b0000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a8150490 0x7f97a813dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97b0000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81eb120 con 0x7f97a80c25a0 2024-02-17T12:20:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97b0000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a813e150 con 0x7f97a8150490 2024-02-17T12:20:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97b0000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81450a0 con 0x7f97a806db50 2024-02-17T12:20:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97acc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80c25a0 0x7f97a813d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97acc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80c25a0 0x7f97a813d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50380/0 (socket says 172.21.15.114:50380) 2024-02-17T12:20:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97acc00640 1 -- 172.21.15.114:0/3777016240 learned_addr learned my addr 172.21.15.114:0/3777016240 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97ad600640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97a806db50 0x7f97a8141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97ae000640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a8150490 0x7f97a813dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97acc00640 1 -- 172.21.15.114:0/3777016240 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97a806db50 msgr2=0x7f97a8141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97acc00640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97a806db50 0x7f97a8141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97acc00640 1 -- 172.21.15.114:0/3777016240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a8150490 msgr2=0x7f97a813dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97acc00640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a8150490 0x7f97a813dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97acc00640 1 -- 172.21.15.114:0/3777016240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97940094d0 con 0x7f97a80c25a0 2024-02-17T12:20:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97acc00640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80c25a0 0x7f97a813d6d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f9794019ff0 tx=0x7f9794019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97a5600640 1 -- 172.21.15.114:0/3777016240 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940b37d0 con 0x7f97a80c25a0 2024-02-17T12:20:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97a5600640 1 -- 172.21.15.114:0/3777016240 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97940b3930 con 0x7f97a80c25a0 2024-02-17T12:20:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97a5600640 1 -- 172.21.15.114:0/3777016240 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940b3ca0 con 0x7f97a80c25a0 2024-02-17T12:20:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97b0000640 1 -- 172.21.15.114:0/3777016240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a81ef520 con 0x7f97a80c25a0 2024-02-17T12:20:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97b0000640 1 -- 172.21.15.114:0/3777016240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a81ef240 con 0x7f97a80c25a0 2024-02-17T12:20:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97b0000640 1 -- 172.21.15.114:0/3777016240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a81eb270 con 0x7f97a80c25a0 2024-02-17T12:20:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.028+0000 7f97a5600640 1 -- 172.21.15.114:0/3777016240 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f97940b2070 con 0x7f97a80c25a0 2024-02-17T12:20:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.032+0000 7f97a5600640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9788066e40 0x7f9788069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.032+0000 7f97a5600640 1 -- 172.21.15.114:0/3777016240 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f979411e860 con 0x7f97a80c25a0 2024-02-17T12:20:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.032+0000 7f97ad600640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9788066e40 0x7f9788069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.032+0000 7f97ad600640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9788066e40 0x7f9788069300 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f97a8152670 tx=0x7f979c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.036+0000 7f97a5600640 1 -- 172.21.15.114:0/3777016240 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f97a81eb270 con 0x7f97a80c25a0 2024-02-17T12:20:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.188+0000 7f97b0000640 1 -- 172.21.15.114:0/3777016240 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f97a815fcf0 con 0x7f9788066e40 2024-02-17T12:20:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.188+0000 7f97a5600640 1 -- 172.21.15.114:0/3777016240 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f979c004020 con 0x7f9788066e40 2024-02-17T12:20:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 4 to deep-scrub 2024-02-17T12:20:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 -- 172.21.15.114:0/3777016240 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9788066e40 msgr2=0x7f9788069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9788066e40 0x7f9788069300 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f97a8152670 tx=0x7f979c008040 comp rx=0 tx=0).stop 2024-02-17T12:20:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 -- 172.21.15.114:0/3777016240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80c25a0 msgr2=0x7f97a813d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80c25a0 0x7f97a813d6d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f9794019ff0 tx=0x7f9794019160 comp rx=0 tx=0).stop 2024-02-17T12:20:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 -- 172.21.15.114:0/3777016240 shutdown_connections 2024-02-17T12:20:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97a8150490 0x7f97a813dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f9788066e40 0x7f9788069300 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97a80c25a0 0x7f97a813d6d0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 --2- 172.21.15.114:0/3777016240 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f97a806db50 0x7f97a8141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 -- 172.21.15.114:0/3777016240 >> 172.21.15.114:0/3777016240 conn(0x7f97a80a8490 msgr2=0x7f97a806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 -- 172.21.15.114:0/3777016240 shutdown_connections 2024-02-17T12:20:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.192+0000 7f97b0000640 1 -- 172.21.15.114:0/3777016240 wait complete. 2024-02-17T12:20:10.213 INFO:tasks.ceph:Scrubbing osd.5 2024-02-17T12:20:10.214 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-17T12:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.348+0000 7f5aab000640 1 Processor -- start 2024-02-17T12:20:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.348+0000 7f5aab000640 1 -- start start 2024-02-17T12:20:10.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aab000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5aa40c38e0 0x7f5aa406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aab000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5aa40a6590 0x7f5aa40a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aab000640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5aa40a7020 0x7f5aa41543a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aab000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa40c3cc0 con 0x7f5aa40a6590 2024-02-17T12:20:10.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aab000640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa41506a0 con 0x7f5aa40a7020 2024-02-17T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aab000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa4153640 con 0x7f5aa40c38e0 2024-02-17T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aa3400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5aa40a6590 0x7f5aa40a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aa3400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5aa40a6590 0x7f5aa40a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50390/0 (socket says 172.21.15.114:50390) 2024-02-17T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aa3400640 1 -- 172.21.15.114:0/2341890653 learned_addr learned my addr 172.21.15.114:0/2341890653 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aa9000640 1 --2- 172.21.15.114:0/2341890653 >> v2:172.21.15.116:3300/0 conn(0x7f5aa40a7020 0x7f5aa41543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aa3e00640 1 --2- 172.21.15.114:0/2341890653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5aa40c38e0 0x7f5aa406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aa3400640 1 -- 172.21.15.114:0/2341890653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5aa40c38e0 msgr2=0x7f5aa406e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aa3400640 1 --2- 172.21.15.114:0/2341890653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5aa40c38e0 0x7f5aa406e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aa3400640 1 -- 172.21.15.114:0/2341890653 >> v2:172.21.15.116:3300/0 conn(0x7f5aa40a7020 msgr2=0x7f5aa41543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aa3400640 1 --2- 172.21.15.114:0/2341890653 >> v2:172.21.15.116:3300/0 conn(0x7f5aa40a7020 0x7f5aa41543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.352+0000 7f5aa3400640 1 -- 172.21.15.114:0/2341890653 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa4153b70 con 0x7f5aa40a6590 2024-02-17T12:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aa3400640 1 --2- 172.21.15.114:0/2341890653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa40a6590 0x7f5aa40a6ae0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40ac670 tx=0x7f5a9001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcdd06b9b2643dd server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aa2a00640 1 -- 172.21.15.114:0/2341890653 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa41550f0 con 0x7f5aa40a6590 2024-02-17T12:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aa2a00640 1 -- 172.21.15.114:0/2341890653 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a900a7050 con 0x7f5aa40a6590 2024-02-17T12:20:10.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aa2a00640 1 -- 172.21.15.114:0/2341890653 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a900ab820 con 0x7f5aa40a6590 2024-02-17T12:20:10.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 -- 172.21.15.114:0/2341890653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa40a6590 msgr2=0x7f5aa40a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 --2- 172.21.15.114:0/2341890653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa40a6590 0x7f5aa40a6ae0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40ac670 tx=0x7f5a9001c400 comp rx=0 tx=0).stop 2024-02-17T12:20:10.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 -- 172.21.15.114:0/2341890653 shutdown_connections 2024-02-17T12:20:10.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 --2- 172.21.15.114:0/2341890653 >> v2:172.21.15.116:3300/0 conn(0x7f5aa40a7020 0x7f5aa41543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 --2- 172.21.15.114:0/2341890653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa40a6590 0x7f5aa40a6ae0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 --2- 172.21.15.114:0/2341890653 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5aa40c38e0 0x7f5aa406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 -- 172.21.15.114:0/2341890653 >> 172.21.15.114:0/2341890653 conn(0x7f5aa406b210 msgr2=0x7f5aa406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:10.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 -- 172.21.15.114:0/2341890653 shutdown_connections 2024-02-17T12:20:10.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 -- 172.21.15.114:0/2341890653 wait complete. 2024-02-17T12:20:10.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 Processor -- start 2024-02-17T12:20:10.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 -- start start 2024-02-17T12:20:10.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa40a6590 0x7f5aa4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.356+0000 7f5aab000640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5aa40a7020 0x7f5aa4149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aab000640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5aa40c38e0 0x7f5aa4151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aab000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa414a200 con 0x7f5aa40a6590 2024-02-17T12:20:10.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aab000640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa41edf30 con 0x7f5aa40c38e0 2024-02-17T12:20:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aab000640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa41ee210 con 0x7f5aa40a7020 2024-02-17T12:20:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa40a6590 0x7f5aa4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa40a6590 0x7f5aa4152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50406/0 (socket says 172.21.15.114:50406) 2024-02-17T12:20:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa3e00640 1 -- 172.21.15.114:0/4020024589 learned_addr learned my addr 172.21.15.114:0/4020024589 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa9000640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5aa40c38e0 0x7f5aa4151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa3400640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5aa40a7020 0x7f5aa4149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa3e00640 1 -- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5aa40a7020 msgr2=0x7f5aa4149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa3e00640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5aa40a7020 0x7f5aa4149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa3e00640 1 -- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5aa40c38e0 msgr2=0x7f5aa4151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa3e00640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5aa40c38e0 0x7f5aa4151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa3e00640 1 -- 172.21.15.114:0/4020024589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a900094d0 con 0x7f5aa40a6590 2024-02-17T12:20:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aa3e00640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa40a6590 0x7f5aa4152f20 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5a94007e40 tx=0x7f5a9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5a9be00640 1 -- 172.21.15.114:0/4020024589 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94014620 con 0x7f5aa40a6590 2024-02-17T12:20:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5a9be00640 1 -- 172.21.15.114:0/4020024589 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9400ee90 con 0x7f5aa40a6590 2024-02-17T12:20:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5a9be00640 1 -- 172.21.15.114:0/4020024589 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940149c0 con 0x7f5aa40a6590 2024-02-17T12:20:10.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa40a9420 con 0x7f5aa40a6590 2024-02-17T12:20:10.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa4149950 con 0x7f5aa40a6590 2024-02-17T12:20:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5aa40c0b40 con 0x7f5aa40a6590 2024-02-17T12:20:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5a9be00640 1 -- 172.21.15.114:0/4020024589 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f5a94014b20 con 0x7f5aa40a6590 2024-02-17T12:20:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.360+0000 7f5a9be00640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a84066e40 0x7f5a84069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.364+0000 7f5a9be00640 1 -- 172.21.15.114:0/4020024589 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5a94085cb0 con 0x7f5aa40a6590 2024-02-17T12:20:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.364+0000 7f5aa3400640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a84066e40 0x7f5a84069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.364+0000 7f5a9be00640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] conn(0x7f5a8406cda0 0x7f5a8406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.364+0000 7f5a9be00640 1 -- 172.21.15.114:0/4020024589 --> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a8406f870 con 0x7f5a8406cda0 2024-02-17T12:20:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.364+0000 7f5a9be00640 1 -- 172.21.15.114:0/4020024589 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a94086100 con 0x7f5aa40a6590 2024-02-17T12:20:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.364+0000 7f5aa9000640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] conn(0x7f5a8406cda0 0x7f5a8406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.364+0000 7f5aa3400640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a84066e40 0x7f5a84069300 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5a900ad000 tx=0x7f5a90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.364+0000 7f5aa9000640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] conn(0x7f5a8406cda0 0x7f5a8406f1c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.364+0000 7f5a9be00640 1 -- 172.21.15.114:0/4020024589 <== osd.5 v2:172.21.15.116:6824/3672471702 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5a8406f870 con 0x7f5a8406cda0 2024-02-17T12:20:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.376+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 --> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5aa406e640 con 0x7f5a8406cda0 2024-02-17T12:20:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5a9be00640 1 -- 172.21.15.114:0/4020024589 <== osd.5 v2:172.21.15.116:6824/3672471702 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5aa406e640 con 0x7f5a8406cda0 2024-02-17T12:20:10.382 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:20:10.382 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T12:20:10.382 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:20:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] conn(0x7f5a8406cda0 msgr2=0x7f5a8406f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aab000640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.116:6824/3672471702,v1:172.21.15.116:6825/3672471702] conn(0x7f5a8406cda0 0x7f5a8406f1c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a84066e40 msgr2=0x7f5a84069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aab000640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5a84066e40 0x7f5a84069300 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5a900ad000 tx=0x7f5a90008040 comp rx=0 tx=0).stop 2024-02-17T12:20:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa40a6590 msgr2=0x7f5aa4152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aab000640 1 --2- 172.21.15.114:0/4020024589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa40a6590 0x7f5aa4152f20 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5a94007e40 tx=0x7f5a9400e4b0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aa9000640 1 -- 172.21.15.114:0/4020024589 reap_dead start 2024-02-17T12:20:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 shutdown_connections 2024-02-17T12:20:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 >> 172.21.15.114:0/4020024589 conn(0x7f5aa406b210 msgr2=0x7f5aa40c26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:10.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 shutdown_connections 2024-02-17T12:20:10.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.380+0000 7f5aab000640 1 -- 172.21.15.114:0/4020024589 wait complete. 2024-02-17T12:20:10.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-17T12:20:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.532+0000 7f2e64c00640 1 Processor -- start 2024-02-17T12:20:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.532+0000 7f2e64c00640 1 -- start start 2024-02-17T12:20:10.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.532+0000 7f2e64c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6014e9b0 0x7f2e600ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.532+0000 7f2e64c00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2e6006ef50 0x7f2e601512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.532+0000 7f2e64c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600aa150 con 0x7f2e601517e0 2024-02-17T12:20:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.532+0000 7f2e64c00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6014ed90 con 0x7f2e6006ef50 2024-02-17T12:20:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.532+0000 7f2e64c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600c1e90 con 0x7f2e6014e9b0 2024-02-17T12:20:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.536+0000 7f2e5de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6014e9b0 0x7f2e600ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.536+0000 7f2e5d400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2e6006ef50 0x7f2e601512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.536+0000 7f2e5e800640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f2e601517e0 0x7f2e6006dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.114:35316/0 (socket says 172.21.15.114:35316) 2024-02-17T12:20:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.536+0000 7f2e5e800640 1 -- 172.21.15.114:0/2611414192 learned_addr learned my addr 172.21.15.114:0/2611414192 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.536+0000 7f2e5de00640 1 -- 172.21.15.114:0/2611414192 >> v2:172.21.15.116:3300/0 conn(0x7f2e6006ef50 msgr2=0x7f2e601512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.536+0000 7f2e5de00640 1 --2- 172.21.15.114:0/2611414192 >> v2:172.21.15.116:3300/0 conn(0x7f2e6006ef50 0x7f2e601512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.536+0000 7f2e5de00640 1 -- 172.21.15.114:0/2611414192 >> v1:172.21.15.116:6789/0 conn(0x7f2e601517e0 legacy=0x7f2e6006dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.536+0000 7f2e5de00640 1 -- 172.21.15.114:0/2611414192 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e60152000 con 0x7f2e6014e9b0 2024-02-17T12:20:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.536+0000 7f2e5de00640 1 --2- 172.21.15.114:0/2611414192 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6014e9b0 0x7f2e600ab5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2e500097c0 tx=0x7f2e5001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b404822857f418c server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e5ca00640 1 -- 172.21.15.114:0/2611414192 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500ab600 con 0x7f2e6014e9b0 2024-02-17T12:20:10.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e5ca00640 1 -- 172.21.15.114:0/2611414192 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e500a7050 con 0x7f2e6014e9b0 2024-02-17T12:20:10.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e5ca00640 1 -- 172.21.15.114:0/2611414192 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500ab980 con 0x7f2e6014e9b0 2024-02-17T12:20:10.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 -- 172.21.15.114:0/2611414192 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6014e9b0 msgr2=0x7f2e600ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 --2- 172.21.15.114:0/2611414192 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6014e9b0 0x7f2e600ab5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2e500097c0 tx=0x7f2e5001c4a0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 -- 172.21.15.114:0/2611414192 shutdown_connections 2024-02-17T12:20:10.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 --2- 172.21.15.114:0/2611414192 >> v2:172.21.15.116:3300/0 conn(0x7f2e6006ef50 0x7f2e601512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 --2- 172.21.15.114:0/2611414192 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6014e9b0 0x7f2e600ab5d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 -- 172.21.15.114:0/2611414192 >> 172.21.15.114:0/2611414192 conn(0x7f2e600a8490 msgr2=0x7f2e600a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:10.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 -- 172.21.15.114:0/2611414192 shutdown_connections 2024-02-17T12:20:10.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 -- 172.21.15.114:0/2611414192 wait complete. 2024-02-17T12:20:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 Processor -- start 2024-02-17T12:20:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 -- start start 2024-02-17T12:20:10.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6006ef50 0x7f2e6015f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e6014e9b0 0x7f2e601f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e601517e0 0x7f2e60140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e60149470 con 0x7f2e6014e9b0 2024-02-17T12:20:10.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e60148c60 con 0x7f2e601517e0 2024-02-17T12:20:10.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e64c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e601f0f00 con 0x7f2e6006ef50 2024-02-17T12:20:10.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e5d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e6014e9b0 0x7f2e601f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e5de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6006ef50 0x7f2e6015f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e5de00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6006ef50 0x7f2e6015f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.114:43236/0 (socket says 172.21.15.114:43236) 2024-02-17T12:20:10.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e5de00640 1 -- 172.21.15.114:0/1329687131 learned_addr learned my addr 172.21.15.114:0/1329687131 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.540+0000 7f2e5e800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e601517e0 0x7f2e60140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e5d400640 1 -- 172.21.15.114:0/1329687131 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6006ef50 msgr2=0x7f2e6015f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e5d400640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6006ef50 0x7f2e6015f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e5d400640 1 -- 172.21.15.114:0/1329687131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e601517e0 msgr2=0x7f2e60140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e5d400640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e601517e0 0x7f2e60140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e5d400640 1 -- 172.21.15.114:0/1329687131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e50009420 con 0x7f2e6014e9b0 2024-02-17T12:20:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e5de00640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6006ef50 0x7f2e6015f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-17T12:20:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e5d400640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e6014e9b0 0x7f2e601f1670 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00e870 tx=0x7f2e4c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e56000640 1 -- 172.21.15.114:0/1329687131 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00c940 con 0x7f2e6014e9b0 2024-02-17T12:20:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e56000640 1 -- 172.21.15.114:0/1329687131 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00caa0 con 0x7f2e6014e9b0 2024-02-17T12:20:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e64c00640 1 -- 172.21.15.114:0/1329687131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e60148eb0 con 0x7f2e6014e9b0 2024-02-17T12:20:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e56000640 1 -- 172.21.15.114:0/1329687131 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00ce10 con 0x7f2e6014e9b0 2024-02-17T12:20:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e64c00640 1 -- 172.21.15.114:0/1329687131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e601f1150 con 0x7f2e6014e9b0 2024-02-17T12:20:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e64c00640 1 -- 172.21.15.114:0/1329687131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6015fed0 con 0x7f2e6014e9b0 2024-02-17T12:20:10.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e56000640 1 -- 172.21.15.114:0/1329687131 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f2e4c013470 con 0x7f2e6014e9b0 2024-02-17T12:20:10.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e56000640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e40066e70 0x7f2e40069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e56000640 1 -- 172.21.15.114:0/1329687131 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2e4c084870 con 0x7f2e6014e9b0 2024-02-17T12:20:10.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.544+0000 7f2e5de00640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e40066e70 0x7f2e40069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.548+0000 7f2e5de00640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e40066e70 0x7f2e40069330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2e500097c0 tx=0x7f2e500a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.548+0000 7f2e56000640 1 -- 172.21.15.114:0/1329687131 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2e4c051910 con 0x7f2e6014e9b0 2024-02-17T12:20:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.700+0000 7f2e64c00640 1 -- 172.21.15.114:0/1329687131 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e6006e1c0 con 0x7f2e40066e70 2024-02-17T12:20:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e56000640 1 -- 172.21.15.114:0/1329687131 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2e6006e1c0 con 0x7f2e40066e70 2024-02-17T12:20:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 5 to deep-scrub 2024-02-17T12:20:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 -- 172.21.15.114:0/1329687131 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e40066e70 msgr2=0x7f2e40069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e40066e70 0x7f2e40069330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2e500097c0 tx=0x7f2e500a6000 comp rx=0 tx=0).stop 2024-02-17T12:20:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 -- 172.21.15.114:0/1329687131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e6014e9b0 msgr2=0x7f2e601f1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e6014e9b0 0x7f2e601f1670 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00e870 tx=0x7f2e4c00ed30 comp rx=0 tx=0).stop 2024-02-17T12:20:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 -- 172.21.15.114:0/1329687131 shutdown_connections 2024-02-17T12:20:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e601517e0 0x7f2e60140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f2e40066e70 0x7f2e40069330 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e6014e9b0 0x7f2e601f1670 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 --2- 172.21.15.114:0/1329687131 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e6006ef50 0x7f2e6015f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 -- 172.21.15.114:0/1329687131 >> 172.21.15.114:0/1329687131 conn(0x7f2e600a8490 msgr2=0x7f2e600a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 -- 172.21.15.114:0/1329687131 shutdown_connections 2024-02-17T12:20:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.704+0000 7f2e64c00640 1 -- 172.21.15.114:0/1329687131 wait complete. 2024-02-17T12:20:10.726 INFO:tasks.ceph:Scrubbing osd.6 2024-02-17T12:20:10.727 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-17T12:20:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.860+0000 7f7f55a00640 1 Processor -- start 2024-02-17T12:20:10.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.860+0000 7f7f55a00640 1 -- start start 2024-02-17T12:20:10.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.860+0000 7f7f55a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7f500c38e0 0x7f7f5006e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.860+0000 7f7f55a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7f500a6590 0x7f7f500a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.860+0000 7f7f55a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f50153640 con 0x7f7f500a7020 2024-02-17T12:20:10.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.860+0000 7f7f55a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f500c3cc0 con 0x7f7f500a6590 2024-02-17T12:20:10.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.860+0000 7f7f55a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f501506a0 con 0x7f7f500c38e0 2024-02-17T12:20:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f46000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7f500a6590 0x7f7f500a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f46000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7f500a6590 0x7f7f500a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50430/0 (socket says 172.21.15.114:50430) 2024-02-17T12:20:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f46000640 1 -- 172.21.15.114:0/3011177415 learned_addr learned my addr 172.21.15.114:0/3011177415 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f4ea00640 1 --2- 172.21.15.114:0/3011177415 >> v2:172.21.15.116:3300/0 conn(0x7f7f500c38e0 0x7f7f5006e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f46000640 1 -- 172.21.15.114:0/3011177415 >> v2:172.21.15.116:3300/0 conn(0x7f7f500c38e0 msgr2=0x7f7f5006e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f46000640 1 --2- 172.21.15.114:0/3011177415 >> v2:172.21.15.116:3300/0 conn(0x7f7f500c38e0 0x7f7f5006e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f46000640 1 -- 172.21.15.114:0/3011177415 >> v1:172.21.15.116:6789/0 conn(0x7f7f500a7020 legacy=0x7f7f501543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f46000640 1 -- 172.21.15.114:0/3011177415 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50153b70 con 0x7f7f500a6590 2024-02-17T12:20:10.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f46000640 1 --2- 172.21.15.114:0/3011177415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f500a6590 0x7f7f500a6ae0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7f5006f0c0 tx=0x7f7f3801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacd0d0b6cf574a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f4e000640 1 -- 172.21.15.114:0/3011177415 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380ab600 con 0x7f7f500a6590 2024-02-17T12:20:10.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f4e000640 1 -- 172.21.15.114:0/3011177415 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f380a7050 con 0x7f7f500a6590 2024-02-17T12:20:10.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.864+0000 7f7f4e000640 1 -- 172.21.15.114:0/3011177415 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380ab980 con 0x7f7f500a6590 2024-02-17T12:20:10.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 -- 172.21.15.114:0/3011177415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f500a6590 msgr2=0x7f7f500a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 --2- 172.21.15.114:0/3011177415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f500a6590 0x7f7f500a6ae0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7f5006f0c0 tx=0x7f7f3801c400 comp rx=0 tx=0).stop 2024-02-17T12:20:10.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 -- 172.21.15.114:0/3011177415 shutdown_connections 2024-02-17T12:20:10.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 --2- 172.21.15.114:0/3011177415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f500a6590 0x7f7f500a6ae0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 --2- 172.21.15.114:0/3011177415 >> v2:172.21.15.116:3300/0 conn(0x7f7f500c38e0 0x7f7f5006e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 -- 172.21.15.114:0/3011177415 >> 172.21.15.114:0/3011177415 conn(0x7f7f5006b210 msgr2=0x7f7f5006dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:10.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 -- 172.21.15.114:0/3011177415 shutdown_connections 2024-02-17T12:20:10.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 -- 172.21.15.114:0/3011177415 wait complete. 2024-02-17T12:20:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 Processor -- start 2024-02-17T12:20:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 -- start start 2024-02-17T12:20:10.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7f500a6590 0x7f7f5015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f500a7020 0x7f7f501497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f500c38e0 0x7f7f50149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5014a240 con 0x7f7f500a7020 2024-02-17T12:20:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500ab8c0 con 0x7f7f500c38e0 2024-02-17T12:20:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f55a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50072560 con 0x7f7f500a6590 2024-02-17T12:20:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f46000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f500a7020 0x7f7f501497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f46000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f500a7020 0x7f7f501497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50434/0 (socket says 172.21.15.114:50434) 2024-02-17T12:20:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f46000640 1 -- 172.21.15.114:0/3298156358 learned_addr learned my addr 172.21.15.114:0/3298156358 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f4ea00640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7f500a6590 0x7f7f5015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f4f400640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f500c38e0 0x7f7f50149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f46000640 1 -- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7f500a6590 msgr2=0x7f7f5015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f46000640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7f500a6590 0x7f7f5015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f46000640 1 -- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f500c38e0 msgr2=0x7f7f50149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f46000640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f500c38e0 0x7f7f50149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f46000640 1 -- 172.21.15.114:0/3298156358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380094d0 con 0x7f7f500a7020 2024-02-17T12:20:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f46000640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f500a7020 0x7f7f501497c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7f380ae040 tx=0x7f7f380191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f47400640 1 -- 172.21.15.114:0/3298156358 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380b4420 con 0x7f7f500a7020 2024-02-17T12:20:10.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f47400640 1 -- 172.21.15.114:0/3298156358 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f380b4580 con 0x7f7f500a7020 2024-02-17T12:20:10.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.868+0000 7f7f47400640 1 -- 172.21.15.114:0/3298156358 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380b4930 con 0x7f7f500a7020 2024-02-17T12:20:10.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f50072d30 con 0x7f7f500a7020 2024-02-17T12:20:10.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f50072770 con 0x7f7f500a7020 2024-02-17T12:20:10.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f500c0b40 con 0x7f7f500a7020 2024-02-17T12:20:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f47400640 1 -- 172.21.15.114:0/3298156358 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f7f380b2070 con 0x7f7f500a7020 2024-02-17T12:20:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f47400640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7f2c066e40 0x7f7f2c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f47400640 1 -- 172.21.15.114:0/3298156358 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7f3811e230 con 0x7f7f500a7020 2024-02-17T12:20:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f4ea00640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7f2c066e40 0x7f7f2c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f47400640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] conn(0x7f7f2c06cda0 0x7f7f2c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f47400640 1 -- 172.21.15.114:0/3298156358 --> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f2c06f870 con 0x7f7f2c06cda0 2024-02-17T12:20:10.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f47400640 1 -- 172.21.15.114:0/3298156358 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f38120810 con 0x7f7f500a7020 2024-02-17T12:20:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f4f400640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] conn(0x7f7f2c06cda0 0x7f7f2c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f4ea00640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7f2c066e40 0x7f7f2c069300 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7f400074a0 tx=0x7f7f4000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.872+0000 7f7f4f400640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] conn(0x7f7f2c06cda0 0x7f7f2c06f1c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.876+0000 7f7f47400640 1 -- 172.21.15.114:0/3298156358 <== osd.6 v2:172.21.15.116:6810/616119485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7f2c06f870 con 0x7f7f2c06cda0 2024-02-17T12:20:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 --> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7f50074320 con 0x7f7f2c06cda0 2024-02-17T12:20:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f47400640 1 -- 172.21.15.114:0/3298156358 <== osd.6 v2:172.21.15.116:6810/616119485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7f50074320 con 0x7f7f2c06cda0 2024-02-17T12:20:10.892 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:20:10.892 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T12:20:10.892 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:20:10.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] conn(0x7f7f2c06cda0 msgr2=0x7f7f2c06f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.116:6810/616119485,v1:172.21.15.116:6812/616119485] conn(0x7f7f2c06cda0 0x7f7f2c06f1c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7f2c066e40 msgr2=0x7f7f2c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f7f2c066e40 0x7f7f2c069300 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7f400074a0 tx=0x7f7f4000b040 comp rx=0 tx=0).stop 2024-02-17T12:20:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f500a7020 msgr2=0x7f7f501497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:10.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 --2- 172.21.15.114:0/3298156358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f500a7020 0x7f7f501497c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7f380ae040 tx=0x7f7f380191a0 comp rx=0 tx=0).stop 2024-02-17T12:20:10.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f4f400640 1 -- 172.21.15.114:0/3298156358 reap_dead start 2024-02-17T12:20:10.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 shutdown_connections 2024-02-17T12:20:10.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 >> 172.21.15.114:0/3298156358 conn(0x7f7f5006b210 msgr2=0x7f7f5014fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:10.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 shutdown_connections 2024-02-17T12:20:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:10.888+0000 7f7f55a00640 1 -- 172.21.15.114:0/3298156358 wait complete. 2024-02-17T12:20:10.911 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-17T12:20:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6744400640 1 Processor -- start 2024-02-17T12:20:11.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6744400640 1 -- start start 2024-02-17T12:20:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6744400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f673c0c2580 0x7f673c0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6744400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f673c0c1eb0 0x7f673c15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6744400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c0a9420 con 0x7f673c14f110 2024-02-17T12:20:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6744400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c14f4f0 con 0x7f673c0c2580 2024-02-17T12:20:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6744400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c0aae80 con 0x7f673c0c1eb0 2024-02-17T12:20:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6741000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f673c0c2580 0x7f673c0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6741a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f673c14f110 0x7f673c0c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48278/0 (socket says 172.21.15.114:48278) 2024-02-17T12:20:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6741a00640 1 -- 172.21.15.114:0/3174654546 learned_addr learned my addr 172.21.15.114:0/3174654546 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6742400640 1 --2- 172.21.15.114:0/3174654546 >> v2:172.21.15.116:3300/0 conn(0x7f673c0c1eb0 0x7f673c15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6741000640 1 -- 172.21.15.114:0/3174654546 >> v2:172.21.15.116:3300/0 conn(0x7f673c0c1eb0 msgr2=0x7f673c15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6741000640 1 --2- 172.21.15.114:0/3174654546 >> v2:172.21.15.116:3300/0 conn(0x7f673c0c1eb0 0x7f673c15c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6741000640 1 -- 172.21.15.114:0/3174654546 >> v1:172.21.15.114:6789/0 conn(0x7f673c14f110 legacy=0x7f673c0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.044+0000 7f6741000640 1 -- 172.21.15.114:0/3174654546 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c152850 con 0x7f673c0c2580 2024-02-17T12:20:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6741000640 1 --2- 172.21.15.114:0/3174654546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 0x7f673c0aa150 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f673c06ceb0 tx=0x7f672801e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d78f56e8aa53d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f673be00640 1 -- 172.21.15.114:0/3174654546 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280ac640 con 0x7f673c0c2580 2024-02-17T12:20:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f673be00640 1 -- 172.21.15.114:0/3174654546 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280ac7a0 con 0x7f673c0c2580 2024-02-17T12:20:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f673be00640 1 -- 172.21.15.114:0/3174654546 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280acb30 con 0x7f673c0c2580 2024-02-17T12:20:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6744400640 1 -- 172.21.15.114:0/3174654546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 msgr2=0x7f673c0aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6744400640 1 --2- 172.21.15.114:0/3174654546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 0x7f673c0aa150 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f673c06ceb0 tx=0x7f672801e5d0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6744400640 1 -- 172.21.15.114:0/3174654546 shutdown_connections 2024-02-17T12:20:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6744400640 1 --2- 172.21.15.114:0/3174654546 >> v2:172.21.15.116:3300/0 conn(0x7f673c0c1eb0 0x7f673c15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6744400640 1 --2- 172.21.15.114:0/3174654546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 0x7f673c0aa150 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6744400640 1 -- 172.21.15.114:0/3174654546 >> 172.21.15.114:0/3174654546 conn(0x7f673c0a8490 msgr2=0x7f673c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:11.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6744400640 1 -- 172.21.15.114:0/3174654546 shutdown_connections 2024-02-17T12:20:11.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6744400640 1 -- 172.21.15.114:0/3174654546 wait complete. 2024-02-17T12:20:11.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6744400640 1 Processor -- start 2024-02-17T12:20:11.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.048+0000 7f6744400640 1 -- start start 2024-02-17T12:20:11.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6744400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f673c0c1eb0 0x7f673c0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6744400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 0x7f673c1ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6744400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f673c14f110 0x7f673c0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6744400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c1eec40 con 0x7f673c0c2580 2024-02-17T12:20:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6744400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0c3f60 con 0x7f673c0c1eb0 2024-02-17T12:20:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6744400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0c5da0 con 0x7f673c14f110 2024-02-17T12:20:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6741000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 0x7f673c1ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6741000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 0x7f673c1ee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50464/0 (socket says 172.21.15.114:50464) 2024-02-17T12:20:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6741000640 1 -- 172.21.15.114:0/1764031046 learned_addr learned my addr 172.21.15.114:0/1764031046 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6741a00640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f673c0c1eb0 0x7f673c0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6742400640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f673c14f110 0x7f673c0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6741000640 1 -- 172.21.15.114:0/1764031046 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f673c14f110 msgr2=0x7f673c0bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6741000640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f673c14f110 0x7f673c0bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6741000640 1 -- 172.21.15.114:0/1764031046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f673c0c1eb0 msgr2=0x7f673c0c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6741000640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f673c0c1eb0 0x7f673c0c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6741000640 1 -- 172.21.15.114:0/1764031046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6728009420 con 0x7f673c0c2580 2024-02-17T12:20:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6742400640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f673c14f110 0x7f673c0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:20:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6741000640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 0x7f673c1ee700 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f672801c200 tx=0x7f672801ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6739600640 1 -- 172.21.15.114:0/1764031046 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280b5420 con 0x7f673c0c2580 2024-02-17T12:20:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6739600640 1 -- 172.21.15.114:0/1764031046 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280b55a0 con 0x7f673c0c2580 2024-02-17T12:20:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6744400640 1 -- 172.21.15.114:0/1764031046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c0c41b0 con 0x7f673c0c2580 2024-02-17T12:20:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6739600640 1 -- 172.21.15.114:0/1764031046 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280b5950 con 0x7f673c0c2580 2024-02-17T12:20:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6744400640 1 -- 172.21.15.114:0/1764031046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c0c4770 con 0x7f673c0c2580 2024-02-17T12:20:11.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6744400640 1 -- 172.21.15.114:0/1764031046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c0c4960 con 0x7f673c0c2580 2024-02-17T12:20:11.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.052+0000 7f6739600640 1 -- 172.21.15.114:0/1764031046 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f67280aa050 con 0x7f673c0c2580 2024-02-17T12:20:11.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.056+0000 7f6739600640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f671c066e40 0x7f671c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.056+0000 7f6739600640 1 -- 172.21.15.114:0/1764031046 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f672811eb30 con 0x7f673c0c2580 2024-02-17T12:20:11.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.056+0000 7f6741a00640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f671c066e40 0x7f671c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.056+0000 7f6741a00640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f671c066e40 0x7f671c069300 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6730000f70 tx=0x7f6730007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.060+0000 7f6739600640 1 -- 172.21.15.114:0/1764031046 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f67280ebd80 con 0x7f673c0c2580 2024-02-17T12:20:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.212+0000 7f6744400640 1 -- 172.21.15.114:0/1764031046 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f673c152440 con 0x7f671c066e40 2024-02-17T12:20:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.212+0000 7f6739600640 1 -- 172.21.15.114:0/1764031046 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6730001400 con 0x7f671c066e40 2024-02-17T12:20:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 6 to deep-scrub 2024-02-17T12:20:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 -- 172.21.15.114:0/1764031046 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f671c066e40 msgr2=0x7f671c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f671c066e40 0x7f671c069300 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6730000f70 tx=0x7f6730007e90 comp rx=0 tx=0).stop 2024-02-17T12:20:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 -- 172.21.15.114:0/1764031046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 msgr2=0x7f673c1ee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 0x7f673c1ee700 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f672801c200 tx=0x7f672801ce10 comp rx=0 tx=0).stop 2024-02-17T12:20:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 -- 172.21.15.114:0/1764031046 shutdown_connections 2024-02-17T12:20:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f673c14f110 0x7f673c0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f671c066e40 0x7f671c069300 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f673c0c2580 0x7f673c1ee700 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 --2- 172.21.15.114:0/1764031046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f673c0c1eb0 0x7f673c0c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 -- 172.21.15.114:0/1764031046 >> 172.21.15.114:0/1764031046 conn(0x7f673c0a8490 msgr2=0x7f673c142650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:11.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 -- 172.21.15.114:0/1764031046 shutdown_connections 2024-02-17T12:20:11.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.216+0000 7f6744400640 1 -- 172.21.15.114:0/1764031046 wait complete. 2024-02-17T12:20:11.237 INFO:tasks.ceph:Scrubbing osd.7 2024-02-17T12:20:11.237 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-17T12:20:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.372+0000 7f64cda00640 1 Processor -- start 2024-02-17T12:20:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.372+0000 7f64cda00640 1 -- start start 2024-02-17T12:20:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64cda00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f64c814f310 0x7f64c81524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64cda00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64c80a7dd0 0x7f64c80c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64cda00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f64c80c2530 0x7f64c80c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64cda00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c80a6980 con 0x7f64c80c2530 2024-02-17T12:20:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64cda00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c80c2e00 con 0x7f64c814f310 2024-02-17T12:20:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64cda00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80c30e0 con 0x7f64c80a7dd0 2024-02-17T12:20:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f64c80c2530 0x7f64c80c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f64c80c2530 0x7f64c80c3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50474/0 (socket says 172.21.15.114:50474) 2024-02-17T12:20:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c7400640 1 -- 172.21.15.114:0/1648657971 learned_addr learned my addr 172.21.15.114:0/1648657971 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c6a00640 1 --2- 172.21.15.114:0/1648657971 >> v2:172.21.15.116:3300/0 conn(0x7f64c814f310 0x7f64c81524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c6000640 1 --2- 172.21.15.114:0/1648657971 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64c80a7dd0 0x7f64c80c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c7400640 1 -- 172.21.15.114:0/1648657971 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64c80a7dd0 msgr2=0x7f64c80c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c7400640 1 --2- 172.21.15.114:0/1648657971 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64c80a7dd0 0x7f64c80c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c7400640 1 -- 172.21.15.114:0/1648657971 >> v2:172.21.15.116:3300/0 conn(0x7f64c814f310 msgr2=0x7f64c81524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c7400640 1 --2- 172.21.15.114:0/1648657971 >> v2:172.21.15.116:3300/0 conn(0x7f64c814f310 0x7f64c81524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c7400640 1 -- 172.21.15.114:0/1648657971 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c814f6f0 con 0x7f64c80c2530 2024-02-17T12:20:11.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c6000640 1 --2- 172.21.15.114:0/1648657971 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64c80a7dd0 0x7f64c80c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:11.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.376+0000 7f64c7400640 1 --2- 172.21.15.114:0/1648657971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64c80c2530 0x7f64c80c3570 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f64c80c3ff0 tx=0x7f64c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b88166f78d2dece server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64c5600640 1 -- 172.21.15.114:0/1648657971 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c00ac630 con 0x7f64c80c2530 2024-02-17T12:20:11.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64c5600640 1 -- 172.21.15.114:0/1648657971 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c00ac790 con 0x7f64c80c2530 2024-02-17T12:20:11.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64c5600640 1 -- 172.21.15.114:0/1648657971 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c00acb20 con 0x7f64c80c2530 2024-02-17T12:20:11.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 -- 172.21.15.114:0/1648657971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64c80c2530 msgr2=0x7f64c80c3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 --2- 172.21.15.114:0/1648657971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64c80c2530 0x7f64c80c3570 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f64c80c3ff0 tx=0x7f64c001c520 comp rx=0 tx=0).stop 2024-02-17T12:20:11.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 -- 172.21.15.114:0/1648657971 shutdown_connections 2024-02-17T12:20:11.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 --2- 172.21.15.114:0/1648657971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64c80c2530 0x7f64c80c3570 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 --2- 172.21.15.114:0/1648657971 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64c80a7dd0 0x7f64c80c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 --2- 172.21.15.114:0/1648657971 >> v2:172.21.15.116:3300/0 conn(0x7f64c814f310 0x7f64c81524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 -- 172.21.15.114:0/1648657971 >> 172.21.15.114:0/1648657971 conn(0x7f64c806b210 msgr2=0x7f64c806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:11.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 -- 172.21.15.114:0/1648657971 shutdown_connections 2024-02-17T12:20:11.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 -- 172.21.15.114:0/1648657971 wait complete. 2024-02-17T12:20:11.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 Processor -- start 2024-02-17T12:20:11.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 -- start start 2024-02-17T12:20:11.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64c80a7dd0 0x7f64c814d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64c80c2530 0x7f64c8150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64c814f310 0x7f64c8147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80ac6a0 con 0x7f64c80c2530 2024-02-17T12:20:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8148080 con 0x7f64c80a7dd0 2024-02-17T12:20:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64cda00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c814a100 con 0x7f64c814f310 2024-02-17T12:20:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64c6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64c80c2530 0x7f64c8150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64c6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64c80c2530 0x7f64c8150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50482/0 (socket says 172.21.15.114:50482) 2024-02-17T12:20:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64c6000640 1 -- 172.21.15.114:0/3840538798 learned_addr learned my addr 172.21.15.114:0/3840538798 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64c7400640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64c814f310 0x7f64c8147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.380+0000 7f64c6a00640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64c80a7dd0 0x7f64c814d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64c6000640 1 -- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64c814f310 msgr2=0x7f64c8147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64c6000640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64c814f310 0x7f64c8147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64c6000640 1 -- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64c80a7dd0 msgr2=0x7f64c814d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64c6000640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64c80a7dd0 0x7f64c814d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64c6000640 1 -- 172.21.15.114:0/3840538798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c00094d0 con 0x7f64c80c2530 2024-02-17T12:20:11.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64c6000640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64c80c2530 0x7f64c8150320 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f64b400c7f0 tx=0x7f64b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64bea00640 1 -- 172.21.15.114:0/3840538798 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b400cea0 con 0x7f64c80c2530 2024-02-17T12:20:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64bea00640 1 -- 172.21.15.114:0/3840538798 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4007a30 con 0x7f64c80c2530 2024-02-17T12:20:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64bea00640 1 -- 172.21.15.114:0/3840538798 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4007de0 con 0x7f64c80c2530 2024-02-17T12:20:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c8151830 con 0x7f64c80c2530 2024-02-17T12:20:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c8149d90 con 0x7f64c80c2530 2024-02-17T12:20:11.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64c80a7150 con 0x7f64c80c2530 2024-02-17T12:20:11.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64bea00640 1 -- 172.21.15.114:0/3840538798 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f64b40113f0 con 0x7f64c80c2530 2024-02-17T12:20:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64bea00640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f64a8066e40 0x7f64a8069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64bea00640 1 -- 172.21.15.114:0/3840538798 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f64b4084890 con 0x7f64c80c2530 2024-02-17T12:20:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64c6a00640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f64a8066e40 0x7f64a8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64bea00640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] conn(0x7f64a806cda0 0x7f64a806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64bea00640 1 -- 172.21.15.114:0/3840538798 --> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64a806f870 con 0x7f64a806cda0 2024-02-17T12:20:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.384+0000 7f64bea00640 1 -- 172.21.15.114:0/3840538798 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64b40892a0 con 0x7f64c80c2530 2024-02-17T12:20:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.388+0000 7f64c7400640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] conn(0x7f64a806cda0 0x7f64a806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.388+0000 7f64c6a00640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f64a8066e40 0x7f64a8069300 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f64b80039f0 tx=0x7f64b8009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.388+0000 7f64c7400640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] conn(0x7f64a806cda0 0x7f64a806f1c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.388+0000 7f64bea00640 1 -- 172.21.15.114:0/3840538798 <== osd.7 v2:172.21.15.116:6808/2799570166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f64a806f870 con 0x7f64a806cda0 2024-02-17T12:20:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 --> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f64c8152a10 con 0x7f64a806cda0 2024-02-17T12:20:11.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64bea00640 1 -- 172.21.15.114:0/3840538798 <== osd.7 v2:172.21.15.116:6808/2799570166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f64c00ac5f0 con 0x7f64a806cda0 2024-02-17T12:20:11.405 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-02-17T12:20:11.405 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-17T12:20:11.405 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-02-17T12:20:11.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] conn(0x7f64a806cda0 msgr2=0x7f64a806f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64cda00640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.116:6808/2799570166,v1:172.21.15.116:6809/2799570166] conn(0x7f64a806cda0 0x7f64a806f1c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f64a8066e40 msgr2=0x7f64a8069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64cda00640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f64a8066e40 0x7f64a8069300 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f64b80039f0 tx=0x7f64b8009830 comp rx=0 tx=0).stop 2024-02-17T12:20:11.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64c80c2530 msgr2=0x7f64c8150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64cda00640 1 --2- 172.21.15.114:0/3840538798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64c80c2530 0x7f64c8150320 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f64b400c7f0 tx=0x7f64b400ccb0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64c7400640 1 -- 172.21.15.114:0/3840538798 reap_dead start 2024-02-17T12:20:11.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 shutdown_connections 2024-02-17T12:20:11.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.400+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 >> 172.21.15.114:0/3840538798 conn(0x7f64c806b210 msgr2=0x7f64c81489e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:11.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.404+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 shutdown_connections 2024-02-17T12:20:11.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.404+0000 7f64cda00640 1 -- 172.21.15.114:0/3840538798 wait complete. 2024-02-17T12:20:11.424 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-17T12:20:11.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.556+0000 7f6c42a00640 1 Processor -- start 2024-02-17T12:20:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.556+0000 7f6c42a00640 1 -- start start 2024-02-17T12:20:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.556+0000 7f6c42a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6c3c0c25a0 0x7f6c3c06e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.556+0000 7f6c42a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3c156270 con 0x7f6c3c152c50 2024-02-17T12:20:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.556+0000 7f6c42a00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3c156550 con 0x7f6c3c06db50 2024-02-17T12:20:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.556+0000 7f6c42a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3c071630 con 0x7f6c3c0c25a0 2024-02-17T12:20:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.556+0000 7f6c40a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6c3c152c50 0x7f6c3c153070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48288/0 (socket says 172.21.15.114:48288) 2024-02-17T12:20:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.556+0000 7f6c40a00640 1 -- 172.21.15.114:0/3106388180 learned_addr learned my addr 172.21.15.114:0/3106388180 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:11.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.556+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351236546 0 0) 0x7f6c3c156270 con 0x7f6c3c152c50 2024-02-17T12:20:11.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c20003530 con 0x7f6c3c152c50 2024-02-17T12:20:11.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3be00640 1 --2- 172.21.15.114:0/3106388180 >> v2:172.21.15.116:3300/0 conn(0x7f6c3c0c25a0 0x7f6c3c06e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3605436311 0 0) 0x7f6c20003530 con 0x7f6c3c152c50 2024-02-17T12:20:11.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 >> v2:172.21.15.116:3300/0 conn(0x7f6c3c0c25a0 msgr2=0x7f6c3c06e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:11.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 --2- 172.21.15.114:0/3106388180 >> v2:172.21.15.116:3300/0 conn(0x7f6c3c0c25a0 0x7f6c3c06e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 >> v1:172.21.15.116:6789/0 conn(0x7f6c3c06db50 legacy=0x7f6c3c14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c156830 con 0x7f6c3c152c50 2024-02-17T12:20:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f6c34001a00 con 0x7f6c3c152c50 2024-02-17T12:20:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 >> v1:172.21.15.114:6789/0 conn(0x7f6c3c152c50 legacy=0x7f6c3c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c20003980 0x7f6c20003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c200047d0 0x7f6c20004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c2000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2000c1d0 con 0x7f6c200052b0 2024-02-17T12:20:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2000c340 con 0x7f6c200047d0 2024-02-17T12:20:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2000c500 con 0x7f6c20003980 2024-02-17T12:20:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c40a00640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c2000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3be00640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c20003980 0x7f6c20003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c3b400640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c200047d0 0x7f6c20004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c40a00640 1 -- 172.21.15.114:0/3106388180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c20003980 msgr2=0x7f6c20003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c40a00640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c20003980 0x7f6c20003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c40a00640 1 -- 172.21.15.114:0/3106388180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c200047d0 msgr2=0x7f6c20004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c40a00640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c200047d0 0x7f6c20004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c40a00640 1 -- 172.21.15.114:0/3106388180 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c20003530 con 0x7f6c200052b0 2024-02-17T12:20:11.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c40a00640 1 -- 172.21.15.114:0/3106388180 reap_dead start 2024-02-17T12:20:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.560+0000 7f6c40a00640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c2000b990 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6c34002240 tx=0x7f6c3401d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2bbea9d13887e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340ad430 con 0x7f6c200052b0 2024-02-17T12:20:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c340a8070 con 0x7f6c200052b0 2024-02-17T12:20:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3aa00640 1 -- 172.21.15.114:0/3106388180 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340ad7f0 con 0x7f6c200052b0 2024-02-17T12:20:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 -- 172.21.15.114:0/3106388180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 msgr2=0x7f6c2000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c2000b990 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6c34002240 tx=0x7f6c3401d2f0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 -- 172.21.15.114:0/3106388180 shutdown_connections 2024-02-17T12:20:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 --2- 172.21.15.114:0/3106388180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c2000b990 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 -- 172.21.15.114:0/3106388180 >> 172.21.15.114:0/3106388180 conn(0x7f6c3c0a8490 msgr2=0x7f6c3c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:11.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 -- 172.21.15.114:0/3106388180 shutdown_connections 2024-02-17T12:20:11.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 -- 172.21.15.114:0/3106388180 wait complete. 2024-02-17T12:20:11.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 Processor -- start 2024-02-17T12:20:11.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 -- start start 2024-02-17T12:20:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c3c1459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c3c14ac50 0x7f6c3c14b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c3c1443a0 0x7f6c3c144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c146510 con 0x7f6c200052b0 2024-02-17T12:20:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c1460f0 con 0x7f6c3c14ac50 2024-02-17T12:20:11.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c42a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c155400 con 0x7f6c3c1443a0 2024-02-17T12:20:11.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c3c1459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c3c1459f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50500/0 (socket says 172.21.15.114:50500) 2024-02-17T12:20:11.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3be00640 1 -- 172.21.15.114:0/1559670906 learned_addr learned my addr 172.21.15.114:0/1559670906 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:11.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3b400640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c3c14ac50 0x7f6c3c14b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c40a00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c3c1443a0 0x7f6c3c144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3be00640 1 -- 172.21.15.114:0/1559670906 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c3c1443a0 msgr2=0x7f6c3c144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3be00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c3c1443a0 0x7f6c3c144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3be00640 1 -- 172.21.15.114:0/1559670906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c3c14ac50 msgr2=0x7f6c3c14b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3be00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c3c14ac50 0x7f6c3c14b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c3be00640 1 -- 172.21.15.114:0/1559670906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c155ca0 con 0x7f6c200052b0 2024-02-17T12:20:11.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.564+0000 7f6c40a00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c3c1443a0 0x7f6c3c144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-17T12:20:11.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c3be00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c3c1459f0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400b7f0 tx=0x7f6c2400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c33e00640 1 -- 172.21.15.114:0/1559670906 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240040f0 con 0x7f6c200052b0 2024-02-17T12:20:11.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c33e00640 1 -- 172.21.15.114:0/1559670906 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c24010830 con 0x7f6c200052b0 2024-02-17T12:20:11.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c42a00640 1 -- 172.21.15.114:0/1559670906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c154ad0 con 0x7f6c200052b0 2024-02-17T12:20:11.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c33e00640 1 -- 172.21.15.114:0/1559670906 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24010bc0 con 0x7f6c200052b0 2024-02-17T12:20:11.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c42a00640 1 -- 172.21.15.114:0/1559670906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c155090 con 0x7f6c200052b0 2024-02-17T12:20:11.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c42a00640 1 -- 172.21.15.114:0/1559670906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3c074840 con 0x7f6c200052b0 2024-02-17T12:20:11.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c33e00640 1 -- 172.21.15.114:0/1559670906 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f6c24014430 con 0x7f6c200052b0 2024-02-17T12:20:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c33e00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6c18066e70 0x7f6c18069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c33e00640 1 -- 172.21.15.114:0/1559670906 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6c24084e60 con 0x7f6c200052b0 2024-02-17T12:20:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.568+0000 7f6c3b400640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6c18066e70 0x7f6c18069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.572+0000 7f6c3b400640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6c18066e70 0x7f6c18069330 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c147370 tx=0x7f6c2c007cd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.572+0000 7f6c33e00640 1 -- 172.21.15.114:0/1559670906 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6c24051f90 con 0x7f6c200052b0 2024-02-17T12:20:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 -- 172.21.15.114:0/1559670906 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c3c0c2b90 con 0x7f6c18066e70 2024-02-17T12:20:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c33e00640 1 -- 172.21.15.114:0/1559670906 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6c2c004b90 con 0x7f6c18066e70 2024-02-17T12:20:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 7 to deep-scrub 2024-02-17T12:20:11.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 -- 172.21.15.114:0/1559670906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6c18066e70 msgr2=0x7f6c18069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6c18066e70 0x7f6c18069330 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c147370 tx=0x7f6c2c007cd0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 -- 172.21.15.114:0/1559670906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 msgr2=0x7f6c3c1459f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c3c1459f0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400b7f0 tx=0x7f6c2400bcb0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 -- 172.21.15.114:0/1559670906 shutdown_connections 2024-02-17T12:20:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6c3c1443a0 0x7f6c3c144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c3c14ac50 0x7f6c3c14b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f6c18066e70 0x7f6c18069330 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 --2- 172.21.15.114:0/1559670906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c200052b0 0x7f6c3c1459f0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 -- 172.21.15.114:0/1559670906 >> 172.21.15.114:0/1559670906 conn(0x7f6c3c0a8490 msgr2=0x7f6c3c14ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 -- 172.21.15.114:0/1559670906 shutdown_connections 2024-02-17T12:20:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.728+0000 7f6c42a00640 1 -- 172.21.15.114:0/1559670906 wait complete. 2024-02-17T12:20:11.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:20:11.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.884+0000 7f5777800640 1 Processor -- start 2024-02-17T12:20:11.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.884+0000 7f5777800640 1 -- start start 2024-02-17T12:20:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.884+0000 7f5777800640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f57700c2580 0x7f57700aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.884+0000 7f5777800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57700a9420 con 0x7f577014f110 2024-02-17T12:20:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.884+0000 7f5777800640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5770152850 con 0x7f57700c1eb0 2024-02-17T12:20:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.884+0000 7f5777800640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577014f4f0 con 0x7f57700c2580 2024-02-17T12:20:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.884+0000 7f5774e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f577014f110 0x7f57700c65a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48292/0 (socket says 172.21.15.114:48292) 2024-02-17T12:20:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.884+0000 7f5774e00640 1 -- 172.21.15.114:0/2714334892 learned_addr learned my addr 172.21.15.114:0/2714334892 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205779864 0 0) 0x7f57700a9420 con 0x7f577014f110 2024-02-17T12:20:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5754005740 con 0x7f577014f110 2024-02-17T12:20:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576fe00640 1 --2- 172.21.15.114:0/2714334892 >> v2:172.21.15.116:3300/0 conn(0x7f57700c2580 0x7f57700aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1054814687 0 0) 0x7f5754005740 con 0x7f577014f110 2024-02-17T12:20:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 >> v2:172.21.15.116:3300/0 conn(0x7f57700c2580 msgr2=0x7f57700aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 --2- 172.21.15.114:0/2714334892 >> v2:172.21.15.116:3300/0 conn(0x7f57700c2580 0x7f57700aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 >> v1:172.21.15.116:6789/0 conn(0x7f57700c1eb0 legacy=0x7f577015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700a9670 con 0x7f577014f110 2024-02-17T12:20:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7f5760001680 con 0x7f577014f110 2024-02-17T12:20:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 >> v1:172.21.15.114:6789/0 conn(0x7f577014f110 legacy=0x7f57700c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5754005be0 0x7f5754006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57540069e0 0x7f5754006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57540074c0 0x7f575400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577014f4f0 con 0x7f57540074c0 2024-02-17T12:20:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575400e3e0 con 0x7f57540069e0 2024-02-17T12:20:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575400e5a0 con 0x7f5754005be0 2024-02-17T12:20:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f5775800640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57540074c0 0x7f575400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f576fe00640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57540069e0 0x7f5754006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f5774e00640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5754005be0 0x7f5754006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f5775800640 1 -- 172.21.15.114:0/2714334892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5754005be0 msgr2=0x7f5754006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f5775800640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f5754005be0 0x7f5754006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f5775800640 1 -- 172.21.15.114:0/2714334892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57540069e0 msgr2=0x7f5754006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:11.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f5775800640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f57540069e0 0x7f5754006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.888+0000 7f5775800640 1 -- 172.21.15.114:0/2714334892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5754005740 con 0x7f57540074c0 2024-02-17T12:20:11.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5775800640 1 -- 172.21.15.114:0/2714334892 reap_dead start 2024-02-17T12:20:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5775800640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57540074c0 0x7f575400dba0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f5768001e70 tx=0x7f576801c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afac07aacfa979d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768003b80 con 0x7f57540074c0 2024-02-17T12:20:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768003d20 con 0x7f57540074c0 2024-02-17T12:20:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f576f400640 1 -- 172.21.15.114:0/2714334892 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768005310 con 0x7f57540074c0 2024-02-17T12:20:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 -- 172.21.15.114:0/2714334892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57540074c0 msgr2=0x7f575400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57540074c0 0x7f575400dba0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f5768001e70 tx=0x7f576801c5a0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 -- 172.21.15.114:0/2714334892 shutdown_connections 2024-02-17T12:20:11.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 --2- 172.21.15.114:0/2714334892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57540074c0 0x7f575400dba0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 -- 172.21.15.114:0/2714334892 >> 172.21.15.114:0/2714334892 conn(0x7f57700a8490 msgr2=0x7f57700a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 -- 172.21.15.114:0/2714334892 shutdown_connections 2024-02-17T12:20:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 -- 172.21.15.114:0/2714334892 wait complete. 2024-02-17T12:20:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 Processor -- start 2024-02-17T12:20:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 -- start start 2024-02-17T12:20:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57540074c0 0x7f577014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57701eddc0 0x7f5770149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f577014aee0 0x7f577014b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577014b8a0 con 0x7f57701eddc0 2024-02-17T12:20:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577014ba70 con 0x7f577014aee0 2024-02-17T12:20:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5777800640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577014aa50 con 0x7f57540074c0 2024-02-17T12:20:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f576fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57701eddc0 0x7f5770149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f576fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57701eddc0 0x7f5770149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50514/0 (socket says 172.21.15.114:50514) 2024-02-17T12:20:11.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f576fe00640 1 -- 172.21.15.114:0/1625138807 learned_addr learned my addr 172.21.15.114:0/1625138807 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:11.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5774e00640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57540074c0 0x7f577014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.892+0000 7f5775800640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f577014aee0 0x7f577014b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576fe00640 1 -- 172.21.15.114:0/1625138807 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57540074c0 msgr2=0x7f577014a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576fe00640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57540074c0 0x7f577014a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576fe00640 1 -- 172.21.15.114:0/1625138807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f577014aee0 msgr2=0x7f577014b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:11.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576fe00640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f577014aee0 0x7f577014b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:11.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576fe00640 1 -- 172.21.15.114:0/1625138807 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577014bc80 con 0x7f57701eddc0 2024-02-17T12:20:11.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576fe00640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57701eddc0 0x7f5770149410 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f575c00b7f0 tx=0x7f575c00bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576cc00640 1 -- 172.21.15.114:0/1625138807 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0107d0 con 0x7f57701eddc0 2024-02-17T12:20:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576cc00640 1 -- 172.21.15.114:0/1625138807 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c010930 con 0x7f57701eddc0 2024-02-17T12:20:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f5777800640 1 -- 172.21.15.114:0/1625138807 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577014bf60 con 0x7f57701eddc0 2024-02-17T12:20:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576cc00640 1 -- 172.21.15.114:0/1625138807 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c010ce0 con 0x7f57701eddc0 2024-02-17T12:20:11.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f5777800640 1 -- 172.21.15.114:0/1625138807 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5770149950 con 0x7f57701eddc0 2024-02-17T12:20:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f5777800640 1 -- 172.21.15.114:0/1625138807 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577014a880 con 0x7f57701eddc0 2024-02-17T12:20:11.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576cc00640 1 -- 172.21.15.114:0/1625138807 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f575c014430 con 0x7f57701eddc0 2024-02-17T12:20:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576cc00640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5750066e70 0x7f5750069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f576cc00640 1 -- 172.21.15.114:0/1625138807 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f575c084b60 con 0x7f57701eddc0 2024-02-17T12:20:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.896+0000 7f5774e00640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5750066e70 0x7f5750069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.900+0000 7f5774e00640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5750066e70 0x7f5750069330 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5760001060 tx=0x7f5760001a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:11.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:11.900+0000 7f576cc00640 1 -- 172.21.15.114:0/1625138807 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f575c051c90 con 0x7f57701eddc0 2024-02-17T12:20:12.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.052+0000 7f5777800640 1 -- 172.21.15.114:0/1625138807 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57700a9c30 con 0x7f5750066e70 2024-02-17T12:20:12.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f576cc00640 1 -- 172.21.15.114:0/1625138807 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50630 (secure 0 0 0) 0x7f5760001600 con 0x7f5750066e70 2024-02-17T12:20:12.058 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:20:12.059 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:20:12.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 -- 172.21.15.114:0/1625138807 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5750066e70 msgr2=0x7f5750069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:12.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5750066e70 0x7f5750069330 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5760001060 tx=0x7f5760001a10 comp rx=0 tx=0).stop 2024-02-17T12:20:12.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 -- 172.21.15.114:0/1625138807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57701eddc0 msgr2=0x7f5770149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:12.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57701eddc0 0x7f5770149410 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f575c00b7f0 tx=0x7f575c00bbf0 comp rx=0 tx=0).stop 2024-02-17T12:20:12.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 -- 172.21.15.114:0/1625138807 shutdown_connections 2024-02-17T12:20:12.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f577014aee0 0x7f577014b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:12.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5750066e70 0x7f5750069330 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:12.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57701eddc0 0x7f5770149410 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:12.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 --2- 172.21.15.114:0/1625138807 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57540074c0 0x7f577014a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:12.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 -- 172.21.15.114:0/1625138807 >> 172.21.15.114:0/1625138807 conn(0x7f57700a8490 msgr2=0x7f57700a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:12.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 -- 172.21.15.114:0/1625138807 shutdown_connections 2024-02-17T12:20:12.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:12.056+0000 7f5777800640 1 -- 172.21.15.114:0/1625138807 wait complete. 2024-02-17T12:20:12.078 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-02-17T12:20:11.265707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":254000,"kb_used_data":8712,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720720,"statfs":{"total":773094113280,"available":772834017280,"internally_reserved":0,"allocated":8921088,"data_stored":4599184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-138,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.848815"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-02-17T12:20:05.525828+0000","last_change":"2024-02-17T12:16:11.362145+0000","last_active":"2024-02-17T12:20:05.525828+0000","last_peered":"2024-02-17T12:20:05.525828+0000","last_clean":"2024-02-17T12:20:05.525828+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:20:05.525828+0000","last_undegraded":"2024-02-17T12:20:05.525828+0000","last_fullsized":"2024-02-17T12:20:05.525828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T12:16:09.743511+0000","last_clean_scrub_stamp":"2024-02-17T12:16:09.743511+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T21:48:33.345920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.45000000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97299999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.63}]},{"osd":1,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.115,"15min":1.115},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91200000000000003,"5min":1.143,"15min":1.143},"last":0.76200000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0640000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":1.734,"15min":1.734},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.98799999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.73999999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.72199999999999998,"15min":0.747},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0840000000000001,"5min":1.804,"15min":1.804},"last":0.45400000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.05,"5min":1.5,"15min":1.5},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:19:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1419999999999999,"5min":1.855,"15min":1.855},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84599999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.69099999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95499999999999996,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.68600000000000005,"15min":0.68700000000000006},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85099999999999998,"5min":1.103,"15min":1.103},"last":0.60899999999999999}]},{"osd":1,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.64400000000000002,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.84699999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69899999999999995,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89700000000000002,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92900000000000005,"5min":1.377,"15min":1.377},"last":0.68200000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.038,"5min":1.415,"15min":1.415},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80000000000000004,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.63700000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.89000000000000001,"5min":1.52,"15min":1.52},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90400000000000003,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86499999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:19:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.434,"15min":0.434},"max":{"1min":0.93300000000000005,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92000000000000004,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.52400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66000000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57599999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45500000000000002}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46700000000000003,"15min":0.48699999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54600000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52100000000000002,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81399999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58499999999999996}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52000000000000002,"15min":0.52600000000000002},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.56599999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.014,"5min":1.387,"15min":1.387},"last":0.65800000000000003}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0409999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.68700000000000006}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.149,"5min":1.714,"15min":1.714},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1339999999999999,"5min":1.744,"15min":1.744},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98199999999999998,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0980000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0720000000000001,"5min":1.575,"15min":1.575},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.95099999999999996,"5min":1.321,"15min":1.321},"last":0.78500000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.46100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":1.145,"15min":1.145},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.60599999999999998,"15min":0.66600000000000004},"min":{"1min":0.27500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60699999999999998,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65700000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.755},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.752,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.34499999999999997}]},{"osd":3,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.626,"15min":0.66100000000000003},"min":{"1min":0.40899999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":2.609,"15min":2.609},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.68200000000000005,"15min":0.75700000000000001},"min":{"1min":0.41899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.03,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.503}]},{"osd":5,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.86499999999999999,"15min":0.92700000000000005},"min":{"1min":0.54700000000000004,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.012,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.042,"5min":1.095,"15min":1.095},"last":0.47099999999999997}]},{"osd":6,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.96999999999999997,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.91600000000000004,"15min":0.98999999999999999},"min":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0549999999999999,"5min":5.375,"15min":5.375},"last":0.57199999999999995}]},{"osd":7,"last update":"Sat Feb 17 12:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.92400000000000004,"15min":0.998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95099999999999996,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.80100000000000005},"min":{"1min":0.56799999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95499999999999996,"5min":1.629,"15min":1.629},"last":0.58199999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1560576,"data_stored":1017674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.39400000000000002,"15min":0.40000000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.317},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57899999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.40600000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.31,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58799999999999997,"5min":1.046,"15min":1.046},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.34300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.55800000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.66700000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65400000000000003}]},{"osd":4,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96699999999999997,"5min":1.139,"15min":1.139},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94099999999999995,"5min":1.038,"15min":1.038},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.746,"15min":0.73099999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.071,"15min":1.071},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.085,"5min":1.095,"15min":1.095},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.99199999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.008,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.623}]},{"osd":7,"last update":"Sat Feb 17 12:19:14 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.749},"min":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.042,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.503},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.63600000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1560576,"data_stored":1017674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89200000000000002,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70199999999999996,"15min":0.71499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97399999999999998,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.57499999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72999999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.71599999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75800000000000001,"15min":0.78500000000000003},"min":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.67500000000000004}]},{"osd":3,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.50700000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.747},"min":{"1min":0.53700000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.62}]},{"osd":4,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.47599999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91400000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92400000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.76300000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72799999999999998,"15min":0.73599999999999999},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98199999999999998,"5min":1.052,"15min":1.052},"last":0.748},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73499999999999999,"15min":0.73999999999999999},"min":{"1min":0.48399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81699999999999995,"5min":1.264,"15min":1.264},"last":0.504},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89200000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.75}]},{"osd":1,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.749,"15min":0.755},"min":{"1min":0.61599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96699999999999997,"5min":1.198,"15min":1.198},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70699999999999996,"15min":0.70599999999999996},"min":{"1min":0.48999999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.171,"15min":1.171},"last":0.69599999999999995}]},{"osd":2,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71099999999999997,"15min":0.71399999999999997},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96699999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1040000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.59699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.999,"5min":1.522,"15min":1.522},"last":0.76700000000000002}]},{"osd":5,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Sat Feb 17 12:19:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.49299999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97399999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.624},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91400000000000003,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64500000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":1.228,"15min":1.228},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.55100000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71299999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.378}]},{"osd":1,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45600000000000002},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.40200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77200000000000002,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.60399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.179,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93200000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.59799999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0389999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.004,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.042,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.995,"5min":1.252,"15min":1.252},"last":0.626}]},{"osd":7,"last update":"Sat Feb 17 12:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79200000000000004,"15min":0.81799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0669999999999999,"5min":1.29,"15min":1.29},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1319999999999999,"5min":1.337,"15min":1.337},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:20:12.082 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-17T12:16:09.743511+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=16, tm_sec=9, tm_wday=5, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=20, tm_sec=6, tm_wday=5, tm_yday=48, tm_isdst=0) 2024-02-17T12:20:12.082 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-17T12:20:12.849 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:20:12.852 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:20:32.083 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-17T12:20:32.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd550c00640 1 Processor -- start 2024-02-17T12:20:32.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd550c00640 1 -- start start 2024-02-17T12:20:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd550c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c158ad0 0x7fd54c0aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd550c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c0c5ee0 con 0x7fd54c0aa060 2024-02-17T12:20:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd550c00640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c0706e0 con 0x7fd54c06fdc0 2024-02-17T12:20:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd550c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0c2390 con 0x7fd54c158ad0 2024-02-17T12:20:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd54c0aa060 0x7fd54c1583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47022/0 (socket says 172.21.15.114:47022) 2024-02-17T12:20:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54b400640 1 -- 172.21.15.114:0/1591459287 learned_addr learned my addr 172.21.15.114:0/1591459287 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54be00640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c158ad0 0x7fd54c0aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904303713 0 0) 0x7fd54c0c5ee0 con 0x7fd54c0aa060 2024-02-17T12:20:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd530003530 con 0x7fd54c0aa060 2024-02-17T12:20:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398314389 0 0) 0x7fd54c0706e0 con 0x7fd54c06fdc0 2024-02-17T12:20:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd54c0c5ee0 con 0x7fd54c06fdc0 2024-02-17T12:20:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 975192656 0 0) 0x7fd530003530 con 0x7fd54c0aa060 2024-02-17T12:20:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c158ad0 msgr2=0x7fd54c0aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c158ad0 0x7fd54c0aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 >> v1:172.21.15.116:6789/0 conn(0x7fd54c06fdc0 legacy=0x7fd54c15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0c2570 con 0x7fd54c0aa060 2024-02-17T12:20:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1278114726 0 0) 0x7fd53c001680 con 0x7fd54c0aa060 2024-02-17T12:20:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 >> v1:172.21.15.114:6789/0 conn(0x7fd54c0aa060 legacy=0x7fd54c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd530003b40 0x7fd530003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5300047d0 0x7fd530004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c158ad0 0x7fd530005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0c2390 con 0x7fd530003b40 2024-02-17T12:20:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53000bb50 con 0x7fd5300047d0 2024-02-17T12:20:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53000bd10 con 0x7fd54c158ad0 2024-02-17T12:20:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54b400640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd530003b40 0x7fd530003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd543e00640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5300047d0 0x7fd530004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54be00640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c158ad0 0x7fd530005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54b400640 1 -- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c158ad0 msgr2=0x7fd530005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54b400640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c158ad0 0x7fd530005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54b400640 1 -- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5300047d0 msgr2=0x7fd530004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54b400640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd5300047d0 0x7fd530004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.227+0000 7fd54b400640 1 -- 172.21.15.114:0/1591459287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530003530 con 0x7fd530003b40 2024-02-17T12:20:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd54b400640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd530003b40 0x7fd530003f40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00c160 tx=0x7fd53c01cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a4122b2abc9eb3 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0058e0 con 0x7fd530003b40 2024-02-17T12:20:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c005a60 con 0x7fd530003b40 2024-02-17T12:20:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd54aa00640 1 -- 172.21.15.114:0/1591459287 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c005e10 con 0x7fd530003b40 2024-02-17T12:20:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd550c00640 1 -- 172.21.15.114:0/1591459287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd530003b40 msgr2=0x7fd530003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd550c00640 1 --2- 172.21.15.114:0/1591459287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd530003b40 0x7fd530003f40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00c160 tx=0x7fd53c01cbb0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd54be00640 1 -- 172.21.15.114:0/1591459287 reap_dead start 2024-02-17T12:20:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd550c00640 1 -- 172.21.15.114:0/1591459287 shutdown_connections 2024-02-17T12:20:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd550c00640 1 -- 172.21.15.114:0/1591459287 >> 172.21.15.114:0/1591459287 conn(0x7fd54c06ed70 msgr2=0x7fd54c06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd550c00640 1 -- 172.21.15.114:0/1591459287 shutdown_connections 2024-02-17T12:20:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.231+0000 7fd550c00640 1 -- 172.21.15.114:0/1591459287 wait complete. 2024-02-17T12:20:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd550c00640 1 Processor -- start 2024-02-17T12:20:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd550c00640 1 -- start start 2024-02-17T12:20:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd550c00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd530003b40 0x7fd54c157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd550c00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c159000 0x7fd54c0abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd550c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c1f0970 0x7fd54c1f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd550c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c0ab0c0 con 0x7fd54c1f0970 2024-02-17T12:20:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd550c00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1f1330 con 0x7fd530003b40 2024-02-17T12:20:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd550c00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c1578d0 con 0x7fd54c159000 2024-02-17T12:20:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd54be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c1f0970 0x7fd54c1f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd54be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c1f0970 0x7fd54c1f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37800/0 (socket says 172.21.15.114:37800) 2024-02-17T12:20:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd54be00640 1 -- 172.21.15.114:0/1723789884 learned_addr learned my addr 172.21.15.114:0/1723789884 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd54b400640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd530003b40 0x7fd54c157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd543e00640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c159000 0x7fd54c0abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd54be00640 1 -- 172.21.15.114:0/1723789884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c159000 msgr2=0x7fd54c0abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd54be00640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c159000 0x7fd54c0abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd54be00640 1 -- 172.21.15.114:0/1723789884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd530003b40 msgr2=0x7fd54c157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd54be00640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd530003b40 0x7fd54c157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd54be00640 1 -- 172.21.15.114:0/1723789884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0a9050 con 0x7fd54c1f0970 2024-02-17T12:20:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd54be00640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c1f0970 0x7fd54c1f0df0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0c5260 tx=0x7fd54400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd543400640 1 -- 172.21.15.114:0/1723789884 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400e040 con 0x7fd54c1f0970 2024-02-17T12:20:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd543400640 1 -- 172.21.15.114:0/1723789884 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54400f040 con 0x7fd54c1f0970 2024-02-17T12:20:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd550c00640 1 -- 172.21.15.114:0/1723789884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c14a5c0 con 0x7fd54c1f0970 2024-02-17T12:20:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd543400640 1 -- 172.21.15.114:0/1723789884 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544015430 con 0x7fd54c1f0970 2024-02-17T12:20:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.235+0000 7fd550c00640 1 -- 172.21.15.114:0/1723789884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c0ab5b0 con 0x7fd54c1f0970 2024-02-17T12:20:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.239+0000 7fd550c00640 1 -- 172.21.15.114:0/1723789884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c068180 con 0x7fd54c1f0970 2024-02-17T12:20:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.239+0000 7fd543400640 1 -- 172.21.15.114:0/1723789884 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7fd5440157a0 con 0x7fd54c1f0970 2024-02-17T12:20:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.239+0000 7fd543400640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd528066e70 0x7fd528069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.239+0000 7fd543400640 1 -- 172.21.15.114:0/1723789884 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd544085370 con 0x7fd54c1f0970 2024-02-17T12:20:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.239+0000 7fd54b400640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd528066e70 0x7fd528069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.239+0000 7fd54b400640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd528066e70 0x7fd528069330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0aa000 tx=0x7fd53c001a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:32.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.243+0000 7fd543400640 1 -- 172.21.15.114:0/1723789884 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd5440524a0 con 0x7fd54c1f0970 2024-02-17T12:20:32.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.399+0000 7fd550c00640 1 -- 172.21.15.114:0/1723789884 --> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd54c0ab7a0 con 0x7fd528066e70 2024-02-17T12:20:32.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd543400640 1 -- 172.21.15.114:0/1723789884 <== mgr.4101 v2:172.21.15.114:6832/3817243712 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50445 (secure 0 0 0) 0x7fd54c0ab7a0 con 0x7fd528066e70 2024-02-17T12:20:32.406 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:20:32.407 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-02-17T12:20:32.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 -- 172.21.15.114:0/1723789884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd528066e70 msgr2=0x7fd528069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd528066e70 0x7fd528069330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0aa000 tx=0x7fd53c001a00 comp rx=0 tx=0).stop 2024-02-17T12:20:32.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 -- 172.21.15.114:0/1723789884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c1f0970 msgr2=0x7fd54c1f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c1f0970 0x7fd54c1f0df0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0c5260 tx=0x7fd54400f580 comp rx=0 tx=0).stop 2024-02-17T12:20:32.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 -- 172.21.15.114:0/1723789884 shutdown_connections 2024-02-17T12:20:32.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7fd528066e70 0x7fd528069330 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd54c1f0970 0x7fd54c1f0df0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd54c159000 0x7fd54c0abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 --2- 172.21.15.114:0/1723789884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd530003b40 0x7fd54c157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 -- 172.21.15.114:0/1723789884 >> 172.21.15.114:0/1723789884 conn(0x7fd54c06ed70 msgr2=0x7fd54c14ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:32.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 -- 172.21.15.114:0/1723789884 shutdown_connections 2024-02-17T12:20:32.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.403+0000 7fd550c00640 1 -- 172.21.15.114:0/1723789884 wait complete. 2024-02-17T12:20:32.427 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-02-17T12:20:31.270482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":253992,"kb_used_data":8712,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720728,"statfs":{"total":773094113280,"available":772834025472,"internally_reserved":0,"allocated":8921088,"data_stored":4599184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002719"},"pg_stats":[{"pgid":"1.0","version":"78'119","reported_seq":289,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-02-17T12:20:12.578472+0000","last_change":"2024-02-17T12:20:12.578472+0000","last_active":"2024-02-17T12:20:12.578472+0000","last_peered":"2024-02-17T12:20:12.578472+0000","last_clean":"2024-02-17T12:20:12.578472+0000","last_became_active":"2024-02-17T12:16:11.360833+0000","last_became_peered":"2024-02-17T12:16:11.360833+0000","last_unstale":"2024-02-17T12:20:12.578472+0000","last_undegraded":"2024-02-17T12:20:12.578472+0000","last_fullsized":"2024-02-17T12:20:12.578472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"78'119","last_scrub_stamp":"2024-02-17T12:20:12.578322+0000","last_deep_scrub":"78'119","last_deep_scrub_stamp":"2024-02-17T12:20:12.578322+0000","last_clean_scrub_stamp":"2024-02-17T12:20:12.578322+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-18T19:03:11.682349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69199999999999995,"15min":0.70499999999999996},"min":{"1min":0.49399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90600000000000003,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.752},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.372,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73099999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84299999999999997,"5min":1.115,"15min":1.115},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91400000000000003,"5min":1.143,"15min":1.143},"last":0.69999999999999996}]},{"osd":2,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.52900000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.85299999999999998,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88400000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72899999999999998}]},{"osd":3,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.71699999999999997,"15min":0.73299999999999998},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89400000000000002,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.51700000000000002,"5min":0.503,"15min":0.503},"max":{"1min":0.81799999999999995,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.629}]},{"osd":4,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.68300000000000005,"15min":0.73399999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.877,"5min":1.115,"15min":1.115},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.68899999999999995,"15min":0.71299999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.83899999999999997,"5min":1.804,"15min":1.804},"last":0.443}]},{"osd":5,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.72599999999999998,"15min":0.754},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.91500000000000004,"5min":1.5,"15min":1.5},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.78400000000000003,"15min":0.81799999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85299999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.76400000000000001,"15min":0.78900000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89600000000000002,"5min":1.855,"15min":1.855},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.81299999999999994,"15min":0.85099999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.871,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.56499999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67300000000000004,"15min":0.68200000000000005},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93400000000000005,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.495,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.996,"5min":1.103,"15min":1.103},"last":0.629}]},{"osd":1,"last update":"Sat Feb 17 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.45300000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.63300000000000001},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.038,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Feb 17 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.48299999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91200000000000003,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72199999999999998,"15min":0.74399999999999999},"min":{"1min":0.56499999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.113,"5min":1.377,"15min":1.377},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.59199999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0089999999999999,"5min":1.415,"15min":1.415},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.145,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.42899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85799999999999998,"5min":1.52,"15min":1.52},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.434,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77000000000000002,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.47499999999999998}]},{"osd":6,"last update":"Sat Feb 17 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96999999999999997,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.747,"15min":0.75800000000000001},"min":{"1min":0.60299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92200000000000004,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.72299999999999998}]},{"osd":7,"last update":"Sat Feb 17 12:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70099999999999996,"15min":0.72099999999999997},"min":{"1min":0.52100000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.85799999999999998,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.76400000000000001,"15min":0.78200000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.004,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.61099999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42399999999999999,"15min":0.437},"min":{"1min":0.28499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68799999999999994,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45000000000000001,"15min":0.46400000000000002},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57999999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.443}]},{"osd":1,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.45200000000000001,"15min":0.48199999999999998},"min":{"1min":0.307,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50700000000000001,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67700000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51100000000000001,"15min":0.52300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76900000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.629},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75600000000000001,"5min":1.387,"15min":1.387},"last":0.56599999999999995}]},{"osd":4,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.879,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.502,"5min":0.44,"15min":0.44},"max":{"1min":0.98599999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.501,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.079,"5min":1.714,"15min":1.714},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.55700000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":1.744,"15min":1.744},"last":0.80200000000000005}]},{"osd":6,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.48799999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96399999999999997,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.52600000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.05,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.89200000000000002}]},{"osd":7,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89500000000000002,"5min":1.575,"15min":1.575},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.745,"15min":0.76300000000000001},"min":{"1min":0.56100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.93400000000000005,"5min":1.321,"15min":1.321},"last":0.871}]}]},{"osd":1,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45000000000000001,"15min":0.45800000000000002},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68100000000000005,"5min":1.145,"15min":1.145},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.55100000000000005,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":5.1779999999999999,"15min":5.1779999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44500000000000001,"15min":0.46100000000000002},"min":{"1min":0.31900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.56200000000000006,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.623,"15min":0.73599999999999999},"min":{"1min":0.34499999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82699999999999996,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Feb 17 12:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59499999999999997,"15min":0.65100000000000002},"min":{"1min":0.38300000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79400000000000004,"5min":2.609,"15min":2.609},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.621,"15min":0.73699999999999999},"min":{"1min":0.375,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73799999999999999,"5min":6.3959999999999999,"15min":6.3959999999999999},"last":0.71099999999999997}]},{"osd":4,"last update":"Sat Feb 17 12:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.871,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.74099999999999999,"15min":0.77600000000000002},"min":{"1min":0.503,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.76300000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.96599999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.80700000000000005,"15min":0.90700000000000003},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86399999999999999,"5min":5.2779999999999996,"15min":5.2779999999999996},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71699999999999997,"15min":0.73099999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.878,"5min":1.095,"15min":1.095},"last":0.88400000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.76200000000000001,"15min":0.81100000000000005},"min":{"1min":0.51400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.84599999999999997,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.84799999999999998,"15min":0.96799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.83299999999999996,"5min":5.375,"15min":5.375},"last":0.93200000000000005}]},{"osd":7,"last update":"Sat Feb 17 12:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.85499999999999998,"15min":0.97499999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.90500000000000003,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.58199999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.80300000000000005,"5min":1.629,"15min":1.629},"last":1.0840000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32700,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1560576,"data_stored":1017674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.40100000000000002},"min":{"1min":0.28999999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.441,"15min":0.46200000000000002},"min":{"1min":0.29399999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55900000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.38300000000000001}]},{"osd":2,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45600000000000002},"min":{"1min":0.33800000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.82299999999999995,"5min":1.046,"15min":1.046},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.624,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.442}]},{"osd":3,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46600000000000003,"15min":0.45700000000000002},"min":{"1min":0.36099999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75800000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.45500000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84499999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.92500000000000004,"5min":1.139,"15min":1.139},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.52600000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89200000000000002,"5min":1.038,"15min":1.038},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":1.071,"15min":1.071},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.747,"15min":0.74099999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.90600000000000003,"5min":1.095,"15min":1.095},"last":0.63500000000000001}]},{"osd":6,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.76500000000000001},"min":{"1min":0.58599999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91500000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.77000000000000002},"min":{"1min":0.57099999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92200000000000004,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.755,"15min":0.748},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.55600000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.59199999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542198,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32700,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1560576,"data_stored":1017674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.68300000000000005,"15min":0.71899999999999997},"min":{"1min":0.48399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82499999999999996,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68799999999999994,"15min":0.70999999999999996},"min":{"1min":0.46300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.873,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.65500000000000003}]},{"osd":1,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92200000000000004,"5min":2.9300000000000002,"15min":2.9300000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72399999999999998,"15min":0.754},"min":{"1min":0.55000000000000004,"5min":0.505,"15min":0.505},"max":{"1min":0.88800000000000001,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.52000000000000002}]},{"osd":2,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.79400000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.871,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73699999999999999,"15min":0.77800000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84899999999999998,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65500000000000003},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.90000000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.62},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.502,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92900000000000005,"5min":2.8370000000000002,"15min":2.8370000000000002},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66400000000000003,"15min":0.67500000000000004},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.497},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66500000000000004,"15min":0.66600000000000004},"min":{"1min":0.42199999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.47599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92500000000000004,"5min":0.999,"15min":0.999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Feb 17 12:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.56000000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91300000000000003,"5min":1.052,"15min":1.052},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.53800000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98399999999999999,"5min":0.999,"15min":0.999},"last":0.68600000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.70199999999999996},"min":{"1min":0.47899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95199999999999996,"5min":1.264,"15min":1.264},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.879,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Feb 17 12:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.74099999999999999,"15min":0.753},"min":{"1min":0.54600000000000004,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":1.198,"15min":1.198},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88,"5min":1.171,"15min":1.171},"last":0.59399999999999997}]},{"osd":2,"last update":"Sat Feb 17 12:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70499999999999996,"15min":0.71199999999999997},"min":{"1min":0.58999999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":1.028,"15min":1.028},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71599999999999997,"15min":0.72599999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86799999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Feb 17 12:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76300000000000001,"15min":0.79500000000000004},"min":{"1min":0.57399999999999995,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92500000000000004,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.628},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79300000000000004,"15min":0.80500000000000005},"min":{"1min":0.64800000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97099999999999997,"5min":1.522,"15min":1.522},"last":0.67500000000000004}]},{"osd":5,"last update":"Sat Feb 17 12:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79900000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.68300000000000005,"15min":0.72499999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95599999999999996,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Feb 17 12:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.71799999999999997,"15min":0.76600000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.92100000000000004,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.69799999999999995,"15min":0.73099999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86699999999999999,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Feb 17 12:20:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74199999999999999,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93700000000000006,"5min":1.228,"15min":1.228},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.749,"15min":0.78900000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98899999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.69799999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":966656,"data_stored":427306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.42799999999999999,"15min":0.45200000000000001},"min":{"1min":0.29099999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52100000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44700000000000001,"15min":0.46400000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65100000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996}]},{"osd":1,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.57099999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65500000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47699999999999998,"15min":0.505},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59299999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.626},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.54500000000000004,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.68999999999999995,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.55700000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.875,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.747,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93300000000000005,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.88900000000000001}]},{"osd":5,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.77100000000000002,"15min":0.81000000000000005},"min":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.85899999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.74399999999999999,"15min":0.75900000000000001},"min":{"1min":0.49099999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90700000000000003,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.98399999999999999}]},{"osd":6,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.502,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.76100000000000001,"15min":0.80100000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.81899999999999995,"5min":1.252,"15min":1.252},"last":1.0249999999999999}]},{"osd":7,"last update":"Sat Feb 17 12:20:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76400000000000001,"15min":0.80800000000000005},"min":{"1min":0.54400000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83999999999999997,"5min":1.29,"15min":1.29},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.59199999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.88900000000000001,"5min":1.337,"15min":1.337},"last":1.016}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-17T12:20:32.430 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-17T12:20:32.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.563+0000 7ff784400640 1 Processor -- start 2024-02-17T12:20:32.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.563+0000 7ff784400640 1 -- start start 2024-02-17T12:20:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff784400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff77c14f110 0x7ff77c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff784400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c2580 0x7ff77c0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff784400640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff77c0c1eb0 0x7ff77c155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff784400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c14f4f0 con 0x7ff77c14f110 2024-02-17T12:20:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff784400640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c0aae80 con 0x7ff77c0c1eb0 2024-02-17T12:20:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff784400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0a9420 con 0x7ff77c0c2580 2024-02-17T12:20:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff781a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff77c14f110 0x7ff77c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff781a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff77c14f110 0x7ff77c0c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37804/0 (socket says 172.21.15.114:37804) 2024-02-17T12:20:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff781a00640 1 -- 172.21.15.114:0/3350316807 learned_addr learned my addr 172.21.15.114:0/3350316807 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff781000640 1 --2- 172.21.15.114:0/3350316807 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c2580 0x7ff77c0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff782400640 1 --2- 172.21.15.114:0/3350316807 >> v2:172.21.15.116:3300/0 conn(0x7ff77c0c1eb0 0x7ff77c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff781a00640 1 -- 172.21.15.114:0/3350316807 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c2580 msgr2=0x7ff77c0aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff781a00640 1 --2- 172.21.15.114:0/3350316807 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c2580 0x7ff77c0aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff781a00640 1 -- 172.21.15.114:0/3350316807 >> v2:172.21.15.116:3300/0 conn(0x7ff77c0c1eb0 msgr2=0x7ff77c155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff781a00640 1 --2- 172.21.15.114:0/3350316807 >> v2:172.21.15.116:3300/0 conn(0x7ff77c0c1eb0 0x7ff77c155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff781a00640 1 -- 172.21.15.114:0/3350316807 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c152850 con 0x7ff77c14f110 2024-02-17T12:20:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff782400640 1 --2- 172.21.15.114:0/3350316807 >> v2:172.21.15.116:3300/0 conn(0x7ff77c0c1eb0 0x7ff77c155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.567+0000 7ff781000640 1 --2- 172.21.15.114:0/3350316807 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c2580 0x7ff77c0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff781a00640 1 --2- 172.21.15.114:0/3350316807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c14f110 0x7ff77c0c65a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0c1090 tx=0x7ff77001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4e2b83eedfee80 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff77be00640 1 -- 172.21.15.114:0/3350316807 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700ab620 con 0x7ff77c14f110 2024-02-17T12:20:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff77be00640 1 -- 172.21.15.114:0/3350316807 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7700ab780 con 0x7ff77c14f110 2024-02-17T12:20:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff77be00640 1 -- 172.21.15.114:0/3350316807 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700abb10 con 0x7ff77c14f110 2024-02-17T12:20:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 -- 172.21.15.114:0/3350316807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c14f110 msgr2=0x7ff77c0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 --2- 172.21.15.114:0/3350316807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c14f110 0x7ff77c0c65a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0c1090 tx=0x7ff77001c460 comp rx=0 tx=0).stop 2024-02-17T12:20:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 -- 172.21.15.114:0/3350316807 shutdown_connections 2024-02-17T12:20:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 --2- 172.21.15.114:0/3350316807 >> v2:172.21.15.116:3300/0 conn(0x7ff77c0c1eb0 0x7ff77c155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 --2- 172.21.15.114:0/3350316807 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c2580 0x7ff77c0aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 --2- 172.21.15.114:0/3350316807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c14f110 0x7ff77c0c65a0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 -- 172.21.15.114:0/3350316807 >> 172.21.15.114:0/3350316807 conn(0x7ff77c0a8490 msgr2=0x7ff77c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 -- 172.21.15.114:0/3350316807 shutdown_connections 2024-02-17T12:20:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 -- 172.21.15.114:0/3350316807 wait complete. 2024-02-17T12:20:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 Processor -- start 2024-02-17T12:20:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 -- start start 2024-02-17T12:20:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c1eb0 0x7ff77c1ef430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c0c2580 0x7ff77c15b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c14f110 0x7ff77c143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c146f90 con 0x7ff77c0c2580 2024-02-17T12:20:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c1ef970 con 0x7ff77c14f110 2024-02-17T12:20:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.571+0000 7ff784400640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c147d90 con 0x7ff77c0c1eb0 2024-02-17T12:20:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c0c2580 0x7ff77c15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c0c2580 0x7ff77c15b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37812/0 (socket says 172.21.15.114:37812) 2024-02-17T12:20:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781000640 1 -- 172.21.15.114:0/4074762852 learned_addr learned my addr 172.21.15.114:0/4074762852 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781a00640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c1eb0 0x7ff77c1ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff782400640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c14f110 0x7ff77c143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781000640 1 -- 172.21.15.114:0/4074762852 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c1eb0 msgr2=0x7ff77c1ef430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781000640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c1eb0 0x7ff77c1ef430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781000640 1 -- 172.21.15.114:0/4074762852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c14f110 msgr2=0x7ff77c143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781000640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c14f110 0x7ff77c143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781000640 1 -- 172.21.15.114:0/4074762852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700094d0 con 0x7ff77c0c2580 2024-02-17T12:20:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781000640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c0c2580 0x7ff77c15b840 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff76800c7f0 tx=0x7ff76800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff779600640 1 -- 172.21.15.114:0/4074762852 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800cea0 con 0x7ff77c0c2580 2024-02-17T12:20:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff779600640 1 -- 172.21.15.114:0/4074762852 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7680079d0 con 0x7ff77c0c2580 2024-02-17T12:20:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff784400640 1 -- 172.21.15.114:0/4074762852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c148070 con 0x7ff77c0c2580 2024-02-17T12:20:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff779600640 1 -- 172.21.15.114:0/4074762852 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff768007d60 con 0x7ff77c0c2580 2024-02-17T12:20:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff784400640 1 -- 172.21.15.114:0/4074762852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c14a7a0 con 0x7ff77c0c2580 2024-02-17T12:20:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff784400640 1 -- 172.21.15.114:0/4074762852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c148290 con 0x7ff77c0c2580 2024-02-17T12:20:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff779600640 1 -- 172.21.15.114:0/4074762852 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7ff7680113f0 con 0x7ff77c0c2580 2024-02-17T12:20:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff779600640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff75c066e40 0x7ff75c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff779600640 1 -- 172.21.15.114:0/4074762852 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff768084880 con 0x7ff77c0c2580 2024-02-17T12:20:32.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.575+0000 7ff781a00640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff75c066e40 0x7ff75c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.579+0000 7ff781a00640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff75c066e40 0x7ff75c069300 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff7700af000 tx=0x7ff7700b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:32.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.579+0000 7ff779600640 1 -- 172.21.15.114:0/4074762852 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7680519b0 con 0x7ff77c0c2580 2024-02-17T12:20:32.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.735+0000 7ff784400640 1 -- 172.21.15.114:0/4074762852 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff77c067d60 con 0x7ff77c0c2580 2024-02-17T12:20:32.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.739+0000 7ff779600640 1 -- 172.21.15.114:0/4074762852 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff768055070 con 0x7ff77c0c2580 2024-02-17T12:20:32.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.739+0000 7ff779600640 1 -- 172.21.15.114:0/4074762852 <== mon.0 v2:172.21.15.114:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff7680519b0 con 0x7ff77c0c2580 2024-02-17T12:20:32.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 -- 172.21.15.114:0/4074762852 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff75c066e40 msgr2=0x7ff75c069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff75c066e40 0x7ff75c069300 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff7700af000 tx=0x7ff7700b6040 comp rx=0 tx=0).stop 2024-02-17T12:20:32.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 -- 172.21.15.114:0/4074762852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c0c2580 msgr2=0x7ff77c15b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c0c2580 0x7ff77c15b840 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff76800c7f0 tx=0x7ff76800ccb0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 -- 172.21.15.114:0/4074762852 shutdown_connections 2024-02-17T12:20:32.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff77c14f110 0x7ff77c143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7ff75c066e40 0x7ff75c069300 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff77c0c2580 0x7ff77c15b840 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 --2- 172.21.15.114:0/4074762852 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff77c0c1eb0 0x7ff77c1ef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 -- 172.21.15.114:0/4074762852 >> 172.21.15.114:0/4074762852 conn(0x7ff77c0a8490 msgr2=0x7ff77c0c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 -- 172.21.15.114:0/4074762852 shutdown_connections 2024-02-17T12:20:32.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.743+0000 7ff784400640 1 -- 172.21.15.114:0/4074762852 wait complete. 2024-02-17T12:20:32.766 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-17T12:20:32.766 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-17T12:20:32.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5447a00640 1 Processor -- start 2024-02-17T12:20:32.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5447a00640 1 -- start start 2024-02-17T12:20:32.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5447a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f544014f110 0x7f54400c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5447a00640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f54400c2580 0x7f54400aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5447a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54400a9420 con 0x7f54400c1eb0 2024-02-17T12:20:32.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5447a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544014f4f0 con 0x7f544014f110 2024-02-17T12:20:32.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5447a00640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400aae80 con 0x7f54400c2580 2024-02-17T12:20:32.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5445000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f544014f110 0x7f54400c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5445a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f54400c1eb0 0x7f5440155000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47032/0 (socket says 172.21.15.114:47032) 2024-02-17T12:20:32.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5445a00640 1 -- 172.21.15.114:0/3473675522 learned_addr learned my addr 172.21.15.114:0/3473675522 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-02-17T12:20:32.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f543fe00640 1 --2- 172.21.15.114:0/3473675522 >> v2:172.21.15.116:3300/0 conn(0x7f54400c2580 0x7f54400aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5445000640 1 -- 172.21.15.114:0/3473675522 >> v2:172.21.15.116:3300/0 conn(0x7f54400c2580 msgr2=0x7f54400aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-17T12:20:32.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5445000640 1 --2- 172.21.15.114:0/3473675522 >> v2:172.21.15.116:3300/0 conn(0x7f54400c2580 0x7f54400aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5445000640 1 -- 172.21.15.114:0/3473675522 >> v1:172.21.15.114:6789/0 conn(0x7f54400c1eb0 legacy=0x7f5440155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f543f400640 1 -- 172.21.15.114:0/3473675522 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557547898 0 0) 0x7f54400a9420 con 0x7f54400c1eb0 2024-02-17T12:20:32.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f5445000640 1 -- 172.21.15.114:0/3473675522 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5440152850 con 0x7f544014f110 2024-02-17T12:20:32.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.899+0000 7f543fe00640 1 --2- 172.21.15.114:0/3473675522 >> v2:172.21.15.116:3300/0 conn(0x7f54400c2580 0x7f54400aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:32.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f5445000640 1 --2- 172.21.15.114:0/3473675522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544014f110 0x7f54400c65a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f544006f0d0 tx=0x7f543001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae6ec9231d2ebc server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:32.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f543f400640 1 -- 172.21.15.114:0/3473675522 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300ac620 con 0x7f544014f110 2024-02-17T12:20:32.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f543f400640 1 -- 172.21.15.114:0/3473675522 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f54300ac780 con 0x7f544014f110 2024-02-17T12:20:32.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f543f400640 1 -- 172.21.15.114:0/3473675522 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300acb30 con 0x7f544014f110 2024-02-17T12:20:32.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f5447a00640 1 -- 172.21.15.114:0/3473675522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544014f110 msgr2=0x7f54400c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f5447a00640 1 --2- 172.21.15.114:0/3473675522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544014f110 0x7f54400c65a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f544006f0d0 tx=0x7f543001c3c0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f5447a00640 1 -- 172.21.15.114:0/3473675522 shutdown_connections 2024-02-17T12:20:32.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f5447a00640 1 --2- 172.21.15.114:0/3473675522 >> v2:172.21.15.116:3300/0 conn(0x7f54400c2580 0x7f54400aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f5447a00640 1 --2- 172.21.15.114:0/3473675522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f544014f110 0x7f54400c65a0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f5447a00640 1 -- 172.21.15.114:0/3473675522 >> 172.21.15.114:0/3473675522 conn(0x7f54400a8490 msgr2=0x7f54400a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:32.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f5447a00640 1 -- 172.21.15.114:0/3473675522 shutdown_connections 2024-02-17T12:20:32.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.903+0000 7f5447a00640 1 -- 172.21.15.114:0/3473675522 wait complete. 2024-02-17T12:20:32.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 Processor -- start 2024-02-17T12:20:32.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 -- start start 2024-02-17T12:20:32.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54400c1eb0 0x7f544014dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54400c2580 0x7f5440151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f544014f110 0x7f5440137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54401533a0 con 0x7f54400c1eb0 2024-02-17T12:20:32.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440145600 con 0x7f54400c2580 2024-02-17T12:20:32.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54401f1e90 con 0x7f544014f110 2024-02-17T12:20:32.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54400c1eb0 0x7f544014dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54400c1eb0 0x7f544014dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37820/0 (socket says 172.21.15.114:37820) 2024-02-17T12:20:32.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445000640 1 -- 172.21.15.114:0/2055072389 learned_addr learned my addr 172.21.15.114:0/2055072389 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-02-17T12:20:32.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f543fe00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54400c2580 0x7f5440151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445a00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f544014f110 0x7f5440137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445000640 1 -- 172.21.15.114:0/2055072389 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f544014f110 msgr2=0x7f5440137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445000640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f544014f110 0x7f5440137670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445000640 1 -- 172.21.15.114:0/2055072389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54400c2580 msgr2=0x7f5440151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:32.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445000640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54400c2580 0x7f5440151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:32.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445000640 1 -- 172.21.15.114:0/2055072389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430009420 con 0x7f54400c1eb0 2024-02-17T12:20:32.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f543fe00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54400c2580 0x7f5440151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:32.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445a00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f544014f110 0x7f5440137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-17T12:20:32.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5445000640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54400c1eb0 0x7f544014dbd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f5430018fd0 tx=0x7f543001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:32.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f543cc00640 1 -- 172.21.15.114:0/2055072389 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430004030 con 0x7f54400c1eb0 2024-02-17T12:20:32.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f543cc00640 1 -- 172.21.15.114:0/2055072389 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5430004190 con 0x7f54400c1eb0 2024-02-17T12:20:32.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f543cc00640 1 -- 172.21.15.114:0/2055072389 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430004500 con 0x7f54400c1eb0 2024-02-17T12:20:32.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 -- 172.21.15.114:0/2055072389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5440152f20 con 0x7f54400c1eb0 2024-02-17T12:20:32.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 -- 172.21.15.114:0/2055072389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5440145320 con 0x7f54400c1eb0 2024-02-17T12:20:32.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.907+0000 7f5447a00640 1 -- 172.21.15.114:0/2055072389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5440074840 con 0x7f54400c1eb0 2024-02-17T12:20:32.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.911+0000 7f543cc00640 1 -- 172.21.15.114:0/2055072389 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86409+0+0 (secure 0 0 0) 0x7f54300aa070 con 0x7f54400c1eb0 2024-02-17T12:20:32.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.911+0000 7f543cc00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5420066e40 0x7f5420069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-17T12:20:32.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.911+0000 7f543cc00640 1 -- 172.21.15.114:0/2055072389 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f543011ee60 con 0x7f54400c1eb0 2024-02-17T12:20:32.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.911+0000 7f543fe00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5420066e40 0x7f5420069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-17T12:20:32.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.911+0000 7f543fe00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5420066e40 0x7f5420069300 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5440150b10 tx=0x7f542c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-17T12:20:32.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:32.915+0000 7f543cc00640 1 -- 172.21.15.114:0/2055072389 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54300ebe50 con 0x7f54400c1eb0 2024-02-17T12:20:33.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.099+0000 7f5447a00640 1 -- 172.21.15.114:0/2055072389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5440074840 con 0x7f54400c1eb0 2024-02-17T12:20:33.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.099+0000 7f543cc00640 1 -- 172.21.15.114:0/2055072389 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f54300b1e90 con 0x7f54400c1eb0 2024-02-17T12:20:33.106 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-02-17T12:20:33.106 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3997973553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6833","nonce":3997973553},{"type":"v1","addr":"172.21.15.116:6835","nonce":3997973553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6834/74593561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":74593561},{"type":"v1","addr":"172.21.15.116:6834","nonce":74593561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7176,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/770464983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":770464983},{"type":"v1","addr":"172.21.15.114:6837","nonce":770464983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":7281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/472264175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":472264175},{"type":"v1","addr":"172.21.15.114:6836","nonce":472264175}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[]} 2024-02-17T12:20:33.108 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-02-17T12:20:33.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 -- 172.21.15.114:0/2055072389 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5420066e40 msgr2=0x7f5420069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5420066e40 0x7f5420069300 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5440150b10 tx=0x7f542c008040 comp rx=0 tx=0).stop 2024-02-17T12:20:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 -- 172.21.15.114:0/2055072389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54400c1eb0 msgr2=0x7f544014dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T12:20:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54400c1eb0 0x7f544014dbd0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f5430018fd0 tx=0x7f543001ac00 comp rx=0 tx=0).stop 2024-02-17T12:20:33.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 -- 172.21.15.114:0/2055072389 shutdown_connections 2024-02-17T12:20:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f544014f110 0x7f5440137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54400c2580 0x7f5440151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.114:6832/3817243712,v1:172.21.15.114:6833/3817243712] conn(0x7f5420066e40 0x7f5420069300 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:33.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 --2- 172.21.15.114:0/2055072389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54400c1eb0 0x7f544014dbd0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-17T12:20:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 -- 172.21.15.114:0/2055072389 >> 172.21.15.114:0/2055072389 conn(0x7f54400a8490 msgr2=0x7f54400c04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-17T12:20:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 -- 172.21.15.114:0/2055072389 shutdown_connections 2024-02-17T12:20:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-02-17T12:20:33.103+0000 7f5447a00640 1 -- 172.21.15.114:0/2055072389 wait complete. 2024-02-17T12:20:33.126 DEBUG:tasks.cephfs.filesystem:already dead... 2024-02-17T12:20:33.127 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-17T12:20:33.127 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-17T12:20:33.128 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:33.140 INFO:tasks.ceph.mds.a:Stopped 2024-02-17T12:20:33.141 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-17T12:20:33.141 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:33.197 INFO:tasks.ceph.mds.c:Stopped 2024-02-17T12:20:33.198 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-17T12:20:33.198 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:33.212 INFO:tasks.ceph.mds.b:Stopped 2024-02-17T12:20:33.213 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-17T12:20:33.213 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:33.267 INFO:tasks.ceph.mds.d:Stopped 2024-02-17T12:20:33.267 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-17T12:20:33.268 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-17T12:20:33.268 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:33.356 INFO:tasks.ceph.osd.0:Stopped 2024-02-17T12:20:33.357 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-17T12:20:33.357 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:33.441 INFO:tasks.ceph.osd.1:Stopped 2024-02-17T12:20:33.441 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-17T12:20:33.441 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:33.541 INFO:tasks.ceph.osd.2:Stopped 2024-02-17T12:20:33.541 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-17T12:20:33.541 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:33.607 INFO:tasks.ceph.osd.3:Stopped 2024-02-17T12:20:33.608 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-17T12:20:33.608 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:33.699 INFO:tasks.ceph.osd.4:Stopped 2024-02-17T12:20:33.699 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-17T12:20:33.699 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:36.873 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-02-17T12:20:39.801 INFO:tasks.ceph.osd.5:Stopped 2024-02-17T12:20:39.802 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-17T12:20:39.802 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:39.861 INFO:tasks.ceph.osd.6:Stopped 2024-02-17T12:20:39.862 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-17T12:20:39.862 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:39.954 INFO:tasks.ceph.osd.7:Stopped 2024-02-17T12:20:39.955 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-17T12:20:39.955 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-17T12:20:39.955 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:40.015 INFO:tasks.ceph.mgr.y:Stopped 2024-02-17T12:20:40.016 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-17T12:20:40.016 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:40.068 INFO:tasks.ceph.mgr.x:Stopped 2024-02-17T12:20:40.068 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-17T12:20:40.068 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-17T12:20:40.068 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:40.087 INFO:tasks.ceph.mon.a:Stopped 2024-02-17T12:20:40.088 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-17T12:20:40.088 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:40.104 INFO:tasks.ceph.mon.b:Stopped 2024-02-17T12:20:40.104 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-17T12:20:40.105 INFO:teuthology.orchestra.run:waiting for 300 2024-02-17T12:20:40.161 INFO:tasks.ceph.mon.c:Stopped 2024-02-17T12:20:40.162 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-17T12:20:40.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-17T12:20:40.192 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:20:40.193 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-17T12:20:40.483 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:20:40.483 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-17T12:20:40.703 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:20:40.704 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-17T12:20:40.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:20:40.886 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-17T12:20:41.102 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:20:41.103 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-17T12:20:41.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:20:41.301 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-17T12:20:41.463 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:20:41.464 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-17T12:20:41.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:20:41.619 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-17T12:20:41.763 INFO:tasks.ceph:Archiving mon data... 2024-02-17T12:20:41.764 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143/data/mon.a.tgz 2024-02-17T12:20:41.765 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-02-17T12:20:41.774 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.31mx9pv535 2024-02-17T12:20:41.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.31mx9pv535 2024-02-17T12:20:41.874 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-02-17T12:20:41.925 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.31mx9pv535 2024-02-17T12:20:42.005 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.31mx9pv535 is 449KB 2024-02-17T12:20:42.075 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.31mx9pv535 2024-02-17T12:20:42.083 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143/data/mon.b.tgz 2024-02-17T12:20:42.083 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-02-17T12:20:42.092 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.raViAmwUNA 2024-02-17T12:20:42.092 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.raViAmwUNA 2024-02-17T12:20:42.274 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.raViAmwUNA 2024-02-17T12:20:42.349 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.raViAmwUNA is 574KB 2024-02-17T12:20:42.417 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.raViAmwUNA 2024-02-17T12:20:42.425 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143/data/mon.c.tgz 2024-02-17T12:20:42.425 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-02-17T12:20:42.473 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.YpGk8xwgmI 2024-02-17T12:20:42.473 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YpGk8xwgmI 2024-02-17T12:20:42.650 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.YpGk8xwgmI 2024-02-17T12:20:42.725 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.YpGk8xwgmI is 575KB 2024-02-17T12:20:42.796 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.YpGk8xwgmI 2024-02-17T12:20:42.805 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-17T12:20:42.805 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-17T12:20:42.814 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-17T12:20:42.878 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-17T12:20:42.917 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-17T12:20:42.917 INFO:tasks.ceph:Archiving crash dumps... 2024-02-17T12:20:42.919 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143/remote/smithi114/crash 2024-02-17T12:20:42.920 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-17T12:20:42.941 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143/remote/smithi116/crash 2024-02-17T12:20:42.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-17T12:20:42.975 INFO:tasks.ceph:Shutting down logrotate 2024-02-17T12:20:42.976 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:20:42.988 DEBUG:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-17T12:20:43.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-17T12:20:43.091 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-17T12:20:43.132 INFO:tasks.ceph:Compressing logs... 2024-02-17T12:20:43.133 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-17T12:20:43.136 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-17T12:20:43.174 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2024-02-17T12:20:43.174 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36331.log 2024-02-17T12:20:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33288.log 2024-02-17T12:20:43.175 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2024-02-17T12:20:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37347.log 2024-02-17T12:20:43.179 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36331.log.gz 2024-02-17T12:20:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39359.log 2024-02-17T12:20:43.179 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33288.log.gz 2024-02-17T12:20:43.179 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37743.log 2024-02-17T12:20:43.179 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37347.log.gz 2024-02-17T12:20:43.184 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39031.log 2024-02-17T12:20:43.184 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39359.log.gz 2024-02-17T12:20:43.184 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44198.log 2024-02-17T12:20:43.185 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37743.log.gz 2024-02-17T12:20:43.186 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36225.log 2024-02-17T12:20:43.186 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39031.log.gz 2024-02-17T12:20:43.186 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42032.log 2024-02-17T12:20:43.186 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44198.log.gz 2024-02-17T12:20:43.186 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36812.log 2024-02-17T12:20:43.187 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36225.log.gz 2024-02-17T12:20:43.187 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42032.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-17T12:20:43.187 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42032.log.gz 2024-02-17T12:20:43.187 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41825.log 2024-02-17T12:20:43.187 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36812.log.gz 2024-02-17T12:20:43.187 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44705.log 2024-02-17T12:20:43.192 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39149.log 2024-02-17T12:20:43.192 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41825.log.gz 2024-02-17T12:20:43.192 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43351.log 2024-02-17T12:20:43.192 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44705.log.gz 2024-02-17T12:20:43.193 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39087.log 2024-02-17T12:20:43.193 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39149.log.gz 2024-02-17T12:20:43.193 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33444.log 2024-02-17T12:20:43.193 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43351.log.gz 2024-02-17T12:20:43.193 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41390.log 88.0% 2024-02-17T12:20:43.193 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39087.log.gz 2024-02-17T12:20:43.193 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34471.log 2024-02-17T12:20:43.193 INFO:teuthology.orchestra.run.smithi114.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33444.log.gz 2024-02-17T12:20:43.193 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2024-02-17T12:20:43.194 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41390.log.gz 2024-02-17T12:20:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.34471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45536.log 2024-02-17T12:20:43.194 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34471.log.gz 2024-02-17T12:20:43.194 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39333.log 2024-02-17T12:20:43.194 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2024-02-17T12:20:43.196 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32971.log 2024-02-17T12:20:43.197 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45536.log.gz 2024-02-17T12:20:43.197 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42896.log 2024-02-17T12:20:43.197 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39333.log.gz 2024-02-17T12:20:43.197 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.32971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41442.log 2024-02-17T12:20:43.198 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32971.log.gz 2024-02-17T12:20:43.198 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37061.log 2024-02-17T12:20:43.198 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42896.log.gz 2024-02-17T12:20:43.198 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35896.log 2024-02-17T12:20:43.198 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41442.log.gz 2024-02-17T12:20:43.242 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.33239.log 2024-02-17T12:20:43.243 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33177.log 2024-02-17T12:20:43.243 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.testuser.33239.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.testuser.33239.log.gz /var/log/ceph/ceph-client.admin.27541.log 2024-02-17T12:20:43.243 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-02-17T12:20:43.244 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.33177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33177.log.gz 2024-02-17T12:20:43.244 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32976.log 2024-02-17T12:20:43.244 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.27541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32864.log 2024-02-17T12:20:43.244 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27541.log.gz 2024-02-17T12:20:43.245 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.32976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32976.log.gz 2024-02-17T12:20:43.245 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27565.log 2024-02-17T12:20:43.245 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.32864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27685.log 2024-02-17T12:20:43.245 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32864.log.gz 2024-02-17T12:20:43.246 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.27565.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-17T12:20:43.246 INFO:teuthology.orchestra.run.smithi116.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27565.log.gz 2024-02-17T12:20:43.246 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.27685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27661.log 2024-02-17T12:20:43.246 INFO:teuthology.orchestra.run.smithi116.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27685.log.gz 2024-02-17T12:20:43.247 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-17T12:20:43.247 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.27661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27613.log 2024-02-17T12:20:43.247 INFO:teuthology.orchestra.run.smithi116.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27661.log.gz 2024-02-17T12:20:43.247 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33172.log 2024-02-17T12:20:43.248 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.27613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.33234.log 2024-02-17T12:20:43.248 INFO:teuthology.orchestra.run.smithi116.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27613.log.gz 2024-02-17T12:20:43.248 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.33172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33172.log.gz 2024-02-17T12:20:43.248 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32869.log 2024-02-17T12:20:43.249 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.testuser.33234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.33234.log.gz 2024-02-17T12:20:43.249 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27589.log 2024-02-17T12:20:43.249 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.32869.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-17T12:20:43.249 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32869.log.gz 2024-02-17T12:20:43.249 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.27589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33018.log 2024-02-17T12:20:43.249 INFO:teuthology.orchestra.run.smithi116.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27589.log.gz 2024-02-17T12:20:43.250 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27517.log 2024-02-17T12:20:43.250 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.33018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33018.log.gz 2024-02-17T12:20:43.250 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32971.log 2024-02-17T12:20:43.250 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32671.log 2024-02-17T12:20:43.250 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.27517.log: /var/log/ceph/ceph-client.1.32971.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27517.log.gz 2024-02-17T12:20:43.250 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32971.log.gz 2024-02-17T12:20:43.251 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-17T12:20:43.251 INFO:teuthology.orchestra.run.smithi116.stderr:gzip/var/log/ceph/ceph-client.1.32671.log: -5 --verbose -- /var/log/ceph/ceph-client.1.33023.log 2024-02-17T12:20:43.251 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32671.log.gz 2024-02-17T12:20:43.251 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-17T12:20:43.251 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.33023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33130.log 2024-02-17T12:20:43.252 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33023.log.gz 2024-02-17T12:20:43.252 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33125.log 2024-02-17T12:20:43.252 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.33130.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-17T12:20:43.252 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33130.log.gz 2024-02-17T12:20:43.252 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.33125.log: 92.1% 0.0%gzip -- replaced with /var/log/ceph/ceph-client.1.33125.log.gz 2024-02-17T12:20:43.253 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.27637.log 2024-02-17T12:20:43.253 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-02-17T12:20:43.253 INFO:teuthology.orchestra.run.smithi116.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-17T12:20:43.253 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32817.log 2024-02-17T12:20:43.254 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.27637.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-17T12:20:43.254 INFO:teuthology.orchestra.run.smithi116.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27637.log.gz 2024-02-17T12:20:43.254 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.32817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32817.log.gz 2024-02-17T12:20:43.254 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-02-17T12:20:43.255 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-17T12:20:43.255 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-17T12:20:43.255 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-mon.b.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-17T12:20:43.255 INFO:teuthology.orchestra.run.smithi116.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-02-17T12:20:43.256 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32689.log 2024-02-17T12:20:43.256 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32822.log 2024-02-17T12:20:43.256 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.32689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32689.log.gz 2024-02-17T12:20:43.257 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-17T12:20:43.257 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.1.32822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32822.log.gz 2024-02-17T12:20:43.271 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.4.log: 94.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-02-17T12:20:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42924.log 2024-02-17T12:20:43.283 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37061.log.gz 2024-02-17T12:20:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40245.log 2024-02-17T12:20:43.283 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35896.log.gz 2024-02-17T12:20:43.283 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40901.log 2024-02-17T12:20:43.283 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42924.log.gz 2024-02-17T12:20:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44283.log 2024-02-17T12:20:43.284 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40245.log.gz 2024-02-17T12:20:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33504.log 2024-02-17T12:20:43.284 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40901.log.gz 2024-02-17T12:20:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34120.log 2024-02-17T12:20:43.284 INFO:teuthology.orchestra.run.smithi114.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.44283.log.gz 2024-02-17T12:20:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44575.log 2024-02-17T12:20:43.284 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33504.log.gz 2024-02-17T12:20:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45036.log 2024-02-17T12:20:43.285 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34120.log.gz 2024-02-17T12:20:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42465.log 2024-02-17T12:20:43.285 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44575.log.gz 2024-02-17T12:20:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32997.log 2024-02-17T12:20:43.285 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45036.log.gz 2024-02-17T12:20:43.285 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45614.log 2024-02-17T12:20:43.286 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42465.log.gz 2024-02-17T12:20:43.286 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.32997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40771.log 2024-02-17T12:20:43.286 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32997.log.gz 2024-02-17T12:20:43.286 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45614.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-17T12:20:43.286 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45614.log.gz 2024-02-17T12:20:43.287 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45380.log 2024-02-17T12:20:43.287 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40771.log.gz 2024-02-17T12:20:43.287 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43645.log 2024-02-17T12:20:43.287 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45796.log 2024-02-17T12:20:43.288 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45380.log.gz 2024-02-17T12:20:43.288 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43645.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43645.log.gz 2024-02-17T12:20:43.288 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39879.log 2024-02-17T12:20:43.288 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33392.log 2024-02-17T12:20:43.288 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45796.log.gz 2024-02-17T12:20:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39879.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39879.log.gz 2024-02-17T12:20:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35382.log 2024-02-17T12:20:43.289 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35694.log 2024-02-17T12:20:43.289 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33392.log.gz 2024-02-17T12:20:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35382.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35382.log.gzgzip 2024-02-17T12:20:43.290 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42545.log 2024-02-17T12:20:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40483.log 2024-02-17T12:20:43.290 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35694.log.gz 2024-02-17T12:20:43.290 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34302.log 2024-02-17T12:20:43.291 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42545.log.gz 2024-02-17T12:20:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35538.log 2024-02-17T12:20:43.291 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40483.log.gz 2024-02-17T12:20:43.291 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40927.log 2024-02-17T12:20:43.292 INFO:teuthology.orchestra.run.smithi114.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34302.log.gz 2024-02-17T12:20:43.292 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-02-17T12:20:43.292 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35538.log.gz 2024-02-17T12:20:43.292 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40927.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40927.log.gz 2024-02-17T12:20:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33725.log 2024-02-17T12:20:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41005.log 2024-02-17T12:20:43.293 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2024-02-17T12:20:43.293 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36489.log 2024-02-17T12:20:43.293 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33725.log.gz 2024-02-17T12:20:43.294 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39059.log 2024-02-17T12:20:43.294 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41005.log.gz 2024-02-17T12:20:43.294 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44471.log 2024-02-17T12:20:43.294 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36489.log.gz 2024-02-17T12:20:43.294 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36515.log 2024-02-17T12:20:43.295 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39059.log.gz 2024-02-17T12:20:43.295 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38745.log 2024-02-17T12:20:43.295 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44471.log.gz 2024-02-17T12:20:43.295 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44012.log 2024-02-17T12:20:43.296 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36515.log.gz 2024-02-17T12:20:43.296 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33262.log 2024-02-17T12:20:43.296 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38745.log.gz 2024-02-17T12:20:43.296 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42255.log 2024-02-17T12:20:43.296 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44012.log.gz 2024-02-17T12:20:43.296 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36894.log 2024-02-17T12:20:43.297 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33262.log.gz 2024-02-17T12:20:43.297 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41721.log 2024-02-17T12:20:43.297 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42255.log.gz 2024-02-17T12:20:43.297 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39762.log 2024-02-17T12:20:43.297 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36894.log.gz 2024-02-17T12:20:43.297 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35842.log 2024-02-17T12:20:43.298 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41721.log.gz 2024-02-17T12:20:43.298 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34250.log 2024-02-17T12:20:43.298 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39762.log.gz 2024-02-17T12:20:43.298 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38466.log 2024-02-17T12:20:43.299 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35842.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35842.log.gz 2024-02-17T12:20:43.299 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34979.log 2024-02-17T12:20:43.299 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34250.log.gz 2024-02-17T12:20:43.299 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38466.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.38466.log.gz /var/log/ceph/ceph-client.admin.41468.log 2024-02-17T12:20:43.299 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-02-17T12:20:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38336.log 2024-02-17T12:20:43.300 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34979.log.gz 2024-02-17T12:20:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34172.log 2024-02-17T12:20:43.300 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41468.log.gz 2024-02-17T12:20:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38803.log 2024-02-17T12:20:43.301 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38336.log.gz 2024-02-17T12:20:43.301 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39788.log 2024-02-17T12:20:43.301 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34172.log.gz 2024-02-17T12:20:43.301 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34587.log 2024-02-17T12:20:43.302 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38803.log.gz 2024-02-17T12:20:43.302 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41883.log 2024-02-17T12:20:43.302 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39788.log.gz 2024-02-17T12:20:43.302 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40193.log 2024-02-17T12:20:43.303 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34587.log.gz 2024-02-17T12:20:43.303 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43697.log 2024-02-17T12:20:43.303 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41883.log.gz 2024-02-17T12:20:43.303 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39281.log 2024-02-17T12:20:43.304 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-17T12:20:43.304 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40193.log.gz 2024-02-17T12:20:43.304 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43697.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43697.log.gz 2024-02-17T12:20:43.304 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38284.log 2024-02-17T12:20:43.305 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36642.log 2024-02-17T12:20:43.305 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39281.log.gz 2024-02-17T12:20:43.305 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41338.log 2024-02-17T12:20:43.305 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38284.log.gz 2024-02-17T12:20:43.306 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.36642.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.42361.log -- replaced with /var/log/ceph/ceph-client.0.36642.log.gz 2024-02-17T12:20:43.306 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-02-17T12:20:43.306 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44932.log 2024-02-17T12:20:43.306 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41338.log.gz 2024-02-17T12:20:43.307 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34561.log 2024-02-17T12:20:43.307 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42361.log.gz 2024-02-17T12:20:43.307 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38440.log 2024-02-17T12:20:43.307 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44932.log.gz 2024-02-17T12:20:43.308 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42493.log 2024-02-17T12:20:43.308 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34561.log.gz 2024-02-17T12:20:43.308 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44984.log 2024-02-17T12:20:43.308 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38440.log.gz 2024-02-17T12:20:43.309 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43325.log 2024-02-17T12:20:43.309 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42493.log.gz 2024-02-17T12:20:43.309 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44146.log 2024-02-17T12:20:43.309 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44984.log.gz 2024-02-17T12:20:43.310 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40037.log 2024-02-17T12:20:43.310 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43325.log.gz 2024-02-17T12:20:43.310 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40349.log 2024-02-17T12:20:43.311 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44146.log.gz 2024-02-17T12:20:43.311 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35434.log 2024-02-17T12:20:43.311 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40037.log.gz 2024-02-17T12:20:43.311 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42790.log 2024-02-17T12:20:43.312 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40349.log.gz 2024-02-17T12:20:43.312 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37925.log 2024-02-17T12:20:43.312 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35434.log.gz 2024-02-17T12:20:43.312 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42790.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-17T12:20:43.313 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42790.log.gz 2024-02-17T12:20:43.313 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34639.log 2024-02-17T12:20:43.313 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37925.log.gz 2024-02-17T12:20:43.313 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38414.log 2024-02-17T12:20:43.314 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35304.log 2024-02-17T12:20:43.314 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34639.log.gz 2024-02-17T12:20:43.314 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33470.log 2024-02-17T12:20:43.315 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38414.log.gz 2024-02-17T12:20:43.315 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45088.log 2024-02-17T12:20:43.315 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35304.log.gz 2024-02-17T12:20:43.315 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33024.log 2024-02-17T12:20:43.316 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33470.log.gz 2024-02-17T12:20:43.316 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39606.log 2024-02-17T12:20:43.316 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45088.log.gz 2024-02-17T12:20:43.316 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44802.log 2024-02-17T12:20:43.317 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33024.log.gz 2024-02-17T12:20:43.317 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40535.log 2024-02-17T12:20:43.317 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39606.log.gz 2024-02-17T12:20:43.317 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44802.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44802.log.gz 2024-02-17T12:20:43.318 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40509.log 2024-02-17T12:20:43.318 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33184.log 2024-02-17T12:20:43.318 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40535.log.gz 2024-02-17T12:20:43.318 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45640.log 2024-02-17T12:20:43.319 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40509.log.gz 2024-02-17T12:20:43.319 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41031.log 2024-02-17T12:20:43.319 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33184.log.gz 2024-02-17T12:20:43.320 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45640.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.45640.log.gz 2024-02-17T12:20:43.320 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40401.log 2024-02-17T12:20:43.320 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37455.log 2024-02-17T12:20:43.321 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41031.log.gz 2024-02-17T12:20:43.321 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36279.log 2024-02-17T12:20:43.321 INFO:teuthology.orchestra.run.smithi114.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.40401.log.gz 2024-02-17T12:20:43.321 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39463.log 2024-02-17T12:20:43.322 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37455.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37455.log.gz 2024-02-17T12:20:43.322 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38055.log 2024-02-17T12:20:43.322 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36279.log.gz 2024-02-17T12:20:43.322 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37795.log 2024-02-17T12:20:43.323 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39463.log: /var/log/ceph/ceph-client.admin.38055.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39463.log.gzgzip 2024-02-17T12:20:43.323 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34509.log 2024-02-17T12:20:43.323 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38055.log.gz 2024-02-17T12:20:43.323 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37321.log 2024-02-17T12:20:43.323 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37795.log.gz 2024-02-17T12:20:43.323 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34509.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34509.log.gz 2024-02-17T12:20:43.324 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41163.log 2024-02-17T12:20:43.324 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37321.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-17T12:20:43.324 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37321.log.gz 2024-02-17T12:20:43.324 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42006.log 2024-02-17T12:20:43.324 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41163.log.gz 2024-02-17T12:20:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36637.log 2024-02-17T12:20:43.352 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42006.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42006.log.gz -5 2024-02-17T12:20:43.352 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44231.log 2024-02-17T12:20:43.352 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.36637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41598.log 2024-02-17T12:20:43.352 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36637.log.gz 2024-02-17T12:20:43.352 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36199.log 2024-02-17T12:20:43.352 INFO:teuthology.orchestra.run.smithi114.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44231.log.gz 2024-02-17T12:20:43.353 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34042.log 2024-02-17T12:20:43.353 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41598.log.gz 2024-02-17T12:20:43.353 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34357.log 2024-02-17T12:20:43.353 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36199.log.gz 2024-02-17T12:20:43.353 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34042.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34042.log.gz 2024-02-17T12:20:43.353 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35330.log 2024-02-17T12:20:43.353 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37591.log 2024-02-17T12:20:43.353 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35330.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34357.log.gz 2024-02-17T12:20:43.354 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35330.log.gz 2024-02-17T12:20:43.354 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44601.log 2024-02-17T12:20:43.354 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39541.log 2024-02-17T12:20:43.354 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44601.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37591.log.gz 2024-02-17T12:20:43.354 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44601.log.gz 2024-02-17T12:20:43.354 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45770.log 2024-02-17T12:20:43.354 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44828.log 2024-02-17T12:20:43.354 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39541.log.gz 2024-02-17T12:20:43.355 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45770.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45770.log.gz 2024-02-17T12:20:43.355 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45212.log 2024-02-17T12:20:43.355 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.44828.log: /var/log/ceph/ceph-client.admin.45744.log 2024-02-17T12:20:43.355 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44828.log.gz 2024-02-17T12:20:43.355 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36656.log 2024-02-17T12:20:43.355 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45212.log.gz 2024-02-17T12:20:43.356 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.admin.45744.log: --verbose -- /var/log/ceph/ceph-client.admin.37403.log 2024-02-17T12:20:43.356 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45744.log.gz 2024-02-17T12:20:43.356 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.43815.log 2024-02-17T12:20:43.356 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36656.log.gz 2024-02-17T12:20:43.356 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36383.log 2024-02-17T12:20:43.356 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37403.log.gz 2024-02-17T12:20:43.356 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.testuser.43815.log: --verbose -- /var/log/ceph/ceph-client.admin.42203.log 2024-02-17T12:20:43.356 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.43815.log.gz 2024-02-17T12:20:43.357 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37429.log 2024-02-17T12:20:43.357 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36383.log.gz 2024-02-17T12:20:43.357 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2024-02-17T12:20:43.357 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42203.log.gz 2024-02-17T12:20:43.357 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.admin.37429.log: --verbose -- /var/log/ceph/ceph-client.admin.41137.log 2024-02-17T12:20:43.357 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9%/var/log/ceph/ceph-client.admin.44445.log: -- replaced with /var/log/ceph/ceph-client.admin.37429.log.gz 2024-02-17T12:20:43.357 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35408.log 2024-02-17T12:20:43.357 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-02-17T12:20:43.358 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44257.log 2024-02-17T12:20:43.358 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41137.log.gz 2024-02-17T12:20:43.358 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41364.log 2024-02-17T12:20:43.358 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35408.log.gz 2024-02-17T12:20:43.358 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2024-02-17T12:20:43.358 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44257.log.gz 2024-02-17T12:20:43.359 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34094.log 2024-02-17T12:20:43.359 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41364.log.gz 2024-02-17T12:20:43.359 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42571.log: -- /var/log/ceph/ceph-client.admin.37191.log 2024-02-17T12:20:43.359 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39229.log 2024-02-17T12:20:43.359 INFO:teuthology.orchestra.run.smithi114.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gz 2024-02-17T12:20:43.360 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34094.log.gz 2024-02-17T12:20:43.360 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37269.log 2024-02-17T12:20:43.360 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37191.log.gz 2024-02-17T12:20:43.360 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42868.log 2024-02-17T12:20:43.361 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39229.log.gz 2024-02-17T12:20:43.361 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44309.log 2024-02-17T12:20:43.361 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37269.log.gz 2024-02-17T12:20:43.361 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40089.log 2024-02-17T12:20:43.362 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42868.log.gz 2024-02-17T12:20:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35195.log 2024-02-17T12:20:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40089.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44309.log.gz 2024-02-17T12:20:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33156.log 88.5% 2024-02-17T12:20:43.363 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40089.log.gz 2024-02-17T12:20:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34489.log 2024-02-17T12:20:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33156.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35195.log.gz 2024-02-17T12:20:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41851.log 2024-02-17T12:20:43.364 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33156.log.gz 2024-02-17T12:20:43.364 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.34489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34489.log.gz 2024-02-17T12:20:43.364 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27630.log 2024-02-17T12:20:43.364 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40797.log 2024-02-17T12:20:43.365 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.27630.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41851.log.gz 2024-02-17T12:20:43.365 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37217.log 2024-02-17T12:20:43.365 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27630.log.gz 2024-02-17T12:20:43.365 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41520.log 2024-02-17T12:20:43.366 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40797.log.gz 2024-02-17T12:20:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41416.log 2024-02-17T12:20:43.366 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37217.log.gz 2024-02-17T12:20:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36955.log 2024-02-17T12:20:43.367 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41520.log.gz 2024-02-17T12:20:43.367 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39307.log 2024-02-17T12:20:43.367 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41416.log.gz 2024-02-17T12:20:43.367 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34665.log 2024-02-17T12:20:43.368 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36955.log: /var/log/ceph/ceph-client.admin.39307.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36955.log.gz 2024-02-17T12:20:43.368 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43671.log 2024-02-17T12:20:43.368 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39307.log.gz 2024-02-17T12:20:43.368 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39437.log 2024-02-17T12:20:43.369 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34665.log.gz 2024-02-17T12:20:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41915.log 2024-02-17T12:20:43.369 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43671.log.gz 2024-02-17T12:20:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41085.log 2024-02-17T12:20:43.370 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39437.log.gz 2024-02-17T12:20:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45588.log 2024-02-17T12:20:43.370 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41915.log.gz 2024-02-17T12:20:43.371 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39491.log 2024-02-17T12:20:43.371 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45588.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41085.log.gz 2024-02-17T12:20:43.371 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45588.log.gz 2024-02-17T12:20:43.371 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33714.log 2024-02-17T12:20:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43273.log 2024-02-17T12:20:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33714.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.39491.log.gz 2024-02-17T12:20:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36173.log 2024-02-17T12:20:43.372 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33714.log.gz 2024-02-17T12:20:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41267.log 2024-02-17T12:20:43.373 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43273.log.gz 2024-02-17T12:20:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33730.log 2024-02-17T12:20:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41267.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36173.log.gz 2024-02-17T12:20:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45114.log 2024-02-17T12:20:43.374 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41267.log.gz 2024-02-17T12:20:43.374 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33730.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.33730.log.gz 2024-02-17T12:20:43.374 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.43403.log 2024-02-17T12:20:43.374 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40875.log 2024-02-17T12:20:43.374 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45114.log.gz 2024-02-17T12:20:43.374 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37951.log 2024-02-17T12:20:43.374 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43403.log.gz 2024-02-17T12:20:43.374 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40011.log 2024-02-17T12:20:43.375 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40875.log.gz 2024-02-17T12:20:43.375 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37951.log: /var/log/ceph/ceph-client.admin.43065.log 2024-02-17T12:20:43.375 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40011.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37951.log.gz 2024-02-17T12:20:43.375 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37769.log 2024-02-17T12:20:43.375 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40011.log.gz 2024-02-17T12:20:43.375 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43906.log 2024-02-17T12:20:43.375 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43065.log.gz 2024-02-17T12:20:43.375 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44549.log/var/log/ceph/ceph-client.admin.37769.log: 2024-02-17T12:20:43.375 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43906.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37769.log.gz 2024-02-17T12:20:43.376 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43906.log.gz 2024-02-17T12:20:43.376 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38310.log 2024-02-17T12:20:43.376 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40271.log 2024-02-17T12:20:43.376 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44549.log.gz 2024-02-17T12:20:43.376 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35169.log 2024-02-17T12:20:43.376 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38310.log.gz 2024-02-17T12:20:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40271.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-17T12:20:43.385 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40271.log.gz 2024-02-17T12:20:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36357.log 2024-02-17T12:20:43.385 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35169.log: /var/log/ceph/ceph-osd.3.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35169.log.gz 2024-02-17T12:20:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36138.log 2024-02-17T12:20:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40427.log 2024-02-17T12:20:43.386 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36357.log.gz 2024-02-17T12:20:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38667.log 2024-02-17T12:20:43.386 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36138.log.gz 2024-02-17T12:20:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38979.log 2024-02-17T12:20:43.386 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz 2024-02-17T12:20:43.386 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34719.log 2024-02-17T12:20:43.387 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38667.log.gz 2024-02-17T12:20:43.387 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43429.log 2024-02-17T12:20:43.387 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38979.log.gz 2024-02-17T12:20:43.387 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35977.log 2024-02-17T12:20:43.387 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34719.log.gz 2024-02-17T12:20:43.387 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44361.log 2024-02-17T12:20:43.387 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43429.log.gz 2024-02-17T12:20:43.387 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39684.log 2024-02-17T12:20:43.388 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35977.log.gz 2024-02-17T12:20:43.388 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45354.log 2024-02-17T12:20:43.388 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44361.log.gz 2024-02-17T12:20:43.388 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33340.log 2024-02-17T12:20:43.388 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39684.log.gz 2024-02-17T12:20:43.388 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41312.log 2024-02-17T12:20:43.388 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45354.log.gz 2024-02-17T12:20:43.388 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36030.log 2024-02-17T12:20:43.388 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33340.log.gz 2024-02-17T12:20:43.389 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43091.log 2024-02-17T12:20:43.389 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41312.log.gz 2024-02-17T12:20:43.389 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43299.log 2024-02-17T12:20:43.389 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36030.log.gz 2024-02-17T12:20:43.389 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38693.log 2024-02-17T12:20:43.389 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43091.log.gz 2024-02-17T12:20:43.389 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36463.log 2024-02-17T12:20:43.389 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43299.log.gz 2024-02-17T12:20:43.390 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36708.log 2024-02-17T12:20:43.390 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38693.log.gz 2024-02-17T12:20:43.390 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42335.log 2024-02-17T12:20:43.390 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36463.log.gz 2024-02-17T12:20:43.390 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37691.log 2024-02-17T12:20:43.390 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36708.log.gz 2024-02-17T12:20:43.390 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45458.log 2024-02-17T12:20:43.390 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42335.log.gz 2024-02-17T12:20:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42712.log 2024-02-17T12:20:43.391 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37691.log.gz 2024-02-17T12:20:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41799.log 2024-02-17T12:20:43.391 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45458.log.gz 2024-02-17T12:20:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35143.log 2024-02-17T12:20:43.391 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42712.log.gz 2024-02-17T12:20:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39005.log 2024-02-17T12:20:43.391 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41799.log.gz 2024-02-17T12:20:43.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33726.log 2024-02-17T12:20:43.392 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35143.log.gz 2024-02-17T12:20:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36682.log 2024-02-17T12:20:43.392 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39005.log.gz 2024-02-17T12:20:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33050.log 2024-02-17T12:20:43.392 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33726.log.gz 2024-02-17T12:20:43.392 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38187.log 2024-02-17T12:20:43.392 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36682.log.gz 2024-02-17T12:20:43.396 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45562.log 2024-02-17T12:20:43.396 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33050.log.gz 2024-02-17T12:20:43.396 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43117.log 2024-02-17T12:20:43.396 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38187.log.gz 2024-02-17T12:20:43.396 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39736.log 2024-02-17T12:20:43.396 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45562.log.gz 2024-02-17T12:20:43.396 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36253.log 2024-02-17T12:20:43.397 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43117.log.gz 2024-02-17T12:20:43.397 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43593.log 2024-02-17T12:20:43.397 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39736.log.gz 2024-02-17T12:20:43.397 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45159.log 2024-02-17T12:20:43.397 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36253.log.gz 2024-02-17T12:20:43.397 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33990.log 2024-02-17T12:20:43.397 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43593.log.gz 2024-02-17T12:20:43.397 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37243.log 2024-02-17T12:20:43.398 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45159.log.gz 2024-02-17T12:20:43.398 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33990.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-17T12:20:43.398 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33990.log.gz 2024-02-17T12:20:43.398 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45666.log 2024-02-17T12:20:43.398 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37243.log.gz 2024-02-17T12:20:43.399 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39985.log 2024-02-17T12:20:43.400 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.43810.log 2024-02-17T12:20:43.400 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45666.log.gz 2024-02-17T12:20:43.400 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40141.log 2024-02-17T12:20:43.400 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39985.log.gz 2024-02-17T12:20:43.400 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.testuser.43810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.43810.log.gz 2024-02-17T12:20:43.401 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36305.log 2024-02-17T12:20:43.401 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40453.log 2024-02-17T12:20:43.401 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40141.log.gz 2024-02-17T12:20:43.402 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39385.log 2024-02-17T12:20:43.403 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36305.log.gz 2024-02-17T12:20:43.404 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40453.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40453.log.gz 2024-02-17T12:20:43.405 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40561.log 2024-02-17T12:20:43.405 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39385.log.gz 2024-02-17T12:20:43.405 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33210.log 2024-02-17T12:20:43.407 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36591.log 2024-02-17T12:20:43.407 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40561.log.gz 2024-02-17T12:20:43.408 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33210.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33210.log.gz 2024-02-17T12:20:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36591.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36591.log.gz 2024-02-17T12:20:43.409 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44094.log 2024-02-17T12:20:43.410 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44958.log 2024-02-17T12:20:43.412 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43195.log 2024-02-17T12:20:43.412 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44094.log.gz 2024-02-17T12:20:43.413 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44523.log 2024-02-17T12:20:43.413 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44958.log.gz 2024-02-17T12:20:43.414 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43195.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43195.log.gz 2024-02-17T12:20:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36435.log 2024-02-17T12:20:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44523.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44523.log.gz 2024-02-17T12:20:43.416 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43455.log 2024-02-17T12:20:43.417 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40849.log 2024-02-17T12:20:43.417 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36435.log.gz 2024-02-17T12:20:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43455.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43455.log.gz 2024-02-17T12:20:43.419 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40849.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40849.log.gz 2024-02-17T12:20:43.420 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41773.log 2024-02-17T12:20:43.421 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37373.log 2024-02-17T12:20:43.422 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40823.log 2024-02-17T12:20:43.423 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41773.log.gz 2024-02-17T12:20:43.423 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42085.log 2024-02-17T12:20:43.423 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37373.log.gz 2024-02-17T12:20:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40823.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40823.log.gz 2024-02-17T12:20:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42387.log 2024-02-17T12:20:43.429 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42085.log.gz 2024-02-17T12:20:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35031.log 2024-02-17T12:20:43.430 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.40726.log 2024-02-17T12:20:43.430 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42387.log.gz 2024-02-17T12:20:43.430 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35031.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35031.log.gz 2024-02-17T12:20:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.testuser.40726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.40726.log.gz 2024-02-17T12:20:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40323.log 2024-02-17T12:20:43.431 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44854.log 2024-02-17T12:20:43.433 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39959.log 2024-02-17T12:20:43.433 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40323.log.gz 2024-02-17T12:20:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44854.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44854.log.gz 2024-02-17T12:20:43.435 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39959.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39959.log.gz 2024-02-17T12:20:43.435 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37821.log 2024-02-17T12:20:43.436 INFO:teuthology.orchestra.run.smithi116.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-17T12:20:43.436 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33128.log 2024-02-17T12:20:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35512.log 2024-02-17T12:20:43.439 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37821.log.gz 2024-02-17T12:20:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33128.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33128.log.gz 2024-02-17T12:20:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35512.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35512.log.gz 2024-02-17T12:20:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43567.log 2024-02-17T12:20:43.441 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42842.log 2024-02-17T12:20:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 2024-02-17T12:20:43.443 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43567.log.gz 2024-02-17T12:20:43.444 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42842.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42842.log.gz 2024-02-17T12:20:43.445 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44653.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2024-02-17T12:20:43.445 INFO:teuthology.orchestra.run.smithi116.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-17T12:20:43.446 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41669.log 2024-02-17T12:20:43.446 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40587.log 2024-02-17T12:20:43.448 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35460.log 2024-02-17T12:20:43.449 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41669.log.gz 2024-02-17T12:20:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35590.log 2024-02-17T12:20:43.449 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40587.log.gz 2024-02-17T12:20:43.450 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35460.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35460.log.gz 2024-02-17T12:20:43.451 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43377.log 2024-02-17T12:20:43.451 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35590.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35590.log.gz 2024-02-17T12:20:43.452 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34927.log 2024-02-17T12:20:43.453 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38952.log 2024-02-17T12:20:43.453 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43377.log.gz 2024-02-17T12:20:43.454 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34927.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34927.log.gz 2024-02-17T12:20:43.455 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38952.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38952.log.gz 2024-02-17T12:20:43.455 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27395.log 2024-02-17T12:20:43.456 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37295.log 2024-02-17T12:20:43.458 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.27395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45824.log 2024-02-17T12:20:43.459 INFO:teuthology.orchestra.run.smithi114.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.27395.log.gz 2024-02-17T12:20:43.459 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37295.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37295.log.gz 2024-02-17T12:20:43.460 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45824.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45824.log.gz 2024-02-17T12:20:43.460 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39844.log 2024-02-17T12:20:43.461 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39203.log 2024-02-17T12:20:43.463 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44335.log 2024-02-17T12:20:43.463 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39844.log.gz 2024-02-17T12:20:43.464 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45328.log 2024-02-17T12:20:43.465 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39203.log.gz 2024-02-17T12:20:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44335.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44335.log.gz 2024-02-17T12:20:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35356.log 2024-02-17T12:20:43.467 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45328.log.gz 2024-02-17T12:20:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35752.log 2024-02-17T12:20:43.468 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34823.log 2024-02-17T12:20:43.469 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35356.log.gz 2024-02-17T12:20:43.469 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35752.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35752.log.gz 2024-02-17T12:20:43.470 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34823.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34823.log.gz 2024-02-17T12:20:43.471 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-17T12:20:43.472 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36838.log 2024-02-17T12:20:43.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43482.log 2024-02-17T12:20:43.475 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36838.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36838.log.gz 2024-02-17T12:20:43.475 INFO:teuthology.orchestra.run.smithi114.stderr: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-17T12:20:43.476 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43482.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43482.log.gz 2024-02-17T12:20:43.476 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42283.log 2024-02-17T12:20:43.477 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43880.log 2024-02-17T12:20:43.478 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42283.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42283.log.gz 2024-02-17T12:20:43.479 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43880.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43880.log.gz 2024-02-17T12:20:43.481 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41189.log 2024-02-17T12:20:43.481 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37873.log 2024-02-17T12:20:43.485 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43755.log 2024-02-17T12:20:43.485 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41189.log.gz 2024-02-17T12:20:43.485 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37873.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37873.log.gz 2024-02-17T12:20:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36929.log 2024-02-17T12:20:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43755.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43755.log.gz 2024-02-17T12:20:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37009.log 2024-02-17T12:20:43.486 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34771.log 2024-02-17T12:20:43.487 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36929.log.gz 2024-02-17T12:20:43.487 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37009.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37009.log.gz 2024-02-17T12:20:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34771.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34771.log.gz 2024-02-17T12:20:43.489 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45692.log 2024-02-17T12:20:43.490 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33236.log 2024-02-17T12:20:43.491 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.40731.log 2024-02-17T12:20:43.491 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45692.log.gz 2024-02-17T12:20:43.492 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33236.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33236.log.gz 2024-02-17T12:20:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.testuser.40731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.40731.log.gz 2024-02-17T12:20:43.493 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35117.log 2024-02-17T12:20:43.494 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37533.log 2024-02-17T12:20:43.496 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43828.log 2024-02-17T12:20:43.496 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35117.log.gz 2024-02-17T12:20:43.497 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34953.log 2024-02-17T12:20:43.497 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37533.log.gz 2024-02-17T12:20:43.498 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43828.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43828.log.gz 2024-02-17T12:20:43.498 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39255.log 2024-02-17T12:20:43.499 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34953.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34953.log.gz 2024-02-17T12:20:43.499 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38835.log 2024-02-17T12:20:43.501 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33718.log 2024-02-17T12:20:43.501 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39255.log.gz 2024-02-17T12:20:43.502 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33964.log 2024-02-17T12:20:43.502 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38835.log.gz 2024-02-17T12:20:43.503 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33718.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22560.log 2024-02-17T12:20:43.503 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33718.log.gz 2024-02-17T12:20:43.505 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33964.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33964.log.gz 2024-02-17T12:20:43.506 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41494.log 2024-02-17T12:20:43.506 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.tmp-client.admin.22560.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22560.log.gz 2024-02-17T12:20:43.506 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34875.log 2024-02-17T12:20:43.507 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38926.log 2024-02-17T12:20:43.508 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41494.log.gz 2024-02-17T12:20:43.509 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34875.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34875.log.gz 2024-02-17T12:20:43.510 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38926.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38926.log.gz 2024-02-17T12:20:43.510 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34198.log 2024-02-17T12:20:43.511 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45276.log 2024-02-17T12:20:43.512 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35057.log 2024-02-17T12:20:43.513 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34198.log.gz 2024-02-17T12:20:43.515 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45276.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2024-02-17T12:20:43.515 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35057.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35057.log.gz 2024-02-17T12:20:43.515 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35278.log 2024-02-17T12:20:43.516 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42621.log 2024-02-17T12:20:43.518 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33731.log 2024-02-17T12:20:43.518 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35278.log.gz 2024-02-17T12:20:43.519 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42621.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.42621.log.gz 2024-02-17T12:20:43.520 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33731.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33731.log.gz 2024-02-17T12:20:43.520 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36734.log 2024-02-17T12:20:43.521 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33314.log 2024-02-17T12:20:43.523 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42413.log 2024-02-17T12:20:43.523 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36734.log.gz 2024-02-17T12:20:43.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33314.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.33314.log.gz 2024-02-17T12:20:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42413.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42413.log.gz 2024-02-17T12:20:43.526 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45848.log 2024-02-17T12:20:43.527 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37139.log 2024-02-17T12:20:43.528 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45185.log 2024-02-17T12:20:43.529 INFO:teuthology.orchestra.run.smithi114.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45848.log.gz 2024-02-17T12:20:43.531 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33418.log 2024-02-17T12:20:43.532 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37139.log.gz 2024-02-17T12:20:43.532 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42229.log 2024-02-17T12:20:43.532 INFO:teuthology.orchestra.run.smithi114.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.45185.log.gz 2024-02-17T12:20:43.533 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43013.log 2024-02-17T12:20:43.533 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33418.log.gz 2024-02-17T12:20:43.533 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42229.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42229.log.gz 2024-02-17T12:20:43.534 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43013.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43013.log.gz 2024-02-17T12:20:43.534 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43511.log 2024-02-17T12:20:43.535 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37665.log 2024-02-17T12:20:43.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32906.log 2024-02-17T12:20:43.538 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43511.log.gz 2024-02-17T12:20:43.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37665.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37665.log.gz 2024-02-17T12:20:43.539 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.32906.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32906.log.gz 2024-02-17T12:20:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40375.log 2024-02-17T12:20:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36056.log 2024-02-17T12:20:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36409.log 2024-02-17T12:20:43.542 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40375.log.gz 2024-02-17T12:20:43.542 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36056.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36056.log.gz 2024-02-17T12:20:43.543 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36409.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36409.log.gz 2024-02-17T12:20:43.544 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33366.log 2024-02-17T12:20:43.545 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-02-17T12:20:43.547 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35564.log 2024-02-17T12:20:43.548 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33366.log.gz 2024-02-17T12:20:43.548 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43854.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-02-17T12:20:43.549 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35564.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35564.log.gz 2024-02-17T12:20:43.550 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33512.log 2024-02-17T12:20:43.550 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43039.log 2024-02-17T12:20:43.552 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34068.log 2024-02-17T12:20:43.553 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33512.log.gz 2024-02-17T12:20:43.554 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42816.log 2024-02-17T12:20:43.554 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43039.log.gz 2024-02-17T12:20:43.554 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34068.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34068.log.gz 2024-02-17T12:20:43.555 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42519.log 2024-02-17T12:20:43.555 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42816.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42816.log.gz 2024-02-17T12:20:43.556 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44042.log 2024-02-17T12:20:43.557 INFO:teuthology.orchestra.run.smithi116.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-17T12:20:43.557 INFO:teuthology.orchestra.run.smithi116.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-17T12:20:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38003.log 2024-02-17T12:20:43.558 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42519.log.gz 2024-02-17T12:20:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44042.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44042.log.gz 2024-02-17T12:20:43.559 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38003.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38003.log.gz 2024-02-17T12:20:43.559 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42059.log 2024-02-17T12:20:43.560 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45718.log 2024-02-17T12:20:43.562 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37559.log 2024-02-17T12:20:43.562 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42059.log.gz 2024-02-17T12:20:43.563 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45718.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45718.log.gz 2024-02-17T12:20:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37559.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37559.log.gz 2024-02-17T12:20:43.565 INFO:teuthology.orchestra.run.smithi116.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-17T12:20:43.565 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27511.log 2024-02-17T12:20:43.565 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33522.log 2024-02-17T12:20:43.567 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.27511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42667.log 2024-02-17T12:20:43.567 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27511.log.gz 2024-02-17T12:20:43.568 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33522.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33522.log.gz 2024-02-17T12:20:43.569 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.42667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42667.log.gz 2024-02-17T12:20:43.569 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40297.log 2024-02-17T12:20:43.570 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37847.log 2024-02-17T12:20:43.572 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45484.log 2024-02-17T12:20:43.572 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40297.log.gz 2024-02-17T12:20:43.573 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33509.log 2024-02-17T12:20:43.573 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37847.log.gz 2024-02-17T12:20:43.574 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45484.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45484.log.gz 2024-02-17T12:20:43.575 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34535.log 2024-02-17T12:20:43.575 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33509.log.gz 2024-02-17T12:20:43.575 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40671.log 2024-02-17T12:20:43.577 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45010.log 2024-02-17T12:20:43.577 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34535.log.gz 2024-02-17T12:20:43.580 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40671.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40671.log.gz 2024-02-17T12:20:43.580 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45010.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45010.log.gz 2024-02-17T12:20:43.581 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37113.log 2024-02-17T12:20:43.581 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33732.log 2024-02-17T12:20:43.583 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44880.log 2024-02-17T12:20:43.583 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37113.log.gz 2024-02-17T12:20:43.585 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39592.log 2024-02-17T12:20:43.585 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33732.log.gz 2024-02-17T12:20:43.585 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44880.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44880.log.gz 2024-02-17T12:20:43.585 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2024-02-17T12:20:43.586 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.39592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39592.log.gz 2024-02-17T12:20:43.586 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34224.log 2024-02-17T12:20:43.587 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38615.log 2024-02-17T12:20:43.588 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2024-02-17T12:20:43.589 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34224.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34224.log.gz 2024-02-17T12:20:43.590 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38615.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38615.log.gz 2024-02-17T12:20:43.590 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35005.log 2024-02-17T12:20:43.591 INFO:teuthology.orchestra.run.smithi116.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-17T12:20:43.591 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.37651.log 2024-02-17T12:20:43.593 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-02-17T12:20:43.593 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m0.414s 2024-02-17T12:20:43.593 INFO:teuthology.orchestra.run.smithi116.stderr:user 0m1.786s 2024-02-17T12:20:43.594 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m0.213s 2024-02-17T12:20:43.598 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34797.log 2024-02-17T12:20:43.598 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35005.log.gz 2024-02-17T12:20:43.598 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45062.log 2024-02-17T12:20:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.testuser.37651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.37651.log.gz 2024-02-17T12:20:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34797.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34797.log.gz 2024-02-17T12:20:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33722.log 2024-02-17T12:20:43.599 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45062.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45062.log.gz 2024-02-17T12:20:43.600 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35925.log 2024-02-17T12:20:43.600 INFO:teuthology.orchestra.run.smithi114.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-17T12:20:43.600 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33722.log: gzip -5 --verbose 88.1% -- -- replaced with /var/log/ceph/ceph-client.admin.33722.log.gz /var/log/ceph/ceph-client.admin.42439.log 2024-02-17T12:20:43.601 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-02-17T12:20:43.605 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36786.log 2024-02-17T12:20:43.605 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35925.log: /var/log/ceph/ceph-client.admin.42439.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35925.log.gz 2024-02-17T12:20:43.605 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-17T12:20:43.606 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42439.log.gz 2024-02-17T12:20:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41624.log 2024-02-17T12:20:43.606 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36786.log.gz 2024-02-17T12:20:43.606 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-02-17T12:20:43.607 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.41624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44387.log 2024-02-17T12:20:43.607 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41624.log.gz 2024-02-17T12:20:43.610 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35642.log 2024-02-17T12:20:43.611 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-17T12:20:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44387.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44387.log.gz 2024-02-17T12:20:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36760.log 2024-02-17T12:20:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35642.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35642.log.gz 2024-02-17T12:20:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42139.log 2024-02-17T12:20:43.616 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36760.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-17T12:20:43.616 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36760.log.gz 2024-02-17T12:20:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42139.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42139.log.gz 2024-02-17T12:20:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39122.log 2024-02-17T12:20:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35616.log 2024-02-17T12:20:43.617 INFO:teuthology.orchestra.run.smithi114.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-17T12:20:43.617 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34016.log 2024-02-17T12:20:43.619 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39122.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35668.log 2024-02-17T12:20:43.619 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39122.log.gz 2024-02-17T12:20:43.619 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35616.log: /var/log/ceph/ceph-client.admin.34016.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35616.log.gz 2024-02-17T12:20:43.619 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34016.log.gz 2024-02-17T12:20:43.620 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38258.log 2024-02-17T12:20:43.620 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42309.log 2024-02-17T12:20:43.620 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35668.log.gz 2024-02-17T12:20:43.621 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36082.log 2024-02-17T12:20:43.621 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38258.log.gz 2024-02-17T12:20:43.623 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42309.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42309.log.gz 2024-02-17T12:20:43.624 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36082.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36082.log.gz 2024-02-17T12:20:43.624 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38362.log 2024-02-17T12:20:43.625 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32873.log 2024-02-17T12:20:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-02-17T12:20:43.627 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38362.log.gz 2024-02-17T12:20:43.627 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.32873.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32873.log.gz 2024-02-17T12:20:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42686.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-02-17T12:20:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37899.log 2024-02-17T12:20:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43537.log 2024-02-17T12:20:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41057.log 2024-02-17T12:20:43.633 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37899.log.gz 2024-02-17T12:20:43.634 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43537.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43537.log.gz 2024-02-17T12:20:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41057.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41057.log.gz 2024-02-17T12:20:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37481.log 2024-02-17T12:20:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.37646.log 2024-02-17T12:20:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42111.log 2024-02-17T12:20:43.638 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37481.log.gz 2024-02-17T12:20:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.testuser.37646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.37646.log.gz 2024-02-17T12:20:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42111.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42111.log.gz 2024-02-17T12:20:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34613.log 2024-02-17T12:20:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43143.log 2024-02-17T12:20:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44627.log 2024-02-17T12:20:43.643 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34613.log.gz 2024-02-17T12:20:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43143.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43143.log.gz 2024-02-17T12:20:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39658.log 2024-02-17T12:20:43.646 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44627.log.gz 2024-02-17T12:20:43.646 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35720.log 2024-02-17T12:20:43.648 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39931.log 2024-02-17T12:20:43.648 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39658.log.gz 2024-02-17T12:20:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35720.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35720.log.gz 2024-02-17T12:20:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39931.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39931.log.gz 2024-02-17T12:20:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39587.log 2024-02-17T12:20:43.651 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39175.log 2024-02-17T12:20:43.653 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.39587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45432.log 2024-02-17T12:20:43.653 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39587.log.gz 2024-02-17T12:20:43.654 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41215.log 2024-02-17T12:20:43.654 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39175.log.gz 2024-02-17T12:20:43.655 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33912.log 2024-02-17T12:20:43.655 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45432.log.gz 2024-02-17T12:20:43.656 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41215.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41215.log.gz 2024-02-17T12:20:43.657 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35221.log 2024-02-17T12:20:43.658 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33912.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33912.log.gz 2024-02-17T12:20:43.659 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35221.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35221.log.gz 2024-02-17T12:20:43.659 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38107.log 2024-02-17T12:20:43.660 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39710.log 2024-02-17T12:20:43.662 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37087.log 2024-02-17T12:20:43.663 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38107.log.gz 2024-02-17T12:20:43.663 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39710.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39710.log.gz 2024-02-17T12:20:43.664 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37087.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37087.log.gz 2024-02-17T12:20:43.665 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39411.log 2024-02-17T12:20:43.666 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35252.log 2024-02-17T12:20:43.667 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42168.log 2024-02-17T12:20:43.668 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39411.log.gz 2024-02-17T12:20:43.668 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33523.log 2024-02-17T12:20:43.669 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35252.log.gz 2024-02-17T12:20:43.669 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37977.log 2024-02-17T12:20:43.669 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42168.log.gz 2024-02-17T12:20:43.671 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36003.log 2024-02-17T12:20:43.671 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33523.log.gz 2024-02-17T12:20:43.672 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44757.log 2024-02-17T12:20:43.672 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37977.log.gz 2024-02-17T12:20:43.673 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34693.log 2024-02-17T12:20:43.673 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36003.log.gz 2024-02-17T12:20:43.675 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40613.log 2024-02-17T12:20:43.675 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44757.log.gz 2024-02-17T12:20:43.675 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35816.log 2024-02-17T12:20:43.676 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34693.log.gz 2024-02-17T12:20:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40613.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40613.log.gz 2024-02-17T12:20:43.677 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37507.log 2024-02-17T12:20:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35816.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-02-17T12:20:43.678 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35816.log.gz 2024-02-17T12:20:43.678 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33516.log 2024-02-17T12:20:43.679 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36110.log 2024-02-17T12:20:43.679 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37507.log.gz 2024-02-17T12:20:43.680 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42985.log 2024-02-17T12:20:43.680 INFO:teuthology.orchestra.run.smithi114.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-02-17T12:20:43.680 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33516.log.gz 2024-02-17T12:20:43.681 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39632.log 2024-02-17T12:20:43.681 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36110.log.gz 2024-02-17T12:20:43.682 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37035.log 2024-02-17T12:20:43.682 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42985.log.gz 2024-02-17T12:20:43.683 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41747.log 2024-02-17T12:20:43.683 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39632.log.gz 2024-02-17T12:20:43.684 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34901.log 2024-02-17T12:20:43.684 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37035.log.gz 2024-02-17T12:20:43.685 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38029.log 2024-02-17T12:20:43.685 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41747.log.gz 2024-02-17T12:20:43.686 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44731.log 2024-02-17T12:20:43.686 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34901.log.gz 2024-02-17T12:20:43.687 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38161.log 2024-02-17T12:20:43.687 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38029.log.gz 2024-02-17T12:20:43.688 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.admin.44731.log: --verbose -- /var/log/ceph/ceph-client.admin.36866.log 2024-02-17T12:20:43.688 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44731.log.gz 2024-02-17T12:20:43.689 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45874.log 2024-02-17T12:20:43.689 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38161.log.gz 2024-02-17T12:20:43.690 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38388.log 2024-02-17T12:20:43.690 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36866.log.gz 2024-02-17T12:20:43.691 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35083.log 2024-02-17T12:20:43.691 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45874.log.gz 2024-02-17T12:20:43.692 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35868.log 2024-02-17T12:20:43.692 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38388.log.gz 2024-02-17T12:20:43.692 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36981.log 2024-02-17T12:20:43.693 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35083.log.gz 2024-02-17T12:20:43.693 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33102.log 2024-02-17T12:20:43.694 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35868.log.gz 2024-02-17T12:20:43.694 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38492.log 2024-02-17T12:20:43.694 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36981.log.gz 2024-02-17T12:20:43.695 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39816.log 2024-02-17T12:20:43.696 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33102.log.gz 2024-02-17T12:20:43.696 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41241.log 2024-02-17T12:20:43.696 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38492.log.gz 2024-02-17T12:20:43.697 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40063.log 2024-02-17T12:20:43.697 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39816.log.gz 2024-02-17T12:20:43.698 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36541.log 2024-02-17T12:20:43.699 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41241.log.gz 2024-02-17T12:20:43.699 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41695.log 2024-02-17T12:20:43.700 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40063.log.gz 2024-02-17T12:20:43.700 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40639.log 2024-02-17T12:20:43.701 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.36541.log.gz 2024-02-17T12:20:43.701 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32804.log 2024-02-17T12:20:43.701 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41695.log.gz 2024-02-17T12:20:43.702 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44120.log 2024-02-17T12:20:43.702 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40639.log.gz 2024-02-17T12:20:43.703 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.32804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42764.log 2024-02-17T12:20:43.703 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32804.log.gz 2024-02-17T12:20:43.704 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43984.log 2024-02-17T12:20:43.705 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2024-02-17T12:20:43.705 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40953.log 2024-02-17T12:20:43.706 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42764.log.gz 2024-02-17T12:20:43.706 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40979.log 2024-02-17T12:20:43.706 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43984.log.gz 2024-02-17T12:20:43.707 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33524.log 2024-02-17T12:20:43.707 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40953.log.gz 2024-02-17T12:20:43.708 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37165.log 2024-02-17T12:20:43.708 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40979.log.gz 2024-02-17T12:20:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41980.log 2024-02-17T12:20:43.709 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33524.log.gz 2024-02-17T12:20:43.709 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43169.log 2024-02-17T12:20:43.710 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37165.log.gz 2024-02-17T12:20:43.710 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41572.log 2024-02-17T12:20:43.711 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41980.log.gz 2024-02-17T12:20:43.712 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42672.log 2024-02-17T12:20:43.712 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43169.log.gz 2024-02-17T12:20:43.713 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44419.log 2024-02-17T12:20:43.713 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41572.log.gz 2024-02-17T12:20:43.714 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.42672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38518.log 2024-02-17T12:20:43.714 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42672.log.gz 2024-02-17T12:20:43.715 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38771.log 2024-02-17T12:20:43.715 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44419.log.gz 2024-02-17T12:20:43.715 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40745.log 2024-02-17T12:20:43.716 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38518.log.gz 2024-02-17T12:20:43.716 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41111.log 2024-02-17T12:20:43.716 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38771.log.gz 2024-02-17T12:20:43.717 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43221.log 2024-02-17T12:20:43.718 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40745.log.gz 2024-02-17T12:20:43.718 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38232.log 2024-02-17T12:20:43.718 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41111.log.gz 2024-02-17T12:20:43.719 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44906.log 2024-02-17T12:20:43.719 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43221.log.gz 2024-02-17T12:20:43.720 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44068.log 2024-02-17T12:20:43.720 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38232.log.gz 2024-02-17T12:20:43.721 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2024-02-17T12:20:43.721 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44906.log.gz 2024-02-17T12:20:43.721 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35951.log 2024-02-17T12:20:43.721 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44068.log.gz 2024-02-17T12:20:43.722 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34276.log 2024-02-17T12:20:43.722 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2024-02-17T12:20:43.724 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40219.log 2024-02-17T12:20:43.724 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35951.log.gz 2024-02-17T12:20:43.725 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41546.log 2024-02-17T12:20:43.725 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34276.log.gz 2024-02-17T12:20:43.726 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37717.log 2024-02-17T12:20:43.726 INFO:teuthology.orchestra.run.smithi114.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40219.log.gz 2024-02-17T12:20:43.726 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44172.log 2024-02-17T12:20:43.726 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41546.log.gz 2024-02-17T12:20:43.727 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44679.log 2024-02-17T12:20:43.727 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37717.log.gz 2024-02-17T12:20:43.729 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38900.log 2024-02-17T12:20:43.729 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44172.log.gz 2024-02-17T12:20:43.729 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40115.log 2024-02-17T12:20:43.729 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44679.log.gz 2024-02-17T12:20:43.730 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43619.log 2024-02-17T12:20:43.730 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38900.log.gz 2024-02-17T12:20:43.731 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34146.log 2024-02-17T12:20:43.731 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40115.log.gz 2024-02-17T12:20:43.732 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38641.log 2024-02-17T12:20:43.732 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43619.log.gz 2024-02-17T12:20:43.733 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44497.log 2024-02-17T12:20:43.733 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34146.log.gz 2024-02-17T12:20:43.734 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40167.log 2024-02-17T12:20:43.734 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38641.log.gz 2024-02-17T12:20:43.734 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35486.log 2024-02-17T12:20:43.735 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44497.log.gz 2024-02-17T12:20:43.735 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40167.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40167.log.gz 2024-02-17T12:20:43.735 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33076.log 2024-02-17T12:20:43.736 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-02-17T12:20:43.736 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35486.log.gz 2024-02-17T12:20:43.737 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43723.log 2024-02-17T12:20:43.737 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33076.log.gz 2024-02-17T12:20:43.738 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2024-02-17T12:20:43.738 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2024-02-17T12:20:43.739 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43247.log 2024-02-17T12:20:43.739 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43723.log.gz 2024-02-17T12:20:43.740 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33938.log 2024-02-17T12:20:43.740 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2024-02-17T12:20:43.741 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-02-17T12:20:43.741 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43247.log.gz 2024-02-17T12:20:43.742 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38544.log 2024-02-17T12:20:43.742 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33938.log.gz 2024-02-17T12:20:43.743 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43932.log 2024-02-17T12:20:43.744 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-02-17T12:20:43.744 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45406.log 2024-02-17T12:20:43.744 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38544.log.gz 2024-02-17T12:20:43.745 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33519.log 2024-02-17T12:20:43.745 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43932.log.gz 2024-02-17T12:20:43.746 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42738.log 2024-02-17T12:20:43.746 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45406.log.gz 2024-02-17T12:20:43.747 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.33519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34849.log 2024-02-17T12:20:43.747 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33519.log.gz 2024-02-17T12:20:43.748 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38135.log 2024-02-17T12:20:43.748 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42738.log.gz 2024-02-17T12:20:43.748 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38719.log 2024-02-17T12:20:43.749 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34849.log.gz 2024-02-17T12:20:43.750 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34745.log 2024-02-17T12:20:43.750 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38135.log.gz 2024-02-17T12:20:43.750 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38719.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38719.log.gz 2024-02-17T12:20:43.751 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34745.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34745.log.gz 2024-02-17T12:20:43.760 INFO:teuthology.orchestra.run.smithi114.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-17T12:20:43.786 INFO:teuthology.orchestra.run.smithi114.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-17T12:20:43.837 INFO:teuthology.orchestra.run.smithi114.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-17T12:20:43.839 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-02-17T12:20:43.839 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m0.700s 2024-02-17T12:20:43.839 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m2.668s 2024-02-17T12:20:43.839 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m0.948s 2024-02-17T12:20:43.840 INFO:tasks.ceph:Archiving logs... 2024-02-17T12:20:43.841 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143/remote/smithi114/log 2024-02-17T12:20:43.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-17T12:20:44.615 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143/remote/smithi116/log 2024-02-17T12:20:44.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-17T12:20:44.907 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-17T12:20:44.921 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-17T12:20:44.921 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-17T12:20:44.925 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-17T12:20:45.000 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-17T12:20:45.009 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-17T12:20:45.009 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T12:20:45.012 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T12:20:45.025 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2024-02-17T12:20:45.025 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2024-02-17T12:20:45.026 INFO:teuthology.orchestra.run.smithi114.stdout:*hv01.front.sepi 44.4.53.2 2 u 31 64 377 0.054 -2.835 1.983 2024-02-17T12:20:45.026 INFO:teuthology.orchestra.run.smithi114.stdout:+hv02.front.sepi 63.231.80.2 3 u 34 64 377 0.081 -2.180 2.859 2024-02-17T12:20:45.026 INFO:teuthology.orchestra.run.smithi114.stdout:+hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.072 +0.666 1.480 2024-02-17T12:20:45.026 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-17T12:20:45.028 INFO:teuthology.orchestra.run.smithi116.stdout: remote refid st t when poll reach delay offset jitter 2024-02-17T12:20:45.028 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================== 2024-02-17T12:20:45.029 INFO:teuthology.orchestra.run.smithi116.stdout:*hv01.front.sepi 44.4.53.2 2 u 25 64 377 0.061 -3.258 1.252 2024-02-17T12:20:45.029 INFO:teuthology.orchestra.run.smithi116.stdout:+hv02.front.sepi 63.231.80.2 3 u 29 64 377 0.067 +0.258 0.798 2024-02-17T12:20:45.029 INFO:teuthology.orchestra.run.smithi116.stdout:+hv03.front.sepi 74.6.168.72 3 u 30 64 377 0.096 -1.386 1.401 2024-02-17T12:20:45.029 INFO:teuthology.orchestra.run.smithi116.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-17T12:20:45.030 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-17T12:20:45.043 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-17T12:20:45.043 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-17T12:20:45.054 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-17T12:20:45.064 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-17T12:20:45.074 INFO:teuthology.task.internal:Duration was 953.860059 seconds 2024-02-17T12:20:45.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-17T12:20:45.084 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-17T12:20:45.084 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-17T12:20:45.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-17T12:20:45.174 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-17T12:20:45.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-02-17T12:20:45.175 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-17T12:20:45.195 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-02-17T12:20:45.195 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-17T12:20:45.217 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-17T12:20:45.217 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-17T12:20:45.243 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-17T12:20:45.298 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-17T12:20:45.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-17T12:20:45.328 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-17T12:20:45.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-17T12:20:45.422 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-17T12:20:45.423 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-17T12:20:45.443 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-17T12:20:45.463 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-17T12:20:45.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-17T12:20:45.487 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-17T12:20:45.502 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-02-17T12:20:45.521 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-02-17T12:20:45.539 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-17T12:20:45.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:20:45.572 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-17T12:20:45.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T12:20:45.593 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-17T12:20:45.604 INFO:teuthology.task.internal:Transferring archived files... 2024-02-17T12:20:45.605 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143/remote/smithi114 2024-02-17T12:20:45.605 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-17T12:20:45.640 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143/remote/smithi116 2024-02-17T12:20:45.641 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-17T12:20:45.667 INFO:teuthology.task.internal:Removing archive directory... 2024-02-17T12:20:45.668 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-17T12:20:45.680 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-17T12:20:45.714 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-17T12:20:45.725 INFO:teuthology.task.internal:Not uploading archives. 2024-02-17T12:20:45.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-17T12:20:45.736 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-17T12:20:45.737 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-17T12:20:45.740 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-17T12:20:45.745 INFO:teuthology.orchestra.run.smithi114.stdout: 658082 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:20 /home/ubuntu/cephtest 2024-02-17T12:20:45.765 INFO:teuthology.orchestra.run.smithi116.stdout: 658082 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:20 /home/ubuntu/cephtest 2024-02-17T12:20:45.767 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-17T12:20:45.779 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-17T12:20:45.804 INFO:teuthology.nuke:Checking targets against current locks 2024-02-17T12:20:45.838 DEBUG:teuthology.nuke:shortname: smithi114 2024-02-17T12:20:45.838 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T12:20:45.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 11:49:09.162999', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL6soZ/2M0BMyTZaG5SYv/KkFa4RALmBoVtHAPaRow79sRvEhfmgz33c2kcX1s88HA3Yq1ObhawzKCu2QI7LLUw='} 2024-02-17T12:20:45.867 DEBUG:teuthology.nuke:shortname: smithi116 2024-02-17T12:20:45.867 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T12:20:45.895 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 11:49:09.164943', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDktHTE9B9MTGoufF2t6x5vPChZAEQ/ahQGXp91POuQtL+bao8eCNm13wDkdquQussIFlKHfFzqTde3pGGysEQM='} 2024-02-17T12:20:45.931 INFO:teuthology.orchestra.console.smithi114:Power off 2024-02-17T12:20:45.932 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T12:20:45.960 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2024-02-17T12:20:45.960 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:20:45.984 INFO:teuthology.orchestra.console.smithi116:Power off 2024-02-17T12:20:45.984 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T12:20:46.001 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-02-17T12:20:46.010 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-02-17T12:20:46.010 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:20:46.035 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-02-17T12:20:50.004 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:20:50.036 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:20:50.116 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-02-17T12:20:50.148 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-02-17T12:20:54.119 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:20:54.149 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:20:54.232 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2024-02-17T12:20:54.265 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-02-17T12:20:54.365 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-02-17T12:20:58.234 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:20:58.345 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2024-02-17T12:20:58.446 INFO:teuthology.orchestra.console.smithi114:Power off completed 2024-02-17T12:20:58.940 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8d59ab0bd93c806231018a6729893bf309624262 client.1-kernel-sha1: 8d59ab0bd93c806231018a6729893bf309624262 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 953.8600587844849 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=eca273c69c4b4179b5d39c8c5420ef07 status: fail success: false 2024-02-17T12:20:58.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T12:20:59.030 INFO:teuthology.run:FAIL